If you're looking for a basic page editor you have different choices like Amaya or KompoZer which is also available as a portable app from portableapps.com. I tried KompoZer a while back and I was probably being way too choosy about how my html was structured and ended up fighting with it, but if you're not as anal-retentive as I am about how pristine the underlying code is, it will make you a good website and guide you through your choices then generate the code needed to achieve what you want.
I myself actually ditched KompoZer in favor of learning to write the code in a text editor, but you're probably not looking to become a full-time web designer like I have been working at becoming. So go for it dude, one of those would probably fit your needs, there are others, but I am not familiar with them, just google WYSIWYG Web authoring freeware.
And if you really want to dive headlong into the deep end of the pool, you could install an xaamp server and Wordpress on your computer and develop a site locally before putting it up on a public web server. And a Wordpress site would definitely be different than a website created in Publisher.
All open source and free software.