Nobody is really sure why Microsoft decided that explorer windows shouldn't have a title anymore, but that's the way things are. You can still look in the address bar to see what folder you are looking at, but there's another option. This option comes in the form of a small utility called AeroBar which does nothing else other than add titles to your Explorer windows based on the current folder. You can see the utility in action here: All you need to do is download and run the executable, and if you like the effect then add the utility to your startup group.
If you want to stop this application from running you will need to use Task Manager, find the Aerobar.exe process in the list, and then click on End Process.
Note: There's no reason to install every single utility we write about, just install the ones that fix your pet peeves.