you could save all the files as .shtml or .php and then use a SSI (Server Side Include). Its an old outdated method, but for small sites it works.
Heres a link that explains how to use it. You will need to test on a server to see the results.
http://www.smartwebby.com/web_site_d...e_includes.asp