Try this 1st.

http://en.wikipedia.org/wiki/Server_Side_Includes

If you can't get that to work, use PHP include. Odds are your host supports PHP. Most do.