My Firefox memory usage is about 28Mb and stays in that region. That's higher than many other applications but it's not huge. Do you have any extensions that may be the cause of the problem?

Starman*