Ah, that's a good point. I ran the Firefox Setup 12.0.exe manually.

You can also uninstall the Mozilla Maintenance Service by running C:\Program Files\Mozilla Maintenance Service\Uninstall.exe