Also, make sure that the modem is not sharing its IRQ with another device.