See if you can get the manual for the modem.

If you have one item connected #1 and it is working, then start the second pc which is hooked to #2 they both should hit the internet with no problems.

But it seems there is a setting in the router part that is wrong, or the modem itself is in need of replacing. Had that happen a time or two.