Second computer won't hook

Hay guys and gals it's been a long time

Well, here goes.

Finally got a dsl connection and am spoiled in just a couple of days. It's a 2Wire DSl modem. Hooked in first computer-no problem. Hooked in second computer and it keeps saying it is not connected. The second computer is running w2k pro just like mine.They both are running realtek nics. Both show up as the lights are on for both computers on the router. The router is a Linksys Network Everywhere NR041 four port router. The second computer hooks the web if connected directly to the dsl modem but not if it is connected through the router. The first machine works no matter what. I have checked config on second machine and it seems to look ok, I haven't found anything out of whack so far.
Second machine is:

Gateway C500
500mhz celeron
256 mb ram
Windows 2k

Throw me some bones here folks. I would really like to figure out why this second machine won't pick up and connect.

Thanks ahead of time

Hi Jsave

Sounds like a router problem. Is DHCP allocating an IP address to the second computer. Is the MAC address of the second computer showing up in the DHCP allocations in the router. What does the Routing table look like? BF