Okay, I think I understand your issue. All you need to know is the IP Address of that first router. Your second router will look to the first one to be the "gateway" and will issue DHCP addressing to the four machines.
Just make sure you enable all the security features on the second router becasue it is going to be exposed to the entire world without good security.