My ISP is very small and self-employed. He rents access to the fiber network from a big company who use it for cell towers. Therefore he doesn't own dedicated IPs and uses NAT and charges $10 a month for a dedicated IP. I have two PCs and would like them to be able to connect remotely but while they can both join rooms and see each other in these rooms when they go to connect to each other they time out.

Two NAT users can't connect because neither has an open port.
One of the users has to have an open port.

while $10 for a dedicated IP is insanely cheap for someone running a server; its not practical for home use.

is it possible for the owner of this ISP to forward a port for you? this would allow you to use the internet facing IP address and (theoretically) gain proper functionality.