Are the DNS servers on the router configured properly? If you know how to access the configuration, you might want to try any combination of these DNS servers:
8.8.8.8 (Google DNS)
4.4.4.4 (Unicast DNS)
208.67.222.222 (OpenDNS)
208.67.220.220 (OpenDNS)