Is this other PC on the LAN? If yes then you should use the IP address instead of the domain name. Or have the domain name in your hosts file.
If it is in the same LAN you can always enable Remote Desktop.
While WHS works as a virtual machines, having to create virtual HDs to add to the machine makes the whole "easy to use and maintain" idea a lot harder. This is more of an OS for a real PC - no need for keyboard and monitor, but still a server.