In the latest 8.1 Update you can now close your apps with the X that appears if you hover your mouse near where the title bar would be on a traditional app, but in 2012r2 server it doesn't seem this is possible or at least not via RDP.
Is there somewhere you need to enable this ?
