The key is to make sure you have redirected the Clipboard so that you can use it on the remote computer - verify settings:
In the Remote Desktop Connection dialog box, click Options, and then click the Local Resources tab. Under Local devices and resources, select the Clipboard check box, and then click Connect.