When using CVS-over-SSH, set the CVSROOT environment variable as follows:
:ext:username@remotemachine:/full/path/to/cvsroot
You may wish to use SSH public key authentication and ssh-agent to avoid having to enter your password on the remote machine repeatedly.