Finally took time to learn rsync. Great stuff. Can copy gigs and gigs of files real fast. Learned it from http://www.physics.queensu.ca/Computing/Docs/HOWTOs/rsync/. Basically all I needed to do was:
rsync -av -e ssh username@host:/source/directory/ destination/directory
Or if you need to ssh over a different port you would do something like this:
rsync -av -e "ssh -p 443" username@host:/source/directory destination/directory
-a for archive. -v for verbose. -e to specify to use ssh.