To connect remotely, you'll need SSH. Installation is trivially easy:
$ sudo apt-get install openssh-server