Create a file called ~/.ssh/config SSH will look for the user's ~/.ssh/config file. I have mine setup as: Host gitserv Hostname remote.server.com IdentityFile ~/.ssh/id_rsa.github IdentitiesOnly yes # see NOTES below Above can be used for both cloning/pushing git repository and logging