I want to ssh to a remote machine with a
rsa key. In linux, it is simple:
ssh -i file.rsa firstname.lastname@example.org
But how can I do that in windows using
You can change your key settings in putty. Look for the Connection->SSH->Auth menu on the left side of the window.