A great series of articles on IBM Developer Works about SSH Key management:

Part 1
Part 2
Part 3


and, to go with that, a page about keychain, a program to manage your SSH keys for you.