Too many authentication failures on SSH

It seems like having several SSH keys on the same system starts giving issues with some SSH servers. The issue is that while connecting it returns:

Too many authentication failures for xxxxxx.

The fix for this is very simple and quick. Open up your ~/.ssh/config and put:

IdentitiesOnly yes

You can add that per-host or wide (without indents, even as the first line in the config file!).

Any comment goes best to my twitter here.