Troubleshooting ssh key-pair authentication

So that "future me" never forgets to do this first when a newly configured ssh key-pair authentication does not work and I keep getting asked for a password ... use the -v option in the ssh command to get a verbose output and see exactly at what point the authentication is failing. Really this can solve the problem in two minutes flat.

ssh -v user@remotehost