The whole point is to let the owner of the private key without password. The rest login by entering the password.