SSH into ESX 6.7 does NOT work

I installed ESX 6.7u3 image of OVH. Using my ed25516 SSH key to SSH into the ESX however it still asks for the password. I know that there is nothing wrong with my SSH key since I can use the same key to SSH into the IPMI.

Any help appreciated.