I held similar apprehensions. Google already knows too much about me. Giving Google control over a physical (as opposed to digital) records of me approaches a limit of personal privacy.
It would be an disturbingly easy sell too, especially if people could toggle off the password requirement. Before you know it, ISPs will require them.