Similar to your experience, I’ve seen several large governments and organizations mishandle or mismanage user data by accident or on purpose many times with little or no recompense. If nobody can do it right they should either make it all publicly transparent for everyone or not store it at all.
Misinformation, not using accounts or accounts with incorrect information, multiple accounts, etc counter ops seem prudent at this point as the information system and monitoring apparatus of some of the most powerful governments and corporations in human history remains largely unchecked.
Privacy is an important right to protect and value because of the damage that can and will be done when groups hold personal information (financial, medical, behavior patterns, etc) and either sell it without explicit consent or leak it because they have no expectation of risk or loss if they don’t protect it.
Tl;Dr The oldest rules of the Internet are don’t believe everything you read and don’t dox yourself.
This assumes all of the data fed into the model is accurate and not including noise like misinformation