Have people started using #ChatGPT to guess passwords yet?
@danderzei A password is a prompt though?
@danderzei Yes, but the request to enter the password is the prompt to the LLM. You don't think an LLM trained on data about people will be able to make good guesses at passwords? The list of common passwords as well as common password "methods" (like birthdays etc) would be one part of the data, but also things like where people live and what they do for a living, etc.. I don't know, but seems pretty likely to me.
@johns without additional prompt information, it will be as good as a random user. LLM is a text predictor and thus only as good as the input. With "Please enter password" you pretty much get a random response. Perhaps guesses will be better if you enter the users biography.
@johns The password is a response to a prompt. You don't need a complex language model to guess one word. Hackers use lists of common passwords.