@picofarad I forgot to do it, so I had to ask for it to be added in the follow up prompt. :)

@adam the "chat" one kinda only gives you what you ask for.

I'm hilariously annoyed that GPUs are never going to be cheap unless intel or some RISC-V company can pull a rabbit out of their hat.

I am semi-tempted to just spend the $5k and get a 40GB card so i can at least run the "slightly larger" models.

So annoyed. The crypto bust last year was supposed to signal the end of inflated GPU prices but magically LLaMa and Stable Diffusion came out within a couple - three months. Lucky for nvidia.