

21·
24 days agodeleted by creator
deleted by creator
Yes, but 20 billion parameters is too much for most GPUs, regardless of quantization. You would need at least 14GB, and even that’s unlikely without offloading major parts to the CPU and system RAM (which kills the token rate).
Imagine Tylenol is found to cure a disease.
Tylenol is already approved, with known conditions under which it is safe and not safe.
Therefore, it is easier and safer to test a new use for Tylenol than starting from scratch testing a previously unknown drug.
Somewhat the opposite, but can it run Crysis?
Made in Abyss is pretty insane.