• rumba@lemmy.zip
    link
    fedilink
    English
    arrow-up
    7
    ·
    5 hours ago

    This has already started to happen. The new llama3.2 model is only 3.7GB and it WAAAAY faster than anything else. It can thow a wall of text at you in just a couple of seconds. You’re still not running it on $20 hardware, but you no longer need a 3090 to have something useful.