• arthurpizza@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    10 months ago

    Those server farms are because the needs of corporations might just be different from the needs of regular users.

    I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago.

    It’s almost as if technology can get better and more efficient over time.