• 23 Posts
  • 94 Comments
Joined 3 years ago
cake
Cake day: July 2nd, 2023

help-circle
  • And right now China is trying to catch up with that technology. They might be lagging today, but they are a huge market, and they will eventually catch up, maybe not completely but enough to be competitive.

    Plus their LLMs need a lot less hardware resources for inferences.

    Don’t forget that all US frontier models are operating at a huge loss, because if they need to charge market rates their market will shrink significantly.

    So this GPU crunch is forcing Chinese labs to innovate and find clever ways to achieve higher intelligence with constrained resources.

    And cloud and computing cost will only go up now, due to exploding hardware prices, which will make the whole business model of the US frontier models even more unprofitable.











  • filister@lemmy.worldOPtoLinux@lemmy.ml•Systemd-sysext Help Needed
    link
    fedilink
    arrow-up
    1
    arrow-down
    1
    ·
    8 months ago

    That’s a great question. I like the concept of more stable OS and I played a bit with NixOS in the past but ultimately decided that it is too much of a hassle to learn Nix to use it and decided to try Bluefin. I am actually overall content as I was able to install the missing packages either in Toolbox/Distrobox or using homebrew.

    By the way I have actually found a way, and rebased my OS to another immutable flavor. I know that’s more of a workaround.