9 Comments

    1. Yul_B_Alwright on

      Nothing burger. Everything is down. This will make RAM needed more, just like what happened with chips. The only real thing to consider is MU gets most of its helium from the US, while Samsung and SK get most of theirs from Qatar.

    2. The kv cache is maybe 50-60%% of memory in datacenters so a 6x improvement would realistically be more like a 2x overall memory efficiency improvement. Good but with the immense shortage and demand I’m honestly not sure it moves the needle that much. Plus implementation delays plus let’s see if the proposed efficiencies are actually as advertised.

    3. This literally won’t affect memory demand, it will just lead to faster scaling up. This is more on side of AI model efficiency improvement and less on memory tech improvement. It even says in the article: technologies designed to reduce memory consumption typically expand overall demand rather than diminish it

      Such a nothing burger, journalists these days just want to grasp at straws to make connections like that guy in the meme

    Leave A Reply
    Share via