I’m not sure I agree with the idea that the necessary level of compute will be made available to the average person. We are already well into a paradigm where the average “PC” is an iPad or similar, with Google locking down Android and Microsoft… being Microsoft, I just don’t have any optimism that the future will have the same kind of access to personal computing power or even software access. The “tin-foil hat” part of my brain says that the purchasing years worth of chips output is part of a conspiracy to keep consumers and potential competitors at bay more than it’s a requirement for new models.
I hope I am wrong, but I am not holding my breath.
And this tech is now being developed in China as well, so you might not have to rely on western hardware either going forward. Chinese companies are building stuff on top of RSIC-V like the Alibaba chip I linked above, and I fully expect there will be a lot of focus on Linux as China continues to decouple from the US tech stack.
I’m not sure I agree with the idea that the necessary level of compute will be made available to the average person. We are already well into a paradigm where the average “PC” is an iPad or similar, with Google locking down Android and Microsoft… being Microsoft, I just don’t have any optimism that the future will have the same kind of access to personal computing power or even software access. The “tin-foil hat” part of my brain says that the purchasing years worth of chips output is part of a conspiracy to keep consumers and potential competitors at bay more than it’s a requirement for new models.
I hope I am wrong, but I am not holding my breath.
There are already chips being developed specifically for running LLMs, so it’s almost certain this will become akin to having a GPU in the future.
And this tech is now being developed in China as well, so you might not have to rely on western hardware either going forward. Chinese companies are building stuff on top of RSIC-V like the Alibaba chip I linked above, and I fully expect there will be a lot of focus on Linux as China continues to decouple from the US tech stack.