Artificial Intelligence thread

lockedemosthenes1

New Member
Registered Member
Right, but also wrong. The real reason why LLMs will NEVER be AGI is because the weights are fixed, once the model is trained the model cannot change on its own neural nets. A human brain, like the one of a toddler has way less knowledge than any LLM but is flexible, malleable and is making new connections as the kid learn more, LLMs can´t do that, they have to rely on a fixed neural net to solve a problem. They know python because they saw a million python examples but as soon they face a new python library that was not in their training dataset, is over. an AGI could be able to take a few examples of the new python library and "learn" by adjusting the configuration of its own weights like a normal brain would do. You don´t need a giant context window, because no human that is not in the spectrum can memorize so much. Most human memorize snippets or resume of the things they learn.
NVIDIA TTT-E2E or Google Titans may have solved this concern? You may have a look at this(translation needed):
Please, Log in or Register to view URLs content!
 

tokenanalyst

Lieutenant General
Registered Member
Right, but also wrong. The real reason why LLMs will NEVER be AGI is because the weights are fixed, once the model is trained the model cannot change on its own neural nets. A human brain, like the one of a toddler has way less knowledge than any LLM but is flexible, malleable and is making new connections as the kid learn more, LLMs can´t do that, they have to rely on a fixed neural net to solve a problem. They know python because they saw a million python examples but as soon they face a new python library that was not in their training dataset, is over. an AGI could be able to take a few examples of the new python library and "learn" by adjusting the configuration of its own weights like a normal brain would do. You don´t need a giant context window, because no human that is not in the spectrum can memorize so much. Most human memorize snippets or resume of the things they learn.
1769091764215.png
Please, Log in or Register to view URLs content!
Please, Log in or Register to view URLs content!

At the moment these AI models can continuously adapt, learn and have flexible-malleable neural connections we could become obsolete as a intelligent species.
 

HighGround

Senior Member
Registered Member
Jukan is a solid account with a good track record.


But I also see Bloomberg reporting this, and their track record is very mixed. So we'll see. Seems clear the main impediment to Chinese AI labs getting the GPUs they want isn't the US but the CCP.
This was always the most likely outcome in my opinion.

Smaller labs can probably access Nvidia chips using a data center in Singapore or something. Im more surprised not to see Deepseek on the list, but that might be on purpose to avoid drawing more attention.

Either way, seems this saga is still on-going.
 

MortyandRick

Senior Member
Registered Member
Jukan is a solid account with a good track record.


But I also see Bloomberg reporting this, and their track record is very mixed. So we'll see. Seems clear the main impediment to Chinese AI labs getting the GPUs they want isn't the US but the CCP.
Disagree. The main impediment of Chinese AI labs getting the chips they want is the US limiting which chips they could buy. So don't put the onus in the CPC. If the US is willing to sell what China wants, the Chinese govt would be happy to let them buy
 

tphuang

General
Staff member
Super Moderator
VIP Professional
Registered Member
Jukan is a solid account with a good track record.


But I also see Bloomberg reporting this, and their track record is very mixed. So we'll see. Seems clear the main impediment to Chinese AI labs getting the GPUs they want isn't the US but the CCP.
he is a high school kid who just reports on what he reads on Western and Korean news. Something to think about before you treat his posts as gospel.

Again, they will probably buy H200s, but there seems to be just wild reporting right now.
 

Wrought

Captain
Registered Member
he is a high school kid who just reports on what he reads on Western and Korean news. Something to think about before you treat his posts as gospel.

Again, they will probably buy H200s, but there seems to be just wild reporting right now.

Better than what I was doing in highschool tbh.
 
Top