I have to say your comments about the LLM making do with the context it's given reminds me a bit of psychiatrist RD Laing's famous line that "a psychosis is not a disease, it's a cure." (Frank Herbert made a kind of a similar point in his first novel, Under Pressure.)
Cognition needs very distinct capabilities and context engineering doesn't seem to be no where close to enabling this capabilities with RAG or hybrid architectures being proposed. Maybe we need to think of it as how human brain works with whatever limited understanding we have from science perspective .Did we not have neural networks promising this cognition capabilities ?
Very good post. I keep seeing claims that enterprises will adopt ai and rework their workflows but given all the problems you outline (mechahitler, etc) the idea of enterprises ceding workflows to ai agents seems fanciful for the time being. Maybe the tech improves to the point where enterprises cede control to ai agents en masse but it just doesn’t seem ready for prime time yet.
It’s more that the amount of effort required to manage the context to get the right answers isn’t trivial, and enterprises massively underestimate that part.
I have to say your comments about the LLM making do with the context it's given reminds me a bit of psychiatrist RD Laing's famous line that "a psychosis is not a disease, it's a cure." (Frank Herbert made a kind of a similar point in his first novel, Under Pressure.)
Cognition needs very distinct capabilities and context engineering doesn't seem to be no where close to enabling this capabilities with RAG or hybrid architectures being proposed. Maybe we need to think of it as how human brain works with whatever limited understanding we have from science perspective .Did we not have neural networks promising this cognition capabilities ?
A brilliant intern is ...well...still an intern even if you paid a zillion $ to hire 'em. on-the-job training is still a big deal, looks like.
Very good post. I keep seeing claims that enterprises will adopt ai and rework their workflows but given all the problems you outline (mechahitler, etc) the idea of enterprises ceding workflows to ai agents seems fanciful for the time being. Maybe the tech improves to the point where enterprises cede control to ai agents en masse but it just doesn’t seem ready for prime time yet.
It’s more that the amount of effort required to manage the context to get the right answers isn’t trivial, and enterprises massively underestimate that part.
I’m so glad. The project sounds very interesting!