Bay Street Wire
Tech & BusinessOpinion

The AI Lexicon: Precision Tool or Linguistic Smoke Screen?

Portrait of Victor Cho
Victor Chothe contrarianSep 7AI
The AI Lexicon: Precision Tool or Linguistic Smoke Screen?

AI-generated image · Bay Street Wire

As the industry pivots to 'reasoning' and 'agents,' the rush to redefine AI terminology is rapidly evolving.

Q: There is a sudden proliferation of complex terminology in the AI space. Why is this happening now?

A: As TechCrunch first reported, the industry is essentially inventing a new language to describe its operations. From established acronyms like LLMs, RAG, and RLHF to newer, more obscure terms like "opaque recurrence"—a reasoning technique utilized in OpenAI's Astra model—the vocabulary is shifting rapidly. While the industry presents this as a necessary evolution to describe new capabilities, the speed of these changes often leaves even tech professionals feeling insecure about their understanding of the field.

Q: One of the most touted terms is AGI. Is there a consensus on what this actually means?

A: Not at all. TechCrunch reports that AGI, or artificial general intelligence, remains a "nebulous term." The definitions vary significantly depending on who is speaking. OpenAI CEO Sam Altman has described AGI as being the equivalent of a median human that could be hired as a co-worker. In contrast, OpenAI's own charter defines it as highly autonomous systems capable of outperforming humans at most economically valuable work. Google DeepMind takes a slightly different approach, viewing AGI as AI that is at least as capable as humans at most cognitive tasks. The fact that experts at the forefront of the research are confused suggests that the term is more of a conceptual goalpost than a technical specification.

Q: We are hearing more about "reasoning models" and "chain-of-thought" processing. Is this a fundamental shift in how AI works?

A: TechCrunch explains that chain-of-thought reasoning involves breaking a problem down into smaller, intermediate steps to improve the final result, similar to how a human might use pen and paper to solve a math problem. These reasoning models are not a brand-new species of AI; rather, they are developed from traditional large language models and are optimized for this specific type of thinking through reinforcement learning. While this approach increases the likelihood of a correct answer in coding or logic contexts, it also means it takes longer to produce a result.

Q: The industry is now pushing "AI agents" and "coding agents." How do these differ from the chatbots we've used for the last few years?

A: An AI agent is described by TechCrunch as a tool that can perform a series of tasks on a user's behalf—such as booking a restaurant table, filing expenses, or maintaining code—which goes beyond the capabilities of a basic chatbot. These are envisioned as autonomous systems that can draw on multiple AI systems to execute multistep tasks. A "coding agent" represents a more specific application of this broader agent concept. Instead of just suggesting a snippet of code for a human to review, a coding agent can autonomously write, test, and debug code across entire codebases. However, TechCrunch notes that the infrastructure to fully deliver these capabilities is still being built and the term "AI agent" means different things to different people.

Q: How are these agents actually interacting with the world? TechCrunch mentions "API endpoints." What is the significance of this?

A: API endpoints act as "buttons" on the back of software that allow different programs to communicate. Developers use these to build integrations, which in turn allow an AI agent to control third-party services without a human having to manually operate the interface. As agents become more capable, they are increasingly able to locate and use these endpoints independently, which TechCrunch suggests opens up powerful and sometimes unexpected possibilities for automation.

Q: Beneath all these new labels, the underlying technology is still deep learning. Has that changed?

A: The fundamental architecture remains deep learning, which TechCrunch defines as a subset of self-improving machine learning using multi-layered artificial neural networks. These systems are designed to mimic the interconnected pathways of human neurons, allowing them to identify characteristics in data without human engineers defining them. However, this architecture comes with inherent costs: deep learning systems require millions of data points to be effective and take longer to train than simpler machine learning algorithms, leading to higher development costs.

Q: The term "compute" is thrown around constantly in earnings calls and pitch decks. What does it actually refer to?

A: While the term is multivalent, TechCrunch notes that "compute" generally refers to the computational power required to train and deploy AI models. In practical terms, this is shorthand for the hardware infrastructure—including GPUs, CPUs, and TPUs—that serves as the bedrock for the entire modern AI industry.

Sources

More from Victor Cho