0

WHY THIS MATTERS IN BRIEF

AI already ingests information fast, but now it can detect changes in that information even faster.

 

Love the Exponential Future? Join our XPotential Community, future proof yourself with courses from XPotential University, read about exponential tech and trendsconnect, watch a keynote, or browse my blog.

Anthropic says it has vastly expanded the amount of information its Generative AI, Claude, is able to process. Claude has gone from having a limit of 9,000 tokens to 100,000 tokens, which corresponds to roughly 75,000 words. That’s a full novel. To put that into perspective, Claude now has the ability to easily read and finish Ernest Hemingway’s A Farewell to Arms (74,240 words), Mary Shelley’s Frankenstein (74,800 words) and Mark Twain’s The Adventures of Tom Sawyer (69,000 words). And, as The Verge notes, the company says Claude can read and analyze information from each book in under a minute.

 

RELATED
ChatGPT listed as an author on research papers and scientists disapprove

 

Generative AIs like Claude are still limited by the number of “tokens” they can process. As OpenAI explains in its help page, you can think of tokens as pieces of words. The AI cuts up words for processing, and they’re not always chopped up from the start to the end of each word, since spaces and other characters are also included. At the moment, OpenAI’s standard GPT-4 model is capable of processing 8,000 tokens, while an extended version can process 32,000 tokens. Meanwhile, its publicly available ChatGPT chatbot has a limit of around 4,000 tokens.

Now Claude has a much wider context window than all of them. According to Anthropic, it loaded Great Gatsby onto the AI during testing and modified a single line to say Mr. Carraway was “a software engineer that works on machine learning tooling at Anthropic.” Claude was able to spot how the book was modified within 22 seconds which is impressive.

 

RELATED
NIST scientists say they've created an "unhackable quantum machine"

 

The AI’s expanded context window is now available to Anthropic’s business partners who are using its API. Anthropic says the capability will help businesses quickly digest and summarise lengthy financial statements and research papers, assess pieces of legislation, identify risks and arguments across legal documents and comb through dense developer documentation, among other possible tasks.

About author

Matthew Griffin

Matthew Griffin, described as “The Adviser behind the Advisers” and a “Young Kurzweil,” is the founder and CEO of the World Futures Forum and the 311 Institute, a global Futures and Deep Futures consultancy working between the dates of 2020 to 2070, and is an award winning futurist, and author of “Codex of the Future” series. Regularly featured in the global media, including AP, BBC, Bloomberg, CNBC, Discovery, RT, Viacom, and WIRED, Matthew’s ability to identify, track, and explain the impacts of hundreds of revolutionary emerging technologies on global culture, industry and society, is unparalleled. Recognised for the past six years as one of the world’s foremost futurists, innovation and strategy experts Matthew is an international speaker who helps governments, investors, multi-nationals and regulators around the world envision, build and lead an inclusive, sustainable future. A rare talent Matthew’s recent work includes mentoring Lunar XPrize teams, re-envisioning global education and training with the G20, and helping the world’s largest organisations envision and ideate the future of their products and services, industries, and countries. Matthew's clients include three Prime Ministers and several governments, including the G7, Accenture, Aon, Bain & Co, BCG, Credit Suisse, Dell EMC, Dentons, Deloitte, E&Y, GEMS, Huawei, JPMorgan Chase, KPMG, Lego, McKinsey, PWC, Qualcomm, SAP, Samsung, Sopra Steria, T-Mobile, and many more.

Your email address will not be published. Required fields are marked *