Samsung readies its new line of AI accelerator chips to rival Nvidia in the future

0 12

By Matthew Griffin Computing 2nd April 2024

WHY THIS MATTERS IN BRIEF

With a $2 Trillion valuation Nvidia has proven there’s a huge market for GPU’s and now everyone else wants a piece of the market.

Love the Exponential Future? Join our XPotential Community, future proof yourself with courses from XPotential University, read about exponential tech and trends, connect, watch a keynote, or browse my blog.

As we see Nvidia smash through multi-trillion dollar valuations as the demand for GPU chips to help train today’s most powerful Artificial Intelligences (AI) becomes white hot Samsung Electronics is gearing up to launch its own AI accelerator chip — the Mach-1 — in early 2025, the company announced at its 55th annual shareholders meeting, reports Sedaily. The move will mean competing against companies like Nvidia, but the South Korean company has no plans, at least for now, to rival Nvidia’s ultra-high-end AI solutions, such as the H100, B100, or B200.

Windows are the perfect lens-less cameras for AI and VR headsets

Samsung’s Mach-1 is an AI inference accelerator based on an Application Specific Integrated Circuit (ASIC) and equipped with LPDDR memory, which makes it particularly suitable for edge computing applications. The report claims that Samsung’s Mach-1 has a unique feature that will dramatically reduce memory bandwidth requirements for inference to about 0.125x when compared to existing designs — but does not elaborate on how it will do this, so take this claim with a grain of salt.

The Future of Computing, by Futurist Matthew Griffin

Kye Hyun Kyung, the head of Samsung Electronics Device Solutions Division, overseeing global operations of the Memory, System LSI, and Foundry business units, said that the chip design had passed technological validation on Field-Programmable Gate Arrays (FPGAs) and that the physical finalization of the System-on-Chip (SoC) is currently underway. Kyung assured that the chip would be ready by the end of the year, allowing for the launch of an AI system powered by the Mach-1 chip early next year.

Samsung’s Mach-1 is not designed to compete against high-performance AI processors such as the AWS Trainium or the Nvidia H100, but it will certainly compete against other inference-oriented solutions, including AWS Inferentia. It is highly likely that Samsung will position its Mach-1 primarily for edge applications that require low power consumption, minimal dimensions, and low costs, which is where it can probably excel.

Microsoft created elusive particles to build the world's most accurate quantum computer

Samsung is not only focused on developing the Mach-1 chip but is also actively involved in broader AI semiconductor development efforts, according to Kye Hyun Kyung. The company has established a lab in Silicon Valley dedicated to Artificial General Intelligence (AGI) research, signalling its commitment to becoming a key player in the future of AI technology. The lab’s mission is to create new types of processors and memory that meet processing requirements of future AGI systems.

Matthew Griffin / About Author

Matthew Griffin, described as “The Adviser behind the Advisers” and a “Young Kurzweil,” is the founder and CEO of the World Futures Forum and the 311 Institute, a global Futures and Deep Futures consultancy working across the next 50 years, and is an award winning futurist, and author of “Codex of the Future” series.

Regularly featured in the global media, including AP, BBC, Bloomberg, CNBC, Discovery, RT, Viacom, and WIRED, Matthew’s ability to identify, track, and explain the impacts of hundreds of revolutionary emerging technologies on global culture, industry and society, is unparalleled. Recognised for the past six years as one of the world’s foremost futurists, innovation and strategy experts Matthew is an international speaker who helps governments, investors, multi-nationals and regulators around the world envision, build and lead an inclusive, sustainable future.

A rare talent Matthew’s recent work includes mentoring Lunar XPrize teams, re-envisioning global education and training with the G20, and helping the world’s largest organisations envision and ideate the future of their products and services, industries, and countries.

Matthew's clients include three Prime Ministers and several governments, including the G7, Accenture, Aon, Bain & Co, BCG, Credit Suisse, Dell EMC, Dentons, Deloitte, E&Y, GEMS, Huawei, JPMorgan Chase, KPMG, Lego, McKinsey, PWC, Qualcomm, SAP, Samsung, Sopra Steria, T-Mobile, and many more.