Palo Alto, CA – Generative AI company SambaNova announced last week that DeepSeek-R1 671B is running today on SambaNova Cloud at 198 tokens per second (t/s), “achieving speeds and efficiency that no other platform can match,” the company said. DeepSeek-R1 has reduced AI training costs by 10X, but its widespread adoption has been hindered by […]

The post SambaNova Reports Fastest DeepSeek-R1 671B with High Efficiency appeared first on High-Performance Computing News Analysis | insideHPC.

PALO ALTO, CA — Sept. 10th, 2024 —  AI chips and models company SambaNova Systems announced SambaNova Cloud AI inference service powered by its SN40L AI chip. The company said developers can log on for free via an API today — no waiting list — and create their own generative AI applications using both the […]

The post SambaNova Launches AI Inference Cloud Platform appeared first on High-Performance Computing News Analysis | insideHPC.

A happy May morning to you! In the aftermath of ISC 2024 in Hamburg, we offer this quick (6:21) run-through of recent news from the world of HPC-AI, including ....

The post HPC News Bytes 20240520: Expanding Exascale Club; Nvidia ‘Paints It Green’ at ISC; Specialty AI Chip News; Student Cluster Competition appeared first on High-Performance Computing News Analysis | insideHPC.

The Argonne Leadership Computing Facility has announced a series of training workshops to introduce users to the novel AI accelerators deployed at the ALCF AI Testbed. The four individual workshops will introduce participants to the architecture and software of the SambaNova DataScale SN30, the Cerebras CS-2 system, the Graphcore Bow Pod system, and the GroqRack […]

The post ALCF Announces Online AI Testbed Training Workshops appeared first on High-Performance Computing News Analysis | insideHPC.

Feb. 28, 2024 — AI technology company SambaNova Systems said today its Samba-1 is the first 1 trillion (1T) parameter generative AI model. “This past fall, we announced the SN40L, the smartest AI chip (rivaling Nvidia), and today we’ve integrated that chip with the first 1T parameter model for the enterprise,” said Rodrigo Liang, co-founder […]

The post SambaNova Says It’s First with Trillion-Parameter GenAI Model appeared first on High-Performance Computing News Analysis | insideHPC.

We offer these predictions across a range of developments, trends and challenges facing the HPC-AI industry in 2024. Some take on the entrepreneurial spirit of business consultant Peter Drucker and his famous call-to-arms: "The best....

The post Predictions 2024: HPC-AI, Quantum, Storage and Data Management, Optical Computing, Containers, GenAI — Where It’s All Going appeared first on High-Performance Computing News Analysis | insideHPC.

January 10, 2024—Wilmington, MA and Palo Alto, CA — Semiconduct company Analog Devices, Inc. (Nasdaq: ADI) and AI platform developer SambaNova Systems announced that ADI is deploying SambaNova Suite for its global AI strategy, “making AI pervasive enterprise-wide,” ADI said. “ADI is synonymous with innovation, and we have a legacy of technology leadership in bridging […]

The post Analog Devices Deploys SambaNova for GenAI appeared first on High-Performance Computing News Analysis | insideHPC.

Specialty AI chip maker SambaNova Systems today announced the SN40L processor, which the company said will power SambaNova’s full stack large language model (LLM) platform, the SambaNova Suite. Manufactured by TSMC, the SN40L can serve a 5 trillion parameter model, with 256k+ sequence length possible on a single system node, according to the company.

The post SambaNova: New AI Chip Runs 5 Trillion Parameter Models appeared first on High-Performance Computing News Analysis | insideHPC.

April 28, 2023, Lemont, IL — The Argonne Leadership Computing Facility is accepting proposals to access the facility’s 22-petaFLOPS Graphcore Bow Pod64 at the ALCF AI Testbed. Access is open to the global research community via an approved proposal submission. The newest ALCF AI Testbed platform to be made available to researchers, the Graphcore Bow […]

The post ALCF AI Testbed’s Graphcore System Available to Researchers appeared first on High-Performance Computing News Analysis | insideHPC.

Proposals are now being accepted by the Argonne Leadership Computing Facility for access to its AI Testbed, a collection of advanced artificial intelligence accelerators available for science. Researchers interested in using the AI Testbed’s Cerebras CS-2 and SambaNova DataScale systems can submit project proposals via the ALCF’s Director’s Discretionary program. Access to additional testbed resources, including Graphcore, Groq, and Habana accelerators, will be […]

The post Proposals Open to Research Community for ALCF AI Testbed’s Cerebras and SambaNova Systems appeared first on High-Performance Computing News Analysis | insideHPC.