A happy mid-winter day to you! The HPC-AI world produced its usual extraordinary onslaught of news this past week, here’s ...

The post HPC News Bytes 20250217: Arm Selling Its Own Chips to Meta?, Big xAI, Big Power, Big… Pollution?, TSMC in Intel Fab Takeover?, Europe’s Big AI Investment, Exascale in Industry appeared first on High-Performance Computing News Analysis | insideHPC.

Good post-Super Bowl morning to you! The past week was somewhat calm relative to the riotous preceding period in the world of HPC-AI, but still, important developments emerged. Here’s a fast (5:52) overview ....

The post HPC News Bytes 20250210: Big AI CAPEX Binge, More Data Center SMRs, Euro-Origin Quantum, Softbank Eyes Ampere appeared first on High-Performance Computing News Analysis | insideHPC.

Dec. 13, 2024 — AI company Lambda today announced its Inference API, which the company said enables access to LLMs through a serverless AI for “a fraction of a cent.” The company said Lambda Inference API offers low-cost, scalable AI inference with such models as Meta’s recently released Llama 3.3 70B Instruct (FP8) at $0.20 […]

The post Lambda Launches Inference API appeared first on High-Performance Computing News Analysis | insideHPC.

In this “Industry View” episode of the @HPCpodcast, special guest Ryan Smith joins Shahin and Doug to discuss the vexing challenges of implementing HPC-class AI systems in a managed services model. We examine ....

The post @HPCpodcast Industry View: Penguin Solutions on Big HPC-AI Deployment Challenges and How to Overcome Them appeared first on High-Performance Computing News Analysis | insideHPC.

Delft, 20th November 2024: In a bid to accelerate the transition to clean energy in the fight against climate change, VSParticle (VSP) – a Dutch nanotechnology engineering company – today announced the first results from a collaboration with Meta’s Fundamental AI Research (FAIR) team, and the University of Toronto (UofT). The collaboration brings together VSP’s […]

The post Meta FAIR and VSParticle Launch Catalyst Database Designed to Accelerate Clean Energy Transition appeared first on High-Performance Computing News Analysis | insideHPC.

[SPONSORED GUEST ARTICLE]   These are the times that try the souls of IT staffs tasked with deploying AI at scale... Effectively implementing AI at scale involves a whole host of design, build, deployment, and management considerations. It requires ....

The post Penguin Solutions’ Big Cluster Expertise Extends to Powerhouse Services for Big AI Deployments appeared first on High-Performance Computing News Analysis | insideHPC.

AI compute company Cerebras Systems today announced what it said is the fastest AI inference solution. Cerebras Inference delivers 1,800 tokens per second for Llama3.1 8B and 450 tokens per second for Llama3.1 70B, according to the company, making it 20 times faster than GPU-based solutions in hyperscale clouds.

The post Cerebras Claims Fastest AI Inference appeared first on High-Performance Computing News Analysis | insideHPC.

AUSTIN, Texas, Aug. 20, 2024 — Today, the Open Compute Project Foundation (OCP) announces a collaboration to test development and deployment of low-embodied carbon concrete or “green concrete.” While numerous emerging technologies exist to achieve production of low carbon concrete, adoption has not yet scaled. This proactive and collaborative demonstration project is an important step towards […]

The post Open Compute Project Foundation and Hyperscalers to Trial Low-Carbon ‘Green Concrete’ appeared first on High-Performance Computing News Analysis | insideHPC.

Nvidia today announced its AI Foundry service and NIM inference microservices for generative AI with Meta's Llama 3.1 collection of models, also introduced today. The company said its AI Foundry allows organizaations to create custom “supermodels” for their ....

The post Nvidia AI Foundry for Custom Llama 3.1 Generative AI Models appeared first on High-Performance Computing News Analysis | insideHPC.

BEAVERTON, Ore.– AMD, Broadcom, Cisco, Google, Hewlett Packard Enterprise (HPE), Intel, Meta and Microsoft today announced they have aligned to develop a new industry standard dedicated to advancing high-speed and low latency communication for scale-up AI systems linking in data centers. Called the Ultra Accelerator Link (UALink), this initial group will define and establish an […]

The post Ultra Accelerator Link Group for Data Center AI Connectivity Formed: AMD, Broadcom, Cisco, Google, HPE, Intel, Meta and Microsoft appeared first on High-Performance Computing News Analysis | insideHPC.