0
0
Intel Introduces Breakthrough AI Hardware
Intel recently showcased its latest AI hardware at the Intel Vision 2024 conference in Phoenix, unveiling the Gaudi 3 AI accelerator. This new technology surpasses its predecessor, the Gaudi 2 AI accelerator, with enhanced AI computing power, networking bandwidth, and memory bandwidth. The prime focus of the Gaudi 3 accelerator is to upscale AI training and inference for large language models (LLMs) such as ChatGPT, which are fundamental for AI chatbots.
Optimized Parallel AI Operations
One of the key features of the Gaudi 3 AI accelerator is its ability to significantly enhance the speed and efficiency of parallel AI operations. Intel claims that this hardware can support multiple data types and is projected to be 50% faster in training top LLMs compared to Nvidia’s H100 chip. Additionally, it offers 30% faster inferencing for top LLMs than Nvidia’s H200 chip, showcasing its superior performance in handling AI operations.
AI Expansion and Efficiency
Intel emphasizes the importance of incorporating AI across various sectors and aims to make AI technology accessible and efficient. With improved memory capacity, the Gaudi 3 accelerator reduces the number of units required to process datasets from larger AI models, thereby enhancing cost efficiency for data centers. This advancement aligns with Intel’s goal of bolstering AI capabilities in the enterprise space.
Promising Industry Growth
Intel’s commitment to fostering innovation in the AI market is evident in its collaborations with prominent companies like Bosch, LandingAI, and Seekr, who have already signed up as customers for the Gaudi 3 accelerator. The expansion of AI hardware offerings by Intel addresses the demand for diversity and choice in the industry, especially in light of the scarcity of Nvidia chips.
Moreover, Intel’s strategic plans for chip manufacturing expansion in the U.S., including securing substantial government funding and setting up a new AI chip manufacturing site, underline its ambition to solidify its position as a leading AI systems foundry globally by the end of the decade. The company’s vision to provide flexible solutions tailored to evolving customer needs reflects its dedication to capitalizing on future opportunities in the AI landscape.
Image/Photo credit: source url
