Intel recently announced its new 5th Gen Xeon processors, which feature AI acceleration in every core. These cutting-edge processors are set to hit the market in 2024.
At the AI Everywhere event, Intel CEO Pat Gelsinger revealed the new processors, codenamed Emerald Rapids. Designed for artificial intelligence, high-performance computing, networking, storage, databases, and security, these processors aim to enhance performance while reducing total ownership costs.
Sandra Rivera, Intel’s executive vice president and general manager of the Data Center and AI Group, highlighted the processors’ impact. She noted that the 5th Gen Intel Xeon processors offer superior performance for customers deploying AI across various applications, including cloud, network, and edge use cases. Built on a reliable foundation, these processors ensure quick adoption and scalability at lower costs.
Key Features of the 5th Gen Xeon Processors:
AI Acceleration in Every Core: Optimized for AI workloads, these processors provide up to 42% higher inference performance with minimal latency on large language models. They support end-to-end AI processing without needing additional accelerators, enhancing efficiency.
Performance and Efficiency Gains: Compared to their predecessors, these processors deliver an average performance boost of 21% for general computing tasks and a 36% increase in performance per watt across various workloads, significantly improving efficiency.
Enhanced Capabilities: Featuring up to 64 cores per CPU, increased last-level cache, eight channels of DDR5, and higher memory transfer speeds, these processors offer enhanced performance and bandwidth. They are also compatible with CXL Type 3 workflows through leading cloud service providers.
Security Enhancements: With the inclusion of Intel Trust Domain Extensions (Intel TDX), these processors provide improved confidentiality and security at the VM level, ensuring better privacy and data control.
The Road Ahead:
The 5th Gen Xeon processors are compatible with previous-generation systems and will be available in single- and dual-socket systems from major OEMs like Cisco, Dell, HPE, and Lenovo by early 2024. Cloud service providers will roll out instances based on these processors throughout the year.
Additionally, Intel plans to stick to its roadmap by introducing Sierra Forest, focusing on efficient E-core performance with up to 288 cores, in the first half of 2024. This will be followed by Granite Rapids, which will emphasize high P-core performance.