93482: Leveraging Open-Source AI for Mission-Critical Workloads with AI Toolkit for IBM Z and LinuxONE
Project and Program:
New and Innovative Technologies,
Machine Learning/AI,
Open Source Linux
Tags:
Proceedings,
SHARE DC 2025,
2025
AI Toolkit for IBM Z and IBM LinuxONE is a family of popular open-source AI
frameworks and model servers with IBM Elite support. This offering is designed
to enable enterprises to leverage these frameworks in production with
confidence. AI Toolkit for IBM Z and LinuxONE includes highly optimized runtimes
and serving environments that can leverage all the software and hardware
capabilities provided within the IBM Z platform. The AI Toolkit for IBM Z and
LinuxONE is also optimized to leverage the IBM Z on-chip Integrated Accelerator
for AI. In this session, we will present our vision for leveraging AI
open-source frameworks and serving solutions and best practices for real-time AI
use cases. We will demonstrate how an AI model developed with a popular AI
open-source framework leverages data that resides off the IBM Z platform. Using
IBM z Container Extensions(zCX), this model is deployed on z/OS close to where
the end sample application resides. This setup closely replicates what our
customer has and demonstrates how they achieved high throughput and low latency
by inferencing the AI model on the IBM Z platform. We will also provide some
best practices and practical guidance on how to best leverage the AI Toolkit.
Back to Proceedings File Library