In a move set to redefine enterprise AI, Red Hat has unveiled RHEL AI (Red Hat Enterprise Linux AI) and InstructLab, aimed toward democratizing access to AI technologies and empowering domain experts to reinforce language models with their knowledge. These initiatives were announced on the Red Hat Summit 2024 in Denver, Colorado, signaling a big shift towards open collaboration and community-driven innovation in the sphere of AI.
RHEL AI: Simplifying AI Development
RHEL AI serves as a foundation model platform, allowing developers to seamlessly develop, test, and run best-of-breed open source Granite generative AI models to power enterprise applications. Based on the InstructLab open source project, RHEL AI combines open source-licensed Granite models from IBM Research with model alignment tools, creating an optimized RHEL image for simplified server deployments.
Empowering Domain Experts with InstructLab
The core objective of InstructLab and RHEL AI is to empower domain experts to contribute on to Large Language Models (LLMs) with their knowledge and skills. InstructLab provides a user-friendly set of software tools and workflows targeted at domain experts without data science experience, enabling them to coach and fine-tune AI models efficiently. By leveraging open source models and skills, InstructLab democratizes access to AI development and customization.
Components of RHEL AI:
- Open Granite Models: RHEL AI includes highly performant, open source-licensed Granite language and code models from the InstructLab community, providing transparent access to data sources and model weights. Developers can customize these models with their skills and knowledge, contributing to the community-driven evolution of AI.
- InstructLab Model Alignment: InstructLab implements the LAB (Large-scale Alignment for ChatBots) technique, allowing users to customize LLMs with domain-specific knowledge and skills. This novel approach generates high-quality synthetic training data, enabling continuous model improvement through community contributions.
- Optimized Bootable RHEL Image: RHEL AI is deployed on a bootable RHEL image with an optimized software stack for popular hardware accelerators. It offers support for AI-optimized servers from various vendors, facilitating seamless integration into existing infrastructure.
- Enterprise Support and Indemnification: At general availability, RHEL AI Subscriptions will include enterprise support, complete product lifecycle management, and IP indemnification by Red Hat, ensuring reliability and confidence for enterprise deployments.
Phased Approach to Deployment:
- Experimentation: Developers can start experimenting with InstructLab on their laptops/desktops, familiarizing themselves with AI development workflows.
- Production Deployment: RHEL AI enables production deployments on bare metal servers, virtual machines, or cloud environments, allowing for the creation of high-fidelity trained models integrated into enterprise applications.
- Scalability with OpenShift AI: OpenShift AI provides a scalable platform for deploying trained models in production environments, offering MLOps capabilities for managing predictive and generative AI models at scale.
The Road Ahead for Enterprise AI:
Red Hat’s initiatives aim to bring the facility of open source innovation to enterprise AI, empowering organizations to leverage AI technologies effectively and responsibly. By fostering collaboration and community-driven development, Red Hat seeks to speed up the adoption of generative AI in enterprise environments, while ensuring reliability, trust, and support for AI deployments.
Key Takeaways:
- RHEL AI and InstructLab democratize access to AI technologies, empowering domain experts to contribute on to the evolution of AI models.
- Red Hat’s initiatives aim to bridge the gap between open source innovation and enterprise AI deployment, providing a seamless platform for AI development and customization.
- By leveraging community-driven development and collaboration, Red Hat seeks to speed up the adoption of generative AI in enterprise environments, while ensuring reliability and support for AI deployments.
Recommended Newsletters 🐝 🐝 🐝 🐝🐝
References
