0%

Most companies don't have problems building and deploying algorithmic models, but they do struggle to effectively manage them in production. Maximizing the value of machine learning projects in the enterprise requires a robust MLOps program. But there's one key challenge: The problem MLOps sets out to solve isn't just about technology. It's also about process.

In this report, Kyle Gallatin defines a framework for ML governance--a comprehensive strategy to help your organization deliver real business value with your MLOps program. While MLOps provides a set of best practices and tools that let you deliver ML at scale, ML governance is how you control and manage those practices and tools.

This report shows infrastructure and operations (I&O) leaders and CTOs how to approach AI projects in a way that adds value from start to finish.

  • Approach ML governance with a consistent framework that covers ML operations and ML development
  • Dive deep into specifics for implementing governance throughout the ML life cycle
  • Understand why governing the delivery and operations stages are the most difficult parts of a comprehensive ML governance strategy
  • Explore ways to involve the right stakeholders to set up an ML governance program

Table of Contents

  1. 1. Delivering Business Value Through ML Governance
    1. The Current State of ML Governance
    2. Why Organizations Aren’t Seeing Value from ML
    3. What’s Needed to Derive Value from ML
    4. Development
    5. Delivery
    6. Operations
    7. ML Governance and the ML Lifecycle
    8. A Consistent Framework for ML Governance
    9. The Need for Governance in Development
    10. The Need for Governance in Delivery and Operations
  2. 2. Governing ML During the Development Stage
    1. MLOps of Development
    2. ML Governance of Development
    3. Model Validation and Reproducibility
    4. Documentation of Rationale
  3. 3. Governing ML During the Delivery and Operations Stages
    1. Observability, Visibility, and Control
    2. Monitoring and Alerting
    3. Model Service Catalog
    4. Security
    5. Compliance and Auditability
    6. Setup Within Your Organization
  4. 4. Putting It All Together
    1. Getting Value from Your ML with ML Governance
    2. How to Set Up an ML Governance Program
    3. Infrastructure and Operations
    4. CTO and CIO
    5. Head of Data Science
    6. Other Business Team Members
    7. How to Action on This Framework
    8. Conclusion and Next Steps
3.144.17.45