0%

Book Description

Machine learning isn’t a set-it-and-forget-it operation. Even with solid examples, ML algorithms can still fail and end up blocking important emails, filtering out useful content, and causing a variety of other problems. In this O‘Reilly report, industry analyst Ted Cuzzillo examines real-world examples of active learning, a relatively new strategy for improving ML results through short-term human intervention.

Throughout this report, Cuzzillo relies on several experts in the field for practical applications and tips they’ve unearthed through various projects in active learning. As you’ll discover, the point at which algorithms fail is precisely where there’s an opportunity to insert human judgment to actively improve the algorithm’s performance.

  • Learn the basic principles of labeling data
  • Help algorithms decrease the uncertainty of their results in email spam filtering and online search accuracy
  • Effectively use crowdsourcing in your ML training project, without incurring undue costs
  • Select training data from areas where the data volume is greatest
  • Use multiple classification methods to better train ML algorithms
  • Learn how to apply more advanced strategies for even greater accuracy

Table of Contents

  1. O’Reilly Strata Conferenc
  2. Introduction
  3. When Active Learning Works Best
    1. Real-World Example: The Spam Filter
    2. Real-World Example: Matching Business Listings at GoDaddy
    3. Real-World Example: Ranking Top Search Results at Yahoo!
    4. Where Active Learning Works Best
    5. Basic Principles of Labeling Data
    6. Beyond the Basics
  4. “Gold Standard” Data: A Best Practice Method for Assessing Labels
  5. Managing the Crowd
    1. A Challenge: Overconfident Contributors
    2. More Tips for Managing Contributors
    3. When to Skip the Crowd
  6. Expert-level Contributors
    1. How to Find the Experts
    2. Managing Expert-level Contributors
    3. A Real-World Example: Expert Stylists + Machine Learning
  7. Machines and Humans Work Best Together
18.118.102.225