Active Learning


Active learning is a method of intelligently sampling data to select the most informative unlabeled points for labeling. It helps in scenarios with limited data budget, imbalanced datasets, and when standard sampling techniques do not improve accuracy.

Active learning involves iteratively selecting the most uncertain data points for labeling to improve the model’s performance. img

Intelligent sampling techniques in active learning:

  1. Margin sampling: Labels the most uncertain points based on their distance from the decision boundary.
  2. Cluster-based sampling: Selects diverse points using clustering methods over the feature space.
  3. Query-by-committee: Trains multiple models and selects points with the highest disagreement among them.
  4. Region-based sampling: Divides the input space into regions and runs active learning algorithms in each region.
  5. etc.

References

  1. https://www.coursera.org/learn/machine-learning-data-lifecycle-in-production/home/week/4
  2. https://en.wikipedia.org/wiki/Active_learning_(machine_learning)