CS 2750 Machine
Learning

Theoretical Boosting algorithm

•Similarly to boosting the
accuracy we can boost the confidence at
some restricted accuracy cost

•**The key result:** we can improve both the
accuracy and confidence

•**Problems with the theoretical algorithm
**

–A good (better than 50 %)
classifier on all data problems

–We cannot properly sample from
data-distribution

–Method requires large training
set

•**Solution to the sampling problem:
**

–Boosting by sampling

•**AdaBoost** algorithm and variants