You saw in the last post that decision trees overfit easily. Change a few training examples and the whole tree changes. That instability is the core problem.

The fix is almost embarrassingly simple. Don't build one tree. Build hundreds of them. Make each one slightly different. Then have them all vote on the answer.

That's Random Forest. And...