Binary Classification from Scratch using Numpy
Tag: machinelearning
The Decision Tree Algorithm: Fighting Over-Fitting Issue – Part(2): Reduced Error Pruning
What is this post about? In the previous post, we learned all about what over-fitting is, and why over-fitting to our training data could easily…
The Decision Tree Algorithm: Information Gain
Which attribute to choose? (Part-2) Today we are going to touch on something quite exciting. In our previous post we talked about Entropy of a…
The Decision Tree Algorithm: Entropy
Which Attribute to Choose? (Part1) In our last post, we introduced the idea of the decision trees (DTs) and you understood the big picture. Now…
The Decision Tree Algorithm: A Gentle Introduction
What will you learn? You will learn how a decision tree works but without going to the details. For example, you will NOT learn about…
Concept Learning and General to Specific Ordering-Part(5)
A Quick Recap Hello everyone and welcome! In our previous post, we talked about the first algorithm that uses the “more-general-thank-or-equal-to” operation to smooth out…
Concept Learning and General to Specific Ordering-Part(4)
A Quick Recap on our Last Post In our last post, we talked about the more-general-than-or-equal-to operation, which we denoted with ≥g and we said that in…
Concept Learning and General to Specific Ordering-Part(3)
General-to-Specific Ordering of Hypotheses In the last post, we said that all concept learning problems share 1 thing in common regarding their structure, and it…
Concept Learning and General to Specific Ordering-Part(1)
Introduction If we really wanted to simplify the whole story behind “Learning” in machine learning, we could say that a machine learning algorithm strives to…
Machine Learning vs. Algorithms
What is an Algorithm? An algorithm describes the way to do something, step-by-step in the necessary order! As an observant reader would realize, this means…