This repository contains an implementation of gradient descent for linear regression using Python. The purpose of this project is to demonstrate how gradient descent can be used to optimize a simple ...

Gradient descent is a fundamental optimization algorithm widely used in machine learning and numerical optimization. It is employed to minimize a cost function iteratively by adjusting the parameters ...

Gradient Boosting Decision Tree (GBDT) is a popular machine learning algorithm. It has quite effective implementations such as XGBoost as many optimization techniques are adopted from this algorithm.