ML Techniques Used in ML Algorithms and Models
- Overview
Some key Machine Learning (ML) techniques used in ML algorithms and models include: supervised learning, unsupervised learning, reinforcement learning.
Each serving different purposes depending on the type of data and prediction task at hand":
- Supervised Learning: Trains a model on labeled data where the desired output is known, allowing it to learn patterns and make predictions on new data based on the input features.
- Unsupervised Learning: Identifies patterns in unlabeled data, often used for clustering or dimensionality reduction.
- Reinforcement Learning: An agent learns through trial and error by receiving rewards for positive actions and penalties for negative actions.
- Supervised Learning
A. Classification:
- K-Nearest Neighbors (KNN)
- Logistic Regression
- Naive Bayes
- Decision Trees
- Support Vectors Machines (SVM)
- Random Forest
- Gradient Boosting Machines (GBM)
- Neural Networks (MLP, CNN)
B. Regression
- Linear Regression
- Polynomial Regression
- Ridge Regression
- Lasso Regression
- Elastic Net
- Support Vector Regression (SVR)
- Decision Tress
- Random Forest
- Gradient Boosting
- Unsupervised Learning
A. Clustering
- K-Means
- DBSCAN (Density-Based Spatial Clustering of Applications with Noise)
- Hierarchical Clustering
- Gaussion Mixture Models (GMM)
B. Dimensionality Reduction
- Principal Component Analysis (PCA)
- Singular Value Decomposition (SVD)
- Independent Component Analysis (ICA)
- t-Distributed Stochastic Neighbor Embedding (t-SNE)
- Linear Discriminant Analysis (LDA)
C. Association
- Apriori Algorithm
- FP-Growth Algorithm
- ECLAT Algorithm
- Reinforcement Learning
A. Value-Based
- Q-Learning
- Deep Q-Network (DQN)
B. Policy-Based
- Reinforcement Algorithm
- Proximal Policy Optization (PPO)
C. Model-Based
- AlphaZero
- Dyna-Q
D. Other Algorithms
- Actor-Critic Methods (A3C, A2C)
- Deep Deterministic Policy Gradient (DDPG)
- Twin Delayed Deep -Deterministic Policy Gradient (TD3)
- Soft Actor-Critic (SAC)
- Neural Networks
[More to come ...]