Personal tools

ML Techniques Used in ML Algorithms and Models

US Capitol_122521A
[US Capitol - Department of Agriculture]

 

- Overview

Some key Machine Learning (ML) techniques used in ML algorithms and models include: supervised learning, unsupervised learning, reinforcement learning. 

Each serving different purposes depending on the type of data and prediction task at hand":

  • Supervised Learning: Trains a model on labeled data where the desired output is known, allowing it to learn patterns and make predictions on new data based on the input features. 
  • Unsupervised Learning: Identifies patterns in unlabeled data, often used for clustering or dimensionality reduction. 
  • Reinforcement Learning: An agent learns through trial and error by receiving rewards for positive actions and penalties for negative actions. 

 

- Supervised Learning

 

A. Classification:

  • K-Nearest Neighbors (KNN)
  • Logistic Regression
  • Naive Bayes
  • Decision Trees
  • Support Vectors Machines (SVM)
  • Random Forest
  • Gradient Boosting Machines (GBM)
  • Neural Networks (MLP, CNN)

 

B. Regression

  • Linear Regression
  • Polynomial Regression
  • Ridge Regression
  • Lasso Regression
  • Elastic Net
  • Support Vector Regression (SVR)
  • Decision Tress
  • Random Forest
  • Gradient Boosting

 

- Unsupervised Learning

 

A. Clustering

  • K-Means
  • DBSCAN (Density-Based Spatial Clustering of Applications with Noise)
  • Hierarchical Clustering
  • Gaussion Mixture Models (GMM)

 

B. Dimensionality Reduction

  • Principal Component Analysis (PCA)
  • Singular Value Decomposition (SVD)
  • Independent Component Analysis (ICA)
  • t-Distributed Stochastic Neighbor Embedding (t-SNE)
  • Linear Discriminant Analysis (LDA)

 

 C. Association

  • Apriori Algorithm
  • FP-Growth Algorithm
  • ECLAT Algorithm

 

ML Algorithms and Models_120924A
[ML Algorithms and Models]

- Reinforcement Learning

 

A. Value-Based

  • Q-Learning
  • Deep Q-Network (DQN)

 

B. Policy-Based

  • Reinforcement Algorithm
  • Proximal Policy Optization (PPO)

 

C. Model-Based

  • AlphaZero
  • Dyna-Q

 

D. Other Algorithms

  • Actor-Critic Methods (A3C, A2C)
  • Deep Deterministic Policy Gradient (DDPG)
  • Twin Delayed Deep -Deterministic Policy Gradient (TD3)
  • Soft Actor-Critic (SAC)

 

- Neural Networks

 

 

[More to come ...]

Document Actions