aman.ai

Distilled AI

Algorithms/Architecture
• Linear and Logistic Regression
• k-Nearest Neighbors
• Clustering
• Support Vector Machines (SVM)
• Naive Bayes
• Decision Trees and Ensemble Methods
• ML Algorithms Comparative Analysis
• DL Architectures Comparative Analysis
• Neural Architectures
• Encoder vs. Decoder vs. Encoder-Decoder
• Prompt Engineering
• Generative Adversarial Networks (GANs)
• Diffusion Models
• Graph Neural Networks
• Attention
• Transformers
• Token Sampling Methods
• Separable Convolutions
• Inductive Bias
• Convolutional Neural Networks (CNNs)
• Reinforcement Learning
• Mixture-of-Experts
• State Space Models
• Agents
• Reinforcement Learning for Agents
• FlashAttention
• Model Acceleration
• Speculative Decoding
• Cross Validation

Data/Training
• Data Sampling
• Data Imbalance
• Data Quality/Filtering
• Standardization vs. Normalization
• Inter-Annotator Agreement
• Learning Paradigms
• Xavier Initialization
• Padding and Packing
• Regularization
• Gradient Descent & Backprop
• Activation Functions
• Loss Functions
• Fine-tuning Models
• Splitting Datasets
• Batchnorm
• Dropout
• Double Descent
• Fine-tuning and Evaluating BERT
• Training Loss > Validation Loss?
• Bias Variance Tradeoff
• Gradient Accumulation & Checkpointing
• Parameter Efficient Fine-Tuning
• Hypernetworks
• Distributed Training Parallelism

NLP/LLMs
• Word Vectors/Embeddings
• NLP Tasks
• Preprocessing
• Tokenization
• Large Language Models (LLMs)
• Preference Optimization
• Reinforcement Fine-Tuning
• Machine Translation
• Knowledge Graphs
• Factuality in LLMs
• Reasoning in LLMs
• Hallucination Detection and Mitigation
• AI Text Detection Techniques
• Named Entity Recognition
• Textual Entailment
• Retrieval Augmented Generation (RAG)
• LLM Context Length Extension
• Document Intelligence
• Code Mixing and Switching
• Large Language Model Ops (LLMOps)

Vision
• Vision Transformer (ViT)
• Receptive Field
• Skip Connections/ResNet
• GPT-4o Native Image Generation

Speech
• Speech Processing

Practice
• Interview Questions

Hyperparameters
• Tuning
• Logging

Miscellaneous
• Ilya Sutskever's Top 30
• GPU Architecture
• Debugging Model Training
• ML Runtimes
• Chain Rule
• Bayes' Theorem
• Probability Calibration
• Multiclass vs. Multilabel Classification
• N-Dimensional Tensor Product
• PyTorch vs. TensorFlow
• Approximate Nearest Neighbors
• Transferability Estimation
• TensorBoard
• Hidden Markov Models vs. Naive Bayes
• CNNs for Text Classification
• Maximum Entropy Markov Models
• Conditional Random Fields