Blog Posts: Class Notes
Mathematical Statistics
My notes over Mark Maxwell’s course, Introduction to Mathematical Statistics, and his textbook, Probability & Statistics with Applications, Second Edition.
Sampling Distributions and Estimation: Normally in a probability experiment, we don’t know the true …
Common Probability Distributions
An overview of common discrete and continuous distributions found in probability and statistics, from Mark Maxwell’s textbook, Probability & Statistics with Applications, Second Edition.
Common Discrete Distributions: Discrete Uniform: A random variable …
Gradient Descent & Optimizers
Theses are some of my over Qiang Liu’s course, Machine Learning II.
Gradient Descent: Gradient Descent is a fundamental, first-order iterative optimization algorithm designed for minimizing a function. The primary objective of Gradient Descent is to find …
Language Modeling: Word Embedings & Architectures
These are a few of my notes from Eunsol Choi’s NLP class at UT Austin.
Word Embeddings: Word embeddings are a type of word representation that captures the semantic meaning of words in a continuous vector space. Unlike one-hot encoding, where each word is …
Neural Networks: RNNs, Seq2Seq, & CNNs
These are a few of my notes from Eunsol Choi’s NLP class at UT Austin.
Recurrent Neural Networks (RNNs): Recurrent Neural Networks (RNNs) are a class of artificial neural networks specifically designed to tackle sequence-based problems. Unlike traditional …
Classifiers: Generative & Discriminative Models
These are a few of my notes from Eunsol Choi’s NLP class at UT Austin.
Generative Models vs. Discriminative Models: When it comes to classification, models are broadly categorized into Generative Models and Discriminative Models.
Generative Models: In …
Probability
My notes over Mark Maxwell’s course, Probability I, and his textbook, Probability & Statistics with Applications, Second Edition.
Combinatorial Probability: The fundamental theorem of counting is also known as the multiplication principle.
Given that …
Linear Algebra
These are my notes over my review of Linear Algebra, going through Gilbert Strang’s Introduction To Linear Algebra.
Introduction to Vectors: The core of linear algebra is vector addition and scalar multiplication. Combining these two operations gives us a …
Basic Calculus
A small review over Calculus 1, 2, and 3, based on the textbook, Calculus: Early Transcendentals (Eight Edition).
Differentiation Rules: Product Rule: If $f$ and $g$ are both differentiable, then
$$\frac{d}{dx}[f(x)g(x)]=f(x)g^\prime(x)+g(x)f^\prime(x)$$ …