A doorknob

Mathematical Statistics

My notes over Mark Maxwell’s course, Introduction to Mathematical Statistics, and his textbook, Probability & Statistics with Applications, Second Edition. Sampling Distributions and Estimation: Normally in a probability experiment, we don’t know the true …

Common Probability Distributions

An overview of common discrete and continuous distributions found in probability and statistics, from Mark Maxwell’s textbook, Probability & Statistics with Applications, Second Edition. Common Discrete Distributions: Discrete Uniform: A random variable …

Gradient Descent & Optimizers

Theses are some of my over Qiang Liu’s course, Machine Learning II. Gradient Descent: Gradient Descent is a fundamental, first-order iterative optimization algorithm designed for minimizing a function. The primary objective of Gradient Descent is to find …

Language Modeling: Word Embedings & Architectures

These are a few of my notes from Eunsol Choi’s NLP class at UT Austin. Word Embeddings: Word embeddings are a type of word representation that captures the semantic meaning of words in a continuous vector space. Unlike one-hot encoding, where each word is …

Neural Networks: RNNs, Seq2Seq, & CNNs

These are a few of my notes from Eunsol Choi’s NLP class at UT Austin. Recurrent Neural Networks (RNNs): Recurrent Neural Networks (RNNs) are a class of artificial neural networks specifically designed to tackle sequence-based problems. Unlike traditional …

Classifiers: Generative & Discriminative Models

These are a few of my notes from Eunsol Choi’s NLP class at UT Austin. Generative Models vs. Discriminative Models: When it comes to classification, models are broadly categorized into Generative Models and Discriminative Models. Generative Models: In …

Probability

My notes over Mark Maxwell’s course, Probability I, and his textbook, Probability & Statistics with Applications, Second Edition. Combinatorial Probability: The fundamental theorem of counting is also known as the multiplication principle. Given that …

Linear Algebra

These are my notes over my review of Linear Algebra, going through Gilbert Strang’s Introduction To Linear Algebra. Introduction to Vectors: The core of linear algebra is vector addition and scalar multiplication. Combining these two operations gives us a …

Basic Calculus

A small review over Calculus 1, 2, and 3, based on the textbook, Calculus: Early Transcendentals (Eight Edition). Differentiation Rules: Product Rule: If $f$ and $g$ are both differentiable, then $$\frac{d}{dx}[f(x)g(x)]=f(x)g^\prime(x)+g(x)f^\prime(x)$$ …