LineageBaseline/Hyper-Param SweepHome / TEL / Phase_0 / Baseline Experiments / Baseline/Hyper-Param Sweepv

Home
[8]
Blogs Builds CV Muse Notes Posts Wishlist Me
TEL
[3]
Phase_1 Phase_2 Phase_3
Phase_0
[4]
Implementing a Baseline Model Lineage of Transformer Resources Training GPT-2 with bigger data
Baseline Experiments
[3]
Mem & GPU Exp Experiment Template Pre vs Post Norms, With & Without Warmups
Baseline/Hyper-Param Sweep
[2]
Experiments with Weight Decay LR vs Batch Size Empirical Sweep

Home

LineageBaseline/Hyper-Param SweepHome / TEL / Phase_0 / Baseline Experiments / Baseline/Hyper-Param Sweepv

Home
[8]
Blogs Builds CV Muse Notes Posts Wishlist Me
TEL
[3]
Phase_1 Phase_2 Phase_3
Phase_0
[4]
Implementing a Baseline Model Lineage of Transformer Resources Training GPT-2 with bigger data
Baseline Experiments
[3]
Mem & GPU Exp Experiment Template Pre vs Post Norms, With & Without Warmups
Baseline/Hyper-Param Sweep
[2]
Experiments with Weight Decay LR vs Batch Size Empirical Sweep

Home

❯

❯

❯

Baseline Experiments

❯

Baseline/Hyper Param Sweep

Baseline/Hyper-Param Sweep

Mar 30, 20261 min read

LR vs Batch Size Empirical Sweep
Optim Sweep

2 items under this folder.

Mar 02, 2026
Experiments with Weight Decay
Feb 27, 2026
LR vs Batch Size Empirical Sweep

ashwinms.com // v3.0.1● SYSTEM ONLINETEL/Baseline/4-Experiments/Hyper-Param-Sweep/indexMODE: READERSWITCH: CLICK READER ICON

Graph View

Find me on:

GitHub X Substack LinkedIn

hi@ashwinms.com

Created with Quartz v4.5.2 © 2026