There are 4 programming assignments described in the table below.
| # | Title | Links | Description | Due Dates |
|---|---|---|---|---|
| HW0 | Exploring LLMs | [Notebook] | An introductory assignment comparing and analyzing outputs from different LLMs. |
|
| HW1 | Transformer from Scratch | [Notebook] | Build and understand the Transformer architecture from the ground up. |
|
| HW2 | Finetuning LLMs | [Notebook-Part-1] [Notebook-Part-2] [Notebook-Part-3] |
Explore techniques to adapt pre-trained LLMs to new tasks in an efficient and performant manner. |
|
| HW3 | LLM Compression | [Notebook] | Leverage patterns in pretrained weights to compress LLMs for memory-efficient inference and finetuning. |
|