There are 5 programming assignments described in the table below.
| # | Title | Description | Due Dates |
|---|---|---|---|
| HW0 | Exploring LLMs | An introductory assignment comparing and analyzing outputs from different LLMs. |
|
| HW1 | Transformer from Scratch | Build and understand the Transformer architecture from the ground up. |
|
| HW2 | Finetuning LLMs | Explore techniques to adapt pre-trained LLMs to new tasks in an efficient and performant manner. |
|
| HW3 | LLM Compression | Leverage patterns in pretrained weights to compress LLMs for memory-efficient inference and finetuning. |
|
| HW4 | Neurosymbolic and Advanced Topics | Investigate the intersection of LLMs with symbolic reasoning and apply it towards challenging reasoning tasks. |
|