# CS336 Spring 2024 Assignment 4 (Data) Leaderboard

To submit to the leaderboard, submit a pull request that adds your results to
the Markdown table below. The table should be sorted by increasing loss.

Note that your submission can run for at most 24 hours on 2 H100s, and that you
must evaluate on the C4 100 domains dataset that we provide. In addition, your
data should be exclusively filtered from the common crawl WARC files that we
provide.

In your pull request description, you should include:

- The final validation loss that was recorded
- A link to an associated learning curve. You may either upload an image
  directly to the repo (use the [./images](./images)) folder or link to a
  publicly-viewable plot from a service like Weights and Biases.
- A description of what you did / how you built your dataset.


## C4 100 domains validation loss leaderboard

| Name           | Validation Loss | Link                                         |
|:---------------|----------------:|---------------------------------------------:|
| chengshu       |           3.397 | [Link](https://wandb.ai/chengshu/cs336_hw4/reports/eval_loss-24-05-27-10-59-19---Vmlldzo4MTEzOTgz) |
| Marcel Rød     |           3.415 | [wandb](https://api.wandb.ai/links/uce/22sfzl5n) |
| rishabh        |           3.417 | [wandb](https://api.wandb.ai/links/rishabh-ranjan/93c9jode) |
| Abhinav Garg (1/5th data, full run pending)   |           3.432  | [Link](https://api.wandb.ai/links/abhinavg4/8l2esdu6) 
| Tony Sun       |           3.440 | [wandb](https://api.wandb.ai/links/tonysun9/hvypz4dv)    |
| Beicheng Lou   |           3.448 | [wandb](https://api.wandb.ai/links/lbc45123s/r6lssfdi)    |
| Shijia Yang    |           3.450 | [wandb](https://api.wandb.ai/links/shijiayang/ackk9eun) |
| Mason Wang     |           3.485 | [wandb](https://api.wandb.ai/links/masonwang/oga6dz89) |
| Jason Wang     |           3.497 | [wandb](https://api.wandb.ai/links/blahblahhhj/o390l3a1) |
| Sarah Chen     |           3.504 | [wandb](https://api.wandb.ai/links/sachen/mec4fo2v) |
| sundararajan   |           3.511 | [wandb](https://api.wandb.ai/links/sundararajan-team/brohdggp) |
| xiongb         |           3.511 | [image](./images/xiongb.png)                                    |
| Matty Reed     |           3.545 | [wandb](https://api.wandb.ai/links/matthewreed/wad1hxqu) |
| Sudharsan Sundar |         3.582 | [wandb](https://api.wandb.ai/links/alephentine/thenownc) |
| Santiago Hernández (78k steps) | 3.700 | [wandb](https://api.wandb.ai/links/estanfor/p2epo6oz) |
| Michael Ryan   |           3.823 | [wandb](https://api.wandb.ai/links/michael-nlp/6o5lh2y3) |
| mattding       |           10.365| [wandb](https://api.wandb.ai/links/mattding/wgu1ko6s) |