Skip to content

Commit d41dc90

Browse files
Naman-ntcNaman-ntc
committed
feat: livecodebench v5 initial leaderboard
1 parent aa37a9f commit d41dc90

File tree

11 files changed

+63098
-288996
lines changed

11 files changed

+63098
-288996
lines changed

‎build/asset-manifest.json‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
11
{
22
"files": {
33
"main.css": "./static/css/main.be588df3.css",
4-
"main.js": "./static/js/main.38a8c78e.js",
4+
"main.js": "./static/js/main.75a3ac17.js",
55
"index.html": "./index.html",
66
"main.be588df3.css.map": "./static/css/main.be588df3.css.map",
7-
"main.38a8c78e.js.map": "./static/js/main.38a8c78e.js.map"
7+
"main.75a3ac17.js.map": "./static/js/main.75a3ac17.js.map"
88
},
99
"entrypoints": [
1010
"static/css/main.be588df3.css",
11-
"static/js/main.38a8c78e.js"
11+
"static/js/main.75a3ac17.js"
1212
]
1313
}

‎build/index.html‎

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -325,11 +325,10 @@ <h2 class="title is-3">Model Comparisions</h2>
325325
<h2 class="title is-3">Submitting Custom Models</h2>
326326
<div class="content has-text-justified">
327327
<p>
328-
To submit models to the leaderboard, you can run the evaluation using the evaluation scripts in
329-
<a href="https://github.com/LiveCodeBench/LiveCodeBench">GitHub</a>. Once you have the results,
330-
you can fill out <a href="https://forms.gle/h2abvAHh6UnhWzzd9">this form</a>. You will need to fill out
331-
model details and provide the generated evaluation file with model generations and pass@1 scores. We will
332-
review the submission and add the model to the leaderboard accordingly.
328+
To submit models you can create a pull request on our <a
329+
href="https://github.com/LiveCodeBench/submissions">Github</a>. Particularly, you can copy your model
330+
generations folder from `output` to the `submissions` folder and create a pull request. We will review the
331+
submission and add the model to the leaderboard accordingly.
333332
</p>
334333
</div>
335334
</div>

‎build/leaderboard.html‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
<!doctype html><html lang="en"><head><title>LiveCodeBench Leaderboard</title><meta charset="UTF-8"/><meta name="viewport" content="width=device-width,initial-scale=1"/><meta name="theme-color" content="#000000"/><meta name="description" content="LiveCodeBench Leaderboard"/><link rel="stylesheet" href="bootstrap.min.css"/><link rel="stylesheet" href="./css/bulma.min.css"/><link rel="stylesheet" href="./css/bulma-carousel.min.css"/><link rel="stylesheet" href="./css/bulma-slider.min.css"/><link rel="stylesheet" href="./css/fontawesome.all.min.css"/><link rel="stylesheet" href="https://cdn.jsdelivr.net/gh/jpswalsh/academicons@1/css/academicons.min.css"/><link rel="stylesheet" href="./css/index.css"/><link rel="icon" href="./images/favicon.svg"/><script src="https://ajax.googleapis.com/ajax/libs/jquery/3.5.1/jquery.min.js"></script><script defer="defer" src="./js/fontawesome.all.min.js"></script><script src="./js/bulma-carousel.min.js"></script><script src="./js/bulma-slider.min.js"></script><script src="./js/index.js"></script><script defer="defer" src="./static/js/main.38a8c78e.js"></script><link href="./static/css/main.be588df3.css" rel="stylesheet"></head><body><noscript>You need to enable JavaScript to run this app.</noscript><div id="root"></div></body></html>
1+
<!doctype html><html lang="en"><head><title>LiveCodeBench Leaderboard</title><meta charset="UTF-8"/><meta name="viewport" content="width=device-width,initial-scale=1"/><meta name="theme-color" content="#000000"/><meta name="description" content="LiveCodeBench Leaderboard"/><link rel="stylesheet" href="bootstrap.min.css"/><link rel="stylesheet" href="./css/bulma.min.css"/><link rel="stylesheet" href="./css/bulma-carousel.min.css"/><link rel="stylesheet" href="./css/bulma-slider.min.css"/><link rel="stylesheet" href="./css/fontawesome.all.min.css"/><link rel="stylesheet" href="https://cdn.jsdelivr.net/gh/jpswalsh/academicons@1/css/academicons.min.css"/><link rel="stylesheet" href="./css/index.css"/><link rel="icon" href="./images/favicon.svg"/><script src="https://ajax.googleapis.com/ajax/libs/jquery/3.5.1/jquery.min.js"></script><script defer="defer" src="./js/fontawesome.all.min.js"></script><script src="./js/bulma-carousel.min.js"></script><script src="./js/bulma-slider.min.js"></script><script src="./js/index.js"></script><script defer="defer" src="./static/js/main.75a3ac17.js"></script><link href="./static/css/main.be588df3.css" rel="stylesheet"></head><body><noscript>You need to enable JavaScript to run this app.</noscript><div id="root"></div></body></html>

‎build/static/js/main.38a8c78e.js‎

Lines changed: 0 additions & 3 deletions
This file was deleted.

‎build/static/js/main.75a3ac17.js‎

Lines changed: 3 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎build/static/js/main.38a8c78e.js.LICENSE.txt‎ renamed to ‎build/static/js/main.75a3ac17.js.LICENSE.txt‎

File renamed without changes.

‎build/static/js/main.38a8c78e.js.map‎ renamed to ‎build/static/js/main.75a3ac17.js.map‎

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎public/index_home.html‎

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -325,11 +325,10 @@ <h2 class="title is-3">Model Comparisions</h2>
325325
<h2 class="title is-3">Submitting Custom Models</h2>
326326
<div class="content has-text-justified">
327327
<p>
328-
To submit models to the leaderboard, you can run the evaluation using the evaluation scripts in
329-
<a href="https://github.com/LiveCodeBench/LiveCodeBench">GitHub</a>. Once you have the results,
330-
you can fill out <a href="https://forms.gle/h2abvAHh6UnhWzzd9">this form</a>. You will need to fill out
331-
model details and provide the generated evaluation file with model generations and pass@1 scores. We will
332-
review the submission and add the model to the leaderboard accordingly.
328+
To submit models you can create a pull request on our <a
329+
href="https://github.com/LiveCodeBench/submissions">Github</a>. Particularly, you can copy your model
330+
generations folder from `output` to the `submissions` folder and create a pull request. We will review the
331+
submission and add the model to the leaderboard accordingly.
333332
</p>
334333
</div>
335334
</div>

‎src/LeaderboardComp.tsx‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,7 @@ const Leaderboard = React.memo(function LeaderboardComponent(props: any) {
6161
}, [date_marks]);
6262

6363
const [dateStartAndEnd, setDateStartAndEnd] = React.useState<number[]>([
64-
(dateMarks.length > 12) ? dateMarks[8].value : dateMarks[4].value, // Right now, this is 2023-05-01
64+
(dateMarks.length > 12) ? dateMarks[12].value : dateMarks[4].value, // Right now, this is 2023-05-01
6565
dateMarks[dateMarks.length - 1].value,
6666
])
6767

‎src/index.tsx‎

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -128,10 +128,11 @@ ReactDOM.render(
128128
<h2 className="title is-3">Submitting Custom Models</h2>
129129
<div className="content has-text-justified">
130130
<p>
131-
To submit models to the leaderboard, you can run the evaluation using the evaluation scripts in <a href="https://github.com/LiveCodeBench/LiveCodeBench">GitHub</a>. Once you have the results,
132-
you can fill out <a href="https://forms.gle/h2abvAHh6UnhWzzd9">this form</a>. You will need to fill out
133-
model details and provide the generated evaluation file with model generations and pass@1 scores. We will
134-
review the submission and add the model to the leaderboard accordingly.
131+
To submit models you can create a pull request on our <a
132+
href="https://github.com/LiveCodeBench/submissions">Github</a>. Particularly, you can copy your model
133+
generations folder from `output` to the `submissions` folder and create a pull request. We will review the
134+
submission and add the model to the leaderboard accordingly.
135+
135136
</p>
136137
</div>
137138
</div>

0 commit comments

Comments
 (0)