Project Leaderboard (CS 1671)
Preliminary Evaluation (test set 1)
| Group Name |
Question 1 Accuracy |
Question 2 Word Level F-score |
Group4 |
58.06% |
36.5% |
Group6 |
0.00% |
11.9% |
Infinity |
52.58% |
N/A |
/Win{2}er(zz)+/ |
44.84% |
41.8% |
Group5 |
N/A |
N/A |
JKZ |
55.48% |
37.4% |
Natural Language Pwning |
0.00% |
27.1% |
CodeTurtles |
37.42% |
0.0% |
Group1 |
0.00% |
29.0% |
Orin |
0.00% |
23.7% |
Never Grads |
49.03% |
24.2% |
Group3 |
0.00% |
Error |
Final Evaluation (test set #1 and test set #2)
| Group Name |
Test set #1 Question 1 Accuracy (rank) |
Test set #1 Question 2 Word Level F-score (rank) |
Test set #2 Question 1 Accuracy (rank) |
Test set #2 Question 2 Word Level F-score (rank) |
Infinity |
54.84% (3) |
25.50% (12) |
61.59% (5) |
33.00% (10) |
Never Grads |
52.58% (5) |
56.20% (4) |
63.67% (3) |
75.00% (1) |
JKZ |
59.68% (2) |
69.10% (2) |
64.93% (2) |
61.60% (4) |
Natural Language Pwning |
43.23% (11) |
29.90% (10) |
49.90% (10) |
40.20% (9) |
Group6 |
43.55% (10) |
76.70% (1) |
54.07% (8) |
66.00% (3) |
/Win{2}er(zz)+/ |
53.23% (4) |
58.50% (3) |
59.50% (6) |
66.80% (2) |
Orin |
47.74% (8) |
42.30% (7) |
53.65% (9) |
52.30% (5) |
CodeTurtles |
37.42% (12) |
40.40% (8) |
43.84% (12) |
47.60% (7) |
Group 4 |
60.00% (1) |
46.60% (6) |
66.60% (1) |
52.00% (6) |
Group 5 |
50.00% (7) |
25.70% (11) |
56.78% (7) |
19.90% (12) |
Group 3 |
52.58% (6) |
48.30% (5) |
62.21% (4) |
43.30% (8) |
Group 1 |
43.55% (9) |
30.10% (9) |
49.27% (11) |
31.20% (11) |