Improved Partial Scoring Options

Today, we are introducing test suites and a new partial-scoring mode. With test suites, you can group tests and use the latest partial scoring mode to evaluate submissions based on their performance across all test suites.

With this, you can now organize IOI-style contests on Toph exactly as intended.

Test Suites in Drafts

You can define test suites when authoring problems in Drafts. Drag tests and test suites to create the layout you want.

Each test suite inherits the sum of its tests’ weights as its own weight.

You can use test suites to organize tests. They only affect scoring if you select the test suite partial scoring mode for a programming problem in Toph.

Partial Scoring Modes

Previously, Toph offered a toggle for partial scoring mode, on or off. Now, there are three options:

• Off
  • All test cases must pass. A submission receives either the full score or 0.
  • Classic “all‑or‑nothing” contests (e.g., ICPC).
• Test
  • Each passed test case contributes its weighted points to the total score.
  • Traditional partial scoring where individual tests matter.
  • Toph exhibited this behavior when the partial scoring mode was on previously.
• Test Suite
  • Toph awards points only when all tests in a suite pass, using the suite’s weight to calculate the total score.
  • Use this when Toph should treat a group of related tests as a single unit, such as in IOI-style contests.

How Test Suite Scoring Works

1. Group tests into suites when authoring a problem.
2. The weight of a test suite is the sum of the weights of the tests in it.
3. During evaluation, a suite contributes its weight only if every test in that suite passes.
4. The final score is the sum based on the weights of all fully‑passed suites.

You can also enable Stacked Scoring to let participants solve a problem through multiple submissions, with each submission solving some test suites until all are solved.

Presets and Configuration

• The IOI preset automatically enforces Test Suite partial scoring mode, matching the scoring style used in International Olympiad in Informatics contests.
• If you do not select a preset that forces partial scoring, you can manually set the mode (Off, Test, or Test Suite) for each challenge when preparing a contest.

Thanks to @RafsanAmin2020 for this suggestion.

If you have any questions or need assistance, please don’t hesitate to contact Toph support or join the conversation in our community forum.