How to use weights and points when using a Discrete Rubric Category with AutoTest

The final grade of an AutoTest run is not defined by the weights you set in AutoTest, but by the amount of points a rubric level in a category has that is reached by AutoTest.

To start setting the weights, first select the rubric calculation mode. Either minimum, where a rubric category item will be chosen when the lower bound is reached, or maximum, where a rubric category item will be chosen when the upper bound is reached.

You want to use maximum when students need to pass all tests in an AutoTest category, before they should get the maximum item in the rubric category.

Let's go over an example to make this more clear. This is the rubric category we want to create tests for:

Item name	Nothing works (0)	Compiling works (1)	Simple tests work (5)	Advanced tests work (10)
Percentage range to reach item	0%-50%	50%-75%	75%-100%	100%

As you can see, the maximum mode is selected, as you only reach the last rubric item (Advanced tests work) with 100% of passed tests.

Type	Name	Weight
Run Program	Compile	8
Checkpoint	Stop if compilation fails	-
IO Test (4 substeps)	Simple tests	4
Capture Points	Advanced tests	4

As you can see here, the compile step actually has the highest weight, but will get the student the least amount of points. This is due to the fact that you need a weight of 8 to get 50% in the rubric category, which in turn will get you the Compiling works item.

Both the simple tests and advanced tests have a weight of 4, which is both 25% of the total amount of points achievable, which will make sure the right rubric item is filled in.