Advanced autograding

We designed AutoTest to work with any workflow. The advanced guides in this section are there to help you get the most out of CodeGrade for your assignment and workflow.

​📈
 For most assignments, just one AutoTest level is sufficient. But if your assignment is really elaborate or if you want to add advanced tests, you can create multiple levels with conditions between each other.
📈
Creating multiple levels
​💬
 Your AutoTest test steps will have a default description that explains what command the test executes. You can replace this description with a custom one to make it more understandable for your students!
💬
Adding custom descriptions for tests
​👀
We believe the more details of AutoTest we display to students, the more feedback they get and the more engaged they are. By default, all tests are visible to students and students could programatically try to access fixtures. Learn how to limit visibility of tests and fixtures below.
👀
Limiting visibility to students
​🌐
 Enable network access for your AutoTest categories, so that you can download requirements and your students can interact with the internet.
🌐
Enabling network access
​🕐
 Configure the timeout time of steps in your AutoTest category to allow students to do more performance heavy tasks without timing out.
⏱
Configuring timeout time of steps
​✏
 Generate output using AutoTest to then easily display and or manually assess. For instance if you want to generate GUI screenshots to assess, generate a testing report or run a Jupyter Notebook automatically.
✏
Generating output automatically
​🔁
 AutoTest caching will speed up your AutoTest and is turned on by default. This guide explains how it works and when you may decide to turn it off:
📎
Configure AutoTest caching
​🔎
 Find information about the submission you are grading in AutoTest in the submission metadata, useful to automatically deduct late days or seed random input data.
🔎
Accessing submission metadata
📉
Subtracting points for late submissions
 ⚡
Turn on instant feedback for your students!
⚡
Give students Instant Feedback
​

Writing Unit Test wrapper scripts

Creating multiple levels

Last modified 6mo ago

Copy link

Outline

​📈 For most assignments, just one AutoTest level is sufficient. But if your assignment is really elaborate or if you want to add advanced tests, you can create multiple levels with conditions between each other.

​💬 Your AutoTest test steps will have a default description that explains what command the test executes. You can replace this description with a custom one to make it more understandable for your students!

​👀We believe the more details of AutoTest we display to students, the more feedback they get and the more engaged they are. By default, all tests are visible to students and students could programatically try to access fixtures. Learn how to limit visibility of tests and fixtures below.

​🕐 Configure the timeout time of steps in your AutoTest category to allow students to do more performance heavy tasks without timing out.

​✏ Generate output using AutoTest to then easily display and or manually assess. For instance if you want to generate GUI screenshots to assess, generate a testing report or run a Jupyter Notebook automatically.

​🔁 AutoTest caching will speed up your AutoTest and is turned on by default. This guide explains how it works and when you may decide to turn it off:

​🔎 Find information about the submission you are grading in AutoTest in the submission metadata, useful to automatically deduct late days or seed random input data.

⚡Turn on instant feedback for your students!

📈
For most assignments, just one AutoTest level is sufficient. But if your assignment is really elaborate or if you want to add advanced tests, you can create multiple levels with conditions between each other.

💬
Your AutoTest test steps will have a default description that explains what command the test executes. You can replace this description with a custom one to make it more understandable for your students!

👀
We believe the more details of AutoTest we display to students, the more feedback they get and the more engaged they are. By default, all tests are visible to students and students could programatically try to access fixtures. Learn how to limit visibility of tests and fixtures below.

🕐
Configure the timeout time of steps in your AutoTest category to allow students to do more performance heavy tasks without timing out.

✏
Generate output using AutoTest to then easily display and or manually assess. For instance if you want to generate GUI screenshots to assess, generate a testing report or run a Jupyter Notebook automatically.

🔁
AutoTest caching will speed up your AutoTest and is turned on by default. This guide explains how it works and when you may decide to turn it off:

🔎
Find information about the submission you are grading in AutoTest in the submission metadata, useful to automatically deduct late days or seed random input data.

⚡
Turn on instant feedback for your students!