Configure AutoTest caching

Caching your AutoTest configuration is a powerful tool to speed up your AutoTest. This guide will show how you can configure this and when it is best to disable it.

AutoTest caching will cache the state of your AutoTest environment after your configuration (e.g. after downloading data, installing additional software or packages or unarchiving). When it is restarted, it can use this cached state to restart instantly and allow for very fast feedback to students. It is also very useful when iteratively developing your AutoTest, as changes in test steps will not require a cache refresh.

Good practice: as long as you make no changes in fixtures or the Global Setup Script, CodeGrade will use the cached state of your environment and have near instant restart times.

When to turn off AutoTest caching?

AutoTest caching is turned on by default and should be left turned on for most cases. There are however some uncommon configurations and reasons to disable AutoTest caching for your AutoTest. In short, this is when your Global Setup depends on a live variable, for instance:

  • You require that the downloaded and installed package or software is always the latest version and therefore do not want to cache this.

  • You require that the data you download is always the latest version and therefore do not want to cache this.

  • Your AutoTest setup depends on variables like the current date or time or generates a random numbers during configuration.

Turning on or off AutoTest caching

  1. Navigate to the AutoTest tab.

  2. Under Setup find the Setup caching option.

  3. Use the toggle to disable or enable Setup caching. This is saved automatically.

Last updated