WARNING! Gitlab maintenance operation scheduled for Monday, 20 April between 12:00 and 14:00 (CET). During this time window, short service interruptions (less than 5 minutes) may occur. Thank you in advance for your understanding.
-`MC` expands to `5_1`, `7_1`, `5_1_4`, `5_1_2`, `7_1_4`.
- Any other token is treated as a case-insensitive substring match.
- Token modifiers:
-`TOKEN`: restrictive token. Multiple restrictive tokens combine with logical AND.
-`+TOKEN`: additive token. Adds matching tests even if they would otherwise be excluded.
-`-TOKEN`: subtractive token. Removes matching tests from the final selection.
-`TOKEN*`: wildcard token. Matches all known tokens starting with the given prefix.
-`+TOKEN*`, `-TOKEN*`: wildcard token with add/remove behavior.
### LEVEL1, LEVEL2 and LEVEL3 behavior
For all levels, the default tag baseline is `ENC` + `DEC`.
`REND`, `ISAR`, and `ISAR_ENC` are optional and are only included if explicitly selected
as plain tags or added via `+REND` and/or `+ISAR`.
For all levels, the default test-group baseline is `ENC` + `DEC`.
`REND`, `ISAR`, and `ISAR_ENC` are optional and are only included if explicitly selected as plain test-group tokens or added via `+REND`, `+ISAR`, `+ISAR_ENC`, or `+ISAR*`.
When `--filter LEVEL1` is specified, the following default tests are run:
@@ -253,19 +254,19 @@ When `--filter LEVEL1` is specified, the following default tests are run:
-`MONO` output format: all bitrates.
-`STEREO` output format: all bitrates.
- The default `LEVEL1` tests may be restricted by adding more terms (acting as logical AND).
- The default `LEVEL1` tests may be restricted by adding more tokens (acting as logical AND).
- Example: `--filter LEVEL1 DEC MONO` keeps only `MONO` tests from the LEVEL1-eligible DEC set.
- Example: `--filter LEVEL1 JBM` keeps all LEVEL1-eligible ENC tests but only JBM tests from the LEVEL1-eligible DEC tests.
-`+TERM` adds tests to the final LEVEL1 selection, even if they would otherwise be restricted.
-`+TOKEN` adds tests to the final LEVEL1 selection, even if they would otherwise be restricted.
- Example: `--filter LEVEL1 DEC JBM +BINAURAL` runs only JBM-matching LEVEL1 DEC tests and additionally includes DEC tests containing `BINAURAL` keyword, i.e. `BINAURAL`, `BINAURAL_IR`, `BINAURAL_ROOM_IR`, `BINAURAL_REVERB`.
-`-TERM` removes matching tests from the final LEVEL1 selection (including tests added via `+TERM`).
-`-TOKEN` removes matching tests from the final LEVEL1 selection (including tests added via `+TOKEN`).
- Example: `--filter LEVEL1 DEC +JBM -VOIP` adds JBM-matching DEC tests and then excludes any DEC tests containing the keyword `VOIP`.
- Renderer and ISAR tests are not run by default in `LEVEL1`.
- Add `+REND` and/or `+ISAR` in `--filter` to include them.
-If`+ISAR` is provided, both `ISAR` and `ISAR_ENC` testgroups are run.
- Add `+REND`, `+ISAR`, and/or `+ISAR_ENC` in `--filter` to include them.
-Use`+ISAR*` if you want wildcard expansion across all `ISAR*`-prefixed test-group tokens.
When `--filter LEVEL2` is specified, all selection rules above remain the same,
except bitrate caps are relaxed to 192 kbps:
except the bitrate cap is set to 192 kbps:
- Encoder (`ENC`) tests: only tests with bitrate up to 192 kbps (inclusive).
- Decoder (`DEC`) tests:
@@ -273,14 +274,7 @@ except bitrate caps are relaxed to 192 kbps:
-`MONO` output format: all bitrates.
-`STEREO` output format: all bitrates.
When `--filter LEVEL3` is specified, all selection rules above remain the same,
with no bitrate caps:
- Encoder (`ENC`) tests: all bitrates.
- Decoder (`DEC`) tests:
-`EXT` output format: all bitrates.
-`MONO` output format: all bitrates.
-`STEREO` output format: all bitrates.
When `--filter LEVEL3` is specified, there are no restrictions on the bitrate or output formats.