Problem package test group metadata
Test group metadata for programming tasks in the Kattis/CLICS problem package format
| Type | object |
|---|---|
| File match |
test_group.yml
test_group.yaml
|
| Schema URL | https://catalog.lintel.tools/schemas/schemastore/problem-package-test-group-metadata/latest.json |
| Source | https://raw.githubusercontent.com/RagnarGrootKoerkamp/BAPCtools/refs/heads/main/bapctools/resources/support/schemas/test_group_yaml_schema.json |
Validate with Lintel
npx @lintel/lintel check
Type:
object
Properties
data
data_dict | data_list[]
include
path[]
Definitions
command
string
config
object
random_salt
string
solution
string
pattern=^/?([a-zA-Z0-9_][a-zA-Z0-9_.-]{0,254}/)*[a-zA-Z0-9_][a-zA-Z0-9_.-]{0,254}$
data_dict
object
data_list
object
path
string
test_case
string | object
test_case_configuration
object
args
string[]
full_feedback
boolean
input_validator_args
string[] | object
input_visualizer_args
string[]
output_validator_args
string[]
output_visualizer_args
string[]
test_case_or_group_configuration
object
args
string[]
full_feedback
boolean
input_validator_args
string[] | object
input_visualizer_args
string[]
output_validator_args
string[]
output_visualizer_args
string[]
test_data_group
string
test_group
object
test_group.yaml
object
4 nested properties
max_score
const: "unbounded"
require_pass
const: "sample" | test_data_group | const: "sample" | test_data_group[]
score_aggregation
enum
static_validation_score
const: "pass-fail"
test_group_config
object
random_salt
string
solution
string
pattern=^/?([a-zA-Z0-9_][a-zA-Z0-9_.-]{0,254}/)*[a-zA-Z0-9_][a-zA-Z0-9_.-]{0,254}$
test_group_configuration
object
args
string[]
full_feedback
boolean
input_validator_args
string[] | object
input_visualizer_args
string[]
output_validator_args
string[]
output_visualizer_args
string[]