Type object
Schema URL https://catalog.lintel.tools/schemas/schemastore/serverless-framework-configuration/_shared/latest--aws-databrew-job.json
Parent schema serverless-framework-configuration
Type: object

Properties

Name string | Aws_CF_FunctionString required

Job name

Type string | Aws_CF_FunctionString required

Job type

RoleArn string | Aws_CF_FunctionString required

Role arn

DatasetName string | Aws_CF_FunctionString

Dataset name

EncryptionKeyArn string | Aws_CF_FunctionString

Encryption Key Arn

EncryptionMode string | Aws_CF_FunctionString

Encryption mode

LogSubscription string | Aws_CF_FunctionString

Log subscription

MaxCapacity integer

Max capacity

MaxRetries integer

Max retries

Outputs Output[]
DataCatalogOutputs DataCatalogOutput[]
DatabaseOutputs DatabaseOutput[]
OutputLocation object

Output location

3 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
BucketOwner string | Aws_CF_FunctionString
ProjectName string | Aws_CF_FunctionString

Project name

Recipe object
2 nested properties
Name string | Aws_CF_FunctionString required

Recipe name

Version string | Aws_CF_FunctionString

Recipe version

Tags Tag[]
Timeout integer

Timeout

JobSample object

Job Sample

2 nested properties
Mode string | Aws_CF_FunctionString

Sample configuration mode for profile jobs.

Size integer

Sample configuration size for profile jobs.

format=int64
ProfileConfiguration object
4 nested properties
DatasetStatisticsConfiguration object
2 nested properties
IncludedStatistics Statistic[]
minItems=1
minItems=1
ProfileColumns ColumnSelector[]
minItems=1
ColumnStatisticsConfigurations ColumnStatisticsConfiguration[]
minItems=1
EntityDetectorConfiguration object
2 nested properties
EntityTypes string[] required
minItems=1
AllowedStatistics object
1 nested properties
Statistics Statistic[] required
minItems=1
ValidationConfigurations ValidationConfiguration[]

Data quality rules configuration

Definitions

S3Location object

S3 Output location

Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
BucketOwner string | Aws_CF_FunctionString
CsvOutputOptions object

Output Csv options

Delimiter string | Aws_CF_FunctionString
OutputFormatOptions object

Format options for job Output

Csv object

Output Csv options

1 nested properties
Delimiter string | Aws_CF_FunctionString
OutputLocation object

Output location

Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
BucketOwner string | Aws_CF_FunctionString
Output object
Location object required

S3 Output location

3 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
BucketOwner string | Aws_CF_FunctionString
CompressionFormat string | Aws_CF_FunctionString
Format string | Aws_CF_FunctionString
FormatOptions object

Format options for job Output

1 nested properties
Csv object

Output Csv options

1 nested properties
Delimiter string | Aws_CF_FunctionString
PartitionColumns string[]
uniqueItems=true
Overwrite boolean
MaxOutputFiles integer
min=1max=999
DataCatalogOutput object
DatabaseName string | Aws_CF_FunctionString required
TableName string | Aws_CF_FunctionString required
CatalogId string | Aws_CF_FunctionString
S3Options object
1 nested properties
Location object required

S3 Output location

3 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
BucketOwner string | Aws_CF_FunctionString
DatabaseOptions object
2 nested properties
TableName string | Aws_CF_FunctionString required
TempDirectory object

S3 Output location

3 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
BucketOwner string | Aws_CF_FunctionString
Overwrite boolean
S3TableOutputOptions object
Location object required

S3 Output location

3 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
BucketOwner string | Aws_CF_FunctionString
DatabaseTableOutputOptions object
TableName string | Aws_CF_FunctionString required
TempDirectory object

S3 Output location

3 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
BucketOwner string | Aws_CF_FunctionString
DatabaseOutput object
GlueConnectionName string | Aws_CF_FunctionString required

Glue connection name

DatabaseOptions object required
2 nested properties
TableName string | Aws_CF_FunctionString required
TempDirectory object

S3 Output location

3 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
BucketOwner string | Aws_CF_FunctionString
DatabaseOutputMode string | Aws_CF_FunctionString

Database table name

Recipe object
Name string | Aws_CF_FunctionString required

Recipe name

Version string | Aws_CF_FunctionString

Recipe version

Tag object

A key-value pair to associate with a resource.

Key string | Aws_CF_FunctionString required
Value string | Aws_CF_FunctionString required
SampleMode string | Aws_CF_FunctionString

Sample configuration mode for profile jobs.

JobSize integer

Sample configuration size for profile jobs.

JobSample object

Job Sample

Mode string | Aws_CF_FunctionString

Sample configuration mode for profile jobs.

Size integer

Sample configuration size for profile jobs.

format=int64
ProfileConfiguration object
DatasetStatisticsConfiguration object
2 nested properties
IncludedStatistics Statistic[]
minItems=1
minItems=1
ProfileColumns ColumnSelector[]
minItems=1
ColumnStatisticsConfigurations ColumnStatisticsConfiguration[]
minItems=1
EntityDetectorConfiguration object
2 nested properties
EntityTypes string[] required
minItems=1
AllowedStatistics object
1 nested properties
Statistics Statistic[] required
minItems=1
EntityDetectorConfiguration object
EntityTypes string[] required
minItems=1
AllowedStatistics object
1 nested properties
Statistics Statistic[] required
minItems=1
AllowedStatistics object
Statistics Statistic[] required
minItems=1
ColumnStatisticsConfiguration object
Statistics object required
2 nested properties
IncludedStatistics Statistic[]
minItems=1
minItems=1
Selectors ColumnSelector[]
minItems=1
StatisticsConfiguration object
IncludedStatistics Statistic[]
minItems=1
minItems=1
ColumnSelector object
Regex string | Aws_CF_FunctionString
Name string | Aws_CF_FunctionString
Statistic string | Aws_CF_FunctionString
StatisticOverride object
Statistic string | Aws_CF_FunctionString required
Parameters object required
ParameterMap object
ValidationMode string | Aws_CF_FunctionString
ValidationConfiguration object

Configuration to attach Rulesets to the job

RulesetArn string | Aws_CF_FunctionString required

Arn of the Ruleset

ValidationMode string | Aws_CF_FunctionString