Type object
Schema URL https://catalog.lintel.tools/schemas/schemastore/serverless-framework-configuration/_shared/latest--aws-databrew-dataset.json
Parent schema serverless-framework-configuration
Type: object

Properties

Name string | Aws_CF_FunctionString required

Dataset name

Input object required

Input

4 nested properties
S3InputDefinition object

Input location

2 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
DataCatalogInputDefinition object
4 nested properties
CatalogId string | Aws_CF_FunctionString

Catalog id

DatabaseName string | Aws_CF_FunctionString

Database name

TableName string | Aws_CF_FunctionString

Table name

TempDirectory object

Input location

2 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
DatabaseInputDefinition object
4 nested properties
GlueConnectionName string | Aws_CF_FunctionString required

Glue connection name

DatabaseTableName string | Aws_CF_FunctionString

Database table name

TempDirectory object

Input location

2 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
QueryString string | Aws_CF_FunctionString

Custom SQL to run against the provided AWS Glue connection. This SQL will be used as the input for DataBrew projects and jobs.

Metadata object
1 nested properties
SourceArn string | Aws_CF_FunctionString

Arn of the source of the dataset. For e.g.: AppFlow Flow ARN.

Format string | Aws_CF_FunctionString

Dataset format

FormatOptions object

Format options for dataset

3 nested properties
Json object

Json options

1 nested properties
MultiLine boolean
Excel object
One of: variant, variant
3 nested properties
SheetNames string[]
minItems=1maxItems=1
SheetIndexes integer[]
minItems=1maxItems=1
HeaderRow boolean
Csv object

Csv options

2 nested properties
Delimiter string | Aws_CF_FunctionString
HeaderRow boolean
PathOptions object

Path options for dataset

3 nested properties
FilesLimit object
3 nested properties
MaxFiles integer required

Maximum number of files

OrderedBy string | Aws_CF_FunctionString

Ordered by

Order string | Aws_CF_FunctionString

Order

LastModifiedDateCondition object
2 nested properties
Expression string | Aws_CF_FunctionString required

Filtering expression for a parameter

ValuesMap FilterValue[] required
Parameters PathParameter[]
Tags Tag[]

Definitions

JsonOptions object

Json options

MultiLine boolean
ExcelOptions object
SheetNames string[]
minItems=1maxItems=1
SheetIndexes integer[]
minItems=1maxItems=1
HeaderRow boolean
CsvOptions object

Csv options

Delimiter string | Aws_CF_FunctionString
HeaderRow boolean
FormatOptions object

Format options for dataset

Json object

Json options

1 nested properties
MultiLine boolean
Excel object
One of: variant, variant
3 nested properties
SheetNames string[]
minItems=1maxItems=1
SheetIndexes integer[]
minItems=1maxItems=1
HeaderRow boolean
Csv object

Csv options

2 nested properties
Delimiter string | Aws_CF_FunctionString
HeaderRow boolean
Input object

Input

S3InputDefinition object

Input location

2 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
DataCatalogInputDefinition object
4 nested properties
CatalogId string | Aws_CF_FunctionString

Catalog id

DatabaseName string | Aws_CF_FunctionString

Database name

TableName string | Aws_CF_FunctionString

Table name

TempDirectory object

Input location

2 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
DatabaseInputDefinition object
4 nested properties
GlueConnectionName string | Aws_CF_FunctionString required

Glue connection name

DatabaseTableName string | Aws_CF_FunctionString

Database table name

TempDirectory object

Input location

2 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
QueryString string | Aws_CF_FunctionString

Custom SQL to run against the provided AWS Glue connection. This SQL will be used as the input for DataBrew projects and jobs.

Metadata object
1 nested properties
SourceArn string | Aws_CF_FunctionString

Arn of the source of the dataset. For e.g.: AppFlow Flow ARN.

S3Location object

Input location

Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
DataCatalogInputDefinition object
CatalogId string | Aws_CF_FunctionString

Catalog id

DatabaseName string | Aws_CF_FunctionString

Database name

TableName string | Aws_CF_FunctionString

Table name

TempDirectory object

Input location

2 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
DatabaseInputDefinition object
GlueConnectionName string | Aws_CF_FunctionString required

Glue connection name

DatabaseTableName string | Aws_CF_FunctionString

Database table name

TempDirectory object

Input location

2 nested properties
Bucket string | Aws_CF_FunctionString required
Key string | Aws_CF_FunctionString
QueryString string | Aws_CF_FunctionString

Custom SQL to run against the provided AWS Glue connection. This SQL will be used as the input for DataBrew projects and jobs.

Metadata object
SourceArn string | Aws_CF_FunctionString

Arn of the source of the dataset. For e.g.: AppFlow Flow ARN.

PathOptions object

Path options for dataset

FilesLimit object
3 nested properties
MaxFiles integer required

Maximum number of files

OrderedBy string | Aws_CF_FunctionString

Ordered by

Order string | Aws_CF_FunctionString

Order

LastModifiedDateCondition object
2 nested properties
Expression string | Aws_CF_FunctionString required

Filtering expression for a parameter

ValuesMap FilterValue[] required
Parameters PathParameter[]
FilesLimit object
MaxFiles integer required

Maximum number of files

OrderedBy string | Aws_CF_FunctionString

Ordered by

Order string | Aws_CF_FunctionString

Order

PathParameter object

A key-value pair to associate dataset parameter name with its definition.

PathParameterName string | Aws_CF_FunctionString required

Parameter name

DatasetParameter object required
5 nested properties
Name string | Aws_CF_FunctionString required

Parameter name

Type string | Aws_CF_FunctionString required

Parameter type

DatetimeOptions object
3 nested properties
Format string | Aws_CF_FunctionString required

Date/time format of a date parameter

TimezoneOffset string | Aws_CF_FunctionString

Timezone offset

LocaleCode string | Aws_CF_FunctionString

Locale code for a date parameter

CreateColumn boolean

Add the value of this parameter as a column in a dataset.

Filter object
2 nested properties
Expression string | Aws_CF_FunctionString required

Filtering expression for a parameter

ValuesMap FilterValue[] required
PathParameterName string | Aws_CF_FunctionString

Parameter name

DatasetParameter object
Name string | Aws_CF_FunctionString required

Parameter name

Type string | Aws_CF_FunctionString required

Parameter type

DatetimeOptions object
3 nested properties
Format string | Aws_CF_FunctionString required

Date/time format of a date parameter

TimezoneOffset string | Aws_CF_FunctionString

Timezone offset

LocaleCode string | Aws_CF_FunctionString

Locale code for a date parameter

CreateColumn boolean

Add the value of this parameter as a column in a dataset.

Filter object
2 nested properties
Expression string | Aws_CF_FunctionString required

Filtering expression for a parameter

ValuesMap FilterValue[] required
DatetimeOptions object
Format string | Aws_CF_FunctionString required

Date/time format of a date parameter

TimezoneOffset string | Aws_CF_FunctionString

Timezone offset

LocaleCode string | Aws_CF_FunctionString

Locale code for a date parameter

FilterExpression object
Expression string | Aws_CF_FunctionString required

Filtering expression for a parameter

ValuesMap FilterValue[] required
FilterValue object

A key-value pair to associate expression variable names with their values

ValueReference string | Aws_CF_FunctionString required

Variable name

Value string | Aws_CF_FunctionString required
Tag object

A key-value pair to associate with a resource.

Key string | Aws_CF_FunctionString required
Value string | Aws_CF_FunctionString required