Class - builtin.flatfile.flatfile.iov2.regex.RegexInput

JSON Schema

RegexInput

Use a regex or glob pattern to select files and process them with a base input.

This inputter allows users to specify a regex or glob pattern to filter files in the Runner’s data folder. The matched files are then processed by the specified base input.

Use regex to filter and process files:
{

“use”: “mitto.iov2.input#RegexInput”, “base”: “xsv.iov2#XsvInput2”, “regex”: “^.*.csv$”

}

Use glob to filter and process files:
{

“use”: “mitto.iov2.input#RegexInput”, “base”: “xsv.iov2#XsvInput2”, “glob”: “**/*.csv”

}

Use additional options (kwargs), like in this xsv.iov2#XsvInput2:
{

“use”: “mitto.iov2.input#RegexInput”, “base”: “xsv.iov2#XsvInput2”, “regex”: “^.*.csv$”, “skip”: 3, “delimiter”: “,”

}

type

object

properties

  • base

Base

Fully qualified name of the base input to use for processing files. Supported values include: flatfile.iov2#JsonInput, flatfile.iov2#JsonlInput, flatfile.iov2#ExcelInput, flatfile.iov2#DbfInput, xsv.iov2#XsvInput2.

type

string

examples

flatfile.iov2#DbfInput

flatfile.iov2#ExcelInput

flatfile.iov2#JsonInput

flatfile.iov2#JsonlInput

xsv.iov2#XsvInput2

  • regex

Regex

Regular expression pattern to filter files.

type

string

  • glob

Glob

Glob pattern to filter files.

type

string