SingleStore DB Job Components - Details and Properties

Property Type

Either Built-in or Repository. Since version 5.6, both the Built-In mode and the Repository mode are available in any of the Talend solutions.

Built-in: No property data stored centrally.

Repository: Select the repository file in which the properties are stored. The fields that follow are completed automatically using the data retrieved.

Use an existing connection

Select this check box and in the Component List click the relevant connection component to reuse the connection details you already defined. Note: When a Job contains the parent Job and the child Job, if you need to share an existing connection between the two levels, for example, to share the connection created by the parent Job with the child Job, you have to: 1. In the parent level, register the database connection to be shared in the Basic settings view of the connection component which creates that very database connection. 2. In the child level, use a dedicated connection component to read that registered database connection. For an example about how to share a database connection across Job levels, see the Talend Studio User Guide.

jdbcUrl

Enter the JDBC compliant URL to SingleStore DB along with additional JDBC parameters. This component utilizes the MariaDB driver.

Username and Password

Enter the authentication data used to connect to the SingleStore DB database to be used.

Schema and Edit Schema

A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. The schema is either Built-In or stored remotely in the Repository. This component offers the advantage of the dynamic schema feature. This allows you to retrieve unknown columns from source files or to copy batches of columns from a source without mapping each column individually. For further information about dynamic schemas, see the Talend Studio User Guide. This dynamic schema feature is designed for the purpose of retrieving unknown columns of a table and is recommended to be used for this purpose only; it is not recommended for the use of creating tables.

Built-In: You create and store the schema locally for this component only. Related topic: see the Talend Studio User Guide.

Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs. Related topic: see the Talend Studio User Guide.

Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

Table Name

Name of the table to be read.

Property type

Either Built-in or Repository. Since version 5.6, both the Built-In mode and the Repository mode are available in any of the Talend solutions.

Built-in: No property data stored centrally.

Repository: Select the repository file in which the properties are stored. The fields that follow are completed automatically using the data retrieved.

Use an existing connection

Select this check box and in the Component List click the relevant connection component to reuse the connection details you already defined. Note: When a Job contains the parent Job and the child Job, if you need to share an existing connection between the two levels, for example, to share the connection created by the parent Job with the child Job, you have to: 1. In the parent level, register the database connection to be shared in the Basic settings view of the connection component which creates that very database connection. 2. In the child level, use a dedicated connection component to read that registered database connection. For an example about how to share a database connection across Job levels, see the Talend Studio User Guide.

jdbcUrl

Enter the JDBC compliant URL to SingleStore DB along with additional JDBC parameters. This component utilizes the MariaDB driver.

Username and Password

Enter the authentication data used to connect to the SingleStore DB database to be used.

Schema and Edit Schema

A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. The schema is either Built-In or stored remotely in the Repository. This component offers the advantage of the dynamic schema feature. This allows you to retrieve unknown columns from source files or to copy batches of columns from a source without mapping each column individually. For further information about dynamic schemas, see the Talend Studio User Guide. This dynamic schema feature is designed for the purpose of retrieving unknown columns of a table and is recommended to be used for this purpose only; it is not recommended for the use of creating tables.

Built-In: You create and store the schema locally for this component only. Related topic: see the Talend Studio User Guide.

Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs. Related topic: see the Talend Studio User Guide.

Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

Query

Must be a SELECT only query

Property type

Either Built-in or Repository. Since version 5.6, both the Built-In mode and the Repository mode are available in any of the Talend solutions.

Built-in: No property data stored centrally.

Repository: Select the repository file in which the properties are stored. The fields that follow are completed automatically using the data retrieved.

Use an existing connection

Select this check box and in the Component List click the relevant connection component to reuse the connection details you already defined. Note: When a Job contains the parent Job and the child Job, if you need to share an existing connection between the two levels, for example, to share the connection created by the parent Job with the child Job, you have to: 1. In the parent level, register the database connection to be shared in the Basic settings view of the connection component which creates that very database connection. 2. In the child level, use a dedicated connection component to read that registered database connection. For an example about how to share a database connection across Job levels, see the Talend Studio User Guide.

jdbcUrl

Enter the JDBC compliant URL to SingleStore DB along with additional JDBC parameters. This component utilizes the MariaDB driver.

Username and Password

Enter the authentication data used to connect to the SingleStore DB database to be used.

Table

Enter the name of the table to be written. Note that only one table can be written at a time

If table is not present, then under Custom you can enter the name of the table. The “Create If Not Exists” property must also be selected as this will then create the table in the SingleStore DB instance.

Create table if not exists

The table is created if it does not exist.

varcharLength

If “Create table if not exists” is checked then you can enter the max size of varchar fields. Default: -1 This means typically 255

keys

If “Create table if not exists” is checked OR Action on Data is Update / Upsert. Then user can enter which field(s) should be marked as keys

ignoreUpdate

If Action on Data is Update / Upsert then user can enter which field(s) should be ignored when component performs Update statement.

rewriteBatchStatements

If checked will create a single batch operation to be executed on the SingleStore DB instance

truncateTable

If checked will truncate data in the selected table before performing the given action selected.

Action on data

On the data of the table defined, you can perform:

Insert: Add new entries to the table. If duplicates are found, the job stops.

Update: Make changes to existing entries.

Upsert: Insert a new record. If the record with the given reference already exists, an update would be made.

Delete: Remove entries corresponding to the input flow.

Bulk Load: Uses the SingleStore DB bulk load command.

Warning: You must specify at least one column as a primary key on which the Update and Delete operations are based. You can do that by clicking Edit Schema and selecting the check box(es) next to the column(s) you want to set as primary key(s). For an advanced use, click the Advanced settings view where you can simultaneously define primary keys for the update and delete operations. To do that: Select the Use field options check box and then in the Key in update column, select the check boxes next to the column name on which you want to base the update operation. Do the same in the Key in delete column for the deletion operation.

Schema and Edit schema

A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. The schema is either Built-In or stored remotely in the Repository. This component offers the advantage of the dynamic schema feature. This allows you to retrieve unknown columns from source files or to copy batches of columns from a source without mapping each column individually. For further information about dynamic schemas, see the Talend Studio User Guide. This dynamic schema feature is designed for the purpose of retrieving unknown columns of a table and is recommended to be used for this purpose only; it is not recommended for the use of creating tables.

Built-In: You create and store the schema locally for this component only. Related topic: see the Talend Studio User Guide.

Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs. Related topic: see the Talend Studio User Guide. When the schema to be reused has default values that are integers or functions, ensure that these default values are not enclosed within quotation marks. If they are, you must remove the quotation marks manually. For more details, see Verifying default values in a retrieved schema.

Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

Use Batch Size

Select this check box to activate the batch mode for data processing. In the Batch Size field that appears when this check box is selected, you can type in the number you need to define the batch size to be processed.