Skip to main content

Doris batch Sink

1、Introduce​

Doris batch Sink插件支持向Doris数据库写入数据

2、Version Support​

Doris 0.14.x

3、Connector name​

Syncdorisbatchsink、dorisbatchwriter
SQL

4、Parameter description​

1.Sync​

  • feNodes
    • Description：Connect to the Fe Nodes address of Doris
    • Required：required
    • Type：List
    • Default none
"feNodes": ["127.0.0.1:8030"]

  • table
    • Description: doris table name, only support one table in a single work at the moment.
    • Required:required
    • Type:List
    • Default:none

  • database
    • Description:doris database schema
    • Required:optional
    • Type:string
    • Default:none

  • username

    • Description: user name
    • Required:required
    • Type:String
    • Default:none

  • password

    • Description: password
    • Required:required
    • Type:String
    • Default:none

  • column
    • Description:the fields to be written to the destination table,which is separated by English commas.for example: "column": ["id","name","age"]
    • Required:required
    • Type:List
    • Default:none

  • fieldDelimiter
    • Description：Writes the field separator for the Doris value
    • Required：optional
    • Type：String
    • Default：\t

  • lineDelimiter
    • Description：Writes the line delimiter for the Doris value
    • Required：optional
    • Type：String
    • Default：\n

  • loadProperties
    • Description：System parameters for Doris write task, mainly for Doris specific configuration
    • Required：optional
    • Type：Object
    • Default：none

  • batchSize
    • Description：The amount of data written to Doris in batches
    • Required：optional
    • Type：int
    • Default：1000

5、Supported data type​

supporteddata type
yesBOOLEAN、TINYINT、SMALLINT、INT、BIGINT、LARGEINT、FLOAT、DOUBLE、DECIMAL、DATE、DATETIME、CHAR、VARCHAR、STRING

6、Demo​

see details in flinkx-examples dir of project flinkx.