EXPORT TABLE TO S3 ，error Msg curlCode: 6, Couldn't resolve host name

[heichong]

Please help me, I export table data to S3(MINIO) , get error : Couldn't resolve host name

export：

EXPORT TABLE t_stat_contract_increment_year TO "s3://doris/test/" WITH S3  (
        "AWS_ENDPOINT" = "http://10.3.23.117:19000",
        "AWS_ACCESS_KEY" = "doris_oss",
        "AWS_SECRET_KEY"="详细信息xxxxxxxx",
        "AWS_REGION" = ""
    );

show EXPORT\G ;：

*************************** 1. row ***************************
      JobId: 140219
      Label: export_384a9f38-a4e0-49cf-85f2-8b1caaf2ff5c
      State: CANCELLED
   Progress: 100%
   TaskInfo: {"partitions":["*"],"max_file_size":"","delete_existing_files":"","columns":"","format":"csv","broker":"S3","column_separator":"\t","line_delimiter":"\n","db":"default_cluster:db_test","tbl":"async_operation_base","tablet_num":0}
       Path: s3://doris/test/
 CreateTime: 2023-09-18 15:12:01
  StartTime: 2023-09-18 15:12:06
 FinishTime: 2023-09-18 15:12:58
    Timeout: 300
   ErrorMsg: type:RUN_FAIL; msg:errCode = 2, detailMessage = (10.3.6.24)[IO_ERROR]failed to create multipart upload(bucket=doris, key=http://10.3.23.117:19000/doris/test/25e949da09674aa3-946ab796a3a1a4cc_0.csv, upload_id=): curlCode: 6, Couldn't resolve
OutfileInfo: NULL

fe.warn log ：

2023-09-18 15:12:32,713 WARN (thrift-server-pool-11|401) [Coordinator.updateFragmentExecStatus():2278] one instance report fail, query_id=25e949da09674aa3-946ab796a3a1a4bf instance_id=25e949da09674aa3-946ab796a3a1a4cc, error message: (10.3.6.24)[IO_ERROR]failed to create multipart upload(bucket=doris, key=http://10.3.23.117:19000/doris/test/25e949da09674aa3-946ab796a3a1a4cc_0.csv, upload_id=): curlCode: 6, Couldn't resolve host name
2023-09-18 15:12:32,713 WARN (thrift-server-pool-11|401) [Coordinator.updateStatus():1137] one instance report fail throw updateStatus(), need cancel. job id: -1, query id: 25e949da09674aa3-946ab796a3a1a4bf, instance id: 25e949da09674aa3-946ab796a3a1a4cc, error message: (10.3.6.24)[IO_ERROR]failed to create multipart upload(bucket=doris, key=http://10.3.23.117:19000/doris/test/25e949da09674aa3-946ab796a3a1a4cc_0.csv, upload_id=): curlCode: 6, Couldn't resolve host name
2023-09-18 15:12:32,762 WARN (thrift-server-pool-11|401) [Coordinator.updateFragmentExecStatus():2278] one instance report fail, query_id=25e949da09674aa3-946ab796a3a1a4bf instance_id=25e949da09674aa3-946ab796a3a1a4c2, error message: (10.3.6.24)[CANCELLED]Cancelled
2023-09-18 15:12:32,764 WARN (thrift-server-pool-9|396) [Coordinator.updateFragmentExecStatus():2278] one instance report fail, query_id=25e949da09674aa3-946ab796a3a1a4bf instance_id=25e949da09674aa3-946ab796a3a1a4c4, error message: (10.3.6.23)[CANCELLED]Cancelled
2023-09-18 15:12:58,801 WARN (export-exporting-job-pool-3|139146) [Coordinator.getNext():1186] query failed: (10.3.6.24)[IO_ERROR]failed to create multipart upload(bucket=doris, key=http://10.3.23.117:19000/doris/test/25e949da09674aa3-946ab796a3a1a4cc_0.csv, upload_id=): curlCode: 6, Couldn't resolve host name
2023-09-18 15:12:58,801 WARN (export-exporting-job-pool-3|139146) [StmtExecutor.sendResult():1483] cancel fragment query_id:25e949da09674aa3-946ab796a3a1a4bf cause errCode = 2, detailMessage = (10.3.6.24)[IO_ERROR]failed to create multipart upload(bucket=doris, key=http://10.3.23.117:19000/doris/test/25e949da09674aa3-946ab796a3a1a4cc_0.csv, upload_id=): curlCode: 6, Couldn't resolve
2023-09-18 15:12:58,801 WARN (export-exporting-job-pool-3|139146) [StmtExecutor.executeByLegacy():763] execute Exception. stmt[416, 25e949da09674aa3-946ab796a3a1a4bf]
org.apache.doris.common.UserException: errCode = 2, detailMessage = (10.3.6.24)[IO_ERROR]failed to create multipart upload(bucket=doris, key=http://10.3.23.117:19000/doris/test/25e949da09674aa3-946ab796a3a1a4cc_0.csv, upload_id=): curlCode: 6, Couldn't resolve
        at org.apache.doris.qe.Coordinator.getNext(Coordinator.java:1193) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.qe.StmtExecutor.sendResult(StmtExecutor.java:1416) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.qe.StmtExecutor.handleQueryStmt(StmtExecutor.java:1368) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.qe.StmtExecutor.handleQueryWithRetry(StmtExecutor.java:604) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.qe.StmtExecutor.executeByLegacy(StmtExecutor.java:697) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:448) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:419) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.task.ExportExportingTask.exec(ExportExportingTask.java:90) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.task.MasterTask.run(MasterTask.java:31) ~[doris-fe.jar:1.2-SNAPSHOT]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_361]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_361]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_361]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_361]
        at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_361]
2023-09-18 15:12:58,807 WARN (export-exporting-job-pool-3|139146) [ExportExportingTask.exec():118] Exporting task failed because Exception: errCode = 2, detailMessage = (10.3.6.24)[IO_ERROR]failed to create multipart upload(bucket=doris, key=http://10.3.23.117:19000/doris/test/25e949da09674aa3-946ab796a3a1a4cc_0.csv, upload_id=): curlCode: 6, Couldn't resolve

Who can help me solve this problem

[yagagagaga]

what's your Doris version?

[yagagagaga]

Execute the following command on 10.3.6.24:

telnet 10.3.23.117 9000

[heichong]

my doris version is 2.0.0
telnet command:

[root@dw-test3 ~]# telnet 10.3.23.117 19000

HTTP/1.1 400 Bad Request
Content-Type: text/plain; charset=utf-8
Connection: close

400 Bad RequestConnection closed by foreign host

I think the port can access it

[heichong]

on 10.3.6.24, I test curl mode and can upload files to S3 doris bucket .

[yagagagaga]

Are you AWS_SECRET_KEY contains Chinese?

[heichong]

No, not contain Chinese 。
AWS_SECRET_KEY IS WZRcXsvPcUNskHgEpUn2vip1KagtPREz

[heichong]

我已经发现了问题，增加use_path_style参数后，export就能成功导出数据。

EXPORT TABLE t_stat_contract_increment_year TO "s3://doris/test/" WITH S3  (
        "AWS_ENDPOINT" = "http://10.3.23.117:19000",
        "AWS_ACCESS_KEY" = "doris_oss",
        "AWS_SECRET_KEY"="xxxxxx",
        "AWS_REGION" = "",
        "use_path_style" = "true"
    );

我觉得这个例子容易误导，应该在这个例子上加上 "use_path_style" = "true"

[yagagagaga]

You can commit a PR to Apache Doris and become Apache Doris Contributor.
https://doris.apache.org/zh-CN/community/how-to-contribute/contribute-doc