1.报错场景

加载数据

[starcross@app1 FLink-test-LT]$ curl --location-trusted -u root:aba -T 'data_2022-04-11.csv' -H "label:testdoris201" -H "column_separator:," -XPUT http://10.22.33.69:8030/api/os/ws/_stream_load

2.报错内容

{
    "TxnId": 831311,
    "Label": "testdoris201",
    "Status": "Fail",
    "Message": "too many filtered rows",
    "NumberTotalRows": 1,
    "NumberLoadedRows": 0,
    "NumberFilteredRows": 1,
    "NumberUnselectedRows": 0,
    "LoadBytes": 1050,
    "LoadTimeMs": 85,
    "BeginTxnTimeMs": 0,
    "StreamLoadPutTimeMs": 1,
    "ReadDataTimeMs": 0,
    "WriteDataTimeMs": 57,
    "CommitAndPublishTimeMs": 0,
    "ErrorURL": "http://192.168.1.6:8040/api/_load_error_log?file=__shard_32/error_log_insert_stmt_b84753506aa7e6e9-434467e6d4a8a49e_b84753506aa7e6e9_434467e6d4a8a49e"
}

3.解决方案

1.加载数据与对应doris表字段不一致,调整一致即可
2.对应doris表无对应数据分区,调整数据或分区即可

Logo

AtomGit 是由开放原子开源基金会联合 CSDN 等生态伙伴共同推出的新一代开源与人工智能协作平台。平台坚持“开放、中立、公益”的理念,把代码托管、模型共享、数据集托管、智能体开发体验和算力服务整合在一起,为开发者提供从开发、训练到部署的一站式体验。

更多推荐