Kafka Connect Elasticsearch Sink 连接器写入索引实践

---

title: Kafka Connect Elasticsearch Sink 连接器写入索引实践

keywords: ElasticsearchSinkConnector, connection.url, index, key.ignore, write.method

description: 使用 Elasticsearch Sink 连接器将 Kafka 主题写入索引，配置连接与写入模式、键处理与容错策略。

tags:

• Elasticsearch
• ElasticsearchSinkConnector
• Kafka
• connection.url
• index
• key.ignore
• write.method
• 数据流

categories:

• 文章资讯
• 技术教程

---

es-sink.json：

{
  "name": "es-sink",
  "config": {
    "connector.class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
    "tasks.max": "2",
    "topics": "orders",
    "connection.url": "http://es:9200",
    "key.ignore": "false",
    "write.method": "upsert",
    "type.name": "_doc",
    "behavior.on.malformed.documents": "ignore",
    "schema.ignore": "true",
    "max.in.flight.requests": "1",
    "flush.timeout.ms": "60000",
    "batch.size": "2000",
    "max.buffered.records": "20000"
  }
}

REST 创建与状态：

curl -X POST -H "Content-Type: application/json" --data @es-sink.json http://localhost:8083/connectors
curl http://localhost:8083/connectors/es-sink/status