You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: documentation/modules/configuring/con-config-mirrormaker2.adoc
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -220,7 +220,7 @@ Standard Apache Kafka configuration may be provided, restricted to those propert
220
220
<16> Cluster alias for the target cluster used by the MirrorMaker 2 connectors.
221
221
<17> Configuration for the `MirrorSourceConnector` that creates remote topics. The `config` overrides the default configuration options.
222
222
<18> The maximum number of tasks that the connector may create. Tasks handle the data replication and run in parallel. If the infrastructure supports the processing overhead, increasing this value can improve throughput. Kafka Connect distributes the tasks between members of the cluster. If there are more tasks than workers, workers are assigned multiple tasks. For sink connectors, aim to have one task for each topic partition consumed. For source connectors, the number of tasks that can run in parallel may also depend on the external system. The connector creates fewer than the maximum number of tasks if it cannot achieve the parallelism.
223
-
<19> Enables automatic restarts of failed connectors and tasks.
223
+
<19> Enables automatic restarts of failed connectors and tasks. By default, the number of restarts is indefinite, but you can set a maximum on the number of automatic restarts using the `maxRestarts` property.
224
224
<20> Replication factor for mirrored topics created at the target cluster.
225
225
<21> Replication factor for the `MirrorSourceConnector` `offset-syncs` internal topic that maps the offsets of the source and target clusters.
226
226
<22> When ACL rules synchronization is enabled, ACLs are applied to synchronized topics. The default is `true`. This feature is not compatible with the User Operator. If you are using the User Operator, set this property to `false`.
Copy file name to clipboardExpand all lines: documentation/modules/deploying/proc-deploying-kafkaconnector.adoc
+8-33Lines changed: 8 additions & 33 deletions
Original file line number
Diff line number
Diff line change
@@ -15,8 +15,7 @@ You remove a connector by deleting its corresponding `KafkaConnector`.
15
15
16
16
`KafkaConnector` resources must be deployed to the same namespace as the Kafka Connect cluster they link to.
17
17
18
-
In the configuration shown in this procedure, the `autoRestart` features is enabled (`enabled: true`).
19
-
This enables automatic restarts of failed connectors and tasks.
18
+
In the configuration shown in this procedure, the `autoRestart` feature is enabled (`enabled: true`) for automatic restarts of failed connectors and tasks.
20
19
You can also annotate the `KafkaConnector` resource to xref:proc-manual-restart-connector-str[restart a connector] or xref:proc-manual-restart-connector-task-str[restart a connector task] manually.
21
20
22
21
.Example connectors
@@ -65,33 +64,9 @@ With the `KafkaConnector` resources enabled, the Cluster Operator watches for th
65
64
66
65
. Edit the `examples/connect/source-connector.yaml` file:
<1> Name of the `KafkaConnector` resource, which is used as the name of the connector. Use any name that is valid for a Kubernetes resource.
88
-
<2> Name of the Kafka Connect cluster to create the connector instance in. Connectors must be deployed to the same namespace as the Kafka Connect cluster they link to.
89
-
<3> Full name or alias of the connector class. This should be present in the image being used by the Kafka Connect cluster.
90
-
<4> Maximum number of Kafka Connect tasks that the connector can create.
91
-
<5> Enables automatic restarts of failed connectors and tasks.
92
-
<6> xref:kafkaconnector-configs[Connector configuration] as key-value pairs.
93
-
<7> This example source connector configuration reads data from the `/opt/kafka/LICENSE` file.
<1> Name of the `KafkaConnector` resource, which is used as the name of the connector. Use any name that is valid for a Kubernetes resource.
204
-
<2> Name of the Kafka Connect cluster to create the connector instance in. Connectors must be deployed to the same namespace as the Kafka Connect cluster they link to.
205
-
<3> Full name of the connector class. This should be present in the image being used by the Kafka Connect cluster.
206
-
<4> Maximum number of Kafka Connect tasks that the connector can create.
207
-
<5> link:{BookURLDeploying}#kafkaconnector-configs[Connector configuration^] as key-value pairs.
208
-
<6> Location of the external data file. In this example, we're configuring the `FileStreamSourceConnector` to read from the `/opt/kafka/LICENSE` file.
NOTE: You can link:{BookURLDeploying}#assembly-loading-config-with-providers-str[load confidential configuration values for a connector^] from external sources, such as Kubernetes Secrets or ConfigMaps.
<1> Name of the `KafkaConnector` resource, which is used as the name of the connector. Use any name that is valid for a Kubernetes resource.
22
+
<2> Name of the Kafka Connect cluster to create the connector instance in. Connectors must be deployed to the same namespace as the Kafka Connect cluster they link to.
23
+
<3> Full name of the connector class. This should be present in the image being used by the Kafka Connect cluster.
24
+
<4> Maximum number of Kafka Connect tasks that the connector can create.
25
+
<5> Enables automatic restarts of failed connectors and tasks. By default, the number of restarts is indefinite, but you can set a maximum on the number of automatic restarts using the `maxRestarts` property.
26
+
<6> link:{BookURLDeploying}#kafkaconnector-configs[Connector configuration^] as key-value pairs.
27
+
<7> Location of the external data file. In this example, we're configuring the `FileStreamSourceConnector` to read from the `/opt/kafka/LICENSE` file.
0 commit comments