kafka not assigning replica as leader after all brokers down
up vote
0
down vote
favorite
I have 2 node kafka cluster (replica 0,1) and 3 zookeeper setup.
I tried bring down both kafka nodes (0, 1) for sometime then when I am describing a topic its showing replica 0 as leader as kafka was brought down at the end in replica 0.
$ ./kafka-topics.sh --zookeeper zoo1:2181 --topic test1 --describe
Topic: test1 PartitionCount:8 ReplicationFactor:2 Configs:
Topic: test1 Partition: 0 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 1 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 2 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 3 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 4 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 5 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 6 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 7 Leader: 0 Replicas: 0,1 Isr: 0
Case 1: But when I brings up kafka in replica 1 its still showing same output as above and its not changing it to replica 1 as it up now. And mesage produce and consume is failing for old topics (while for newer topics its working).
Case 2: Now Again I stopped kafka on replica 1 and started on replica 0 then it starts working.
Any there any such tool or any configuration which can assign replica forcefully so that this scenario can be addressed?
Leadership and ISR updating is also huge time.
apache-kafka
add a comment |
up vote
0
down vote
favorite
I have 2 node kafka cluster (replica 0,1) and 3 zookeeper setup.
I tried bring down both kafka nodes (0, 1) for sometime then when I am describing a topic its showing replica 0 as leader as kafka was brought down at the end in replica 0.
$ ./kafka-topics.sh --zookeeper zoo1:2181 --topic test1 --describe
Topic: test1 PartitionCount:8 ReplicationFactor:2 Configs:
Topic: test1 Partition: 0 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 1 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 2 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 3 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 4 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 5 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 6 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 7 Leader: 0 Replicas: 0,1 Isr: 0
Case 1: But when I brings up kafka in replica 1 its still showing same output as above and its not changing it to replica 1 as it up now. And mesage produce and consume is failing for old topics (while for newer topics its working).
Case 2: Now Again I stopped kafka on replica 1 and started on replica 0 then it starts working.
Any there any such tool or any configuration which can assign replica forcefully so that this scenario can be addressed?
Leadership and ISR updating is also huge time.
apache-kafka
Those aren't "replica" numbers, justbroker.idfrom the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?
– cricket_007
yesterday
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I have 2 node kafka cluster (replica 0,1) and 3 zookeeper setup.
I tried bring down both kafka nodes (0, 1) for sometime then when I am describing a topic its showing replica 0 as leader as kafka was brought down at the end in replica 0.
$ ./kafka-topics.sh --zookeeper zoo1:2181 --topic test1 --describe
Topic: test1 PartitionCount:8 ReplicationFactor:2 Configs:
Topic: test1 Partition: 0 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 1 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 2 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 3 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 4 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 5 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 6 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 7 Leader: 0 Replicas: 0,1 Isr: 0
Case 1: But when I brings up kafka in replica 1 its still showing same output as above and its not changing it to replica 1 as it up now. And mesage produce and consume is failing for old topics (while for newer topics its working).
Case 2: Now Again I stopped kafka on replica 1 and started on replica 0 then it starts working.
Any there any such tool or any configuration which can assign replica forcefully so that this scenario can be addressed?
Leadership and ISR updating is also huge time.
apache-kafka
I have 2 node kafka cluster (replica 0,1) and 3 zookeeper setup.
I tried bring down both kafka nodes (0, 1) for sometime then when I am describing a topic its showing replica 0 as leader as kafka was brought down at the end in replica 0.
$ ./kafka-topics.sh --zookeeper zoo1:2181 --topic test1 --describe
Topic: test1 PartitionCount:8 ReplicationFactor:2 Configs:
Topic: test1 Partition: 0 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 1 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 2 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 3 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 4 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 5 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 6 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 7 Leader: 0 Replicas: 0,1 Isr: 0
Case 1: But when I brings up kafka in replica 1 its still showing same output as above and its not changing it to replica 1 as it up now. And mesage produce and consume is failing for old topics (while for newer topics its working).
Case 2: Now Again I stopped kafka on replica 1 and started on replica 0 then it starts working.
Any there any such tool or any configuration which can assign replica forcefully so that this scenario can be addressed?
Leadership and ISR updating is also huge time.
apache-kafka
apache-kafka
edited 2 days ago
Giorgos Myrianthous
3,50121233
3,50121233
asked 2 days ago
dcds
702215
702215
Those aren't "replica" numbers, justbroker.idfrom the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?
– cricket_007
yesterday
add a comment |
Those aren't "replica" numbers, justbroker.idfrom the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?
– cricket_007
yesterday
Those aren't "replica" numbers, just
broker.id from the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?– cricket_007
yesterday
Those aren't "replica" numbers, just
broker.id from the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?– cricket_007
yesterday
add a comment |
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53206186%2fkafka-not-assigning-replica-as-leader-after-all-brokers-down%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Those aren't "replica" numbers, just
broker.idfrom the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?– cricket_007
yesterday