kafka not assigning replica as leader after all brokers down









up vote
0
down vote

favorite












I have 2 node kafka cluster (replica 0,1) and 3 zookeeper setup.



I tried bring down both kafka nodes (0, 1) for sometime then when I am describing a topic its showing replica 0 as leader as kafka was brought down at the end in replica 0.



$ ./kafka-topics.sh --zookeeper zoo1:2181 --topic test1 --describe
Topic: test1 PartitionCount:8 ReplicationFactor:2 Configs:
Topic: test1 Partition: 0 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 1 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 2 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 3 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 4 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 5 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 6 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 7 Leader: 0 Replicas: 0,1 Isr: 0


Case 1: But when I brings up kafka in replica 1 its still showing same output as above and its not changing it to replica 1 as it up now. And mesage produce and consume is failing for old topics (while for newer topics its working).



Case 2: Now Again I stopped kafka on replica 1 and started on replica 0 then it starts working.



Any there any such tool or any configuration which can assign replica forcefully so that this scenario can be addressed?



Leadership and ISR updating is also huge time.










share|improve this question























  • Those aren't "replica" numbers, just broker.id from the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?
    – cricket_007
    yesterday














up vote
0
down vote

favorite












I have 2 node kafka cluster (replica 0,1) and 3 zookeeper setup.



I tried bring down both kafka nodes (0, 1) for sometime then when I am describing a topic its showing replica 0 as leader as kafka was brought down at the end in replica 0.



$ ./kafka-topics.sh --zookeeper zoo1:2181 --topic test1 --describe
Topic: test1 PartitionCount:8 ReplicationFactor:2 Configs:
Topic: test1 Partition: 0 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 1 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 2 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 3 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 4 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 5 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 6 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 7 Leader: 0 Replicas: 0,1 Isr: 0


Case 1: But when I brings up kafka in replica 1 its still showing same output as above and its not changing it to replica 1 as it up now. And mesage produce and consume is failing for old topics (while for newer topics its working).



Case 2: Now Again I stopped kafka on replica 1 and started on replica 0 then it starts working.



Any there any such tool or any configuration which can assign replica forcefully so that this scenario can be addressed?



Leadership and ISR updating is also huge time.










share|improve this question























  • Those aren't "replica" numbers, just broker.id from the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?
    – cricket_007
    yesterday












up vote
0
down vote

favorite









up vote
0
down vote

favorite











I have 2 node kafka cluster (replica 0,1) and 3 zookeeper setup.



I tried bring down both kafka nodes (0, 1) for sometime then when I am describing a topic its showing replica 0 as leader as kafka was brought down at the end in replica 0.



$ ./kafka-topics.sh --zookeeper zoo1:2181 --topic test1 --describe
Topic: test1 PartitionCount:8 ReplicationFactor:2 Configs:
Topic: test1 Partition: 0 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 1 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 2 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 3 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 4 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 5 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 6 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 7 Leader: 0 Replicas: 0,1 Isr: 0


Case 1: But when I brings up kafka in replica 1 its still showing same output as above and its not changing it to replica 1 as it up now. And mesage produce and consume is failing for old topics (while for newer topics its working).



Case 2: Now Again I stopped kafka on replica 1 and started on replica 0 then it starts working.



Any there any such tool or any configuration which can assign replica forcefully so that this scenario can be addressed?



Leadership and ISR updating is also huge time.










share|improve this question















I have 2 node kafka cluster (replica 0,1) and 3 zookeeper setup.



I tried bring down both kafka nodes (0, 1) for sometime then when I am describing a topic its showing replica 0 as leader as kafka was brought down at the end in replica 0.



$ ./kafka-topics.sh --zookeeper zoo1:2181 --topic test1 --describe
Topic: test1 PartitionCount:8 ReplicationFactor:2 Configs:
Topic: test1 Partition: 0 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 1 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 2 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 3 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 4 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 5 Leader: 0 Replicas: 0,1 Isr: 0
Topic: test1 Partition: 6 Leader: 0 Replicas: 1,0 Isr: 0
Topic: test1 Partition: 7 Leader: 0 Replicas: 0,1 Isr: 0


Case 1: But when I brings up kafka in replica 1 its still showing same output as above and its not changing it to replica 1 as it up now. And mesage produce and consume is failing for old topics (while for newer topics its working).



Case 2: Now Again I stopped kafka on replica 1 and started on replica 0 then it starts working.



Any there any such tool or any configuration which can assign replica forcefully so that this scenario can be addressed?



Leadership and ISR updating is also huge time.







apache-kafka






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited 2 days ago









Giorgos Myrianthous

3,50121233




3,50121233










asked 2 days ago









dcds

702215




702215











  • Those aren't "replica" numbers, just broker.id from the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?
    – cricket_007
    yesterday
















  • Those aren't "replica" numbers, just broker.id from the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?
    – cricket_007
    yesterday















Those aren't "replica" numbers, just broker.id from the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?
– cricket_007
yesterday




Those aren't "replica" numbers, just broker.id from the server.properties file. They could be any number. But perhaps you can show the exact commands you used and the Kafka version so someone can reproduce fully?
– cricket_007
yesterday

















active

oldest

votes











Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













 

draft saved


draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53206186%2fkafka-not-assigning-replica-as-leader-after-all-brokers-down%23new-answer', 'question_page');

);

Post as a guest



































active

oldest

votes













active

oldest

votes









active

oldest

votes






active

oldest

votes















 

draft saved


draft discarded















































 


draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53206186%2fkafka-not-assigning-replica-as-leader-after-all-brokers-down%23new-answer', 'question_page');

);

Post as a guest














































































Popular posts from this blog

𛂒𛀶,𛀽𛀑𛂀𛃧𛂓𛀙𛃆𛃑𛃷𛂟𛁡𛀢𛀟𛁤𛂽𛁕𛁪𛂟𛂯,𛁞𛂧𛀴𛁄𛁠𛁼𛂿𛀤 𛂘,𛁺𛂾𛃭𛃭𛃵𛀺,𛂣𛃍𛂖𛃶 𛀸𛃀𛂖𛁶𛁏𛁚 𛂢𛂞 𛁰𛂆𛀔,𛁸𛀽𛁓𛃋𛂇𛃧𛀧𛃣𛂐𛃇,𛂂𛃻𛃲𛁬𛃞𛀧𛃃𛀅 𛂭𛁠𛁡𛃇𛀷𛃓𛁥,𛁙𛁘𛁞𛃸𛁸𛃣𛁜,𛂛,𛃿,𛁯𛂘𛂌𛃛𛁱𛃌𛂈𛂇 𛁊𛃲,𛀕𛃴𛀜 𛀶𛂆𛀶𛃟𛂉𛀣,𛂐𛁞𛁾 𛁷𛂑𛁳𛂯𛀬𛃅,𛃶𛁼

ャフサォクコ ケウ,コ,ワ メ,ロスョノ゙,クネ,フムカヤヲニ,エコ゚ツ ウイオン゙ケワサネォキモュキォウイノンコチ゚メヌナイゥフュ,カヒウネェ ネ,ホノケ,ムュキ ッボーミュハ,チ ツス ィ メウイマヤ,゙ウチ ヅ ロ,ォジヌェ ャヌット ェ,マャ,チナエヒネソキツテ トホヲヲミーァ

How do I collapse sections of code in Visual Studio Code for Windows?