Flink distributes tasks to one taskmanager until slots is full

I have a flink cluster with 5 nodes. And each nodes have 8 slots. I am using Flink 1.5.2.

If there are N tasks, the problem is that:

If N <= 8, all tasks will assign to node1.
New tasks will be assigned to node2 until it is full.etc.
And the other nodes will be empty.

I want all tasks distributed to all nodes balanced. Can anybody help?

Thanks.

1 Answer
1

The job manager's scheduler is not aware of which task managers the slots belong to, so no, it is not possible balance the distribution of tasks.

Thanks for contributing an answer to Stack Overflow!

But avoid …

To learn more, see our tips on writing great answers.

Some of your past answers have not been well-received, and you're in danger of being blocked from answering.

Please pay close attention to the following guidance:

But avoid …

To learn more, see our tips on writing great answers.

Required, but never shown

Required, but never shown

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.