I have a general question regarding performance data and graphing.
I'm currently setting up a test/evaluation installation of Icinga2 with the following components:
2 master endpoints with HA, local IDO mysql on each and top down config sync to 2 satellite zones. I have Icingaweb2 installed on both masters and I see that HA is working.
The masters do not execute any checks but they have the graphing features enabled.
In our future production setup we plan to ship all performance data to opentsdb. That will be approx. 60,000 service checks with performance data in our future Icinga2 setup.
We now have some concerns that it would be a performance bottleneck when this amount of metric data is processed by one (or two?) master nodes.
My general understanding is that the satellites, who are executing the checks report the check results (and performance data) to all nodes in the parent zone (master).
I'm seeing traffic from both master nodes to influxdb (that I use for testing currently). My influxdb.conf is the same on both master nodes.
Is it true that both masters are sending the same performance data information, or is this sort of balanced? Is there a way to modify this behavior?