I've been working on getting my configuration from icinga1 ported over to icinga2 version 2.4.10-1, running on OpenBSD 6 - an extremely slow and painful process, but that's beside the point. The old install was running on OpenBSD 5.5 and icinga 1. At this point I have all my hosts moved over (447 of them), and was working on moving my services across. Everything was going fine until I got up to around 150 services or so, at which point the web interface stopped showing any hosts/services after a icinga restart, and my icinga log started showing things like:
[2017-02-28 14:01:30 -0900] information/IdoPgsqlConnection: Query queue items: 2286, query rate: 0.366667/s (22/min 22/5min 22/15min); empty in infinite time, your database isn't able to keep up
I found that there was an open connection to the IDO database (Postgresql 5.5 running on the localhost to rule out network issues) that was listed as "idle in transaction" state, and looking at the process list showed that this connection in fact wasn't doing anything (total time on-processor was only 1 second, CPU utilization a solid 0%). In looking around, I find that apparently there is some startup process that does a bunch of database updates that has to complete before the "normal" process can start doing its thing, so it would appear once I get over a few hundred services, this process just hangs.
I did find some references to adding certain indexes on the database to speed things up, which I have done, but it hasn't appeared to help any.
So, two questions:
1) Is there a way I can fix this, and if so, what?
2) Is there any way to use icinga2 WITHOUT ido utils? It would appear that the icinga-web2 interface relies on IDO utils, but if there was some way I could use the (vastly superior, at least from an interface standpoint) CGI interface from icinga1 instead, that would be great, and allow me to ditch IDO utils completely.
For what it's worth, icinga2 itself appears to be fine with the number of hosts/services, it's just the IDO utils that appears to have issues.