Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add parallel check execution #8

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Add parallel check execution #8

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
cd3a9dd
Use multiprocessing module for parallel check execution
xorpaul Jul 12, 2013
7beb02b
Added new example file to show that parallel execution works
xorpaul Jul 12, 2013
a084a96
execute checks once asynchronously for all hosts and not for each host
xorpaul Jul 25, 2013
32b0d06
added more hosts to test correct async check exec behaviour
xorpaul Jul 25, 2013
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 23 additions & 4 deletions nagixsc/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@
import sys
import time
import urllib2
import multiprocessing.pool

def debug(level, verb, string):
if level <= verb:
Expand Down Expand Up @@ -179,6 +180,15 @@ def conf2dict(config, opt_host=None, opt_service=None):
else:
hosts = []

# This additional loop is necessary to sum up all service checks on all hosts
number_of_services = 0
for host in hosts:
services = config.options(host)
number_of_services += len(services)

# Create a ThreadPool with one thread for each service check
pool = multiprocessing.pool.ThreadPool(processes=number_of_services)

for host in hosts:
# Overwrite section/host name with '_host_name'
if config.has_option(host,'_host_name'):
Expand Down Expand Up @@ -210,15 +220,24 @@ def conf2dict(config, opt_host=None, opt_service=None):
else:
services = []

# Then let each thread fork the actual check process asynchronously
async_results = []
for service in services:
# If option starts with '_' it may be a NagixSC option in the future
if service[0] != '_':
cmdline = config.get(host, service)
async_results.append(pool.apply_async(exec_check, (host_name, service, cmdline, cmdprefix, timeout, timeout_returncode)))



check = exec_check(host_name, service, cmdline, cmdprefix, timeout, timeout_returncode)
if add_pnp4nagios_template_hint and '|' in check['output']:
check['output'] += ' [%s]' % check['command']
checks.append(check)

# Gather each check result
for host in hosts:
for async_result in async_results:
check = async_result.get()
if add_pnp4nagios_template_hint and '|' in check['output']:
check['output'] += ' [%s]' % check['command']
checks.append(check)

return checks

Expand Down
80 changes: 80 additions & 0 deletions sample-configs/conf/nagixsc_sleep.conf
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,80 @@
[nagixsc]
Reserved: For future use

[host1]
_underscores_at_start: reserved
_use_section_name_as: host_name in nagios
_host_check: /usr/local/nagios/libexec/check_host -H 127.0.0.1
Disk_Home: /usr/local/nagios/libexec/check_disk -w 10% -c 5% -m -p /home
Disk_Root: /usr/local/nagios/libexec/check_disk -w 10% -c 5% -m -p /
Load: /usr/local/nagios/libexec/check_load -w 5,5,5 -c 10,10,10
Sleep1: sleep 1
Sleep2: sleep 2
Sleep3: sleep 3
Sleep4: sleep 4
Sleep5: sleep 4
Sleep6: sleep 4

[host6]
_host_name: host2.foo.bar
Procs_Total: /usr/local/nagios/libexec/check_procs -w 200 -c 250
Swap: /usr/local/nagios/libexec/check_swap -w 50% -c 25%
Users: /usr/local/nagios/libexec/check_users -w 10 -c 15
Sleep1: sleep 1
Sleep2: sleep 2

[host7]
Sleep1: sleep 1
Sleep2: sleep 2
Sleep3: sleep 3
Sleep4: sleep 4
Sleep5: sleep 4
Sleep6: sleep 4

[host8]
Sleep1: sleep 1
Sleep2: sleep 2
Sleep3: sleep 3
Sleep4: sleep 4
Sleep5: sleep 4
Sleep6: sleep 4

[host9]
Sleep1: sleep 1
Sleep2: sleep 2
Sleep3: sleep 3
Sleep4: sleep 4
Sleep5: sleep 4
Sleep6: sleep 4

[host10]
Sleep1: sleep 1
Sleep2: sleep 2
Sleep3: sleep 3
Sleep4: sleep 4
Sleep5: sleep 4
Sleep6: sleep 4

[host11]
Sleep1: sleep 1
Sleep2: sleep 2
Sleep3: sleep 3
Sleep4: sleep 4
Sleep5: sleep 4
Sleep6: sleep 4

[host12]
Sleep1: sleep 1
Sleep2: sleep 2
Sleep3: sleep 3
Sleep4: sleep 4
Sleep5: sleep 4
Sleep6: sleep 4

[host13]
Sleep1: sleep 1
Sleep2: sleep 2
Sleep3: sleep 3
Sleep4: sleep 4
Sleep5: sleep 4
Sleep6: sleep 4