Problem with Status Information field: "(No output on stdout) stderr:"

Hi,

Unfortunattely it does not occur everytime. Meaning same command runs randomly with Status update or with "(No output on stdout) stderr:".Sometime it happens and at next check Status is properly updated. Problem happens for all commands randomly as sample below. There is nothing at logs mentioned why and what happend so I have no clue what could be reason. As you can see at screenshot it also happend for localhost which was included in Nagwin package with standart command and services.

Is there any way how to debug it?

Sample commands:

check_http (this is orginal command):

# 'check_http' command definition
define command{

       command_name    check_http
       command_line    $USER1$/check_http -I $HOSTADDRESS$ $ARG1$
       }

and also this:

define command{ 
command_name check_java
; Check via java
command_line c:/nagios/ICW/java/jre7/bin/java.exe -jar $USER3$plugins/CheckJava.jar $USER3$plugins/ "$ARG1$" "$ARG2$"

}

Hi,

I have enabled full debugging and here is part of log with this exception:

Making callbacks (type 6)...

handle_timed_event() end

Making callbacks (type 1)...

** Event Check Loop

Next Event Time: Wed Jan 22 09:10:34 2014

Current/Max Service Checks: 1/0 (inf% saturation)

## Polling 1500ms; sockets=6; events=18; iobs=0x80051660

Processing check result for service 'Physical memory' on host 'localhost'

handle_async_service_check_result()

** Handling check result for service 'Physical memory' on host 'localhost' from 'Core Worker 4872'...

HOST: localhost, SERVICE: Physical memory, CHECK TYPE: Active, OPTIONS: 0, SCHEDULED: Yes, RESCHEDULE: Yes, EXITED OK: Yes, RETURN CODE: 0, OUTPUT: (No output on stdout) stderr: 

Parsing check output...

Short Output: (No output on stdout) stderr:

Long Output:  NULL

Perf Data:    NULL

ST: HARD  CA: 1  MA: 4  CS: 0  LS: 0  LHS: 0

Service is OK.

Service did not change state.

Rescheduling next check of service at Wed Jan 22 09:15:26 2014

get_next_valid_time()

_get_matching_timerange()

schedule_service_check()

Scheduling a non-forced, active check of service 'Physical memory' on host 'localhost' @ Wed Jan 22 09:15:26 2014 

Hi,

Unfortunattely I was blocked to publish whole log in this forum. Below goes begin point when 'Physical memory' was called. This command and service is a standart command/service delivered with Nagwin

Log:

Attempting to run scheduled check of service 'Physical memory' on host 'localhost': check options=0, latency=0.000000

run_async_service_check()

check_service_check_viability()

check_time_against_period()

_get_matching_timerange()

check_service_dependencies()

Making callbacks (type 6)...

Checking service 'Physical memory' on host 'localhost'...

get_raw_command_line_r()

Raw Command Input: $USER1$/check_pdm --memory physical --warning $ARG1$ --critical $ARG2$

process_macros_r()

Service:

# Define a service to check the physical memory usage the local machine. 

# Critical if less than 90% of swap is in use, warning if 80% is in use

define service{

       use                             local-service,srv-pnp         ; Name of service template to use

       host_name                       localhost

       service_description             Physical memory

check_command check_local_physical_mem!80!90

       }

Command:

# 'check_local_pyhsical_mem' command definition

define command{

command_name check_local_physical_mem

command_line $USER1$/check_pdm --memory physical --warning $ARG1$ --critical $ARG2$

}

Nagwin is running on dedicated VM . However there are some additional processes like Web and DB server but for Nagwin reporting purposes.

I am not sure if this is related to load becuase logs are saying that plugin ended normaly. Only what is missing is stdout. If there would be timeout than whole process would fail. Isn it?

Here is line:

Thanks for that indeed not big relief :)

I would like to do more investigation but dont have idea from where to start. This column (Status Information) is very important for us and our Proof Of Concept for Nagwin depends at this result and further purchase of this product for production.

Currently Nagwin runs on my dev machine Windows 7 at VM.

Anyway here is this report:

Monitoring Performance
--------------------------------------------------------
Service Check Execution Time: 0.09 / 15.48 / 5.518 sec
Service Check Latency: 0.00 / 0.00 / 0.000 sec
Host Check Execution Time: 0.06 / 4.17 / 1.096 sec
Host Check Latency: 0.00 / 0.00 / 0.000 sec
# Active Host / Service Checks: 4 / 6
# Passive Host / Service Checks: 0 / 2

Hi again,

My machine does not have this limit but I assume that this would not be source of problem becuase there are only 8 services. Neverless I also tried to enable Notifications and there I also got this error so this is very bad:

***** Nagios *****

Notification Type: PROBLEM

Service: Selenium test which fail

Host: QlikView

Address: srvqliviewpoc.ops.adr.ch.glencore.com

State: CRITICAL

Date/Time: Thu Jan 23 18:57:57 WEST 2014

Additional Info:

(No output on stdout) stderr: