The port is open and listening. The logs directory which I am monitoring contain hundreds of thousands of files in it. But for some reason, the monitor stops monitoring and no longer picks up new log files, or even ones that exist. It's very frustrating and makes me think that the forwarder is unreliable, which for us is a nightmare as we need it to alert us to the fact that no new jobs have been completed.
the monitor is as follows in the inputs.conf
[monitor:///data/logs
disabled = false
host = MFT
index = support
blacklist = goanywhere*
drwxr-xr-x 18 esb esb 4096 Dec 20 09:08 .
drwxr-xr-x 21 esb esb 4096 Nov 14 23:30 ..
drwxr-xr-x 2 esb esb 2097152 Dec 20 13:33 2016-12-10
drwxr-xr-x 2 esb esb 2109440 Dec 20 18:51 2016-12-11
drwxr-xr-x 2 esb esb 2162688 Dec 12 23:57 2016-12-12
drwxr-xr-x 2 esb esb 2093056 Dec 13 23:57 2016-12-13
drwxr-xr-x 2 esb esb 2211840 Dec 15 02:08 2016-12-14
drwxr-xr-x 2 esb esb 2183168 Dec 15 23:58 2016-12-15
drwxr-xr-x 2 esb esb 2023424 Dec 16 23:58 2016-12-16
drwxr-xr-x 2 esb esb 2043904 Dec 17 23:59 2016-12-17
drwxr-xr-x 2 esb esb 2072576 Dec 18 23:58 2016-12-18
drwxr-xr-x 2 esb esb 2015232 Dec 19 23:58 2016-12-19
drwxr-xr-x 2 esb esb 1802240 Dec 20 18:51 2016-12-20
inside the directories are files which look like this
-rw-r--r-- 1 esb esb 10300 Dec 20 18:54 1000001209329.log
-rw-r--r-- 1 esb esb 977 Dec 20 18:54 1000001209330_error_1.log
-rw-r--r-- 1 esb esb 10317 Dec 20 18:54 1000001209330.log
-rw-r--r-- 1 esb esb 977 Dec 20 18:54 1000001209331_error_1.log
-rw-r--r-- 1 esb esb 10325 Dec 20 18:54 1000001209331.log
-rw-r--r-- 1 esb esb 971 Dec 20 18:54 1000001209332_error_1.log
-rw-r--r-- 1 esb esb 10273 Dec 20 18:54 1000001209332.log
-rw-r--r-- 1 esb esb 971 Dec 20 18:54 1000001209333_error_1.log
-rw-r--r-- 1 esb esb 8120 Dec 20 18:55 1000001209333.log
-rw-r--r-- 1 esb esb 977 Dec 20 18:54 1000001209334_error_1.log
-rw-r--r-- 1 esb esb 10293 Dec 20 18:54 1000001209334.log
-rw-r--r-- 1 esb esb 977 Dec 20 18:55 1000001209335_error_1.log
-rw-r--r-- 1 esb esb 10214 Dec 20 18:55 1000001209335.log
-rw-r--r-- 1 esb esb 977 Dec 20 18:55 1000001209336_error_1.log
-rw-r--r-- 1 esb esb 10309 Dec 20 18:55 1000001209336.log
-rw-r--r-- 1 esb esb 977 Dec 20 18:55 1000001209337_error_1.log
-rw-r--r-- 1 esb esb 8131 Dec 20 18:55 1000001209337.log
-rw-r--r-- 1 esb esb 971 Dec 20 18:55 1000001209338_error_1.log
-rw-r--r-- 1 esb esb 9712 Dec 20 18:55 1000001209338.log
-rw-r--r-- 1 esb esb 977 Dec 20 18:55 1000001209339_error_1.log
-rw-r--r-- 1 esb esb 6320 Dec 20 18:55 1000001209339.log
-rw-r--r-- 1 esb esb 971 Dec 20 18:55 1000001209340_error_1.log
-rw-r--r-- 1 esb esb 0 Dec 20 18:55 1000001209340.log
-rw-r--r-- 1 esb esb 0 Dec 20 18:55 1000001209341.log
one directory has 200,000 files in it.
I'm stumped, as i said the forwarder just gives up
... View more