Refine your search:

@ a customers site:
"
Splunk was indexing udp:514 data until this Wednesday when it stopped altogether. Using TCPDump i was able to confirm that data is coming into the server but splunk is not indexing it.

The splunk service is started as root and no other data is missing.
"

asked 18 Jun '10, 22:26

Genti's gravatar image

Genti ♦
3.8k5441
accept rate: 37%


One Answer:

checking the splunkd.logs and metrics.logs showed no sign of Blocked data. There were also no other errors related to UDP:514 within the splunkd.logs

On the other hand, metrics.logs show that splunk was listening and indexing data till a certain point in time, and afterwords no other data was coming in. This does not match the statement from the customer...

One thing to keep in mind though is that tcpDump listens to the connection socket prior to any application, so there might be some firewall or an app that is blocking it from going into splunk.

Try a netstat -an | grep 514 to check if there is another app listening to the port. In the customers case it ended up being syslog starting up on wednesday and blocking the data from going to splunk...

link

answered 18 Jun '10, 22:37

Genti's gravatar image

Genti ♦
3.8k5441
accept rate: 37%

Post your answer
toggle preview

Follow this question

Log In to enable email subscriptions

RSS:

Answers

Answers + Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "Title")
  • image?![alt text](/path/img.jpg "Title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Tags:

×463
×278
×50

Asked: 18 Jun '10, 22:26

Seen: 2,166 times

Last updated: 18 Jun '10, 22:37

Copyright © 2005-2012 Splunk Inc. All rights reserved.