Getting Data In

How do I set hostname without syslog

I_am_Jeff
Communicator

I have a UF sending logs to my indexer. The UF receives logs, via syslog, from several other systems. All my UFs, indexers, and search heads are Splunk 4.2.3 and running Red Hat Linux. The logs go to a custom index, not main.

I'd like to extract the hostname from the events so I can search for host=hostname. I know the hostname is between AB: and the next colon, and believe I have the regex to do that. I believe I have to do this on the indexers.

 2012-01-13 16:05:44,528 weblogic:[ExecuteThread: '20' for queue: 'webapp.queue']AB:hostname:1234567:autofoo

I've done this on a standalone implementation where the log is written to a file by syslog, but how do I do it with forwarders, multiple indexers and search heads? Right now host= the name of the UF box, not the "correct" hostnames.

0 Karma
1 Solution

Damien_Dallimor
Ultra Champion

You could perform an index time transform on the host field.
Add entrys to props.conf and transforms.conf in the "local" directory for the app on the Universal Forwarder.My regex example is a bit generic, you might want to tighten it up a bit based on the actual patterns in your logs.

#props.conf
[my_sourcetype]
TRANSFORMS-host = my_sourcetype_host

#transforms.conf
[my_sourcetype_host]
DEST_KEY = MetaData:Host
REGEX = ^.+AB:(\w+):\d+:\w+
FORMAT = host::$1

View solution in original post

Damien_Dallimor
Ultra Champion

You could perform an index time transform on the host field.
Add entrys to props.conf and transforms.conf in the "local" directory for the app on the Universal Forwarder.My regex example is a bit generic, you might want to tighten it up a bit based on the actual patterns in your logs.

#props.conf
[my_sourcetype]
TRANSFORMS-host = my_sourcetype_host

#transforms.conf
[my_sourcetype_host]
DEST_KEY = MetaData:Host
REGEX = ^.+AB:(\w+):\d+:\w+
FORMAT = host::$1

Damien_Dallimor
Ultra Champion

regex = ^.+(?:AB|CD):(\w+):\d+:\w+

Yep , the files get deployed to the UF.

0 Karma

I_am_Jeff
Communicator

Working on getting this implemented using a Deployment Server. The regex needs some work as I have an AB: or CD: situation. (That shouldn't be a big deal.) The props.conf and transforms.conf go on the UF, huh, not on the indexer? $SPLUNK_HOME/etc/apps/jeff/local/{props.conf|transforms.conf}

0 Karma
Get Updates on the Splunk Community!

Observability | Use Synthetic Monitoring for Website Metadata Verification

If you are on Splunk Observability Cloud, you may already have Synthetic Monitoringin your observability ...

More Ways To Control Your Costs With Archived Metrics | Register for Tech Talk

Tuesday, May 14, 2024  |  11AM PT / 2PM ET Register to Attend Join us for this Tech Talk and learn how to ...

.conf24 | Personalize your .conf experience with Learning Paths!

Personalize your .conf24 Experience Learning paths allow you to level up your skill sets and dive deeper ...