Refine your search:

Hi, is it possible to route events to nullQueue based on the value found in a field generated by a csv lookup?

I am facing a SAP audit sequential file which:

  1. (on a LWF) is read through a scripted input, which also splits it in lines;
  2. has field extraction based on field position and length;
  3. field "user_name" is used to lookup a csv file which provides the field "user_role".

I'd need to only index log lines which have a particular value of user_role, but since that value is not present in _raw, I am not able to write the REGEX in the transforms.conf stanza.

Any idea would be greatly appreciated, thanks

asked 12 Jul '10, 16:42

Paolo%20Prigione's gravatar image

Paolo Prigione
2.0k2317
accept rate: 38%


2 Answers:

Sorry Paolo, I don't think it's possible. According to http://www.splunk.com/base/Documentation/latest/Admin/Indextimeversussearchtime lookups are applied at search time, not index time. The nullQueue routing would have to occur at index time in order to be effective.

link

answered 12 Jul '10, 19:07

dwaddle's gravatar image

dwaddle ♦
15.5k2924
accept rate: 33%

Thank you Dwaddle; I actually knew it but was hoping on some creative ways to direct inputs to the parsingQueue and then to the nullQueue prior to indexing.

(13 Jul '10, 07:13) Paolo Prigione

Hi Paolo, did you ever solve this problem? If not, since you are collecting this data via a scripted input, why not add the lookup capability on the user_name field in the same script? The script could either augment _raw with the user_role, or only write events for roles are you interested in. The 2nd option saves Splunk the trouble of having to apply index-time filtering altogether and maybe some CPU cycles.

link

answered 28 Mar '11, 06:54

hulahoop's gravatar image

hulahoop ♦
2.6k141151
accept rate: 40%

Thanks for the suggestion. At the time I didn't have the skills to set that up. I had solved the problem at search time: the volume was not that bad.

(28 Mar '11, 12:07) Paolo Prigione
Post your answer
toggle preview

Follow this question

Log In to enable email subscriptions

RSS:

Answers

Answers + Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "Title")
  • image?![alt text](/path/img.jpg "Title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Tags:

×540
×290
×41
×41
×31

Asked: 12 Jul '10, 16:42

Seen: 1,185 times

Last updated: 28 Mar '11, 06:54

Copyright © 2005-2012 Splunk Inc. All rights reserved.