Refine your search:

How many tags can be created before Splunk's performance is adversely affected? And what specifcally is adversely affected when too many tags are defined-- index perf, search perf, or both?

asked 22 Jan '10, 05:39

Justin%20Grant's gravatar image

Justin Grant
1.5k6739
accept rate: 50%


3 Answers:

Per Steve Z, one of Splunk's rocket scientists:

The tag approach is definitely not scalable beyond a few thousand. Tags were designed to handle expanding to tens or hundreds of values, not tens of thousands or more. Also, note that tagging is designed to tag specific values of a single field, rather than events as a whole

link

answered 28 Jan '10, 22:55

Justin%20Grant's gravatar image

Justin Grant
1.5k6739
accept rate: 50%

4

To extend this, the better bet is to use field lookups, which scale easily to millions of items. Another technique is eventtypes, which allow for "tagging" of events that match generic search expressions.

(29 Jan '10, 17:11) Stephen Sorkin ♦

Tags have no effect on indexing or indexing performance, so any effect would only be realized at search time.

link

answered 29 Jan '10, 04:29

gkanapathy's gravatar image

gkanapathy ♦
26.2k1622
accept rate: 42%

I wouldn't recommend more than 1000 tags, I have seen degradation linked to applications loading a specific amount of tags and neglecting tags that correlate to the same numbers of hosts beyond the 1000 mark. Though they don't have any impact on indexing, search can be more meaningful with better direction of your catagories through eventtypes. This can also be associated with hosts r sources, as opposed to matching a case in an event.

link

answered 05 Apr '10, 18:57

fwilmot's gravatar image

fwilmot
21
accept rate: 0%

Post your answer
toggle preview

Follow this question

Log In to enable email subscriptions

RSS:

Answers

Answers + Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "Title")
  • image?![alt text](/path/img.jpg "Title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Tags:

×147
×56

Asked: 22 Jan '10, 05:39

Seen: 927 times

Last updated: 05 Apr '10, 18:57

Copyright © 2005-2012 Splunk, Inc. All rights reserved.