Refine your search:

Thanks For Downloading!

Review the documentation below and follow any custom installation steps. If no install steps are listed, most Splunk Apps and Add-ons can be installed as follows:

Windows: Decompress the downloaded file using a tool like 7-Zip and place the resulting folder into %PROGRAMFILES%\Splunk\etc\apps. Then restart Splunk using the splunk restart command or the GUI.

Unix/Linux: Decompress the downloaded file using a tool like tar -xvf and place the resulting folder into $SPLUNK_HOME/etc/apps. Then restart Splunk using the splunk restart command or the GUI.

Description

Splunk Hadoop Connect provides bi-directional integration to easily and reliably move data between Splunk and Hadoop.

Splunk Hadoop Connect provides bi-directional integration to easily and reliably move data between Splunk and Hadoop. Deploy Splunk quickly for real-time collection, indexing, analysis and visualizations and then reliably forward events to Hadoop for long-term archiving and additional batch analytics. You can further leverage Splunk by importing data already stored in Hadoop. This makes it easy to stand up reliable, secure, enterprise-grade big data projects in days instead of months.

Splunk Hadoop Connect includes three core features:

  • Export events to Hadoop - Use Splunk to collect and index massive streams of machine data in real-time. Then send all or a subset of events in a reliable and predictable way to HDFS for archiving, further processing or additional batch analytics. You can choose to pre-process data in Splunk before exporting the results into Hadoop, selecting both the format type as well as specific fields to include. Alternatively, you can simply export raw events.
  • Explore Hadoop directories and files - Browse, navigate and inspect HDFS directories and files from the Splunk Hadoop Connect user interface before deciding to import them into Splunk.
  • Import and Index Hadoop data into Splunk - Import and index Hadoop data into Splunk to make it available for searching, reporting, analysis and visualizations and provide role-based access controls protection. Gain rapid insight and analysis without writing MapReduce code.

Splunk Hadoop Connect Video Tutorials:

Splunk Hadoop Connect Documentation:

Splunk Hadoop Connect is compatible with Apache Hadoop; it is also tested and certified against Cloudera's CDH and Hortonworks' HDP distribution. Additionally, Hadoop Connect supports any locally mounted point, which enables it to work with MapR or IBM GPFS distributions. Refer to the product documentation for the latest list of supported Hadoop distributions.

Versions and Release Notes

Version 1.1 (current version - updated Feb 20, 2013)
release notes:

Splunk App for Hadoop Connect 1.1. Copyright © 2005-2013 Splunk Inc. All rights reserved.

show older versions »
Version 1.0 (updated Feb 20, 2013)
release notes:

Splunk App for Hadoop Connect 1.0. Copyright © 2005-2012 Splunk Inc. All rights reserved.

Version 1.0beta (updated Sep 10, 2012)
release notes:

Splunk Hadoop Connect 1.0 beta. Copyright (C) 2005-2012 Splunk Inc. All rights reserved.

* For the Release Notes and Getting Started documentation for this release see: http://docs.splunk.com/Documentation/HadoopConnect

posted 29 Aug '12, 13:53

splunk's gravatar image

splunk
7.9k111
accept rate: 100%

new version 20 Feb, 09:46


2 Reviews:
2 reviews, 4 ratings, average 3.25

Can any one explain how can we configure splunk with hadoop which is in LINUX environment???

comments (0)

reviewed 28 Jan, 21:11

satti916's gravatar image

satti916
111
accept rate: 0%

Reviews related to version 1.0 (current is 1.1)

Awesome app. I just tested the "hdfs command" execution in splunk 4.3.5. Seems to be working fine. I was able to import a file from hdfs and outputlookup the data into a lookup table. Took a little while to figure out how to use the command though. Here is an example:

| hdfs read "hdfs://localhost:9000/tmp/nickcities.csv" delim="," fields="city,state" | table city, state | outputlookup nickcities.csv

Will be trying the export features soon enough.

comments (0)

reviewed 21 Nov '12, 14:54

nicholasgrabowski's gravatar image

nicholasgrab...
1713
accept rate: 28%

Your review

Did you find this app useful?

Preview toggle preview

Copyright © 2005-2012 Splunk Inc. All rights reserved.