Getting Data In

How to use rsync to move frozen data to another location?

mdtoro
Explorer

I was looking at rsync to move some frozen buckets to another location.  One concern,  if rsync picks up new frozen data still being written  and removes the source file before splunk finishes.

I could add find and mtime but this really slows down rsync.

Concerns?

 

Labels (3)
0 Karma

mdtoro
Explorer

I was thinking it is easier to not touch anything recently created.  Create a list of files at least 2 days old.

0 Karma

richgalloway
SplunkTrust
SplunkTrust

That could work, too.

---
If this reply helps you, Karma would be appreciated.
0 Karma

richgalloway
SplunkTrust
SplunkTrust

Consider using lsof to test if the file is still open before moving it.

---
If this reply helps you, Karma would be appreciated.
Get Updates on the Splunk Community!

Detecting Remote Code Executions With the Splunk Threat Research Team

WATCH NOWRemote code execution (RCE) vulnerabilities pose a significant risk to organizations. If exploited, ...

Enter the Splunk Community Dashboard Challenge for Your Chance to Win!

The Splunk Community Dashboard Challenge is underway! This is your chance to showcase your skills in creating ...

.conf24 | Session Scheduler is Live!!

.conf24 is happening June 11 - 14 in Las Vegas, and we are thrilled to announce that the conference catalog ...