Lots of stupidities in s3cmd, like the following:
If you miss the trailing slash in the directory names, s3cmd will ignore --skip-existing and will also not compare files using MD5 :( Here's the command that works:
$ s3cmd sync -v --delete-removed --skip-existing --rexclude=.* --rinclude .*localhost_access_log.2012-0[6-9].* s3://brp-logs/selfserve/ logs/
Reference: Solution 38 by William Denniss
If you miss the trailing slash in the directory names, s3cmd will ignore --skip-existing and will also not compare files using MD5 :( Here's the command that works:
$ s3cmd sync -v --delete-removed --skip-existing --rexclude=.* --rinclude .*localhost_access_log.2012-0[6-9].* s3://brp-logs/selfserve/ logs/
Reference: Solution 38 by William Denniss
Thank you! This was driving me crazy. It kept trying to re-download 500k+ files.
ReplyDelete