Zsh Mailing List Archive Messages sorted by: Reverse Date, Date, Thread, Author

Re: copying a million small files between disks?

X-seq: zsh-users 12156
From: Philippe Troin <phil@xxxxxxxx>
To: "sam reckoner" <sam.reckoner@xxxxxxxxx>
Subject: Re: copying a million small files between disks?
Date: 31 Oct 2007 16:01:30 -0700
Cc: zsh-users@xxxxxxxxxx
In-reply-to: <6a42eec70710311440u52556985wda68ce326f4a0417@xxxxxxxxxxxxxx>
Mail-copies-to: nobody
Mailing-list: contact zsh-users-help@xxxxxxxxxx; run by ezmlm
References: <6a42eec70710311440u52556985wda68ce326f4a0417@xxxxxxxxxxxxxx>
Sender: phil@xxxxxxxx

"sam reckoner" <sam.reckoner@xxxxxxxxx> writes:

> I'm not exaggerating. I have over one million small files that like to
> move between disks. The problem is that even getting a directory
> listing takes forever.
> 
> Is there a best practice for this?
> 
> I don't really need the directory listing, I just need to move all the
> files. I have been using rsync, but that takes a very long time to
> generate the list of files to be moved.
> 
> Any alternatives?

Dump/restore won't get directory listings...  And it will traverse
them via libe2fs, which *might* be faster.

Phil.

References:
- copying a million small files between disks?
  - From: sam reckoner

Messages sorted by: Reverse Date, Date, Thread, Author