Merging three slightly different directories

[hput Putnam]

Robin Wrote:

> So I'm not quite following your Windows rsync problem. 

Specifically, do you mean: 

 

>"I copied files A, B, and C, and there's still 3 files but each file 

is bigger" 

 

> or 

 

> "I copied files A, B, and C to a directory containing files that I 

> thought were identical using the -b flag but now there's twice as 



I'm astounded you seem to think I used the -b flag but you must know that it was you who introduced the topic of -b flag.  That suggestion came after all rsyncing was done.

I expect the -b flag will play a big role in cleaning things up.



> many files because apparently rsync thinks none of them are 

> identical" 

 

Ok, sorry to be unclear... but really I'm not writing in ancient Sanscrit here.



There was no copying done at all.  Everything was and will be done with rsync.  I still have not tried the -b option but expect that to be very helpful.



I explained how I ran rsync from an Images/ directory on one linux host directly into an Images directory on another linux host.



rsync -vvrptgoD --stats LINHOST1:/Images/  LINHOST2:/Images/



I thought the directories were too large to examine them much by hand but I knew how they were built and knew they were at least very similar.

both structurally and content wise.  So that first merge went about how I expected there was a small overall size increase of a few hundred MB.



Then I ran "rsync -vvrptgoD winHOST:/Images/   LINHOST2:/Images/"  so from the win host to the already once merged LINHOST2:/Images. Both directories showed quite similar size according to "du -sh" before rsyncing.



However when the rsyncing was through the LINHOST2:/Images directory had grown considerably. I still have not examined by hand but clearly something unexpected has happened.  I expect I'll find some significant differences I'd forgotten about.



Until I stop and examine things closely; any further discussion will be kind of lame.  I was putting off a pains taking examination but I see it must be done.



These thousands of images have built up from 2008 to late 2021 and many Phone camera images have been added since then.  So I need to be careful with them.  With that in mind I have kept backups of all three directories in their original state.



Thank you much for your input so far.  I expect to be a good little while examining things.  In fact I see now this will be a major undertaking.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.samba.org/pipermail/rsync/attachments/20220609/7c95fb7e/attachment.htm>