File archiver for duplicate files

[j7n]

I have a set of files with many duplicates. It is not an option to delete them.

Is there a file archiver that would gather information about the dupes and efficiently pack them. This could be accomplished by a generic compressor with extremely large dictionary (~ 48 MB or so), but the system requirements for shuch an operation, including later decompression, would be inadequate. Maybe disc image with multiple references to the same data?

[DigeratiPrime]

Any compression software that will create a 'solid archive' will work. Try 7-zip.

http://www.7-zip.org/

[Camarade_Tux]

Your idea for a disc image is possible. The corresponding switch for cdimage is -o : http://unattended.msfn.org/unattended.xp/view/web/15/

[jondercik]

If you know what files are duplicates of what other files, you can write a script to make links to those files using the "fsutil hardlink create" command. This command will create another file name that points at the same data as the other one. One of the lesser know features of versions of Windows XP and higher.

Jim

[j7n]

Thank you for your replies. My apologies for posting in the wrong forum. I'm gonna check out CDImage now.

[jaclaz]

FYI,

CDImage is NOT a PD program, nor is it freely available/usable:

http://www.msfn.org/board/index.php?showtopic=88660

It would be much better if you would use mkisofs that has a similar option or the version OSCDIMG.EXE that is in the OPK.

jaclaz