Comments on: To deduplicate or not to deduplicate ? http://blog.open-e.com/to-deduplicate-or-not-to-deduplicate/ Open-E - Enterprise Class Storage OS For Every Business Wed, 05 Jun 2013 18:35:47 +0000 hourly 1 http://wordpress.org/?v=3.5.1 By: robert.bluszcz http://blog.open-e.com/to-deduplicate-or-not-to-deduplicate/#comment-35783 robert.bluszcz Tue, 22 May 2012 14:23:56 +0000 http://blog.open-e.com/?p=16513#comment-35783 There are many deduplication softwares and opendedup is one of the possibility. The choice depends on budget, purposes and so on.
On the other hand, our research team investiges the opendedup software but at this stage we are not able to tell you more if it will be implemented or not.

]]> By: Laurent http://blog.open-e.com/to-deduplicate-or-not-to-deduplicate/#comment-35693 Laurent Sun, 13 May 2012 22:00:44 +0000 http://blog.open-e.com/?p=16513#comment-35693 Hi,

dedup is no voodoo magic.
You may get the vendor prediction of 80% on database table.
You often get nothing on compressed images.

There is a case where dedup is great.
I’m using a storage bay featuring offline dedup to run VMware servers.
I deploy VM by cloning prebuild VM templates.
The dedup rate after the nightly dedup is just what you expect : very good.

A side effect of the dedup here is that it boost the cache read hit.
A host cold reboot is really showing I/O improvement after the dedup process.

My 2 cents.

]]> By: Patrick S. http://blog.open-e.com/to-deduplicate-or-not-to-deduplicate/#comment-35663 Patrick S. Thu, 10 May 2012 15:04:03 +0000 http://blog.open-e.com/?p=16513#comment-35663 Janusz, thanks for your article. I am really curious on NAS level deduplication.

As a software company, we are running a buildserver that does its work mainly on a DSS V6 NAS target. For a bunch of reasons, all libs etc. are copied into each relase build folder, which should really make up for a good dedup target. Furthermore, the build generates various zips and exe-Setups which should not differ all to much against each other in minor build versions. I always had the opinion this was a good scenario for block level dedup, which I would really love, since every build currently consumes about 500 megs of space.

What is your opinion on using dedup in that scenario, will you consider integrating dedup into DSS (the technical basement should be there, http://opendedup.org/) and if not, can you recommend something to look further on the subject?

]]>