{"id":15866,"date":"2014-01-03T16:39:13","date_gmt":"2014-01-03T16:39:13","guid":{"rendered":"https:\/\/aidanfinn.com\/?p=15866"},"modified":"2014-01-03T16:39:13","modified_gmt":"2014-01-03T16:39:13","slug":"how-much-ram-cpu-does-window-server-deduplication-optimization-require","status":"publish","type":"post","link":"https:\/\/aidanfinn.com\/?p=15866","title":{"rendered":"How Much RAM & CPU Does Window Server Deduplication Optimization Require?"},"content":{"rendered":"

I\u2019ve been asked about resource requirements for the dedupe optimization job before but I did not have the answer<\/a> before now.<\/p>\n

Processor<\/span><\/strong><\/p>\n

The CPU side is \u2026 not clear.\u00a0 The dedupe subsystem will schedule one single-threaded job per volume. That means a machine with 8 logical processors is only 1\/8th utilized if there is a single data volume. Microsoft says:<\/p>\n

To achieve optimal throughput, consider configuring multiple deduplication volumes, up to the number of CPU cores on the file server.<\/p><\/blockquote>\n

That seems pretty dumb to me. \u201cGo ahead and complicate volume management to optimize the dedupe processing\u201d. Uhhhhh, no thanks.<\/p>\n

Memory<\/span><\/strong><\/p>\n

Microsoft tells us that 1-2 GB RAM is used per 1 TB of data per volume.\u00a0 They clarify this with an example:<\/p>\n\n\n\n\n\n\n\n
Volume <\/b><\/td>\nVolume size <\/b><\/td>\nMemory used <\/b><\/td>\n<\/tr>\n
Volume 1<\/td>\n1 TB<\/td>\n1-2 GB<\/td>\n<\/tr>\n
Volume 2<\/td>\n1 TB<\/td>\n1-2 GB<\/td>\n<\/tr>\n
Volume 3<\/td>\n2 TB<\/td>\n2-4 GB<\/td>\n<\/tr>\n
Total for all volumes<\/td>\n1+1+2 * 1GB up to 2GB<\/td>\n4 \u2013 8 GB RAM<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

By default a server will limit the RAM used by the optimization job to 50% of total RAM in the server.\u00a0 So if the above server had just 4 GB RAM, then only 2 GB would be available for the optimization job.\u00a0 You can manually override this:<\/p>\n

Start-Dedupjob <volume> -Type Optmization\u00a0 -Memory <50 to 80><\/p>\n

There is an additional note from Microsoft:<\/p>\n

Machines where very large amount of data change between optimization job is expected may require even up to 3 GB of RAM per 1 TB of diskspace.<\/p><\/blockquote>\n

So you might see RAM become a bottleneck or increase pressure (in a VM with Dynamic Memory) if the optimization job hasn’t run in a while or if lots of data is dumped into a deduped volume.\u00a0 Example: you have deployed lots of new personal (dedicated) VMs for new users on a deduped volume.<\/p>\n

Technorati Tags: Windows Server 2012<\/a>,Windows Server 2012 R2<\/a>,Storage<\/a>,Hyper-V<\/a>,Virtualisation<\/a>,VDI<\/a>,Remote Desktop Services<\/a><\/div>\n","protected":false},"excerpt":{"rendered":"

I\u2019ve been asked about resource requirements for the dedupe optimization job before but I did not have the answer before now. Processor The CPU side is \u2026 not clear.\u00a0 The dedupe subsystem will schedule one single-threaded job per volume. That means a machine with 8 logical processors is only 1\/8th utilized if there is a … Continue reading “How Much RAM & CPU Does Window Server Deduplication Optimization Require?”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"categories":[52],"tags":[181,188,99,102,195,118,120],"class_list":["post-15866","post","type-post","status-publish","format-standard","hentry","category-windows-server","tag-hyper-v","tag-remote-desktop-services","tag-storage","tag-vdi","tag-virtualisation","tag-windows-server-2012","tag-windows-server-2012-r2"],"aioseo_notices":[],"jetpack_featured_media_url":"","amp_enabled":true,"_links":{"self":[{"href":"https:\/\/aidanfinn.com\/index.php?rest_route=\/wp\/v2\/posts\/15866","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aidanfinn.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aidanfinn.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aidanfinn.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/aidanfinn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=15866"}],"version-history":[{"count":0,"href":"https:\/\/aidanfinn.com\/index.php?rest_route=\/wp\/v2\/posts\/15866\/revisions"}],"wp:attachment":[{"href":"https:\/\/aidanfinn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=15866"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aidanfinn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=15866"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aidanfinn.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=15866"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}