- \n
- File based storage: high performance SMB protocol for Hyper-V storage over Ethernet networks. In addition: the scale-out file server to make SMB HA with transparent failover. SMB is the best way to do Hyper-V storage, even with backend SAN. <\/li>\n
- Storage Spaces: Cost-effective business critical storage <\/li>\n<\/ul>\n
Enterprise Storage Management Scenarios with SC 2012 R2<\/u><\/strong><\/p>\n
Summary: not forgotten. We can fully manage FC SAN from SysCtr via SMI’-S now, including zoning. And the enhancements in WS2012 such as TRIM, UNMAP, and ODX offer great value.<\/p>\n
Hector, Storage PM in VMM, comes up to demo.<\/p>\n
Demo: SCVMM<\/u><\/strong><\/p>\n
Into the Fabric view of the VMM console. Fibre Channel Fabrics is added to Providers under Storage. He browses to VMs and Services and expands an already deployed 1 tier service with 2 VMs. Opens the Service Template in the designer. Goes into the machine tier template. There we see that FC is surfaced in the VM template. It can dynamically assign or statically assign FC WWNs. There is a concept of fabric classification, e.g. production, test, etc. That way, Intelligent Placement can find hosts with the right FC fabric and put VMs there automatically for you. <\/p>\n
Opens a powered off VM in a service. 2 vHBAs. We can see the mapped Hyper-V virtual SAN, and the 4 WWNs (for seamless Live Migration). In Storage he clicks Add Fibre Channel Array. Opens a Create New Zone dialog. Can select storage array and FC fabric and the zoning is done. No need to open the SAN console. Can create a LUN, unmask it at the service tier \u2026. in other words provision a LUN to 64 VMs (if you want) in a service tier with just a couple of mouse clicks \u2026 in the VMM console. <\/p>\n
In the host properties, we see the physical HBAs. You can assign virtual SANs to the HBAs. Seems to offer more abstraction than the bare Hyper-V solution \u2013 but I\u2019d need a \u20ac50K SAN and rack space to test
![\"Smile\"](\"https:\/\/aidanfinn.com\/wp-content\/uploads\/2013\/06\/wlEmoticon-smile6.png\")
<\/p>\nSo instead of just adding vHBA support, but they\u2019ve given us end-end deployment and configuration.<\/p>\n
Requirement: SMI-S provider for the FC SAN.<\/p>\n
Demo: ODX<\/u><\/strong><\/p>\n
In 30 seconds, 3% of BITS VM template creation is done. Using same setup but with ODX, but the entire VM can be deployed and customized much more quickly. In just over 2 minutes the VM is started up.<\/p>\n
Back to Elden<\/p>\n
The Road Ahead<\/u><\/strong><\/p>\n
WS2012 R2 is cloud optimized \u2026 short time frame since last release so they went with a focused approach to make the most of the time:<\/p>\n
- \n
- Private clouds <\/li>\n
- Hosted clouds <\/li>\n
- Cloud Service Providers <\/li>\n<\/ul>\n
Focus on capex and opex costs. Storage and availability costs<\/p>\n
IaaS Vision<\/u><\/strong><\/p>\n
- \n
- Dramatically lowering the costs and effort of delivering IaaS storage services <\/li>\n
- Disaggregated compute and storage: independent manage and scale at each layer. Easier maintenance and upgrade. <\/li>\n
- Industry standard servers, networking and storage: inexpensive networks. inexpensive shared JBOD storage. Get rid of the fear of growth and investment. <\/li>\n<\/ul>\n
SMB is the vision, not iSCSI\/FC, although they got great investments in WS2012 and SC2012 R2.<\/p>\n
Storage Management Pillars<\/u><\/strong><\/p>\n
![\"picture053\"](\"https:\/\/aidanfinn.com\/wp-content\/uploads\/2013\/06\/picture053_thumb.jpg\" "\\"picture053\\"")
<\/a><\/p>\nStorage Management API (SM-API)<\/u><\/strong><\/p>\n
![\"DSCN0086\"](\"https:\/\/aidanfinn.com\/wp-content\/uploads\/2013\/06\/DSCN0086_thumb.jpg\" "\\"DSCN0086\\"")
<\/a><\/p>\nVMM + SOFS & Storage Spaces<\/u><\/strong><\/p>\n
- \n
- Capacity management: pool\/volume\/file share classification. File share ACL. VM workload deployment to file shares. <\/li>\n
- SOFS deployment: bare metal deployment of file server and SOFS. <\/li>\n
- Spaces provisioning <\/li>\n<\/ul>\n
Guest Clustering With Shared VHDX<\/u><\/strong><\/p>\n
See yesterday\u2019s post.<\/p>\n
iSCSI Target<\/u><\/strong><\/p>\n
- \n
- Uses VHDX instead of VHD. Can import VHD, but not create. Provision 64 TB and dynamically resize LUNs <\/li>\n
- SMI-S support built in for standards based management, VMM. <\/li>\n
- Can now manage an iSCSI cluster using SCVMM <\/li>\n<\/ul>\n
Back to Hector \u2026<\/p>\n
Demo: SCVMM<\/u><\/strong><\/p>\n
Me: You should realise by now that System Center and Windows Server are developed as a unit and work best together.<\/p>\n
He creates a Physical Computer Profile. Can create a VM host (Hyper-V) or file server. The model is limited to that now, but later VMM could<\/em> be extended to deploy other kinds of physical server in the data centre. <\/p>\n
Hector deploys a clustered file server. You can use existing machine (enables roles and file shares on existing OS) OR provision a bare metal machine (OS, cluster, etc, all done by VMM). He provisions the entire server, VMM provisions the storage space\/virtual disk\/CSV, and then a file share on a selected Storage Pool with a classification for the specific file share.<\/p>\n
Now he edits the properties of a Hyper-V cluster, selects the share, and VMM does all the ACL work.<\/p>\n
Basically, a few mouse clicks in VMM and an entire SOFS is built, configured, shared, and connected. No logging into the SOFS nodes at all. Only need to touch them to rack, power, network, and set BMC IP\/password.<\/p>\n
SMB Direct<\/u><\/strong><\/p>\n
- \n
- 50% improvement for small IO workloads with SMB Direct (RDMA) in WS2012 R2. <\/li>\n
- Increased performance for 8K IOPS <\/li>\n<\/ul>\n
Optimized SOFS Rebalancing<\/u><\/strong><\/p>\n
- \n
- SOFS clients are now redirected to the \u201cbest\u201d node for access <\/li>\n
- Avoids uneccessary redirection <\/li>\n
- Driven by ownership of CSV <\/li>\n
- SMB connections are managed by share instead of per file server. <\/li>\n
- Dynamically moves as CSV volume ownership changes \u2026 clustering balances CSV automatically. <\/li>\n
- No admin action. <\/li>\n<\/ul>\n
Hyper-V over SMB<\/u><\/strong><\/p>\n
Enables SMB Multichannel (more than 1 NIC) and Direct (RDMA \u2013 speed). Lots of bandwidth and low latency. Vacate a host really quickly. Don\u2019t fear those 1 TB RAM VMs
<\/p>\nSMB Bandwidth Management<\/u><\/strong><\/p>\n
We now have 3 QoS categories for SMB:<\/p>\n
- \n
- Default \u2013 normal host storage <\/li>\n
- VirtualMachine \u2013 VM accessing SMB storage <\/li>\n
- LiveMigration \u2013 Host doing LM <\/li>\n<\/ul>\n
Gives you granular control over converged networks\/fabrics because 1 category of SMB might be more important than others.<\/p>\n
Storage QoS<\/u><\/strong><\/p>\n
Can set Maximup IOPS and Minimum IOPS alerts per VHDX. Cap IOPS per virtual hard disk, and get alerts when virtual hard disks aren\u2019t getting enough bandwidth \u2013 could lead to auto LM to another better host.<\/p>\n
Jose comes up \u2026<\/p>\n
Demo: <\/u><\/strong><\/p>\n
Has a 2 node SOFS. 1 client: a SQL server. Monitoring via Perfmon, and both the SOFS nodes are getting balanced n\/w utilization caused by that 1 SQL server. Proof of connection balancing. Can also see that the CSVs are balanced by the cluster. <\/p>\n
Jose adds a 3rd file server to the SOFS cluster. It\u2019s just an Add operation of an existing server that is physically connected to the SOFS storage. VMM adds roles, etc, and adds the server. After a few minutes the cluster is extended. The CSVs are rebalanced across all 3 nodes, and the client traffic is rebalanced too. <\/p>\n
That demo was being done entirely with Hyper-V VMs and shared VHDX on a laptop.<\/em><\/p>\n
Another demo: Kicks off an 8K IO worklaod. Single client talking to single server (48 SSDs in single mirrored space) and 3 infiniband NICs per server. Averaging nearly 600,000 IOPS, sometimes getting over that. Now he enables RAM caching. Now he gets nearly 1,000,000 IOPS. CPU becomes his bottleneck
<\/p>\nNice timing: question on 32K IOs. That\u2019s the next demo
RDMA loves large IO. 500,000 IOPS, but now the throughput is 16.5 GIGABYTES (not Gbps) per second. That\u2019s 4 DVDs per second. No cheating: real usable data, going to real file system, nor 5Ks to raw disk as in some demo cheats.<\/p>\nBack to Elden \u2026<\/p>\n
Data Deduplication<\/u><\/strong><\/p>\n
Some enhancements:<\/p>\n
- \n
- Dedup open VHD\/VHDX files. Not supported with data VHD\/VHDX. Works great for volumes that only store OS disks, e.g. VDI. <\/li>\n
- Faster read\/write of optimized files \u2026 in fact, faster than CSV Block Cache!!!!! <\/li>\n
- Support for SOFS with CSV <\/li>\n<\/ul>\n
The Dedup filter redirects read request to the chunk store. Hyper-V does buffered IO that bypasses the cache. But Dedup does cache. So Hyper-V read of deduped files is cached in RAM, and that\u2019s why dedupe can speed up the boot storm.<\/p>\n
Demo: Dedup<\/u><\/strong><\/p>\n
A PM I don’t know takes the stage. This demo will be how Dedup optimizes the boot storm scenario. Starts up VMs\u2026 one collection is optimized and the other not. Has a tool to monitor boot up status. The deduped VMs start up more quickly.<\/p>\n
Reduced Mean Time To Recovery<\/u><\/strong><\/p>\n
- \n
- Mirrored spaces rebuild: parallelized recovery <\/li>\n
- Increased throughput during rebuilds. <\/li>\n<\/ul>\n
Storage Spaces<\/u><\/strong><\/p>\n
See yesterday\u2019s notes. They heapmap the data and automatically (don\u2019t listen to block storage salesman BS) promote hot data and demote cold data through the 2 tiers configured in the virtual disk (SSD and HDD in storage space).<\/p>\n
Write-Back Cache: absorbs write spikes using SSD tier.<\/p>\n
Brian Matthew takes the stage<\/p>\n
Demo: Storage Spaces<\/u><\/strong><\/p>\n
See notes from yesterday<\/p>\n
Back to Elden \u2026<\/p>\n
Summary<\/u><\/strong><\/p>\n
![\"DSCN0087\"](\"https:\/\/aidanfinn.com\/wp-content\/uploads\/2013\/06\/DSCN0087_thumb.jpg\" "\\"DSCN0087\\"")
<\/a><\/p>\nTechnorati Tags: Event Notes<\/a>,Windows Server 2012 R2<\/a>,Hyper-V<\/a>,System Center<\/a>,VMM<\/a>,Storage<\/a><\/div>\n","protected":false},"excerpt":{"rendered":"Speakers: Elden Christensen, Hector Linares, Jose Barreto, and Brian Matthew (last two are in the front row at least) 4:12 SSDs in 60 drive jbod. Elden kicks off. He owns Failover Clustering in Windows Server. New Approach To Storage File based storage: high performance SMB protocol for Hyper-V storage over Ethernet networks. In addition: the … Continue reading “TechEd NA 2013 – Software Defined Storage In Windows Server & System Center 2012 R2”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"categories":[14],"tags":[176,181,99,193,196,120],"class_list":["post-14863","post","type-post","status-publish","format-standard","hentry","category-eventnotes","tag-eventnotes","tag-hyper-v","tag-storage","tag-system-center","tag-vmm","tag-windows-server-2012-r2"],"aioseo_notices":[],"jetpack_featured_media_url":"","amp_enabled":true,"_links":{"self":[{"href":"https:\/\/aidanfinn.com\/index.php?rest_route=\/wp\/v2\/posts\/14863","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aidanfinn.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aidanfinn.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aidanfinn.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/aidanfinn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=14863"}],"version-history":[{"count":0,"href":"https:\/\/aidanfinn.com\/index.php?rest_route=\/wp\/v2\/posts\/14863\/revisions"}],"wp:attachment":[{"href":"https:\/\/aidanfinn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=14863"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aidanfinn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=14863"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aidanfinn.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=14863"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"picture053\"](\"https:\/\/aidanfinn.com\/wp-content\/uploads\/2013\/06\/picture053.jpg\" "\\"picture053\\"")
<\/a><\/p>\n