User Tools

Site Tools


computing:storage:shared_storage

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
computing:storage:shared_storage [2013/07/17 10:09]
gcooper
— (current)
Line 1: Line 1:
-====== Shared Storage System ====== 
  
-See also: **[[sonora:sonora_data_center|Sonora Communications Data Center]]** 
- 
-See also: **[[computing:storage:napp-it|napp-it ZFS Storage Server]]** 
- 
-See also: **[[computing:storage:raid_controllers|RAID Controllers]]** 
- 
-See also: **[[computing:storage:controllers|SAS and SATA Controllers]]** 
- 
-See also: **[[computing:storage:drive_mount_trays|Drive Mounting Trays]]** 
- 
-See also: **[[networking:10g_ethernet|High Performance Networking]]** 
- 
-http://constantin.glez.de/blog/2010/04/ten-ways-easily-improve-oracle-solaris-zfs-filesystem-performance 
- 
-http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide 
- 
-http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide 
- 
-http://info.nexenta.com/rs/nexenta/images/nexenta_hardware_supported_list.pdf 
- 
-===== Ideal 2U Components ===== 
- 
-12-Drive Chassis (3.5"): http://www.supermicro.com/products/chassis/2U/826/SC826BE16-R920W.cfm 
- 
-2-Drive Bracket (2.5"): MCP-220-82609-0N 
- 
-===== Least Cost 2U Storage Server Configuration ===== 
- 
-^Item                        ^Price      ^Note             ^ 
-|2U SYS-6027R-TRF Server      $1,060.00|8 drive bays     | 
-|2x Xeon E5-2609 2.4GHz CPUs |     550.00|$275 each        | 
-|8x 16GB (128GB) 1600 RDIMM  |    1072.00|$134 each, M393B2G70BH0-CK0 | 
-|LSI 9207-8i SAS2 Controller |     244.00|8 ports          | 
-|2x 32GB SSD (System Drive)  |      90.00|$45 each         | 
-|6x 2TB 7200 SAS Drives      |    1350.00|$225 ea, ST32000645SS | 
-|2-Port 10GbE NIC            |     535.00|RJ-45, X540-T2   | 
-|                            |   ========|                 | 
-|                            |  $4,901.00|Total            | 
- 
-===== Sample 4U Storage Server Configuration ===== 
- 
-^Item                        ^Price      ^Note             ^ 
-|4U Storage Server            $2,079.17|24 drive bays    | 
-|2x Xeon E5-2609 CPUs @ $300 |     534.00|$267 each        | 
-|8x 8GB (64GB) 1600 RDIMM    |     490.24|$61 each, M393B1K70DH0-CK0 | 
-|2x 2.5" Drive Tray          |      40.00|system drives    | 
-|BBU                             165.00|in stock         | 
-|2x 32GB SSD (System Drive)  |      92.00|$46 each         | 
-|20GB Intel 311 SSD (ZIL)    |     100.00|write log        | 
-|100GB Intel 710 SSD (L2ARC) |     400.00|read cache       | 
-|6x 3TB 7200 SAS Drives      |   1,356.00|$226, HUS723020ALS640 | 
-|6x 600GB 15K SAS Drives       2,190.00|$365, ST3600057SS | 
-|2-Port 10GbE NIC            |     517.21|RJ-45            | 
-|                            |   ========|                 | 
-|                            |  $8,029.62|Total            | 
- 
-===== Head Unit ===== 
- 
-  * Use this head unit with a JBOD for disk drives 
- 
-==== 1U ==== 
- 
-http://www.supermicro.com/products/system/1U/1026/SYS-1026T-6RF_.cfm 
- 
-Supermicro SYS-1026T-6RFT+ - $1,501.17 
- 
-  * 1U 
-  * 2x Socket LGA1366 
-  * 8x 2.5" Drive Bays 
-  * LSI 2108 Storage Controller 
-    * 2x I-PASS Connectors 
-  * 2x GbE 
-  * 2x 10GbE (SFP+) 
-  * 700W Redundant Power Supply 
- 
-===== Storage Servers ===== 
- 
-  * These servers can serve as head units plus have many hot-swap drive bays 
-  * These all need 10GbE NICs 
-  * These servers do not have dual SAS repeaters 
-    * The backplane must have dual SAS repeaters for HA 
-  * These servers come with AOC-SAS2LP-H8iR RAID controllers 
- 
-2U - $1,832.75: 
- 
-  * 12x 3.5" SAS/SATA Drive Bays 
-  * 920W Redundant Power Supplies 
-  * http://www.supermicro.com/products/system/2U/6027/SSG-6027R-E1R12N.cfm 
- 
-3U - $1,935.35: 
- 
-  * 16x 3.5" SAS/SATA Drive Bays 
-  * 920W Redundant Power Supplies 
-  * http://www.supermicro.com/products/system/3U/6037/SSG-6037R-E1R16N.cfm 
- 
-4U - $2,079.17: 
- 
-  * 24x 3.5" SAS/SATA Drive Bays 
-  * 920W Redundant Power Supplies 
-  * 2x 2.5" OS Drive Tray (MCP-220-84606-0N) 
-  * http://www.supermicro.com/products/system/4U/6047/SSG-6047R-E1R24N.cfm 
- 
-===== Processors ===== 
- 
-==== AMD ==== 
- 
-=== Socket G34 === 
- 
-http://www.newegg.com/Product/Product.aspx?Item=N82E16819113026 
- 
-http://www.newegg.com/Product/Product.aspx?Item=N82E16819113028 
- 
-==== Intel ==== 
- 
-=== Socket LGA 1366 === 
- 
-http://www.newegg.com/Product/ProductList.aspx?Submit=ENE&N=100008494%2050001157%20600048497&IsNodeId=1&name=LGA%201366 
- 
-=== Socket LGA 2011 === 
- 
-http://www.newegg.com/Product/ProductList.aspx?Submit=ENE&N=100008494%2050001157%20600303512&IsNodeId=1&name=LGA%202011 
- 
-===== RAM ===== 
- 
-==== 1600 ==== 
- 
-http://malabs.com/product/D3-16R8GS1 
- 
-  - Samsung 8GB M393B1K70DH0-CK0 - $61.28 
-  - Dual Rank 
-  - HCL listed 
-  - 32GB RAM - $61.28 x 4 = $245.12 
-  - 64GB RAM - $61.28 x 8 = $490.24 
- 
-==== 1333 ==== 
- 
-http://malabs.com/product/D3-13R8GH1 
- 
-  * Hynix DDR3-1333 8GB ECC/REG Original Server Memory - $68.50 
-  * 48GB RAM - $68.50 x 6 = $411 
- 
-===== BBU ===== 
- 
-  * Supermicro BTR-0018L-0000-LSI - $175.10 - in stock 
-  * Supermicro BTR-0018L-KIT LSI iBBU07 extension kit - $51.50 
- 
-===== Read Cache (L2ARC) ===== 
- 
-  * L2ARC - Adaptive Replacement Cache 
-  * One or more inexpensive MLC SSD - Not mirrored 
-  * Add RAM before implementing L2ARC 
- 
-===== Write Cache (ZIL) ===== 
- 
-[[http://www.intel.com/content/dam/www/public/us/en/documents/technology-briefs/ssd-320-series-power-loss-data-protection-brief.pdf|Power Loss Data Protection] 
- 
-[[http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide#Separate_Log_Devices|Solaris ZFS Best Practices For Log Devices]] 
- 
-http://info.nexenta.com/rs/nexenta/images/nexenta_hardware_supported_list.pdf 
- 
-http://www.nexentastor.org/boards/1/topics/972 
- 
-http://hardforum.com/showthread.php?t=1591181 
- 
-==== ZFS Intent Log (SLOG) ==== 
- 
-  * Assigned per pool 
-    * Shared by all datasets (file systems, volumes, clones) contained within the pool  
-  * One or more SSD 
-    * Not Mirrored 
-    * RAID0 for more performance 
-  * Need SSD tuned for writes and long life 
-    * SLC may be best, but more expensive 
-  * With supercapacitor to guaranty writes are completed 
-    * 3rd-gen Intel SLC SSDs should meet this requirement 
-    * X25-E (eMLC, supercap) 
-    * Vertex 3 Pro 
-    * P400 
- 
-==== DRAM Based ==== 
- 
-http://www.ddrdrive.com/ 
- 
-http://www.ddrdrive.com/zil_rw_revelation.pdf 
- 
-http://www.ddrdrive.com/zil_accelerator.pdf 
- 
-===== JBOD Unit ===== 
- 
-[[http://www.sasexpanders.com|Why SAS Expanders]] 
- 
-One SAS2 expander: $1,737.47 
- 
-http://www.supermicro.com/products/chassis/4U/847/SC847E16-RJBOD1.cfm 
- 
-Two SAS2 expanders: $1,994.48 
- 
-http://www.supermicro.com/products/chassis/4U/847/SC847E26-RJBOD1.cfm 
- 
-===== Storage Operating System Software ===== 
- 
-http://www.anandtech.com/show/3963/zfs-building-testing-and-benchmarking 
- 
-http://www.nexenta.com/corp/index.php 
- 
-===== ZFS ===== 
- 
-See **[[computing:storage|ZFS]]**. 
computing/storage/shared_storage.1374077350.txt.gz · Last modified: 2013/07/17 10:09 by gcooper