User Tools
This is an old revision of the document!
Table of Contents
Shared Storage System
Sonora Communications Data Center
http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide
http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide
http://info.nexenta.com/rs/nexenta/images/nexenta_hardware_supported_list.pdf
Least Cost 2U Storage Server Configuration
| Item | Price | Note |
|---|---|---|
| 2U SYS-6027R-TRF Server | $1,060.00 | 8 drive bays |
| 2x Xeon E5-2609 2.4GHz CPUs | 550.00 | $275 each |
| 8x 16GB (128GB) 1600 RDIMM | 1072.00 | $134 each, M393B2G70BH0-CK0 |
| LSI 9207-8i SAS2 Controller | 244.00 | 8 ports |
| 2x 32GB SSD (System Drive) | 90.00 | $45 each |
| 6x 2TB 7200 SAS Drives | 1350.00 | $225 ea, ST32000645SS |
| 2-Port 10GbE NIC | 535.00 | RJ-45, X540-T2 |
| ======== | ||
| $4,901.00 | Total |
Sample 4U Storage Server Configuration
| Item | Price | Note |
|---|---|---|
| 4U Storage Server | $2,079.17 | 24 drive bays |
| 2x Xeon E5-2609 CPUs @ $300 | 534.00 | $267 each |
| 8x 8GB (64GB) 1600 RDIMM | 490.24 | $61 each, M393B1K70DH0-CK0 |
| 2x 2.5“ Drive Tray | 40.00 | system drives |
| BBU | 165.00 | in stock |
| 2x 32GB SSD (System Drive) | 92.00 | $46 each |
| 20GB Intel 311 SSD (ZIL) | 100.00 | write log |
| 100GB Intel 710 SSD (L2ARC) | 400.00 | read cache |
| 6x 3TB 7200 SAS Drives | 1,356.00 | $226, HUS723020ALS640 |
| 6x 600GB 15K SAS Drives | 2,190.00 | $365, ST3600057SS |
| 2-Port 10GbE NIC | 517.21 | RJ-45 |
| ======== | ||
| $8,029.62 | Total |
Head Unit
- Use this head unit with a JBOD for disk drives
1U
http://www.supermicro.com/products/system/1U/1026/SYS-1026T-6RF_.cfm
Supermicro SYS-1026T-6RFT+ - $1,501.17
- 1U
- 2x Socket LGA1366
- 8x 2.5” Drive Bays
- LSI 2108 Storage Controller
- 2x I-PASS Connectors
- 2x GbE
- 2x 10GbE (SFP+)
- 700W Redundant Power Supply
Storage Servers
- These servers can serve as head units plus have many hot-swap drive bays
- These all need 10GbE NICs
- These servers do not have dual SAS repeaters
- The backplane must have dual SAS repeaters for HA
- These servers come with AOC-SAS2LP-H8iR RAID controllers
2U - $1,832.75:
- 12x 3.5“ SAS/SATA Drive Bays
- 920W Redundant Power Supplies
3U - $1,935.35:
- 16x 3.5” SAS/SATA Drive Bays
- 920W Redundant Power Supplies
4U - $2,079.17:
- 24x 3.5“ SAS/SATA Drive Bays
- 920W Redundant Power Supplies
- 2x 2.5” OS Drive Tray (MCP-220-84606-0N)
Processors
AMD
Socket G34
http://www.newegg.com/Product/Product.aspx?Item=N82E16819113026
http://www.newegg.com/Product/Product.aspx?Item=N82E16819113028
Intel
Socket LGA 1366
Socket LGA 2011
RAM
1600
http://malabs.com/product/D3-16R8GS1
- Samsung 8GB M393B1K70DH0-CK0 - $61.28
- Dual Rank
- HCL listed
- 32GB RAM - $61.28 x 4 = $245.12
- 64GB RAM - $61.28 x 8 = $490.24
1333
http://malabs.com/product/D3-13R8GH1
- Hynix DDR3-1333 8GB ECC/REG Original Server Memory - $68.50
- 48GB RAM - $68.50 x 6 = $411
BBU
- Supermicro BTR-0018L-0000-LSI - $175.10 - in stock
- Supermicro BTR-0018L-KIT LSI iBBU07 extension kit - $51.50
Read Cache (L2ARC)
- L2ARC - Adaptive Replacement Cache
- One or more inexpensive MLC SSD - Not mirrored
- Add RAM before implementing L2ARC
Write Cache (ZIL)
Solaris ZFS Best Practices For Log Devices
http://info.nexenta.com/rs/nexenta/images/nexenta_hardware_supported_list.pdf
ZFS Intent Log (SLOG)
- Assigned per pool
- Shared by all datasets (file systems, volumes, clones) contained within the pool
- One or more SSD
- Not Mirrored
- RAID0 for more performance
- Need SSD tuned for writes and long life
- SLC may be best, but more expensive
- With supercapacitor to guaranty writes are completed
- 3rd-gen Intel SLC SSDs should meet this requirement
- X25-E (eMLC, supercap)
- Vertex 3 Pro
- P400
DRAM Based
JBOD Unit
One SAS2 expander: $1,737.47
http://www.supermicro.com/products/chassis/4U/847/SC847E16-RJBOD1.cfm
Two SAS2 expanders: $1,994.48
http://www.supermicro.com/products/chassis/4U/847/SC847E26-RJBOD1.cfm
Storage Operating System Software
ZFS
See ZFS.
