[TriLUG] [For Sale] Lab-In-A-Box: Home lab needs to go! Roughly 28 RU & 600+ lbs, box not included

Derek Linz via TriLUG trilug at trilug.org
Sat Dec 19 22:17:28 EST 2015


Fellow tinkerers, the time has finally come--I'll be moving soon, likely to
New England, and there's no way I'm lugging 600+ lbs of hardware with me.

In short, this package includes everything you need to set up a home lab--
if you wanted to take it home, plug cable it up, and power everything on,
you could have a fully operational test environment in very little time.

*NetApp Storage* - 25.43TB of raw disk capacity, mixed SATA and 15K FC
(50/50 by capacity)-- Expandable to 2.35PB (1196 disks)
*Brocade SAN - *64 4GB ports across 3 FC switches
*Dell/Cisco Networking:* 34 1GBe ports total
*IBM Compute: *x3550 M3 & x3550 M1 -- 12 cores/ 128GB memory, ssd cache + 4
cores 16GB memory
*Cabling: *All the Cat5e and optical cabling you'll need
*Odds and Ends: *Assorted PCI/PCI-E/PCI-X server adapters
*OS: *ESXi 6.0 Enterprise Plus (Licensed through 4/26/2016), RHEL 7.2
Enterprise Server (Licensed through 2/20/2017), OnTAP 8.2.4 (Licensing does
not expire), FabOS (Licensing does not expire)

While this is some fairly expensive (if somewhat dated by now) hardware,
don't be shy about making an offer--I'll leave the 6U storage controller on
the side of the road if I have to, I'm absolutely not bringing it with me.

Is anyone interested in adopting my problem child?


*Complete list of the inventory follows:*

*SAN:*

*(2) Brocade Silkworm 200E 16 port 4GB FIber Channel switches*

*(1) Brocade Silkworm 5000 32 port 4GB FIber Channel Switch*


*(64) 4Gb Finistar or equivilant SFP modules*


All switches are running the latest supported FabOS firmware and are
licensed


*IP Network:*


*(1) Dell Powervault 2824 24 port Gbe switch, two combo ports*


*Optional: *

*(1) Cisco SG300 10 port managed switch, two combo ports *

*-*Layer 2 or Layer 3 mode

-I’m using this outside my lab, but I don’t necessarily need to be


*(2) Cisco 10gbe SFPs (negotiates down to 1Gbe)*


*Compute:*


*(1) IBM x3550 M3 1U Server, 128GB memory, Dual-Socket “Westmere” Server*


(18) DIMM slots, fully populated with (12) 8GB DDR3 ECC and (6) 4GB DDR3 ECC

(2) Intel Xeon Hexcore CPUS, E5645 @ 2.40GHz

(2) 1GBe onboard adapters (broadcom)

(1) Management port, 10/100

(1) Hardware license key for remote KVM console

(2) PCI-E riser cards expansion ports

(1) Dual-Port Emulex LPe11000 4GB FC initiator card

(1) Dual-Port Intel 1GBe adapter

(2) Hot-Swappable PSUs

(8) 2.5” SAS ports, hot-swappable — no trays, ghetto rigged

Assorted drives installed:

72GB 10K RPM SAS

144GB 10K RPM

300GB 10K RPM

240GB SSD used for flash-cache


Boots off a 30GB SSD (via USB currently) containing ESXi 6.0

Internal USB port for hyper-visor


Reported power consumption under load: 250-300W


*(1) IBM x3550 M1 1U Server, 16GB memory, Dual-Socket “Dempsey” Server*


(8) DIMM slots, fully populated with (8) 2GB DDR3 ECC

(2) Intel Xeon 5050 Dual-Core CPUS, 3GHz, 64bit, virtualization extensions

(2) 1GBe onboard adapters (broadcom

(1) Management port, 10/100

(1) PCI-E riser card

(1) PCI-X riser card

(1) Dual-port QLogic ISP2432-based 4GB FC initiator

(1) RT3062 Wireless 802.11n adapter (I don’t know, I didn’t like the slot
being empty, sue me)

(1) PSU

(2) 3.5” hot-swap FC drives, 72GB 10k RPM (Raid 0)

Currently running RHEL 7.2, registration valid until 2/20/2017

Reported power consumption: 10W and definitely *not *accurate in any way.

*Storage:*


*(1) NETAPP FAS6080 6U Filer Head/Controller running OnTAP OS 8.2.4  (l*atest,
licensed), cluster mode

This thing is a beast!

Supports a maximum of *1196 drives* (*2.35 PetaBytes* of raw capacity) in 4
dual-attached FC loops, 84 drivers per loop (max)

(4) dual core 2.8ghz AMD processors

(16)2Gb ECC memory modules

(1) 2GB NVRAM with internal battery power sufficient to preserve memory
contents for at least 7-10 days without power

(6) onboard 1Gbe ports

(8) onboard 4GB FC ports, target or initiator mode

(1) RJ45 serial port

(1) RJ45 —> serial cable

(1) Serial —> usb adapter (if requested)

(1) Remote Lan Module and ethernet management port for managing the array
during operations requiring system reboots

(5) PCI Express Expansion Ports

(3) PCI-X Expansion Slots

(2) 1100w, hot swappable power supplies— 615w typical power usage @110v


*6U, 120lbs*

I have enough spare cards to fully populate the expansion slots with
additional FC ports and/or additional Gbe ports if requested.


*(2) DS14-MK4-FC disk shelves*

-14 disk capacity per shelf

-Dual 4GB (ESH4) FC IO modules

-Requires Fiber Channel disks

-Redundant hot-swap power supplies (650w)

*3U, 77lbs*


*(2) DS14-MK2-AT disk shelves*

-14 disk capacity per shelf

-Dual 4GB FC (ESH4) IO modules for compatibility, operating speed is 2GB/s

-Requires SATA disks

-Redundant hot-swap power supplies (650w)

*3U, 68lbs*


*(1) DS14-MK2-FC disk shelf*

-14 disk capacity

-Dual 4GB FC (ESH4) IO modules for compatibility, operating speed is 2GB/s

-Requires Fiber Channel disks

-Redundant hot-swap power supplies (650w)

*3U, 77lbs*


4 shelves are fully populated—one of the DS14-MK2-AT shelves is empty.

*Drives installed are:*


(10) 450GB 15k RPM 4GB FC disks

(30) 300GB 15k RPM 4GB FC disks

(14) 1TB 7200RPM disks

(2) 144GB 15K RPM disks (root aggregate)


*Storage report from On Command Balance:*

*Ghost : FAS6080 : NetApp Release 8.2.4 Cluster-Mode*

*NFS shares:                      *1
*Total Disks:*                       56
*Total raw capacity:*           25.43 TB
*CIFS shares:*                      3
*Spare Disks:*                      2
*Total formatted capacity:* 17.41 TB
*Volumes:*                            7
*Aggregates:*                        3
*Free formatted capacity:*   5.95 TB
*LUNs:*                                  4
*FC Ports:*                            4
*Used capacity:*                   66 %
The maximum IO rate was 5,479 IOs/Sec
The average IO rate was 503 IOs/Sec
Ghost had 8 processor(s) and an average CPU utilization of 7%


*Odds & Ends*

(24) Cat5e cables (minimum)

(A lot) fiber channel cables

(5) extra 4GB DDR3 ECC dimms

(1) Dell D610 laptop with a bad GPU, will not run X11, 3 wireless adapters,
serial port (poor man’s terminal server…I sit it on top and ssh into it for
serial console access when necessary…other times it just sniffs wifi
traffic)

(1) 15” LCD, DVI/VGA input

(1) 2-port KVM switch, VGA/USB based

(1) Dell keyboard, UK layout (Great for getting really annoyed at the UK
for being just different enough to mess up typing)

(0) Mice…why do you need a mouse?


*PCI-E  and PCI-X Adapters*

QLogic hardware-accelerated iSCSI card(s)

Dual and Quad Port Intel Gbe Adapters

Dual and Quad Port 4GB FC initiators and target adapters

Intel Dual-Port 10GB, fiber-optic medium network adapter (*does not work in
windows, development prototype revision—works fine in Linux)*

Quad-Port PCI-X TOE offload iSCSI card (massive)


Thanks for looking!


More information about the TriLUG mailing list