More disk(s) fun


July 07, 2016 posted by Martin Husemann

When I got my Sun T1000 machine, it came with a ~80 GB hard disk - good enough for a NetBSD installation, but a bit challenged when you want to use logical domains. Time to expand disk space, or maybe make it faster? But these 1U server machines do not offer a lot of room for extensions, and it is sometimes tricky to get hold of the official extension options nowadays.

So I had fun with disks and modern replacements again... (after the scsi2sd adventures).

The T1000 were offered in single 3.5" disk configurations (this is what I got) or with two 2.5" disks. The mainboard has two sata (sas?) connectors. But the disk tray in my machine is not usable for mounting two 2.5" HDs.

But: the machine has a spare PCIe slot:
PCIe slot on the back of a T1000
and we support NVMe, so why not put a M.2 module in an adapter card in there? I tried and failed. I learned that the T1000's PCIe x4 slot is PCIe version 1, but modern NVMe modules do not fancy working in anything older than PCIe version 3.

Too bad, but whatever. I switched things around, my amd64 desktop machine got a faster "SSD" (i.e. the NVMe), another machine got the SSD freed from there and I ended up with a spare 128 GB sata SSD.

Now the T1000 had a sata connector free, but no way to place the disk and no power connector for it. The mainboard had a legacy 5/12V jack and the single disk used a strange power/sata connector:

SATA and power connector for the single disk in my T1000

but of course that could be replaced easily. I cut a Y-sata power split and one legacy 5/12V power connector from an old (broken) PSU and soldered a dual sata power connector cable that connected to the jack on the mainboard.

I found a small cavity in the at the front of the machine in the sheet separating PSU and disk from the fans and mainboard. Big enough to push a sata power connector and a sata connector through! So I just glued the SSD at the bottom of the chasis in front of the fans (it should be low enough to not harm airflow significantly):
SSD on bottom of chasis

It was a bit tricky to fit the custom power cabling and the standard sata cable alongside the disk, and I hope the disk will not get too hot to unsolder the connectors ;-)
Custom power cabling for the SSD
Hardware service technicians would hate this, as usually the T1000 offers really easy and fast hard disk replacement, but I suppose no one but me will ever deal with hardware failure on this particular machine.

Now thats it, fast base system on SSD and plenty of space for other LDOMs data on the second disk:

mpt0 at pci3 dev 2 function 0: Symbios Logic SAS1064 (rev. 0x02)
mpt0: interrupting at ivec 7c0
mpt0: Phy 0: Link Status Unknown
mpt0: Phy 0: Link Status Unknown
scsibus0 at mpt0: 63 targets, 8 luns per target
scsibus0: waiting 2 seconds for devices to settle...
sd0 at scsibus0 target 0 lun 0:  disk fixed
sd0: 111 GB, 114474 cyl, 16 head, 127 sec, 512 bytes/sect x 234441648 sectors
sd0: tagged queueing
sd1 at scsibus0 target 1 lun 0:  disk fixed
sd1: 1863 GB, 1907730 cyl, 16 head, 127 sec, 512 bytes/sect x 3907029168 sectors
sd1: tagged queueing

Unfortunately the machine is louder than hell, and even though the rack is in our basement, the sound level is still irritating elsewhere in the house (massive stone walls, old style german construction). My wife officially hates the T1000.

Now that the hardware is ready, it is time to get it fully supported and import the LDOM management/utilities. I need to find time and help Palle!

[5 comments]

 



Comments:

But the machine will run Solaris...not? Can you use Logical Domains with NetBSD? Or primary with Solaris and ldoms with NetBSD?

Posted by Jose Luis on July 08, 2016 at 08:57 AM UTC #

No, NetBSD (of course). We are nearly there (yeah, I know it is high time). The LDOM conecepts are mostly done by the hypervisor, even firmware on the ldoms is only aware of its part of the hardware. I don't have a Solaris version of the ldom manager software, so I neither know nor could test whether it will be compatible, but it will certainly be possible to run OpenBSD and NetBSD side by side on the same machine (in both roles).

Posted by Martin Husemann on July 08, 2016 at 11:52 AM UTC #

The fans in the T1000 are rated at 24cfm and 55db noise each. 4 fans nets you 61db noise and 96cfm. You could replace the fans with lower cfm, rpm, noise like the FFB0424VHN-F00 rated at 15.8cfm, 41.9db noise, four of these fans nets you 47.9db of noise at 63.2cfm , a 13.1db noise reduction. The reduced air flow should be sufficient as it is not in a server farm environment. A 10db audio reduction is a perceived halving of the sound level, 13db would be closer to one third as loud. The reduction of wife irritation should greatly increase harmonious wife husband relations, offsetting the cost of the fans. calculations based on http://www.engineeringtoolbox.com/adding-decibel-d_63.html and http://www.sengpielaudio.com/calculator-levelchange.htm

Posted by Gregory Ross on July 08, 2016 at 05:38 PM UTC #

I found a small cavity in the at the front of the machine in the sheet separating PSU and disk from the fans and mainboard. Big enough to push a sata power connector and a sata connector through!

Posted by Glassesshop on August 04, 2016 at 07:51 AM UTC #

The fans in the T1000 are rated at 24cfm and 55db noise each. 4 fans nets you 61db noise and 96cfm. You could replace the fans with lower cfm, rpm, noise like the FFB0424VHN-F00 rated at 15.8cfm, 41.9db noise, four of these fans nets you 47.9db of noise at 63.2cfm , a 13.1db noise reduction.

Posted by Glassesshop on September 13, 2016 at 07:10 AM UTC #

Post a Comment:
Comments are closed for this entry.