ebay is cheap 1 for esxi homelab

New serie: ebay is cheap !!

I can not buy any for tried.

Power supply and pcie are not standard for all motherboard,  one include adaptator. Not help for you sorry.

That is the good stuff on ebay:

Arima Quad CPU 16 core AMD Opteron motherboard

$59 + shipping

!CCh-4OgBGk~$(KGrHqUOKikE0slSLVEQBNLdSdp07!~~_3

Arima AMD 16 cores server motherboard (4 x 4 cpu 4 cores )

——-> Power supply converter cable <——- good

Support 10 SATA II HDD

64Gb ram DDR2

See description

Only Supports Linux

See description

Another version of this motherboard 

Are not the same!

$52.99 + shipping

$(KGrHqN,!hcFC80Il!t9BQ)8WOKUug~~60_1

Xsigo Systems F-X430047 DDR Infiniband 24-Port Switch Dual Power Supply New

$199 + free shipping

$_1

Switch infiniBand DDR, no manual on the web, possible not working with standard nic.

Dell PowerEdge C6145 Server Quad Socket G34 AMD System Motherboard 40N24

My prefered motherboard, good price $99.99 + shipping

$_1 (1)

-4 AMD Opteron 6100/6200/6300 series processors

-32 x DDR3 mini 64GB, maxi 1024GB

-PCIe adaptator not includ

-power supply not inclued, and custome

I’m not trying all, and you?

Advertisements
Posted in Uncategorized | Tagged , , | 2 Comments

Supermicro X8DTT-F+: mod a power supply

Second Party modifying a standard power supply, part of

-Supermicro X8DTT-F+: Mod Cooler Master HAF STACKER 915R

-Supermicro X8DTT-F+: Mod a power supply -Supermicro X8DTT

-Supermicro X8DTT-F+: connection and update BIOS, IPMI

-Supermicro X8DTT-F+: ESXi Installation

Attention open a power supply is very dangerous, even unplugged. There is a lot of risk to your life. Made a professional if you do not mastered the principles of electricity. I decline any responsibility on you and your equipment when tampering on your part.

• First unplug the power supply. And unload components, check for tension using a multimeter. • Then open your power supply to identify 12v rails. They are generally rated on the printed circuit. As the picture:

alim avec tensions.jpg

My power supply has 2 RAIL + 12V (+12v1 and +12v2). You can use several ways, iron welded, cut and son connected with small connectors. Attention the connector is seen from below

connector 1

The + 3.3v and + 5v will not be used.

The + 5V Standby (green wire) is useful to maintain a current in the motherboard when is power off, for example wol. And DC On (purple wire) is used to boot the PC. You must have this at the end

connector

Posted in Uncategorized | Leave a comment

Supermicro X8DTT-F+ part 1

Hello,

Looking for a motherboard to build a workstation and a management ESXi,
My choice is (as always) Supermicro.

There will be

-Supermicro X8DTT-F+: Mod Cooler Master HAF STACKER 915R
-Supermicro X8DTT-F+: Mod a power supply
-Supermicro X8DTT-F+: connection and update BIOS, IPMI
-Supermicro X8DTT-F+: ESXi Installation

The X8DTT-F+ seems to be the right motherboard, there are several standard versions and the InfiniBand version. After looking on ebay, an opportunity to reach into the mechanics.
Choosing a SGI Octane X8DTT III-F-SG007 Rev. 2.0, but the card is rebadged X8DTT is a standard, cheap ~50€ on ebay, with a Cooler Master HAF Cabinet Mini Tower case STACKER 915R.

Spec :

1. Intel® Xeon® processor 5600/5500

 2. Intel® 5520 (Tylersburg) Chipset
 3. Up to 192GB** DDR3 1333/ 1066/
 4. Dual Intel® 82574L Gigabit
 5. 1 (x16) PCI-E 2.0 slot
 6. Integrated Matrox G200eW Graphics
 7. Integrated IPMI 2.0 with KVM and
8. 1 PCI-E 2.0 x8 supports SMCI SAS

and Adaptec w/ Hardware RAID

On arrival the first problems are there, cool !!

Please do not plugged a standard power connector, even if he goes perfectly, and looked at it:

connector

Yellow son are power + 12v, black ground, purple + 5V Standby and green is the DC. So the wiring connector is not standard.

See a power supply to change it. There is this principle of RAIL who asks, what is it? I made you a little simplified diagram

Without RAIL:

power supply no RAIL

With RAIL:

power supply RAIL

The difference is a maximum protection by RAIL 18 to 20A + 12V. It will be easy to change this.

To finish photo ESXi installed, and the simple case mod

esxi x8dtt haf

Posted in supermicro, VMware, X8DTT-HEF+ | 5 Comments

Update firmware HP 452372-001 Infiniband PCIe on vsphere 5.5

For updating the HP 452372-001 card in ESXi 5.0 / 5.1 / 5.5 , you need 3 files :

mlnx-mft-2.7.1-1.vib

MLNX-MST-ESX-2.0.0.0

And firmware 2.7, 2.8 and 2.9 have some error in vsphere

Go to hold firmware page and select

– Adapter Cards
– ConnectX® VPI
– MHGH28-XTC

And your card rev:

-Rev X1-X4/A1: MT_04A0110002
-Rev A4/A5/A6/A7/A8:MT_04A0140005
-Rev A2/A3: MT_04A0120002

image

First upload file to ESXi in directory /tmp/ . And open ssh connection.

Change directory to /tmp/


cd /tmp/

Install mlnx-mft-2.7.1-1.vib


esxcli software vib install -v /tmp/mlnx-mft-2.7.1-1.vib --no-sig-check

image

Install MLNX-MST-ESX-2.0.0.0.zip


esxcli software vib install -d /tmp/MLNX-MST-ESX-2.0.0.0.zip --no-sig-check

image

With no ” –no-sig-check ” you have error of opensm. And reboot


reboot

Open ssh connection and mount tool


vmkload_mod mst

image

Check you device, and Firmware version on device


ls dev


/opt/mellanox/bin/flint -d /dev/mt25418_pciconf0 q

image

Or on vSphere client

image

Update device you have error, because it’s HP card and melanox firmware.


/opt/mellanox/bin/flint -d /dev/mt25418_pciconf0 -i /tmp/fw-25408-2_7_000-MHGH28-XTC_A1.bin -qq -y b

image

Add -allow_psid_change to line


/opt/mellanox/bin/flint -d /dev/mt25418_pciconf0 -i /tmp/fw-25408-2_7_000-MHGH28-XTC_A1.bin -qq -allow_psid_change -y b

image

Verify update

/opt/mellanox/bin/flint -d /dev/mt25418_pciconf0 q

image

image

And link up


./opt/opensm/bin/ibstat mlx4_0

image

image

Posted in infiniband, VMware | Tagged , , , , | 6 Comments

Helps to power up H8dme-ex-ls006

We are ready for the power up of the motherboard.

… But the traditional methods, the pins “power on” does not work.

Do not worry, connecting “NMI” pins, and motherboard power up.

If you are lucky, on the display screen you see boot logo. If not, only fan and black screen.

Why?

Maybe it’s a one or more RAM DIMM  dead. Just place one dimm and start motherboard. It’s ok? Move the dimms, until found the wrong one 🙂

After booting press del key to acces BIOS, and change the boot order with CD in first and USB after. Take an IP address IPMI, save and reboot.

Connecting with supermicro software IPMI view FTP link with ip adress gived before. User / pass is ADMIN / ADMIN.

In virtual devise plug iso of ESXi and connect it.

Look the screen tab, is your screen report, navigate it, and install ESXi.

My English has not improved…

Posted in H8DME-EX-LS006, VMware | Tagged , , | 19 Comments

Infiniband in the HomeLab

Update 10.22.13 : link OpenSM for ESXi 5.5

 

Just small post for all members, thank you.

-I posted at vmug.fr ” Infiniband Pour Vmotion, Ha, Vsa “
a thought, a desire, questions…

-At the same time Raphael Schitz, looking infiniband for nexenta and creat a VIB OpenSM for ESXi 5.1 ( not 5.5 at time ) and 5.5.

-Vladan post about it Homelab Storage Network Speedup with …. Infiniband, good explained with mellanox community link.

-and Erik Bussink deployed a lot of materials and times for the infiniband at home InfiniBand in the lab… Switchs, QDR cards…

And finaly vBrownbag TechTalk “InfiniBand in the Lab” presentation.

Forgotten technology, awake by our homelab.

image

Posted in infiniband, VMware | Tagged , , , | Leave a comment

Welcome to my new web site, dedicated HomeLab with VMware ESXi.

For build my cluster for ESXi 5.1 and 5.5 work. 3 nodes 12 cores / 64Gb $1110

-3 OEM motherboards dual socket Supermicro H8DME-EX-LS006  on ebay

image

-CPUs 6 AMD Opteron 2419, 1.8GHz / 6 cores  on ebay

image

-Heatsink socket F

image

-RAM Micro 200Gb DDR2 ECC REG PC2-5300P MT36HTF51272PY-667E1 memory HP …. on ebay

image

-IPMI card ( optical ) , Supermicro AOC-SIMSO+  and on ebay

image

Total ( no Tax and delivery )  : $1109.66 / 817.98€
Tax and delivery for France : $437.23 / 322.31€

image

The following article will describe the motherboard, then the BIOS

Posted in VMware | Tagged , , , , | 30 Comments