R720 riser card power to RTX 3060 GPUs

So… I want to put a consumer gaming grade GPU … actually I want to put two consumer grade GPUs into my ol’ Dell R720 server to play with LLMs etc. The problem is there apparently is no power cable that exists which can connect the 8 pin 12v sockets on the riser cards to the GPUs. I bought a bunch of different cables and none of them worked… so now it’s time to get to splicing.

Here is one of the riser cards with the power socket on the back;

Here is the cable configuration I need;

To make things easy on myself, I ended up cannibalizing pre-made cables;

RTX 3060 GPU socket

I needed a cable that has the GPU connector on it that is compatible with the RTX 3060, which I found is kinda hard to find for some reason, but Amazon had some options which I plan to extract this connector from;

or these…

R720 riser card socket

I needed a cable that has a connector on it that is compatible with the R720 riser card power socket. This whole thing started when I mistakenly purchased a power cable that fit my R720 riser card socket but did not plug into my 3060 GPU.

but Amazon also has options;

How to mod…

I found that eBay listing above for the R720 GPU cable because of this guy’s great video;

In it, there is a nice pinout shot right at the start of the video which I will post here to save it, just in case the video disappears later;

Also, just to double check, I found this pinout information on the actual NVIDIA website;

Key points from his video are as follows;

  1. He makes his cables 17.5" long which is just enough to get under the GPU then up and around into the connector on the GPU.

  2. The GPU does not communicate anything over the power cable, while the riser card in the R720 does have a sensing pin. Because of this, the sensing pin must be shorted to ground. The specific pin used for this on one of the official Dell power cables is ground pin 4;

Here is the official Dell cable using a grey wire to accomplish this.

Notice how the sensing pin is not tied into a used ground which connects to the GPU side, it uses an entire ground pin for this. Technically this could impact the ability of the cable to carry current, but if it’s good enough for Dell… then ok. Also, who knows how this works internally, it might be arbitrary or it might actually damage the sensing pin if another ground is used or pin 4 is also connected to GPU ground.

… update forthcoming as soon as I have my completed tested working cables …

1 Like

Actually nevermind…

I got impatient… turns out a scalpel works to mod the molex connector to fit proper…

Getting the cards in is another story…

The case fit on just fine… so now…

Moment of truth…

It doesn’t work. I have dual 1100W PSUs installed. Pressing the power button on the server does nothing but turn the solid green indicators on the PDUs to blinking amber…

Checking the logs in the iDRAC management card I found this…

I twiddled with the settings…

Still no… I removed one of the cards completely… still no… but now nothing shows in the iDRAC log… it just starts flashing amber when I try to boot. :confused:

I removed the other card and it booted right up. So, either;

  • a single GPU is pulling too much power for an 1100W PSU
  • the second final card I removed is faulty
  • the wiring of the cables I modified is not correct
  • i’m too tired and i made some simple mistake

Who knows… I’ll keep tinkering on it in the morning.

4 Likes

Omg…

Still a work in progress…

4 Likes

Messenger_creation_4E6B6B84-7A7D-4CE6-A5EC-67881B429DE0

6 Likes

Once installed I had to update Grub to keep the native video card the primary after boot. Only the native card has the diagnostic VGA output on the front panel so I figured I’d keep that active for console work. To do that, I had to update grub;

sudo nano /etc/default/grub

Change this line

GRUB_CMDLINE_LINUX_DEFAULT="quiet splash"

to this;

GRUB_CMDLINE_LINUX_DEFAULT="quiet splash video=vesa:off nomodeset"

then sudo update-grub

3 Likes

I would’ve looked at the xserver configuration first. But I’m showing my age here… Doing it in grub is probably more flexible TBH.

1 Like

Actually I think it’s caused a problem with VirtualBox because it doesn’t actually just force the use of the onboard video output, it also forces minimal settings and the VirtualBox GUI on the desktop won’t open… pretty sure it’s because of this issue.

My solution actually turned out to be the lowest tech option hahah… I happened to have an old VGA/DVI monitor and I connected both cables up… the VGA to the onboard VGA diag port on the front, and the DVI to HDMI cable to one of the GPUs. Meh… it works. I see the bootup via VGA and the GNOME desktop through the HDMI.

1 Like

1 Like

Running locally in my basement! Yay!

3 Likes

I’m starting to work through my power cables and I have a few questions. First off, I found THIS WEBPAGE that has a more complete picture of the various pinouts.

Firstly, as I understand it:
The R720 uses a modified EPS-12V plug, where Pin 6 is a sensing pin, and is grounded to Pin 4. That leaves Pins 5,7,8 as +12v and Pins 1,2,3 as ground. (I’m ignoring Pin 4 as a ground because it seems unwise to mix current carrying with sensing grounds.)

The PCIe 8 pin, used on consumer graphics cards, needs 3 +12v pins, 3 ground pins (current carrying) and 2 sense pins (grounded).

It seems to me, that I would then want PCIe pins 4 and 6 both connected to EPS Pin 4 . This would mean all 3 sense pins from BOTH ends of cable are grounded to PIN 4 on the EPS Connector.

That leaves 3 remaining EPS 12v pins to 3 PCIe 12v pins, and 3 EPS ground pins to 3 PCIe pins.

Does that seem right?
Also worth noting, I found THIS PAGE with the claim that the sense pins:

so maybe it matters, maybe not.

One side requires a ground pin be looped to the sense pin… it should be illustrated above