Comments on: How To Build A Better “Blackwell” GPU Than Nvidia Did https://www.nextplatform.com/2024/03/28/how-to-build-a-better-blackwell-gpu-than-nvidia-did/ In-depth coverage of high-end computing at large enterprises, supercomputing centers, hyperscale data centers, and public clouds. Tue, 09 Apr 2024 19:58:56 +0000 hourly 1 https://wordpress.org/?v=6.7.1 By: Paul Berry https://www.nextplatform.com/2024/03/28/how-to-build-a-better-blackwell-gpu-than-nvidia-did/#comment-222654 Mon, 01 Apr 2024 14:13:08 +0000 https://www.nextplatform.com/?p=143875#comment-222654 In reply to Danny.

I imagine you only use the high performance connect for things that need it. One for cost, but two for reliability. Ideally you don’t rip out all the compute engines and high performance memory because the usb controller died. The more chips you pack onto the device, the more chances there are for one of them to go bad and cause you to throw the whole thing away. Perhaps you build in redundancy and just ignore failures, but that increases complexity, leading to a higher rate of errors, etc.

]]>
By: Slim Albert https://www.nextplatform.com/2024/03/28/how-to-build-a-better-blackwell-gpu-than-nvidia-did/#comment-222635 Sun, 31 Mar 2024 23:48:05 +0000 https://www.nextplatform.com/?p=143875#comment-222635 Interesting! Maybe this NuLink-PHY based UMI (bi-directional, interposer-less, UCIe/BoW-compatible) can be part of the next generation of UCIe (if it gets called UMI-express) — especially as Intel provided Series A funding to Eliyan (with Marvell and Micron, as stated in the article). And with “NuLink Switch” (last sentence) Nvidia competitors could get a few legs up on putting rack-scale units of computing together, that potentially outdo the NVL72 in AI (noting though that Nvidia has some level of “in-switch computing” for hierarchical aggregation, and automated adaptive tensor-block precision in the FP8, FP6, FP4 range).

In particular, bypassing the CoWoS heartburn-indigestion, looks to me like the healthier way to go about HPC/AI/ML gastronomy (if it works right … seeing how the 2D MCM image does look visually like 2.5D EMIB). This could be a winning tech from Eliyan.

]]>
By: Danny https://www.nextplatform.com/2024/03/28/how-to-build-a-better-blackwell-gpu-than-nvidia-did/#comment-222614 Sun, 31 Mar 2024 01:48:20 +0000 https://www.nextplatform.com/?p=143875#comment-222614 In reply to Timothy Prickett Morgan.

I’m not sure whether to be amazed or frightened. I remember the day hawking 3rd party modem cards and convincing folks to go with brands that had the Lucent 56k chip as opposed to the Rockwell chip. Then suddenly….poof….supply dried up as everything started going into the motherboard. It’s like I’m the silicon version of a black hole creation . You first see the parent star swell and swell until it explodes, collapses into itself, only to be reborn into something even larger.

]]>
By: Timothy Prickett Morgan https://www.nextplatform.com/2024/03/28/how-to-build-a-better-blackwell-gpu-than-nvidia-did/#comment-222598 Sat, 30 Mar 2024 17:19:06 +0000 https://www.nextplatform.com/?p=143875#comment-222598 In reply to Danny.

I think so.

]]>
By: Danny https://www.nextplatform.com/2024/03/28/how-to-build-a-better-blackwell-gpu-than-nvidia-did/#comment-222572 Sat, 30 Mar 2024 01:42:47 +0000 https://www.nextplatform.com/?p=143875#comment-222572 In reply to Timothy Prickett Morgan.

So the socket will TRULY be the motherboard. I’m actually starting to believe this to be true . I mean, extrapolate this out. Does a desktop AI PC in 2035 ( whatever that means in 2035 much less today ) have a motherboard with nothing but one huge socket and traces on the motherboard for various physical connections like USB, HDMI, and Ethernet? Could you see a NUC sized mini PC where the motherboard is only as large as the socket itself as there is no need for any external connectors as everything is wireless in and out? Or another extreme. What happens to the Raspberry Pi when the socket becomes bigger than today’s motherboard? Will that become the ultimate expression of an SBC when quite literally the socket is the single board and the computer simultaneously?

]]>
By: Timothy Prickett Morgan https://www.nextplatform.com/2024/03/28/how-to-build-a-better-blackwell-gpu-than-nvidia-did/#comment-222571 Sat, 30 Mar 2024 00:37:09 +0000 https://www.nextplatform.com/?p=143875#comment-222571 In reply to Mark S Wroblewski.

They have done their PHY in 5 nanometer and 3 nanometer processes as far as I know. And they have one large scale customer, someone not quite a hyperscaler but more than a typical service provider.

]]>
By: Timothy Prickett Morgan https://www.nextplatform.com/2024/03/28/how-to-build-a-better-blackwell-gpu-than-nvidia-did/#comment-222570 Sat, 30 Mar 2024 00:35:47 +0000 https://www.nextplatform.com/?p=143875#comment-222570 In reply to Danny.

But made of chiplets with interconnects.

]]>
By: Danny https://www.nextplatform.com/2024/03/28/how-to-build-a-better-blackwell-gpu-than-nvidia-did/#comment-222565 Fri, 29 Mar 2024 20:59:25 +0000 https://www.nextplatform.com/?p=143875#comment-222565 So if I’m reading this article correctly and especially the viewpoint stated that the socket is becoming the motherboard, could we begin to see by the end of this decade the socket growing so large as to begin looking like Cerebras’s wafer scale chip ?

]]>
By: Mark S Wroblewski https://www.nextplatform.com/2024/03/28/how-to-build-a-better-blackwell-gpu-than-nvidia-did/#comment-222554 Fri, 29 Mar 2024 15:17:47 +0000 https://www.nextplatform.com/?p=143875#comment-222554 Hi Timothy,
NuLink sounds impressive and makes sense if I follow the arguments correctly. But has Eliyan produced any hardware to verify and validate this yet?

]]>