Comments on: Meta Platforms Is Determined To Make Ethernet Work For AI https://www.nextplatform.com/2023/09/26/meta-platforms-is-determined-to-make-ethernet-work-for-ai/ In-depth coverage of high-end computing at large enterprises, supercomputing centers, hyperscale data centers, and public clouds. Thu, 05 Oct 2023 17:04:20 +0000 hourly 1 https://wordpress.org/?v=6.7.1 By: Timothy Prickett Morgan https://www.nextplatform.com/2023/09/26/meta-platforms-is-determined-to-make-ethernet-work-for-ai/#comment-214191 Wed, 27 Sep 2023 13:27:14 +0000 https://www.nextplatform.com/?p=143027#comment-214191 In reply to Adir Zevulun.

Ah, but did it turn into a prince? HA!

]]> By: Adir Zevulun https://www.nextplatform.com/2023/09/26/meta-platforms-is-determined-to-make-ethernet-work-for-ai/#comment-214176 Wed, 27 Sep 2023 09:38:42 +0000 https://www.nextplatform.com/?p=143027#comment-214176 InfiniBand is the frog that gets a kiss from Nvidia

]]> By: Hubert https://www.nextplatform.com/2023/09/26/meta-platforms-is-determined-to-make-ethernet-work-for-ai/#comment-214166 Wed, 27 Sep 2023 04:55:50 +0000 https://www.nextplatform.com/?p=143027#comment-214166 Interesting piece! It brings perspective on the need for, and reasoning behind, wanting composable disaggregated heterogeneous computational systems, linked by interesting switches (eg. Enfabrica Godbox). As illustrated here, when systems grow to accomodate bigger workloads, previous-gen hardware can remain valuable as long as it can be integrated (or composed into) an upgraded system with pods of latest-gen machinery (say A100 and H100, or MI210 and MI300x, or even tutti-frutti) — rather than having the new system being a complete overhaul of uniformly new-gen chippery, and the old system being landfilled.

Composability should also help large disaggregated heterogeneous systems better meet the contrasting needs of LLMs vs DLRMs, training vs inference, and prefill vs decode phases. Slicing through the composable system in different ways to accomate those different processes, at different times. A great job opportunity for IaC tools, or just convincing shoulder shakin’!

]]>