Comments on: Climate Simulation Screams On The Frontier Exascale Supercomputer https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/ In-depth coverage of high-end computing at large enterprises, supercomputing centers, hyperscale data centers, and public clouds. Thu, 27 Apr 2023 03:13:37 +0000 hourly 1 https://wordpress.org/?v=6.7.1 By: Hubert https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/#comment-207680 Tue, 25 Apr 2023 17:10:01 +0000 https://www.nextplatform.com/?p=142243#comment-207680 In reply to Hubert.

Updated to add (sadly): Just 2 days before this article was published, Dr. Ivo Babuška, pioneer of the numerical solution of CFD equations, and of a-posteriori error analysis for mesh refinment, passed away (April 12, 2023), at the age of 97. He was a pre-former colleague who retired from UMCP in 1994 or 1996 (a couple years before I got onboard). He uncovered the formerly unknown eponymous Babuška–Brezzi (“inf-sup”) condition required for solving Navier-Stokes (and other saddle-point systems) whereby velocities need to be discretized at a higher-order (eg. 2nd-order) than pressure (eg. 1st-order) to prevent wild checkerboard oscillations in the solution. He would probably get a kick to know that, becasue of him, more than 400 billion simultaneous equations will now need to be solved by the SCREAM model!

]]>
By: Hubert https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/#comment-207396 Tue, 18 Apr 2023 23:07:05 +0000 https://www.nextplatform.com/?p=142243#comment-207396 In reply to Gerald van der Grijn.

Great point! Chaos theory means sensitivity to initial conditions (via non-negative Lyapunov exponents), and therefore, the more accurately one knows current conditions everywhere in a domain (vx, vy, vz, T, P, H2O vapor, at time=0), the farther into the future they can produce accurate predictions for the subsequent temporal evolution of the system (eg. predict weather accurately for 10-days into the future). However, even without “infinitely” accurate ICs (initial conditions), solution of the system for a substantial time span has the potential to resolve the phase-space attractor of the system (eg. Lorentz attractor) which determines all of its possible future states, and hence every possible weather that can occur in the target domain — which is still mighty useful (and awesome)!

It’s not pure unadulterated chaos thanks to the fluid viscosity of air (or its eddy viscosity computed from appropriate turbulence closures) which makes the flow dissipative on the whole: tornadoes, hurricanes, monsoons, and the like, eventually die-out as a result — but their frequency of occurence, and their intensity, may increase or decrease depending on global conditions of warming, cooling, and mis-exfoliation (eh-eh-eh!).

]]>
By: Hubert https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/#comment-207386 Tue, 18 Apr 2023 20:13:37 +0000 https://www.nextplatform.com/?p=142243#comment-207386 In reply to Hubert.

Correction: make that approx. 400 billion simultaneous equations … as this is (I think) 3-D Navier-Stokes plus heat and moisture transport, and therefore (at least) 6 dependent vars per node (vx, vy, vz, P, T, H2O vapor), mapped over 65 billion nodes … Definitely awe-inspiring stuff!

I’ll add that the grid-Courant-number limit on accurate computations constrains time-step size to possibly less than 1/100 of an hour (for up to 100 km/h winds over a 1km grid), that is roughly 30 seconds, and means approximately 1 million time steps per year (plus nonlinearity iterations). Shorter time steps (and more of them per year) would be needed for higher maximum wind speeds (in conventional FDM/FEM).

]]>
By: Peter Connell https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/#comment-207362 Tue, 18 Apr 2023 11:15:08 +0000 https://www.nextplatform.com/?p=142243#comment-207362 A turning point in GPU power IMO is the recent introduction at last, of chiplets to graphics processors also.

We have seen the radical effect AMD’s chiplets have had on the economics & performance of CPUs since Zen arrived in 2017. I am confident of similar gains as GPU chiplets evolve now the ice is broken.

]]>
By: Gerald van der Grijn https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/#comment-207359 Tue, 18 Apr 2023 10:00:36 +0000 https://www.nextplatform.com/?p=142243#comment-207359 It is a nice article but it seems to make the false claim that forecasts can be (close to) perfect as long as you have sufficient compute power. The atmosphere and the complete earth system is highly chaotic and cannot be deterministically described by physical equations. Yes, forecast errors will gradually reduce but will never go away completely.

]]>
By: HuMo https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/#comment-207344 Tue, 18 Apr 2023 02:27:02 +0000 https://www.nextplatform.com/?p=142243#comment-207344 In reply to Mark.

I too get this feeling, a lot of times; there seems to be a lot of duplicity in promoters of this and that new zeitgeist, and what not, being fashionable means X, and you’re excluded if different, non-conforming. In such situations it helps me to relate back to folks whose opinion I value, for whichever reason, here Sandra Snan (of Chicken Scheme) — she (can be crude) writes this: “Everything is on the cinder unless we all sober the fuck up wrt climate change and slam the breaks on emissions!” — admitedly her opinion, but I value it!

]]>
By: Hubert https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/#comment-207339 Mon, 17 Apr 2023 23:05:42 +0000 https://www.nextplatform.com/?p=142243#comment-207339 Great article and superb application of contemporary HPC oomph to better understand important phenomena! I’ve looked around on the web a bit and it seems that the transition from E3SM to SCREAM also involves code conversion from Fortran to C++ “to enable efficient simulation on CPUs, GPUs, and future architectures” (using the Kokkos library). It’ll be great to follow how this opens the door to various performance-enhancement strategies and how that pans out in terms of SYPD (as you state!).

The domain discretization of the spherical shell is somewhat anisotropic. In the horizontal, it is 1 node per 10 km^2 (or approx 3.2 km between nodes, in x and y directions), with an upcoming target of 1 node per km^2 (1 km between nodes, in x and y). So they’re looking at 510 million nodes in x-y to cover earth’s 510 million km^2 surface area. The node spacing is finer in the z-direction (vertical), and ranges from 50 m between nodes near the surface, to 250 m between nodes in the stratosphere (at 40km or 60km top elevation), for a total of 72 vertical nodes for E3SM, and 128 such nodes for SCREAM. Accordingly, with SCREAM, there are 65 billion simultaneous equations to be solved (and iterated over for nonlinearity) per time step! WoW!

]]>
By: Timothy Prickett Morgan https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/#comment-207337 Mon, 17 Apr 2023 21:51:33 +0000 https://www.nextplatform.com/?p=142243#comment-207337 In reply to EC.

I don’t think the E3SM people are doing that, but clearly there is a way to interleave AI in the ensembles to do an effective speedup.

]]>
By: EC https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/#comment-207335 Mon, 17 Apr 2023 21:45:11 +0000 https://www.nextplatform.com/?p=142243#comment-207335 Not a peep about AI or ML? Isn’t climate modeling exactly the sort of workload (lower precision) machine learning is perfect for? With all those GPUs in Frontier not sure why they’re still doing it in this brute force sort of way.

]]>
By: Timothy Prickett Morgan https://www.nextplatform.com/2023/04/14/climate-simulation-screams-on-the-frontier-exascale-supercomputer/#comment-207323 Mon, 17 Apr 2023 11:46:27 +0000 https://www.nextplatform.com/?p=142243#comment-207323 In reply to Seb.

Well played….

]]>