<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
    <channel>
        <title>[PROPL'26] A Compiler-First Planetary Compute Engine: Automatic differentiable and performance(…)</title>
        <link>https://watch.eeg.cl.cam.ac.uk/videos/watch/87536e7a-9a4c-422f-9f20-446193621cce</link>
        <description>A Compiler-First Planetary Compute Engine: Automatic differentiable and performance portable Earth System Modeling (Video, PROPL 2026) William S. Moses, Gong Cheng, Valentin Churavy, Maximilian Gelbrecht, Milan Klower, Joseph Kump, Mathieu Morlighem, Sarah Williamson, Dhruv Apte, Paul Berg, Mosè Giordano, Chris Hill, Nora Loose, Alexis Montoison, Sri Hari Krishna Narayanan, Avik Pal, Michel Schanen, Simone Silvestri, Greg Wagner, and Patrick Heimbach (University of Illinois Urbana-Champaign; Dartmouth College; Johannes Gutenberg University, Mainz &amp; University of Augsburg; Technical University of Munich &amp; Potsdam Institute for Climate Impact Research; University of Oxford; UT Austin; Dartmouth College; UT Austin; UT Austin; Aeolus Labs; UCL; MIT; [C]Worthy; Argonne National Laboratory; Argonne National Laboratory; MIT; Argonne National Laboratory; Politecnico di Torino; MIT; Aeolus Labs; UT Austin) Abstract: Position. A new generation planetary compute engine for climate science needs to overcome two fundamental limitations of current-generation climate models: (1) it should be end-to-end auto-differentiable to be able to harness advanced gradient-based algorithms (adjoint and backpropagation operators) to comprehensively learn from diverse, heterogenous data (observations and/or high-fidelity simulations); (2) it should be portable across a rapidly diversifying landscape of compute hardware, from traditional HPC to AI-oriented cloud accelerators.  We argue that both capabilities should be delivered at the compiler level, built around language-agnostic intermediate representations such as LLVM and MLIR, rather than by rewriting science codes. This position is grounded in recent experience differentiating and cross-compiling four production-scale Earth system model components written in Julia and exercised on different architectures (CPUs, GPUs, and TPUs). Differentiability as infrastructure. A “live computational commons” (as envisioned in the call for submission) that ingests billions of observations is, at its core, a massive inverse-problem. The data integration is provided by a physical model which encapsulates known laws, within which may be embedded a neural operator, encapsulating uncertain closures. Extracting actionable information from the data is achieved via gradient-based parameter calibration, state and boundary-flux estimation, sensitivity analysis, and uncertainty quantification. Each becomes computationally tractable if the adjoint of the physical model – along with the backpropagation operator of the embedded neural architecture is available. Today’s Earth system models (ESMs) are rarely differentiable because their complexity pushes the limits of available, reverse mode-enabled AD tools. The DJ4Earth initiative is building a framework for overcoming this hurdle: the AD compiler Enzyme.jl, operating at LLVM IR, together with MLIR-level transpilation via Reactant.jl and sophisticated checkpointing, produces efficient, correct gradients for a range of Earth system model components: the finite-volume ocean GCM Oceananigans.jl, a Julia implementation of the finite-element Ice Sheet and Sea level Model (ISSM), and the spectral atmospheric model SpeedyWeather.jl. Portability on the same stack. Earth system simulation is limited by compute availability, yet the exaFLOPs being deployed for AI — TPUs, low-precision GPUs, complex interconnect topologies — are largely inaccessible to Fortran, C++, and Julia codes targeting MPI-over-InfiniBand. Even new “HPC” machines increasingly expose AI accelerators that are hard to utilize with conventional climate model codes. A manual rewrite strategy is not sustainable in view of rapid AI compute hardware evolution. Compiler-level cross-compilation — demonstrated by transparently running the same Julia ocean and atmosphere forward and adjoint models on AMD, NVIDIA, and Google TPU hardware, with automated optimization of the inter-node communication that dominates scaling — offers a more promising path. It enables rapid retargeting of the “commons” on whatever silicon is cheapest, greenest, or most available, without asking scientists to maintain refactored versions of their code. Implications for the PROPL agenda. Taken together, these threads suggest a concrete architectural roadmap: treat the planetary compute engine as a compiler stack, anchored on a small number of shared IRs (LLVM, MLIR/StableHLO). Above them, scientists write climate models in languages of their choosing (Julia, Python, Fortran, C++); below them, a portability layer targets whatever silicon is available. Differentiation, checkpointing, communication optimization, mixed-precision lowering, and hybrid physics–ML coupling become IR-level passes that any model inherits for free. We suggest the working meeting address four concrete questions: (1) a minimal shared IR co… Presentation at the PROPL 2026 workshop, June 15, 2026, https://pldi26.sigplan.org/home/propl-2026 Sponsored by ACM SIGPLAN.</description>
        <lastBuildDate>Fri, 28 Aug 2026 12:00:06 GMT</lastBuildDate>
        <docs>https://validator.w3.org/feed/docs/rss2.html</docs>
        <generator>PeerTube - https://watch.eeg.cl.cam.ac.uk</generator>
        <image>
            <title>[PROPL'26] A Compiler-First Planetary Compute Engine: Automatic differentiable and performance(…)</title>
            <url>https://watch.eeg.cl.cam.ac.uk/client/assets/images/icons/icon-1500x1500.png</url>
            <link>https://watch.eeg.cl.cam.ac.uk/videos/watch/87536e7a-9a4c-422f-9f20-446193621cce</link>
        </image>
        <copyright>All rights reserved, unless otherwise specified in the terms specified at https://watch.eeg.cl.cam.ac.uk/about and potential licenses granted by each content's rightholder.</copyright>
        <atom:link href="https://watch.eeg.cl.cam.ac.uk/feeds/video-comments.xml?videoId=87536e7a-9a4c-422f-9f20-446193621cce" rel="self" type="application/rss+xml"/>
    </channel>
</rss>