Prompt Engineering for HPC Vibe Coding

Prof. David Keyes

Prof. David Keyes

Professor of Applied Mathematics, Computer Science and Mechanical Engineering Founder, Extreme Computing Research Center King Abdullah University of Science and Technology (KAUST)
Tuesday, 27 October 2026 1:30 – 2:15 PM
Building 19, Hall 1
Keynote
03 Session Talk 03 Economies of the Future
Presentation

Abstract

Prompt Engineering for HPC Vibe Coding

The title is an exaggeration in September 2026 but is expected to reflect reality within a few cycles of further ingestion of open-source HPC codes by LLMs and research programs like the US DOE’s Genesis Mission. The most sophisticated code and problem transformation agendas of today’s computational scientists are beyond vibe coders presently; however, they warrant systematic examination upon our transition to fused computing, where machine learning joins traditional modeling and simulation as an HPC domain, with synergistic benefits in both directions.

“Extreme” in computing means more than large in scale. It can indicate constraints of real-time, low power, low memory capacity or bandwidth per core, or low available concurrency. Some imperatives (“prompts”) in dealing with extremes include:

  • reside high on the memory hierarchy (e.g., by blocking or processing on the fly)
  • reduce synchrony in frequency and/or in span (e.g., by performing extra flops)
  • reduce communication in number and/or volume of messages (e.g., by exploiting extra memory)
  • employ dynamic scheduling and balancing (e.g., by runtime systems based on DAGs)
  • avoid over-resolving with respect to output accuracy requirements (e.g., adapt precision, fidelity, and inner tolerances)
  • reformulate applications before computing (e.g., with smarter bases or discretizations)
  • codesign algorithms with hardware (e.g., specialized heterogeneity in processing, memory, and networking elements)
  • exploit the “right to re-order” (e.g., linearization vs partitioning, lagged evaluations, colorings)
  • exploit hierarchical or multiple alternative versions of the same system
  • exploit data sparsity to meet “curse of dimensionality” with “blessing of low rank”
  • take resilience into algorithms, relieving hardware and systems
  • look “over the transoms” for optimizations beyond optimized components
  • code to specialized back-ends while presenting high-level APIs to users
  • consider “science per Joule.”

Most are classical but have new significance. This talk comes downstream of four Gordon Bell finalist papers from KAUST HPC scientists in 2022–2024 and contains fresh examples. Most importantly, it is a solicitation from the audience of further and better examples.

About the speaker

Biography

David Keyes is a professor of Applied Mathematics, Computer Science, and Mechanical Engineering at the King Abdullah University of Science and Technology (KAUST), where he was a founding Dean in 2009 and founder of the Extreme Computing Research Center. He is also an adjunct professor of Applied Mathematics and Applied Physics at Columbia University, where he formerly held the Fu Foundation Chair.

He focuses on scalable solvers that exploit hierarchy and data sparsity, targeting power-austere emerging architectures. He collaborates on large-scale applications in energy and environment that demand high performance because of resolution, dimension, high fidelity physical models, or the “multi-solve” requirements of optimization, control, sensitivity analysis, inverse problems, data assimilation, or uncertainty quantification.

To support such missions, in various collaborations he popularized the Newton-Krylov-Schwarz (NKS, 1994), pseudo-transient continuation (ψTC, 1998), and Additive Schwarz Preconditioned Inexact Newton (ASPIN, 2002) methods, the Hierarchical Computations on Manycore Architectures (HiCMA, 2014) dense solver framework, and a multilevel version of the H2 hierarchical matrix solver (H2-MG, 2024).

Before joining KAUST, Keyes led multi-institutional scalable solver software projects in the SciDAC and ASCI programs of the US Department of Energy (DoE), ran university collaboration programs at US DoE and NASA institutes, and taught at Columbia, Old Dominion, and Yale Universities.

He is a Fellow of SIAM, the AMS, and the AAAS and an elected member of the European Academy of Engineering. He was awarded the ACM Gordon Bell Prize in 1999 and in 2024, the IEEE Computer Society Sidney Fernbach Award in 2007, the SIAM Prize for Distinguished Service to the Profession in 2011, and the IEEE TCPP Outstanding Service and Contributions Award in 2025.

On its 35th anniversary, HPCwire named Keyes to the inaugural class of the 35 “legends” of High Performance Computing. He earned a B.S.E. in Aerospace and Mechanical Sciences from Princeton in 1978 and a Ph.D. in Applied Mathematics from Harvard in 1984.

Attend this session

The Saudi HPC/AI Conference runs 26–28 October 2026 at KAUST. Attendance is free, but registration is required.