loading page

Interactive Supercomputing with Jupyter
  • Rollin Thomas,
  • Shreyas Cholia
Rollin Thomas
Author Profile
Shreyas Cholia
Author Profile

Abstract

Rich user interfaces like Jupyter have the potential to make interacting with a supercomputer easier and more productive, consequently attracting new kinds of users and helping to expand the application of supercomputing to new science domains. For the scientist-user, the ideal rich user interface delivers a familiar, responsive, introspective, modular, and customizable platform upon which to build, run, capture, document, re-run, and share analysis workflows. From the provider or system administrator perspective, such a platform would also be easy to configure, deploy securely, update, customize, and support. Jupyter checks most if not all of these boxes. But from the perspective of leadership computing organizations that provide supercomputing power to users, such a platform should also make the unique features of a supercomputer center more accessible to users and more composable with high performance computing (HPC) workflows. Project Jupyter's core design philosophy of extensibility, abstraction, and agnostic deployment, has allowed HPC centers like NERSC to bring in advanced supercomputing capabilities that can extend the interactive notebook environment. This has enabled a rich scientific discovery platform, particularly for experimental facility data analysis and machine learning problems.  

Peer review timeline

14 Jan 2021Submitted to Computing in Science and Engineering
14 Jan 2021Editor invited a reviewer
15 Jan 2021Review Report #1 received
01 Feb 2021Published in Computing in Science and Engineering