GPTune is an autotuning framework that relies on multitask and transfer learning to help solve the underlying black-box optimization problem using Bayesian optimization methodologies. In particular, GPTune is designed to tune high-performance computing (HPC) application codes as "black-boxes", running them for carefully chosen tuning parameter values and building a performance model based on the measured performance. GPTune provides a number of advanced autotuning features outlined as follows.

History Database

The success of (Bayesian optimization-based) autotuning depends on collecting sufficient performance data samples to build an accurate surrogate performance model or to explore the search space. To enhance reusabiltiy of performance data for autotuning, we provide a history database which is a shared repository and application programming interface (API) to share autotuning performance data between multiple users at different sites. Our shared repository in this website provides two useful interfaces (1) an interactive web dashboard that allows users to navigate the database from a web browser (2) a programmable API (called crowd-tuning API) which allows users to write a program query to download or upload performance data. The history database is a part of the GPTune project. Performance data in the history database is compatible with GPTune, and the database interfaces are incorporated into GPTune. The database feature can also be used by other autotuners (this is a future work).

Our history database enables following use cases.

  • Checkpointing and restarting: Users can perform checkpointing and restarting of (long-running) autotuning.
  • Query tuning results: Users can query the best tuning parameter configuration to run their applications.
    • Example (web-interface): To browse performance data of ScaLAPACK's PDGEQRF in our history database, 1. Access, 2. Choose "PDGEQRF" and click on "Search", 3. You should be able to see the data table that contains the historical data of ScaLAPACK's PDGEQRF.
  • Sensitivity analysis: Using historical data, users can run a surrogate model-based sensitivity analysis that estimates importance of each tuning parameter.
  • Performance prediction: Using historical data, users can run a surrogate model-based performance prediction for a given tuning parameter configuration.
    • Example (web-interface): To run a sensitivity analysis of SuperLU_DIST, 1. Login at, 2. access, 3. Choose "SuperLU_DIST-pddrive_spawn" and click on "Search", 4. You should be able to see the table, and there should be a button "Make prediction", you can click on this and follow the instructions there.
  • Transfer learning: Users can download historical performance data and use the knowledge to tune a similar but different tuning problem using transfer learning-based autotuning.

Unregistered users can only view publicly available performance data. This means that they cannot view data disclosed to authorized users or upload any kind of data into out database. Please Sign Up to access more data in our history database! Registered users can download data disclosed to registered users. There is another privilege level called "certified" for registered users. The GPTune team will update the user status as "certified" if the user has entered user profile information correctly. Certified users can access data for certified users and create collaboration groups to share data within your group members. For more information about our membership, click here.

About Us

GPTune is a joint research project between Lawrence Berkeley National Laboratory and University of California at Berkeley, and is part of the xSDK4ECP effort supported by the Exascale Computing Project (ECP).



This research was supported by the Exascale Computing Project (17-SC-20-SC), a collaborative effort of the U.S. Department of Energy Office of Science and the National Nuclear Security Administration. We used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231.


GPTune Copyright (c) 2019, The Regents of the University of California, through Lawrence Berkeley National Laboratory (subject to receipt of any required approvals from the U.S. Dept. of Energy) and the University of California, Berkeley. All rights reserved.
If you have questions about your rights to use or distribute this software, please contact Berkeley Lab's Intellectual Property Office at
NOTICE. This Software was developed under funding from the U.S. Department of Energy and the U.S. Government consequently retains certain rights. As such, the U.S. Government has been granted for itself and others acting on its behalf a paid-up, nonexclusive, irrevocable, worldwide license in the Software to reproduce, distribute copies to the public, prepare derivative works, and perform publicly and display publicly, and to permit other to do so.