Every research group has a legend. In one quantum computing lab it was a postdoctoral researcher named Lena, who could look at a noisy set of results, mutter something about “the Tuesday calibration”, and fix a run in minutes. When Lena moved to another university, the group discovered that a great deal of their daily practice had walked out with her. The questions that followed are the ones this post tries to answer, in the order the group asked them. Think of it as a quantum lab runbook told through frequently asked questions.
The story is a composite, and the details are illustrative; the principle applies to simulators, cloud-access projects and hardware labs alike.
What is a runbook, and why would a research group need one?
A runbook is a short list of numbered steps for a task that recurs, written plainly so that a competent teammate could carry it out unaided. Research groups tend to assume they do not need one, because every experiment is different. But the scaffolding around experiments is highly repetitive: preparing the environment, checking instruments or simulator versions, submitting jobs, collecting results, recording settings and cleaning up. That scaffolding is where unwritten habits hide.
Which tasks in a quantum group deserve a page first?
Lena’s group made a list of everything they did at least weekly. The ones that scored highest on “would be a disaster if only one person knew” were:
- Setting up the software environment, including the exact versions of libraries and the way to pin them.
- Submitting circuits to a simulator or a cloud-hosted device and retrieving the results.
- Recording the settings of each experiment so it can be repeated later.
- Running the routine checks before a long job, for example a quick test circuit with a known answer.
- Archiving data and naming files so that results can be found a year later.
- Onboarding a new student with accounts, access tokens and storage space.
Is it really possible to write down something as subtle as a calibration routine?
Partly, and the partial answer is useful. Some of what Lena did was judgement that cannot be captured in steps. But much of it was a sequence of questions and checks that followed the same pattern every time: has the device or simulator changed since last week? Does a known test circuit still give the expected distribution? Are the results consistent with the previous run within the usual spread? Writing those checks as a short list turned her instinct into a routine that anyone could start. Where judgement was genuinely needed, the page said so and told the reader whom to ask.
That honesty is important. A runbook does not claim to replace expertise. It fences off the repeatable part so expertise can focus on the genuinely unusual.
What does a good page look like?
The group settled on a layout that fits on one screen:
- Purpose. One sentence, such as “run a sanity check before any job longer than an hour”.
- Before you start. Accounts, environment name, where credentials are kept (never in the page itself).
- Steps. Short numbered lines, a single verb-led action in each, plus the result you should see.
- How to tell it worked. A specific comparison, such as results matching a stored reference within a stated tolerance.
- If it does not. The next thing to try and the person to ask.
- Last tested. Date and name of the person who followed it.
How do you get the knowledge out of someone’s head?
The group used a simple trick: sit beside the person while they work and write down what you see, interrupting with “why?” whenever they do something without explanation. Lena had already left, so they interviewed her by video, replaying a recent experiment together. Questions like “why did you rerun that circuit?” produced entire paragraphs of unwritten practice. Each answer became a line in a runbook.
What about the difficult reading, the theory?
Runbooks are not substitutes for understanding. Students still need to study how quantum methods work and why they matter, for example how algorithms approach tough scheduling and routing tasks, as laid out in this explainer on how quantum algorithms handle hard optimisation challenges. Procedures simply protect the routine around that learning, so that the hours of a student’s week go to ideas rather than to rediscovering last year’s housekeeping.
The same goes for applied work. Anyone exploring how quantum ideas might influence learning systems, as covered in this piece on quantum computing and the future of machine learning, will eventually run experiments that need repeatable setup. A runbook for the setup means the results can be trusted and compared.
What goes wrong when a group skips this?
Usually nothing dramatic, which is exactly the trouble. Small inconsistencies accumulate. One student pins library versions and another does not, so two runs of the “same” experiment disagree for reasons nobody can trace. A cloud token expires and nobody remembers who renewed it last time. A dataset is saved under a name that means something only to its creator. Each of these costs an afternoon, and together they quietly erode confidence in the group’s own results.
Who tests the pages?
Never the author. After the first draft, a new master’s student who had never touched the group’s tools followed each page cold, while a senior colleague watched silently. Every hesitation was recorded and fixed. Two pages gained entire missing steps, and one had a command that only worked on Lena’s old laptop.
Where do the pages live, and who keeps them current?
In the group’s shared repository, in a folder called “procedures”, with each page named after its task. Each page has one named owner, usually a PhD student, whose job is to keep it correct, not to be the only person who can run it. A rule on the front page says that whoever finds an error fixes it the same day and adds a two-line change note.
Can a group in another field learn anything from this?
Certainly. Data teams in industry, for instance, face the same issue of repeatable routines surrounding unpredictable analysis, and the blog TheDataOps.org has material on how such teams think about running pipelines dependably. Comparing notes across disciplines is often the fastest way to find ideas worth borrowing.
What changed once the pages existed?
The group reported a handful of quiet improvements. New students ran their first successful job within days instead of weeks. Results became easier to reproduce because the settings were captured the same way every time. Supervisors stopped answering the same setup questions. And when another researcher left, the handover was a conversation about ideas and not a salvage operation.
Lena, visiting for a seminar, was shown the folder and laughed. She admitted it was strange to see her private habits turned into numbered steps, but she also said it was the nicest farewell gift the group could have given its successors.
How should your group begin?
- List what you do weekly around experiments, not the experiments themselves.
- Choose the three chores whose loss would sting most if their regular keeper left.
- Watch each being done, writing every action, and ask why.
- Draft numbered steps with expected results and a stop-and-ask line.
- Have a newcomer follow each page cold, and fix what trips them.
- Date each page, name an owner and store them in one shared place.
One page this week, a second next week. By the end of a term the group will own a small library that outlasts any one member. In a field as demanding as quantum computing, where the ideas are hard enough, it is a relief to make the everyday parts of the work easy for the next person to inherit.