Interactive Jobs
Interactive jobs are computational jobs a user works with directly, in real time, through some kind of interface while the job runs on cluster resources. Instead of submitting work and waiting for it to finish unattended, the user stays in the loop, writing code, inspecting data, or adjusting parameters as the job executes on a compute node. Interactive jobs are one of the two primary ways work is run on an HPC cluster, contrasted with batch processing.
What is an interactive job?
An interactive job gives the user a live connection to allocated cluster resources. A common example is a Jupyter notebook running on a compute node: the user develops and tests code interactively while it executes against the node's CPUs, memory, and accelerators. Other examples include interactive shells for debugging, exploratory data analysis, and visualization sessions where results are viewed and refined on the fly. The defining trait is responsiveness, the user issues input and sees output during the job rather than only after it completes.
Why interactive jobs matter
Interactive jobs support the parts of computational work that benefit from a human in the loop: prototyping, debugging, exploring unfamiliar data, and visualizing results. These activities are hard to express as a fixed batch submission because the next step depends on what the previous step showed. By running on cluster hardware rather than a laptop, an interactive session gives developers access to large memory, many cores, or GPUs while keeping the immediacy of local work.
How interactive jobs affect cluster design
Interactive jobs can create resource needs that differ from batch work, and schedulers and operators plan for them accordingly.
- Dedicated visualization nodes, a job may need a GPU-enabled node reserved for rendering and interactive visualization.
- Responsiveness over utilization, resources are held for a user who may pause to think, so a node can sit partly idle in exchange for a fast, interactive experience.
- Low-latency access, the interface must stay responsive, which favors reserved allocations over deep queues.
Interactive jobs vs. batch jobs
| Interactive jobs | Batch jobs | |
|---|---|---|
| User involvement | Continuous, live | None after submission |
| Typical use | Prototyping, debugging, visualization | Simulations, sequencing, analysis runs |
| Resource pattern | Reserved, sometimes idle | Queued, packed for utilization |
| Optimized for | Responsiveness | Throughput and efficiency |
Most clusters support both models so users can develop and debug interactively, then submit the finished work as batch jobs for large-scale, unattended runs.
Built for scale. Chosen by the world’s best.
2.75M+
Rocky Linux instances
Being used world wide
90%
Of fortune 100 companies
Use CIQ supported technologies
250k
Avg. monthly downloads
Rocky Linux