SQUEUE(1) squeue 1.0 (December 2005) SQUEUE(1) NAME squeue - view information about jobs located in the SLURM scheduling queue. SYNOPSIS squeue [OPTIONS...] DESCRIPTION squeue is used to view job and job step information for jobs managed by SLURM. OPTIONS -a, --all Display information about jobs and job steps in all partions. This causes information to be displayed about partitions that are configured as hidden and partitions that are unavailable to user's group. --help Print a help message describing all options squeue. --hide Do not display information about jobs and job steps in all partions. By default, information about partitions that are configured as hidden or are not available to the user's group will not be displayed (i.e. this is the default behavior). --usage Print a brief help message listing the squeue options. -h, --noheader Do not print a header on the output. -i , --iterate= Repeatedly gather and report the requested information at the interval specified (in seconds). By default, prints a time stamp with the header. -j, --jobs Specify the jobs to view. This flag indicates that a comma separated list of jobs to view follows without an equal sign (see examples). Defaults to all jobs. -l, --long Report more of the available information for the selected jobs or job steps, subject to any constraints specified. Page 1 (printed 2/8/06) SQUEUE(1) squeue 1.0 (December 2005) SQUEUE(1) -n , --node= Report only on jobs allocated to the specified node. This may either be the NodeName or NodeHostname as defined in slurm.conf(5) in the event that they differ. A node_name of localhost is mapped to the current host name. -o , --format= Specify the information to be displayed. The default format for jobs is If the --long option is specified, the default job format is Format strings used internally by squeue when running with various options are default "%.7i %.9P %.8j %.8u %.2t %.9M %.6D %R" -l, --long ".7i %.9P %.8j %.8u %.8T %.9M %.9l %.6D %R" -s, --steps "%10i %.8j %.9P %.8u %.9M %N" The field specifications available include: %a Account associated with the job %b Time at which the job began execution %c Minimum number of CPUs (processors) per node requested by the job. This reports the value of the srun --mincpus option with a default value of zero. %C Number of CPUs (processors) requested to the job or job step. This reports the value of the srun --ntasks option with a default value of zero. %d Minimum size of temporary disk space (in MB) requested by the job. %D Number of nodes allocated to the job or the minimum number of nodes required by a pending job. The actual number of nodes allocated to a pending job may exceed this number of the job specified a node range count or the cluster contains nodes with varying processor counts. %e Time at which the job ended or is expected to end (based upon its time limit) Page 2 (printed 2/8/06) SQUEUE(1) squeue 1.0 (December 2005) SQUEUE(1) %E Job dependency. This job will not begin execution until the dependent job completes. A value of zero implies this job has no dependencies. %f Features required by the job %g Group name %G Group ID %h Can the nodes allocated to the job be shared with other jobs %i Job or job step id %j Job or job step name %l Time limit of the job in days-hours:minutes:seconds. The value may be "NOT_SET" if not yet established or "UNLIMITED" for no limit. %m Minimum size of memory (in MB) requested by the job %M Time used by the job or job step in days-hours:minutes:seconds. The days and hours are printed only as needed. For job steps this field shows the elapsed time since execution began and thus will be inaccurate for job steps which have been suspended. %n List of node names explicitly requested by the job %N List of nodes allocated to the job or job step. In the case of a COMPLETING job, the list of nodes will comprise only those nodes that have not yet been returned to service. This may result in the node count being greater than the number of listed nodes. %o Minimum number of nodes requested by the job. %O Are contiguous nodes requested by the job %p Priority of the job (converted to a floating point number between 0.0 and 1.0 %P Partition of the job or job step %r The reason a job is waiting for execution. See the JOB REASON CODES section below for more information. Page 3 (printed 2/8/06) SQUEUE(1) squeue 1.0 (December 2005) SQUEUE(1) %R For running or completed jobs: the list of allocate nodes. For pending jobs: the reason a job is waiting for execution is printed within parenthesis. See the JOB REASON CODES section below for more information. %s Node selection plugin specific data. Possible data includes: Geometry requirement of resource allocation (X,Y,Z dimensions), Connection type (TORUS, MESH, or NAV == torus else mesh), Permit rotation of geometry (yes or no), Node use (VIRTUAL or COPROCESSOR), etc. %S Start time of the job or job step %t Job state, compact form: PD (pending), R (running), CA (cancelled), CG (completing), CD (completed), F (failed), TO (timeout), and NF (node failure). See the JOB STATE CODES section below for more information. %T Job state, extended form: PENDING, RUNNING, SUSPENDED, CANCELLED, COMPLETING, COMPLETED, FAILED, TIMEOUT, and NODE_FAIL. See the JOB STATE CODES section below for more information. %u User name %U User ID %x List of node names explicitly excluded by the job %.<*> right justification of the field %<*> size of field -v Display all job information. -p , --partition= Specify the partitions of the jobs or steps to view. Accepts a comma separated list of partition names. -s, --steps Specify the job steps to view. This flag indicates that a comma separated list of job steps to view follows without an equal sign (see examples). The job step format is "job_id.step_id". Defaults to all job steps. -S , --sort= Page 4 (printed 2/8/06) SQUEUE(1) squeue 1.0 (December 2005) SQUEUE(1) Specification of the order in which records should be reported. This uses the same field specifciation as the . Multiple sorts may be performed by listing multiple sort fields separated by commas. The field specifications may be preceeded by "+" or "-" for assending (default) and desending order respectively. For example, a sort value of "P,U" will sort the records by partition name then by user id. The default value of sort for jobs is "P,t,-p" (increasing partition name then within a given partition by increasing node state and then decreasing priority). The default value of sort for job steps is "P,i" (increasing partition name then within a given partition by increasing step id). -t , --states= Specify the states of jobs to view. Accepts a comma separated list of state names or "all". If "all" is specified then jobs of all states will be reported. If no state is specified then pending, running, and completing jobs are reported. Valid states (in both extended and compact form) include: PENDING (PD), RUNNING (R), SUSPENDED (S), COMPLETING (CG), COMPLETED (CD), CANCELLED (CA), FAILED (F), TIMEOUT (TO), and NODE_FAIL (NF). Note the supplied is case insensitve ("pd" and "PD" work the same). See the JOB STATE CODES section below for more information. -u , --user= Specifies a comma separated list of users whose jobs or job steps are to be reported. The list can consist of user names or user id numbers. -v, --verbose Report details of squeues actions. -V , --version Print version information and exit. JOB REASON CODES These codes identify the reason that a job is waiting for execution. A job may be waiting for more than one reason, in which case only one of those reasons is displayed. Dependency This job is waiting for a dependent job to complete. None No reason is set for this job. PartitionDown The partition required by this job is in a DOWN state. Page 5 (printed 2/8/06) SQUEUE(1) squeue 1.0 (December 2005) SQUEUE(1) PartitionNodeLimit The number of nodes required by this job is outside of it's partitions current limits. PartitionTimeLimit The job's time limit exceeds it's partition's current time limit. Priority One or more higher priority jobs exist for this partition. Resources The job is waiting for resources to become availble. JOB STATE CODES Jobs typically pass through several states in the course of their execution. The typical states are PENDING, RUNNING, SUSPENDED, COMPLETING, and COMPLETED. An explanation of each state follows. CA CANCELLED Job was explicitly cancelled by the user or system administrator. The job may or may not have been initiated. CD COMPLETED Job has terminated all processes on all nodes. CG COMPLETING Job is in the process of completing. Some processes on some nodes may still be active. F FAILED Job terminated with non-zero exit code or other failure condition. NF NODE_FAIL Job terminated due to failure of one or more allocated nodes. PD PENDING Job is awaiting resource allocation. R RUNNING Job currently has an allocation. S SUSPENDED Job has an allocation, but execution has been suspended. TO TIMEOUT Job terminated upon reaching its time limit. ENVIRONMENT VARIABLES Some squeue options may be set via environment variables. These environment variables, along with their corresponding options, are listed below. (Note: Commandline options will Page 6 (printed 2/8/06) SQUEUE(1) squeue 1.0 (December 2005) SQUEUE(1) always override these settings.) SLURM_CONF The location of the SLURM configuration file. SQUEUE_ALL -a, --all SQUEUE_FORMAT -o , --format= SQUEUE_PARTITION -p , --partition= SQUEUE_SORT -S , --sort= SQUEUE_STATES -t , --states= SQUEUE_USERS -u , --users= EXAMPLES Print the jobs scheduled in the debug partition and in the COMPLETED state in the format with six right justified digits for the job id followed by the priority with an arbitrary fields size: # squeue -p debug -t COMPLETED -o "%.6i %p" JOBID PRIORITY 65543 99993 65544 99992 65545 99991 Print the job steps in the debug partition sorted by user: # squeue -s -p debug -S u STEPID NAME PARTITION USER TIME_USED NODELIST(REASON) 65552.1 test1 debug alice 0:23 dev[1-4] 65562.2 big_run debug bob 0:18 dev22 65550.1 param1 debug candice 1:43:21 dev[6-12] Print information only about jobs 12345,12345, and 12348: # squeue --jobs 12345,12346,12348 JOBID PARTITION NAME USER ST TIME_USED NODES NODELIST(REASON) 12345 debug job1 dave R 0:21 4 dev[9-12] 12346 debug job2 dave PD 0:00 8 (Resources) 12348 debug job3 ed PD 0:00 4 (Priority) Print information only about job step 65552.1: # squeue --steps 65552.1 STEPID NAME PARTITION USER TIME_USED NODELIST(REASON) 65552.1 test2 debug alice 12:49 dev[1-4] Page 7 (printed 2/8/06) SQUEUE(1) squeue 1.0 (December 2005) SQUEUE(1) COPYING Copyright (C) 2002 The Regents of the University of California. Produced at Lawrence Livermore National Laboratory (cf, DISCLAIMER). UCRL-CODE-217948. This file is part of SLURM, a resource management program. For details, see . SLURM is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. SLURM is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. SEE ALSO scancel(1), scontrol(1), sinfo(1), smap(1), srun(1), slurm_load_ctl_conf(3), slurm_load_jobs(3), slurm_load_node(3), slurm_load_partitions(3) Page 8 (printed 2/8/06)