Available Destinations
Destinations are defined in calvera's k8s/galaxy/values-jobconf-test.yml (mickey) and
k8s/galaxy/values-jobconf-prod.yml (speedy). The two files share most of their content, so keep them in step.
Dynamic Destinations
NDIP job submission uses our Prometheus monitoring to decide whether compute nodes can receive jobs. If Galaxy
cannot reach the Prometheus alerts API, all jobs stay in the new state waiting for healthy compute nodes. A firing
alert carrying a Pulsar host's host label takes that host out of rotation, even if it is only a warning.
A dynamic destination sends each job to one of the static destinations, based on the tool's resource requirements or parameters.
| Destination | Runner | Notes / Features |
|---|---|---|
| dynamic_resource_orchestration | dynamic | Default for all tools (execution.default) |
| dynamic_olcf | dynamic | OLCF (Frontier/Marble) |
| dynamic_nersc | dynamic | NERSC (prod only) |
| dynamic_nersc_iri | dynamic | NERSC through IRI (prod only) |
| dynamic_remote | dynamic | User-selected remote resource (neutrons_remote_command) |
Static Destinations
| Destination | Runner | Env | Notes / Features |
|---|---|---|---|
| local | local | both | Runs inside the Galaxy pod (uploads, __DATA_FETCH__, internal tools); 2 workers |
| k8s | k8s | both | Kubernetes Job in namespace ndip, mounts galaxy-data |
| pulsar_sns_node01 | pulsar_mq_sns_node01 | both | SNS CPU node (ndip-node01.sns.gov) |
| pulsar_sns_gpu_node01 | pulsar_mq_sns_gpu_node01 | both | SNS GPU node (sns-ndip-gpu.sns.gov) |
| pulsar_imaginex1 / pulsar_imaginex2 | pulsar_mq_imaginex1/2 | both | imaginex GPU nodes |
| pulsar_marble_cph102 / _bip280 / _mat745 | pulsarmq_marble* | both | Frontier through Slate, per project |
| pulsar_spin_m1503 / pulsar_spin_m77 | pulsarmq_spin* | prod | NERSC Perlmutter through Spin |
| pulsar_nersc_iri | pulsar_iri_runner | prod | NERSC IRI API, restricted user list |
| pulsar_export_to_sns | pulsar_mq_export | both | Export jobs to SNS/HFIR storage (neutrons_export) |
| pulsar_reg_to_sns | pulsar_mq_sns_register | both | Registration/load jobs (neutrons_load_data, neutrons_register) |
The VM-era root/X11/noVNC/ThinLinc destinations (pulsar_sns_gpu_root*, pulsar_sns_gpu_novnc,
pulsar_sns_node01_thinlinc) are not defined on the Kubernetes stack.