Developer Release Notes - version 24.02

This is a developer facing release info - list of all merge requests related to this release for the projects relevant for the platform. See user facing changelog here

Development

Galaxy Tools, v24.02.0

• Merge with dev for release 24.02.0 (thanks to Sergey Yakubov). Merge Request 146
• Fix reports (thanks to Sergey Yakubov). Merge Request 145
• Update gitlab to run tests on dev and main only (thanks to Sergey Yakubov). Merge Request 144
• Asrp tools (thanks to Sergey Yakubov). Merge Request 142
• Adding amira novnc (thanks to Andrew Ayres). Merge Request 137
• Ci tool test fixes (thanks to Jenna DeLozier). Merge Request 141
• Bump asrp tool versions for fixes to tools (thanks to Jenna DeLozier). Merge Request 134
• Ci debugging (thanks to Jenna DeLozier). Merge Request 139
• Air-sans demo tool (thanks to Sergey Yakubov). Merge Request 138
• Rpa tools (thanks to Jenna DeLozier). Merge Request 127
• Incident beamline tools (thanks to Jenna DeLozier). Merge Request 133
• Add heatmap to neutrons_dca_maxent2plot_cades tool (thanks to Sergey Yakubov). Merge Request 136
• Update dca tools for frontier (thanks to Sergey Yakubov). Merge Request 131
• Add asrp / espd bbo rietveld tool (thanks to Marshall McDonnell). Merge Request 130
• Changed output name in pdb2pqr tool (thanks to Robert Smith). Merge Request 129
• Added output file to pdb2pqr tool (thanks to Robert Smith). Merge Request 128
• Added imagine-x pdb file conversion tool (thanks to Robert Smith). Merge Request 126
• Mlsans lammps rep lj yukawa (thanks to Sergey Yakubov). Merge Request 125
• Remove 'echo' commands to in.temp, which causes permission issues (thanks to Sergey Yakubov). Merge Request 124
• Pass username to startup script. (thanks to Gregory Watson). Merge Request 123
• Switch dca++ tools to cades (thanks to Sergey Yakubov). Merge Request 122
• Add lammps simulation for lj + 2yukawa tool (thanks to Sergey Yakubov). Merge Request 121
• Update containter version and startup command. (thanks to Gregory Watson). Merge Request 120
• Update container version (thanks to Gregory Watson). Merge Request 119
• Update dca tools for hdf5 inputs/outputs (thanks to Sergey Yakubov). Merge Request 117
• Update dca tools, add dca_bins_for_sqw (thanks to Sergey Yakubov). Merge Request 116
• Get output from jana command (thanks to Gregory Watson). Merge Request 115
• Update container version and fix outputs. (thanks to Gregory Watson). Merge Request 114
• Update dca tools for hdf5 inputs/outputs (thanks to Sergey Yakubov). Merge Request 113
• [mlsans] desmear (thanks to Sergey Yakubov). Merge Request 108
• Update container version (thanks to Gregory Watson). Merge Request 111
• Jana2020 (thanks to Gregory Watson). Merge Request 106
• Added imagine-x data reduction image count tool (thanks to Sergey Yakubov). Merge Request 103
• Update container version (thanks to Gregory Watson). Merge Request 100
• Update maxent tool to the new version (thanks to Sergey Yakubov). Merge Request 104
• Mlsans lammps rep lj yukawa (thanks to Sergey Yakubov). Merge Request 102
• Initial commit of mlsans_lammps_rep_lj_yukawa tool (thanks to Sergey Yakubov). Merge Request 101
• Remove ornl from name (thanks to Sergey Yakubov). Merge Request 99
• Add jana2020 interactive tool (thanks to Gregory Watson). Merge Request 98
• Use gpu container version for paraview (thanks to Sergey Yakubov). Merge Request 96
• Add paraview visualizer tool (thanks to Sergey Yakubov). Merge Request 95
• Add an option to execute tool/workflow from ingress tool (thanks to Sergey Yakubov). Merge Request 94
• Refactors asrp tools (thanks to Sergey Yakubov). Merge Request 93
• Add functionality to ingress tool to pick up old data from experiment folders (thanks to Sergey Yakubov). Merge Request 92
• Fix coord file name for cp2k tool (thanks to Sergey Yakubov). Merge Request 91
• Fix dca tools (thanks to Sergey Yakubov). Merge Request 90
• Fix permissions for dca++ tools (thanks to Sergey Yakubov). Merge Request 89
• Add fail with outputs command to remote_command.xml tool (thanks to Sergey Yakubov). Merge Request 88
• Bump ingress tool image version (thanks to Sergey Yakubov). Merge Request 87
• Corrections for mcu sample sim to run on calvera correctly (thanks to Andrew Ayres). Merge Request 86
• Amira thinlinc (thanks to Andrew Ayres). Merge Request 85
• Bump ingress tool image and rename parameters (thanks to Sergey Yakubov). Merge Request 84

Galaxy, v23.1.dev2.ornl

• Merge with dev for release 24.02.0 (thanks to Sergey Yakubov). Merge Request 74
• Add an option to use extra script for user auth (thanks to Sergey Yakubov). Merge Request 73
• Passthrough oidc_user environment to docker container (thanks to Sergey Yakubov). Merge Request 72
• Allow multiple idps for object store (thanks to Sergey Yakubov). Merge Request 71
• Interactive url (thanks to Andrew Ayres). Merge Request 68
• Allow auth via pingfed (thanks to Sergey Yakubov). Merge Request 69
• Add console output endpoint (thanks to Gregory Cage). Merge Request 67
• Add stopped job metadata (thanks to Gregory Cage). Merge Request 66
• Adding support for a prototype parameter in interactive tools. (thanks to Andrew Ayres). Merge Request 65
• Gzi stderr update (thanks to Gregory Cage). Merge Request 63
• Return status for stopped tools (thanks to Sergey Yakubov). Merge Request 64
• Do not set dataset visible to true in case of failing jobs (thanks to Sergey Yakubov). Merge Request 62
• Stop job feature (thanks to Gregory Cage). Merge Request 60
• Proper fail job on object store error (thanks to Sergey Yakubov). Merge Request 61
• Refactor pulling data from cache (thanks to Sergey Yakubov). Merge Request 59
• Update with recent galaxy from upstream (thanks to Sergey Yakubov). Merge Request 58
• Sync with 23.08.0 dev (thanks to Sergey Yakubov). Merge Request 57

Pulsar, 0.15.3.dev8.ornl

• Dev (thanks to Sergey Yakubov). Merge Request 37
• Bump galaxy version (for object store) (thanks to Sergey Yakubov). Merge Request 36
• Allow token from multiple idps (thanks to Sergey Yakubov). Merge Request 35
• Allow multiple idps, parse token returned by pingfed (thanks to Sergey Yakubov). Merge Request 34
• Soft kill update (thanks to Gregory Cage). Merge Request 33
• Send stderr alongside stdout to galaxy job directory (thanks to Gregory Cage). Merge Request 29
• Fix folder deletion if set_meta failed (thanks to Sergey Yakubov). Merge Request 32
• Add options to clean up jobs (thanks to Sergey Yakubov). Merge Request 31
• Make sure permissions are set correctly in working directory (thanks to Sergey Yakubov). Merge Request 30
• Process metadata errors (thanks to Sergey Yakubov). Merge Request 28
• Add stop job capability to pulsar (thanks to Gregory Cage). Merge Request 26
• Rename update_cache to sync_cache for object_store (thanks to Sergey Yakubov). Merge Request 27
• Add retry for lsf bjobs command (thanks to Sergey Yakubov). Merge Request 25
• Sync with 23.08.0 dev (thanks to Sergey Yakubov). Merge Request 24

Remote Data Broker, v0.5.0

• Allow token from multiple idps (thanks to Sergey Yakubov). Merge Request 13
• Add an option to write logs to file (thanks to Sergey Yakubov). Merge Request 12
• Rpm package for rdb (thanks to Sergey Yakubov). Merge Request 11

OIDC PAM module, v0.3.0

• Accept pingfed tokens (thanks to Sergey Yakubov). Merge Request 8

Deployment

Calvera, v24.02.0

• Update interactivetool_generic_output tool directory (thanks to Sergey Yakubov). Merge Request 143
• Merge with dev for release 24.02 (thanks to Sergey Yakubov). Merge Request 142
• Update versions (thanks to Sergey Yakubov). Merge Request 141
• Add amira novnc to the job an tool confs (thanks to Andrew Ayres). Merge Request 136
• Update tool_conf.xml.j2 (thanks to Jenna DeLozier). Merge Request 140
• Add neutrons_gravitas_phonopy tool (thanks to Sergey Yakubov). Merge Request 138
• Add neutrons_airsans_demo tool,swith gpu tools to bl18 (thanks to Sergey Yakubov). Merge Request 137
• Fix crone config for db backup cleanup (thanks to Sergey Yakubov). Merge Request 135
• Add user auth script and oidc backend config (thanks to Sergey Yakubov). Merge Request 134
• Add postgres recovery script (thanks to Sergey Yakubov). Merge Request 133
• Move ansible-pgclean.yml to ansible/roles/ornl.tuning/tasks. add reference to main.yml (thanks to Sergey Yakubov). Merge Request 129
• Increase client_max_body_size in nginx config (thanks to Sergey Yakubov). Merge Request 132
• Adhoc frontier (thanks to Sergey Yakubov). Merge Request 131
• Move imagine-x pdb2pqr tool out from dev (thanks to Robert Smith). Merge Request 128
• Added imagine-x occupancy tool (thanks to Robert Smith). Merge Request 130
• Adds the pdb2pdq dev tool (thanks to Sergey Yakubov). Merge Request 126
• Update services with changes for xcams (thanks to Sergey Yakubov). Merge Request 125
• Configure calvera to work with pingfed auth (thanks to Sergey Yakubov). Merge Request 124
• Switch job_conf to yaml (thanks to Sergey Yakubov). Merge Request 123
• Add neutrons mlsans lammps rep lj 2yukawa (thanks to Sergey Yakubov). Merge Request 122
• Update summit nodes limit,dca_bins_for_sqw (thanks to Sergey Yakubov). Merge Request 121
• Add new mlsans tools: desmear,rebin,plotiq (thanks to Sergey Yakubov). Merge Request 120
• Use thinlinc job for jana (thanks to Gregory Watson). Merge Request 119
• Add jana2020 (thanks to Gregory Watson). Merge Request 111
• Added imagine-x image generator tool (thanks to Robert Smith). Merge Request 118
• Set correct user for fluentd logrotate config (thanks to Sergey Yakubov). Merge Request 117
• Fix tool branches (thanks to Sergey Yakubov). Merge Request 116
• Add mlsans lammps tool (thanks to Sergey Yakubov). Merge Request 115
• Commit url (thanks to Sergey Yakubov). Merge Request 114
• Elk logs (thanks to Sergey Yakubov). Merge Request 113
• Guard deployment, update welcome page (thanks to Sergey Yakubov). Merge Request 112
• Update promtail to v2.9.2 (thanks to Sergey Yakubov). Merge Request 110
• Add neutrons_plotiq dev tool (thanks to Sergey Yakubov). Merge Request 109
• Add destination for new machine (thanks to Sergey Yakubov). Merge Request 108
• Add label hostname (thanks to Mark Abraham). Merge Request 107
• Deploy ansible-role-promtail for logging agent (thanks to Sergey Yakubov). Merge Request 106
• Add when statement (thanks to Mark Abraham). Merge Request 105
• Remove sudo user promtail (thanks to Mark Abraham). Merge Request 103
• Make galaxy promtail directories owner and user (thanks to Mark Abraham). Merge Request 102
• Add paraview tool (thanks to Sergey Yakubov). Merge Request 101
• Thinlinc (thanks to Andrew Ayres). Merge Request 100
• Deploy extra python packages before galaxy install (thanks to Sergey Yakubov). Merge Request 99
• Update gie proxy (thanks to Sergey Yakubov). Merge Request 97
• Node_exporter role deploying with error: change web_listen to web.listen (thanks to Mark Abraham). Merge Request 95
• Fixed pathing (thanks to Mark Abraham). Merge Request 94
• Seperated node expoert from prometheus roles (thanks to Mark Abraham). Merge Request 93
• 7va add node exporter ansible (thanks to Mark Abraham). Merge Request 92
• Add other resources to the remote_command tool, refactor (thanks to Sergey Yakubov). Merge Request 91
• Set proper umask for files (thanks to Sergey Yakubov). Merge Request 90
• Bump pulsar and oidc-pam versions (thanks to Sergey Yakubov). Merge Request 89
• Update calvera-test certificates (thanks to Sergey Yakubov). Merge Request 88
• Amira thinlinc (thanks to Andrew Ayres). Merge Request 87
• Adding mcu sample sim to job config (thanks to Andrew Ayres). Merge Request 85
• Fix mcu sample sim tool naming (thanks to Andrew Ayres). Merge Request 84
• Add mcu sample sim to tool_conf (thanks to Andrew Ayres). Merge Request 83
• Add ingress tools (thanks to Sergey Yakubov). Merge Request 82
• Bump pulsar on slate deployment version (thanks to Sergey Yakubov). Merge Request 81
• Sync with 23.08.0 dev (thanks to Sergey Yakubov). Merge Request 80
• Sync with dev (thanks to Sergey Yakubov). Merge Request 76
• Fix welcome page (thanks to Sergey Yakubov). Merge Request 71
• Dev (thanks to Sergey Yakubov). Merge Request 69
• Update pulsar version (thanks to Sergey Yakubov). Merge Request 66
• Sync with dev (thanks to Sergey Yakubov). Merge Request 65
• Use object store for pulsar_gpu1 and pulsar_cpu1 dests (thanks to Sergey Yakubov). Merge Request 53
• Add rucio secrets (thanks to Sergey Yakubov). Merge Request 52
• Merge latest changes from dev (thanks to Sergey Yakubov). Merge Request 51

Pulsar on Cades, v24.02.0

• Add sns-gpu to the gitlab deploy job (thanks to Sergey Yakubov). Merge Request 39
• Add logging to production pulsar (thanks to Sergey Yakubov). Merge Request 37
• Merge with dev for release 24.02.0 (thanks to Sergey Yakubov). Merge Request 35
• Update fluentd config (thanks to Sergey Yakubov). Merge Request 34
• Update services with changes for xcams (thanks to Sergey Yakubov). Merge Request 33
• Add pingfed auth (thanks to Sergey Yakubov). Merge Request 32
• 7va promtail deployment (thanks to Mark Abraham). Merge Request 25
• 7va logging (thanks to Randy Petras). Merge Request 22
• Bump pulsar version, add cleanup parameters and umask (thanks to Sergey Yakubov). Merge Request 21
• Bump pulsar and oidc-pam versions (thanks to Sergey Yakubov). Merge Request 20
• Sync with 23.08.0 dev (thanks to Sergey Yakubov). Merge Request 19
• Sync with dev (thanks to Sergey Yakubov). Merge Request 17
• Install galaxy-job-execution package (thanks to Sergey Yakubov). Merge Request 16
• Sync with dev (thanks to Sergey Yakubov). Merge Request 14
• Update from dev (thanks to Sergey Yakubov). Merge Request 6
• Dev (thanks to Sergey Yakubov). Merge Request 3

Pulsar on Slate, v24.02.0

• Added pingfed idp (thanks to Sergey Yakubov). Merge Request 11
• Add fluentd sidecar container for logs (thanks to Sergey Yakubov). Merge Request 10
• Add rse config for sns bl18 (thanks to Sergey Yakubov). Merge Request 9
• Refactor config, add cleanup parameters (thanks to Sergey Yakubov). Merge Request 8
• Bump pulsar version, increase poll interval (thanks to Sergey Yakubov). Merge Request 7

Remote Data Broker on Slate, v24.02.0

• Added pingfed idp (thanks to Sergey Yakubov). Merge Request 3
• Add fluentd sidecar container for logs (thanks to Sergey Yakubov). Merge Request 2

info

see previous changelog here