We are using slurm to develop a solution for job distribution. In our scenario we employ a client filter plugin( to load certain job details to a remote proc during submission using user's credentials) . However, the problem is these details remain loaded when we happen to cancel the job during its pending state. Is there a job cleanup script which we are missing which may help to unload the details?
Also, is there a way to inform a custom select plugin about the job termination (through cancel) ? Presently, it appears slurmctld doesn't inform select plugin if a pending job is killed.
Thanks for any help.