What’s New

This page summarizes the new features and improvements in the latest release of gbasf2.

For more details, please refer to the release notes.

Changes in 6.2.0

Docs

  • User Support: replacing instructions about comp-users-forum for incidents at GitLab User Support

New Features

  • gb2_diagnostic: extend the functionality for productions

Enhancements

  • gbasf2: Add a warning if compiled modules are in input sandbox without a specified resource tag

  • gb2_diagnostic: Extracting sites from JDL when site is not shown in JobParameters

  • gb2 tools: Use entrypoints for gb2_scripts instead of $DIRAC environment variable

  • gbasf2: LFN input sandbox files set by default

  • gbasf2: use executable files from CVMFS

  • gbasf2: unit tests for gbasf2helper

  • gb2_ds: Error codes and unit testing methods in datasetCLController and manager

  • Functional tests for gbasf2, gb2_job and gb2_ds

  • RucioSynchronizer : Introduce default quota for user and group

Fixes

  • gbasf2: try to upload steering file to other SEs if first one fails

  • gbasf2: resolve crash when lfn has no metadata

  • gbasf2: bugfix, skip the check for remoteSandboxFiles when remoteSandboxFiles are not included

  • gb2_ds_list: improve error handling for datablocks

  • gb2_job_reschedule: Fix on verbose option returning wrong data type, preventing printing of message

  • gb2_job_status: fix to get Scout JobGroup properly

  • gb2_job_status: warn if scout job does not have JobGroup

  • gb2_ds_get: fix 0 event file filter

  • gb2_ds_search collection: Changed forcing a list to be a string, fixes collection search error message

  • gb2_ds_searcher_create : Fix bug when adding datasets

  • ds manager: update some methodes to return S_ERROR() instead of exiting

  • RucioFileCatalogClient : fix bug when no replicas found, causing error

  • ScoutingJobStatusAgent: speed the cycles with bulk calls

  • Cleanup of code, removing calls to AMGA (decommissioned)

Changes in 6.1.2

Features

  • gb2_project_getlfns: A gb2 client tool to find LFNs of jobs in a project. For example, getting LFNs for all jobs in Waiting status.

Enhancements

  • gb2_tools: Add the option ‘–output_json’ to put output info into JSON files

  • gbasf2: upload steering file as a placeholder in Rucio

  • gbasf2: Make default input_grouping option configurable

  • gbasf2: Set a configurable quota limit for gb2_tools that use storage on the grid

  • gb2_check_release: Add –prod option using existing production releases

Fixes

  • gbasf2: get header list in gb2_job_status -l from Dirac dictionary

  • gbasf2: Adding exceptions to avoid gbasf2 crash when metadata is missing

  • gbasf2: Retrieving DefaultExpectedEventCPUTime as a float

  • gb2_ds_collection: not to crash for datasets already existing in another collection

  • gb2_diagnostic: bugfixes to properly close buffers and avoid overwriting

  • gb2_ds_get: Only check for duplicates within each file type

  • gb2_ds_rm_rep fails with ZeroDivisionError when the replica contains one file

Changes in 6.1.1

Docs

  • gbasf2 docs: replica and quota

Enhancements

  • gbasf2: Warn if no cputime or evtpersec provided

  • gbasf2: enabling default resource tag

  • gb2_diagnostic: extend the pattern to catch errors inside the job log

Fixes

  • gbasf2: remove banned sites from forecast

  • gb2_diagnostic: BUGFIX to parse JDL information

  • gb2_ds_get: removing misleading message when no skipping directories

  • gb2_job_status reports jobs outside a project

  • gb2_project_summary: properly account for deleted jobs

  • Collections: Handling cases when some of the keys for metadata have None as value

  • Collection : Publish collection broken due to Rucio column metadata

Changes in 6.1.0

Metadata Transition

  • gbasf2: lookup for metadata in Rucio first and fallback to AMGA

  • gb2_ds: manager methods to query Rucio prior to AMGA

  • gb2_ds_put: to use Rucio in addition to AMGA

  • Fail job if registration to Rucio File Catalog Failover fails

  • Switch to deactivate registration of metadata in AMGA

Docs

  • Gbasf2: Replacing links to Confluence -> XWiki, Updating software release info, Updating platform CentOS 7 -> EL8 and EL9

  • Gbasf2 docs updates for new features: https://gbasf2.belle2.org/

New Features

  • gbasf2: using the option –lfn_sandboxfiles, local files that are provided as input sandbox files (option -f) are automatically uploaded on a SE

  • gbasf2: to use apptainer where the environment of the worker node does not match the resource_tag

Enhancements

  • gbasf2: Advanced input file grouping (option -n)

  • gb2_ds_count_events: Allow Collections to be Used

  • gb2_ds_get: to download only from DISK, not to try to get files from TAPE endpoints

  • gb2_job tools: Exits with error code

  • gb2_ds: Clean-up of manager.py, replacing print statements with gLogger and adding docstrings

Fixes

  • gbasf2: deprecate options –query_file and –query_ds

  • gbasf2: delete jobs when submission in batches fails

  • gb2_job_status: the order of the column header names when the option ‘long’ is specified is corrected

  • gb2_ds: All gb2 tools filtering duplicated jobIDs

  • gb2_ds_query_file: was broken if file only registered in Rucio

  • gb2_ds_count_events: Fix not to crash when some file metadata are missing

  • gb2_ds_put: example in help to use a usable SE

  • gb2_ds_put: to print error messages

  • gb2_diagnostic: Fix in Pilot Submission and Site Status Check

  • WebApp: Remove obsolete B2Plot panels

  • Dataset Searcher: Delete Tree browser

  • Patch for making Dataset Searcher compatible with DIRAC v8