What’s New

This page summarizes the new features and improvements in the latest release of gbasf2.

For more details, please refer to the release notes.

Changes in 6.1.2

Features

  • gb2_project_getlfns: A gb2 client tool to find LFNs of jobs in a project. For example, getting LFNs for all jobs in Waiting status.

Enhancements

  • gb2_tools: Add the option ‘–output_json’ to put output info into JSON files

  • gbasf2: upload steering file as a placeholder in Rucio

  • gbasf2: Make default input_grouping option configurable

  • gbasf2: Set a configurable quota limit for gb2_tools that use storage on the grid

  • gb2_check_release: Add –prod option using existing production releases

Fixes

  • gbasf2: get header list in gb2_job_status -l from Dirac dictionary

  • gbasf2: Adding exceptions to avoid gbasf2 crash when metadata is missing

  • gbasf2: Retrieving DefaultExpectedEventCPUTime as a float

  • gb2_ds_collection: not to crash for datasets already existing in another collection

  • gb2_diagnostic: bugfixes to properly close buffers and avoid overwriting

  • gb2_ds_get: Only check for duplicates within each file type

  • gb2_ds_rm_rep fails with ZeroDivisionError when the replica contains one file

Changes in 6.1.1

Docs

  • gbasf2 docs: replica and quota

Enhancements

  • gbasf2: Warn if no cputime or evtpersec provided

  • gbasf2: enabling default resource tag

  • gb2_diagnostic: extend the pattern to catch errors inside the job log

Fixes

  • gbasf2: remove banned sites from forecast

  • gb2_diagnostic: BUGFIX to parse JDL information

  • gb2_ds_get: removing misleading message when no skipping directories

  • gb2_job_status reports jobs outside a project

  • gb2_project_summary: properly account for deleted jobs

  • Collections: Handling cases when some of the keys for metadata have None as value

  • Collection : Publish collection broken due to Rucio column metadata

Changes in 6.1.0

Metadata Transition

  • gbasf2: lookup for metadata in Rucio first and fallback to AMGA

  • gb2_ds: manager methods to query Rucio prior to AMGA

  • gb2_ds_put: to use Rucio in addition to AMGA

  • Fail job if registration to Rucio File Catalog Failover fails

  • Switch to deactivate registration of metadata in AMGA

Docs

  • Gbasf2: Replacing links to Confluence -> XWiki, Updating software release info, Updating platform CentOS 7 -> EL8 and EL9

  • Gbasf2 docs updates for new features: https://gbasf2.belle2.org/

New Features

  • gbasf2: using the option –lfn_sandboxfiles, local files that are provided as input sandbox files (option -f) are automatically uploaded on a SE

  • gbasf2: to use apptainer where the environment of the worker node does not match the resource_tag

Enhancements

  • gbasf2: Advanced input file grouping (option -n)

  • gb2_ds_count_events: Allow Collections to be Used

  • gb2_ds_get: to download only from DISK, not to try to get files from TAPE endpoints

  • gb2_job tools: Exits with error code

  • gb2_ds: Clean-up of manager.py, replacing print statements with gLogger and adding docstrings

Fixes

  • gbasf2: deprecate options –query_file and –query_ds

  • gbasf2: delete jobs when submission in batches fails

  • gb2_job_status: the order of the column header names when the option ‘long’ is specified is corrected

  • gb2_ds: All gb2 tools filtering duplicated jobIDs

  • gb2_ds_query_file: was broken if file only registered in Rucio

  • gb2_ds_count_events: Fix not to crash when some file metadata are missing

  • gb2_ds_put: example in help to use a usable SE

  • gb2_ds_put: to print error messages

  • gb2_diagnostic: Fix in Pilot Submission and Site Status Check

  • WebApp: Remove obsolete B2Plot panels

  • Dataset Searcher: Delete Tree browser

  • Patch for making Dataset Searcher compatible with DIRAC v8