Hello reader,
iRODS 4.3.3 is now available! You can read all about it at https://irods.org/2024/08/irods-4-3-3-is-released/.
For this month's update, work on the iRODS 5.0 server has begun. Our goal is to make the iRODS server cloud-friendly. That means we're going to focus on improvements to the process model and management of hostnames. The C++ project template for the database plugin is coming together. Those looking to integrate other databases with iRODS will soon have a starter project they can use to quickly hit the ground running. Efforts to move more dependencies to find_package() are still in progress too.
Documentation for iRODS has been updated. The Policy Cookbook now covers the data object finalize PEPs. The data object finalize PEPs expose all details of a replica, making them very useful for many tasks. To learn more, check out https://docs.irods.org/4.3.3/administrators/policy_cookbook/#enforcing-policy-when-data-transfers-complete. We're also adding documentation which explains how to add and run tests. For those looking to learn about GenQuery2, you'll be happy to know that full coverage of the new parser is explained at https://docs.irods.org/4.3.3/system_overview/genquery/#genquery2.
The PAM Interactive Authentication plugin is now available for iRODS 4.3.3. See https://irods.org/2024/08/initial-release-of-the-irods-pam-interactive-auth-plugin/ for details.
Work on the Python Rule Engine plugin is progressing well. An issue involving the GIL and concurrent access was resolved in the lead up to 4.3.3. Aside from that, we're working hard to add support for virtual environments. If done correctly, administrators will be able to use a different set of modules than those provided by their system's package manager. You can follow that effort at https://github.com/irods/irods_rule_engine_plugin_python/pull/224.
For the Automated Ingest capability, a new Docker Compose project was added for demonstration purposes. Work to provide a clean separation between filesystem scanner tasks and S3 scanner tasks is in progress. We expect that to land very soon. The big news is we've successfully demonstrated a new Celery task which recursively removes data in parallel. Early performance testing has shown a 55% improvement over irm -rf.
Version 0.4.0 of the iRODS HTTP API is now available. You can view the full list of closed issues at https://github.com/irods/irods_client_http_api/milestone/5?closed=1.
The iRODS S3 API now supports the AbortMultipartUpload operation. The performance improvements for multipart upload are now complete. All that's left to do is to polish the changes. We expect the updates to be merged into upstream within a few weeks.
This is a big one - Jargon 4.3.4.0-RELEASE is now available for download! To learn more, see https://github.com/DICE-UNC/jargon/releases/tag/4.3.4.0-RELEASE.
Thanks for reading. Talk to you next month!
Metadata Templates Working Group
New Development Work
Active Development Work
Build and Packaging
iRODS Documentation
PAM Interactive Authentication Plugin
Unified Storage Tiering Capability
Background Items
Docker-based Testing Environment
Docker-based Development Environment
iRODS Kubernetes Testing Environment
iRODS Command Line Interface (CLI)
Logical Locking
New RPC API framework
Parallel Filesystem Integration
CockroachDB Database Plugin
Discussion