v25.1
All Posts
Release

Onedata 21.02.1 Released

Onedata 21.02.1 is out! This major release expands automation workflows, archive management, datasets and statistics, while adding Space Marketplace and SMTP support and improving S3, transfers and the Web GUI.
Version
Onedata 21.02.1
Released
April 20, 2023
More info & assets →

What's New in Onedata 21.02.1

  • New major release — version 21.02.1 introduces the 21.02 line of Onedata.

Full Changelog

  • VFS-10756 (Oneclient) Switched ones3 to internal onedata temporary directory for handling temporary upload files.
  • VFS-10754 (Oneprovider) Web GUI: Fixed file list crash after jumping to the end and deleting last file.
  • VFS-10735 (Oneclient) FIxed timeout handling in S3 storage driver.
  • VFS-10622 (Oneclient, Oneprovider) Added scalable S3 server interface implementation based on Oneclient.
  • VFS-10546 (Oneprovider) Removed transfer charts padding when viewing them on remote providers.
  • VFS-10540 (Oneprovider) Ported rtransfer fixes with better error recovery and handling from develop to stable branch 20.02.
  • VFS-10531 (Oneprovider, Onezone) Web GUI: Added support for enum-like data types in automation (list of allowed values for string and number types).
  • VFS-10502 (Oneclient, Oneprovider, Onezone) Added option to null device enabling verification of whether read data matches written data based on offset and size of request, which can be used to test for instance transfer data consistency.
  • VFS-10432 (Onezone) Web GUI: Fixed cookie notification appearing after consenting and starting new web browser session.
  • VFS-10414 (Oneprovider, Onezone) Web GUI: Fixed displaying wrong names of spaces in shares sidebar.
  • VFS-10397 (Oneprovider) Fixed rtransfer link error propagation issues, which sometimes result in hanging transfers.
  • VFS-10389 (Oneprovider, Onezone) Web GUI: Added showing data per provider in directory statistics.
  • VFS-10387 (Oneprovider) Blocked setting metadata_protection without data_protection.
  • VFS-10358 (Oneprovider) New archive privilege in space - manage archives. It is required for modifying other user's archives metadata (like description) as well as cancelling them. Those operations can be always performed on owned archives (even without this privilege). Manage dataset privilege is no longer required for archive operations.
  • VFS-10357 (Oneprovider, Onezone) Web GUI: Added support for "manage archives" privilege and "creator" information in archives.
  • VFS-10312 (Oneprovider, Onezone) Web GUI: Changed name conflict and disambiguation separator from # to @.
  • VFS-10283 (Oneprovider) Web GUI: Added possibility to delete, rename and move hardlink to file that is inside data-protected directory and is not data-protected itself.
  • VFS-10264 (Oneclient, Oneprovider) Added parameter to oneclient handshake protocol to distinguish between different oneclient modes of operation.
  • VFS-10261 (Oneprovider, Onezone) Web GUI: Fixed auto-cleaning reports not loading on large screens.
  • VFS-10235 (Oneprovider, Onezone) Changed default value of accountingEnabled parameter to true when requesting space support.
  • VFS-10234 (Oneprovider, Onezone) Web GUI: Changed default space support options to have directory size statistics aggregation turned on.
  • VFS-10222 (Oneprovider) Web GUI: Fixed starting multiple files replication/migration/eviction.
  • VFS-10216 (Oneprovider) Refactored transfer data source traversal and statistics counting so that only regular files would be counted.
  • VFS-10174 (Oneclient, Oneprovider) Fixed possible crash in the nulldevice helper when simulating large filesystems for importing to data space.
  • VFS-10149 (Oneprovider) It is no longer required to have SPACE_MANAGE_QOS space privilege in order to evaluate QoS expression.
  • VFS-10134 (Oneprovider) Improved statistics initialization error handling.
  • VFS-10129 (Oneprovider, Onezone) Web GUI: Added global and per-lane chart dashboards in automation workflows.
  • VFS-10128 (Oneprovider, Onezone) Web GUI: Added possibility to map a lambda result to many stores in an automation task definition.
  • VFS-10126 (Oneprovider, Onezone) Web GUI: Added Space Marketplace - space configuration, spaces browser and membership requests resolver views.
  • VFS-10125 (Onezone) Added mailing capabilities to Onezone by means of an integrated SMTP client.
  • VFS-10122 (Onezone) Introduced the Space Marketplace. Any space can be publicly advertised in the Marketplace, allowing Onedata users to request access to it. The access requesting process is based on an email exchange with the appointed space maintainer.
  • VFS-10118 (Oneprovider, Onezone) Web GUI: Introduced GUI for automation lambda parameters.
  • VFS-10117 (Onezone) Added lambda config specification and the possibility to provide its values on the task level. Changed data types in automation; added boolean, reworked integer into number with constraints.
  • VFS-10065 (Onezone) Web GUI: Fixed API samples tab in file details modal for archived file.
  • VFS-10046 (Oneprovider, Onezone) Web GUI: Added user details popovers with user information in various views.
  • VFS-10037 (Oneprovider, Onezone) Web GUI: Added "rate" and "timeDerivative" time series chart functions.
  • VFS-9999 (Oneprovider, Onezone) Web GUI: Added space details popovers with space information in various views.
  • VFS-9985 (Oneprovider) Added garbage collector periodically removing old automation workflow executions.
  • VFS-9946 (Oneprovider) Web GUI: Added filename hashes for distinguishing files in audit logs.
  • VFS-9905 (Oneprovider) Web GUI: Showing error reason when transfer progress cannot be loaded.
  • VFS-9902 (Oneprovider) Web GUI: Fixed GUI crash when very long file path is shortened.
  • VFS-9849 (Oneprovider) Changed stopped status of interrupted automation workflow execution with uncorrelated results to failed instead of interrupted.
  • VFS-9846 (Oneprovider) Added automation workflow executions graceful stopping (pausing all running executions) procedure to Oneprovider stopping mechanism.
  • VFS-9843 (Oneprovider) Web GUI: Improved UX of action button in file info views.
  • VFS-9801 (Oneprovider) Web GUI: Added more detailed file counters in transfers view.
  • VFS-9800 (Oneprovider) Web GUI: Fixed missing owner name in file details and added "Owner" column in file browser (on wide screens).
  • VFS-9795 (Oneprovider, Onezone) Web GUI: Fixed user logout from Onezone GUI after remove from cluster members.
  • VFS-9786 (Oneprovider) Web GUI: Improved UX of file info permissions tab by adding hints and disabling modifications when it is not permitted.
  • VFS-9781 (Oneprovider) Web GUI: Storage locations are no longer shown in shared file info.
  • VFS-9723 (Oneprovider) Web GUI: Fixed error message when removing dataset.
  • VFS-9710 (Oneprovider) It is now possible to specify that archive should be deleted after cancelation.
  • VFS-9709 (Oneprovider) Web GUI: Added Open Data tag to items on file list if file is published as Open Data.
  • VFS-9671 (Oneprovider) Improved monitoring of OpenFaaS cluster health for workflow execution purposes.
  • VFS-9655 (Oneprovider) Web GUI: Added presentation of directories data distribution.
  • VFS-9637 (Oneprovider, Onezone) Web GUI: Improved and unified look of audit log browsers.
  • VFS-9626 (Oneprovider) Web GUI: Improved UX of file info tabs.
  • VFS-9622 (Oneclient, Oneprovider, Onezone) Upgraded the base image for release dockers from Ubuntu 18.04 to Ubuntu 20.04.
  • VFS-9614 (Oneprovider, Onezone) Web GUI: Added archivisation audit log view.
  • VFS-9611 (Oneprovider) Web GUI: Added showing current directory statistics above historical data charts.
  • VFS-9606 (Oneprovider) Web GUI: Moved file QoS settings from separate modal to file info panel.
  • VFS-9604 (Oneprovider) Web GUI: Moved file metadata settings from separate modal to file info panel.
  • VFS-9603 (Oneprovider) Web GUI: Moved file shares settings from separate modal to file info panel.
  • VFS-9602 (Oneprovider) Web GUI: Moved file permissions settings from separate modal to file info panel.
  • VFS-9589 (Oneprovider) Extend time series with information about measurements ranges.
  • VFS-9534 (Oneprovider) Added Content-Disposition headers to the file download REST endpoint.
  • VFS-9531 (Oneprovider, Onezone) Web GUI: Improved UX of the automation stores browser.
  • VFS-9513 (Oneprovider) Web GUI: Added file path tooltip to file event in QoS audit log.
  • VFS-9473 (Oneprovider) Web GUI: Moved file distribution settings from separate modal to file info panel.
  • VFS-9471 (Oneprovider) Added endpoint for retrievieng regular file location on storages.
  • VFS-9420 (Oneprovider) Directory statistics and file/directory data distribution is now presented in GUI from the point of view of each supporting provider.
  • VFS-9418 (Oneprovider, Onezone) Added accountingEnabled and dirStatsServiceEnabled settings for space support.
  • VFS-9342 (Oneprovider) Added automation task execution Id annotation to function registered in OpenFaaS service.
  • VFS-9339 (Oneprovider, Onezone) Web GUI: Added a new file info tab with REST API samples.
  • VFS-9337 (Oneprovider) Implemented first version of "filePipe" relay method for automation lambdas, allowing streaming of results via a file located inside the container where the lambda is executed.
  • VFS-9235 (Oneprovider) Web GUI: added an input field in file browser for scrolling the list to a file or directory using its name prefix.
  • VFS-9207 (Oneprovider, Onezone) Web GUI: Enforced loading fonts from server to avoid incorrect local fonts in browser.
  • VFS-9200 (Oneprovider) Changed name generation algorithm for functions registered in OpenFaaS so that they are unique for each task (previously if tasks used the same lambda only one function was registered).
  • VFS-9164 (Oneprovider) Web GUI: Added support for cancelling archive creation.
  • VFS-9162 (Oneprovider, Onezone) Web GUI: Added API samples modal for space.
  • VFS-9129 (Oneprovider, Onezone) Web GUI: Upgraded EmberJS to v3.8.
  • VFS-9122 (Oneprovider) It is now possible to enable directory size and capacity statistics collection. Thanks to this, size of directory and number of files/directories in subdirectories can be viewed as well as how this values change in time.
  • VFS-9120 (Oneclient, Oneprovider) Fixed uid/gid encoding to use unsigned int32 rather than signed int32, so that it now aligns with POSIX uid_t and gid_t types.
  • VFS-9104 (Oneprovider) It is now possible to list extended attributes along with file attributes in REST API.
  • VFS-9083 (Oneprovider, Onezone) Fix typo in NFS storage definition in onepanel REST interface definition.
  • VFS-9054 (Oneclient, Oneprovider) Improved connection closing in Oneclient.
  • VFS-9051 (Oneprovider) Added new files endpoint which allow to list all non-directory files (i.e regular files, symbolic links and hardlinks) in given top directory recursively. Files are listed lexicographically ordered by path.
  • VFS-9036 (Oneprovider, Onezone) Web GUI: Added showing time series charts in executed automation workflows.
  • VFS-9028 (Oneprovider) Web GUI: added archive properties modal with support for changing archive description.
  • VFS-9026 (Oneclient, Oneprovider) Added option
  • VFS-9023 (Oneprovider) Web GUI: added "stop recall" feature and improved presentation of remote provider recall process.
  • VFS-9022 (Oneprovider) It is now possible to cancel ongoing archive recalls.
  • VFS-9021 (Oneprovider) Web GUI: added recall error log view.
  • VFS-9019 (Oneprovider) Added support for automation time series store.
  • VFS-8987 (Oneprovider) Web GUI: Fixed Safari animation glitches.
  • VFS-8951 (Oneprovider) Extended directory children listing REST API - additional parameter 'attribute' can now be provided to specify one or more attributes to be included for each entry Additionally, when there is more entries to be listed, the operation returns a 'nextPageToken' that can be used to list the subsequent page of results.
  • VFS-8948 (Oneprovider, Onezone) Introduced the concept of time series dashboard specs - structured recipes for transforming and displaying measurements in charts, which can be organized into sections. Each time series collection has a linked dashboard spec that will be used for rendering the dashboard in GUI.
  • VFS-8935 (Oneprovider) Allow enabling statistics collecting for not empty spaces.
  • VFS-8914 (Oneprovider) Web GUI: redesigned and extended file datasets panel.
  • VFS-8903 (Oneprovider, Onezone) Web GUI: Upgraded EmberJS to v3.4.
  • VFS-8887 (Oneprovider) Web GUI: fixed showing file information modal in shares.
  • VFS-8872 (Oneclient) Dropped support for Python2 in OnedataFS.
  • VFS-8862 (Oneclient) Update conda package dependencies to conda-forge and Python 3.9.
  • VFS-8845 (Oneprovider) Added QoS transfer statistics collection with their preview in GUI. Each QoS requirement is associated with several time series concerning transferred bytes and files in the context of different storages.
  • VFS-8836 (Oneprovider) It is now possible to cancel ongoing archivisation.
  • VFS-8823 (Oneclient, Oneprovider) Fixed improper destruction of OnedataFS instances, resulting in possible deadlocks during deletion of the OnedataFS object.
  • VFS-8817 (Oneclient, Oneprovider) Added multisupport to NFS helper allowing handling of multiple NFS volumes in parallel via a single NFS helper for data import.
  • VFS-8814 (Oneclient, Oneprovider) Disable NFS direct io in oneclient on conda.
  • VFS-8788 (Oneclient, Oneprovider) Added the possibility to handle multiple mountpoints by a single POSIX helper in read only mode.
  • VFS-8783 (Oneprovider) Web GUI: fixed inability to list files of nested archive.
  • VFS-8739 (Oneprovider) Web GUI: fixed double listing of dataset items when their names have the same prefixes.
  • VFS-8716 (Oneprovider, Onezone) Web GUI: Added complex data types editor to the automation views.
  • VFS-8681 (Onezone) Added a new data type to automation machinery - the array type, with recursive specification of the data type of its elements.
  • VFS-8663 (Oneprovider) Improved symbolic links resolution behaviour - now, the option to resolve symbolic links (e.g. during an archive creation or directory download) only applies to symbolic links pointing to paths outside of the dataset/directory.
  • VFS-8658 (Oneprovider, Onezone) Rename "localceph" storage to "embeded ceph".
  • VFS-8654 (Oneprovider) Web GUI: added support for symbolic links in an archive pointing outside it.
  • VFS-8653 (Oneprovider) Web GUI: added "follow symbolic links" option in create archive options.
  • VFS-8638 (Onezone) All lambdas now work in batch mode - the lambda creator must handle the input with batch arguments and produce an output with batch results. The batch size used during workflow execution is controlled by the parameters maxBatchSize in lane schema definitions and preferredBatchSize in lambda definitions.
  • VFS-8616 (Oneprovider) Added monitoring of statuses of Kubernetes pods that are deployed during workflow execution using the OpenFaaS platform. Monitoring is performed by the k8s-events-monitor component and reported to the scheduling Oneprovider. Added preview of pod status changes in GUI for each workflow task.
  • VFS-8598 (Oneprovider) Web GUI: improved presentation of state of archives being built and deleted.
  • VFS-8523 (Oneprovider) Information about files count and size in directory added.
  • VFS-8518 (Oneprovider) Web GUI: unlocked possibility to create a hardlink for symlink.
  • VFS-8483 (Oneclient, Oneprovider, Onezone, S3Adapter) Added direct NFS v3 storage helper.
  • VFS-8478 (Oneprovider) Preserved archives are now protected from any modifications. Before archive is marked as preserved its content is verified to ensure that no modifications have been made during its creation.
  • VFS-8425 (Oneclient, Oneprovider) Added basic cookie support to HTTP storage helper to support OAuth redirect authorization.
  • VFS-8405 (Oneprovider) Web GUI: fixed QoS modal errors when a hardlink for viewed file with QoS requirements has been deleted.
  • VFS-8404 (Oneprovider) Failed lanes are now retried up to specified max retries (given in schema definition).
  • VFS-8348 (Oneprovider, Onezone) Web GUI: added links to transferred files on transfers view and information about their membership in archive and dataset.
  • VFS-8318 (Oneclient, Oneprovider) Fixed conda packaging for oneclient and onedatafs, switched dependencies to conda-forge channel.
  • VFS-8288 (Oneprovider, Onezone) It is now possible to specify requested resources and resource limits on the lambda and task level for OpenFaaS functions.
  • VFS-8281 (Oneprovider) Improved file upload mechanisms to better handle clients with very slow network connections.
  • VFS-8263 (Onezone) Added blocking modal when user tries to exit editor with unsaved workflow.
  • VFS-8250 (Oneprovider) Exceptions returned from user defined lambda OpenFaaS functions are now properly handled and saved to lane exception store.
  • VFS-8247 (Oneprovider, Onezone) Added new option to harverster's indices that allow for harvesting details about archives (archiveId, archiveDescription and archiveCreationTime).
  • VFS-8242 (Oneclient, Oneprovider) Upgraded Oneclient to use Fuse 3 by default.
  • VFS-8240 (Oneclient, Oneprovider) Applied fixes suggested by new version of clang-tidy static C++ code analyzer.
  • VFS-8237 (Oneclient, Oneprovider) Updated C++ clang-format version to 12.
  • VFS-8225 (Oneprovider) Lanes are now created right before their execution rather than alltogether at the start of workflow execution.
  • VFS-8192 (Oneclient) Fixed block synchronization from remote Oneproviders for open share data sets.
  • VFS-8172 (Oneprovider, Onezone) Add /health endpoints to REST APIs of all services.
  • VFS-8073 (Oneclient, Oneprovider, Onezone) Upgrade folly, wangle and proxygen libraries to version 2021.01.04.00.
  • VFS-8065 (Oneprovider, Onezone) Fixed null device helper setup in GUI, where the simulated filesystem parameters can include as a last component a file size for the simulated files.
  • VFS-8045 (Oneprovider) Web GUI: added QoS audit log view.
  • VFS-8043 (Onezone) Added support for the time series data type in automation models.
  • VFS-8041 (Oneprovider) Added basic log entries to workflow execution and task execution audit logs.
  • VFS-8033 (Oneprovider) Introduced the possibility to pause and resume executions. Refined the phases of workflow execution and granularity of statuses on lane/parallel box/task levels.
  • VFS-8018 (Oneclient, Oneprovider, Onezone) Added HTTP storage driver option to limit on the client side maximum number of requests per single session, after which the session is closed and reconnected.
  • VFS-7982 (Oneclient) Fixed handling of HTTP servers, which do not automatically close the HTTP session connection after reaching max requests per session.
  • VFS-7976 (Oneclient, Oneprovider) Ported oneclient communicator async event stream implementation from asio to folly IOThreadPoolExecutor.
  • VFS-7975 (Oneprovider, Onezone) Added possibility to cancel running automation workflow.
  • VFS-7960 (Oneprovider) Fixed navigating through multiple spaces during files upload in GUI.
  • VFS-7947 (Oneprovider, Onezone) Added possibility to run workflows directly from file browser.
  • VFS-7930 (Oneprovider) Web GUI: improved UX of creating incremental archives using archive context menu.
  • VFS-7904 (Oneprovider) Add system audit log for each workflow execution and each task in the execution, with the possibility to append custom logs during lambda execution (using the result mappers).
  • VFS-7900 (Onezone) Added the possibility to unlink unused lambdas from an automation inventory. Upon unlinking from its last inventory, the lambda is automatically removed.
  • VFS-7898 (Oneprovider, Onezone) Web GUI: added self-shortening links to files with support for files inside archives.
  • VFS-7892 (Oneclient, Oneprovider) Improved write performance on object storages by minimizing the number of memory copying from Erlang to C++.
  • VFS-7880 (Oneprovider, Onezone) Introduce the concept of automation; tools for defining and executing automated workflows, made up of lambdas that are submitted to a local OpenFaaS platform These functionalities currently have experimental status.
  • VFS-7873 (Onezone) Web GUI: Added possibility to dump, upload and duplicate automation lambdas.
  • VFS-7863 (Oneprovider) Web GUI: Fixed file download in iOS Safari.
  • VFS-7856 (Oneprovider) Web GUI: added support for uploading, creating directories and renaming files in files selector.
  • VFS-7846 (Oneprovider, Onezone) Added action "Upload BagIt" to file browser, which is available when OpenFaaS and special "BagIt uploader" workflow are available.
  • VFS-7829 (Onezone) Add the possibility to export workflow schemas to JSON and import them based on the JSON, linking or creating missing lambdas in one shot.
  • VFS-7817 (Oneprovider, Onezone) GUI improvements in automation GUI: added navigation via URL to specific execution, creating stores during task and lane creation, showing inventory name for each execution entry.
  • VFS-7813 (Oneclient) Enable access to files directly via their Onedata file id, by opening or performing any other POSIX operation on a file with a name .__onedata__file_id__<FILEID>.
  • VFS-7808 (Oneprovider) Added support for symbolic links resolution during TAR download. By default all symbolic links are resolved.
  • VFS-7796 (Oneprovider) Added support for navigating through symlinked directories without changing active directory path.
  • VFS-7780 (Oneprovider) Added support for creating incremental archives, which results in storing only files that have changed in comparison to the base archive while unchanged files are preserved as hard links to the corresponding files in the base archive.
  • VFS-7779 (Oneprovider) Added REST API for CRUD operations on file using relative paths.
  • VFS-7747 (Oneclient, Oneprovider, Onezone) Upgrade the codebase to Erlang OTP 24.
  • VFS-7738 (Oneprovider, Onezone) Fixed issues with navigation between datasets, archives and archive files browsers.
  • VFS-7736 (Oneclient, Oneprovider) Fixed latency and timeout simulation in nulldevice storage helper.
  • VFS-7733 (Oneclient) Added block_aligned flag to onebench storage benchmarking tool, enforcing read and writes aligned to block_size boundary only.
  • VFS-7728 (Oneprovider, Onezone) Introduced versioning of lambdas and workflow schemas. Users may create subsequent revisions of the above models and modify their statuses (draft, stable, deprecated) to simplify management and retain backward compatibility of definitions that are already in use.
  • VFS-7724 (Oneprovider, Onezone) Web GUI: redesigned datasets and archives browser to browse datasets tree and archives in single splitted view.
  • VFS-7715 (Onezone) Web GUI: Added store references check to automation workflow editor.
  • VFS-7705 (Oneprovider, Onezone) Added more file actions to archive file browser GUI: share, metadata, permissions read, data distribution and quality of service.
  • VFS-7702 (Oneprovider) Add basic REST API for scheduling and retrieving workflow executions.
  • VFS-7692 (Oneprovider) Added stopped automation workflow execution discard functionality.
  • VFS-7664 (Oneprovider) It is now possible to configure symbolic links policy when creating an archive. By default symbolic links in dataset are resolved resulting in link target being archived.
  • VFS-7663 (Oneprovider, Onezone) Changed background image of sign-in page in Onezone and Onepanel.
  • VFS-7653 (Oneprovider) Added support for creating Dissemination Information Package (DIP) alongside with Archival Information Package (AIP).
  • VFS-7651 (Oneprovider) Implement dataset archivization with BagIt layout.
  • VFS-7649 (Oneprovider) Added support for purging archives in GUI.
  • VFS-7648 (Oneprovider, Onezone) Added Web GUI views for browsing and creating datasets and archives.
  • VFS-7633 (Oneprovider, Onezone) UX improvements in web GUI concerning navigation between files, datasets and archives using hyperlinks.
  • VFS-7631 (Oneprovider) Web GUI: added presentation of source file path in dataset browser.
  • VFS-7629 (Oneprovider, Onezone) Web GUI: added new datasets panel with archives browser in file browser.
  • VFS-7617 (Oneprovider) Implemented archive recall functionality, used to copy the archive contents to a specified destination within the space scope.
  • VFS-7592 (Oneprovider) Added support for the Range header during directory or multi file (bulk) downloads, making it possible to resume them in case of interruption or network failure.
  • VFS-7589 (Oneclient, Oneprovider, Onezone) Added StorageRouter and BufferedStorage helpers to handling of aggregate storages such as archive storage.
  • VFS-7575 (Oneprovider, Onezone) Add the possibility to incorporate an XRootD server within the Onedata environment for exposing Open Data collections for public access using the XRootD protocol.
  • VFS-7515 (Onezone) Added new harvesting options - fileType and datasetInfo.
  • VFS-7512 (Oneprovider) Web GUI: redesigned file tags with information about inherited QoS and datasets properties.
  • VFS-7510 (Oneprovider, Onezone) Add API for browsing dataset structures, separately for datasets in attached and detached state The datasets can be listed using batches of requested size, with desired starting point and offset.
  • VFS-7509 (Oneclient) Added support for absolute symlinks relative to Oneclient mountpoint, i.e. always pointing to the same file in a space, regardless of actual Oneclient mountpoint path.
  • VFS-7486 (Oneclient, Oneprovider) Added option to nulldevice helper allowing control of file size returned by getattr in simulated file systems.
  • VFS-7429 (Oneprovider, Onezone) Implemented the concept of datasets. Datasets allow the space users to organize their data into collections with desired granularity. A file or directory marked as a dataset offers additional features, such as optional data and metadata protection or the ability to create persistent snapshots of the physical dataset contents. In case of a directory, a dataset covers all its subdirectories and files. Datasets can be nested, allowing users to compose arbitrary hierarchical structures. Added corresponding views for managing datasets and write protection flags in file browser Web GUI and a REST API, accessible under /datasets, /datasets/{DatasetId} and /data/{FileId}/dataset/summary paths.
  • VFS-7428 (Oneprovider) Added support for hard links and symlinks. Added corresponding REST api specific for hard and symbolic links, accessible under /data/{FileId}/hardlinks and /data/{FileId}/symlink_value paths.
  • VFS-7397 (Oneclient) Added new option to oneclient --show-space-ids which allows to list spaces using their space Id's instead of names in the top level oneclient mount directory.
  • VFS-7378 (Oneprovider) Removed deprecated Oneprovider REST API. The modern API, available since versions 20.02.*, operates on file IDs rather than paths. A special endpoint for resolving file IDs based on paths is available.
  • VFS-7360 (Oneclient) Added support for hardlinks and symlinks through Oneclient POSIX interface.
  • VFS-7358 (Oneclient) Added support for accessing open data shares in oneclient with --open-shares-mode option.
  • VFS-7351 (Oneprovider) It is now possible to download directories and multiple files via gui as a compressed TAR archive.
  • VFS-7329 (Oneprovider, Onezone) Added automation GUI - inventories, lambdas and workflows views in Onezone and workflows execution overview in Oneprovider.
  • VFS-7305 (Oneprovider) Basic support for hard links and symbolic links on the filesystem level, interaction with high-level mechanisms such as data transfers, storage import or QoS is still to be refined.
  • VFS-7304 (Oneprovider, Onezone) Add preliminary REST API for dataset archivization - to be extended in near future.
  • VFS-7228 (Onezone) Improve the design and UX of the token consumer page in Onezone GUI .