Onedata Documentation

Guides, API references, and examples for building with Onedata.

Introduction User Guide Admin Guide Glossary Releases

Release 20.02.1

Release Assets

Release Highlights

  • New major release — version 20.02.1 introduces the 20.02 line of Onedata.

Full Changelog

  • VFS-4760 Added implicit API caveats that limit access tokens used by Onedata GUIs behind the scenes for authentication and authorization. Different services in the system are presented with user's access token with power limited to bare minimum required for the service to handle user requests. For example, Oneproviders do not have access to APIs that could alter or delete user data and memberships.
  • VFS-5648 Extended QoS expression to allow comparators (<, >, <=, >=) and numeric values. Changed "-" operator to "\" Space characters (" "), dashes ("-") and underscores ("_") are now allowed in QoS parameters. Added more details to invalid QoS expression errors.
  • VFS-5698 Added Ceph: directories to persistence, shutdown to entrypoint script, installation to Dockerfile.
  • VFS-5714 Added custom conda build options make arguments, onedatafs_jupyter_conda rule, fs.onedatafs conda rule, oneclient conda rules.
  • VFS-5742 Disabled: http_proxy for normal operation, yum mirrors for package tests, yum proxy for package tests; enabled: proxy cache for package tests, proxy cache for docker builds.
  • VFS-5838 entrypoint: Accept any 2xx and 3xx HTTP codes as success.
  • VFS-5841 entrypoint: Use PyYAML's safe loader to silence a warning; parse deployment error using new onepanel errors format.
  • VFS-6095 Mask private file attributes, such as uid or gid, when showing file attrs in share mode.
  • VFS-6131 Account for changes in emergency passphrase api changes.
  • VFS-6160 Reorganized Local User Mapping (LUMA) management Introduced feeds for populating LUMA DB.
  • VFS-6167 Allow nodes adding and deleting in-fly basing on HA sub-system.
  • VFS-6184 Added the space owner concept. Space owner works like "root" within the space - such user is allowed to perform all file/API operations, regardless of the assigned privileges and file permissions / ACLs. Ownership can be assigned to any number of users, and it is forbidden to leave a space without an owner - ownership must be transferred first.
  • VFS-6225 Added new triggers field to changes stream specification allowing to send events only on specified docs types changes.
  • VFS-6261 Integrate high-level services with HA sub-system.
  • VFS-6263 New experimental Quality of Service functionality. It is used to manage file replica distribution and redundancy between supporting Oneproviders. Users can define any number of QoS requirements for a file or directory. Each requirement consists of target replicas number and an expression that is used to select storages where the replicas should be placed ‐ it is matched against parameters that were assigned to storages by Oneprovider admins.
  • VFS-6287 Integrate traverse pools with HA sub-system.
  • VFS-6288 Basic HA functionality (experimental) - protect Oneprovider from single node failure.
  • VFS-6316 Added statfs support enabling preview of available storage in each space through oneclient, for instance using df or stat utilities.
  • VFS-6320 Old /spaces/{sid}/indexes, /spaces/{sid}/indexes/{index_name}, /spaces/{sid}/indexes/{index_name}/reduce and /spaces/{sid}/indexes/{index_name}/query endpoints were deprecated and will be removed in next major release.
  • VFS-6343 Added delete account feature in GUI.
  • VFS-6344 GUI: showing information if QoS requirement is impossible to be fulfilled.
  • VFS-6346 GUI improvements: added Oneprovider GUI notifications, better file selection, additional error handling, better file manager refresh UX, fixed overflow of context menu in file browser, fixes in responsive layout.
  • VFS-6356 Fixed an error with caching of file location map in Oneclient, which resulted in data access errors in case of invalidation of replicas on Oneprovider.
  • VFS-6358 Optimization of files upload through GUI.
  • VFS-6359 Fixed an issue with accessing files in spaces which are not supported by the Oneprovider instance to which Oneclient is currently connected.
  • VFS-6361 Added new REST api for creating transfers and viewing file distribution, accessible respectively under /transfers and /data/{fileId}/distribution paths. Old /replicas, /replicas-id and /replicas-view endpoints were deprecated and will be removed in next major release.
  • VFS-6370 Create secure fold mechanism on model documents.
  • VFS-6378 Onepanel GUI and REST API now explicitly block supporting a space with more than one imported storage (globally) - such operation was possible in the past but was never supported by the internal storage import logic and led to incoherent view on space data.
  • VFS-6421 New generic GUI plugin for harvesters.
  • VFS-6431 Added performance logs for object storages, which can generate CSV file containing all storage requests including their duration.
  • VFS-6450 Added file name and space id to harvested file metadata.
  • VFS-6453 New Open Data and share description views with visual Dublin Core editor and Markdown editor.
  • VFS-6455 Support for jumping to selected files in GUI, even if they are not visible on infinite-scroll list.
  • VFS-6456 Do not allow the user to perform actions in the GUI related to transfers without the appropriate permissions.
  • VFS-6457 Added new publicly visible field to shares - description (supports the markdown format).
  • VFS-6474 Added initial support for XRootD storage, including direct access to XRootD storages and importing of legacy data sets stored on XRootD or EOS servers.
  • VFS-6494 Introduced REST API for registering files.
  • VFS-6504 Added HTTP storage helper allowing registration of HTTP and HTTPS servers as storage sources for Onedata Spaces.
  • VFS-6535 Updated S3 SDK library to 1.8.7.
  • VFS-6547 Fixed switching between spaces in file browser GUI during upload.
  • VFS-6568 Introduced concept of readonly storage. If enabled, Oneprovider will block any operation that writes, modifies or deletes data on the storage. Such storage can only be used to import data into the space. Mandatory to ensure proper behaviour if the backend storage is actually configured as readonly.
  • VFS-6577 Improve data transfer performance to object storages (e.g. S3) by aligning transferred block size to the object size on target storage, thus minimizing the overhead necessary when updating a file object with partial content.
  • VFS-6580 Fixed bug that could block dbsync on-demand streams on multi-node deployments.
  • VFS-6628 Extended harvesting configuration - it is now possible to select harvesting options, like metadata types to harvest or additional file details (fileName, spaceId), upon index creation New metadata types are now harvestable - xattrs and rdf. Default values of HarvestingBackendType and HarvestingBackendEndpoint can now be set by Onezone admin - if set, these values can be omitted when creating a new harvester. New option (retry_on_rejection) allowing for all payloads rejected by the harvesting backend to be automatically analysed for offending data (e.g. fields that do not match the schema), pruned and submitted again.
  • VFS-6645 Optimize changes querrying.
  • VFS-6668 Fix bug resulting in timeouts of workers after 30s.