CellStore release notes

This page is a placeholder, its contents are being worked on.

Estimated reading time: 33 minutes

This document describes the latest changes, additions, known issues, and fixes for CellStore.

This changelog was created for the following Product:

   
Product CellStore
Version v0.9.12-SNAPSHOT
Stage latest-master

v0.9.11 (2023-08-19)

Major Improvements

  • Full conformance added for XBRL specifications “Open Information Model 1.0” - including XBRL-Json, XBRL-CSV and XBRL-XML (Feature request #658)
  • Full conformance added for XBRL specification “Units Registry - Structure 1.0” (Feature request #668)
  • Full conformance added for XBRL specification “XII Transformation Registry 5” (Feature requests #660)

v0.9.10 (2022-07-15)

Important Notes

  • This release contains breaking changes:
  • The parameter select has been renamed to parameter include (Feature request #625)

Major Improvements

  • Full conformance added for XBRL specification “Taxonomy Packages 1.0” (Feature request #616)
  • Full conformance added for XBRL specification “Formula 1.0” (Feature request #660)
  • Full conformance added for XBRL specification “Transformation Registry 5” (Feature request #660)
  • Full conformance added for XBRL specification “Extensible Enumerations versions 1 and 2” (Feature request #660)

Bug Fixes

  • Fixing Error “Error Items for collection contexts are required to have at least the following key aspects …” which is related to the import of iXBRL filings where setting PERSIST_CONTEXT_ITEMS is true (Bug #628)
  • Fix Log4j vulnerabilities (CVE-2021-45105, CVE-2021-45046, CVE-2021-44832, CVE-2021-44832, CVE-2021-44228, CVE-2021-42550, CVE-2021-42392, CVE-2021-4104, CVE-2021-36090, CVE-2021-35516, CVE-2021-35515, CVE-2021-23463) (Bug #638)
  • Update admin-suite UI endpoints - was failing due to an improperly named query parameter (select -> include) (Bug #637)
  • Some elements were not imported from an XML Schema (Bug #646)

New Features

  • Facts now contain aspect rptx:factType with value as-reported in case the fact is parsed from an instance (Feature request #625)
  • Add parameter plugin to endpoint archives (DELETE) (Feature request #625)
  • Taxonomy Packages can now be dropped into the cache directory and will be found by internal resolution (Feature request #616)

v0.9.9 (2021-08-04)

Important Notes

  • This release contains breaking changes:
  • The format of the factMatch attribute has changed for iXBRL template rendering. Additionally, the previously used namespace http://reportix.com/ext is no longer supported in the template files (use namespace http://reportix.com/2021-07-21/ixbrl/template instead).
  • The key of the labels collection has changed to xbrl:dts, xbrl:linkbase, and xbrl:id. This change requires a database migration (Feature request #619)

Bug Fixes

  • On every item update of any collection the key of the inserted or updated item is checked for the minimal required key to prevent invalid items to be inserted (Bug #624)
  • Fix error “Items for collection contexts are required to have at least the following key aspects” when parsing iXBRL filings (Bug #628)
  • Fix error “Multiple archives were found for Id ‘null’.” when copying an instance (Bug #629)
  • Fix error “Couldn’t insert item (xxx) into ‘facts’, because an item in the same cell already exists.” when copying an instance (Bug #630)

New Features

  • Add new endpoint cellstore/v1/facts/render/ixbrl for rendering Inline XBRL from one or multiple iXBRL template files (Feature request #619)
  • Add feature to analyze Inline XBRL rendering with parameter analyze=true (Feature request #619)
  • Add feature to override all explicit values from the Inline XBRL template whilst rendering with forceKeepContent=true (Feature request #619)
  • Add new Inline XBRL template format supported for the rendering endpoint:
    • The extension prefix (as suggested) is now ixtp and the namespace for extension attributes is http://reportix.com/2021-07-21/ixbrl/template
    • The format of the ixtp:factMatch attribute is now similar (not equal) to CSS and no longer similar to URL query, e.g. xbrl:concept=us-gaap:Assets; xbrl:period=2021-12-31; (note the = instead of the : used in CSS)

v0.9.8 (2021-07-16)

Important Notes

  • This release contains breaking changes:
  • All import endpoints require paramters to be prefixed with parameter:: (Feature #619)
  • The key of the footnotes collection has changed to xbrl:instance, and xbrl:id. This change requires a database migration (Bug #622)

v0.9.7 (2021-06-02)

Important Notes

  • This release contains breaking changes:
  • All DELETE method requests to all endpoints now return a response with status code 200 instead of 204 with no response (Feature #607)

Major Improvements

  • Full conformance has been achieved and has been certified according to XBRL specification “Table Linkbase 1.0” (Feature requests #581)
  • Full conformance has been achieved and has been certified according to XBRL specification “Inline XBRL 1.1” (Feature requests #608)
  • Full conformance has been achieved and has been certified according to XBRL specifications “XII Transformation Registry 3” and “XII Transformation Registry 4” (Feature requests #613)

Bug Fixes

  • Fix data migration to latest data model version bug ‘Unable to initialize main class com.reportix.cellstore.cli.CellstoreCLI’ (Bug #598)
  • Fix removing false port 80 from some links in response when scheme is https (Bug #597)

New Features

  • Add boolean configuration parameters PERSIST_TABLE_DATAPOINTS and PERSIST_PRESENTATION_DATAPOINTS to make persisting of data points configurable (Feature request #601)
  • Add boolean configuration parameters IXBRL_TARGET_INSTANCE_BY_SOURCE_DOCUMENT to allow to import (non-conformant to the specification) one target instance per input iXBRL file (Feature request #613)
  • Add plugins rptx.addFactsCountForTables and rptx.addFactsCountForPresentations to add fact count per table to instance items (Feature request #602)
  • Add boolean configuration parameter DERIVE_TABLE_DEFINITIONS_FROM_PRESENTATIONS to make deriving table definitions from presentation optional (Feature request #603)
  • Add boolean configuration parameter PERSIST_CONTEXT_ITEMS to make persisting contexts optional (Feature request #604)
  • Add aspect rptx:dimensionsCount to each fact to indicate the number of XBRL dimensions characterizing the fact (Feature request #595)
  • Add aspect rptx:factsCount to instance items when importing (Feature request #553)

Improvements

  • Migrate docker container hosting to registry.reportix.com (Enhancement #599)
  • The endpoint /cellstore/v1/instances/import has been deprecated. Instead endpoint /cellstore/v1/archives/import should be used (Enhancement #601).
  • Upgrade api documentation from Swagger 2.0 to Open API 3 (Feature #607)

v0.9.6 (2021-02-26)

Important Notes

  • This release contains breaking changes:
    • Deprecated endpoints /cellstore/v1/import/instances and /cellstore/v1/import/dts have been removed. Use endpoints /cellstore/v1/instances/import and /cellstore/v1/dts/import instead (Enhancement #495)
    • By default no rptx:hash will automatically get added to each item. To reenable this behavior add setting ADD_HASH_TO_ITEMS=true to the reportix.properties (Feature request #543)
    • The proprietary indexing for MongoDB has been rebuilt due to size limitations. This requires a migration of existing databases. (Feature request #557)

Bug Fixes

  • Fix race condition in case the same dts is loaded in two parallel processes (Bug #510)
  • Fix error options not initialized when passing an unsupported parameter to /cellstore/v1/instances (DELETE) (Bug #519)
  • Fix not returning Error 404 when items are deleted which don’t exist (Bug #519)
  • Fix applying calculation validations even when DTS is not imported, but loaded from DB (Bug #519)
  • Fix handling of compound hypercubes, i.e. hypercubes consisting of several cubes (Bug #521)
  • Fix detection of disabled datapoints (Bug #521)
  • Fix datapoints for open tables (Bug #521)
  • Fix including link to dimension labels in facts if fact does not contain any dimensions (Bug #530)
  • Fix error message NumberFormatException '' is not a decimal happening on iXBRL documents with scale="0" (Bug #533)
  • Add missing DTS filter (Parameter: xbrl:dts) to member and dimensions label links in facts (Bug #544)
  • Fix race condition when inserting several items into the same MongoDB physical group index (Bug #548)
  • Fix empty labels in labels field when skip parameter is used (Bug #551)
  • Fix bug Aspect 'xbrl:elementName' does not contain an atomic value for entities endpoint (Bug #572)
  • Fix bug ‘NullPointerException in open table rendering / export to excel’ (Bug #564)
  • Fix bug ‘Invalid cell range, having lastRow < firstRow   lastCol < firstCol, had rows 3 >= 3 or cells 0 >= 1’ when exporting to excel (Bug #565)
  • Fix bug for missing xbrl:dts aspects for iXBRL instances (Bug #579)

New Features

  • Add parameter groupBy to allow grouping of several facts by an arbitrary number of dimensions into one grouped facts (Feature request #506)
  • Add parameter keepDiscreteAccumulatedValues to allow keeping all discrete distinct values of dimensions when grouping facts (Feature request #506)
  • Add parameter function to apply functions such as sum, avg, or count to any dimension, e.g. in grouped facts (Feature request #506)
  • Add configuration parameter ALIGN_PREFIXES_TO_LOWER_CASE which allows to autoheal mismatching use of cases for prefixes (Feature request #510)
  • Add ability to update aspects of all items of an instance with a single PATCH request to the /cellstore/v1/instances endpoint (Feature request #508)
  • Add support for Inline XBRL 1.1 (Feature request #507)
  • Add server release information to error responses (Feature request #514)
  • Add rest endpoint /cellstore/v1/tables/openDimensionValues to query (GET) values for open dimension groups from open tables (Feature request #513).
  • Add parameter xbrlFormulaValidation to endpoint /cellstore/v1/instances/import to allow formula validation when importing an instance (Feature request #516)
  • Add rest endpoint /cellstore/v1/archives to query or search (GET), create (POST), replace (PUT), and delete (DELETE) archives metadata (Feature request #543).
  • Add rest endpoint /cellstore/v1/archives/import to allow better support for (zip) archive imports with multiple reports inside (Feature request #543).
  • Add rest endpoint /cellstore/v1/entities to query or search (GET), create (POST), replace (PUT), and delete (DELETE) entities metadata (Feature request #539).
  • Add rest endpoint /cellstore/v1/formulas to query (GET) formula metadata (Feature request #516).
  • Add rest endpoint /cellstore/v1/instances/validations to query (GET), and delete (DELETE) instances validations (Feature request #514).
  • Add rest endpoint /cellstore/v1/system/cache to query (GET) files from the cache (Feature request #516).
  • Add parameter highlight to each endpoint supporting search. It supports highlighting of matched text phrases when using Elasticsearch setups (Feature request #539)
  • Add dpm:directive, dpm:filingIndicatorCode, dpm:columnRCCode, dpm:rowRCCode to facts in table layouts when plugin dpm.eurofiling is applied (Feature request #521)
  • Add ability to store custom data with every item for plugins (Feature request #521)
  • Add ability to use several taxonomy package versions inside the cache path on endpoint /cellstore/v1/instances/import (use parameter cachePath to alter the cache path)
  • Add links to labelsDimensions and labelsMembers to facts and make them expandable (Feature request #511)
  • Add selectable field labels to endpoints returning facts (Feature request #526):
    • /cellstore/v1/facts
    • /cellstore/v1/presentations/tables/facts
    • /cellstore/v1/tables/facts
    • /cellstore/v1/tables/openDimensionValues
  • In case an instance contains facts with cell conflicts, i.e. several facts in the same cell with dimensional equality, all facts are imported as different versions nevertheless (Feature request #535)
  • Add number of facts per table / presentation section:<section-name> to instance items (Feature request #547)
  • Add optional full-text search capability through Elasticsearch connector (Feature request #536)
  • Add parameter search to footnotes endpoint to enable searching footnotes by full-text (Feature request #536)
  • Add model:framework, model:taxonomy, and model:module to each dts, instance, and fact when plugin dpm.eurofiling is applied (Feature request #537)
  • Add plugins rptx.addAspects.* to add arbitrary aspects to any item on import (Feature request #555)
  • Add plugins efg.addFactFiscalInfo to add fiscal year and period information to each fact (Feature request #559)
  • Add configuration property CREATE_ENTITY_IF_NOT_EXISTENT to allow turning off auto-creation of entities (Feature request #560)
  • Allow multiple member values in key dimensions, e.g. multiple xbrl:entity ids such as LEI and EDInet code for a single entity (Feature request #569)
  • Add aspect rptx:isHTML with true to each fact that contains html as text value (Feature request #571)
  • Well-known namespaces can now be configured in the reportix.json file to give more control over the prefix normalization (Feature request #558)
  • The use of well-known namespaces can now be forced (REQUIRE_ALL_NAMESPACES_TO_BE_KNOWN=true) to a degree that any import will fail if a namespace is found that is not defined in the reportix.json (Feature request #558)
  • Add support for interval arithmetics in calculations (Feature request #568)
  • Optimize entities search performance, add fuzziness and partial string matches (Feature request #583)

Improvements

  • Improve error message in case of a cell conflict - now including the conflicting cells (Feature request #510)
  • All fact textual values and label values are now normalized according to the Normalization Form Canonical Composition (NFC) (Bug #498)
  • Elements and labels are added for XBRL core dimensions: xbrl:concept, xbrl:period, xbrl:entity, xbrl:unit, xml:lang, iso2:lang, xbrl:decimals, and xbrl:instance (Feature request #518)
  • Performance optimization in prefix normalization (Feature request #23)
  • Upgrade to new admin UI (Feature request #570)
  • Plugin xbrl.calculations has been removed as this functionality is now a core feature.

v0.9.5 (2020-03-20)

Major Improvements

  • Full conformance has been achieved according to Extensible Business Reporting Language (XBRL) 2.1 and XBRL Dimensions 1.0 specification (Feature requests #476, # 537, #540, #545, and #567)

Bug Fixes

  • Fixed file resolution issue for zip archives having file references with ‘..’ on linux (Feature request #476)
  • Fixed error Aspect 'xxx' does not contain an atomic value. (Bug #541)
  • Fixed json schema for updating facts that have decimal values for aspects.
  • Fixed exception thrown when xbrl:dts dimension contains multiple values.

Improvements

  • Allow more sophisticated dimensional validation for instance (Feature request #476)
  • Added parameter factDimensionalValidation to allow enabling/disabling dimensional validation of primary items when importing an instance (Feature request #476)
  • Enabled XBRL conformance test suite ‘XBRL Dimensions 1.0’ (Feature request #537)
  • Enabled XBRL conformance tests 201 to 293 of the core ‘Extensible Business Reporting Language (XBRL) 2.1’ (Feature request #559)
  • Enabled XBRL conformance tests 301 to 314 of the core ‘Extensible Business Reporting Language (XBRL) 2.1’ (Feature request #540)
  • Enabled XBRL conformance tests 320 to 398 of the core ‘Extensible Business Reporting Language (XBRL) 2.1’ (Feature request #545)
  • Enabled XBRL conformance tests 102 to 161, 400, 401, and misc tests of the core ‘Extensible Business Reporting Language (XBRL) 2.1’ (Feature request #567)

New Features

  • Several new endpoints have been added (Feature request #511):
    • /cellstore/v1/presentations/tables/definition: Rest endpoint to query (GET) presentation networks as ‘table’ definitions from the CellStore.
    • /cellstore/v1/presentations/tables/datapoints: Rest endpoint to query (GET) datapoints from presentation networks.
    • /cellstore/v1/presentations/tables/facts: Rest endpoint to query (GET) facts matching presentation networks from the CellStore.
    • /cellstore/v1/presentations/tables/hypercube: Rest endpoint to query (GET) hypercubes implied by presentation networks.
    • /cellstore/v1/presentations/tables/presentations/tables/layout: Rest endpoint to query (GET) render presentation networks to table layouts.
    • /cellstore/v1/presentations/tables/presentations/tables/structural: Rest endpoint to query (GET) table structurals for presentation networks.
    • /cellstore/v1/tables/facts: Rest endpoint to query (GET) facts matching table definitions from the CellStore.
  • Added endpoint to export to XBRL:
    • /cellstore/v1/instances/export: Rest endpoint to export (GET) instances to XBRL (Feature request #511).
  • Added parameter format to allow rendering different variants of table layouts (json and excel) (Feature request #511).
  • Added parameter xmlSchemaValidation to endpoint /cellstore/v1/instances/import to allow disabling XML Schema validation (Feature request #540)
  • Added parameter xmlSchemaValidation to endpoint /cellstore/v1/dts/import to allow disabling XML Schema validation (Feature request #567)
  • Added parameter xbrlConformanceValidation to endpoint /cellstore/v1/instances/import to allow disabling XBRL conformance validation (Feature request #540)
  • Added parameter xbrlCalculationValidation to endpoint /cellstore/v1/instances/import to allow disabling XBRL calculation validations (Feature request #559)

v0.9.4 (2019-11-28)

Improvements

  • Improve memory consumption for copying instances (Feature request #387)
  • Create and publish cachePacks.json to being able to automatically publish AMI with latest cachePacks (Enhancement #504)
  • AMI uses the latest cache packs from cachePacks.json (Enhancement #504)
  • Automatically add text indices to facts and labels collections (Enhancement #519)
  • Add additional field “_lang” to collections to act as a language override field. (Enhancement #519)
  • Filter the possible values of the “_lang” field to only accept languages supported by mongo, otherwise insert “none” (Enhancement #519)
  • Switch all CircleCI variables to GitLabCI equivalents (Bug #517)
  • Add pre-release stage to CI so that the test-publish and publish jobs are never run together, as that is entirely redundant (Optimization #515)
  • Changed released ami name to include proper release version (Bug #516)
  • Built AMIs in us-east-1 instead of eu-west-1 so that they can more easily be released to the marketplace

v0.9.3 (2019-08-29)

New Features

  • Add support for headers Forwarded, X-Forwarded-Proto, X-Forwarded-Host, X-Forwarded-Port (Feature request #489)
  • Add expandable labels and links to presentation, definition, and calculation items (Feature request #494)
  • Add generic role labels (Feature request #494)
  • Add generic message 1.0 (Feature request #494)

Improvements

  • Improve endpoint API documentation with better titles (Feature request #494)

v0.9.2 (2019-08-16)

Bug Fixes

  • Fixed error Parameter '_' not allowed for endpoint. which occurs when caching is turned off in some HTTP client libraries. This parameter is now allowed, but ignored, on all endpoints for GET requests. (Bug #484)
  • Fixed ClassCastException in esef.wider-narrower plugin when reimporting an ESEF instance. (Bug #484)
  • Fixed error Cannot create HypercubeSpec: Member '-3' (Dimension: 'xbrl:decimals') has an unsupported type when updating a fact (Bug #484)

New Features

  • Add support for core DTS imports and auto-inheritance of DTS items for importing DTS to reduce redundancy and increase query performance (Feature request #469)
  • Implemented support for specification Including XBRL Reports in Taxonomy Packages 1.0 (Feature request #484)

v0.9.1 (2019-07-15)

Important Notes

  • Support for MarkLogic 8 is going into sun-down phase. MarkLogic 8 will no longer be supported from version 0.9.2.

Improvements

  • Performance optimizations have been implemented for the MarkLogic connector (Enhancement #448)

Bug Fixes

  • Fixed CellStore bug: NullPointerException in table layout (Bug #426)
  • Fixed CellStore bug: loading Edinet filings with CJK date (Bug #432)
  • Fixed CellStore bug: respect uri rewrite from catalog.xml (Feature #443)

New Features

  • Add EverContract server to expose validation API; exposed new endpoint for directly accessing files from the Cache (Feature request #397):
    • /evercontract/v1/system/cache: Rest Endpoint to retrieve (GET) file from Cache with parameter url.
  • Plugin dpm.eurofiling now adds all filed tables according to the filingIndicator to the instance items (Feature Request #420)
  • Add aspect xml:lang to table layouts (Feature request #424)
  • Add more aspects to each imported fact: xbrl:conceptName, xbrl:contextRef, xbrl:unitRef, xbrl:url (Feature request #427)
  • Add new endpoint for Datapoints (Feature request #441):
    • /cellstore/v1/tables/datapoints: Rest Endpoint to query (GET) table datapoint metadata.
  • Add plugin esef.wider-narrower to support wider-narrower arcrole (Feature request #443)
  • Add parameter search to the labels and facts endpoints to enable full-text search (Feature request #392)

v0.9.0 (2019-04-20)

Bug Fixes

  • Fixed NullPointerException when loading SEC Risk/Return filings (Bug #394)
  • Fixed race condition when several filings with the same DTS are imported at the same time

v0.8.19 (2019-03-29)

Bug Fixes

  • Fixed error when importing instances with nil values for typed dimensions (Bug #378)

New Features

  • Add commandline flags to run tests against custom server url and port (Feature request #368)
  • Add endpoints for table layout rendering (Feature request #355):
    • /cellstore/v1/tables/hypercube: Rest Endpoint to query (GET) implicit table hypercubes.
    • /cellstore/v1/tables/layout: Rest Endpoint to query (POST) renderings for particular tables.

v0.8.18 (2019-02-02)

Bug Fixes

  • Fixed Error “Couldn’t get member type from element defining type of domain ref : ‘…’” (Bug #361)

New Features

  • [Advanced Feature] Added new config parameters to change the default system prefixes used (Feature Request #356):
    • DATA_PREFIX_DIMENSION_D3: default prefix for D3 related aspects is d3
    • DATA_PREFIX_DIMENSION_PROVENANCE: default prefix for provenance related aspects is prov
    • DATA_PREFIX_DIMENSION_RPTX: default prefix for Reportix internal aspects is rptx
    • DATA_PREFIX_DIMENSION_TABLE: default prefix for table related aspects is table
    • DATA_PREFIX_DIMENSION_XBRL: default prefix for XBRL related aspects is xbrl
    • DATA_PREFIX_DIMENSION_XBRLDT: default prefix for XBRL dimensions related aspects is xbrldt
    • DATA_PREFIX_DIMENSION_XLINK: default prefix for XLink related aspects is xlink
    • DATA_PREFIX_DIMENSION_XML: default prefix for XML related aspects is xml
    • DATA_PREFIX_DIMENSION_XS: default prefix for XML Schema related aspects is xs
    • DATA_PREFIX_DIMENSION_XSI: default prefix for XML Schema instances related aspects is xsi

v0.8.17 (2018-10-31)

New Features

  • First alpha release of the structural table resolution and addition of the following endpoints (Feature Request #267):
    • /cellstore/v1/tables/hypercube: Rest Endpoint to query (GET) metadata of implied table hypercubes.
    • /cellstore/v1/tables/structural: Rest Endpoint to query (GET) resolved structural table metadata.
  • Added config parameter MARKLOGIC_DIRECTORIES_URI_PREFIX to prefix directories created in MarkLogic (Feature Request #341)

v0.8.16 (2018-08-09)

Breaking changes

  • For labels the xbrl:value is now part of the key to prevent duplicate label definitions

Bug Fixes

  • Fixed importing only a single label if multiple identical labels exist in the XBRL instance (Bug #282)
  • Admin UI: Fixed bug: Internet Explorer covers checkbox area (UI Bug #81)
  • Escrow packaging: Fixed broken packaging and added regression test (Bug #318)

New Features

  • Added new parameter storage to endpoints instances/import and dts/import to enable validation without persistence (storage=false) (Feature Request #302)
  • Admin UI: Expose fact validation checkbox to be able to explicitly disable fact validation when importing an instance (UI Feature Request #85)

v0.8.15 (2018-07-25)

Bug Fixes

  • Fix validation issue with dateTime items: cvc-datatype-valid.1.2.1: '2018-06-29' is not a valid value for 'dateTime'. (Bug #298)

New Features

  • Added parameter factValueValidation to allow turning off fact value validations on endpoint instances/import (Feature request #289)

v0.8.14 (2018-07-18)

Bug Fixes

  • Fix error “Couldn’t validate instance with id ‘xxx’ because the DTS does not exist in the store” when importing with importDts=false and no dts in store (Bug #285)

v0.8.13 (2018-07-11)

Bug Fixes

  • Fixed adding of several networks (presentation, definition, calculation) does not throw an error if a linkRole is used that already exists in the store for the same linkbaseType (Bug #257)
  • Fixed race condition in license date parsing (Bug #262)
  • Fixed conflict when providing an instanceId whilst importing an archive that contains several instances (Bug #268)
  • Fixed nonnum:textBlockItemType validation to allow simpleContent (Bug #275)
  • Fixed handling of manifest.xml files when multiple instance definitions are present (Bug #276)

New Features

  • Added plugin for xbrl calculation validations (Plugin Id: xbrl.calculations) (Feature request #252)
  • Add fact value datatype (XML Schema) validations (Feature request #256)
  • Added automatic integration with EscrowTech (Feature request #264)
  • Added parameter archiveId to instance/import endpoint to add dimension xbrl:archive as archive identifier. This allows addressing all items from an archive containing multiple instances with a single identifier.

v0.8.12 (2018-04-22)

New Features

  • Extend licenses to allow software usage only for specific features (feature request #225)
  • Added view for footnotes to the CellStore Admin UI (UI feature request #74)

Bug Fixes

  • Fixed handling of error failed to apply resource at documents: Bad Request. Server Message: XDMP-NOTXN: No transaction with identifier xxxx caused by timed out transactions in the MarkLogicConnector. Now pointing to the documentation in the error log (Bug #244)
  • Fixed paging in Admin UI (UI bug #73)
  • Fixed error dialog in Admin UI (UI bug #72)

Improvements

  • Allow import of iXBRL filings without any plugin (feature request #202)
  • New Admin UI colors (UI feature #75)
  • On CellStore startup the cache directory is now automatically created if it does not exist.

v0.8.11 (2018-04-02)

Breaking changes

  • xbrl:url is now a key of instance items to support import of archives containing multiple instance files.

New Features

  • Added plugin for iXBRL transformation (Plugin Id: ixbrl) (Feature request #202)
  • Added plugin for japanese TDNet instances import (Plugin Id: tdnet) (Feature request #202)
  • Added links as selectable field for facts (Feature request #220)
  • Added expand parameter to facts endpoint for expanding footnotes inline (Feature request #220)

v0.8.10 (2018-03-26)

Bug Fixes

  • Fixed copying instance only copies one fact. This happened only if facts did not contain an xbrl:xpointer aspect (Bug #217)

v0.8.9 (2018-03-22)

New Features

  • Implemented support for xbrl:use=prohibited arcs that prevented import of some old Edinet filings (was bug #221)

Bug Fixes

  • Fixed reporting parser errors in response

v0.8.8 (2018-03-19)

Bug Fixes

  • Fixed creation of definition tree when several xlink:label have the same id and same elements are used in the same extended link, but are located in different files (was feature #206)

v0.8.7 (2018-03-15)

New Features

  • Added endpoint /cellstore/v1/footnotes: Rest Endpoint to query (GET), create (POST), replace (PUT), and delete (DELETE) footnotes metadata (feature request #188).
  • Added parameter toEntryPointUrl to endpoint /cellstore/v1/dts/import to allow importing the same dts several times with different entryPointUrls (feature request #203).

Bug Fixes

  • Fixed URL resolution broken in filing archives containing a root directory (Bug #185)
  • Fixed CELLSTORE_EXCEPTION and INSERTION_CONFLICT when copying instance / dts (Bug #208)

v0.8.6 (2018-03-12)

Bug Fixes

  • Fixed error: “A locator points to an uninstanciated element” if element is not defined in a standard XBRL substitutionGroup (Bug #196)
  • Fixed: xlink:title not imported for extended links (Bug #192)

v0.8.5 (2018-03-08)

Breaking changes

  • The endpoint /cellstore/v1/import/instances is now deprecated. Please use newly added endpoint /cellstore/v1/instances/import instead
  • The endpoint /cellstore/v1/import/dts is now deprecated. Please use newly added endpoint /cellstore/v1/dts/import instead

Bug Fixes

  • Fix importing duplicate instances (same id and version) (Bug #191)
  • Add xbrl:linkRole to key for labels collection to fix import of Solvency II instance imports (Bug #189)

New Features

  • Add copy feature for dts (new endpoint /cellstore/v1/dts/copy) (feature request #187)
  • Add copy feature for instances (new endpoint /cellstore/v1/instances/copy) (feature request #187)

v0.8.4 (2018-02-22)

Breaking changes

  • xbrl:decimals and xml:lang are now part of the key for facts (this requires reimporting instances)

Bug Fixes

  • Fix missing aspects xbrldt:default for elements with xbrl:resourceType=dimension
  • Fix retrieval of previous versions for MarkLogic Connector
  • Fix selection of fields for MarkLogic Connector
  • Fix querying of endpoints for closed hypercubes and all versions

Improvements

  • Performance optimization for MarkLogic connector when importing instances or dts

New Features

  • Add xbrl:tupleGroupId to each fact belonging to the same tuple (feature request #175)
  • Add xbrldt:typedDomainRef to type dimensions
  • Add xbrl:memberType to elements with xbrl:resourceType=dimension
  • Allow batch insertion for endpoints using Json arrays of items (feature request #180)
  • Elements now have xbrl:taxonmoy or xbrl:linkbase as part of the key

v0.8.3 (2018-02-05)

Bug Fixes

  • Fix handling of instances with multiple tuples of the same kind without an explicit id attribute (this raised a conflicting cell error) (Bug #171)

Improvements

  • Allow setting MARKLOGIC_PARTIAL_COMMIT_AFTER=0 in reportix.properties to configure committing after each atomic updating operation (Bug #170)

v0.8.2 (2018-02-01)

New Features

  • Added new endpoint methods:
    • /cellstore/v1/presentations/definition: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) presentations metadata from the CellStore.
    • /cellstore/v1/calculations/definition: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) calculations metadata from the CellStore.
    • /cellstore/v1/definitions/definition: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) definitions metadata from the CellStore.
    • /cellstore/v1/tables/definition: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) tables metadata from the CellStore.

Bug Fixes

  • Aspect xbrl:linkbaseType now contains one of: presentation, calculation, definition, reference, label or generic
  • The xbrl:linkName now contains the linkname, for example link:definitionLink (was stored in xbrl:linkbaseType before)
  • The section name is now stored in aspect xbrl:sectionName (was stored in xbrl:linkName before)

v0.8.1 (2018-01-29)

New Features

  • Added new endpoint methods:
    • /cellstore/v1/elements: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) element metadata from the CellStore.
    • /cellstore/v1/labels: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) label metadata from the CellStore.

v0.8.0 (2018-01-28)

New Features

  • Added new endpoints:
    • /cellstore/v1/definitions/definition: Rest Endpoint to query (GET) definition networks metadata from the CellStore. (Feature Request #157)
  • Added new endpoint methods:
    • /cellstore/v1/dts: Rest Endpoint to create (POST) and replace (PUT) dts metadata in the CellStore.
    • /cellstore/v1/taxonomies: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) taxonomy metadata from the CellStore.
    • /cellstore/v1/linkbases: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) linkbase metadata from the CellStore.
  • Added xbrl:linkRoles to elements (indicating in which linkRole the elements are used) (Feature Request #157)
  • Added views for hypercubes, presentations, calculations, definitions and tables to the CellStore Admin UI

v0.7.9 (2018-01-12)

New Features

  • Added new endpoints:
    • /cellstore/v1/tables/definition: Rest Endpoint to query (GET) table definition metadata from the CellStore.
    • /cellstore/v1/presentations/definition: Rest Endpoint to query (GET) presentation network metadata from the CellStore.
    • /cellstore/v1/calculations/definition: Rest Endpoint to query (GET) calculation network metadata from the CellStore.
  • Added support for directory wide metadata for ETL repositories using file reportix.json (Feature Request #137)
  • Added parsing support for table linkbase public workding draft 2013-05-17 (PWD/2013-05-17)
  • Added DPM Eurofiling plugin (dpm.eurofiling)

Bug Fixes

  • Fixed NullpointerException in resolveTargetRoles caused by cyclic targetRoles (Bug #148)

v0.7.8 (2018-01-03)

Bug Fixes

  • Loading an instance with the ETL Tool should by default load the DTS too according to importDts=true parameter (Bug #136)
  • Error importing xbrl filings that contain undimensional scenarios or segments (Bug #140)

v0.7.7 (2017-12-22)

New Features

  • Add importDts parameter to endpoint /cellstore/v1/import/instances to automatically import the DTS together with the instance in case it hasn’t been imported before (Feature Request #131)
  • Add checkbox to also import DTS information to upload dialog of admin UI

Bug Fixes

  • Loading an instance with endpoint /cellstore/v1/import/instances without instanceId parameter creates xbrl:instance=null as ID (Bug #130)

v0.7.6 (2017-12-14)

New Features

  • Added DPM EBA plugin (dpm.eba)

Bug Fixes

  • Fixed wrong xbrl:resourceType for some elements that were marked as concepts but were actually members #124

Improvements

  • When importing an instance zip archive the behavior of the default instance Id is now configurable in the reportix.properties (DEFAULT_INSTANCE_ID) as either: UUID, the basename of the XBRL instance file (INSTANCEFILENAME), or the basename of the archive zip (ARCHIVEFILENAME). Was only UUID.

v0.7.5 (2017-11-17)

New Features

  • Added Plugin Type ARCHIVE_IMPORT_BEFORE_PARSING to allow non-XBRL imports with transformations
  • Added BoE FSA001 example plugin

Bug Fixes

  • Fixed allowing ETL repositories without Json Metadata files #116
  • Fixed making version parameter optional #116

v0.7.4 (2017-10-30)

New Features

  • First alpha release of the following endpoints:
    • /cellstore/v1/dts: Rest Endpoint to query (GET), or delete (DELETE) dts metadata from the cellstore.
    • /cellstore/v1/linkbases: Rest Endpoint to query (GET) linkbases metadata from the cellstore.
    • /cellstore/v1/taxonomies: Rest Endpoint to query (GET) taxonomies metadata from the cellstore.
    • /cellstore/v1/labels: Rest Endpoint to query (GET) labels metadata from the cellstore.
    • /cellstore/v1/elements: Rest Endpoint to query (GET) elements metadata from the cellstore.
    • /cellstore/v1/hypercubes: Rest Endpoint to query (GET) hypercubes metadata from the cellstore.
    • /cellstore/v1/import/dts: Rest Endpoint to import (POST) dts archives. Files, such as the schemas and linkbases need to be posted in a zip archive (Or, be present in the local file cache).
  • Added new source type FILE to ETL tool to allow bulkloading data from local filesystem.
  • Added importing DTS with the ETL tool.
  • Added support for MarkLogic 9 #111

Breaking changes

  • Configuration parameter DEFAULT_INSTANCE_URL_BASE has been renamed to DEFAULT_BASE_URL.
  • In the import/instances endpoint parameter instanceVersion parameter has been renamed to just version.
  • In the import/instances endpoint parameter instancesBaseUrl parameter has been renamed to just baseUrl.

Bug Fixes

  • Fixed filtering array members [MongoDB Layer] #102
  • Fixed select parameter [MongoDB Layer, MarkLogic Layer] #106

v0.7.3 (2017-10-13)

Improvements

  • Rename xbrl:version aspect to rptx:version
  • Enabled replace command in addition to add-missing in ETL Tool for bulkloading filings from S3 (cellstore-etl docker container)

Bug Fixes

  • Fix BOE PRA value date plugin (reference date for next year after Q8)

v0.7.2 (2017-10-06)

Improvements

  • Expose openAPI yaml file on server at /docs/index.yaml
  • Improve API documentation
  • Performance optimization in Mongo Layer: Physical group index added
  • Performance optimization in MarkLogic Layer: Physical group index added
  • Performance optimization for imports and deletes (parallelization)
  • use a 512 bit hash for item identifiers instead of a potentially very long cleartext identifier

New Features

  • Added new ETL Tool for bulkloading filings from S3 (Published as cellstore-etl docker container)
  • First release containing the modular MarkLogic Connector (configure in reportix.properties DB_LAYER=MARKLOGIC):
    • MARKLOGIC_SERVER: server host
    • MARKLOGIC_PORT: server port
    • MARKLOGIC_DB: Database name (requires range index on ‘_gKey’)
    • MARKLOGIC_USER: authenticating user
    • MARKLOGIC_PASS: authentication user’s password
  • Added support for xbrldi:typedMember in contexts of xbrl instances
  • First integration of CellStore SDK adding the ability to implement custom Plugins
  • Added support for item deletion in the CellStore Admin UI
  • Add Transaction Checkpointing for long running transactions (Marklogic only)

Bug Fixes

  • Fixed paging regression “Command failed with error 40234” with parameter paging=true
  • Fixed propagation of default open parameter value into hypercube
  • Fixed paging in MarkLogic Layer
  • Fixed deletion of all versions of an item with rptx:version=* in Mongo Layer

v0.7.1 (2017-08-09)

Improvements

  • Removed required pattern parameter for filtering (GET) on each endpoint. For example, for the facts endpoint this makes using filter xbrl:concept=* superfluous.
  • Add contexts collection to Admin UI

Bug Fixes

  • Allow all CORS methods GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS for rest API endpoints
  • Fix instances base url field in upload dialog of instances collection in the admin UI
  • Fix target folder path of default docker config (did not find the right reportix.properties)

New Features

  • Expose static information on server endpoint /docs/*. This is in more detail:
    • The current Changelog: /docs/changeLog.html
    • OpenApi definition: /docs/index.json
    • Server Version info: /docs/version.json
    • The endpoint schemas as listed in the schemas index: /docs/schemas/index.json

v0.7.0 (2017-08-03)

New Features

  • First alpha release of the following endpoints:
    • /cellstore/v1/instances: Rest Endpoint to query (GET), create (POST), replace (PUT), and delete (DELETE) instances metadata.
    • /cellstore/v1/facts: Rest Endpoint to query (GET), create (POST), replace (PUT), and delete (DELETE) facts from the cellstore.
    • /cellstore/v1/contexts: Rest Endpoint to query (GET) contexts from the cellstore.
    • /cellstore/v1/import/instances: Rest Endpoint to import (POST) instance archives. All files, such as the instance XBRL file and extension taxonomy documents need to be posted in a zip archive.
  • The Query (GET) Rest interfaces support two operators in this release: equality (default; ::eq) and greater than (::gt).
  • The Query (GET) Rest interfaces support a wildcard filter (*) for the equality operator.
  • Added an admin user interfact to browse/filter the instances and facts collections.
cellstore, install, release notes