CellStore release notes
Estimated reading time: 33 minutesThis page is a placeholder, its contents are being worked on.
This document describes the latest changes, additions, known issues, and fixes for CellStore.
This changelog was created for the following Product:
| Product | CellStore |
| Version | v0.9.12-SNAPSHOT |
| Stage | latest-master |
v0.9.11 (2023-08-19)
Major Improvements
- Full conformance added for XBRL specifications “Open Information Model 1.0” - including XBRL-Json, XBRL-CSV and XBRL-XML (Feature request #658)
- Full conformance added for XBRL specification “Units Registry - Structure 1.0” (Feature request #668)
- Full conformance added for XBRL specification “XII Transformation Registry 5” (Feature requests #660)
v0.9.10 (2022-07-15)
Important Notes
- This release contains breaking changes:
- The parameter
selecthas been renamed to parameterinclude(Feature request #625)
Major Improvements
- Full conformance added for XBRL specification “Taxonomy Packages 1.0” (Feature request #616)
- Full conformance added for XBRL specification “Formula 1.0” (Feature request #660)
- Full conformance added for XBRL specification “Transformation Registry 5” (Feature request #660)
- Full conformance added for XBRL specification “Extensible Enumerations versions 1 and 2” (Feature request #660)
Bug Fixes
- Fixing Error “Error Items for collection contexts are required to have at least the following key aspects …” which is related to the import of iXBRL filings where setting
PERSIST_CONTEXT_ITEMSistrue(Bug #628) - Fix Log4j vulnerabilities (CVE-2021-45105, CVE-2021-45046, CVE-2021-44832, CVE-2021-44832, CVE-2021-44228, CVE-2021-42550, CVE-2021-42392, CVE-2021-4104, CVE-2021-36090, CVE-2021-35516, CVE-2021-35515, CVE-2021-23463) (Bug #638)
- Update admin-suite UI endpoints - was failing due to an improperly named query parameter (select -> include) (Bug #637)
- Some elements were not imported from an XML Schema (Bug #646)
New Features
- Facts now contain aspect
rptx:factTypewith valueas-reportedin case the fact is parsed from an instance (Feature request #625) - Add parameter
pluginto endpointarchives(DELETE) (Feature request #625) - Taxonomy Packages can now be dropped into the
cachedirectory and will be found by internal resolution (Feature request #616)
v0.9.9 (2021-08-04)
Important Notes
- This release contains breaking changes:
- The format of the
factMatchattribute has changed for iXBRL template rendering. Additionally, the previously used namespacehttp://reportix.com/extis no longer supported in the template files (use namespacehttp://reportix.com/2021-07-21/ixbrl/templateinstead). - The key of the labels collection has changed to
xbrl:dts,xbrl:linkbase, andxbrl:id. This change requires a database migration (Feature request #619)
Bug Fixes
- On every item update of any collection the key of the inserted or updated item is checked for the minimal required key to prevent invalid items to be inserted (Bug #624)
- Fix error “Items for collection contexts are required to have at least the following key aspects” when parsing iXBRL filings (Bug #628)
- Fix error “Multiple archives were found for Id ‘null’.” when copying an instance (Bug #629)
- Fix error “Couldn’t insert item (xxx) into ‘facts’, because an item in the same cell already exists.” when copying an instance (Bug #630)
New Features
- Add new endpoint
cellstore/v1/facts/render/ixbrlfor rendering Inline XBRL from one or multiple iXBRL template files (Feature request #619) - Add feature to analyze Inline XBRL rendering with parameter
analyze=true(Feature request #619) - Add feature to override all explicit values from the Inline XBRL template whilst rendering with
forceKeepContent=true(Feature request #619) - Add new Inline XBRL template format supported for the rendering endpoint:
- The extension prefix (as suggested) is now
ixtpand the namespace for extension attributes ishttp://reportix.com/2021-07-21/ixbrl/template - The format of the
ixtp:factMatchattribute is now similar (not equal) to CSS and no longer similar to URL query, e.g.xbrl:concept=us-gaap:Assets; xbrl:period=2021-12-31;(note the=instead of the:used in CSS)
- The extension prefix (as suggested) is now
v0.9.8 (2021-07-16)
Important Notes
- This release contains breaking changes:
- All import endpoints require paramters to be prefixed with
parameter::(Feature #619) - The key of the footnotes collection has changed to
xbrl:instance, andxbrl:id. This change requires a database migration (Bug #622)
v0.9.7 (2021-06-02)
Important Notes
- This release contains breaking changes:
- All
DELETEmethod requests to all endpoints now return a response with status code 200 instead of 204 with no response (Feature #607)
Major Improvements
- Full conformance has been achieved and has been certified according to XBRL specification “Table Linkbase 1.0” (Feature requests #581)
- Full conformance has been achieved and has been certified according to XBRL specification “Inline XBRL 1.1” (Feature requests #608)
- Full conformance has been achieved and has been certified according to XBRL specifications “XII Transformation Registry 3” and “XII Transformation Registry 4” (Feature requests #613)
Bug Fixes
- Fix data migration to latest data model version bug ‘Unable to initialize main class com.reportix.cellstore.cli.CellstoreCLI’ (Bug #598)
- Fix removing false port 80 from some links in response when scheme is
https(Bug #597)
New Features
- Add boolean configuration parameters
PERSIST_TABLE_DATAPOINTSandPERSIST_PRESENTATION_DATAPOINTSto make persisting of data points configurable (Feature request #601) - Add boolean configuration parameters
IXBRL_TARGET_INSTANCE_BY_SOURCE_DOCUMENTto allow to import (non-conformant to the specification) one target instance per input iXBRL file (Feature request #613) - Add plugins
rptx.addFactsCountForTablesandrptx.addFactsCountForPresentationsto add fact count per table to instance items (Feature request #602) - Add boolean configuration parameter
DERIVE_TABLE_DEFINITIONS_FROM_PRESENTATIONSto make deriving table definitions from presentation optional (Feature request #603) - Add boolean configuration parameter
PERSIST_CONTEXT_ITEMSto make persisting contexts optional (Feature request #604) - Add aspect
rptx:dimensionsCountto each fact to indicate the number of XBRL dimensions characterizing the fact (Feature request #595) - Add aspect
rptx:factsCountto instance items when importing (Feature request #553)
Improvements
- Migrate docker container hosting to registry.reportix.com (Enhancement #599)
- The endpoint
/cellstore/v1/instances/importhas been deprecated. Instead endpoint/cellstore/v1/archives/importshould be used (Enhancement #601). - Upgrade api documentation from Swagger 2.0 to Open API 3 (Feature #607)
v0.9.6 (2021-02-26)
Important Notes
- This release contains breaking changes:
- Deprecated endpoints
/cellstore/v1/import/instancesand/cellstore/v1/import/dtshave been removed. Use endpoints/cellstore/v1/instances/importand/cellstore/v1/dts/importinstead (Enhancement #495) - By default no
rptx:hashwill automatically get added to each item. To reenable this behavior add settingADD_HASH_TO_ITEMS=trueto the reportix.properties (Feature request #543) - The proprietary indexing for MongoDB has been rebuilt due to size limitations. This requires a migration of existing databases. (Feature request #557)
- Deprecated endpoints
Bug Fixes
- Fix race condition in case the same dts is loaded in two parallel processes (Bug #510)
- Fix error
options not initializedwhen passing an unsupported parameter to/cellstore/v1/instances(DELETE) (Bug #519) - Fix not returning Error 404 when items are deleted which don’t exist (Bug #519)
- Fix applying calculation validations even when DTS is not imported, but loaded from DB (Bug #519)
- Fix handling of compound hypercubes, i.e. hypercubes consisting of several cubes (Bug #521)
- Fix detection of disabled datapoints (Bug #521)
- Fix datapoints for open tables (Bug #521)
- Fix including link to dimension labels in facts if fact does not contain any dimensions (Bug #530)
- Fix error message
NumberFormatException '' is not a decimalhappening on iXBRL documents withscale="0"(Bug #533) - Add missing DTS filter (Parameter:
xbrl:dts) to member and dimensions label links in facts (Bug #544) - Fix race condition when inserting several items into the same MongoDB physical group index (Bug #548)
- Fix empty labels in
labelsfield when skip parameter is used (Bug #551) - Fix bug
Aspect 'xbrl:elementName' does not contain an atomic valuefor entities endpoint (Bug #572) - Fix bug ‘NullPointerException in open table rendering / export to excel’ (Bug #564)
-
Fix bug ‘Invalid cell range, having lastRow < firstRow lastCol < firstCol, had rows 3 >= 3 or cells 0 >= 1’ when exporting to excel (Bug #565) - Fix bug for missing
xbrl:dtsaspects for iXBRL instances (Bug #579)
New Features
- Add parameter
groupByto allow grouping of several facts by an arbitrary number of dimensions into one grouped facts (Feature request #506) - Add parameter
keepDiscreteAccumulatedValuesto allow keeping all discrete distinct values of dimensions when grouping facts (Feature request #506) - Add parameter
functionto apply functions such assum,avg, orcountto any dimension, e.g. in grouped facts (Feature request #506) - Add configuration parameter
ALIGN_PREFIXES_TO_LOWER_CASEwhich allows to autoheal mismatching use of cases for prefixes (Feature request #510) - Add ability to update aspects of all items of an instance with a single
PATCHrequest to the/cellstore/v1/instancesendpoint (Feature request #508) - Add support for Inline XBRL 1.1 (Feature request #507)
- Add server release information to error responses (Feature request #514)
- Add rest endpoint
/cellstore/v1/tables/openDimensionValuesto query (GET) values for open dimension groups from open tables (Feature request #513). - Add parameter
xbrlFormulaValidationto endpoint/cellstore/v1/instances/importto allow formula validation when importing an instance (Feature request #516) - Add rest endpoint
/cellstore/v1/archivesto query or search (GET), create (POST), replace (PUT), and delete (DELETE) archives metadata (Feature request #543). - Add rest endpoint
/cellstore/v1/archives/importto allow better support for (zip) archive imports with multiple reports inside (Feature request #543). - Add rest endpoint
/cellstore/v1/entitiesto query or search (GET), create (POST), replace (PUT), and delete (DELETE) entities metadata (Feature request #539). - Add rest endpoint
/cellstore/v1/formulasto query (GET) formula metadata (Feature request #516). - Add rest endpoint
/cellstore/v1/instances/validationsto query (GET), and delete (DELETE) instances validations (Feature request #514). - Add rest endpoint
/cellstore/v1/system/cacheto query (GET) files from the cache (Feature request #516). - Add parameter
highlightto each endpoint supportingsearch. It supports highlighting of matched text phrases when using Elasticsearch setups (Feature request #539) - Add
dpm:directive,dpm:filingIndicatorCode,dpm:columnRCCode,dpm:rowRCCodeto facts in table layouts when plugindpm.eurofilingis applied (Feature request #521) - Add ability to store custom data with every item for plugins (Feature request #521)
- Add ability to use several taxonomy package versions inside the cache path on endpoint
/cellstore/v1/instances/import(use parametercachePathto alter the cache path) - Add links to
labelsDimensionsandlabelsMembersto facts and make them expandable (Feature request #511) - Add selectable field
labelsto endpoints returning facts (Feature request #526):/cellstore/v1/facts/cellstore/v1/presentations/tables/facts/cellstore/v1/tables/facts/cellstore/v1/tables/openDimensionValues
- In case an instance contains facts with cell conflicts, i.e. several facts in the same cell with dimensional equality, all facts are imported as different versions nevertheless (Feature request #535)
- Add number of facts per table / presentation
section:<section-name>to instance items (Feature request #547) - Add optional full-text search capability through Elasticsearch connector (Feature request #536)
- Add parameter
searchto footnotes endpoint to enable searching footnotes by full-text (Feature request #536) - Add
model:framework,model:taxonomy, andmodel:moduleto each dts, instance, and fact when plugindpm.eurofilingis applied (Feature request #537) - Add plugins
rptx.addAspects.*to add arbitrary aspects to any item on import (Feature request #555) - Add plugins
efg.addFactFiscalInfoto add fiscal year and period information to each fact (Feature request #559) - Add configuration property
CREATE_ENTITY_IF_NOT_EXISTENTto allow turning off auto-creation of entities (Feature request #560) - Allow multiple member values in key dimensions, e.g. multiple
xbrl:entityids such as LEI and EDInet code for a single entity (Feature request #569) - Add aspect
rptx:isHTMLwithtrueto each fact that contains html as text value (Feature request #571) - Well-known namespaces can now be configured in the
reportix.jsonfile to give more control over the prefix normalization (Feature request #558) - The use of well-known namespaces can now be forced (
REQUIRE_ALL_NAMESPACES_TO_BE_KNOWN=true) to a degree that any import will fail if a namespace is found that is not defined in thereportix.json(Feature request #558) - Add support for interval arithmetics in calculations (Feature request #568)
- Optimize entities search performance, add fuzziness and partial string matches (Feature request #583)
Improvements
- Improve error message in case of a cell conflict - now including the conflicting cells (Feature request #510)
- All fact textual values and label values are now normalized according to the Normalization Form Canonical Composition (NFC) (Bug #498)
- Elements and labels are added for XBRL core dimensions:
xbrl:concept,xbrl:period,xbrl:entity,xbrl:unit,xml:lang,iso2:lang,xbrl:decimals, andxbrl:instance(Feature request #518) - Performance optimization in prefix normalization (Feature request #23)
- Upgrade to new admin UI (Feature request #570)
- Plugin
xbrl.calculationshas been removed as this functionality is now a core feature.
v0.9.5 (2020-03-20)
Major Improvements
- Full conformance has been achieved according to Extensible Business Reporting Language (XBRL) 2.1 and XBRL Dimensions 1.0 specification (Feature requests #476, # 537, #540, #545, and #567)
Bug Fixes
- Fixed file resolution issue for zip archives having file references with ‘..’ on linux (Feature request #476)
- Fixed error
Aspect 'xxx' does not contain an atomic value.(Bug #541) - Fixed json schema for updating facts that have decimal values for aspects.
- Fixed exception thrown when
xbrl:dtsdimension contains multiple values.
Improvements
- Allow more sophisticated dimensional validation for instance (Feature request #476)
- Added parameter
factDimensionalValidationto allow enabling/disabling dimensional validation of primary items when importing an instance (Feature request #476) - Enabled XBRL conformance test suite ‘XBRL Dimensions 1.0’ (Feature request #537)
- Enabled XBRL conformance tests 201 to 293 of the core ‘Extensible Business Reporting Language (XBRL) 2.1’ (Feature request #559)
- Enabled XBRL conformance tests 301 to 314 of the core ‘Extensible Business Reporting Language (XBRL) 2.1’ (Feature request #540)
- Enabled XBRL conformance tests 320 to 398 of the core ‘Extensible Business Reporting Language (XBRL) 2.1’ (Feature request #545)
- Enabled XBRL conformance tests 102 to 161, 400, 401, and misc tests of the core ‘Extensible Business Reporting Language (XBRL) 2.1’ (Feature request #567)
New Features
- Several new endpoints have been added (Feature request #511):
/cellstore/v1/presentations/tables/definition: Rest endpoint to query (GET) presentation networks as ‘table’ definitions from the CellStore./cellstore/v1/presentations/tables/datapoints: Rest endpoint to query (GET) datapoints from presentation networks./cellstore/v1/presentations/tables/facts: Rest endpoint to query (GET) facts matching presentation networks from the CellStore./cellstore/v1/presentations/tables/hypercube: Rest endpoint to query (GET) hypercubes implied by presentation networks./cellstore/v1/presentations/tables/presentations/tables/layout: Rest endpoint to query (GET) render presentation networks to table layouts./cellstore/v1/presentations/tables/presentations/tables/structural: Rest endpoint to query (GET) table structurals for presentation networks./cellstore/v1/tables/facts: Rest endpoint to query (GET) facts matching table definitions from the CellStore.
- Added endpoint to export to XBRL:
/cellstore/v1/instances/export: Rest endpoint to export (GET) instances to XBRL (Feature request #511).
- Added parameter
formatto allow rendering different variants of table layouts (jsonandexcel) (Feature request #511). - Added parameter
xmlSchemaValidationto endpoint/cellstore/v1/instances/importto allow disabling XML Schema validation (Feature request #540) - Added parameter
xmlSchemaValidationto endpoint/cellstore/v1/dts/importto allow disabling XML Schema validation (Feature request #567) - Added parameter
xbrlConformanceValidationto endpoint/cellstore/v1/instances/importto allow disabling XBRL conformance validation (Feature request #540) - Added parameter
xbrlCalculationValidationto endpoint/cellstore/v1/instances/importto allow disabling XBRL calculation validations (Feature request #559)
v0.9.4 (2019-11-28)
Improvements
- Improve memory consumption for copying instances (Feature request #387)
- Create and publish cachePacks.json to being able to automatically publish AMI with latest cachePacks (Enhancement #504)
- AMI uses the latest cache packs from cachePacks.json (Enhancement #504)
- Automatically add text indices to facts and labels collections (Enhancement #519)
- Add additional field “_lang” to collections to act as a language override field. (Enhancement #519)
- Filter the possible values of the “_lang” field to only accept languages supported by mongo, otherwise insert “none” (Enhancement #519)
- Switch all CircleCI variables to GitLabCI equivalents (Bug #517)
- Add pre-release stage to CI so that the test-publish and publish jobs are never run together, as that is entirely redundant (Optimization #515)
- Changed released ami name to include proper release version (Bug #516)
- Built AMIs in us-east-1 instead of eu-west-1 so that they can more easily be released to the marketplace
v0.9.3 (2019-08-29)
New Features
- Add support for headers
Forwarded,X-Forwarded-Proto,X-Forwarded-Host,X-Forwarded-Port(Feature request #489) - Add expandable labels and links to presentation, definition, and calculation items (Feature request #494)
- Add generic role labels (Feature request #494)
- Add generic message 1.0 (Feature request #494)
Improvements
- Improve endpoint API documentation with better titles (Feature request #494)
v0.9.2 (2019-08-16)
Bug Fixes
- Fixed error
Parameter '_' not allowed for endpoint.which occurs when caching is turned off in some HTTP client libraries. This parameter is now allowed, but ignored, on all endpoints forGETrequests. (Bug #484) - Fixed ClassCastException in
esef.wider-narrowerplugin when reimporting an ESEF instance. (Bug #484) - Fixed error
Cannot create HypercubeSpec: Member '-3' (Dimension: 'xbrl:decimals') has an unsupported typewhen updating a fact (Bug #484)
New Features
- Add support for core DTS imports and auto-inheritance of DTS items for importing DTS to reduce redundancy and increase query performance (Feature request #469)
- Implemented support for specification
Including XBRL Reports in Taxonomy Packages 1.0(Feature request #484)
v0.9.1 (2019-07-15)
Important Notes
- Support for MarkLogic 8 is going into sun-down phase. MarkLogic 8 will no longer be supported from version 0.9.2.
Improvements
- Performance optimizations have been implemented for the MarkLogic connector (Enhancement #448)
Bug Fixes
- Fixed CellStore bug: NullPointerException in table layout (Bug #426)
- Fixed CellStore bug: loading Edinet filings with CJK date (Bug #432)
- Fixed CellStore bug: respect uri rewrite from catalog.xml (Feature #443)
New Features
- Add EverContract server to expose validation API; exposed new endpoint for directly accessing files from the Cache (Feature request #397):
/evercontract/v1/system/cache: Rest Endpoint to retrieve (GET) file from Cache with parameterurl.
- Plugin
dpm.eurofilingnow adds all filed tables according to the filingIndicator to the instance items (Feature Request #420) - Add aspect
xml:langto table layouts (Feature request #424) - Add more aspects to each imported fact:
xbrl:conceptName,xbrl:contextRef,xbrl:unitRef,xbrl:url(Feature request #427) - Add new endpoint for Datapoints (Feature request #441):
/cellstore/v1/tables/datapoints: Rest Endpoint to query (GET) table datapoint metadata.
- Add plugin
esef.wider-narrowerto support wider-narrower arcrole (Feature request #443) - Add parameter
searchto thelabelsandfactsendpoints to enable full-text search (Feature request #392)
v0.9.0 (2019-04-20)
Bug Fixes
- Fixed NullPointerException when loading SEC Risk/Return filings (Bug #394)
- Fixed race condition when several filings with the same DTS are imported at the same time
v0.8.19 (2019-03-29)
Bug Fixes
- Fixed error when importing instances with nil values for typed dimensions (Bug #378)
New Features
- Add commandline flags to run tests against custom server url and port (Feature request #368)
- Add endpoints for table layout rendering (Feature request #355):
/cellstore/v1/tables/hypercube: Rest Endpoint to query (GET) implicit table hypercubes./cellstore/v1/tables/layout: Rest Endpoint to query (POST) renderings for particular tables.
v0.8.18 (2019-02-02)
Bug Fixes
- Fixed Error “Couldn’t get member type from element defining type of domain ref : ‘…’” (Bug #361)
New Features
- [Advanced Feature] Added new config parameters to change the default system prefixes used (Feature Request #356):
DATA_PREFIX_DIMENSION_D3: default prefix for D3 related aspects isd3DATA_PREFIX_DIMENSION_PROVENANCE: default prefix for provenance related aspects isprovDATA_PREFIX_DIMENSION_RPTX: default prefix for Reportix internal aspects isrptxDATA_PREFIX_DIMENSION_TABLE: default prefix for table related aspects istableDATA_PREFIX_DIMENSION_XBRL: default prefix for XBRL related aspects isxbrlDATA_PREFIX_DIMENSION_XBRLDT: default prefix for XBRL dimensions related aspects isxbrldtDATA_PREFIX_DIMENSION_XLINK: default prefix for XLink related aspects isxlinkDATA_PREFIX_DIMENSION_XML: default prefix for XML related aspects isxmlDATA_PREFIX_DIMENSION_XS: default prefix for XML Schema related aspects isxsDATA_PREFIX_DIMENSION_XSI: default prefix for XML Schema instances related aspects isxsi
v0.8.17 (2018-10-31)
New Features
- First alpha release of the structural table resolution and addition of the following endpoints (Feature Request #267):
/cellstore/v1/tables/hypercube: Rest Endpoint to query (GET) metadata of implied table hypercubes./cellstore/v1/tables/structural: Rest Endpoint to query (GET) resolved structural table metadata.
- Added config parameter
MARKLOGIC_DIRECTORIES_URI_PREFIXto prefix directories created in MarkLogic (Feature Request #341)
v0.8.16 (2018-08-09)
Breaking changes
- For labels the
xbrl:valueis now part of the key to prevent duplicate label definitions
Bug Fixes
- Fixed importing only a single label if multiple identical labels exist in the XBRL instance (Bug #282)
- Admin UI: Fixed bug: Internet Explorer covers checkbox area (UI Bug #81)
- Escrow packaging: Fixed broken packaging and added regression test (Bug #318)
New Features
- Added new parameter
storageto endpointsinstances/importanddts/importto enable validation without persistence (storage=false) (Feature Request #302) - Admin UI: Expose fact validation checkbox to be able to explicitly disable fact validation when importing an instance (UI Feature Request #85)
v0.8.15 (2018-07-25)
Bug Fixes
- Fix validation issue with dateTime items:
cvc-datatype-valid.1.2.1: '2018-06-29' is not a valid value for 'dateTime'.(Bug #298)
New Features
- Added parameter
factValueValidationto allow turning off fact value validations on endpointinstances/import(Feature request #289)
v0.8.14 (2018-07-18)
Bug Fixes
- Fix error “Couldn’t validate instance with id ‘xxx’ because the DTS does not exist in the store” when importing with
importDts=falseand no dts in store (Bug #285)
v0.8.13 (2018-07-11)
Bug Fixes
- Fixed adding of several networks (presentation, definition, calculation) does not throw an error if a linkRole is used that already exists in the store for the same linkbaseType (Bug #257)
- Fixed race condition in license date parsing (Bug #262)
- Fixed conflict when providing an instanceId whilst importing an archive that contains several instances (Bug #268)
- Fixed
nonnum:textBlockItemTypevalidation to allow simpleContent (Bug #275) - Fixed handling of manifest.xml files when multiple
instancedefinitions are present (Bug #276)
New Features
- Added plugin for xbrl calculation validations (Plugin Id:
xbrl.calculations) (Feature request #252) - Add fact value datatype (XML Schema) validations (Feature request #256)
- Added automatic integration with EscrowTech (Feature request #264)
- Added parameter archiveId to
instance/importendpoint to add dimensionxbrl:archiveas archive identifier. This allows addressing all items from an archive containing multiple instances with a single identifier.
v0.8.12 (2018-04-22)
New Features
- Extend licenses to allow software usage only for specific features (feature request #225)
- Added view for footnotes to the CellStore Admin UI (UI feature request #74)
Bug Fixes
- Fixed handling of error
failed to apply resource at documents: Bad Request. Server Message: XDMP-NOTXN: No transaction with identifier xxxxcaused by timed out transactions in the MarkLogicConnector. Now pointing to the documentation in the error log (Bug #244) - Fixed paging in Admin UI (UI bug #73)
- Fixed error dialog in Admin UI (UI bug #72)
Improvements
- Allow import of iXBRL filings without any plugin (feature request #202)
- New Admin UI colors (UI feature #75)
- On CellStore startup the cache directory is now automatically created if it does not exist.
v0.8.11 (2018-04-02)
Breaking changes
xbrl:urlis now a key of instance items to support import of archives containing multiple instance files.
New Features
- Added plugin for iXBRL transformation (Plugin Id:
ixbrl) (Feature request #202) - Added plugin for japanese TDNet instances import (Plugin Id:
tdnet) (Feature request #202) - Added
linksas selectable field for facts (Feature request #220) - Added
expandparameter to facts endpoint for expanding footnotes inline (Feature request #220)
v0.8.10 (2018-03-26)
Bug Fixes
- Fixed copying instance only copies one fact. This happened only if facts did not contain an
xbrl:xpointeraspect (Bug #217)
v0.8.9 (2018-03-22)
New Features
- Implemented support for
xbrl:use=prohibitedarcs that prevented import of some old Edinet filings (was bug #221)
Bug Fixes
- Fixed reporting parser errors in response
v0.8.8 (2018-03-19)
Bug Fixes
- Fixed creation of definition tree when several
xlink:labelhave the same id and same elements are used in the same extended link, but are located in different files (was feature #206)
v0.8.7 (2018-03-15)
New Features
- Added endpoint
/cellstore/v1/footnotes: Rest Endpoint to query (GET), create (POST), replace (PUT), and delete (DELETE) footnotes metadata (feature request #188). - Added parameter
toEntryPointUrlto endpoint/cellstore/v1/dts/importto allow importing the same dts several times with different entryPointUrls (feature request #203).
Bug Fixes
- Fixed URL resolution broken in filing archives containing a root directory (Bug #185)
- Fixed
CELLSTORE_EXCEPTIONandINSERTION_CONFLICTwhen copying instance / dts (Bug #208)
v0.8.6 (2018-03-12)
Bug Fixes
- Fixed error: “A locator points to an uninstanciated element” if element is not defined in a standard XBRL substitutionGroup (Bug #196)
- Fixed: xlink:title not imported for extended links (Bug #192)
v0.8.5 (2018-03-08)
Breaking changes
- The endpoint
/cellstore/v1/import/instancesis now deprecated. Please use newly added endpoint/cellstore/v1/instances/importinstead - The endpoint
/cellstore/v1/import/dtsis now deprecated. Please use newly added endpoint/cellstore/v1/dts/importinstead
Bug Fixes
- Fix importing duplicate instances (same id and version) (Bug #191)
- Add
xbrl:linkRoleto key for labels collection to fix import of Solvency II instance imports (Bug #189)
New Features
- Add copy feature for dts (new endpoint
/cellstore/v1/dts/copy) (feature request #187) - Add copy feature for instances (new endpoint
/cellstore/v1/instances/copy) (feature request #187)
v0.8.4 (2018-02-22)
Breaking changes
xbrl:decimalsandxml:langare now part of the key for facts (this requires reimporting instances)
Bug Fixes
- Fix missing aspects
xbrldt:defaultfor elements withxbrl:resourceType=dimension - Fix retrieval of previous versions for MarkLogic Connector
- Fix selection of fields for MarkLogic Connector
- Fix querying of endpoints for closed hypercubes and all versions
Improvements
- Performance optimization for MarkLogic connector when importing instances or dts
New Features
- Add
xbrl:tupleGroupIdto each fact belonging to the same tuple (feature request #175) - Add
xbrldt:typedDomainRefto type dimensions - Add
xbrl:memberTypeto elements withxbrl:resourceType=dimension - Allow batch insertion for endpoints using Json arrays of items (feature request #180)
- Elements now have
xbrl:taxonmoyorxbrl:linkbaseas part of the key
v0.8.3 (2018-02-05)
Bug Fixes
- Fix handling of instances with multiple tuples of the same kind without an explicit id attribute (this raised a conflicting cell error) (Bug #171)
Improvements
- Allow setting
MARKLOGIC_PARTIAL_COMMIT_AFTER=0inreportix.propertiesto configure committing after each atomic updating operation (Bug #170)
v0.8.2 (2018-02-01)
New Features
- Added new endpoint methods:
/cellstore/v1/presentations/definition: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) presentations metadata from the CellStore./cellstore/v1/calculations/definition: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) calculations metadata from the CellStore./cellstore/v1/definitions/definition: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) definitions metadata from the CellStore./cellstore/v1/tables/definition: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) tables metadata from the CellStore.
Bug Fixes
- Aspect
xbrl:linkbaseTypenow contains one of:presentation,calculation,definition,reference,labelorgeneric - The
xbrl:linkNamenow contains the linkname, for examplelink:definitionLink(was stored inxbrl:linkbaseTypebefore) - The section name is now stored in aspect
xbrl:sectionName(was stored inxbrl:linkNamebefore)
v0.8.1 (2018-01-29)
New Features
- Added new endpoint methods:
/cellstore/v1/elements: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) element metadata from the CellStore./cellstore/v1/labels: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) label metadata from the CellStore.
v0.8.0 (2018-01-28)
New Features
- Added new endpoints:
/cellstore/v1/definitions/definition: Rest Endpoint to query (GET) definition networks metadata from the CellStore. (Feature Request #157)
- Added new endpoint methods:
/cellstore/v1/dts: Rest Endpoint to create (POST) and replace (PUT) dts metadata in the CellStore./cellstore/v1/taxonomies: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) taxonomy metadata from the CellStore./cellstore/v1/linkbases: Rest Endpoint to create (POST), replace (PUT), and delete (DELETE) linkbase metadata from the CellStore.
- Added
xbrl:linkRolesto elements (indicating in which linkRole the elements are used) (Feature Request #157) - Added views for hypercubes, presentations, calculations, definitions and tables to the CellStore Admin UI
v0.7.9 (2018-01-12)
New Features
- Added new endpoints:
/cellstore/v1/tables/definition: Rest Endpoint to query (GET) table definition metadata from the CellStore./cellstore/v1/presentations/definition: Rest Endpoint to query (GET) presentation network metadata from the CellStore./cellstore/v1/calculations/definition: Rest Endpoint to query (GET) calculation network metadata from the CellStore.
- Added support for directory wide metadata for ETL repositories using file
reportix.json(Feature Request #137) - Added parsing support for table linkbase public workding draft 2013-05-17 (PWD/2013-05-17)
- Added DPM Eurofiling plugin (
dpm.eurofiling)
Bug Fixes
- Fixed NullpointerException in resolveTargetRoles caused by cyclic targetRoles (Bug #148)
v0.7.8 (2018-01-03)
Bug Fixes
- Loading an instance with the ETL Tool should by default load the DTS too according to
importDts=trueparameter (Bug #136) - Error importing xbrl filings that contain undimensional scenarios or segments (Bug #140)
v0.7.7 (2017-12-22)
New Features
- Add
importDtsparameter to endpoint/cellstore/v1/import/instancesto automatically import the DTS together with the instance in case it hasn’t been imported before (Feature Request #131) - Add checkbox to also import DTS information to upload dialog of admin UI
Bug Fixes
- Loading an instance with endpoint
/cellstore/v1/import/instanceswithout instanceId parameter createsxbrl:instance=nullas ID (Bug #130)
v0.7.6 (2017-12-14)
New Features
- Added DPM EBA plugin (
dpm.eba)
Bug Fixes
- Fixed wrong xbrl:resourceType for some elements that were marked as concepts but were actually members #124
Improvements
- When importing an instance zip archive the behavior of the default instance Id is now configurable in the reportix.properties (
DEFAULT_INSTANCE_ID) as either:UUID, the basename of the XBRL instance file (INSTANCEFILENAME), or the basename of the archive zip (ARCHIVEFILENAME). Was only UUID.
v0.7.5 (2017-11-17)
New Features
- Added Plugin Type
ARCHIVE_IMPORT_BEFORE_PARSINGto allow non-XBRL imports with transformations - Added BoE FSA001 example plugin
Bug Fixes
- Fixed allowing ETL repositories without Json Metadata files #116
- Fixed making version parameter optional #116
v0.7.4 (2017-10-30)
New Features
- First alpha release of the following endpoints:
/cellstore/v1/dts: Rest Endpoint to query (GET), or delete (DELETE) dts metadata from the cellstore./cellstore/v1/linkbases: Rest Endpoint to query (GET) linkbases metadata from the cellstore./cellstore/v1/taxonomies: Rest Endpoint to query (GET) taxonomies metadata from the cellstore./cellstore/v1/labels: Rest Endpoint to query (GET) labels metadata from the cellstore./cellstore/v1/elements: Rest Endpoint to query (GET) elements metadata from the cellstore./cellstore/v1/hypercubes: Rest Endpoint to query (GET) hypercubes metadata from the cellstore./cellstore/v1/import/dts: Rest Endpoint to import (POST) dts archives. Files, such as the schemas and linkbases need to be posted in a zip archive (Or, be present in the local file cache).
- Added new source type FILE to ETL tool to allow bulkloading data from local filesystem.
- Added importing DTS with the ETL tool.
- Added support for MarkLogic 9 #111
Breaking changes
- Configuration parameter
DEFAULT_INSTANCE_URL_BASEhas been renamed toDEFAULT_BASE_URL. - In the
import/instancesendpoint parameterinstanceVersionparameter has been renamed to justversion. - In the
import/instancesendpoint parameterinstancesBaseUrlparameter has been renamed to justbaseUrl.
Bug Fixes
- Fixed filtering array members [MongoDB Layer] #102
- Fixed select parameter [MongoDB Layer, MarkLogic Layer] #106
v0.7.3 (2017-10-13)
Improvements
- Rename
xbrl:versionaspect torptx:version - Enabled
replacecommand in addition toadd-missingin ETL Tool for bulkloading filings from S3 (cellstore-etl docker container)
Bug Fixes
- Fix BOE PRA value date plugin (reference date for next year after Q8)
v0.7.2 (2017-10-06)
Improvements
- Expose openAPI yaml file on server at
/docs/index.yaml - Improve API documentation
- Performance optimization in Mongo Layer: Physical group index added
- Performance optimization in MarkLogic Layer: Physical group index added
- Performance optimization for imports and deletes (parallelization)
- use a 512 bit hash for item identifiers instead of a potentially very long cleartext identifier
New Features
- Added new ETL Tool for bulkloading filings from S3 (Published as cellstore-etl docker container)
- First release containing the modular MarkLogic Connector (configure in reportix.properties DB_LAYER=MARKLOGIC):
- MARKLOGIC_SERVER: server host
- MARKLOGIC_PORT: server port
- MARKLOGIC_DB: Database name (requires range index on ‘_gKey’)
- MARKLOGIC_USER: authenticating user
- MARKLOGIC_PASS: authentication user’s password
- Added support for xbrldi:typedMember in contexts of xbrl instances
- First integration of CellStore SDK adding the ability to implement custom Plugins
- Added support for item deletion in the CellStore Admin UI
- Add Transaction Checkpointing for long running transactions (Marklogic only)
Bug Fixes
- Fixed paging regression “Command failed with error 40234” with parameter
paging=true - Fixed propagation of default open parameter value into hypercube
- Fixed paging in MarkLogic Layer
- Fixed deletion of all versions of an item with
rptx:version=*in Mongo Layer
v0.7.1 (2017-08-09)
Improvements
- Removed required pattern parameter for filtering (
GET) on each endpoint. For example, for the facts endpoint this makes using filterxbrl:concept=*superfluous. - Add contexts collection to Admin UI
Bug Fixes
- Allow all CORS methods
GET,HEAD,POST,PUT,PATCH,DELETE,OPTIONSfor rest API endpoints - Fix instances base url field in upload dialog of instances collection in the admin UI
- Fix target folder path of default docker config (did not find the right reportix.properties)
New Features
- Expose static information on server endpoint
/docs/*. This is in more detail:- The current Changelog:
/docs/changeLog.html - OpenApi definition:
/docs/index.json - Server Version info:
/docs/version.json - The endpoint schemas as listed in the schemas index:
/docs/schemas/index.json
- The current Changelog:
v0.7.0 (2017-08-03)
New Features
- First alpha release of the following endpoints:
/cellstore/v1/instances: Rest Endpoint to query (GET), create (POST), replace (PUT), and delete (DELETE) instances metadata./cellstore/v1/facts: Rest Endpoint to query (GET), create (POST), replace (PUT), and delete (DELETE) facts from the cellstore./cellstore/v1/contexts: Rest Endpoint to query (GET) contexts from the cellstore./cellstore/v1/import/instances: Rest Endpoint to import (POST) instance archives. All files, such as the instance XBRL file and extension taxonomy documents need to be posted in a zip archive.
- The Query (
GET) Rest interfaces support two operators in this release: equality (default;::eq) and greater than (::gt). - The Query (
GET) Rest interfaces support a wildcard filter (*) for the equality operator. - Added an admin user interfact to browse/filter the instances and facts collections.