πDING! DING!π Dear community, we are so proud to announce that OpenCTI version 5.4.0 has been released π₯! This was a huge joint effort from the brand new Filigran engineering team as well as all community contributors π». Thank you everyone for your continuous efforts to make OpenCTI the world leading threat intelligence platform π!
This milestone contains important new features but also the implementation of more systematic development best practices (TypeScript, pure functions, etc.) 𧩠that will allow us to speed-up future milestones in the months and years to come π.
First of all, OpenCTI 5.4.0 brings long-awaited features π:
- bulk search of entities and observables in the platform π;
- customization of workflow statuses for all types of entity π οΈ;
- introduce an analyst workbench to modelize entities and relationships massively and easily before create the knowledge in the platform π©βπ»;
- new inference rules to propagate reports to parent entities (sectors / locations) πΊοΈ;
- performances improvement due to the new way to validate indicators syntax (creation of indicators speed x10) π ;
- it is now possible to deny connectors from creating new labels and keep a set of pre-defined labels in the platform β¨;
- country flags for IPs when
located-at
relationship is set to a specific country π΄; - new specific capabilities for notes and opinions to allow feedback even from read-only users βοΈ;
- implement the STIX 2.1 "Grouping" entity type to allow information clustering without creating a report when it is not relevant π¦;
- Japanese translation, OpenTelemetry, investigation improvements and much more π...
Last but not least, this release introduces a major new data segregation and sharing capability by organization π’. This allows administrators to associate users to organizations (organizations can belong to parent organizations as well) and to distribute knowledge across one or multiple organizations in the platform π.
It is also possible to set a default organization for the whole platform to restrict all data and starting to share progressively information π. A demonstration video will be published to better explain this new feature which will help organizations to open access to third-parties / constituents with full confidence about the confidentiality of the data π₯³.
β οΈ All
internal-export-file
connectors should now be launched with a user which has theAdministrator
role, because they now impersonate the user requesting the export to prevent data leak.
β οΈ All technical creators (users) of existing entities are no longer mapped on the history and then are displayed as "SYSTEM". New entities / relationships will be created with the correct creator fully modelized. If you would like to recover the creators information of your existing data, you can launch a background task (based on the history) on the selected entities (or all of them) using the mass operations toolbar
Update => Replace => Creator
.
βοΈ When using the organization segregation capability, it is recommended to enable the inference rule
ORGANIZATION PROPAGATION VIA PARTICIPATION
so it will propagate if a user A participates in organization B and organization B is part of organization C, then the user A also participates in organization C.
Since the last release, minio implements breaking change. If you decide to upgrade minio, a procedure must be applied. Please read https://min.io/docs/minio/linux/operations/install-deploy-manage/migrate-fs-gateway.html
Enhancements:
- #2543 [api] Improve version checking of platform start
- #2535 Be able to hide background tasks screen using RBAC capabilities
- #2530 Add new attributes to the entity incident
- #2502 Improv dev env by injecting a data set
- #2483 Be able to use workflow status in the stream filters
- #2475 Implement the "Grouping" STIX 2.1 entity as a container
- #2470 Limit the history message length both in backend (when inserting) and frontend
- #2464 Title and meta description of the platform
- #2463 [api] Add usage of impersonate feature to connectors
- #2456 Add Japanese translation
- #2446 Add "Shodan" Pattern Type to Indicators
- #2435 [api] Filters support multiples keys to search on
- #2420 Add a quick filter for sighting lists (false / true positive)
- #2408 Full refactor of pre-validation screen into an analyst workbench
- #2414 Support "content_ref" for StixFile to Artifact (obs_content ?) relation
- #2406 [Feature] Filter for 'Score less than' within Retention Policy Rules
- #2401 Improve of performance indicator checkIndicatorSyntax function
- #2397 Enhance the view of the rules definition in the frontend
- #2341 [rules] Add report objects related rules
- #2336 Bulk search of SDOs and SCOs
- #2331 Mass delete labels
- #2293 Add Infrastructure fields to UI when creating new Objects
- #2263 Ability to search OpenCTI for a list of Observables (as opposed to one by one)
- #2196 Finer access controls for Reports for feedback - Separate "Opinions" as a knowledge creation access control under roles.
- #2188 Add organizations restrictions on top of markings to increase data segregation possibilities
- #2163 Entity details edition during data import
- #2116 Session refresh on user rights change
- #2109 Create/Update notes and opinions specifying author with a different user
- #2029 Add technical creator in data + ordering/filtering
- #1991 Exporting Report details, Malware or Intrusion Sets is hard to do
- #1943 Ability to create additional custom workflow status names straight from the UI if possible.
- #1934 Ability to expand to any kind of entity from Investigations Workspace
- #1867 Removing report
- #1799 Bulk creation of knowledge around a threat entity
- #1781 STIX ID standard is useless to analysts but have the most visible spot in item pages
- #1757 Add Indicator to Report when Observable+Indicator created within the context of a Report
- #1755 Be able to select labels to import
- #1730 Add country flag icons to IPv4/IPv6 observables
- #1596 Expose worker metrics for prometheus
- #1468 Remove entities after report deletion
- #1428 Suppressing an entity does not suppress its relations
- #1182 Infrastructure, Systems and Vulnerabilities
- #1071 No way to implement STIX's Windows Service (and Process) extensions
Bug Fixes:
- #2550 Events/Incidents/Observables. Doesn't display more than 25 observables.
- #2487 Empty channels type break the UI
- #2448 Pending Imports UI potentially referencing incorrect path for STIX bundles when APP__BASE_PATH is set
Pull Requests:
- [api] Add OpenTelemetry for tracing and metrics (#1596) by @richard-julien in #2439
- [Tool] Update some files for dev env setup by @Kedae in #2440
- [api] Filters support multiples keys to search on (#2435) by @Kedae in #2444
- [api] Introduce impersonate capability for bypass role (#1755) by @richard-julien in #2445
- [api] Fix missing filters on graphQL and update of elastic size for d⦠by @Kedae in #2451
- Add locale ja jp (#5) by @kohsawa in #2455
- [api/front] Bump librairies + adapt front testing by @richard-julien in #2458
- [front] Add quick filter to Sightings qualification by @Kedae in #2453
- [api] Improve performance of python execution (#2401) by @richard-julien in #2461
- [front] Add lte on score for retention by adding a grouped filter by @Kedae in #2457
- [api/frontend] Implement a first version of the analyst workbench (#2408) by @SamuelHassine in #2466
- [Front] add the possibility to select a type in the infrastructure cr⦠by @Archidoit in #2471
- [api/front] Default rendering of title and meta description (#2464) by @richard-julien in #2465
- [api] Add rabbitmq queue_prefix and improve dev testing by @richard-julien in #2479
- [api] Session lazy refresh on user rights/roles/groups modifications (#2116) by @richard-julien in #2480
- [api] Add support of content_ref in Stix file for Artifact by @Kedae in #2468
- [Back] StatusTemplate creation (#1943) by @Archidoit in #2477
- [api/front] Implement process extensions (#1071) by @richard-julien in #2405
- [frontend] Fix channels list if types is empty (#2487) by @SamuelHassine in #2492
- [rules] Add report objects related rules (#2341) by @richard-julien in #2375
- [api/frontend] Implement the "Grouping" STIX 2.1 entity as a container (#2475) by @SamuelHassine in #2501
- [api] Improv dev env by injecting a data set (#2502) by @RomuDeuxfois in #2527
- Add "Shodan" Pattern Type to Indicators (#2446) by @RomuDeuxfois in #2537
- [api/frontend] Truncate history message when they are too long (#2470) by @Kedae in #2494
- [api/frontend] Remove entities after report deletion (#1468) by @SamuelHassine in #2524
- [tools] Fix on insert:dev by @Kedae in #2542
- [frontend] Hide background task when cannot update knowledge (#2535) by @SamuelHassine in #2539
- [api/frontend] Re-organize sightings menu, add attack patterns export button (#1182, #1991) by @SamuelHassine in #2538
- [api/frontend] Full refactor of the rules list screen (#2397) by @SamuelHassine in #2525
- [frontend] Adapt overview of objects lowering ID importance (#1781) by @SamuelHassine in #2489
- [back] Upgrade librairies + migration jest -> vitest by @richard-julien in #2552
- [api/frontend] Add country flag icons to IPv4/IPv6 observables (#1730) by @SamuelHassine in #2549
- [frontend] Add technical creator in data + ordering/filtering (#2029) by @SamuelHassine in #2495
- [api/frontend] New attributes for incidents (#2530) by @SamuelHassine in #2532
- [api/frontend] Enhance search screen with table and number of reports (#2336, #2263) by @SamuelHassine in #2557
- [frontend] Be able to expand all types of entity / relations in investigations (#1934) by @SamuelHassine in #2490
- [front] Add needed configuration for types by @Kedae in #2565
- [api/frontend] Add organizations restrictions on top of markings to increase data segregation possibilities (#2188) by @richard-julien in #2317
- [api/frontend] Status Template creation, deletion, edition (#1943) by @Archidoit in #2548
- Segregation upgrade by @richard-julien in #2573
- [back/frontend] Improve backend meta relationships creation and segregation rule by @richard-julien in #2576
New Contributors:
- @Kedae made their first contribution in #2440
- @kohsawa made their first contribution in #2455
- @Archidoit made their first contribution in #2471
- @RomuDeuxfois made their first contribution in #2527
- @SarahBocognano joined the team!
Full Changelog: 5.3.17...5.4.0