Release Overview
Overview:
Calculated filed rule
Accelario is pleased to announce a significant update to our Masking Service by introducing the Calculated Field Rule feature. This enhancement expands our data privacy capabilities by enabling cross-column masking functionality.
Key Features:
The calculated field rule introduces the ability to define masking logic that considers the values of multiple columns, allowing for dynamic masking outputs based on interdependent data within the same record.
This helps us to tailor the masking process to accommodate complex privacy requirements where sensitive data is spread across several fields.
Enhanced data correlation - our previous single-column masking approach is now enriched to address scenarios requiring correlated data considerations.
Contains an embedded JavaScript-based expression builder to craft custom masking rules, allowing for a vast range of complexities in data masking logic.
Users can develop masking rules that range from straightforward to highly sophisticated, ensuring flexibility in addressing unique data scenarios.
This feature update significantly strengthens our Masking Service, offering users the ability to create complex masking rules with an advanced JavaScript-based expression builder. Customers now have the flexibility to design a wide spectrum of data masking rules – from the simplest to the most complex – ensuring precise and compliant data privacy across various scenarios.
Masking preview
Accelario has introduced the Masking preview feature, a pivotal update to our Masking Service that provides a real-time, in-memory testing environment for data masking.
Key Features:
Users can now perform test masking operations on a selected subset of data directly within the system's memory.
The outcomes of masking rules are immediately visible within the Masking service UI for quick verification.
This feature allows for a non-destructive preview, ensuring that data integrity is maintained during the testing phase.
Benefits:
Immediate validation. Users can quickly validate the impact of masking rules without having to process the entire dataset.
Efficiency. This preview capability saves time by identifying issues before the full masking operation commences.
Risk reduction. By confirming the effectiveness of masking rules beforehand, the risk of data loss or compliance issues in the actual masking process is greatly minimized.
With the 'Masking Preview' feature, users gain a powerful tool to ensure their data masking rules are precise and effective, boosting confidence in Accelario Masking service before committing to large-scale masking operations.
Appendix. The new features tickets details:
Epic/Module | Story/Task | Description |
Calculated field | POC: Choose and consider proper dev library for the calculated field | |
Calculated field | Input window for calculated field rule without wizard helpers and validations | |
Calculated field | Input window for calculated field rule for XML/JSON embedded structures | |
Calculated field | Implement basic validation for Masking calculated fields | |
Preview Masking | Implement Preview masking for testing | |
Masking Engine | Metrics for Masking | |
Small enhancements | Remove default Incremental flag from the SDS Masking | |
Masking Engine | Change the minimum PG version support |
Appendix. Important fixed bugs details:
Epic/Module | Bug | Description |
Small enhancements | User management. The password policy is not obeyed while creating new user. | |
Small enhancements | Progress monitor. Error about empty table is not clear | |
Small enhancements | When the env is created automatically (after DS creation) the empty schema should not be added | |
Small enhancements | Job Monitoring. Active Sensitive Search jobs are jumping in the job monitoring screen | |
Special characters | Special characters. Issues with usage of symboled databases by masking application | |
Special characters | Environments. 500 Error appears when we are calling the schemas for DS during creation of environment (Oracle DB) | |
Special characters | Environments. Error 500 appears when we are calling the schemas for DS during creation of environment (MySQL) | |
Masking rules | Long values (more than 9 digits) are identified as Israel national id (teudat zehut) |
The list of new known issues found since the previous code freeze:
Issue key | Summary | Include to release notes red mark (from previous notes) |
IM-2455 | Sensitive search. Different amount of sensitive columns after sensitive and privacy search (in comparison) | |
IM-2454 | Environments. Long schema name overlaps table name in Select tables popup | |
IM-2453 | Sensitive search. During Search operation 0/0 tables is shown during REFRESHING status | |
IM-2447 | Environments. Modify button doesnt react to the first click | |
IM-2437 | Masking editor. MongoDB. Masking cannot be provided for some cases, when we use fields with special characters | |
IM-2433 | Masking editor. Preview masking. Table becomes corrupted (UI) when using sorting | |
IM-2424 | Masking editor. Preview masking. Rendering doesnt work properly in Preview Masking popup | |
IM-2417 | Masking editor. Preview masking. Aggregated warnings in XML embedded masking preview for single records | |
IM-2414 | Masking editor. "Apply" option applies/removes rule to all members of FK by confirmation popup | |
IM-2413 | Masking editor. VIN rule doesnt work during masking | |
IM-2411 | Masking editor. Preview masking. Issues with displaying of preview in MongoDB | |
IM-2410 | Masking. "Masking error: Unable to retrieve data from the source." appears during masking (MSSQL) | |
IM-2408 | Masking editor. Preview masking. Ugly scroller for values in Preview Masking popup | |
IM-2404 | Masking editor. Preview masking. Vertical scroll for Preview masking popup is not allways shown | |
IM-2402 | Progress monitor. Error 404 "Masked file 'somename.masked' was not found" appears when application opened in 2 tabs simultaniously during masking files | |
IM-2403 | AI scan identifies HR.EMPLOYEES.EMAIL as USA States 100%, but the data inside does not look like it | |
IM-2386 | Masking editor. Masking Editor. Wrong placing of the name of environment for FIXED, CSV files | |
IM-2379 | Masking editor. Calculated field. Expression parameter is not availible after loading Masking Configuration | |
IM-2378 | Masking editor. Calculated field. Masking is COMPLETE successfully in the app when there is no expression for CF | |
IM-2363 | Masking editor. Calculated field. Masking with Calculated field is possible for FK group | |
IM-2362 | Masking performance test. Deadlocks on MS SQL Server on "100K tables" stage. | |
IM-2350 | Environments. Schema null is added automatically during creation of environment with all schemas | |
IM-2349 | API. Masking editor. Deactivated table in tree isnt become activated after refresh environment operation and further activation | |
IM-2346 | Masking Editor. "schemaName": "null" is present in tree when we call all tables with schemas in editor | |
IM-2343 | Environments. After renaming the DS, its environment starts to be empty (with schema but without tables) | |
IM-2341 | Environments. Columns are not adding/deleting in editor automatically if we refresh the environment in Select tables popup | |
IM-2337 | Sensitive Search. Policy with a long name doesnt fit the screen | |
IM-2336 | Sensitive search. AI Scan. Incorrect results from AI Scan | |
IM-2329 | Sensitive search. PENDING status is shown after attempt to launch scan on environment during its creation |
Testing status:
The manual regression tests - completed
https://docs.google.com/spreadsheets/d/1HUZOXP3eCKGH9kzF6RyTK9FHSm50fYbwjVn9qmNkPQQ/edit?pli=1#gid=0 Connect to preview
All critical bugs found during regression testing have been successfully fixed.
The automated smoke tests - completed
All supported versions have been tested and work as expected:
MongoDB v3.6/5/6
DB2 LUW v11.5
DB2 z/OS v11
Oracle v12cR2/19c RDS
MSSQL v2019/2016 RDS
PostgreSQL v13.2/14.3 RDS
MySQL v5.7/8 RDS
MySQL Aurora v5.7
SAP HANA v2.00.05
Fixed/CSV files
Post-release action items
Refer the description of action items here /wiki/spaces/SDLC/pages/2024505345
Action item | Assignee | Date | Status | |
|---|---|---|---|---|
| 1 | Release notes |
|
| |
| 2 | Release notes, overview |
|
| |
| 3 | Internal dev demo | ? | ||
| 4 | Update user manual |
| ||
| 5 | Product demo |
| ||
| 6 | Update installation and upgrade guides | |||
| 7 | API changes that break the previous version, add to release notes | |||
| 8 | Update sandbox version |
|
|
