Release 21.0
- Vladimir Garkusha
January 1, 2023
Release Overview
The new features:
Epic/Module | Story/Task | Description | Comments / Source |
MongoDB Support | As a PM I want to release a full flow MongoDB MVP release so it can be demonstrated to prospects |
| |
MongoDB Support | Add and manage a MongoDB Data Source |
| |
MongoDB Support | Add and manage a MongoDB Environment |
| |
MongoDB Support | Scan a MongoDB environment for sensitive data |
| |
MongoDB Support | Edit the rule assignment of a MongoDB environment and perform masking |
| |
MongoDB Support | MongoDB support in Privacy dashboard |
| |
Environment Management | Simplify the process for creating and managing environments for a subset of tables |
| |
Custom Rules | As an admin I want to modify a custom rule | from previous sprint | |
Sensitive Search | Control the scan process to reduce false negative results by defining a sensitive search threshold by the user | from previous sprint | |
Sensitive Search | Add the column that shows selected for masking in the csv files so it can easily be removed or filtered | from previous sprint - Bank Leumi | |
Progress Monitor | Make clear why table is shown as skipped in the monitor | Michael | |
UI Design | Set cursor to first field when opening a screen | QA enhancement | |
Progress Monitor | Warnings about non-masked values are not present near the status if masked In Postgres |
| |
MongoDB Improvements | Hide not supported buttons for MongoDB | QA Enhancement |
Important fixed bugs:
Epic/Module | Bug | Description | Customer / reporter / comments |
Data Source | Wrong error message is shown on failure to test connection (Bug) |
|
The list of known issues found since the previous code freeze:
Issue key | Summary |
IM-1929 | Privacy Dashboard. Top sensitive data results dont appear during privacy search. |
IM-1928 | Environments. Empty Environments field validation is triggered on selecting data source |
IM-1926 | Masking editor. Mask pop-up. Incorrect list of disable database object for partial schemas |
IM-1925 | Sensitive Search. Search results are not correct on Search dashboard after changing environment |
IM-1924 | Environments.Issues with environment after changing port for DS |
IM-1917 | Masking editor. Methods proposed for empty string |
IM-1916 | As an admin I want to see clear errors so that I can understand the problem |
IM-1915 | As an admin I want to see a notification for any change that affects the Privacy Dashboard so that I can follow the data |
IM-1914 | Environment. Add enviroment pop-up. User can't redirect to environment page after first click on the cancel button |
IM-1912 | Refresh all datasources operation failures after environment reinstall |
IM-1911 | Masking editor. JSON data inside the cell becomes cut after masking (MSSQL) |
IM-1910 | Masking editor. XML data is transformed from column view to string after masking (MSSQL) |
IM-1899 | Sensitive Search. MongoDB. Array/arrays inside array is not found in search |
IM-1888 | Masking rules. "Column' tag is present for dataregexp rule Medicare Beneficiary Identifier (MBI) |
IM-1887 | Masking rules. Uploaded list is not shown on UI for rule in modifying popup |
IM-1886 | Progress monitor. Incorrect error message in warning for Mongo DB |
IM-1879 | Privacy Dashboard. MongoDB. System collections are not hidden in dashboard |
IM-1869 | Masking editor. MongoDB. Masking error: 'Invalid BSON field name email@email.com' appears during masking |
IM-1863 | Sensitive search. MongoDB. DATETIME datatype is shown instead TIMESTAMP in the results of sensitive search for TIMESTAMP values |
IM-1855 | Sensitive search. MongoDB. Timestamp keys is not shown in search results, timestamp datattype is notsupported |
IM-1854 | Masking editor. MongoDB. Rules are shown for unsupported type (null) in mongo db |
IM-1850 | Primary key is enabled after masking, even when it was disabled before |
IM-1849 | Progress monitor. MongoDB. Incorrect count of documents |
IM-1847 | Invalid reporting of warning for "mask an value" |
IM-1844 | Sensitive search. MongoDB. Weight rule is trigerring for MedicalRecordNumber column (mongodb) |
IM-1843 | Sensitive Search. Phone Number ruler behaves not correct |
IM-1835 | Masking editor. It is possible to mask column with unsupported datatype |
IM-1830 | As an admin I want to see all the data sources so that I can't miss information in the privacy dashboard |
IM-1827 | Error message for connection does not show correct message in UI |
IM-1824 | Environments. 10/7 is shown for environment after many changes of selection the collections |
IM-1799 | Environments. Environment is not created when during modifying DS user ticks 'Create environment' checkbox |
IM-1798 | Environments. 0/137 tables displayed for schema in environment which can be created |
IM-1796 | Environments. Error '500 Internal Server Error' appears when trying to create second env with left tables |
IM-1795 | Environments. Select all checkbox in Schemas doesnt work if environment was created together with DS and user switches between daasources |
IM-1792 | Environments. Schemas for DS are displayed with a bigger delay after creating full env for it |
IM-1790 | Environments. It is possible to select selected earlier schemas for new env |
IM-1780 | Privacy Dashboard. Full Refresh was not performed for the entire data source right after the data source with environment had created |
IM-1779 | Data Sources. Test connection for db is proceeding when user goes back to Add Data Source first popup stage |
IM-1771 | Progress Monitor. STOPPING 0% status is shown for stopped already masking job |
IM-1769 | Masking editor. Openning of masking editor page is slow if we have big db. |
IM-1768 | Masking Editor. OutOfMemoryError appears when do masking for 40k tables |
IM-1767 | Sensitive search. Error "Error during performing request: Can not find object with name: IM1569SCHEMA1. It has been logged (ID 48585e96a716cd20)." appears while doing search |
IM-1765 | Sensitive search. Long REFRESHING 100% is displayed for a user during the ending of refresh job |
IM-1764 | Privacy Dashboard. Data after long Scan all operation is not displayed after switching on Dashboard from other screen |
IM-1763 | Job Monitoring. Active Sensitive Search jobs are jumping in the job monitoring screen |
IM-1762 | Environments. Sometimes it is not possible to stop the import by clicking on 'Stop' button for environment. |
IM-1760 | Privacy Dashboard. Privacy Search start is postponed after clicking on Scan button |
IM-1751 | Sensitive search. No information in details when too much sensitive data was found |
IM-1750 | Sensitive search. Incorrect status on a progress bar during search, when switching between environments |
IM-1748 | Masking rules. SSN Numeric Column rule triggers to columns with 'ID' |
IM-1746 | Logs. Logs are shown and downloaded with delay in show logs popup |
IM-1745 | Masking of onenamed keys in a different columns is not correct |
IM-1738 | Sensitive Search. Deleted custom rule is present in search results without it |
IM-1731 | Proposed Masking Method cannot be switched with rule with highest probability |
IM-1730 | Environments. After deleting all tables from db, env without selected tables in partial mode shows not correct amount of tables selected |
Testing status:
The regression tests - completed
https://docs.google.com/spreadsheets/d/1HUZOXP3eCKGH9kzF6RyTK9FHSm50fYbwjVn9qmNkPQQ/edit?pli=1#gid=0 Connect to preview
All critical bugs found during regression testing have been successfully fixed.
All supported versions have been tested and work as expected:
MongoDB v3.6
DB2 LUW v11.5
DB2 z/OS v11
Oracle v12cR2
MSSQL v2019
PostgreSQL v13.2
MySQL v5.7
MySQL Aurora v5.7
SAP HANA v2.00.05
Fixed file
CSV file