Release 28.0

Dec 27, 2023

Release Overview:

Introduction of UsageMate for Accelario Masking and Virtualization Services

We are excited to announce the launch of UsageMate, our internal new statistics and usage service, as part of our ongoing commitment to enhancing the Accelario Test Data Platform. UsageMate is a centralized analytics and monitoring solution designed to provide in-depth insights into utilization patterns and operational performance, streamlining support for our clients.

Key Features of UsageMate:

  1. Near Real-Time Analytics: UsageMate offers near real-time analysis of data operations within the Masking and Virtualization services, enabling a deeper understanding of usage patterns and system efficiency. UsageMate is engineered to send action-related event data almost instantaneously, ensuring that critical operational information is relayed without delay.

  2. Data Collection with Privacy Focus: Respecting client privacy, data collection is secured and optional. Users can opt-in through the system parameters (option "Allow sending statistics to statistics server" ). Detailed information about the collected statistics and data protection measures are available in our documentation.

  3. Prerequisite for Activation: To fully benefit from UsageMate's capabilities, it is essential to enable the IP address of the UsageMate server from the instance of the installed Virtualization or Masking service. This step is crucial for activating the service and ensuring a seamless data flow between your systems and UsageMate.

  4. Operational Monitoring: The service includes robust monitoring capabilities, tracking running jobs, job statuses, and errors. This covers user actions, refresh, sensitive searches, and masking jobs.

UsageMate represents a significant advancement in our support infrastructure, offering near real-time analytics and enhanced operational monitoring. This service is a testament to our commitment to continuous improvement and client-focused innovation in database virtualization and masking solutions.

Overview:

Appendix. The new features tickets details:

Epic/Module

Story/Task

Description

Accelario statistics

https://accelario.atlassian.net/browse/IM-2394

POC consider AS implementation architecture

Accelario statistics

https://accelario.atlassian.net/browse/IM-2393

Implement new AS service core components

Accelario statistics

https://accelario.atlassian.net/browse/IM-2389

Send Masking configs to AS (Accelario Statistics) storage

Accelario statistics

https://accelario.atlassian.net/browse/IM-2390

Send Masking events to AS (Accelario Statistics) storage

Accelario statistics

https://accelario.atlassian.net/browse/IM-2391

Masking opt-in flag for sending statistics

Masking Engine

https://accelario.atlassian.net/browse/IM-2427

Refactoring of the Masking process with breakdown

Small enhancements

https://accelario.atlassian.net/browse/IM-2398

Add HELP link

Small enhancements

https://accelario.atlassian.net/browse/IM-2267

Masking Configurations. Show existing tags during modifying MC

Small enhancements

https://accelario.atlassian.net/browse/IM-2246

Environments. Execute refresh automatically after changing the XML/Json toggle from ON to OFF

Small enhancements

https://accelario.atlassian.net/browse/IM-2088

Data sources. Preset the default port for each DB type

Small enhancements

https://accelario.atlassian.net/browse/IM-2016

Change the info message about specific refreshed DS on Privacy Dashboard

Small enhancements

https://accelario.atlassian.net/browse/IM-1889

Add filter+sorting on the "masking rule" column in masking editor>table>columns grid

Small enhancements

https://accelario.atlassian.net/browse/IM-1834

Add search field for column names to masking editor page

Small enhancements

https://accelario.atlassian.net/browse/IM-1488

Put the message about necessity of finish the refreshing process of env

Appendix. Important fixed bugs details:

Epic/Module

Bug

Description

Small enhancements

https://accelario.atlassian.net/browse/IM-1610

Masking editor. Error 'Cannot read properties of underfined (reading ‘map’)' appears after applying all rules after sensitive search

HotFix

https://accelario.atlassian.net/browse/IM-2500

MSSQL Masking fails with connection error - (Eldan customer)

The list of new known issues found since the previous code freeze:

Issue key

Summary

Include to release notes

red mark (from previous notes)

IM-2517

Masking editor. Possible to start masking with empty required filed 'Parallel processes'

 

IM-2513

Intagration/Environments. Environment importing failed with error 'DocumentNotFoundException: Document to update was not found'

 

IM-2512

UsageMate. ObjectId is absent for some actions

 

IM-2504

Masking editor. Scroll is jupming down in the tree of tables during filtering

 

IM-2502

Masking editor. Attempt to start masking without rules finishes with 500 error

 

IM-2499

Data Sources. Incorrect port is shown for a user in Port field.

 

IM-2498

Data Sources. DS with incorrect credentials to connect dissapears from data source list

 

IM-2497

Remove real licenseid from example request of UsageMate

 

IM-2495

Environments. Schemas become unchecked after launching the refresh after interrupted one

 

IM-2494

Masking editor. Masking fail for Oracle with some Israeli rules with an error Cannot map Unicode to Oracle character

 

IM-2483

Environments. Refreshing starts after first renaming of the environment

 

IM-2480

Fixed size file with character set ISO-8859-8 (Hebrew) is returned from masking in UTF8

 

IM-2477

Jobs. When connection to DB is failed, running job still stays running

 

IM-2476

Environments. Impossible to create environment after editing DS to one with incorrect port.

 

IM-2470

Privacy Dashboard. DS, which was updated stays in the list of present Privacy Data Sources (FLOAT)

 

IM-2469

Masking editor. Preview masking. Error "java.sql.Timestamp cannot be cast to java.lang.String" appears when do preview with incorrect rule for date columns

 

IM-2466

Environments. API. Environment doesn't see schemas, tables when it created via API

 

IM-2465

Masking editor. Calculated Field. Column cannot refer to itself using Calculated Field

 

IM-2463

Environments. Performance. 500 error appears during the refreshing of more than 20k tables in 'Select tables' popup

 

IM-2455

Sensitive search. Different amount of sensitive columns after sensitive and privacy search (in comparison)

 

IM-2454

Environments. Long schema name overlaps table name in Select tables popup

 

IM-2453

Sensitive search. During Search operation 0/0 tables is shown during REFRESHING status

 

IM-2447

Environments. Modify button doesn't react to the first click

 

Testing status:

  • The manual regression tests -  completed 

https://docs.google.com/spreadsheets/d/1HUZOXP3eCKGH9kzF6RyTK9FHSm50fYbwjVn9qmNkPQQ/edit?pli=1#gid=0 Connect to preview

All critical bugs found during regression testing have been successfully fixed.

  • The automated smoke tests -  completed 

image-20231226-111545.png
image-20231226-111555.png

 

  • All supported versions have been tested and work as expected:

    • MongoDB v3.6/5/6

    • DB2 LUW v11.5

    • DB2 z/OS v11

    • Oracle v12cR2/19c RDS

    • MSSQL v2019/2016 RDS

    • PostgreSQL v13.2/14.3 RDS

    • MySQL v5.7/8 RDS

    • MySQL Aurora v5.7

    • SAP HANA v2.00.05

    • Fixed/CSV files

 

Post-release action items

Refer to the description of action items here https://accelario.atlassian.net/wiki/spaces/SDLC/pages/2024505345

Action item

Assignee

Date

Status

Action item

Assignee

Date

Status

1

Release notes

@Vladimir Garkusha

26/12/2023

Done

2

Release notes, overview

@Dima Urban (Unlicensed)

 

 

3

Internal dev demo

@Vladimir Garkusha

 

 

4

Update user manual

@Dima Urban (Unlicensed) @Vladimir Garkusha

 

 

5

Product demo

@Dima Urban (Unlicensed)

 

 

6

Update installation and upgrade guides

@Alexey Sosnovskih

 

 

7

API changes that break the previous version, add to release notes

@Andrew Shalimov

 

 

8

Update sandbox version

@Maksym Halytsia