Release Notes

TV_4.0.0

01092 - CT_WATCH as Watcher process
ct_watch has been changed from job to watcher to enable parallel execution

01858 - Oracle CDC
Change Tracking (CT) for Oracle is implemented.

02034 - Correction Response Header content-type (REST)

02235 - RED License Check
RED framework now needs a valid license which is bound to the raw data size license of Exasol

02514 - LDR Names UpperCase
CFI and DBI loader names can only be found in upper case, creation converts the name into upper case

03215 - CDCG_SYNC as Watcher process

04343 - Check email adresses in action parameter for recipients
check if mail recipients are correct by checking the syntax for RFC standard

04540 - SCURTY - issue on user account creation
Fixed an issue where creating a user whose name contains a “.” succeeded, but the creation of the user’s private sandbox schema failed because the schema name was not enclosed in double quotes.

04867 - Fix column ordering in CREATE_TSA_TABLES for Oracle source
Resolved an issue where column order was ignored during execution of CREATE_TSA_TABLES when targeting Oracle sources. Column ordering is now correctly preserved.

05142 - Configure WETX timeout in red_params

05192 - restctl: error on initial password reset “restctl start” now resets redsys password correctly

05203 - Remove REPPSA refresh from OPEN_BV script
To reduce wait times, REFRESH call removed from OPEN_BV script. Refresh is finally done with the compile.

05206 - Refactoring RED Deployment
For detailed information, please refer to the RED documentation.

05248 - PSA/TSA_CONTROL Housekeeping
Fix in housekeeping for failed control entries

05330 - REDGPR - fixes and adjustments
some fixes and adjustments, e.g. extended check view, and startup checks

05332 - SCURTY.S_REP_REFRESH fails to create PSV-Views Fixed Security View Generation: Security views are now correctly generated in scenarios where only column-level security is applied without any row-level security.

05348 - RED Python SLC
Setup Python Container Language Landscape

  • PYTHON3 - Standard Exasol Language Container

  • SXPY - Sphinx Python3 Language Container for Customer

  • REDPY for RED Framework

New REDSYS.STA_LIST_PY_PACKAGES View providing PY Package Versions

05360 - PSA_OBJECT_DELIVERY - more info on status NOT SCHEDULED (e.g. blocked by patch)
PSA_OBJECT_DELIVERY won’t show reason for NOT SCHEDULED status, if object load is blocked by patching or application action

05412 - Problem with BDATE EXPR and BDATE_INIT_EXPR
Fixed an issue where using the same position numbers as placeholders in both API calls caused the BDATE expression to be generated incorrectly in the DV view.

05486 - DBIADM: CDCG_WATCH –> CDCG rename
All objects in DBIADM that contain %CDCG_WATCH% have been renamed to %CDCG%.

05495 - DBI_LOADER_REFRESH - Exasol Bug EXA_ALL_COLUMNS
As there is an Exasol Bug in EXA_ALL_COLUMNS workaround in DBI refresh implemented

05512 - Enforce TSA Naming Convention

  • LDR_NAME data type changed from VARCHAR(128) to VARCHAR(64).

  • TSA_SCHEMA is now replaced by TSA_SCHEMA_SUFFIX. If the suffix is null, the object will be created in the default TSA layer (CFITSA/DBITSA). Otherwise the name will be generated by using CFITSA_<TSA_SCHEMA_SUFFIX> or DBITSA__<TSA_SCHEMA_SUFFIX>.

  • TSA_TABLE is now generated by using the pattern: BDOMAIN || ‘_’ || LDR_NAME. Existing TSA table names will stay.

  • The view CFI/DBI_LOADER_DETAILS shows these generated names.

  • New CREATE_TSA_SCHEMA API is now available in CFIADM and DBIADM
    Use Case: This is required for schema creation during specific events, such as UDF (User Defined Function) deployments.

05516 - REPPSA - changes in newcol expression, using TRIM Flag and BSK

  • Fixed an issue where creating a newcol expression for a TSA object with TRIMCHARS = true caused duplicate entries in the REPPSA views.

  • Fixed an issue where disabling the TSA column expression and using only newcol_expr caused the expression to be missing from the BSK.

05538 - Handling of Errors in application actions

  • Do not repeat failed action if the action was deactivated

  • new API for managing ERROR-Entries

05539 - APP_ACTION SEXEC: remove socket timeout
For Script Actions, execution must always wait until completion; therefore, no timeout should be set.

05608 - REDADM - new logic for handling loading error “BSK is NULL”
Introduced a dedicated ERR view for loading the Error Table. Previously, error records were selected from the DV view based on records where the BSK was NULL. Adjusted REPPSA processing so that only the BSK columns are checked for NULL and returned. Refactored P_REDPSA_CONTROL to use the new Error View.

05609 - PSA_LOAD - changes in grouping of loading multiple dates or domains in PSA
Added the PSA_LOAD_GROUP_THRESHOLD parameter to define the maximum number of TSA rows for which multiple BDates and BDomains can still be grouped. Above this threshold, PSA loading remains in individual processing mode.

05713 - Application Action: Export empty file
Added the new SKIP_ON_EMPTY flag to control whether empty files should be generated and sent.

05716 - REPPSA - DV View adjustment to handle ACTIVE expression
Adjusted the generation of the DV view in the repository to support the new handling of the ACTIVE expression.

05897 - Lineage Module
Lineage Module is now available

05928 - Autofill Missing Days automatically active
When a data load in DBIADM experiences missing BDATEs, the chronological gap between the dates is now automatically populated with virtual entries to ensure data continuity.

05951 - Changes in Loadtype INFU

  • Optimized Deletion Detection: The incremental loading process into the Persistent Staging Area (PSA) for INFU (which operates as a source-side daily full snapshot) now accurately detects and closes deleted rows when a data load contains multiple business dates (BDATEs) at once.

  • Flexible Date Mapping: Introduced an option to explicitly determine whether the Control BDATE should also be utilized as the Effective BDATE.

05991 - Historization in DV view - fix Boolean Column Compare
Adjusted DV view historization for Boolean values so that changes from NULL to TRUE and from TRUE to NULL are not historized.

05992 - Changes in REPPSA - seperate ACTIVE from Change Tracking expression
Changed active flag to use the default CT active expression. Added/adjusted the historization comment. Fixed the RED_PSA_RUN_VALIDATE expression in the DV view

06065 - IGNORE flag - check on running Framework in API S_DBI_LOADER_IGNORE
when using API S_DBI_LOADER_IGNORE:

Added a check for ignored APIs. The action can only be executed when the FW is stopped. Since the DBI_CDC_LOG view checks the IGNORED flag, the flag must also be considered in the CDC_LOG_DETAILS_PARTITION_ID view. Adjusted the repartition script accordingly.

06066 - REPPSA - cleanup old BVs
REPPSA will only keep the data of the last two business versions.

06076 - Fix RED_FINISHED_OBJECTS_PENDING view
Resolved an issue in the RED_FINISHED_OBJECTS_PENDING view where TSA status was incorrectly ignored when multiple TSA objects shared the same business domain (BDOMAIN).

06077 - Fix RED_PSA_OBJECT_DELIVERY view
Resolved an issue in RED_PSA_OBJECT_DELIVERY where duplicate rows were generated when multiple TSA objects shared the same business domain (BDOMAIN).

06097 - DQ Framework
Introduced Data Quality (DQ) checks as a new feature in the RED Framework. DQ checks can now be configured and evaluated before Application Actions are executed. Based on the DQ check result, the corresponding action is either executed or blocked.

06128 - List-based incremental loading in DBIADM
List-based incremental loading (SRC_INCR_DATATYPE = ‘L’) is now available in the DBIADM database loader framework.

Key Features & Logic:
- Added a new column `INCR_CHAR_LIST_SQL` to store the query returning the list of character values to be loaded.
- Loader only performs data import for values returned by `INCR_CHAR_LIST_SQL` that are not already present in the partition log table `dbi_cdc_incr_log_#`.
- Seamlessly handles sequential fallback execution when `SPLIT_ON_LOAD_ABORT` is enabled and load abort occurs, processing list items top-down in the query’s presorted order.
- Created API procedure `IGNORE_CDC_INCR_VALUES` to clear loaded values from the log, enabling them to be re-imported on the next load run.

06204 - Suppression of “WAIT FOR COMMIT” on SELECT Queries
Under certain conditions, read queries can trigger a WAIT FOR COMMIT lock in Exasol (Exasol KB Article). To prevent this issue, the loading process for all tables underlying a materialization is now paused until the necessary transactions are completed.

06213 - adjust EV, DV Views for ACTIVE Flag on CT
Adjusted DV and EV view handling related to Change Tracking (CT), Added proper handling of the ACTIVE expression / CT flag as RED_ACTIVE in EV views. Fixed the distinction between a NULL BSK caused by missing source data and a NULL BSK caused by missing Change Tracking information. Records affected by CT must still be historized and closed correctly even if the BSK becomes NULL.

06219 - Grouping of CDCG watch statements per source
Updated watch ID determination to process queries per source in a single statement. This significantly reduces the total number of database queries executed during CDCG evaluation.

06227 - Optimize P_DBI_CDC_SYNC by conditionally evaluating row count and min/max values
Modified row count and min/max value queries in P_DBI_CDC_SYNC to execute on demand during splits rather than before every data import, reducing unnecessary query execution.

TV_4.0.1

06444 - REDLIN: Missing Foreign Key

06449 - EXASYS: EXA_CLUSTER_DB_SIZE_DAILY

06450 - Fix RED_APP_ACTION_STATUS
too many rows selected, only last status should be in the resultset

06451 - Fix RED_PSA_OBJECT_STATUS
missing Error Code and Error information in status view

06486 - Standardize nomenclature for materialization actions
Renames materialization application actions from RED_MATERIALIZE% to RED_APP_MAT% to align with the standard naming convention.

06488 - Integrate RED_PSA_OBJECT_DELIVERY into RED_OBJECT_STATUS
Integrated the logic of REDADM.RED_PSA_OBJECT_DELIVERY into RED_OBJECT_STATUS and removed the obsolete view.

06489 - REDLIN: Live Lineage