3.2. red_params.conf Configuration¶

The red_params.conf file contains the primary configuration for the RED Lineage module. It is divided into sections such as [DEFAULT] and [REDLIN] to manage general settings and module-specific configurations.

3.2.1. [DEFAULT] Section¶

This section defines global default settings for the application.

log_level¶: Sets the global logging level for the application (e.g., INFO, DEBUG, WARNING).

exa_connection¶: The connection string, IP address, and port used to connect to the Exasol database.

exa_dbname¶: The name of the Exasol database to connect to.

3.2.2. [REDLIN] Section¶

This section contains parameters specific to the harvesting and processing behavior of the REDLIN module.

log_level¶: Sets the logging level specifically for the REDLIN module. Overrides the global setting if provided.

num_processes¶: Defines the number of parallel processes to use for harvesting Exasol lineage to improve performance. (e.g., 6).

max_task_per_child¶: Sets the maximum number of tasks a single child process can execute before it is recycled, helping to prevent memory leaks in large runs (e.g., 50).

instance¶: Specifies the target instance identifier or name for the lineage run (e.g., MGV-TEST).

mstr_connection¶: Specifies the Exasol connection name used by the tool to interface with MicroStrategy (e.g., redlin_mstr_rest_api).

mstr_projects¶: Defines the specific MicroStrategy projects to be harvested (e.g., BDR).

mstr_system¶: Sets the internal system name for the MicroStrategy environment (e.g., MSTR-OEAMTC-TEST).

exasol_system¶: Sets the internal system name for the Exasol data warehouse environment. If not set, the database name (db_name) is used by default.

exasol_user¶: The Exasol database user for the lineage operations. If not set, it defaults to redlin.

exasol_schema¶: The Exasol database schema where lineage objects are stored. If not set, it defaults to REDLIN.

push¶: A list of target systems to push the data lineage to (e.g., ['dataspot_interface']).

dataspot_interface¶: Configuration definition for the Dataspot interface, containing target SQL configurations for different layers (e.g., [{"target_sql": "LIN_SOURCES"}, {"target_sql": "LIN_EXASOL"}, {"target_sql": "LIN_MSTR"}]).