Skip to main content

Module 6: Enriched Entities

Generating Enriched Entities​

This module guides you through creating enriched entities using the Lucid Data Hub platform. Enriched entities are designed to combine and transform data from multiple sources for advanced reporting and analytics.

Step 1: Open the Enriched Data Modeling Section​

From the left sidebar, click on the Data Modeling icon. You will see a list of available entities, including fact and dimension tables.

Reference:
Data Modeling Entity List

Step 2: Select or Create an Enriched Entity​

Click on "Add Enriched Entities" to create a new enriched entity, or select an existing one from the list.

Provide the following:

  • Enriched Entity Name
  • Entity Type (e.g., Transaction or Reference)
  • Description explaining the purpose, granularity, and usage of the entity.

Review the Suggested Entities. You can also add or drop suggested entities, or even regenerate the entire suggestion list, by clicking on the refresh icon.

Reference:
Create or Select Enriched Entity

Step 3: Add Source Attributes​

For each source, click Add All Attributes of Entity to bring in required columns.

Reference:
Source Tables and Attributes

Step 4: Generate Relationships and Prompt​

Define relationships between entities by linking key attributes. Once done, review or generate the transformation prompt that describes:

  • Filters
  • Aggregations
  • Grouping logic

The prompt guides the platform in generating the correct transformation logic.

Reference:
Entity Relationships and Prompt

Step 5: Generate Code and Execute​

Click Generate Code to produce transformation logic using PySpark. You can edit the code before committing. After reviewing, click Commit Changes, then Execute to run the transformation and save the enriched entity.

Reference:
Generated Code and Execution

Summary of Steps​

StepAction
1Open Data Modeling section
2Create or select an enriched entity
3Add source tables and attributes
4Generate relationships and transformation prompt
5Generate, commit, and execute code

Enriched entities enable powerful analytical models by combining multiple canonical and transactional tables, applying transformations, and materializing the result in your data lake or warehouse.