Databricks Connector for Apache Kafka
|
Databricks is the data and AI company. Founded by the creators of Apache Spark™, Delta Lake and MLflow, organizations like Comcast, Condé Nast, Nationwide and H&M rely on Databricks’ open and unified… Tags: Data Warehouse | Cloud |
|
Tool or system |
Databricks for |
|
Tool manufacturer |
Databricks |
|
Connector provider |
Databricks |
|
Connector name |
Databricks Connector for Apache Kafka |
|
Connector type |
Not specified |
|
Tags |
Data Warehouse | Cloud |
|
Information it handles |
datasets, tables, and analytical data |
Details
The Databricks Connector for Apache Kafka allows integrating GlobalSuite with Databricks for exchanging relevant information for corporate processes.
It is applicable to executive reporting scenarios, risk dashboards, data consolidation, and historical analytics, reducing manual workloads and improving traceability.
Features
-
Integrated management of datasets, tables, and analytical data between GlobalSuite and Databricks for.
-
Preparation of datasets for reporting, dashboards, historical analysis, or business intelligence.
-
Mapping of tables, schemas, fields, or partitions according to the agreed analytical model.
-
Support for incremental or periodic loads to keep exploitation data up to date.
-
Separation between operational information and analytical layer to facilitate governance and performance.
Key benefits
-
Allows exploiting data from GlobalSuite and related systems in BI and analytics tools.
-
Accelerates the creation of executive dashboards on risks, compliance, auditing, or operations.
-
Reduces dependency on manual extractions for recurring reporting.
-
Facilitates historical analysis, comparisons, and trend tracking.
-
Helps separate daily operational management from the analytical layer used by management and reporting.
Installation
|
Configuration note: Before activating the integration, validate credentials, permissions, functional scope, and a data test with the responsible area. |
-
Access the GlobalSuite® Marketplace and select Databricks Connector for Apache Kafka.
-
Configure the connection with Databricks for: URL or endpoint, credentials, permissions, and environment.
-
Define the functional scope: datasets, tables, and analytical data, filters, and frequency.
-
Set up field mapping and review the configuration validation.
-
Run a test, review results, and activate the integration.
More information
https://www.databricks.com/product/delta-lake-on-databricks
Recommended use in GlobalSuite
Use this connector when you need to integrate Databricks for with GlobalSuite processes, for example, for executive reporting, risk dashboards, data consolidation, and historical analytics. Define scope, responsibilities, and validation criteria before activating it.