Spanish English German Portuguese
Spanish English German Portuguese

Kafka Connect Databricks Delta Lake Connector

Kafka Connect Databricks Delta Lake Connector

att_0_for_1846903047.png

Connector to send files, evidence, documents, and storage objects from GlobalSuite to Databricks Delta Lake or the defined destination system.

Tags: Data Warehouse | Cloud | Sink | Storage

Tool or system

Databricks Delta Lake

Tool manufacturer

Databricks

Connector provider

Confluent, Inc

Connector name

Kafka Connect Databricks Delta Lake Connector

Connector type

Sink

Tags

Data Warehouse | Cloud | Sink | Storage

Information it handles

files, evidence, documents, and storage objects

Details

The Kafka Connect Databricks Delta Lake Connector allows sending information related to files, evidence, documents, and storage objects from GlobalSuite to Databricks Delta Lake.

It is useful when Databricks Delta Lake must act as a destination, exploitation, archiving, or monitoring system for cases such as evidence retention, file exchange with third parties, document archiving, and subsequent analytical exploitation.

Features

  • Controlled sending of files, evidence, documents, and storage objects from GlobalSuite to Databricks Delta Lake or the defined destination repository.

  • Management of paths, folders, containers, or prefixes to organize information by process or period.

  • Compatibility with use cases such as archiving, evidence exchange, document backup, or subsequent exploitation.

  • Definition of formats, filters, and selection criteria to limit the volume imported or exported.

  • Traceability of which files have been processed, when, and with what result.

Key benefits

  • Facilitates preserving evidence and documentation in already governed corporate repositories.

  • Reduces manual file uploads and improves organization by process, third party, control, or period.

  • Supports retention, audit, and document backup policies with less operational effort.

  • Allows sharing information with internal areas or third parties using controlled locations.

  • Improves data preparation for reporting, data lake, or subsequent analysis.

Installation

Configuration note: Before activating the integration, validate credentials, permissions, functional scope, and a data test with the responsible area.

  1. Access the GlobalSuite® Marketplace and select Kafka Connect Databricks Delta Lake Connector.

  2. Configure the destination in Databricks Delta Lake: URL or endpoint, credentials, permissions, and environment.

  3. Define what information will be sent: files, evidence, documents, and storage items, filters, format, and frequency.

  4. Map the fields from GlobalSuite to the structure expected by the target system.

  5. Run a test, review the reception at the destination, and activate the integration.

More information

https://www.databricks.com/product/delta-lake-on-databricks

Use this connector when you need to send information from GlobalSuite to Databricks Delta Lake, for example, for evidence retention, file exchange with third parties, document archiving, and subsequent analytical exploitation. Before publishing it, validate with the team responsible for the destination system the expected format, permissions, frequency, and quality criteria.