Skip to main content
Version: devel

Configure credentials and pipelines

The configuration mechanism in dlt provides a flexible, secure way to define credentials to external systems and other settings separately from your code.

Key features​

  1. Separation of secrets and configs from code - The main role of the configuration system is to keep sensitive information out of your source code.

  2. Built-in credentials - dlt provides built-in support for most common systems with default/machine credential access.

  3. Auto-generated configurations - For functions decorated with @dlt.source, @dlt.resource, and @dlt.destination, dlt automatically generates appropriate configuration specs so they behave like built-in configs and credentials.

  4. Comprehensive configurability - Nearly all aspects of dlt are configurable, including pipelines, normalizers, loaders, and logging, allowing you to change behavior without modifying code. This capability enables performance optimization and other adjustments at runtime.

This demo works on codespaces. Codespaces is a development environment available for free to anyone with a Github account. You'll be asked to fork the demo repository and from there the README guides you with further steps.
The demo uses the Continue VSCode extension.

Off to codespaces!

DHelp

Ask a question

Welcome to "Codex Central", your next-gen help center, driven by OpenAI's GPT-4 model. It's more than just a forum or a FAQ hub – it's a dynamic knowledge base where coders can find AI-assisted solutions to their pressing problems. With GPT-4's powerful comprehension and predictive abilities, Codex Central provides instantaneous issue resolution, insightful debugging, and personalized guidance. Get your code running smoothly with the unparalleled support at Codex Central - coding help reimagined with AI prowess.