D2X Technologies, Data to Excellence

Coming soon, join the waitlist

Data Engineering with Databricks on AWS

Lakehouse engineering with Databricks native tools on AWS.

Level
Intermediate
Duration
To be announced
Format
Live online, instructor-led
Timing
To be announced

Course at a glance

Data Engineering with Databricks on AWS is an upcoming live online course by D2X Technologies covering Delta Lake, Unity Catalog, Spark and Databricks SQL through projects. Dates will be announced soon; the waitlist is open.

Duration
To be announced
Mode
Live online, instructor-led
Timing
To be announced
Level
Intermediate
Prerequisites
Spark basics help.
Project
Medallion pipeline
Key tools
Databricks, Delta Lake, Unity Catalog, Apache Spark, Databricks SQL, MLflow
Next batch
To be announced, join the waitlist
Fee
Shared on WhatsApp or the demo call
Free demo
Join the waitlist to hear first

About this course

A hands-on workshop on scalable lakehouse architecture with Databricks on AWS. Spark transformations, Delta Lake, governance with Unity Catalog and analytics that bridge data engineering with machine learning.

DatabricksDelta LakeUnity CatalogApache SparkDatabricks SQLMLflow

Who this is for

  • Data engineers who know Spark basics and want Databricks skills
  • AWS data engineers adding Databricks to their profile
  • Analysts and ML engineers who work on shared lakehouse data

What you will be able to do

  • Design a medallion lakehouse on Databricks
  • Build Delta Lake pipelines with reliable incremental loads
  • Govern data access with Unity Catalog
  • Schedule and monitor jobs in Databricks
  • Serve analytics with Databricks SQL

Syllabus

  1. 1

    Databricks on AWS setup

    • Workspace, clusters and compute
    • Connecting to S3 securely
  2. 2

    Spark on Databricks

    • Notebooks and repos
    • Transformations at scale
  3. 3

    Delta Lake

    • ACID tables and MERGE
    • Optimize, Z-order and vacuum
  4. 4

    Governance

    • Unity Catalog
    • Lineage and permissions
  5. 5

    Pipelines and jobs

    • Declarative pipelines
    • Job scheduling and alerts
  6. 6

    Analytics and ML bridge

    • Databricks SQL
    • MLflow introduction

Projects you will build

Project 1

Medallion pipeline

Bronze, silver and gold layers on Delta Lake with data quality checks at each step.

Questions about this course

When does this batch start?+

Dates will be announced soon. Join the waitlist and you will hear first, with an early joiner offer.

Should I finish the AWS course first?+

It is not required, but Spark basics help. Our team can guide you on the right order in a free call.

Other courses

Same data. Bigger opportunities.

Book the free live demo or WhatsApp us. We will suggest the right path for your background and goal.