Databricks Data Engineer Associate
Lakehouse, Spark, Delta Lake and pipelines on Databricks for the Data Engineer Associate exam.
Study & career skills · Intermediate · English · 133 videos · 7 h 32 min · videos by ExamPro
By the end you should be able to
- Explain the lakehouse architecture and Delta Lake
- Build ETL pipelines with Spark and SQL
- Run and govern production pipelines on Databricks
Watch in this order
- 1.Exam Guide Overview9 min
- 2.Audio Clipping Disclaimer1 min
- 3.Meet Your Instructor1 min
- 4.Dp 900: Data Overview1 min
- 5.Introduction to Data1 min
- 6.Data Types4 min
- 7.Schema vs Schemaless2 min
- 8.Data Documents1 min
- 9.Data Sets3 min
- 10.Query and Querying2 min
- 11.Batch vs Stream Processing3 min
- 12.Pivot Table2 min
- 13.Relational Data2 min
- 14.Relational Data Relationships1 min
- 15.Row Store vs Column Store2 min
- 16.Database Index1 min
- 17.Non Relational Data1 min
- 18.Data Integrity vs Data Corruption2 min
- 19.Normalized vs Denormalized Data1 min
- 20.Strongly Consistent vs Eventually Consistent1 min
- 21.DP 900— Synchronous vs Asynchronous2 min
- 22.Data Source1 min
- 23.Data Store1 min
- 24.Database1 min
- 25.Data Warehouse2 min
- 26.Data Mart1 min
- 27.Data Lakes1 min
- 28.Data Lakehouse1 min
- 29.Data Structures1 min
- 30.Azure Databricks2 min
- 31.Create a Databricks Account4 min
- 32.Setup Databricks on Azure4 min
- 33.DBUs and DSUs2 min
- 34.Budgets1 min
- 35.Create Budget and Consumption Dashboard3 min
- 36.How to Upgrade to Premium2 min
- 37.Medallion Architecture4 min
- 38.Control Plane vs Data Plane3 min
- 39.Cluster Types3 min
- 40.Types of Compute and Compute Policy1 min
- 41.Launch Compute AWS and Azure27 min
- 42.Workspace1 min
- 43.Creating Workspaces3 min
- 44.Notebooks1 min
- 45.Creating Notebooks2 min
- 46.Run Notebook within Databricks3 min
- 47.Jobs (part 1)1 min
- 48.Create a Job8 min
- 49.Repos1 min
- 50.Repos vs Git Folder1 min
- 51.Create a Git Folder11 min
- 52.Magic Commands1 min
- 53.Practice Magic Commands27 min
- 54.What is Git?4 min
- 55.Repo vs Native Notebook versioning2 min
- 56.Compare Native Notebook7 min
- 57.Delta Lake1 min
- 58.Running PySpark Delta Lake Locally26 min
- 59.ACID Transactions2 min
- 60.Transactions and Constraints36 min
- 61.Delta Lake Time Travel2 min
- 62.Time Travel Table and Declaring Setting Variables20 min
- 63.Optimization1 min
- 64.VACUUM1 min
- 65.Delta Lake Write and Load Commands1 min
- 66.Use Write and Load Commands29 min
- 67.Delta Lake Statements3 min
- 68.Apache Spark1 min
- 69.Apache Spark Cache Statements3 min
- 70.RDD API1 min
- 71.PySpark1 min
- 72.Array Functions in Databricks1 min
- 73.Deduplication and Validation Logic1 min
- 74.Timestamp and String Functions1 min
- 75.Regex Pattern1 min
- 76.Dot Syntax1 min
- 77.Explode vs Flatten1 min
- 78.Count if and cloud is null1 min
- 79.What is a Table in Databricks1 min
- 80.Delta Table Operations1 min
- 81.Create Table From External Sources1 min
- 82.External Tables1 min
- 83.Working with Views in Databricks1 min
- 84.Create Table As Select1 min
- 85.Generated Columns1 min
- 86.Add Table Comments1 min
- 87.DML Statements3 min
- 88.SQL Commands and Logic1 min
- 89.Pivot Clause in SQL1 min
- 90.CASE When in SQL1 min
- 91.JOIN in Spark SQL1 min
- 92.LEFT Join Example2 min
- 93.SQL Describe6 min
- 94.UDFs1 min
- 95.File Handling in Databricks1 min
- 96.File Format Prefix in Databricks1 min
- 97.Triggers in Structured Streaming1 min
- 98.Watermarking and Late Data Handling1 min
- 99.Output Modes in Streaming1 min
- 100.Triggered vs Continuous Pipelines1 min
- 101.Auto Loader3 min
- 102.S3 Import Data57 min
- 103.Delta Live Table1 min
- 104.Notebook Libraries and Targets1 min
- 105.Delta Live Table Syntax1 min
- 106.Violations in Delta Live Tables1 min
- 107.Change Data Capture (CDC)1 min
- 108.Error Diagnostics in DLT Pipelines1 min
- 109.DLT Event Log1 min
- 110.Jobs (part 2)2 min
- 111.Monitoring Jobs and Failure Alerts2 min
- 112.Debug Fail tasks using logs and history1 min
- 113.Visualization with SQL Editor1 min
- 114.Scheduled Dashboards for Updates1 min
- 115.Unity Catalog2 min
- 116.Databricks 3 level namespace1 min
- 117.Data Lineage1 min
- 118.Unity Catalog Tables5 min
- 119.Unity Catalog Views1 min
- 120.Unity Catalog Volumes1 min
- 121.Access Control Scope1 min
- 122.RBAC1 min
- 123.Fine grained access controls1 min
- 124.Service Principals1 min
- 125.Isolate Business Unit1 min
- 126.Unity Catalog Best Practices1 min
- 127.Connect1 min
- 128.Install VSC Databricks and Connect to Cluster6 min
- 129.Run Code Using Databricks Connect4 min
- 130.Metastore1 min
- 131.Pools1 min
- 132.Photon1 min
- 133.Photon Checkbox1 min
Before you start: SQL basics · Some Python
skillspring · Videos belong to ExamPro and play from YouTube. Printed for personal study.