Data Engineer Guide - DataTribe Learning Platform

🚀 Get Started in 3 Steps

1

Access Databricks Workspace

🔐 Don't Have Access Yet?

📝 Request Workspace Access

Or email: datatribe.collective@gmail.com

Choose Your Workspace Option:

RECOMMENDED

✅ Option A: Provided Workspace

✅ All 27 course notebooks pre-loaded
✅ Unity Catalog & reference data
✅ Zero setup required
✅ Personal isolated workspace

Workspace URL:

https://dbc-d8111651-e8b1.cloud.databricks.com

⚠️ Option B: Your Own Workspace

Good for: Independent practice

❌ No course content pre-loaded
❌ No Unity Catalog setup
❌ Manual notebook setup required
✅ Free Community Edition

Setup:

Sign up: databricks.com
Clone from GitHub
Adapt code manually

2

Find the Course Content

In your Databricks workspace:

Navigate to: Workspace → Shared → terraform-managed → course → notebooks
All course content is already there!
Start with: 01_week/01_databricks_fundamentals.py

3

Start Learning

Copy notebooks to your personal space to edit:

Right-click any notebook → Clone
Save to: /Users/{your-email}/my-learning/
Edit, experiment, and learn!

🎯 Choose Your Learning Path

New to Databricks

3-4 weeks

Weeks 1-2: Complete all notebooks to understand platform and data ingestion
Week 3: Master transformations and analytics
Week 4: Build complete end-to-end pipelines

🏠

Know Spark/Data Engineering

2-3 weeks

Week 3-4: Master complex transformations and complete pipelines
Week 5: Production deployment with wheels and job orchestration

🏠

Production Ready

1-2 weeks

Week 5: Job orchestration, wheel packages, and production patterns
Advanced: Build interactive data applications with Streamlit

🏠

Complete Journey

4-6 weeks

Databricks fundamentals and platform features
Data engineering patterns (ingestion, transformations, pipelines)
Production deployment with professional Python packaging
Interactive applications for stakeholders

🏠

💡 Tips for Success

📝

Start with Week 1 even if you know Spark - Databricks has unique features

📋

Clone before editing - copy notebooks to your personal folder

🧪

Experiment freely - modify code, try different parameters

🎯

Create your own data to test different scenarios

🔒 Privacy & Data Protection

Data Collection: By requesting access, you consent to the collection of your name and email address.

Purpose: Your data will be used solely for provisioning Databricks workspace access and communication related to the learning platform.

Data Retention: Your information will be retained only for the duration of your participation in the learning program.

Your Rights: You have the right to access, rectify, or delete your personal data at any time. Contact us at datatribe.collective@gmail.com to exercise your rights.

No Commercial Use: Your data will not be shared with third parties or used for commercial purposes. This is an educational initiative.

👨‍💻 Data Engineer Guide