Data Engineering Essentials using SQL, Python, and PySpark

Download Now


Files Included :

001 Introduction to Data Engineering Essentials Course.mp4 (12.63 MB)
MP4
002 Overview of our support to Data Engineering Essentials course.mp4 (26.3 MB)
MP4
003 Overview of SQL topics covered in the course.mp4 (36.13 MB)
MP4
004 Overview of Python topics covered in the course.mp4 (37.46 MB)
MP4
005 Overview of Getting Started with GCP related to the course.mp4 (17.75 MB)
MP4
006 Overview of Spark and Databricks Environment related topics.mp4 (23.82 MB)
MP4
007 Detailed outline of Spark SQL Topics in the course.mp4 (46.91 MB)
MP4
008 Detailed outline of Pyspark Topics in the course.mp4 (34.78 MB)
MP4
009 Detailed outline of ELT Data Pipelines on Databricks.mp4 (15.15 MB)
MP4
010 Overview of Performance Tuning of Spark covered in the course.mp4 (32.61 MB)
MP4
001 Introduction to SQL for Data Engineering.mp4 (6.12 MB)
MP4
002 Overview of Application Architecture and RDBMS.mp4 (16.85 MB)
MP4
003 Overview of Database Technologies and relevance of SQL.mp4 (30.27 MB)
MP4
004 Overview of Purpose Built Databases.mp4 (21.75 MB)
MP4
005 Overview of Data Warehouse and Data Lake.mp4 (21.8 MB)
MP4
006 Usage of RDBMS and Data Warehouse technologies.mp4 (19.52 MB)
MP4
007 Differences and Similarities between RDBMS and Data Warehouse Technologies.mp4 (15.13 MB)
MP4
001 Introduction to Setting up Tools for Data Engineering Essentials.mp4 (13 MB)
MP4
002 Setup VS Code on Windows.mp4 (20.48 MB)
MP4
003 Setup Python 3 9 on Windows.mp4 (31.9 MB)
MP4
004 Configure Environment Variable PATH for Python on Windows.mp4 (18.26 MB)
MP4
005 Overview of learning Python using Python CLI.mp4 (14.83 MB)
MP4
006 Integrate VSCode with Python on Windows.mp4 (16.63 MB)
MP4
007 Install Postgres 14 on Windows 11.mp4 (23.33 MB)
MP4
008 Getting Started with pgAdmin on Windows.mp4 (11.38 MB)
MP4
009 Getting Started with pgAdmin on Mac.mp4 (17.22 MB)
MP4
010 Conclusion of Setting up Tools for Data Engineering Essentials.mp4 (9.18 MB)
MP4
001 Overview of Postgres Database Server and pgAdmin.mp4 (36.19 MB)
MP4
002 Overview of Database Connection Details.mp4 (33.61 MB)
MP4
003 Overview of Connecting to External Databases using pgAdmin.mp4 (13.16 MB)
MP4
004 Create Application Database and User in Postgres Database Server.mp4 (12.93 MB)
MP4
005 Clone Data Sets from Git Repository for Database Scripts.mp4 (12.25 MB)
MP4
006 Register Server in pgAdmin using Application Database and User.mp4 (12.46 MB)
MP4
007 Setup Application Tables and Data in Postgres Database.mp4 (26.25 MB)
MP4
008 Overview of pgAdmin to write SQL Queries.mp4 (39.36 MB)
MP4
001 Review Data Model Diagram.mp4 (28.6 MB)
MP4
002 Define Problem Statement for SQL Queries.mp4 (10.73 MB)
MP4
003 Filtering Data using SQL Queries.mp4 (31.01 MB)
MP4
004 Total Aggregations using SQL Queries.mp4 (19.35 MB)
MP4
005 Group By Aggregations using SQL Queries.mp4 (30.4 MB)
MP4
006 Order of Execution of SQL Queries.mp4 (25.23 MB)
MP4
007 Rules and Restrictions to Group and Filter Data in SQL queries.mp4 (19.96 MB)
MP4
008 Filter Data based on Aggregated Results using Group By and Having.mp4 (17.66 MB)
MP4
009 Inner Joins using SQL Queries.mp4 (24.01 MB)
MP4
010 Outer Joins using SQL Queries.mp4 (41.92 MB)
MP4
011 Filter and Aggregate on Join Results using SQL.mp4 (16.26 MB)
MP4
012 Overview of Database Views.mp4 (23.86 MB)
MP4
013 Overview of Common Table Expressions or CTEs.mp4 (15.49 MB)
MP4
014 Outer Join with Additional Conditions in SQL Queries.mp4 (38.89 MB)
MP4
015 Explanation about Fix of SQL Queries with Filtering on Outer Join Results.mp4 (26.35 MB)
MP4
001 Introduction to Cumulative Aggregations and Ranking in SQL Queries.mp4 (6.48 MB)
MP4
002 Overview of CTAS to create tables based on Query Results.mp4 (17.95 MB)
MP4
003 Create Tables for Cumulative Aggregations and Ranking.mp4 (9.53 MB)
MP4
004 Overview of OVER and PARTITION BY Clause in SQL Queries.mp4 (36.89 MB)
MP4
005 Compute Total Aggregation using OVER and PARTITION BY in SQL Queries.mp4 (8.34 MB)
MP4
006 Overview of Ranking in SQL.mp4 (13.15 MB)
MP4
007 Compute Global Ranks using SQL.mp4 (18.16 MB)
MP4
008 Compute Ranks based on key using SQL.mp4 (19.77 MB)
MP4
009 Rules and Restrictions to Filter Data based on Ranks in SQL.mp4 (14.85 MB)
MP4
010 Filtering based on Global Ranks using Nested Queries and CTEs in SQL.mp4 (28.3 MB)
MP4
011 Filtering based on Ranks per Partition using Nested Queries and CTEs in SQL.mp4 (22.02 MB)
MP4
012 Create Students table with Data for ranking using SQL.mp4 (11.02 MB)
MP4
013 Difference between rank and dense rank using SQL.mp4 (22.2 MB)
MP4
001 Introduction to SQL Troubleshooting and Debugging Guide.mp4 (4.53 MB)
MP4
002 Overview of Database Connectivity Issues.mp4 (22.4 MB)
MP4
003 Validate and Setup Telnet on Mac or PC.mp4 (31.32 MB)
MP4
004 Validate Connectivity to Database Server using telnet.mp4 (10.59 MB)
MP4
005 Troubleshoot Database Connectivity Issue with Correct Host Details.mp4 (20.07 MB)
MP4
006 Current Databases and Users in Postgres Database Server.mp4 (16.11 MB)
MP4
007 Troubleshoot Database Credentials and Permissions Issues.mp4 (49.1 MB)
MP4
008 Overview of Compilation of SQL Queries.mp4 (19.71 MB)
MP4
009 Troubleshooting Syntax Errors in SQL Queries.mp4 (29.2 MB)
MP4
010 Troubleshooting Semantec Errors in SQL Queries.mp4 (24.97 MB)
MP4
011 Overview of Bugs in SQL Queries.mp4 (12.82 MB)
MP4
012 Development Best Practices with tips to troubleshoot SQL bugs.mp4 (16.14 MB)
MP4
013 Develop Initial Solution based on the requirement.mp4 (16.92 MB)
MP4
014 Identify and Troubleshoot Bugs in SQL Queries.mp4 (64.7 MB)
MP4
015 Develop Solution using Development Best Practices.mp4 (19.98 MB)
MP4
001 Introduction to Performance Tuning of SQL Queries.mp4 (12.22 MB)
MP4
002 Overview of SQL Compilation Process and Explain Plans.mp4 (56.03 MB)
MP4
003 Generate Explain Plans for SQL Queries.mp4 (51.9 MB)
MP4
004 Review Tables used for Performance Tuning of SQL Queries.mp4 (34.34 MB)
MP4
005 Review Data Storage Internals for Tables and Indexes.mp4 (19.44 MB)
MP4
006 Review key terms used in Explain Plans for SQL Queries.mp4 (19.05 MB)
MP4
007 Interpret Explain Plans for Basic SQL Queries.mp4 (44.59 MB)
MP4
008 Review the Common Application Scenarios for Performance Tuning.mp4 (17.45 MB)
MP4
009 Write SQL Queries for Customer Orders.mp4 (33.59 MB)
MP4
010 Performance Testing of SQL Queries using Stored Procedure.mp4 (24.98 MB)
MP4
011 Add Required Indexes to tune performance of SQL Queries.mp4 (44.8 MB)
MP4
012 Guidelines on adding Indexes on Tables for SQL Queries.mp4 (17.15 MB)
MP4
013 Interpreting the explain plan for SQL Queries using Indexes.mp4 (30.8 MB)
MP4
014 Conclusion of Performance Tuning of SQL Queries.mp4 (14.73 MB)
MP4
001 Simple Exercises for Filtering and Aggregations.mp4 (42.34 MB)
MP4
002 Exercises on Joins and Aggregations using SQL.mp4 (17.6 MB)
MP4
001 Solutions for Filtering and Aggregations.mp4 (60.18 MB)
MP4
002 Solutions for Filtering and Aggregations.mp4 (46.98 MB)
MP4
003 Validate Data and Review Data Model Diagram.mp4 (18.78 MB)
MP4
004 Solution for Exercise 1 to get Customer Order Count.mp4 (77.41 MB)
MP4
005 Solution for Exercise 2 to get Dormant Customers using Outer Join.mp4 (109.14 MB)
MP4
006 Solution for Exercise 3 to get Revenue Per Customer using Outer Join.mp4 (92.15 MB)
MP4
007 Solution for Exercise 4 to get Revenue Per Category.mp4 (79.85 MB)
MP4
008 Solution for Exercise 5 to get Product Count Per Department.mp4 (48.76 MB)
MP4
001 Setup Visual Studio Workspace for Python Application Development.mp4 (20.6 MB)
MP4
002 Setup Notebook Environment in VS Code Workspace.mp4 (31.07 MB)
MP4
003 Overview of VS Code Notebook Environment.mp4 (12.21 MB)
MP4
004 Overview of Cells in VS Code Notebook.mp4 (17.11 MB)
MP4
005 Defining Functions in VS Code Notebooks.mp4 (18.14 MB)
MP4
006 Run the Code in VS Code Notebook Cell by Line.mp4 (15.94 MB)
MP4
007 Constants and Variables in Python.mp4 (15.02 MB)
MP4
008 Overview of Python Data Types.mp4 (12.47 MB)
MP4
009 Getting help on Python Variables and Functions.mp4 (45.12 MB)
MP4
010 Pre-Defined String Manipulation Functions.mp4 (21.87 MB)
MP4
011 Overview of Python Lists.mp4 (24.93 MB)
MP4
012 Loops and Conditions in Python.mp4 (26.78 MB)
MP4
013 User Defined Functions in Python.mp4 (19.14 MB)
MP4
001 Overview of File IO using Python.mp4 (35.67 MB)
MP4
002 Read Data from CSV File into Python List.mp4 (14.31 MB)
MP4
003 Overview of Python Collections.mp4 (42.93 MB)
MP4
004 Getting Started with Processing Python Lists.mp4 (17.37 MB)
MP4
005 Overview of Lambda Functions in Python.mp4 (19.54 MB)
MP4
006 Usage of Lambda Functions.mp4 (14.4 MB)
MP4
007 Filter Data in Python Lists using filter and lambda.mp4 (29.47 MB)
MP4
008 Get unique values from list using map and set.mp4 (29.29 MB)
MP4
009 Sort Python lists using key.mp4 (68.13 MB)
MP4
010 Overview of JSON Strings and Files.mp4 (18.32 MB)
MP4
011 Read JSON Strings to Python dicts or lists.mp4 (26.08 MB)
MP4
012 Read JSON Schemas from file to Python dicts.mp4 (26.01 MB)
MP4
013 Overview of Processing JSON Data using Python.mp4 (11.06 MB)
MP4
014 Extract Details from Complex JSON Arrays using Python.mp4 (17.02 MB)
MP4
015 Sort Data in JSON Arrays using Python.mp4 (21.66 MB)
MP4
016 Create Function to get Column Details from Schemas JSON File.mp4 (32.27 MB)
MP4
001 Overview of Pandas for Data Processing.mp4 (39.15 MB)
MP4
002 Overview of Reading CSV Data using Pandas.mp4 (28.61 MB)
MP4
003 Read Data from CSV Files to Pandas Dataframes.mp4 (24.92 MB)
MP4
004 Filter Data in Pandas Dataframe using query.mp4 (64.35 MB)
MP4
005 Get Count by Status using Pandas Dataframe APIs.mp4 (39.57 MB)
MP4
006 Get count by Month and Status using Pandas Dataframe APIs.mp4 (23.41 MB)
MP4
007 Create Dataframes using dynamic column list on CSV Data.mp4 (27.41 MB)
MP4
008 Performing Inner Join between Pandas Dataframes.mp4 (39.94 MB)
MP4
009 Perform Aggregations on Join results.mp4 (20.18 MB)
MP4
010 Sort Data in Pandas Dataframes.mp4 (37.9 MB)
MP4
011 Overview of Writing Pandas Dataframes to Files.mp4 (13.67 MB)
MP4
012 Write Pandas Dataframes to JSON Files.mp4 (94.17 MB)
MP4
002 Get File Names to be processed using glob.mp4 (34.26 MB)
MP4
003 Get Column Names using Schemas File.mp4 (16.31 MB)
MP4
004 Get Data Set Names from File Names or Paths using regular expressions.mp4 (20.85 MB)
MP4
005 Read CSV Data into Pandas Dataframe with Schema Dynamically.mp4 (25.51 MB)
MP4
006 Generate File Paths for Target JSON Files Dynamically.mp4 (16.66 MB)
MP4
007 Recap of Writing Pandas Dataframe to JSON File.mp4 (13.17 MB)
MP4
008 Write Pandas Dataframe to JSON Files.mp4 (43.14 MB)
MP4
009 Modularize File Format Converter for Dataset.mp4 (57.97 MB)
MP4
010 Wrapper to Process all Data Sets.mp4 (42.83 MB)
MP4
011 Setup Project for File Format Converter using Python.mp4 (15.59 MB)
MP4
012 Install Dependencies for the Python Project using pip.mp4 (16.41 MB)
MP4
013 Add Core Logic to Python Application.mp4 (41.3 MB)
MP4
014 Overview of Run-time Arguments and Environment Variables.mp4 (7.43 MB)
MP4
015 Using Run Time Arguments in Python Applications.mp4 (24.15 MB)
MP4
016 Overview of Environment Variables.mp4 (13.19 MB)
MP4
017 Setting Environment Variables on Windows or Mac or Linux.mp4 (27.65 MB)
MP4
018 Use Environment Variables in Python Applications.mp4 (42.62 MB)
MP4
019 Use Environment Variables in File Format Converter.mp4 (51.08 MB)
MP4
020 Pass JSON Array as argument to Python Applications.mp4 (44.43 MB)
MP4
021 Pass Data Sets as Run Time Arguments to File Format Converter.mp4 (66.27 MB)
MP4
022 Exception Handling in Python Applications.mp4 (13.09 MB)
MP4
023 Raising Exceptions in Python Applications.mp4 (33.79 MB)
MP4
024 Exception Handling in File Format Converter Application.mp4 (47.29 MB)
MP4
002 Install Python Dependencies for Pandas and Database Integration.mp4 (22.91 MB)
MP4
003 Run Queries from Notebook using SQL Magic.mp4 (32.94 MB)
MP4
004 Validate Pandas and SQL Integration.mp4 (54.85 MB)
MP4
005 Write CSV Data from File to Database Table.mp4 (51.41 MB)
MP4
006 Write CSV Data from Files to Database Tables in Chunks.mp4 (64.02 MB)
MP4
007 Overview of Deploying File to DB Loader Project.mp4 (82.39 MB)
MP4
001 Introduction to Troubleshooting and Debugging Python issues.mp4 (9.64 MB)
MP4
002 Guidelines for Troubleshooting and Debugging Python related Issues.mp4 (7.53 MB)
MP4
003 Overview of Database Connectivity using Python Applications.mp4 (28.18 MB)
MP4
004 Overview of Database Connectivity using Python.mp4 (16.24 MB)
MP4
005 Troubleshoot Network Connectivity to the Database Server using telnet.mp4 (17.72 MB)
MP4
006 Troubleshoot Module Related issues for Database Connectivity using Python.mp4 (54.55 MB)
MP4
007 Troubleshoot Credentials Related issues for Database Connectivity using Python.mp4 (30.12 MB)
MP4
008 Overview of Python process to run Python Applications.mp4 (11.99 MB)
MP4
009 Troubleshooting Compilation Errors in Python.mp4 (19.43 MB)
MP4
010 Troubleshooting Run Time Errors in Python.mp4 (17.18 MB)
MP4
011 Overview of Software Development Life Cycle.mp4 (15.03 MB)
MP4
012 Overview of Unit Testing or Validation of Applications.mp4 (41.18 MB)
MP4
013 Overview of Debugging VS Code Notebooks using Debug Feature.mp4 (44.69 MB)
MP4
014 Debug VS Code Notebooks using Debug Feature.mp4 (107.37 MB)
MP4
015 Getting Started with Debugging of Python Programs using VS Code.mp4 (13.42 MB)
MP4
016 Recap of running File Format Converter application.mp4 (37.38 MB)
MP4
017 Debug Python Application using VS Code with breakpoints.mp4 (43.25 MB)
MP4
018 Managing Breakpoints for Debugging in VS Code.mp4 (19.38 MB)
MP4
019 Conclusion to Troubleshooting and Debugging Python Issues.mp4 (8.88 MB)
MP4
001 Introduction to Performance of Python Applications.mp4 (28.39 MB)
MP4
002 Setup Database Loader Python Application.mp4 (32.39 MB)
MP4
003 Ensure Postgres Database is setup for file to db loader Python Application.mp4 (68.83 MB)
MP4
004 Cleanup the tables to run file to db loader application.mp4 (16.54 MB)
MP4
005 Run and Validate File to DB Loader Application.mp4 (39.27 MB)
MP4
006 Fix the error message in file to db loader application.mp4 (25.97 MB)
MP4
007 Overview of Execution of file to db loader application.mp4 (40.24 MB)
MP4
008 Performance Tuning using Chunksize in Pandas.mp4 (46.38 MB)
MP4
009 Review Pandas Data Frame API to load data into the target table.mp4 (77.52 MB)
MP4
010 Overview of multi or batch insert into Database Tables.mp4 (19.11 MB)
MP4
011 Develop application for multiprocessing.mp4 (11.22 MB)
MP4
012 Getting Started with Multiprocessing using Python.mp4 (20.4 MB)
MP4
013 Invoking User Defined Functions using multiprocessing in Python.mp4 (36.31 MB)
MP4
014 Refactor File to Database Loader Application for Multiprocessing.mp4 (55.88 MB)
MP4
015 Add Parallel Processing to file to db loader Python Application.mp4 (49.67 MB)
MP4
016 Validate File to DB Loader Application with Multiprocessing.mp4 (53.77 MB)
MP4
017 Understanding the concept of Multiprocessing in Python.mp4 (38.6 MB)
MP4
018 Performance Tuning Scenarios of Python Applications.mp4 (24.04 MB)
MP4
001 Introduction to Getting Started with GCP.mp4 (6.47 MB)
MP4
002 Pre-requisite Skills to Sign up for course on GCP Data Analytics.mp4 (8 MB)
MP4
003 Overview of Cloud Platforms.mp4 (11.65 MB)
MP4
004 Overview of Google Cloud Platform or GCP.mp4 (16.88 MB)
MP4
005 Overview of Signing for GCP Account.mp4 (8.87 MB)
MP4
006 Create New Google Account using Non Gmail Id.mp4 (8.4 MB)
MP4
007 Sign up for GCP using Google Account.mp4 (11.33 MB)
MP4
008 Overview of GCP Credits.mp4 (30.46 MB)
MP4
009 Overview of GCP Project and Billing.mp4 (9.68 MB)
MP4
010 Overview of Google Cloud Shell.mp4 (14.12 MB)
MP4
011 Install Google Cloud SDK on Windows.mp4 (53.71 MB)
MP4
012 Initialize gcloud CLI using GCP Project.mp4 (37.39 MB)
MP4
013 Reinitialize Google Cloud Shell with Project id.mp4 (17.3 MB)
MP4
014 Overview of Analytics Services on GCP.mp4 (12.04 MB)
MP4
015 Conclusion to Get Started with GCP for Data Engineering.mp4 (6.32 MB)
MP4
001 Different Types of Databases.mp4 (4.57 MB)
MP4
002 Usecases for Different Types of Databases.mp4 (10.88 MB)
MP4
003 Technologies for Different Types of Databases.mp4 (12.16 MB)
MP4
004 Volumes for Different Types of Databases.mp4 (12.67 MB)
MP4
005 Overview of Big Data.mp4 (17.56 MB)
MP4
006 Evolution of Big Data Technologies.mp4 (7.58 MB)
MP4
007 Overview of Data Lake using Hadoop eco system.mp4 (17.39 MB)
MP4
008 Limitations of Hadoop eco system.mp4 (16.55 MB)
MP4
009 Overview of Modern Data Lakes on Cloud.mp4 (8.78 MB)
MP4
010 Implementation of Modern Data Lakes on Cloud.mp4 (11.83 MB)
MP4
011 Advantages of Modern Data Lakes on Cloud.mp4 (14 MB)
MP4
001 Overview of Data Processing.mp4 (14.34 MB)
MP4
002 Overview of Data Processing Libraries.mp4 (5.09 MB)
MP4
003 Setup Environment to explore Pandas, Dask and Pyspark.mp4 (53.22 MB)
MP4
004 Code Examples of Pandas, Dask and Pyspark.mp4 (58.01 MB)
MP4
005 Differences between Pandas, Dask and Pyspark.mp4 (27.18 MB)
MP4
006 Overview of Distributed Computing.mp4 (24.12 MB)
MP4
007 Overview of Official Documentation of Apache Spark.mp4 (39.15 MB)
MP4
008 Overview of Spark Key Features and Platforms.mp4 (33.88 MB)
MP4
009 Overview of Spark Infrastructure.mp4 (12.52 MB)
MP4
010 Overview of Spark Cluster using Databricks.mp4 (38.75 MB)
MP4
011 Overview of Executors in Spark Cluster.mp4 (16.27 MB)
MP4
012 Overview of Spark Glossary.mp4 (14.37 MB)
MP4
013 Understand Spark Key Terms.mp4 (53.06 MB)
MP4
001 Overview of Databicks on GCP.mp4 (5.38 MB)
MP4
002 Signing up for Databricks on GCP.mp4 (21.98 MB)
MP4
003 Create Databricks Workspace on GCP.mp4 (13.76 MB)
MP4
004 Getting Started with Databricks Clusters on GCP.mp4 (10.29 MB)
MP4
005 Getting Started with Databricks Notebook.mp4 (9.57 MB)
MP4
006 Overview of Databricks on GCP.mp4 (33.1 MB)
MP4
007 High level architecture of Databricks.mp4 (30.22 MB)
MP4
008 Setup Databricks CLI on Mac or Windows.mp4 (21.65 MB)
MP4
009 Overview of Databricks CLI and other clients.mp4 (21.34 MB)
MP4
010 Configure Databricks CLI on Mac or Windows.mp4 (40.81 MB)
MP4
011 Troubleshoot issues to configure Databricks CLI.mp4 (23.4 MB)
MP4
012 Overview of Databricks CLI Commands.mp4 (64.57 MB)
MP4
013 Setup Data Repository for Data Sets.mp4 (22.06 MB)
MP4
014 Setup Data Sets in DBFS using Databricks CLI Commands.mp4 (50.48 MB)
MP4
001 Process Data in DBFS using Databricks Spark SQL.mp4 (21.25 MB)
MP4
002 Getting Started with Spark SQL Example using Databricks.mp4 (42.11 MB)
MP4
003 Create Temporary Views using Spark SQL.mp4 (49.67 MB)
MP4
004 Exercise to create temporary views using Spark SQL.mp4 (8.34 MB)
MP4
005 Spark SQL Query to compute Daily Product Revenue.mp4 (30.4 MB)
MP4
006 Save Query Result to DBFS using Spark SQL.mp4 (37.04 MB)
MP4
007 Overview of Pyspark Examples on Databricks.mp4 (5.21 MB)
MP4
008 Process Schema Details in JSON using Pyspark.mp4 (53.99 MB)
MP4
009 Create Dataframe with Schema from JSON File using Pyspark.mp4 (61.52 MB)
MP4
010 Transform Data using Spark APIs.mp4 (30.52 MB)
MP4
011 Get Schema Details for all Data Sets using Pyspark.mp4 (17.83 MB)
MP4
012 Convert CSV to Parquet with Schema using Pyspark.mp4 (41.08 MB)
MP4
001 Introduction to Creating Delta Tables using Spark SQL.mp4 (6.04 MB)
MP4
002 Overview of Supported Providers for Spark Metastore Tables.mp4 (7.67 MB)
MP4
003 Create Database and Review the Details.mp4 (42.42 MB)
MP4
004 Create and Review Managed Spark Metastore Table using Delta Format.mp4 (28.56 MB)
MP4
005 Copy Data into Spark Metastore Managed Table.mp4 (46.76 MB)
MP4
006 Validate Data in Spark Metastore Managed Table.mp4 (17.64 MB)
MP4
007 Create and Review External Spark Metastore Table using Delta Format.mp4 (26.19 MB)
MP4
008 Insert Data into Spark Metastore External Table.mp4 (25.97 MB)
MP4
009 Validate Data in Spark Metastore External Table.mp4 (26.65 MB)
MP4
010 Overview of Spark Metastore.mp4 (28.42 MB)
MP4
011 Difference Between Managed and External Spark Metastore Tables.mp4 (30.08 MB)
MP4
012 Perform CRUD Operations on Delta Tables in Spark Metastore.mp4 (26.59 MB)
MP4
013 Using Merge to Update and Insert into Delta Tables in Spark Metastore.mp4 (60.08 MB)
MP4
014 Conclusion of Creating Delta Tables using Spark SQL.mp4 (8.72 MB)
MP4
001 Overview of Functions in Spark SQL.mp4 (12.17 MB)
MP4
002 Validate Functions in Spark SQL.mp4 (25.61 MB)
MP4
003 Overview of String Manipulation Functions in Spark SQL.mp4 (7.07 MB)
MP4
004 Case Conversion and Length of Strings using Spark SQL.mp4 (32.53 MB)
MP4
005 Extract Substring using substr in Spark SQL.mp4 (41.33 MB)
MP4
006 Extract Substrings from Delimited Strings using split in Spark SQL.mp4 (22.65 MB)
MP4
007 Trimming Characters or Strings using Spark SQL.mp4 (62.05 MB)
MP4
008 Padding Characters to Strings using Spark SQL.mp4 (47.4 MB)
MP4
009 Reverse and Concatenate Strings using Spark SQL.mp4 (46.44 MB)
MP4
010 Overview of Date Manipulation Functions in Spark SQL.mp4 (6.16 MB)
MP4
011 Overview of Standard Date and Timestamp in Spark SQL.mp4 (13.54 MB)
MP4
012 Date Arithmetic using Spark SQL Functions.mp4 (22.06 MB)
MP4
013 Overview of trunc and date trunc in Spark SQL.mp4 (42.64 MB)
MP4
014 Extract Information from Date or Time using Spark SQL.mp4 (69.75 MB)
MP4
015 Convert Non Standard Dates or Timestamps to Standard Ones using Spark SQL.mp4 (33.9 MB)
MP4
016 Extract Information using Calendar Functions from Date or Timestamp using Spark.mp4 (14.86 MB)
MP4
017 Dealing with Unix Timestamp using Spark SQL.mp4 (45.36 MB)
MP4
018 Overview of Numeric Functions in Spark SQL.mp4 (46.54 MB)
MP4
019 Data Type Conversion using Spark SQL.mp4 (46.53 MB)
MP4
020 Overview of Handling Null Values using Spark SQL.mp4 (26 MB)
MP4
021 Replace Null Values with default values using nvl and coalesce in Spark SQL.mp4 (45.58 MB)
MP4
022 Conditional Logic on Null Values using nvl2 and case in Spark SQL.mp4 (28.66 MB)
MP4
023 Overview of Case and When in Spark SQL.mp4 (13.89 MB)
MP4
024 Using CASE and WHEN for conditional logic in Spark SQL.mp4 (45.3 MB)
MP4
025 Aggregate using CASE and WHEN in GROUP BY in Spark SQL.mp4 (14.13 MB)
MP4
026 Word Count Query using Pre-defined Functions in Spark SQL.mp4 (53.02 MB)
MP4
027 Exercises for Pre-defined functions in Spark SQL.mp4 (12.07 MB)
MP4
028 Solutions for Exercises 1 and 2 on Pre-defined Functions in Spark SQL.mp4 (63.72 MB)
MP4
029 Solutions for Exercises 3 and 4 on Pre-defined Functions in Spark SQL.mp4 (43.17 MB)
MP4
030 Solutions for Exercises 5 and 6 on Pre-defined Functions in Spark SQL.mp4 (78.02 MB)
MP4
031 Solutions for Exercises 7 and 8 on Pre-defined Functions in Spark SQL.mp4 (78.18 MB)
MP4
001 Introduction to Basic Transformations using Spark SQL.mp4 (5.79 MB)
MP4
002 Prepare Spark Metastore Tables for Basic Transformations.mp4 (25.27 MB)
MP4
003 Projecting Data using Spark SQL.mp4 (29.93 MB)
MP4
001 Filtering Data using Equal Condition in Spark SQL.mp4 (21.95 MB)
MP4
002 Using IN, LIKE and BETWEEN in Spark SQL Queries.mp4 (36.42 MB)
MP4
003 Filter Data using Boolean AND in Spark SQL Queries.mp4 (21.82 MB)
MP4
004 Filter Data using Boolean OR in Spark SQL Queries.mp4 (18.64 MB)
MP4
005 Dealing with NULLS while Filtering Data in Spark SQL Queries.mp4 (14.59 MB)
MP4
001 Perform Total Aggregations using Spark SQL Queries.mp4 (46.12 MB)
MP4
002 Overview of Aggregations using GROUP BY in Spark SQL Queries.mp4 (18.04 MB)
MP4
003 GROUP BY Examples using Spark SQL Queries.mp4 (19.06 MB)
MP4
004 Order of Execution of Spark SQL Queries.mp4 (24.32 MB)
MP4
005 Filter Data based on Aggregate Results using HAVING in Spark SQL Queries.mp4 (26.47 MB)
MP4
001 Overview of Joins in Spark SQL Queries.mp4 (13.39 MB)
MP4
002 Inner Join using Spark SQL Queries.mp4 (40.53 MB)
MP4
003 Concepts Behind Inner Joins in Spark SQL.mp4 (37.78 MB)
MP4
004 Outer Joins using Spark SQL Queries.mp4 (57.67 MB)
MP4
005 Example - Inner Join along with GROUP BY using Spark SQL Queries.mp4 (17 MB)
MP4
006 Example - Outer Join along with GROUP BY using Spark SQL Queries.mp4 (18.91 MB)
MP4
007 Example - Filtering and Outer Joins along with GROUP BY in Spark SQL Queries.mp4 (28.79 MB)
MP4
008 Example - Filtering and Outer Joins along with GROUP BY in Spark SQL Queries.mp4 (21.64 MB)
MP4
001 Sorting Data using Spark SQL Queries.mp4 (21.16 MB)
MP4
002 Dealing with Nulls while Sorting Data using Spark SQL Queries.mp4 (20.57 MB)
MP4
001 Overview of Copying Query Results into Spark Metastore Tables.mp4 (8.13 MB)
MP4
002 Query to Compute Daily Revenue using Spark SQL.mp4 (8.9 MB)
MP4
003 Copy Query Results into Spark Metastore Tables using CTAS.mp4 (22.47 MB)
MP4
004 Copy Query Results into Spark Metastore Tables using INSERT.mp4 (18.2 MB)
MP4
005 Design Pipeline using CTAS and INSERT in Spark SQL.mp4 (70.73 MB)
MP4
006 Copy Query Results into Spark Meatstore Tables using MERGE.mp4 (33.96 MB)
MP4
001 Ranking using Spark SQL Windowing Functions.mp4 (3.92 MB)
MP4
002 Create Temporary View for ranking using Spark SQL Windowing Functions.mp4 (7.9 MB)
MP4
003 Compute Global Rank using Spark SQL Windowing Functions.mp4 (25.67 MB)
MP4
004 Compute Ranks Per Key using Spark SQL Windowing Functions.mp4 (19.91 MB)
MP4
005 Difference Between rank and dense rank.mp4 (15.4 MB)
MP4
006 Filter on Ranks using Spark SQL Windowing Functions.mp4 (55.09 MB)
MP4
001 Overview of JSON.mp4 (14.41 MB)
MP4
002 Creating Spark Metastore Tables with Array Type Columns.mp4 (18.08 MB)
MP4
003 Dealing with Array Type Columns using Spark SQL Queries.mp4 (21.63 MB)
MP4
004 Creating Spark Metastore Tables with Struct Type Columns.mp4 (11.19 MB)
MP4
005 Projecting Data From Struct Type Fields in Spark SQL.mp4 (27.48 MB)
MP4
006 Creating Spark Metastore Tables with Array of Struct Column.mp4 (24.26 MB)
MP4
007 Dealing with Array of Struct Type Columns using Spark SQL Queries.mp4 (28.84 MB)
MP4
008 Overview of Important Functions to Process JSON Data in Spark SQL.mp4 (14.23 MB)
MP4
009 Generate Array Type Columns from Regular Columns in Spark SQL.mp4 (28.38 MB)
MP4
010 Generate Array of Struct Type Columns from Regular Columns in Spark SQL.mp4 (20.91 MB)
MP4
011 Processing Delimited Strings using Spark SQL Queries.mp4 (26.33 MB)
MP4
001 Overview of Pyspark Examples on Databricks.mp4 (5.21 MB)
MP4
002 Process Schema Details in JSON using Pyspark.mp4 (54.02 MB)
MP4
003 Create Dataframe with Schema from JSON File using Pyspark.mp4 (61.5 MB)
MP4
004 Transform Data using Spark APIs.mp4 (30.51 MB)
MP4
005 Get Schema Details for all Data Sets using Pyspark.mp4 (17.83 MB)
MP4
006 Convert CSV to Parquet with Schema using Pyspark.mp4 (41 MB)
MP4
001 Create Spark Data Frame using Pyspark Data Frame APIs.mp4 (18.87 MB)
MP4
002 Introduction to Processing JSON like Data using Spark SQL.mp4 (3.18 MB)
MP4
003 Overview of Data Processing using Conventional loops.mp4 (41.89 MB)
MP4
004 Overview of Data Frame Concepts.mp4 (22.68 MB)
MP4
005 Advantages of Pyspark Data Frames.mp4 (13.2 MB)
MP4
006 Overview of Spark Data Frames and their Characteristics.mp4 (25.91 MB)
MP4
007 Projecting Data in Spark Data Frames using Select.mp4 (15.02 MB)
MP4
008 Using drop to drop columns from Spark Data Frame.mp4 (10.2 MB)
MP4
009 Applying functions on Spark Data Frame Columns.mp4 (25.5 MB)
MP4
010 Using withColumn to apply transformations on Spark Data Frames.mp4 (15.41 MB)
MP4
011 Overview of Writing Data in Data Frame to Delta Files.mp4 (35.53 MB)
MP4
001 Overview of Basic Transformations using Pyspark Data Frame APIs.mp4 (7.46 MB)
MP4
002 Overview of Row Level Transformations.mp4 (30.85 MB)
MP4
003 Apply Row Level transformations using Pyspark Data Frame APIs.mp4 (38.95 MB)
MP4
004 Filtering Data using Pyspark Data Frame APIs.mp4 (27.73 MB)
MP4
005 Filtering Data with Multiple Conditions using Pyspark Data Frame APIs.mp4 (35.37 MB)
MP4
006 Perform Aggregations by Key using Spark Data Frame APIs.mp4 (27.11 MB)
MP4
007 Perform Aggregations by Key using Spark Data Frame APIs.mp4 (32.07 MB)
MP4
008 Perform Aggregations by Key using Spark Data Frame APIs.mp4 (16.29 MB)
MP4
009 Sorting Data using Spark Data Frame APIs.mp4 (23.71 MB)
MP4
010 Composite Sorting using Spark Data Frame APIs.mp4 (48.54 MB)
MP4
011 Develop Spark SQL Queries for Sorting Data.mp4 (19.06 MB)
MP4
012 Review Data Set with Nulls for Sorting using Spark Data Frame APIs.mp4 (48.32 MB)
MP4
013 Dealing with Nulls while Sorting the Data in Spark Data Frames.mp4 (36.75 MB)
MP4
001 Introduction to Joining Data using Spark Data Frame APIs.mp4 (3.52 MB)
MP4
002 Create Data Frames to Join using Spark Data Frame APIs.mp4 (32.61 MB)
MP4
003 Review Syntax for join using Spark Data Frame APIs.mp4 (10.24 MB)
MP4
004 Inner Join using Spark Data Frame APIs.mp4 (26.28 MB)
MP4
005 Join and other Spark Data Frame APIs to process the data.mp4 (35.77 MB)
MP4
006 Analyze Data for outer joins using Spark Data Frame APIs.mp4 (13.06 MB)
MP4
007 Left Outer Join using Spark Data Frame APIs.mp4 (24.45 MB)
MP4
008 Right Outer Join using Spark Data Frame APIs.mp4 (19.43 MB)
MP4
009 Equivalent Spark SQL Queries for Joins.mp4 (34.72 MB)
MP4
001 Introduction to Ranking using Spark Data Frame APIs.mp4 (37.07 MB)
MP4
002 Syntax for ranking using Spark Data Frame APIs.mp4 (7.5 MB)
MP4
003 Compute Global Ranks using Spark Data Frame APIs.mp4 (21.94 MB)
MP4
004 Filter Based on Global Ranks using Spark Data Frame APIs.mp4 (29.66 MB)
MP4
005 Compute Ranks per Partition using Spark Data Frame APIs.mp4 (14.46 MB)
MP4
006 Filter Based on Ranks Per Partition using Spark Data Frame APIs.mp4 (19.73 MB)
MP4
007 Difference Between rank and dense rank.mp4 (46.04 MB)
MP4
001 Introduction to Integration of Spark SQL and Pyspark Data Frame APIs.mp4 (5.63 MB)
MP4
002 Run Spark SQL Queries on Spark Data Frames.mp4 (37.59 MB)
MP4
003 Create Spark Metastore Tables using Data Frames.mp4 (26.5 MB)
MP4
004 Insert into Spark Metastore Tables using Data Frames.mp4 (20.98 MB)
MP4
005 Read Data from Spark Metastore Table to Data Frames.mp4 (17.63 MB)
MP4
006 Process Data in Spark Metastore Tables using Data Frame APIs.mp4 (36.72 MB)
MP4
007 Manage Spark Metastore Database Objects using Spark APIs.mp4 (42.45 MB)
MP4
001 Overview of Databricks Workflows.mp4 (15.3 MB)
MP4
002 Pass Arguments to Databricks Python Notebooks.mp4 (18.17 MB)
MP4
003 Pass Arguments to Databricks SQL Notebooks.mp4 (18.17 MB)
MP4
004 Create and Run First Databricks Job.mp4 (23.33 MB)
MP4
005 Run Databricks Jobs and Tasks with Parameters.mp4 (37.55 MB)
MP4
006 Create and Run Orchestrated Pipeline using Databricks Job.mp4 (45.85 MB)
MP4
007 Import ELT Data Pipeline Applications into Databricks Environment.mp4 (13.21 MB)
MP4
008 Spark SQL Application to Cleanup Database and Datasets.mp4 (11.78 MB)
MP4
009 Review File Format Converter Pyspark Code.mp4 (40.95 MB)
MP4
010 Review Databricks SQL Notebooks for Tables and Final Results.mp4 (13.74 MB)
MP4
011 Validate Applications for ELT Pipeline using Databricks.mp4 (57.71 MB)
MP4
012 Build ELT Pipeline using Databricks Job in Workflows.mp4 (39.96 MB)
MP4
013 Run and Review Execution details of ELT Data Pipeline using Databricks Job.mp4 (22.52 MB)
MP4
014 Cleanup Databricks Environment on GCP.mp4 (21.78 MB)
MP4
001 Getting Started with Performance Tuning using Spark on Databricks.mp4 (12.45 MB)
MP4
002 Overview of Spark Catalyst Optimizer.mp4 (17.46 MB)
MP4
003 Review Explain Plan for Spark Dataframe logic using Spark UI.mp4 (30.17 MB)
MP4
004 Review Explain Plan for Spark SQL logic using Spark UI.mp4 (26.33 MB)
MP4
005 Generate Explain Plans on Spark Dataframes using explain function.mp4 (38.81 MB)
MP4
006 Generate Explain Plans on Spark SQL Queries using explain command.mp4 (11.73 MB)
MP4
007 Interpreting Explain Plan for Spark SQL Query.mp4 (23.64 MB)
MP4
008 Overview of Spark Architecture.mp4 (21.68 MB)
MP4
009 Understand Filter and Broadcast of Orders Data.mp4 (29.08 MB)
MP4
010 Understand Join and Aggregation for Daily Product Revenue.mp4 (43 MB)
MP4
001 Introduction to Databricks Cluster Configuration.mp4 (6.78 MB)
MP4
002 Difference Between All Purpose and Jobs Clusters.mp4 (37.79 MB)
MP4
003 Setting up All Purpose Databricks Compute Clusters.mp4 (15.71 MB)
MP4
004 Understand the size of the data using dbutils.mp4 (48.18 MB)
MP4
005 Create Multinode Databricks Cluster with Auto Scaling.mp4 (13.76 MB)
MP4
006 Overview of Auto Scaling of Databricks Clusters.mp4 (11.28 MB)
MP4
007 Performance Tuning of Cluster using Auto Scaling.mp4 (15.16 MB)
MP4
008 Analyze Airlines Data using Spark SQL.mp4 (22.91 MB)
MP4
009 Setup Databricks Job Compute Clusters using Workflows.mp4 (29.14 MB)
MP4
010 Review Running Job Details using Spark UI.mp4 (31.2 MB)
MP4
011 Review Completed Job Details using Spark UI.mp4 (18.59 MB)
MP4
001 Overview of Inferring Schema using CSV or JSON Files.mp4 (6.2 MB)
MP4
002 Steps to convert CSV or JSON Files to Parquet or Delta Files.mp4 (11.9 MB)
MP4
003 Overview of CSV or JSON Files.mp4 (21.48 MB)
MP4
004 Overview of overhead for inferring schema.mp4 (37.57 MB)
MP4
005 Performance Tuning to infer schema of Spark Dataframe.mp4 (38.37 MB)
MP4
002 Side effects of using CSV Files in Data Lake.mp4 (39.72 MB)
MP4
003 Review the side effects of using CSV Files in Data Lake.mp4 (15.36 MB)
MP4
004 Restructure CSV Data to Columnar Format using Pyspark.mp4 (35.49 MB)
MP4
006 Run Operations on Partitioned Parquet Data.mp4 (19.71 MB)
MP4
007 Overview of Performance Assessment of Spark Jobs.mp4 (35.86 MB)
MP4
011 Evaluate Requirements against Partition Pruning.mp4 (51.34 MB)
MP4
015 Parameterize Spark SQL Solution for Partition Pruning.mp4 (29.29 MB)
MP4
016 Add Condition for Partition Pruning.mp4 (44.02 MB)
MP4
017 Redesign Partition Strategy to tune the performance.mp4 (53.21 MB)
MP4
018 Recap of Spark Performance Tuning Scenarios.mp4 (22.12 MB)
MP4
001 Introduction to Setup Hadoop and Spark Cluster using Dataproc.mp4 (8.74 MB)
MP4
002 Overview of different Spark Platforms on Cloud.mp4 (36.07 MB)
MP4
003 Overview of Hadoop and Spark Cluster Types and Architecture.mp4 (57.22 MB)
MP4
004 Setup Single Node Hadoop and Spark Cluster using Dataproc.mp4 (19.95 MB)
MP4
005 Validate SSH Connectivity to the Dataproc Cluster.mp4 (43.98 MB)
MP4
006 Convert IP Address to Static for Dataproc Cluster.mp4 (26.73 MB)
MP4
007 Setup Project using VS Code Remote Development.mp4 (130.21 MB)
MP4
008 Setup Local Data Sets on Hadoop and Spark Cluster.mp4 (11.01 MB)
MP4
009 Getting Started with HDFS Commands to Manage Files.mp4 (81.6 MB)
MP4
010 Getting Started with Spark CLI using Python.mp4 (37.99 MB)
MP4
011 Getting Started with Spark CLI using Scala.mp4 (26.58 MB)
MP4
012 Getting Started with Spark CLI using SQL.mp4 (16.1 MB)
MP4
013 Stopping the Cluster and Understanding the costs.mp4 (16.27 MB)
MP4
014 Download VS Code Workspace and Delete Cluster.mp4 (23.72 MB)
MP4
001 Introduction to Linux Commands and Scripts for Data Engineers.mp4 (7.03 MB)
MP4
002 Overview of SSH to connect to remote Servers.mp4 (159.76 MB)
MP4
003 Overview of Profile in Linux Shell.mp4 (51.12 MB)
MP4
004 Overview of Environment Variables in Linux.mp4 (61.05 MB)
MP4
005 Understanding PATH Environment Variable.mp4 (190.96 MB)
MP4
006 Creating Folders in Linux using mkdir.mp4 (84.74 MB)
MP4
007 Copy Files and Folders in Linux using cp command.mp4 (108.7 MB)
MP4
008 Move Files and Folders in Linux using mv command.mp4 (41.2 MB)
MP4
009 Delete Files and Folders in Linux using rm command.mp4 (87 MB)
MP4
010 Listing Files and Folders using ls command.mp4 (117.23 MB)
MP4
011 Searching for files using find command in Linux.mp4 (34.42 MB)
MP4
012 Standard Directories in Linux.mp4 (99.32 MB)
MP4
013 Troubleshooting issues in Linux using grep command.mp4 (113.56 MB)
MP4
014 Overview of Shell Scripts.mp4 (89.38 MB)
MP4
015 Running and Debugging Shell Scripts with Arguments.mp4 (44.75 MB)
MP4
016 Overview of Hadoop and Spark Executables.mp4 (48.26 MB)
MP4
001 Introduction to Mastering Hadoop HDFS Commands and Concepts.mp4 (3.81 MB)
MP4
002 Start the Hadoop and Spark Cluster using Dataproc.mp4 (8.03 MB)
MP4
003 Create Hadoop and Spark Cluster and Setup VS Code Workspace.mp4 (54.92 MB)
MP4
004 Overview of important HDFS Commands.mp4 (24.12 MB)
MP4
005 Create Folder and Copy Files into HDFS using Commands.mp4 (50.95 MB)
MP4
006 Programmatically Copy files into HDFS using Python.mp4 (67.03 MB)
MP4
007 Overview of Multinode Hadoop Cluster.mp4 (87.85 MB)
MP4
008 Review Important Properties of HDFS.mp4 (54.6 MB)
MP4
009 Review HDFS Properties on Dataproc Cluster using VS Code.mp4 (44.7 MB)
MP4
010 Overview of local storage of files.mp4 (80.65 MB)
MP4
011 Setup Data Sets to understand HDFS Concepts.mp4 (88.39 MB)
MP4
012 Overview of Distributed Storage of files in HDFS.mp4 (37.99 MB)
MP4
013 Determining Number of Blocks for each file.mp4 (79.96 MB)
MP4
014 Overview of Blocks related to files in HDFS.mp4 (122.62 MB)
MP4
015 Overview of Replication related to files in HDFS.mp4 (90.72 MB)
MP4
016 Physical Storage of HDFS File Blocks.mp4 (83.6 MB)
MP4
017 Overview of HDFS Namenode for HDFS File Metadata.mp4 (91.98 MB)
MP4
018 Recap of HDFS on Dataproc Cluster.mp4 (127.14 MB)
MP4
001 Introduction to Building Hive Applications.mp4 (3.41 MB)
MP4
002 Getting Started with Hive.mp4 (99.58 MB)
MP4
003 Overview of Hive Architecture.mp4 (28.77 MB)
MP4
004 Overview of Integrating Hive Commands with Shell Scripts.mp4 (64.63 MB)
MP4
005 Run Hive Commands using Scripts.mp4 (101.81 MB)
MP4
006 Override Run time Hive Configuration Properties and Variables.mp4 (63.87 MB)
MP4
007 Getting Started Data Loader for NYSE Data using HIve.mp4 (78.38 MB)
MP4
008 Design NYSE Data Loader Application.mp4 (37.52 MB)
MP4
009 Create Partitioned Parquet Table for NYSE Data.mp4 (64.89 MB)
MP4
010 Populate Data into Partitioned NYSE table from Stage Table.mp4 (38.41 MB)
MP4
011 Process NYSE Data and load into partitioned table.mp4 (53.14 MB)
MP4
012 Develop Hive QL Script to Load NYSE Data.mp4 (44.07 MB)
MP4
013 Run Hive QL Commands using Script for NYSE Loader.mp4 (76.17 MB)
MP4
014 Redesign the Solution using HDFS to stage files.mp4 (57.52 MB)
MP4
015 Validate Hive Application to Convert NYSE Data.mp4 (70.71 MB)
MP4
016 Deploy Hive Application in HDFS.mp4 (34.69 MB)
MP4
017 Develop Shell Wrapper to run Hive Application.mp4 (36.54 MB)
MP4
018 Overview of Scheduling and Crontab.mp4 (83.81 MB)
MP4
019 Schedule Hive Applications using Cron.mp4 (169.44 MB)
MP4
020 Recap of Application Development Life Cycle using Hive.mp4 (45.69 MB)
MP4
001 Getting Started with Spark SQL on Hadoop and Spark Cluster.mp4 (3.48 MB)
MP4
002 Getting Started with Data Sets and Spark SQL CLI.mp4 (37.07 MB)
MP4
003 Spark SQL Metastore Architecture.mp4 (42.34 MB)
MP4
004 Overview of Spark Metastore Warehouse Directory.mp4 (37.05 MB)
MP4
005 Launch Spark SQL CLI with Delta Lake Packages.mp4 (51.32 MB)
MP4
006 Populate Data into Delta Lake Tables using Spark SQL.mp4 (122.84 MB)
MP4
007 Run Individual Spark SQL Commands.mp4 (101.19 MB)
MP4
008 Run Spark SQL Scripts using Spark SQL CLI.mp4 (109.5 MB)
MP4
002 Review the Requirements and Datasets for NYSE Data.mp4 (46.29 MB)
MP4
003 Design NYSE Converter Application using Spark SQL and Delta.mp4 (12.57 MB)
MP4
004 Copy Files into HDFS for NYSE Converter.mp4 (41.27 MB)
MP4
005 Create External Stage Table for NYSE CSV Files.mp4 (44.08 MB)
MP4
006 Create Target Table for NYSE Data using Delta Format.mp4 (77.91 MB)
MP4
007 Populate Data for Additional Years into Delta NYSE Table.mp4 (117.58 MB)
MP4
008 Develop Spark SQL Application for NYSE Data Conversion.mp4 (51.3 MB)
MP4
009 Validate Spark SQL Application for NYSE Data Conversion.mp4 (53.9 MB)
MP4
010 Develop Shell Wrapper for Spark SQL Application.mp4 (58.12 MB)
MP4
001 Introduction to Getting Started with Pyspark.mp4 (2.49 MB)
MP4
002 Launching or Getting Started Pyspark CLI.mp4 (42.91 MB)
MP4
003 Overview of Spark Properties Files.mp4 (43.91 MB)
MP4
004 Review Data Sets to explore Pyspark APIs.mp4 (42.95 MB)
MP4
005 Getting Started with Pyspark for Data Processing.mp4 (28.77 MB)
MP4
006 Read Orders and Order Items Data into Spark Data Frames.mp4 (20.87 MB)
MP4
007 Process Data using pyspark Dataframe APIs.mp4 (56.14 MB)
MP4
008 Overview of Spark Submit Command.mp4 (49.93 MB)
MP4
001 Introduction to Submitting Python based Spark Applications.mp4 (2.78 MB)
MP4
002 Develop Pyspark Application for Daily Revenue.mp4 (45.32 MB)
MP4
003 Run Spark Application using spark-submit.mp4 (45.42 MB)
MP4
004 Specify Paths using Environment Variables in Spark Applications.mp4 (70.98 MB)
MP4
005 Run Spark Application with Environment Variables in Client Mode.mp4 (20.06 MB)
MP4
006 Run Spark Application with Environment Variables in Cluster Mode.mp4 (41.57 MB)
MP4
007 Review Spark Application Details using Spark UI.mp4 (18.5 MB)
MP4
008 Review YARN Logs for Spark Applications in Cluster Mode.mp4 (71.02 MB)
MP4
009 Overview of Execution Process of Spark Applications.mp4 (46.87 MB)
MP4
010 Deep Dive into Spark Deploy Modes.mp4 (121.51 MB)
MP4
011 Submit Spark Applications with dependencies as packages.mp4 (109.4 MB)
MP4
012 Submit Spark Applications with dependencies as jars.mp4 (183.87 MB)
MP4
013 Develop Shell Wrappers to submit Spark Applications.mp4 (76.23 MB)
MP4
001 Introduction to Logging in Python baesd Spark Applications.mp4 (4.61 MB)
MP4
002 Run Application without logging.mp4 (73.63 MB)
MP4
003 Overview of Logging Concepts such as Log Levels.mp4 (30.55 MB)
MP4
004 Getting Started with logging using Python.mp4 (40.7 MB)
MP4
005 Changing the Log Message Format using logging.mp4 (55.28 MB)
MP4
006 Add logging to Python based Spark Applications.mp4 (21.27 MB)
MP4