Jyotin Padhi
Online
Skills
About
Jyotin Padhi is a dedicated data engineering and analytics tutor with 3 years of hands-on experience in PySpark and Big Data Analytics. With strong academic qualifications includin...
Jyotin Padhi is a dedicated data engineering and analytics tutor with 3 years of hands-on experience in PySpark and Big Data Analytics. With strong academic qualifications including an M.Sc., Polytechnic Diploma, and B.Tech, he brings both technical depth and practical industry understanding to his teaching.He helps students master distributed computing, data processing pipelines, Spark transformations, real-world big data workflows, and more.Through FindMyGuru, Jyotin provides structured, clear, and application-oriented learning to help students build strong data engineering skills for academic and professional growth.
Jyotin Padhi
Online
Skills :
Jyotin Padhi is a dedicated data engineering and analytics tutor with 3 years of hands-on experience in PySpark and Big Data Analytics. With strong academic qualifications includin...
Jyotin Padhi is a dedicated data engineering and analytics tutor with 3 years of hands-on experience in PySpark and Big Data Analytics. With strong academic qualifications including an M.Sc., Polytechnic Diploma, and B.Tech, he brings both technical depth and practical industry understanding to his teaching.He helps students master distributed computing, data processing pipelines, Spark transformations, real-world big data workflows, and more.Through FindMyGuru, Jyotin provides structured, clear, and application-oriented learning to help students build strong data engineering skills for academic and professional growth.
FindMyGuru is a tutor discovery platform that helps students find and connect with experienced tutors and institutes across a wide range of subjects and skills. Students can explore tutor profiles, compare expertise, and contact tutors directly for online or in-person learning.FindMyGuru facilitates discovery and connections between students and tutors or institutes. All classes and learning arrangements are handled directly between students and the respective tutors or institutes
Courses by: Jyotin Padhi
Hands on Data Engineering in Palantir foundry - Jyotin Padhi
1️⃣ Introduction to Big Data & PySpark
What is Big Data?
Hadoop ecosystem overview
Spark vs Hadoop MapReduce
Installation & environment setup
Introduction to PySpark architecture
2️⃣ PySpark Core Concepts
RDDs (Resilient Distributed Datasets)
Transformations & actions
Lazy evaluation
RDD persistence & optimization
3️⃣ PySpark DataFrames & SQL
DataFrame creation & operations
Schema definition
Importing CSV, JSON, Parquet, ORC
Spark SQL basics
SQL queries on large datasets
Window functions
4️⃣ Data Processing & ETL with PySpark
Data cleaning
Handling nulls & duplicates
Joins & aggregations
User-defined functions (UDFs)
File formats & partitioning
ETL pipelines with PySpark
5️⃣ Big Data Analytics with PySpark
Exploratory data analysis
Distributed computing principles
Performance optimization techniques
Caching & checkpointing
Cluster management basics
6️⃣ PySpark MLlib (Basics)
Basic ML algorithms with PySpark
Feature engineering in Spark
Pipelines & model evaluation
7️⃣ Real-Time & Batch Processing (Optional Module)
Introduction to Spark Streaming
Structured streaming concepts
Batch processing workflows
8️⃣ Hands-on Projects
ETL pipeline for large datasets
Analytics dashboard-ready dataset creation
Big Data business case implementation
