BIG DATA WITH SPARK & SCALA
0.00
Course Content:
HADOOP OVERVIEW, SCALA, APACHE SPARK & PRACTICALS ON REAL TIME DATA
ABOUT TRAINING:
This Hadoop training is designed to make aware about Big Data by giving you hands-on training on Hadoop basics, SPARK, & SCALA. This course will boost yourself to make your career in Big Data and you will get the opportunity to work on a Big data project. You will get certification from central Govt. after the project completion.
COURSE HIGHLIGHTS: WHO SHOULD ATTEND?
- Industry Expert Faculty * Diploma/Degree Students
- Practical hands-On Training * Software Engineers
- Soft Study Material * Developers & Architects
- Accelerate your career growth with Big data * Managers / Team Leaders
- Practical Assignments/Test * Any IT Proffesional
CERTIFICATION:
- Central Govt. Certificate will be awarded.
COURSE CONTENT
- HADOOP OVERVIEW
- Need of Hadoop technology
- Overview of Data centers and Cluster
- Hadoop Cluster and Racks in detail
- Learning Ubuntu for Hadoop
- Overview of Hadoop tools
- Overview of Map Reduce
- Big data Concepts
- Distributed network and computation
- Challenges in data management and control
- Introduction to Big Data
- Types of data in detail
- Sources of Big Data
- Concept of Streaming data
- HDFS and Basic hadoop commands
- SCALA
- Scala Overview
- Environment Setup
- Basic Syntax
- Data Types
- Variables
- Classes & Objects
- Access Modifiers
- Operators
- IF ELSE
- Loop Statements
- Functions
- Closures
- Strings
- Arrays
- Collections
- Traits
- Pattern Matching
- APACHE SPARK
- Download & Install Apache Spark 2 x
- Introduction to Spark Shell
- Spark RDDs Part 1
- Spark RDDs Part 2
- RDD Transformations
- Introduction to IDEs
- Creating Spark Project with Eclipse Maven
- Creating Spark Context and RDD in Spark 1 x style
- Creating Spark Context and RDD in Spark 2 x style
- RDD Basics Working with CSV Files
- RDD Basics Saving RDD to a Text File
- Introduction to Spark DataFrame
- Creating DataFrame using Spark 1 x Style
- Creating DataFrame using Spark 2 x Style
- Creating DataFrame with CSV file in Spark 1 x Style
- Creating DataFrame with CSV file in Spark 2 x Style
- Creating Multiple Spark Context in Spark 1.x
- Creating Multiple Spark Sessions Spark 2 x
- Working with Different File Formats – ORC, JSON, Parquet
- Working with Avro Files
- Applying Own Schema to the DataFrame
- Basic Operations on DataFrame
- Temporary Tables Spark 1 x Style
- Temporary Tables Spark 2 x Style
- Introduction to Datasets
- Creating a Dataset
- Basic Dataset Operations
- Dataset vs DataFrame Performance
Admission Form