Big Data Architecture & Technology Concepts

COURSE FEATURES

Duration

4 Days

Skill level

All levels

Course tailored to participants' expertise.

Language

Romanian

Type

In-class / Online-live

Assessments

Yes

Custom Training

Open Class

Download PDF

The course is designed to make sure the participant will understand the usage and applicability of big data technologies like Hadoop, Spark, Cassandra, Hbase, Kafka, and which aspects to consider when starting to build a big data architecture.

This course is intended for:

– Existing architects from different other domains interested in understanding what architecting a big data solution means

– Solution responsables/engineers knowledgeable in different big data solutions (Hadoop, Spark, NoSQL solutions, ETL components, ML) that would like to understand “the big picture” of what architecting a big data solution means.

This course is taught in Romanian, with course materials available in either English, or Romanian. The course can be customized - on request.

DAY

TOPICS

Specific technologies overview and details:

Storage: NoSQL databases (random reads on data)

Overview of different NoSQL solutions

Cassandra detailed overview

Main concepts: data partitioning, distribution, replication, consistency, how to write and read data, compaction

How data is inserted / updated / deleted

Understand the main patterns and anti-patterns

Basic data modeling rules for Cassandra best performance

Use case based on Cassandra – hands on session

DAY

TOPICS

Main concepts recap

Differences to Cassandra

Main data modeling aspects: how data is best read

How to choose a noSQL solution – the considerations

Recap storage options: long term storage of immutable data (HDFS) & random writes/reads of data (Hbase/Cassandra/..).

DAY

TOPICS

Overview of different solutions : Storm, Spark , …

Distributed computations and Stream processing with Spark

Spark as ETL tool – examples and demo

Examples on using Spark and Spark streaming + demo session

Data Analysis

SQL on everything options: Hive, Impala, Spark SQL, Apache Drill

Integrate Cassandra with Spark SQL for data analytics, what kind of analytics can be performed

Hands on exercises for analytics with Spark SQL and Cassandra

Search solutions – the extra capability needed besides an SQL engine:

Overview of the capabilities of Solr, Elastic – what extra functionalities those bring to a SQL Engine solution

DAY

TOPICS

Why a messaging bus in a big data architecture?

Kafka demo in combination with Spark streaming

Clustering and Resource Management : Mesos

End to End example including Machine Learning – (we will complete/demo a noSQL + Spark app with ML)

Contact Us

Feel free to leave us your thoughts so we can discover the solution together!

academy@esolutions.ro

Get in touch

0753.029.187

Our address

Budisteanu Office Building, Strada General Constantin Budisteanu Nr. 28C, Sector 1, Bucuresti

academy@esolutions.ro

Get in touch

0753.029.187

Our address

Budisteanu Office Building, Strada General Constantin Budisteanu Nr. 28C, Sector 1, Bucuresti

Related Courses

+ View all courses

Big Data

Apache Spark

This course in Spark for big data covers programming with RDDs, key-value pairs, Spark SQL, Spark Streaming, and more.

DURATION

3 Days

Big Data

Big Data: Streaming (Spark&Kafka)

In this course, we’ll be using Apache Spark with a focus on Spark Streaming and its integration with Apache Kafka.

DURATION

3 Days

Big Data

Streams Processing in Big Data Architectures

This stream processing with Kafka and Spark course offers insights on how to manage real-time data flows and analytics.

DURATION

3 Days

Big Data

Exploratory Data Analysis

This course in Exploratory Data Analysis covers concepts on how to visually explore unseen datasets, create visualizations and uncover patterns.

DURATION

2 Days

+ View all courses

Do you want to become a trainer?

Ask not what your company can do for you, ask what you can do for your company. Apply for a training position.

Apply Now