£1,725.00

Price for this course

3 HOURS

Duration

Classroom IBM

Delivery

Available dates


Mon22Mar 21 TO Wed24Mar 21

Where

Tech Data ILO UK
Connection details will be communicated separately
Instructor Led
Online

Code

TR-664546
Mon21Jun 21 TO Wed23Jun 21

Where

Tech Data ILO UK
Connection details will be communicated separately
Instructor Led
Online

Code

TR-664547

Overview

This training course is for those who want a foundation of IBM BigInsights. This course consists of two separate modules.

The first module is IBM BigInsights Overview and it will give you an overview of IBM's big data strategy as well as a why it is important to understand and use big data. It will cover IBM BigInsights as a platform for managing and gaining insights from your big data. As such, you will see how the BigInsights have aligned their offerings to better suit your needs with the IBM Open Platform (IOP) along with the three specialized modules with value-add that sits on top of the IOP. Along with that, you will get an introduction to the BigInsights value-add including Big SQL, BigSheets, and Big R.

The second module is IBM Open Platform with Apache Hadoop. IBM Open Platform (IOP) with Apache Hadoop is the first premiere collaborative platform to enable Big Data solutions to be developed on the common set of Apache Hadoop technologies. The Open Data Platform initiative (ODP) is a shared industry effort focused on promoting and advancing the state of Apache Hadoop and Big Data technologies for the enterprise. The current ecosystem is challenged and slowed by fragmented and duplicated efforts between different groups. The ODP Core will take the guesswork out of the process and accelerate many use cases by running on a common platform. It allows enterprises to focus on building business driven applications.

This module provides an in-depth introduction to the main components of the ODP core --namely Apache Hadoop (inclusive of HDFS, YARN, and MapReduce) and Apache Ambari -- as well as providing a treatment of the main open-source components that are generally made available with the ODP core in a production Hadoop cluster.

IBM BigInsights v4 itself is built upon the ODP core and these other main open-source components.The relationships between the IBM Open Platform with Apache Hadoop and the BigInsights add-ons is covered briefly in Unit 1 - pro.

Audience

This intermediate training course is for those who want a foundation of IBM BigInsights. This includes:

  • Big data engineers
  • Data scientist
  • Developers or programmers
  • Administrators who are interested in learning about IBM's Open Platform with Apache Hadoop.

This course consists of two separate modules. The first module is IBM BigInsights Overview and it will give you an overview of IBM's big data strategy as well as a why it is important to understand and use big data. The second module is IBM Open Platform with Apache Hadoop. IBM Open Platform (IOP) with Apache Hadoop is the first premiere collaborative platform to enable Big Data solutions to be developed on the common set of Apache Hadoop technologies.

Prerequisites

There are no pre-requisites for this course but knowledge of Linux would be beneficial.

Objective

IBM BigInsights Overview

DW6A1

  • Understand the purpose of big data and know why it is important
  • List the sources of data (data-at-rest vs data-in-motion)
  • Describe the IBM BigInsights offering
  • Utilize the various IBM BigInsights tools including Big SQL, BigSheets, Big R, Jaql and AQL for your big data needs.

IBM Open Platform (IOP) with Apache Hadoop

DW6B1

  • List and describe the major components of the open-source Apache Hadoop stack and the approach taken by the Open Data Foundation.
  • Manage and monitor Hadoop clusters with Apache Ambari and related components
  • Explore the Hadoop Distributed File System (HDFS) by running Hadoop commands.
  • Understand the differences between Hadoop 1 (with MapReduce 1) and Hadoop 2 (with YARN and MapReduce 2).
  • Create and run basic MapReduce jobs using command line.
  • Explain how Spark integrates int the Hadoop ecosystem.
  • Execute iterative algorithms using Spark's RDD.
  • Explain the role of coordination, management, and governance in the Hadoop ecosystem using Apache Zookeeper, Apache Slider, and Apache Knox.
  • Explore common methods for performing data movement
  • Configure Flume for data loading of log files
  • Move data int the HDFS from relational databases using Sqoop
  • Understand when t use various data storage formats (flat files, CSV/delimited, Avro/Sequence files, Parquet, etc.).
  • Review the differences between the available open-source programming languages typically used with Hadoop (Pig, Hive) and for Data Science (Python, R)
  • Query data from Hive.
  • Perform random access on data stored in HBase.
  • Explore advanced concepts, including Oozie and Solr

Course Outline

(DW6A1)

  • Unit 1: Introduction to Big Data
  • Exercise 1: Setting up the lab environment
  • Unit 2: Introduction to IBM BigInsights
  • Exercise 2: Getting started with IBM BigInsights
  • Unit 3: IBM BigInsights for Analysts
  • Exercise 3: Working with Big SQL and BigSheets
  • Unit 4: IBM BigInsights for Data Scientist
  • Exercise 4: Analyzing data with Big R, Jaql, and AQL
  • Unit 5: IBM BigInsights for Enterprise Management

(DW6B1)

  • Unit 1: IBM Open Platform with Apache Hadoop
  • Exercise 1: Exploring the HDFS
  • Unit 2: Apache Ambari
  • Exercise 2: Managing Hadoop clusters with Apache Ambari
  • Unit 3: Hadoop Distributed File System
  • Exercise 3: File access & basic commands with HDFS
  • Unit 4: MapReduce and Yarn
  • Topic 1: Introduction to MapReduce based on MR1
  • Topic 2: Limitations of MR1
  • Topic 3: YARN and MR2
  • Exercise 4: Creating and coding a simple MapReduce job (Possibly a more complex second Exercise)
  • Unit 5: Apache Spark
  • Exercise 5: Working with Spark's RDD to a Spark job
  • Unit 6: Coordination, management, and governance
  • Exercise 6: Apache ZooKeeper, Apache Slider, Apache Knox
  • Unit 7: Data Movement
  • Exercise 7: Moving data into Hadoop with Flume and Sqoop
  • Unit 8: Storing and Accessing Data
  • Topic 1: Representing Data: CSV, XML, JSON, and YAML
  • Topic 2: Open Source Programming Languages: Pig, Hive, and Other [R, Python, etc]
  • Topic 3: NoSQL Concepts
  • Topic 4: Accessing Hadoop data using Hive
  • Exercise 8: Performing CRUD operations using the HBase shell
  • Topic 5: Querying Hadoop data using Hive
  • Exercise 9: Using Hive to Access Hadoop / HBase Data
  • Unit 9: Advanced Topics
  • Topic 1: Controlling job workflows with Oozie
  • Topic 2: Search using Apache Solr
  • No lab exercises


FAQs

What do I need to bring with me to my public class?

All required learning materials and equipment are provided in the classroom.

 

 

 

 

When do public training course fees have to be paid?

For public training classes payment must be received no later than three business days prior to the first day of class in order to remain in the class and confirm your seat. Failure to provide payment by this date may result in removal from the class, and/or late cancellation fees applied. You can submit payment in the form of a Purchase Order or credit card.

 

 

 

 

On-site (private) Course Pricing:

To find out more about On-site training e-mail us at enablement@agilesolutions.co.uk or call one of our offices.

 

 

 

 

What is the cancellation policy?

Requests for cancellations or date transfers need to be received at least ten (10) business days prior to the event start date in order to receive a full refund. If a cancellation or reschedule request is received less than ten (10) business days before the start date, the penalty of 100% of the cost of the course will be applied, resulting in no amount of the fee being refunded. Refunds will not be allowed for “no-shows” in our public training or IVA courses. This cancellation policy is strictly enforced.

 

 

 

 

What happens if Agile Solutions needs to cancel or reschedule a course?

Agile Solutions reserves the right to cancel events for any reason at any time. Cancellation liability for Agile Solutions, if Agile Solutions cancels the course, is limited to the return of course payment ONLY. Agile Solutions will not reimburse registrants for any other costs including but not limited to any travel cancellation fees or penalties, including airfare and hotel costs. PLEASE NOTE: If your registration status is either “Approved”, or “Pending Payment” you have not been confirmed for the class and it is recommended that you do not make any travel arrangements until you have received a confirmation e-mail letting you know the class and registration is confirmed.

 

 

 

 

How will I know if my course has been rescheduled?

Agile Solutions reserves the right to reschedule or cancel a course due to low enrollment or if necessitated by other circumstances. Agile Solutions will contact you via e-mail or phone to inform you of the change of schedule. Once you have been notified you may reschedule or receive a full credit. Agile Solutions shall not be liable for any other costs including but not limited to any non-refundable travel arrangements if a course is rescheduled or cancelled.