Running Apache Spark For Administrators

Running Apache Spark For Administrators

Bascom  Bridge’s Running Apache Spark for Administrators training class focuses on running Spark in a production setting. Students learn the hardware specific considerations of Spark as well as architecture and internals. Job scheduling and special considerations for streaming jobs are also covered in this course.

RUNNING SPARK FOR ADMINISTRATORS TRAINING OBJECTIVES

All students will learn how to:

• Install and configure a production Spark cluster
• Integrate Spark with YARN
• Work with the internals of Spark that apply to running an efficient cluster

RUNNING SPARK FOR ADMINISTRATORS TRAINING PREREQUISITES

This course is designed for administrators and no prior Spark experience is presumed.

RUNNING SPARK FOR ADMINISTRATORS TRAINING MATERIALS

All Spark training students receive comprehensive courseware.

SOFTWARE NEEDED FOR EACH PC:

• Laptop or desktop with i7 quad core processor or faster
• 8GB RAM or higher
• Oracle VirtualBox
• Internet connection for all attendees and the instructor
• Note: If you do not have classroom computers available with this spec, we can recommend a rental laptop vendor whose machines meet these specifications.
• For classes delivered online, all participants need either dual monitors or a separate device logged into the online session so that they can do their work on one screen and watch the instructor on the other. A separate computer connected to a projector or large screen TV would be another way for students to see the instructor’s screen simultaneously with working on their own.

RUNNING SPARK FOR ADMINISTRATORS TRAINING OUTLINE

• Introduction
• Spark Architecture
• Spark Internals
• Hardware Considerations
• Streaming Jobs
• Integrating Spark with HortonWorks
• Job Scheduling
  • Stand-alone
  • Mesos
  • YARN
  • Fair Scheduler
• Monitoring
  • What to monitor
  • Diagnosing job issues
• Conclusion