Processing Big Data

Take your Big Data skills to the next level by Processing Big Data using Spark to test quality metrics and data lineage documentation. Great things await!

Enroll now
  • Course Duration
    6 weeks

    At 10 hrs/week

  • Course starts

    October 11, 2021

  • PREREQUISITES
    Analytical Background, Python

Upcoming Courses

Courses coming soon

Our expert scientists have crafted world-class content to ensure learning happens in an engaging, friendly and professional way. Each course allows for varied levels of experience and expertise.

Learning with EXPLORE isn't simply studying, it's an experience!

Master a data skill to boost your productivity

EXPLORE's range of DIGITAL SKILLS are SETA accredited and each offers a unique learning experience over a 6 week period. We’re confident that having nailed one skill, you’ll be back for more - the thrill of learning and applying new knowledge is hard to beat! Each skill is thoughtfully curated to ensure it can be applied in the workplace immediately.

You'll learn theory, tools and technology in a fast-paced and fun online environment, supported by wise and generous tech specialists who delight in learning.

Join the ranks of thousands of EXPLORERs who have learnt Amazing Things with us
HIDE DETAILS
Processing Big Data

Processing Big Data DIGITAL SKILL

This course will provide students with the knowledge, skills and experience to Process Big Data. You will gain practical experience writing functions in Spark that test data quality metrics and data lineage documentation.

Big Data Processing

  • Spark, Hive and Hadoop

    Set up a cluster
    Overview of Hadoop and Spark
    MPP on Spark clusters
    Efficient ways of storing and accessing data

  • Transforming Data

    How to use Spark parallel processing
    Partitioning and indexing data

Governance

  • Data Lineage and Quality

    Data dictionaries
    Governance documentation
    Managing dependencies
    Track and log data quality metrics
    Surfacing data quality

  • Data Security

    Maintaining high availability of datasets
    Data masking, encryption in transit and rest
    Disaster recovery

Explore values curiosity: Did you know?

Instant coffee was invented in 1901

Learn the sexiest skills of the 21st century

Data skills are the most sought after with some of the highest paid salaries on offer.

  • Work with the Best

    Our facilitators and support team have been there and done that - experienced practitioners with a range of data mastery in Utilities, Retail and Financial Services. They are your champions and cheerleaders.

  • Learn How to Solve Problems

    The course is built around solving actual problems, whilst learning the latest tools and technologies. Based on the issues that our renowned scientists have helped to solve, each course was designed by a team with years of experience at a global level.

  • Apply Your Skills

    EXPLORE prides itself on the practicality of its courses. Participants must be able to apply the skills and knowledge that they acquire to do Amazing Things. Specialists have put their incredible skills together to ensure that learning adds value and not just 'nice-to-know'.

  • Extended Access to Material

    Participants will have extended access to the material that is covered in the course, allowing them to revisit the techniques whenever they choose to.

Top Student Reviews

  • The fact that I was allowed to use different methods to achieve a given task was freeing. I felt as if I was given a paint brush and an infinite array of colors to paint my solution without being put into a box.

    Ntwanano Matjokane
  • Dedicated people who obviously believe in what they're doing and have a vocation for the work that they do.

    Tahir Hargey
  • EXPLORE really attracts some of the most talented, creative, and hardworking individuals I've met.

    Jake Ruele

Engaging, interactive and entertaining learning

At EXPLORE we firmly believe that learning can be fun, even when the content is complex. Our highly experienced course designers are able to share their insights and wisdom through our innovative learning platform and video-first approach. Take a look at what you can expect when joining us:

  • Machine Learning

    A solid foundation in the theories behind Machine Learning make applying the tools that much easier.

  • Python

    Programming in Python makes using you data simple & easy, get a feel for how you'll master this art

Find The Right Payment Plan For You

  • Upfront Payment

    Pay your fees before the course starts and enjoy a cost saving.
    No deposit.
    No complexity.
    Just one payment.
    Simple.

  • Pay as you Learn

    Monthly payments unlock your next module of learning.
    Fees payable in advance each month
    Seamless payments by automated deductions
    Make one payment, we do the rest!

Upfront Payment
$750
  • Single payment before learning starts
  • No deposit required
Enroll now
PAY AS YOU LEARN
$375 per month
  • 2 monthly payments
  • Payment in advance each month
Enroll now

Awesome! We’re glad to have you on board!

Please confirm your course selection below.

 

High Five - you’re one step closer!

You will now be directed to your Student Dashboard to complete your application.

Ok

We’ve got your interests at heart

At EXPLORE we believe that talented individuals should be able to access opportunities to uncover their potential and realise their dreams. We are dedicated to make learning more accessible.
The EXPLORE loan is designed to do exactly that. With 36 months to pay off your studies, our intention is to offer a competitive and affordable financing option.
Naturally, we need some details and documents from you to get your application started.

Apply Now

Applying for EXPLORE LOAN!

Simply complete this application.

Only a few steps lie between you and a world of incredible learning!

The following questions need to be answered with the details of the person who will be responsible for the loan repayments.

High Five - you’re one step closer!

You will now be directed to your Student Dashboard to complete your application.

ok