About this course: Welcome to the Capstone Project for Big Data! In this culminating project, you will build a big data ecosystem using tools and methods form the earlier courses in this specialization. You will analyze a data set simulating big data generated from a large number of users who are playing our imaginary game "Catch the Pink Flamingo". During the five week Capstone Project, you will walk through the typical big data science steps for acquiring, exploring, preparing, analyzing, and reporting. In the first two weeks, we will introduce you to the data set and guide you through some exploratory analysis using tools such as Splunk and Open Office. Then we will move into more challenging big data problems requiring the more advanced tools you have learned including KNIME, Spark's MLLib and Gephi. Finally, during the fifth and final week, we will show you how to bring it all together to create engaging and compelling reports and slide presentations. As a result of our collaboration with Splunk, a software company focus on analyzing machine-generated big data, learners with the top projects will be eligible to present to Splunk and meet Splunk recruiters and engineering leadership.
Created by: University of California, San Diego
Taught by: Ilkay Altintas, Chief Data Science Officer
San Diego Supercomputer Center
Taught by: Amarnath Gupta, Director, Advanced Query Processing Lab
San Diego Supercomputer Center (SDSC)
| Basic Info | Course 6 of 6 in the Big Data Specialization |
| Language | English |
| How To Pass | Pass all graded assignments to complete the course. |
| User Ratings |
Syllabus
WEEK 1
Simulating Big Data for an Online Game
This week we provide an overview of the Eglence, Inc. Pink Flamingo game, including various aspects of the data which the company has access to about the game and users and what we might be interested in finding out.
4 videos, 4 readings
- Video: Welcome to the Big Data Capstone Project
- Video: Welcome from Splunk: Rob Reed World Education Evangelist
- Reading: Planning, Preparation, and Review
- Reading: A Game by Eglence Inc. : Catch The Pink Flamingo
- Video: A Summary of Catch the Pink Flamingo
- Video: A Conceptual Schema for Catch the Pink Flamingo
- Reading: Overview of the Catch the Pink Flamingo Data Model
- Reading: Overview of Final Project Design
Acquiring, Exploring, and Preparing the Data
Next, we begin working with the simulated game data by exploring and preparing the data for ingestion into big data analytics applications.
6 readings
- Reading: Downloading the Game Data and Associated Scripts
- Reading: Understanding the CSV Files Generated by the Scripts
- Reading: Optional Review of Splunk
- Reading: “Catch the Pink Flamingo” Data Exploration with Splunk
- Reading: Aggregate Calculations Using Splunk
- Reading: Filtering the Data With Splunk
Graded: Data Exploration With Splunk
Graded: Data Exploration Technical Appendix
WEEK 2
Data Classification with KNIME
This week we do some data classification using KNIME.
4 readings
- Reading: Review: Classification Using Decision Tree in KNIME
- Reading: Review: Interpreting a Decision Tree in KNIME
- Reading: Workflow Overview for Building a Decision Tree in KNIME
- Reading: Description of combined_data.csv
Graded: Classifying in KNIME to identify big spenders in Catch the Pink Flamingo
WEEK 3
Clustering with Spark
This week we do some clustering with Spark.
2 readings
- Reading: Informing business strategies based on client base
- Discussion Prompt: Is there only “one way” to cluster a client base?
- Discussion Prompt: How many clusters?
- Discussion Prompt: What kind of criteria might provide actionable information for Eglence Inc.?
- Reading: Practice with PySpark MLlib Clustering
Graded: Recommending Actions from Clustering Analysis
WEEK 4
Graph Analytics of Simulated Chat Data With Neo4j
This week we apply what we learned from the 'Graph Analytics With Big Data' course to simulated chat data from Catch the Pink Flamingos using Neo4j. We analyze player chat behavior to find ways of improving the game.
2 readings
- Reading: Understanding the Simulated Chat Data Generated by the Scripts
- Reading: Graph Analytics of Catch the Pink Flamingo Chat Data Using Neo4j
Graded: Graph Analytics With Chat Data Using Neo4j
WEEK 5
Reporting and Presenting Your Work
1 video, 1 reading
- Video: Week 5: Bringing It All Together
- Reading: Final project preparation
WEEK 6
Final Submission
1 video, 1 reading
- Video: Congratulations! Some Final Words...
- Peer Review: Optional 3-minute video: Splunk opportunity
- Reading: Part 2: Help us connect your video to your LinkedIn profile
Graded: Final Project
FAQs
How It Works
Coursework
Each course is like an interactive textbook, featuring pre-recorded videos, quizzes and projects.
Help from Your Peers
Connect with thousands of other learners and debate ideas, discuss course material, and get help mastering concepts.
Certificates
Earn official recognition for your work, and share your success with friends, colleagues, and employers.
Creators
University of California, San Diego
UC San Diego is an academic powerhouse and economic engine, recognized as one of the top 10 public universities by U.S. News and World Report. Innovation is central to who we are and what we do. Here, students learn that knowledge isn't just acquired in the classroom—life is their laboratory.
Pricing
| Audit | Purchase Course | |
|---|---|---|
| Access to course materials | Available | Available |
| Access to graded materials | Not available | Available |
| Receive a final grade | Not available | Available |
| Earn a shareable Course Certificate | Not available | Available |
Ratings and Reviews
very good course
very simple and staff are professional , so thank you
Watch out for week 4. This is the hardest one out of the whole specialization
Best course for integrating all the concepts learned during specialization.
Thanks Coursera Team and UC, San Diego.
Coursera provides universal access to the world’s best education, partnering with top universities and organizations to offer courses online.
© 2017 Coursera Inc. All rights reserved.
ZL
Excellent total review of all courses