By the end of this project, you will use the Apache Spark Structured Streaming API with Python to stream data from two different sources, store a dataset in the MongoDB database, and join two datasets.
Use the Apache Spark Structured Streaming API with MongoDB
Taught in English
Instructor: David Dalsveen
Included with
Guided Project
Recommended experience
What you'll learn
Use the Apache Spark Structured Streaming API with Python to stream data from two different sources
Use the Apache Spark Structured Streaming API with Python to store a dataset in the MongoDB database and join two datasets
Skills you'll practice
Details to know
Add to your LinkedIn profile
Guided Project
Recommended experience
See how employees at top companies are mastering in-demand skills
Learn, practice, and apply job-ready skills in less than 2 hours
- Receive training from industry experts
- Gain hands-on experience solving real-world job tasks
- Build confidence using the latest tools and technologies
About this Guided Project
Learn step-by-step
In a video that plays in a split-screen with your work area, your instructor will walk you through these steps:
Create a Python PySpark program to read streaming structured data.
Persist Apache Spark data to MongoDB.
Use Spark Structured Query Language to query data.
Use Spark to stream from two different structured data sources.
Use the Spark Structured Streaming API to join two streaming datasets.
Recommended experience
Intermediate developer, some Linux/IDE Experience. Learners should be familiar with some Python.
5 project images
Instructor
Offered by
How you'll learn
Skill-based, hands-on learning
Practice new skills by completing job-related tasks.
Expert guidance
Follow along with pre-recorded videos from experts using a unique side-by-side interface.
No downloads or installation required
Access the tools and resources you need in a pre-configured cloud workspace.
Available only on desktop
This Guided Project is designed for laptops or desktop computers with a reliable Internet connection, not mobile devices.
Why people choose Coursera for their career
New to Data Management? Start here.
Open new doors with Coursera Plus
Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 3,400 global companies that choose Coursera for Business
Upskill your employees to excel in the digital economy
Frequently asked questions
By purchasing a Guided Project, you'll get everything you need to complete the Guided Project including access to a cloud desktop workspace through your web browser that contains the files and software you need to get started, plus step-by-step video instruction from a subject matter expert.
Because your workspace contains a cloud desktop that is sized for a laptop or desktop computer, Guided Projects are not available on your mobile device.
Guided Project instructors are subject matter experts who have experience in the skill, tool or domain of their project and are passionate about sharing their knowledge to impact millions of learners around the world.