The web is filled with data, only the data is trapped inside HTML pages.
Google has found well over 100 trillion web pages,
and there's useful information,
even profit and innovative business models locked up in many of those pages.
All data scientists love data.
We can never get enough,
and web scraping is the key to unleash the data for your data science projects.
I'm Clarke Bishop, a big data engineer.
In my day‑to‑day work,
I lead a team of engineers and data scientists to
solve real‑world, big data problems.
In this course,
we're going to set the data free. Welcome to my course on
Exploring Web Scraping with Python.
I'll introduce you to several Python web scraping packages to get
you started scraping the web, automated HTTP to download data from
the web, ways you can select the exact data you want to extract,
it's SQL for web scraping.
Along the way,
you'll learn Chrome Developer Tools tricks for scraping and how to
use JupyterLab to improve your scraping results.
I'll show you how to build a spider and how to solve
some common scraping problems,
in particular how to scrape pages that are generated with JavaScript.
As long as you already know some basic Python, you're ready for this course.
Python is really great for web scraping.
By the end of the course, you'll know the territory and many web scraping tricks.
I hope you'll join me on this journey to explore web scraping with Python.