And this demo brings us to the very end of this module
on getting started with web scraping.
We started this module off by understanding how HTTP requests
and responses work and how HTTP can be used to access and
download content from a target URL.
We understood what HTTP requests and responses were,
and we saw how we could fetch web content using HTTP.
When working in Python,
we saw that we have a number of different HTTP clients that
we can choose from to make web requests.
We understood the different clients available and how we would
choose between these different Python libraries.
We saw that Python requests is the library of choice.
It's high level and intuitive.
You would use httplib2 for more granular control and urllib if you
don't want to install an additional package.
We then got hands-on practice using all of these different Python libraries,
and we saw how we could perform GET, PUT,
and POST requests in each of these.
And we also got some hands-on practice handling redirects from URLs.
In this module, we focused on fetching web content from target URLs.
In the next module, we'll see how we'll parse this downloaded content.