[Autogenerated] Hi.
Welcome back again.
We're not going to review how we can influence creepy crawling in this module
will highlight how to gather and organize data that could be later exported
for insights and business intelligence analysis,
which will do by using input processor item loaders and pipelines.
Sounds exciting.
So let's have a look.
Let's review what we're going to cover in this module.
First, we'll explore allowing deny rules and how they can be used control.
Which pages could be scraped end, which cannot.
Then we'll have a look at processors,
which provide the ability to pre and post process raw scraped data to format
and to clean it after we'll have a look at item loaders.
These are convenient mechanism for populating scraped items After a night,
um has been scraped by spider.
It is sent to an item pipeline,
which basically is a set of several components that are executed sequentially.