[Autogenerated] Now let's talk about scrapie spider and go over
its most important properties and methods.
The first property of scrapie Spider is name,
which defines the name of the spider.
Then we have allowed domains,
which is a list of domains that the spider is allowed to crawl.
Then we have start URL TLS, which defines a list of URL,
is where the spider will begin to crawl From.
Then, we have start request,
which is a method that returns an object that can be iterated.
This specifies the first request to crawl for the spider.
Then we have the parts method,
which is a default method that is used to process downloader responses.
Now let's have a look at how this could be implemented.
First, we need to import the scrapie library.
Then we need to specify the spider's name.
The domains of the spider is allowed to crawl and the girls that
will be used to start the crawling process.
Then we have the parse method which iterated through all the H
one tags of those girls and gets their value using the expat
method from the response object.
Then it also iterated through all the A tags getting all the links
available within those URL SSHD and returns multiple requests and
items from a single call back as you have seen,
that wasn't very difficult.