[Autogenerated] Now let's talk about allowing deny rules.
By using allowing the night rules, you will be able to control what URL,
Azure, crossfire or crawls.
The allow option is a single regular expression or list of regular
expressions that the girls must match in order to be extracted.
If not given or empty, it will match all links.
In this case, you are else that contained the catalog category.
Books Path will be crawled.
The deny option is the opposite, and it indicates which you are.
All paths won't be crawled by the spider.
In this case, erotica 50 and crying 51 won't be considered by the spider.