Scrapy spider can close unexpectedly for many reasons. If you’d like to notify yourself or do anything whenever a spider closes (expectedly or unexpectedly)
- Create a function named anything e.g crawlFinished()
- Then paste
self.crawlFinish()
at the bottom of closed() function - Now your function will be executed each time crawler exits