bmjjr released this
Dec 3, 2018
· 25 commits to master since this release
Fixed a bug in BaseWorker.load_items() method which previously resulted in losing scrape data when the number of workers did not equal the number of tasks. Now, using any number of workers or pool size will result in consistent export/save results. While scrape time will change proportional to the number of workers assigned. Wrote tests to ensure the same.