As we deal with different web scrapers, a problem appeared: while a custom scraper can be focused to your specific needs and scrape everything, off-the-shelf web scrapers are often quite generic and mostly designed to perform common, simple tasks. In other words, they may appear not to be as flexible and universal as you’d expect. Of course, all web scraper developers try to make their products scrape all kinds of web pages, but we realized some of them are better suited for one type of task and others, for another.
What web scraper should you buy that will serve you for a long time with different future tasks? This question spurred us to start a “Web Scraper Test Drive” project. And here are some points about this project:
- We were kindly presented with web scrapers from 10 companies for us to test them
- A special testing ground was created with several difficult cases, which we are tested within our web harvesting practice (some of them are not available on that page yet, but we’ll open them as our testing goes on)
- We tried to scrape each of those cases with each of the web scrapers and post the results of each trial
- If we couldn’t do it ourselves, we contacted the scraper developers to see how they could help us
We’ve done all the hard work, so you can just examine the results and decide which scraper best fits your needs. Keep in touch!
Continue at: http://scraping.pro/web-scraper-test-drive/
The text above is owned by the site bellow referred.
Here is only a small part of the article, for more please follow the link