DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
crawler
csharp
dotnetcore
scraping
crawling
webscraper
scrapy
entity-framework-core
webcrawler
webscraping
scrapy-crawler
ddd-architecture
htmlagilitypack
webcrawling
webcrawler-htmlagilitypack
-
Updated
Nov 13, 2019 - C#