This is the Linux app named Abot whose latest release can be downloaded as abotsourcecode.zip. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Abot with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS:
Abot
DESCRIPTION:
Abot is an open source C# web crawler framework designed to help developers efficiently crawl and process web content. It focuses on speed, flexibility, and extensibility while handling the complex low-level tasks involved in web crawling. It manages essential components such as multithreading, HTTP requests, scheduling, and link parsing so developers can focus on processing the collected data. Abot follows a modular architecture that allows developers to customize nearly every stage of the crawl process by implementing or replacing core interfaces. Abot exposes an event-driven model that enables applications to react to crawling events such as page completion or crawl restrictions. It also provides configuration options that control crawling behavior including concurrency limits, crawl delays, and request parameters. Designed to be lightweight and dependency-free, Abot runs without requiring external services or databases, making it easy to integrate.
Features
- High-performance web crawling with built-in multithreading support
- Event-driven architecture for processing crawled pages and data
- Pluggable interfaces allowing full customization of crawling behavior
- Configurable crawl settings including delays, concurrency, and limits
- HTML link extraction and automated URL scheduling
- Lightweight design with no external service or database dependencies
Programming Language
C#
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/abot.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.