Core Components

Core components are the basic building blocks for building your own crawler. They include:

• Bus Components to manage the process of crawling

• RPC Components to communicate with RPC APIs

• Stats Components tracking the performance of individual components or the crawler as a whole

• Click Components to integrate with click commands