A search for local businesses and a search for videos ask different questions. They also need different inputs, pagination rules, and output fields. That is why we’re planning source-specific Actors for BatScrape.
This is a design direction for the Actors in development, rather than a report from a mature catalogue.
Start with a clear task
An Actor should explain what it collects before someone starts a run. For a maps scraper, that might mean listings for a query and a location. For a video scraper, the inputs and the meaning of a result will be different.
We want each listing to describe its own supported inputs, example output, and limits. A field that matters for one source should not become an unexplained empty column in every other dataset.
Share conventions where they help
Source-specific does not mean every detail needs a different name. We plan to use consistent conventions for source URLs, collection timestamps, and record identifiers where the underlying data allows it.
The source still determines what can be collected. Shared conventions cannot create fields that a source does not expose.
Make availability explicit
Our website currently links planned scrapers to the
BatScrape Apify profile
. As Actors are released, each scraper will link to its own listing. That listing will be the place to check supported behavior before running a job.
BatScrape Team
Building BatScrape