Skip to content

Generic Adaptive Crawler (any browser + parser combo) #3187

@janbuchar

Description

@janbuchar

It should be possible to implement a crawler class that would allow combining any browser-based crawler with any plain-http-based crawler in the same way that AdaptivePlaywrightCrawler combines PlaywrightCrawler and CheerioCrawler.

Afterwards, AdaptivePlaywrightCrawler should be made a subclass of this for backwards compatibility.

Metadata

Metadata

Assignees

No one assigned

    Labels

    t-toolingIssues with this label are in the ownership of the tooling team.

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions