ConnectorsDeprecated
Web Crawler
The web crawler connector is deprecated
Web Crawler
Deprecated
The web crawler connector is deprecated and can no longer be connected (the backend refuses new connections with HTTP 410). Crawling is now built into the platform as the Web Crawl native scraper. To save individual webpages, you can also use the SurfSense browser extension, which captures pages behind authentication.