Skip to main content
1 credit per call

​
Method

services.scrape.website(params);

​
Input

​
url
string
required
URL to scrape (must start with http:// or https://)
​
params.limit
number
default:1
Number of pages to scrape (follows links)

​
Output

​
markdown
string
Combined markdown content from all pages
​
data
array
Per-page data: - markdown - Page content as markdown - links - Links found on page
​
socialUrls
object
Extracted social/contact URLs: - emailGeneral - Emails found - phoneGeneral - Phone numbers - linkedinProfile / linkedinCompany - LinkedIn URLs - facebookProfile / instagramProfile / twitterUser - Social profiles - youtubeChannel / tiktokProfile - Video platforms

​
Example

const result = await services.scrape.website({
  url: "https://example.com/about",
});

return result.markdown;

// Extract contact info
const result = await services.scrape.website({
  url: ctx.thisRow.get("Website"),
});

return result.socialUrls.emailGeneral[0];