Content Scraper Page
The Content Scraping from URL feature in your LeadsWithDemos site enables you to automatically extract content from any publicly accessible web page by simply entering its URL. With one click, the system retrieves the main body content from the provided URL and displays it directly within the platform’s editor.
When scraping or retrieving content with the SEO Assistant in your LeadsWithDemos site, it’s recommended to work at the main keyword level, where you can associate a specific page URL. This method allows you to organize scraped content from your website or blog into categories or topics within the Schema File Tab, found under the AI Assistant’s SEO Settings. By extracting the HTML content of each page, you can further segment information by topic or category. This process helps ensure that, when you provide the Schema File as custom knowledge for your website or blog to a custom-trained AI Assistant, it recognizes which page URLs it can reference to deliver accurate information and boost engagement—since not every page or article may be relevant to your audience.
There are times when you’ll want to expand your AI Assistant’s knowledge, especially for the LeadsWithDemos “Other Assistant” type, to deliver more robust support and sustain audience engagement. This is where the Content Scraper Page becomes essential: it lets you fetch content from a specific page URL and save it as a vector file, making it easy to enhance your custom-trained AI Assistant with targeted, up-to-date content for richer, more relevant responses.
The Content Scraping from URL feature in your LeadsWithDemos site allows you to quickly extract the main content from any publicly accessible web page simply by entering the page’s URL. Once the URL is provided and the “Get content” button is clicked, the system automatically retrieves and displays the core body content from the specified web page within the platform’s visual editor.
How it Works
Step 1 – Enter the Target URL: Input the web page URL you want to extract content from into the provided field.
Step 2 – Fetch the Content: Click the “Get content” button to retrieve the main body content from the specified URL.
Step 3 – Review and Edit: The extracted content is automatically imported and displayed in the editor. Here, you can review, organize, or further edit the content as needed.
Step 4 – Save or Copy the Content:
- If you wish to use the retrieved content as knowledge (vector) for an AI Assistant, simply click the “Save as vector file” button. This action saves the content as a text file and stores it in your AI Assistant’s file manager for future use.
- Alternatively, if you want to quickly copy the retrieved content, click the “Save to Clipboard” icon to copy everything in one click for use elsewhere.