Adding Websites
Adding Websites
Adding Websites
Connect a website, blog, or public pages so the AI Double can answer questions using site content. The AI extracts visible text from the pages added.
How to add websites
- Open Knowledge Base (find it in the sidebar under Double AI Twin)
- Click Website URL in Data Sources section
- Choose Single Page or Multiple Pages
- Paste the website URL
- Click Crawl website and train
Websites appear in the Links section on the same page.
What to know
- Single Page - Adds one specific page
- Multiple Pages - Crawls entire site or multiple pages
- Only visible text is imported - Images and hidden content aren't captured
- Previously crawled pages are excluded - Prevents duplicate content
- Paid articles not supported - Content behind paywalls won't work
- Social profiles not supported - Use social media connectors instead
Best practices
Add websites that contain:
- Services or product pages
- About page and team information
- Blog posts or articles
- Support documentation
- Case studies or testimonials
Use a Single Page for specific content. Use Multiple Pages to import the entire site at once.
Managing websites
To delete a website, click the trash icon next to the URL in the Links section.
Next steps:
- Adding Websites
- Connecting X/Twitter
- Connecting LinkedIn
- Connecting YouTube
- Context Instructions