4.5 KiB
URL Research to Documents
Download web articles and automatically create research documents in Mission Control.
When to Use
Use this skill when:
- User provides a URL and wants it researched/summarized
- Task description contains a URL to research
- Creating research notes from web articles
- Building a knowledge base in Mission Control Documents
Workflow
Step 1: Extract Article Content
Use Tavily via mcporter to extract the full article:
mcporter call tavily.tavily_extract 'urls=["URL_HERE"]' extract_depth=advanced format=markdown
Step 2: Create Document in Mission Control
Create a markdown document at:
Location: /Users/mattbruce/Documents/Projects/OpenClaw/Web/mission-control/app/documents/page.tsx
Document Format:
# [Article Title from extracted content]
**URL:** [original URL]
**Source:** [domain name]
**Date Researched:** [YYYY-MM-DD]
**Tags:** [auto-generated based on content]
---
## Summary
[2-3 paragraph overview of the article content]
## Key Takeaways
- [Bullet point 1]
- [Bullet point 2]
- [Bullet point 3]
## Notable Quotes
> [Direct quote from article]
## Related Tasks
- [Link to Gantt task if this came from a task]
## Action Items
- [ ] [Any follow-up actions]
Step 3: Save to Mission Control
The document is automatically saved via the Documents page's LocalStorage system.
Folder Organization
Default Folder: Research/
Sub-folders (auto-detect):
Research/AI & Agents/— AI, ML, OpenClaw, automation contentResearch/iOS Development/— Swift, Xcode, Apple contentResearch/Business & Marketing/— SaaS, indie hacking, growthResearch/Tools & Tech/— Development tools, frameworks
Auto-detection based on:
- URL domain (twitter.com → social, github.com → code)
- Article content keywords
- Title analysis
Examples
Example 1: Research from User Request
User: "Research this: https://x.com/Voxyz_ai/status/2019914775061270747"
Action:
mcporter call tavily.tavily_extract 'urls=["https://x.com/Voxyz_ai/status/2019914775061270747"]' extract_depth=advanced
Create Document:
- Title: "I Built an AI Company with OpenClaw + Vercel + Supabase — Two Weeks Later, They Run It Themselves"
- Folder: Research/AI Agents/
- Tags: #ai #agents #openclaw #automation #voxyz
Example 2: Research from Task Description
Task: "Research implementation details: https://github.com/openclaw/docs"
Action:
- Extract content with Tavily
- Create document in Research/Tools & Tech/
- Update task with link to document
- Move task to "review"
Example 3: Batch Research
User: "Research these 3 articles about AI coding"
Action:
- Extract all 3 URLs
- Create 3 separate documents
- Create summary index document linking all 3
- Tag with #ai-coding-collection
Document Naming Convention
Use article title exactly as published:
- ✅ "I Built an AI Company with OpenClaw..."
- ✅ "Swift 6.2: What's New for Developers"
- ✅ "The Ultimate Guide to CoreML"
Do NOT modify titles (as per user preference)
Tags (Auto-Generated)
Common tags to apply:
#ai— Artificial intelligence content#agents— AI agents, automation#openclaw— OpenClaw-related#ios— iOS development#swift— Swift programming#business— SaaS, entrepreneurship#research— All research documents#article— Web articles
Detection keywords:
- "agent", "automation", "workflow" → #agents
- "OpenClaw", "Claude", "AI" → #ai #openclaw
- "Swift", "iOS", "Xcode", "Apple" → #ios #swift
- "SaaS", "startup", "revenue" → #business
Integration with Gantt Tasks
When research comes from a task:
- Create the document
- Add task link to document:
Task: https://gantt-board.vercel.app/tasks/{task-id} - Optionally update task description with document link
- Move task to "review" status
Error Handling
If Tavily extraction fails:
- Try
extract_depth=basicinstead ofadvanced - Report failure to user with error details
- Suggest manual copy-paste as fallback
If document creation fails:
- Save to
/tmp/research-{timestamp}.mdas backup - Report error to user
- Provide file path for manual recovery
Rate Limits
- Tavily: ~1 request per second
- If rate limited, wait 10-15 seconds and retry
- Batch multiple URLs with 15-second delays between each
Related Skills
- tavily-web-research — General Tavily usage guide
- Use together: This skill for document creation, tavily-web-research for extraction commands