170 lines
4.5 KiB
Markdown
170 lines
4.5 KiB
Markdown
# URL Research to Documents
|
|
|
|
Download web articles and automatically create research documents in Mission Control.
|
|
|
|
## When to Use
|
|
|
|
Use this skill when:
|
|
- User provides a URL and wants it researched/summarized
|
|
- Task description contains a URL to research
|
|
- Creating research notes from web articles
|
|
- Building a knowledge base in Mission Control Documents
|
|
|
|
## Workflow
|
|
|
|
### Step 1: Extract Article Content
|
|
|
|
Use Tavily via mcporter to extract the full article:
|
|
|
|
```bash
|
|
mcporter call tavily.tavily_extract 'urls=["URL_HERE"]' extract_depth=advanced format=markdown
|
|
```
|
|
|
|
### Step 2: Create Document in Mission Control
|
|
|
|
Create a markdown document at:
|
|
**Location:** `/Users/mattbruce/Documents/Projects/OpenClaw/Web/mission-control/app/documents/page.tsx`
|
|
|
|
**Document Format:**
|
|
```markdown
|
|
# [Article Title from extracted content]
|
|
|
|
**URL:** [original URL]
|
|
**Source:** [domain name]
|
|
**Date Researched:** [YYYY-MM-DD]
|
|
**Tags:** [auto-generated based on content]
|
|
|
|
---
|
|
|
|
## Summary
|
|
[2-3 paragraph overview of the article content]
|
|
|
|
## Key Takeaways
|
|
- [Bullet point 1]
|
|
- [Bullet point 2]
|
|
- [Bullet point 3]
|
|
|
|
## Notable Quotes
|
|
> [Direct quote from article]
|
|
|
|
## Related Tasks
|
|
- [Link to Gantt task if this came from a task]
|
|
|
|
## Action Items
|
|
- [ ] [Any follow-up actions]
|
|
```
|
|
|
|
### Step 3: Save to Mission Control
|
|
|
|
The document is automatically saved via the Documents page's LocalStorage system.
|
|
|
|
## Folder Organization
|
|
|
|
**Default Folder:** `Research/`
|
|
|
|
**Sub-folders (auto-detect):**
|
|
- `Research/AI & Agents/` — AI, ML, OpenClaw, automation content
|
|
- `Research/iOS Development/` — Swift, Xcode, Apple content
|
|
- `Research/Business & Marketing/` — SaaS, indie hacking, growth
|
|
- `Research/Tools & Tech/` — Development tools, frameworks
|
|
|
|
**Auto-detection based on:**
|
|
- URL domain (twitter.com → social, github.com → code)
|
|
- Article content keywords
|
|
- Title analysis
|
|
|
|
## Examples
|
|
|
|
### Example 1: Research from User Request
|
|
|
|
**User:** "Research this: https://x.com/Voxyz_ai/status/2019914775061270747"
|
|
|
|
**Action:**
|
|
```bash
|
|
mcporter call tavily.tavily_extract 'urls=["https://x.com/Voxyz_ai/status/2019914775061270747"]' extract_depth=advanced
|
|
```
|
|
|
|
**Create Document:**
|
|
- **Title:** "I Built an AI Company with OpenClaw + Vercel + Supabase — Two Weeks Later, They Run It Themselves"
|
|
- **Folder:** Research/AI Agents/
|
|
- **Tags:** #ai #agents #openclaw #automation #voxyz
|
|
|
|
### Example 2: Research from Task Description
|
|
|
|
**Task:** "Research implementation details: https://github.com/openclaw/docs"
|
|
|
|
**Action:**
|
|
1. Extract content with Tavily
|
|
2. Create document in Research/Tools & Tech/
|
|
3. Update task with link to document
|
|
4. Move task to "review"
|
|
|
|
### Example 3: Batch Research
|
|
|
|
**User:** "Research these 3 articles about AI coding"
|
|
|
|
**Action:**
|
|
1. Extract all 3 URLs
|
|
2. Create 3 separate documents
|
|
3. Create summary index document linking all 3
|
|
4. Tag with #ai-coding-collection
|
|
|
|
## Document Naming Convention
|
|
|
|
**Use article title exactly as published:**
|
|
- ✅ "I Built an AI Company with OpenClaw..."
|
|
- ✅ "Swift 6.2: What's New for Developers"
|
|
- ✅ "The Ultimate Guide to CoreML"
|
|
|
|
**Do NOT modify titles** (as per user preference)
|
|
|
|
## Tags (Auto-Generated)
|
|
|
|
**Common tags to apply:**
|
|
- `#ai` — Artificial intelligence content
|
|
- `#agents` — AI agents, automation
|
|
- `#openclaw` — OpenClaw-related
|
|
- `#ios` — iOS development
|
|
- `#swift` — Swift programming
|
|
- `#business` — SaaS, entrepreneurship
|
|
- `#research` — All research documents
|
|
- `#article` — Web articles
|
|
|
|
**Detection keywords:**
|
|
- "agent", "automation", "workflow" → #agents
|
|
- "OpenClaw", "Claude", "AI" → #ai #openclaw
|
|
- "Swift", "iOS", "Xcode", "Apple" → #ios #swift
|
|
- "SaaS", "startup", "revenue" → #business
|
|
|
|
## Integration with Gantt Tasks
|
|
|
|
When research comes from a task:
|
|
|
|
1. Create the document
|
|
2. Add task link to document: `Task: https://gantt-board.twisteddevices.com/tasks/{task-id}`
|
|
3. Optionally update task description with document link
|
|
4. Move task to "review" status
|
|
|
|
## Error Handling
|
|
|
|
**If Tavily extraction fails:**
|
|
- Try `extract_depth=basic` instead of `advanced`
|
|
- Report failure to user with error details
|
|
- Suggest manual copy-paste as fallback
|
|
|
|
**If document creation fails:**
|
|
- Save to `/tmp/research-{timestamp}.md` as backup
|
|
- Report error to user
|
|
- Provide file path for manual recovery
|
|
|
|
## Rate Limits
|
|
|
|
- Tavily: ~1 request per second
|
|
- If rate limited, wait 10-15 seconds and retry
|
|
- Batch multiple URLs with 15-second delays between each
|
|
|
|
## Related Skills
|
|
|
|
- **tavily-web-research** — General Tavily usage guide
|
|
- Use together: This skill for document creation, tavily-web-research for extraction commands
|