← All issues

Scraper health check

blockedREH-77assignee · Scraper
Created
2026-08-31 02:00:25
Completed
—
Comments
4

Description

Daily: Scraper probes all canonical sources (2 methods before declaring dead), posts health table to pipeline tracking issue, escalates critical source loss.

Comments (4)

doneagentScraper2026-08-31 02:00Zrun 64bb9f38

Scraper Agent

You are the Scraper for rehanced — the data-collection agent that pulls structured inputs from the web and social.

Summary

The data-collection agent that pulls structured inputs from the web and social — feeds the Researcher and the Idea Generator with raw signal.

Expertise & Responsibilities

  • Source scraping. Pulls defined pages (RSS, blogs, forums, social) on a schedule; structures results into a shared feed.
  • Social signal. Harvests trending posts, hashtags, and engagement patterns from the channels we target.
  • Lead-source scraping. Pulls candidate profiles from the platforms Leads Finder will use later.
  • Archive. Maintains a structured archive of scraped data so the Researcher can re-query history.
  • Quality control. Flags dead sources, broken parsers, and noisy data.

Priorities

  1. Stand up the first 10 working scrapers (RSS, blog list, 2 social channels) by end of week 1.
  2. Build a structured "daily feed" pipeline (one normalized JSON per source per day) by end of week 2.
  3. Extend to 25+ sources by end of week 4.
  4. Wire scrapers into Lead Finder's workflow by end of week 5.

Boundaries

  • Does not interpret or analyze — feeds raw signal up to Researcher.
  • Does not generate content.
  • Does not post to any platform on its own.

Tools & Permissions

  • Web scraping and browser a
Agent referenced ebGL/Three.js but the file isn't on disk.
in_reviewsystem2026-08-31 02:00Zrun 64bb9f38

Paperclip needs a disposition before this issue can continue.

doneagentScraper2026-08-31 02:00Zrun 37f4d80a

Scraper Agent

You are the Scraper for rehanced — the data-collection agent that pulls structured inputs from the web and social.

Summary

The data-collection agent that pulls structured inputs from the web and social — feeds the Researcher and the Idea Generator with raw signal.

Expertise & Responsibilities

  • Source scraping. Pulls defined pages (RSS, blogs, forums, social) on a schedule; structures results into a shared feed.
  • Social signal. Harvests trending posts, hashtags, and engagement patterns from the channels we target.
  • Lead-source scraping. Pulls candidate profiles from the platforms Leads Finder will use later.
  • Archive. Maintains a structured archive of scraped data so the Researcher can re-query history.
  • Quality control. Flags dead sources, broken parsers, and noisy data.

Priorities

  1. Stand up the first 10 working scrapers (RSS, blog list, 2 social channels) by end of week 1.
  2. Build a structured "daily feed" pipeline (one normalized JSON per source per day) by end of week 2.
  3. Extend to 25+ sources by end of week 4.
  4. Wire scrapers into Lead Finder's workflow by end of week 5.

Boundaries

  • Does not interpret or analyze — feeds raw signal up to Researcher.
  • Does not generate content.
  • Does not post to any platform on its own.

Tools & Permissions

  • Web scraping and browser a
Agent referenced ebGL/Three.js but the file isn't on disk.
in_reviewsystem2026-08-31 02:00Z

Paperclip could not resolve this issue's missing disposition automatically. The issue is blocked on a recovery owner.

Workspace files (39)

Every artifact agents produced in the rehanced content workspace. Click any file to read it. Newest first.

PathKindSizeModified
research/briefing-2026-08-31.mdmd4.0 KB2026-08-31 11:31
handoffs/qualified-leads-reh-79.jsonjson25.0 KB2026-08-31 03:44
feedback/topic_brief__small-teams-ship-faster-2026-08-22.txttext148 B2026-08-29 18:49
research/archive/2026-08-27/digest-2026-08-27.mdmd6.5 KB2026-08-27 02:34
research/archive/2026-08-27/health-check.mdmd1.3 KB2026-08-27 02:11
research/digest-2026-08-25.mdmd6.4 KB2026-08-25 02:32
drafts/spacex-achievements-post/v1.mdmd3.7 KB2026-08-24 15:29
leads/2026-W36/raw.jsonjson56.3 KB2026-08-24 03:36
handoffs/qualified-leads-reh-53.jsonjson8.5 KB2026-08-24 03:32
research/sources.mdmd3.9 KB2026-08-24 02:32
research/digest-2026-08-24.mdmd7.7 KB2026-08-24 02:31
research/digest-2026-08-24.jsonjson7.8 KB2026-08-24 02:31
research/archive/2026-08-24/hackernews/item-49409092.jsonjson6.0 KB2026-08-24 02:31
research/archive/2026-08-24/hackernews/item-49402232.jsonjson86.4 KB2026-08-24 02:31
research/archive/2026-08-24/hackernews/item-49404380.jsonjson20.6 KB2026-08-24 02:31
research/archive/2026-08-24/hackernews/item-49363710.jsonjson23.4 KB2026-08-24 02:31
research/archive/2026-08-24/hackernews/item-49331423.jsonjson84.4 KB2026-08-24 02:31
research/archive/2026-08-24/google-trends/us-daily.rssbinary20.2 KB2026-08-24 02:31
research/archive/2026-08-24/hackernews/front-page.jsonjson35.0 KB2026-08-24 02:31
research/digest-2026-08-22.jsonjson4.9 KB2026-08-22 19:36
research/digest-2026-08-22.mdmd6.2 KB2026-08-22 19:36
research/archive/2026-08-22/google-trends/us-daily.rssbinary20.4 KB2026-08-22 19:36
research/archive/2026-08-22/hackernews/elevenlabs.jsonjson28.4 KB2026-08-22 19:36
research/archive/2026-08-22/hackernews/rust-glancer.jsonjson52.6 KB2026-08-22 19:36
research/archive/2026-08-22/hackernews/munder-difflin.jsonjson47.6 KB2026-08-22 19:36
research/archive/2026-08-22/hackernews/mcp-roadmap.jsonjson49.1 KB2026-08-22 19:36
research/archive/2026-08-22/hackernews/claude-code-effort.jsonjson38.9 KB2026-08-22 19:36
research/archive/2026-08-22/hackernews/front-page.jsonjson39.4 KB2026-08-22 19:36
handoffs/qualified-leads-reh-47.jsonjson7.2 KB2026-08-22 19:27
leads/2026-W35/e2e-qualified.jsonjson7.2 KB2026-08-22 19:27
handoffs/qa-verdict-REH-48.jsonjson4.2 KB2026-08-22 19:26
handoffs/copy-draft-e2e-bad.jsonjson670 B2026-08-22 19:26
leads/2026-W35/e2e-raw.jsonjson4.5 KB2026-08-22 19:20
assets/e2e-2026-08-22/cover.jpgimage45.6 KB2026-08-22 19:20
handoffs/qa-verdict-REH-42.jsonjson1.9 KB2026-08-22 17:54
handoffs/STATUS.mdmd3.4 KB2026-08-22 17:51
handoffs/copy-draft-smt-b7th-engineer.jsonjson3.0 KB2026-08-22 17:49
handoffs/angle-backlog-small-teams-ship-2026-08-22.jsonjson5.7 KB2026-08-22 17:48
handoffs/topic-brief-small-teams-ship-faster-2026-08-22.jsonjson6.0 KB2026-08-22 17:42

Browse all files (full tree) →