Pipeline v2 Preview
Rollback-safe architecture preview for the multi-agent equity research pipeline. This page documents the free/open-source-first connector stack, Finviz enrichment layer, and paid/MCP fallback rules before the live pipeline is pivoted.
Current production pipeline · Machine-readable v2 spec · Report library
Deployment and rollback posture
Status: preview_not_current. The existing /pipeline/ method page and equityanalysis-reports Cloudflare Pages project remain the production reference until manually promoted.
Preview target: deploy this branch to a separate Cloudflare Pages project named equityanalysis-reports-v2-preview. This makes the rollout rollback-safe: Telegram summaries and production navigation can continue linking to /pipeline/ if v2 has issues.
Free/open-source-first connector policy
- Official free/open APIs first: SEC EDGAR, FRED, Congress.gov, Nasdaq Trader-style symbol files.
- Self-hosted direct connectors second: local RSS/Nitter collector, public political disclosure ingestion, local scoring.
- Reviewed open-source libraries third: yfinance, Finviz connector, pandas/numpy indicators, OpenBB if useful later.
- Paid hosted APIs only as fallbacks: Polygon, Alpha Vantage, QuiverQuant, Apify, FMP, FinancialDatasets.
- MCP only when reviewed and sandboxed: unreviewed MCP servers are not default data connectors due to cybersecurity concerns.
Default v1 connectors to build
social_rssyahoofredsec_edgarfinvizpolitical_disclosures
These are the minimum free/open connectors needed to move from the current social-signal-first cron to the broader agent pipeline.
Paid connectors deferred
apifypolygonquiverquantalpha_vantagefmp
These stay disabled unless a free connector proves insufficient for reliability, coverage, or data quality.
Agent-by-agent connector map
| Agent | Free/open-source default | Paid fallback | Preview scope |
|---|---|---|---|
| 01 Macro Regime | yfinance, FRED, pandas | Polygon, Alpha Vantage | SPY/QQQ/IWM/sector trends, VIX, rates, credit spreads, deterministic regime score. |
| 02 Social | Current RSS/Nitter-style curated-account collector | X API v2, Apify | Keep social as discovery only; add local baseline scoring before paid broad search. |
| 02B Oversold | yfinance OHLCV, pandas indicators, SEC Companyfacts/Form 4, Finviz | Polygon, FMP, FinancialDatasets | 52-week low/RSI/Bollinger/MACD filters plus fundamental survival check. |
| 02C Political | House/Senate disclosures, Congress.gov, GovTrack-style open data | QuiverQuant, CapitolTrades/Apify | Self-hosted STOCK Act ingestion; social political accounts become corroboration only. |
| 03 Distiller | Local deterministic scoring, Finviz enrichment, SEC/Yahoo context | None required for v1 | Confluence boost across sources; LLM explains rankings but does not invent them. |
| 04 Deep Dive | SEC EDGAR, Yahoo, company IR, news RSS | Licensed transcripts, FactSet/Bloomberg | Upgrade current citation-verified report schema. |
| 05 Model | SEC Companyfacts, yfinance, custom model | Visible Alpha, FactSet, FMP | Human-gated public-data model only. |
| 06 PM | Local portfolio state, yfinance returns, PyPortfolioOpt/Riskfolio later | Options/brokerage APIs | Paper portfolio/risk dashboard only; no execution connector. |
Finviz enrichment
Finviz enrichment is assigned to Agent 03 and Agent 02B support. It should be implemented as a pinned, rate-limited, cached direct Python connector with no secrets. It is an unofficial delayed-data scraper, so outputs must be labeled accordingly and never treated as execution-quality market data.
Useful fields
Valuation, performance, RSI/technicals, ownership, short float, recent news, insider transactions, analyst target/rating changes.
Controls
Pin version or commit, cache results, apply backoff, preserve source timestamps, fail soft if Finviz changes its DOM.
Promotion gate
- Local dry run produces valid structured outputs for Agents 01, 02, 02B, 03.
- Agent 04 continues using the Pipeline v1 claim/citation verifier, with every verifier role passing before output is considered promotion-ready.
- Preview site deploys successfully and is manually reviewed.
- Telegram summaries link to preview only during testing.
- Human approval is required before replacing
/pipeline/or changing the current cron behavior.
MRVL selected-ticker smoke test
MRVL smoke test: PASSv1 verifier intact
The selected ticker smoke test exercises the v2 DAG shape with MRVL as a manual override, then routes Agent 04 through the existing Pipeline v1 citation verifier. No portfolio action or target price is generated in smoke mode.
- Result JSON: pipeline-v2-smoke-mrvl-2026-06-03.json
- Generated report: mrvl-deep-dive-2026-06-03.html
- Verifier audit: mrvl-citation-verification-2026-06-03.md
Machine-readable artifacts
Spec: data/pipeline/v2-preview.json
Tag metadata: data/pipeline/tags/pipeline-v2-preview-20260603.json