LightState Registry / Verified X Builder Use Cases / Engineering & DevOps / data-postgres-to-duckdb-parquet-nightly-archiver
⚡ Pulse Score 85/100
Hot Postgres to Cold R2 Parquet Nightly Archiver via DuckDB
Offload audit and telemetry rows older than 90 days from primary Postgres into compressed ZSTD Parquet files on Cloudflare R2.
⚡ 1-Click Agent & Developer Install
Zero Auth · Ready for Grok Bot, Claude Code & Cursornpx lightstate inspect data-postgres-to-duckdb-parquet-nightly-archiver
Copy-Paste System Prompt / Routine Blueprint:
Execute the 'Hot Postgres to Cold R2 Parquet Nightly Archiver via DuckDB' (data-postgres-to-duckdb-parquet-nightly-archiver) blueprint with Postgres MCP, Cloudflare MCP, GitHub MCP. Goal: Offload audit and telemetry rows older than 90 days from primary Postgres into compressed ZSTD Parquet files on Cloudflare R2. First inspect live state in read-only mode, validate all identifiers and metrics, and output a concrete action plan with verification commands before making any changes.
Synthesized Engineering Blueprint & Setup Guide
### 1. Problem & Operational Bottleneck
Offload audit and telemetry rows older than 90 days from primary Postgres into compressed ZSTD Parquet files on Cloudflare R2. Built and battle-tested in production workflows by **@rauchg** (Guillermo Rauch (@rauchg)).
### 2. Target Architecture & Required Stack
- **Postgres MCP**
- **Cloudflare MCP**
- **GitHub MCP**
### 3. Step-by-Step Implementation Blueprint
1. Connect Postgres MCP, Cloudflare MCP, GitHub MCP and verify read-only access to the target workspace.
2. Run the discovery query for 'Hot Postgres to Cold R2 Parquet Nightly Archiver via DuckDB' to establish baseline metrics and identify anomalies.
3. Generate a structured remediation or execution artifact with full source citations and diffs.
4. Stage any mutating actions behind an explicit human approval gate and verify final state.
### 4. Copy-Paste Agent Execution Prompt
```markdown
Execute the 'Hot Postgres to Cold R2 Parquet Nightly Archiver via DuckDB' (data-postgres-to-duckdb-parquet-nightly-archiver) blueprint with Postgres MCP, Cloudflare MCP, GitHub MCP. Goal: Offload audit and telemetry rows older than 90 days from primary Postgres into compressed ZSTD Parquet files on Cloudflare R2. First inspect live state in read-only mode, validate all identifiers and metrics, and output a concrete action plan with verification commands before making any changes.
```
### 5. Verification & Safety Guardrails
- **Human-in-the-Loop Gate:** All external communications, production database mutations, and billing actions stage an explicit review diff before execution.
- **Deterministic Telemetry:** Every run logs structured JSON output, latency metrics, and source citations so operators can audit every decision.
Tags: #postgres-mcp#cloudflare-mcp#github-mcp#blueprint#engineering
✓ CERTIFIED X BUILDER PORTFOLIO
More Capabilities Curated from @rauchg
Related Verified Capabilities
Explore Engineering & DevOps → MCP Server ★ Featured Partner ✓ Claimed
⚡ 98
Grok Template ✓ Claimed
⚡ 97
Dr. Eggbot — Meta-Agent Architect & Bot Builder
MCP Server ✓ Claimed
⚡ 89
Visual Sentinel MCP — Automated UI Pixel-Diff & Layout QA Server
MCP Server ✓ Claimed
⚡ 88
Cloudflare Official MCP — Workers, D1, R2, KV & Observability
Use Case
⚡ 95