Data Streaming Claw
data-streaming-claw
v0.2.0May 28, 2026Streaming that does not lose events on partition rebalance — Kafka, schema registries, and exactly-once with real benchmarks
Designs streaming systems that do not lose events when partitions rebalance. Event schema registries, partitioning keyed by business logic, exactly-once semantics, backpressure that degrades gracefully, and throughput benchmarks with real numbers — not "should be fine."
PRIMARY ACTION
Unlock with ProWhen to Use
- Design clean data workflows
- Plan reliable ETL and quality checks
- Track metrics and pipeline health
- Deliver maintainable data outputs
Compatible Frameworks
8 TOOLs
Quality Gates
- Event schema defined and versioned
- Partitioning strategy documented
- Exactly-once semantics configured
- Backpressure handling implemented
- Throughput benchmark meets requirements
5 GATEs DEFINED
Expected Outputs
Native exports per tool
openclaw/AGENTS.mdopenclaw/SOUL.mdopenclaw/TOOLS.md+7 morehermes/skills/flickclaw/data-streaming-claw/SKILL.mdhermes/skills/flickclaw/data-streaming-claw/references/workflow.mdhermes/skills/flickclaw/data-streaming-claw/references/quality-gates.md+2 moreclaude-code/CLAUDE.mdclaude-code/.claude/skills/data-streaming-claw/SKILL.mdclaude-code/.claude/skills/data-streaming-claw/references/workflow.md+3 morecodex/AGENTS.mdcodex/.flickclaw/agents/data-streaming-claw/codex.mdcodex/.flickclaw/agents/data-streaming-claw/workflow.md+2 morecursor/.cursor/rules/flickclaw-data-streaming-claw.mdccursor/.cursor/rules/flickclaw-data-streaming-claw-workflow.mdccursor/.cursor/rules/flickclaw-data-streaming-claw-quality-gates.mdcwindsurf/.windsurf/rules/flickclaw-data-streaming-claw.mdwindsurf/.windsurf/rules/flickclaw-data-streaming-claw-workflow.mdwindsurf/.windsurf/rules/flickclaw-data-streaming-claw-quality-gates.mdaider/CONVENTIONS.mdaider/aider.mdaider/.aider.conf.ymlollama/Modelfileollama/system-prompt.mdollama/template.md+1 moreInstall Commands
Install the FlickClaw CLI, then select your AI agent framework below to get the correct install command.
Step 1: Install CLI (one-time)
npm install -g @flickclaw/cli@latestStep 2: Select Framework
npm exec --yes @flickclaw/cli@latest -- install data-streaming-claw --target openclawDownload as ZIP
Example Prompt
Try this prompt with Data Streaming Claw to see what it can do:
Analyze the data pipeline for quality issues. Review schema design, ETL processes, and monitoring. Produce Streaming Architecture (Kafka/Pulsar/Kinesis), Event Schema Registry, Partition Strategy Document.Example Output
IllustrativeWhat a typical Data Streaming Claw report looks like:
# Data Streaming Claw — Assessment Report **Project**: analytics-warehouse **Context**: a Snowflake data warehouse with 15 source integrations and daily ETL **Example type**: Illustrative output ## Executive Summary The Data Streaming Claw completed its review of analytics-warehouse (a Snowflake data warehouse with 15 source integrations and daily ETL). 3 findings were identified with concrete remediation steps. All quality gates were verified before delivery. ## Findings | # | Severity | Area | Finding | Recommended Action | |---|----------|------|---------|-------------------| | 1 | **P1** | Schema | Slowly changing dimensions not tracked for customer table | Add SCD Type 2 with effective_date and is_current | | 2 | **P2** | Quality | 5% null rate in revenue column across 3 sources | Add NOT NULL constraint and source-level validation | | 3 | **P2** | Performance | Materialized view refresh blocks reads for 12min | Switch to incremental refresh with partition pruning | ## Quality Gates - [✓] Event schema versioned in registry - [✓] Partition key chosen for consumer parallelism - [✓] Exactly-once delivery verified under rebalance ## Outputs Generated - **Streaming Architecture (Kafka/Pulsar/Kinesis)**: Included in the report above. - **Event Schema Registry**: Included in the report above. - **Partition Strategy Document**: Included in the report above. - **Throughput & Latency Benchmark**: Included in the report above. - **Streaming ETL Blueprint**: Included in the report above. ## Validation - [x] All quality gates passed (3/3) - [x] 3 findings documented with severity and remediation - [x] 5 output sections generated - [x] Evidence collected and referenced --- *This is an illustrative example output from FlickClaw. Results vary based on project context.*