{"owner":"redpanda-data","repo":"connect","hasSkills":true,"hasMcp":false,"mcpConfig":null,"found":["CLAUDE.md"],"skills":{"CLAUDE.md":"# CLAUDE.md\n\nAI agent guidance for working with Redpanda Connect codebase.\n\n---\n\n## Skills and Agents\n\n| Task | Skill / Agent |\n|---|---|\n| Writing or modifying Go code | `godev` agent |\n| Writing or modifying tests | `tester` agent |\n| Code review | `/review` skill |\n\n## Plugin: Redpanda Connect\n\nYAML configuration, Bloblang authoring, and component discovery are provided by the `redpanda-connect` plugin from `.claude-plugin`.\n\n### Prerequisites\n\n```bash\nbrew install redpanda-data/tap/redpanda python3 jq\nrpk connect install\n```\n\n### Installation\n\n```bash\n/plugin marketplace add /path/to/connect   # local dev\n/plugin install redpanda-connect\n```\n\nRestart Claude Code after installation.\n\n### Commands\n\n| Command | Purpose |\n|---|---|\n| `/rpcn:search <query>` | Natural language component discovery |\n| `/rpcn:blobl <description> [sample=<json>]` | Bloblang transformation authoring |\n| `/rpcn:pipeline <description> [file=<path>]` | Pipeline creation and repair |\n\nThe plugin also auto-triggers on mentions of Redpanda Connect, streaming pipelines, or Bloblang.\n\n---\n\n## Project Overview\n\nRedpanda Connect is a high-performance stream processor built on **benthos** (`github.com/redpanda-data/benthos/v4`).\nThis repository adds enterprise features, proprietary connectors, and Redpanda-specific optimizations to the upstream benthos framework.\n\n---\n\n## Build Commands\n\n### Building\n```bash\ntask build:all                    # Build all 4 binary distributions\ntask build:redpanda-connect       # Full-featured binary\ntask build:redpanda-connect-cloud # Cloud-safe version (no filesystem)\ntask build:redpanda-connect-community # Apache 2.0 only version\ntask build:redpanda-connect-ai    # AI-focused version\n\n# Build with external dependencies (ZMQ, etc.)\nTAGS=x_benthos_extra task build:all\n```\n\n### Testing\n```bash\ntask test                         # Run unit and template tests\ntask test:unit                    # Run unit tests only (alias: task test:ut)\ntask test:unit-race               # Run unit tests with race detection\ntask test:template                # Run template/Bloblang tests (alias: task test:tmpl)\ntask test:integration                    # Run all integration tests (alias: task test:it)\ntask test:integration -- aws kafka       # Run integration tests filtered by package name\n\n# Run specific test\ngo test -v -run TestFunctionName ./internal/impl/category/\n```\n\nIntegration tests require Docker and are skipped by default.\n\n### Code Quality\n```bash\ntask fmt                          # Format code with gofumpt\ntask lint                         # Run golangci-lint\ntask vuln                         # Run vulnerability scanner\ntask build:clean                  # Clean build artifacts\n```\n\n### Documentation\n```bash\ntask docs                         # Generate documentation and validate examples\n```\n\n### Running Locally\n```bash\ntask run                          # Run with default config (config/dev.yaml)\ntask run CONF=./path/to/config.yaml # Run with specific config\n\n# Or directly with go\ngo run ./cmd/redpanda-connect --config ./config.yaml\n\n# Or using rpk (if installed)\nrpk connect run ./config.yaml\n```\n\n### Other Commands\n```bash\ntask deps                         # Tidy Go modules\ntask bundles                      # Update bundle imports\ntask bump-benthos                 # Update benthos dependency\n```\n\n---\n\n## Architecture\n\n### Multi-Distribution System\n\nFour binary distributions with different component sets:\n\n| Distribution | Purpose | Components |\n|---|---|---|\n| `redpanda-connect` | Full-featured, self-hosted | All (community + enterprise) |\n| `redpanda-connect-cloud` | Serverless/cloud | Cloud-safe subset, no filesystem |\n| `redpanda-connect-community` | Open-source | Apache 2.0 only |\n| `redpanda-connect-ai` | AI workflows | Cloud + AI integrations |\n\nComponent availability controlled by:\n- `public/bundle/enterprise/` and `public/bundle/free/` - Distribution-specific package imports\n- `public/schema/` - Schema generation and filtering per distribution\n- `internal/plugins/info.csv` - Component metadata (columns: `cloud`, `cloud_with_gpu`)\n\n### Directory Structure\n\n`internal/impl/{category}/` - Component implementations. Each category contains inputs, outputs, processors, caches for that system.\n\n`public/components/{category}/` - Public API wrappers. Thin `import _` wrappers for selective compilation.\n\n`internal/cli/` - Enterprise CLI (license management, MCP server, agent mode).\n\n`internal/license/` - RCL validation and enforcement.\n\n`internal/rpcplugin/` - RPC plugin system (Python/Go templates).\n\n`public/schema/` - Distribution-specific schema generation.\n\n`cmd/` - Binary entry points for each distribution.\n\n### Benthos Integration\n\nRedpanda Connect imports benthos's public service API: `github.com/redpanda-data/benthos/v4/public/service`.\nInherits benthos's component interfaces, configuration DSL, validation, and runtime.\n\nComponent registration, config specs, license headers, and certification standards are covered in the `godev` skill/agent.\n\n---\n\n## Key Non-Obvious Patterns\n\n1. **Distribution gating is compile-time:** Different binaries import different `public/components/` packages. Schema filters at runtime based on `internal/plugins/info.csv`.\n\n2. **Template tests validate YAML configs:** `task test:template` runs actual binaries against config files in `config/test/` and `internal/impl/*/tmpl.yaml`.\n\n3. **Cloud distribution is restrictive:** Only pure processors (no side effects) and pure Bloblang functions. Check `schema.Cloud()` for filtering logic.\n\n---\n\n## Common Gotchas\n\n- **External dependencies:** Components requiring C libraries (like ZMQ) are excluded by default. Use `TAGS=x_benthos_extra task build:all`.\n- **Template tests are slow:** They build and run actual binaries. Run only changed tests during development.\n- **License headers matter:** CI fails if headers don't match the component's distribution classification. See `godev` skill/agent for header formats.\n"},"files":{"CLAUDE.md":"# CLAUDE.md\n\nAI agent guidance for working with Redpanda Connect codebase.\n\n---\n\n## Skills and Agents\n\n| Task | Skill / Agent |\n|---|---|\n| Writing or modifying Go code | `godev` agent |\n| Writing or modifying tests | `tester` agent |\n| Code review | `/review` skill |\n\n## Plugin: Redpanda Connect\n\nYAML configuration, Bloblang authoring, and component discovery are provided by the `redpanda-connect` plugin from `.claude-plugin`.\n\n### Prerequisites\n\n```bash\nbrew install redpanda-data/tap/redpanda python3 jq\nrpk connect install\n```\n\n### Installation\n\n```bash\n/plugin marketplace add /path/to/connect   # local dev\n/plugin install redpanda-connect\n```\n\nRestart Claude Code after installation.\n\n### Commands\n\n| Command | Purpose |\n|---|---|\n| `/rpcn:search <query>` | Natural language component discovery |\n| `/rpcn:blobl <description> [sample=<json>]` | Bloblang transformation authoring |\n| `/rpcn:pipeline <description> [file=<path>]` | Pipeline creation and repair |\n\nThe plugin also auto-triggers on mentions of Redpanda Connect, streaming pipelines, or Bloblang.\n\n---\n\n## Project Overview\n\nRedpanda Connect is a high-performance stream processor built on **benthos** (`github.com/redpanda-data/benthos/v4`).\nThis repository adds enterprise features, proprietary connectors, and Redpanda-specific optimizations to the upstream benthos framework.\n\n---\n\n## Build Commands\n\n### Building\n```bash\ntask build:all                    # Build all 4 binary distributions\ntask build:redpanda-connect       # Full-featured binary\ntask build:redpanda-connect-cloud # Cloud-safe version (no filesystem)\ntask build:redpanda-connect-community # Apache 2.0 only version\ntask build:redpanda-connect-ai    # AI-focused version\n\n# Build with external dependencies (ZMQ, etc.)\nTAGS=x_benthos_extra task build:all\n```\n\n### Testing\n```bash\ntask test                         # Run unit and template tests\ntask test:unit                    # Run unit tests only (alias: task test:ut)\ntask test:unit-race               # Run unit tests with race detection\ntask test:template                # Run template/Bloblang tests (alias: task test:tmpl)\ntask test:integration                    # Run all integration tests (alias: task test:it)\ntask test:integration -- aws kafka       # Run integration tests filtered by package name\n\n# Run specific test\ngo test -v -run TestFunctionName ./internal/impl/category/\n```\n\nIntegration tests require Docker and are skipped by default.\n\n### Code Quality\n```bash\ntask fmt                          # Format code with gofumpt\ntask lint                         # Run golangci-lint\ntask vuln                         # Run vulnerability scanner\ntask build:clean                  # Clean build artifacts\n```\n\n### Documentation\n```bash\ntask docs                         # Generate documentation and validate examples\n```\n\n### Running Locally\n```bash\ntask run                          # Run with default config (config/dev.yaml)\ntask run CONF=./path/to/config.yaml # Run with specific config\n\n# Or directly with go\ngo run ./cmd/redpanda-connect --config ./config.yaml\n\n# Or using rpk (if installed)\nrpk connect run ./config.yaml\n```\n\n### Other Commands\n```bash\ntask deps                         # Tidy Go modules\ntask bundles                      # Update bundle imports\ntask bump-benthos                 # Update benthos dependency\n```\n\n---\n\n## Architecture\n\n### Multi-Distribution System\n\nFour binary distributions with different component sets:\n\n| Distribution | Purpose | Components |\n|---|---|---|\n| `redpanda-connect` | Full-featured, self-hosted | All (community + enterprise) |\n| `redpanda-connect-cloud` | Serverless/cloud | Cloud-safe subset, no filesystem |\n| `redpanda-connect-community` | Open-source | Apache 2.0 only |\n| `redpanda-connect-ai` | AI workflows | Cloud + AI integrations |\n\nComponent availability controlled by:\n- `public/bundle/enterprise/` and `public/bundle/free/` - Distribution-specific package imports\n- `public/schema/` - Schema generation and filtering per distribution\n- `internal/plugins/info.csv` - Component metadata (columns: `cloud`, `cloud_with_gpu`)\n\n### Directory Structure\n\n`internal/impl/{category}/` - Component implementations. Each category contains inputs, outputs, processors, caches for that system.\n\n`public/components/{category}/` - Public API wrappers. Thin `import _` wrappers for selective compilation.\n\n`internal/cli/` - Enterprise CLI (license management, MCP server, agent mode).\n\n`internal/license/` - RCL validation and enforcement.\n\n`internal/rpcplugin/` - RPC plugin system (Python/Go templates).\n\n`public/schema/` - Distribution-specific schema generation.\n\n`cmd/` - Binary entry points for each distribution.\n\n### Benthos Integration\n\nRedpanda Connect imports benthos's public service API: `github.com/redpanda-data/benthos/v4/public/service`.\nInherits benthos's component interfaces, configuration DSL, validation, and runtime.\n\nComponent registration, config specs, license headers, and certification standards are covered in the `godev` skill/agent.\n\n---\n\n## Key Non-Obvious Patterns\n\n1. **Distribution gating is compile-time:** Different binaries import different `public/components/` packages. Schema filters at runtime based on `internal/plugins/info.csv`.\n\n2. **Template tests validate YAML configs:** `task test:template` runs actual binaries against config files in `config/test/` and `internal/impl/*/tmpl.yaml`.\n\n3. **Cloud distribution is restrictive:** Only pure processors (no side effects) and pure Bloblang functions. Check `schema.Cloud()` for filtering logic.\n\n---\n\n## Common Gotchas\n\n- **External dependencies:** Components requiring C libraries (like ZMQ) are excluded by default. Use `TAGS=x_benthos_extra task build:all`.\n- **Template tests are slow:** They build and run actual binaries. Run only changed tests during development.\n- **License headers matter:** CI fails if headers don't match the component's distribution classification. See `godev` skill/agent for header formats.\n"},"items":[{"name":"CLAUDE.md","path":"CLAUDE.md","title":"CLAUDE.md","content":"# CLAUDE.md\n\nAI agent guidance for working with Redpanda Connect codebase.\n\n---\n\n## Skills and Agents\n\n| Task | Skill / Agent |\n|---|---|\n| Writing or modifying Go code | `godev` agent |\n| Writing or modifying tests | `tester` agent |\n| Code review | `/review` skill |\n\n## Plugin: Redpanda Connect\n\nYAML configuration, Bloblang authoring, and component discovery are provided by the `redpanda-connect` plugin from `.claude-plugin`.\n\n### Prerequisites\n\n```bash\nbrew install redpanda-data/tap/redpanda python3 jq\nrpk connect install\n```\n\n### Installation\n\n```bash\n/plugin marketplace add /path/to/connect   # local dev\n/plugin install redpanda-connect\n```\n\nRestart Claude Code after installation.\n\n### Commands\n\n| Command | Purpose |\n|---|---|\n| `/rpcn:search <query>` | Natural language component discovery |\n| `/rpcn:blobl <description> [sample=<json>]` | Bloblang transformation authoring |\n| `/rpcn:pipeline <description> [file=<path>]` | Pipeline creation and repair |\n\nThe plugin also auto-triggers on mentions of Redpanda Connect, streaming pipelines, or Bloblang.\n\n---\n\n## Project Overview\n\nRedpanda Connect is a high-performance stream processor built on **benthos** (`github.com/redpanda-data/benthos/v4`).\nThis repository adds enterprise features, proprietary connectors, and Redpanda-specific optimizations to the upstream benthos framework.\n\n---\n\n## Build Commands\n\n### Building\n```bash\ntask build:all                    # Build all 4 binary distributions\ntask build:redpanda-connect       # Full-featured binary\ntask build:redpanda-connect-cloud # Cloud-safe version (no filesystem)\ntask build:redpanda-connect-community # Apache 2.0 only version\ntask build:redpanda-connect-ai    # AI-focused version\n\n# Build with external dependencies (ZMQ, etc.)\nTAGS=x_benthos_extra task build:all\n```\n\n### Testing\n```bash\ntask test                         # Run unit and template tests\ntask test:unit                    # Run unit tests only (alias: task test:ut)\ntask test:unit-race               # Run unit tests with race detection\ntask test:template                # Run template/Bloblang tests (alias: task test:tmpl)\ntask test:integration                    # Run all integration tests (alias: task test:it)\ntask test:integration -- aws kafka       # Run integration tests filtered by package name\n\n# Run specific test\ngo test -v -run TestFunctionName ./internal/impl/category/\n```\n\nIntegration tests require Docker and are skipped by default.\n\n### Code Quality\n```bash\ntask fmt                          # Format code with gofumpt\ntask lint                         # Run golangci-lint\ntask vuln                         # Run vulnerability scanner\ntask build:clean                  # Clean build artifacts\n```\n\n### Documentation\n```bash\ntask docs                         # Generate documentation and validate examples\n```\n\n### Running Locally\n```bash\ntask run                          # Run with default config (config/dev.yaml)\ntask run CONF=./path/to/config.yaml # Run with specific config\n\n# Or directly with go\ngo run ./cmd/redpanda-connect --config ./config.yaml\n\n# Or using rpk (if installed)\nrpk connect run ./config.yaml\n```\n\n### Other Commands\n```bash\ntask deps                         # Tidy Go modules\ntask bundles                      # Update bundle imports\ntask bump-benthos                 # Update benthos dependency\n```\n\n---\n\n## Architecture\n\n### Multi-Distribution System\n\nFour binary distributions with different component sets:\n\n| Distribution | Purpose | Components |\n|---|---|---|\n| `redpanda-connect` | Full-featured, self-hosted | All (community + enterprise) |\n| `redpanda-connect-cloud` | Serverless/cloud | Cloud-safe subset, no filesystem |\n| `redpanda-connect-community` | Open-source | Apache 2.0 only |\n| `redpanda-connect-ai` | AI workflows | Cloud + AI integrations |\n\nComponent availability controlled by:\n- `public/bundle/enterprise/` and `public/bundle/free/` - Distribution-specific package imports\n- `public/schema/` - Schema generation and filtering per distribution\n- `internal/plugins/info.csv` - Component metadata (columns: `cloud`, `cloud_with_gpu`)\n\n### Directory Structure\n\n`internal/impl/{category}/` - Component implementations. Each category contains inputs, outputs, processors, caches for that system.\n\n`public/components/{category}/` - Public API wrappers. Thin `import _` wrappers for selective compilation.\n\n`internal/cli/` - Enterprise CLI (license management, MCP server, agent mode).\n\n`internal/license/` - RCL validation and enforcement.\n\n`internal/rpcplugin/` - RPC plugin system (Python/Go templates).\n\n`public/schema/` - Distribution-specific schema generation.\n\n`cmd/` - Binary entry points for each distribution.\n\n### Benthos Integration\n\nRedpanda Connect imports benthos's public service API: `github.com/redpanda-data/benthos/v4/public/service`.\nInherits benthos's component interfaces, configuration DSL, validation, and runtime.\n\nComponent registration, config specs, license headers, and certification standards are covered in the `godev` skill/agent.\n\n---\n\n## Key Non-Obvious Patterns\n\n1. **Distribution gating is compile-time:** Different binaries import different `public/components/` packages. Schema filters at runtime based on `internal/plugins/info.csv`.\n\n2. **Template tests validate YAML configs:** `task test:template` runs actual binaries against config files in `config/test/` and `internal/impl/*/tmpl.yaml`.\n\n3. **Cloud distribution is restrictive:** Only pure processors (no side effects) and pure Bloblang functions. Check `schema.Cloud()` for filtering logic.\n\n---\n\n## Common Gotchas\n\n- **External dependencies:** Components requiring C libraries (like ZMQ) are excluded by default. Use `TAGS=x_benthos_extra task build:all`.\n- **Template tests are slow:** They build and run actual binaries. Run only changed tests during development.\n- **License headers matter:** CI fails if headers don't match the component's distribution classification. See `godev` skill/agent for header formats.\n","category":"root","tokens":1495}]}