Using Claude Code as an Agentic Development System: Advisor Agents, Memory, and Deploying to EKS

How I use Claude Code's agent system to build AI systems — with a mandatory Advisor that catches production bugs, persistent memory that compounds across sessions, and a full EKS deployment architecture.

The Meta-Problem: Building AI With AI

I've built and deployed a production multi-agent AI system — 35 tools, 4 specialized agent roles, running on EKS with full Langfuse observability. But here's the meta question: how do you actually build and deploy these systems efficiently?

My answer: treat your development environment itself as an agentic system. I use Claude Code — not as a simple autocomplete, but as a multi-agent development platform with:

• A mandatory Advisor agent that reviews every architectural decision
• Persistent memory that carries context across development sessions
• Specialized subagents for parallel research and implementation
• A structured planning workflow that prevents premature implementation
• Langfuse integration for tracing agent behavior in production

The Advisor Agent: Mandatory Architecture Review

The most impactful pattern in my setup is a mandatory Advisor agent — a senior reviewer that runs on the most capable model (Opus) and must be consulted before every significant decision.

# .claude/agents/advisor.md (simplified)
---
name: advisor
description: Senior architecture reviewer. Must be invoked before
  any significant decision, before finalizing plans, and after every
  code change.
model: opus
tools: Read, Grep, Bash  # Bash included for log/status reads; prompt instructs no file writes
---

You are a senior technical reviewer. You receive a structured summary
and give a concrete recommendation. You have read-only access to
verify claims against the actual codebase.

Rules:
- You are a REVIEWER, not an implementer. Never modify files.
- Identify the core risk or assumption being made.
- Flag architectural trade-offs that may not be obvious.
- Give a CONCRETE recommendation, not just pros/cons.
- Point out anything missing that would change your answer.

When the Advisor Must Be Invoked

This isn't optional or "nice to have." I've configured it as a hard rule:

The Development Workflow: Plan → Question → Implement → Review

Persistent Memory: Context That Compounds

One of the most underused features of Claude Code is its persistent memory system. I maintain a structured memory index that carries hard-won knowledge across sessions:

Key memory types and their purpose:

The Full EKS Deployment Architecture

Here's how the complete agentic AI system deploys to production on Amazon EKS:

Key Kubernetes Patterns

1. Separate Deployment per Agent Role

Each agent role is its own Kubernetes Deployment with its own Service. This gives you:

• Independent scaling: Data Scouts scale to 2 replicas for throughput; Synthesizer stays at 1
• Resource isolation: The Opus-tier agents get more memory; Scouts are lightweight
• Rolling updates: Update the Critic's prompt without restarting the Analyst
• Targeted monitoring: Langfuse traces per-service let you see exactly where time is spent

2. ConfigMap-Driven Model Selection

# configmap.yaml
apiVersion: v1
kind: ConfigMap
metadata:
  name: agent-config
data:
  SCOUT_MODEL: "us.anthropic.claude-sonnet-4-6"
  SYNTHESIZER_MODEL: "us.anthropic.claude-opus-4-8"
  CRITIC_MODEL: "us.anthropic.claude-opus-4-8"
  KNOWLEDGE_GRAPH_TABLE: "agent-kg"
  CACHE_TTL_HOURS: "24"
  TOKEN_BUDGET: "10000000"
  LANGFUSE_ENABLED: "true"

Model selection lives in a ConfigMap, not in code. When a new Claude model drops, you update the ConfigMap and restart pods — no code change, no build, no PR.

3. IRSA for Zero-Credential Pods

# iam/trust-policy.json (simplified)
{
  "Version": "2012-10-17",
  "Statement": [{
    "Effect": "Allow",
    "Principal": {
      "Federated": "arn:aws:iam::ACCOUNT:oidc-provider/oidc.eks.REGION.amazonaws.com"
    },
    "Action": "sts:AssumeRoleWithWebIdentity",
    "Condition": {
      "StringEquals": {
        "oidc.eks....:sub": "system:serviceaccount:ai-agent:agent-sa"
      }
    }
  }]
}

Pods assume IAM roles via IRSA (IAM Roles for Service Accounts). No AWS credentials stored anywhere — not in secrets, not in env vars, not in code. The pod's service account maps to an IAM role that grants access to S3, DynamoDB, Bedrock, and Secrets Manager.

4. Automated Data Freshness via CronJobs

# cronjob-auto-ingest.yaml
apiVersion: batch/v1
kind: CronJob
metadata:
  name: daily-data-refresh
spec:
  schedule: "0 6 * * *"  # 6 AM UTC daily
  concurrencyPolicy: Forbid
  jobTemplate:
    spec:
      activeDeadlineSeconds: 21600  # 6-hour timeout
      template:
        spec:
          containers:
            - name: ingest
              image: agent:${VERSION}
              command: ["python", "-m", "agent.jobs.ingest", "--source", "all"]

Langfuse in the Production Stack

Langfuse sits alongside Prometheus and OpenTelemetry as part of the monitoring deployment:

The "Build the Builder" Feedback Loop

Here's the meta-pattern that makes all of this compound:

1. Langfuse traces from the production agent reveal quality issues
2. Those issues become development tasks in the next session
3. The Advisor agent reviews the proposed fix
4. Fix is implemented using parallel subagents
5. Advisor reviews the implementation and catches edge cases
6. Version bump (all manifest files) — Advisor verifies nothing was missed
7. Deploy → Langfuse traces the improvement → loop

Every production observation becomes a development action. Every development session compounds knowledge into memory. The system gets better at building itself.

What I'd Do Differently Starting Today

1. Start with the Advisor pattern from day one

I added the mandatory Advisor after it caught its 4th production bug. If I'd had it from the start, those 4 bugs would never have shipped.

2. Set up Langfuse before writing the first agent

Retrofitting observability is painful. Instrument from the beginning. Even if the first version is one agent with one tool, trace it. The data compounds.

3. Use ConfigMaps for everything that might change

Model names, feature flags, cache TTLs, token budgets — if it might change without a code change, it belongs in a ConfigMap. I've updated models twice without a single line of code.

4. Write the memory system for your future self

Every hard-won lesson — every "oh, I missed that file again" or "that API changed" — goes into persistent memory immediately. Future sessions start where you left off, not from scratch.

If you're building agentic AI systems, the investment in your development workflow is as important as the system itself. An Advisor that catches bugs before production, memory that compounds lessons, and Langfuse traces that reveal what's actually happening — these aren't luxuries. They're what separate a demo from a production system.

The tools exist. The patterns work. The main barrier is discipline: always invoke the Advisor, always trace with Langfuse, always persist lessons to memory. The compound effect is remarkable.

Coming soon: how I migrated this entire agentic platform from self-managed EKS deployments to AWS Bedrock AgentCore — reducing operational overhead while keeping the same multi-agent architecture. Stay tuned.

If you're building similar systems or have questions about deploying agents on EKS (or migrating off it), feel free to connect.