AI Architect

Job Summary:

As an AI Architect you will build AI-native products. You’ll lead cross-functional Innovation Delivery Squads—owning outcomes end-to-end across web, mobile, AI agents, and streaming backends. You’re a hands-on technical leader who can scope, architect, staff, and ship; then run the product safely at scale.

Job Responsibilities:

• Stand up and run squads (Discovery → Prototype → Product → Platform & SRE).
• Design and ship RAG/agent systems: pick models (e.g., Anthropic Claude, OpenAI, Google, or open-weights like Llama/Mistral), define tools/functions, and choose retrieval (default Postgres + pgvector, scale to Weaviate/Qdrant/Pinecone when needed).
• Operate AI safely: evals & guardrails, structured outputs (JSON/Schema), PII redaction, refusal policies, cost/latency budgets, and LLM observability.
• Own delivery outcomes: SLOs, quality, cost, velocity; release with feature flags and canaries.
• Be client-facing: discovery, scoping, SoW, roadmap, QBRs.
• Hire/coach Tech Leads, EMs, and PMs; level up practices.

Requirements

• 8–12+ yrs engineering; 4+ yrs leading multi-team delivery; shipped production web/mobile systems at scale.
• Shipped at least one production AI app using Claude/GPT/Gemini/Llama/Mistral, backed by retrieval (pgvector or a vector DB) and a basic eval/guardrail pipeline.
• Implemented orchestration (LangGraph/DSPy or Temporal for durable workflows), rerankers (e.g., Cohere/Jina/Voyage), and prompt/tool versioning.
• Built with modern cloud + data: serverless/K8s, Terraform, OpenTelemetry, feature flags/experimentation.
• Excellent client communication and commercial sense (SoWs, staffing, utilization).

Tech stack (you have hands on experience)

• Models: Anthropic Claude; OpenAI; Google; open-weights (Llama, Mistral).
• Orchestration & agents: LangGraph (or DSPy) for graphs; Temporal for durable, long-running tasks and SLAs.
• Retrieval: Postgres + pgvector (default); Weaviate/Qdrant/Pinecone when scale/ops require; hybrid search with OpenSearch/Typesense.
• Embeddings / rerankers: OpenAI/Voyage/E5/BGE; Cohere/Jina/Voyage rerank.
• Guardrails & evals: JSON/Pydantic schemas, red-team sets, promptfoo/Ragas/DeepEval; content/PII filters.
• Observability: OpenTelemetry traces incl. prompt/tool spans; Langfuse/Arize Phoenix (or equivalent) + Sentry/Grafana.
• App & data: Next.js 15 (RSC), TypeScript/Go/Python; Postgres; Kafka/Redpanda/NATS; dbt/lakehouse optional.
• Ops: Cloud Run/ECS/K8s; Terraform/OpenTofu; GitHub Actions; LaunchDarkly/Unleash; Statsig/GrowthBook.

Originally posted on Himalayas