Get in Touch
 Duration 21 hours

Course Outline

Foundational Architecture for AI Systems

  • Defining layers, boundaries, and separation of concerns
  • Applying ports and adapters patterns to AI components
  • Defining quality attribute scenarios for AI features
  • Using Architecture Decision Records (ADR) for governance

Evolution of Existing Applications

  • Prioritizing incremental modernization over complete rewrites
  • Positioning AI services alongside legacy monoliths
  • Utilizing Strangler and anti-corruption layer patterns
  • Creating integration seams for existing APIs and data structures

Patterns for LLM Integration Architecture

  • Implementing a model gateway as an abstraction boundary
  • Managing synchronous, asynchronous, and streaming integrations
  • Configuring fallback mechanisms, degradation strategies, and provider failover
  • Treating prompt and model configurations as versioned assets

Contracts, APIs, and Data Exchange

  • Defining structured output schemas and validation rules
  • Implementing idempotency, retry logic, and rate limiting
  • Establishing latency budgets and timeout orchestration
  • Treating cost per request as a key architectural constraint

End-to-End RAG Architecture

  • Designing ingestion, chunking, and embedding pipelines
  • Structuring index, retrieval, reranking, and generation stages
  • Positioning retrieval components relative to application services
  • Analyzing trade-offs and failure modes at each stage

Vector Databases and Retrieval Design

  • Comparing managed versus self-hosted vector stores
  • Implementing dense, sparse, and hybrid search techniques
  • Applying metadata filtering and ensuring tenant isolation
  • Planning re-embedding strategies when models evolve

Retrieval Quality, Grounding, and Evaluation

  • Building evaluation sets from real-world queries
  • Measuring retrieval and answer quality metrics
  • Implementing citation, grounding, and hallucination containment strategies
  • Closing feedback loops back into the index system

Agent Architectures

  • Understanding the agent loop and tool invocation mechanisms
  • Distinguishing deterministic workflows from autonomous planners
  • Identifying scenarios where agents are not the optimal solution
  • Defining the scope of agent responsibilities and state management

Multi-Agent Systems and Orchestration

  • Designing supervisor and orchestrator topologies
  • Establishing handoff protocols and message contracts
  • Managing shared memory and context
  • Comparing frameworks based on architectural merits

Service Communication and Tool Protocols

  • Utilizing event-driven and queue-based coordination
  • Exposing tools through standardized protocols
  • Implementing Sagas, compensation mechanisms, and long-running transactions
  • Ensuring observability across service hops

AI Agents in the Development Workflow

  • Incorporating coding agents into the delivery pipeline
  • Adopting spec-driven development with review gates
  • Implementing test generation and automated quality checks
  • Establishing guardrails to maintain architectural control

Governance and Software Quality

  • Conducting design reviews for AI features
  • Managing changes to models and prompts
  • Incorporating regression evaluation as a pipeline stage
  • Defining ownership, policy, and approval pathways

Security, Privacy, and Data Governance

  • Mitigating prompt injection and implementing defense in depth
  • Managing secrets, access control, and least privilege principles
  • Addressing data residency, personal data, and retention policies
  • Ensuring auditability and human-in-the-loop controls

Scalability, Cost, and Observability

  • Tracing processes across agent chains
  • Monitoring token usage and cost telemetry
  • Optimizing caching and latency
  • Defining service levels and incident response for AI services

Capstone Project: Architecture for an AI-Driven Solution

  • Developing context, component, and deployment views
  • Designing retrieval and agent orchestration components
  • Creating a security, governance, and cost management plan
  • Conducting peer review, critique, and establishing a migration roadmap

Requirements

  • Proven experience in designing and maintaining production-grade software systems
  • Practical understanding of REST APIs and service integration patterns
  • Knowledge of relational databases and data modeling concepts
  • Familiarity with LLM-based tools or associated APIs

Target Audience

  • Software architects
  • Technical leads and senior engineers
  • Engineering managers overseeing architectural decisions

Testimonials (1)

Upcoming Courses

Related Categories