Skip to Content

Architecture

How the isA platform components work together.

For the enterprise consumption and governance layer above these providers, see the AEP control plane guide. AEP coordinates projects, capability requests, policy, approvals, evidence, and release intent; the provider remains authoritative for runtime execution and source-system truth.

Platform Overview

┌─────────────────────────────────────────────────────────────────────────────────┐ │ APPLICATIONS │ │ Web Apps • Mobile Apps • CLI Tools • Integrations │ └─────────────────────────────────────────────────────────────────────────────────┘ ┌─────────────────────────────────────────────────────────────────────────────────┐ │ AGENT SDK (Python) │ │ │ │ ┌──────────┐ ┌──────────┐ ┌──────────┐ ┌──────────┐ ┌──────────┐ ┌────────┐│ │ │ Agent │ │ Workflow │ │ Memory │ │ Tools │ │ Voice │ │ A2A ││ │ │ Runtime │ │ Engine │ │ Manager │ │ Registry │ │ Service │ │Protocol││ │ └──────────┘ └──────────┘ └──────────┘ └──────────┘ └──────────┘ └────────┘│ └─────────────────────────────────────────────────────────────────────────────────┘ ┌───────────────────┼───────────────────┐ ▼ ▼ ▼ ┌──────────────────────┐ ┌──────────────────────┐ ┌──────────────────────┐ │ MCP SERVICE │ │ MODEL SERVICE │ │ USER SERVICES │ │ │ │ │ │ │ │ 190+ Tools: │ │ LLM Gateway: │ │ 35 Microservices: │ │ • Web Search │ │ • 8+ Providers │ │ • Authentication │ │ • File Operations │ │ • Role Routing │ │ • Payments │ │ • Code Execution │ │ • Voice/Realtime │ │ • Storage │ │ • Marketplace │ │ • ML Prediction │ │ • Organizations │ │ • Browser │ │ • Caching │ │ • Devices (IoT) │ │ • APIs │ │ • Cost Ranking │ │ • Memory │ └──────────────────────┘ └──────────────────────┘ └──────────────────────┘ │ │ │ └───────────────────┼───────────────────┘ ┌───────────────────┼───────────────────┐ ▼ ▼ ┌──────────────────────────────────┐ ┌──────────────────────────────────┐ │ DOMAIN SERVICES │ │ PLATFORM TOOLING │ │ │ │ │ │ ┌──────────────┐ ┌───────────┐ │ │ ┌──────────────────────┐ │ │ │ Creative │ │ Marketing │ │ │ │ Orchestration │ │ │ │ │ │ │ │ │ │ (isA Orch) │ │ │ │ • Content │ │ • Campaign│ │ │ │ │ │ │ │ Creator │ │ Manager │ │ │ │ • Unified Code Index │ │ │ │ • Visual │ │ • SEO │ │ │ │ • Project Registry │ │ │ │ Designer │ │ Agent │ │ │ │ • Impact Analysis │ │ │ │ • Brand │ │ • Content │ │ │ │ • Cross-Project │ │ │ │ Strategist │ │ Agent │ │ │ │ Search │ │ │ │ • Copy Editor│ │ • Audience│ │ │ └──────────────────────┘ │ │ │ • DAM Manager│ │ Insights│ │ │ │ │ │ • Design │ │ • Campaign│ │ │ │ │ │ System │ │ Analyst │ │ │ │ │ └──────────────┘ └───────────┘ │ │ │ └──────────────────────────────────┘ └──────────────────────────────────┘ │ │ └───────────────────┬───────────────────┘ ┌─────────────────────────────────────────────────────────────────────────────────┐ │ DATA SERVICE │ │ │ │ ┌──────────────┐ ┌──────────────┐ ┌──────────────┐ ┌──────────────┐ │ │ │ Data Lake │ │ Data Fabric │ │ RAG │ │ File │ │ │ │ (DuckDB) │ │ (Pipelines) │ │ (Vectors) │ │ Processing │ │ │ └──────────────┘ └──────────────┘ └──────────────┘ └──────────────┘ │ └─────────────────────────────────────────────────────────────────────────────────┘ ┌─────────────────────────────────────────────────────────────────────────────────┐ │ isA CLOUD │ │ │ │ ┌────────────────────────────────────────────────────────────────────────┐ │ │ │ APISIX GATEWAY (Port 9080) │ │ │ │ Rate Limiting • Auth • Routing • SSL • Metrics │ │ │ └────────────────────────────────────────────────────────────────────────┘ │ │ │ │ │ ┌────────────────────────────────────────────────────────────────────────┐ │ │ │ CONSUL SERVICE DISCOVERY (Port 8500) │ │ │ │ Registration • Health Checks • DNS • KV Store │ │ │ └────────────────────────────────────────────────────────────────────────┘ │ │ │ │ │ ┌────────────────────────────────────────────────────────────────────────┐ │ │ │ gRPC SERVICES (50051-50070) │ │ │ │ postgres • redis • neo4j • nats • mqtt • minio • qdrant • duckdb │ │ │ └────────────────────────────────────────────────────────────────────────┘ │ │ │ │ │ ┌────────────────────────────────────────────────────────────────────────┐ │ │ │ INFRASTRUCTURE │ │ │ │ PostgreSQL • Redis • Neo4j • NATS • MQTT • MinIO • Qdrant • DuckDB │ │ │ └────────────────────────────────────────────────────────────────────────┘ │ └─────────────────────────────────────────────────────────────────────────────────┘

Component Details

Agent SDK

The Python SDK is the primary interface for building agents:

ComponentPurpose
Agent RuntimeExecutes agent logic, manages state
Workflow EngineSwarm handoffs and DAG orchestration
Memory ManagerHandles short and long-term memory
Tools RegistryDiscovers and invokes tools
Voice ServiceFull-duplex voice with audio buffering and STT rewriting
A2A ProtocolAgent-to-agent communication via Agent Card + JSON-RPC
DelegationRemote team task delegation with circuit breakers
ObservabilityPrometheus metrics for nodes, models, tools, and pools

Agent SDK Documentation →

MCP Service

Model Context Protocol provides 190+ tools with marketplace and multi-tenant security:

CategoryTools
Searchweb_search, image_search, news_search
Filesfile_read, file_write, file_list
Codecode_interpreter, shell, git
Datadatabase_query, api_call, scrape
Browserbrowser_navigate, browser_click
MarketplacePackage install, update, enable/disable
SecurityJWT/API key auth, command allowlist, SSE injection prevention

MCP Documentation →

Model Service

Unified LLM gateway with intelligent routing:

FeatureDescription
Multi-ProviderOpenAI, Anthropic, OpenRouter, Cerebras, Ollama, YYDS, Replicate, Anthropic Sub
Intelligent RoutingRole-based resolution, capability filtering, cost-aware ranking
Voice/RealtimeWebSocket sessions with privacy filter and turn detection
ML PredictionTime-series forecasting with Prophet (training + inference)
CachingL1 exact-match (Redis) + L2 semantic (Qdrant)
FailoverAutomatic provider failover with circuit breakers

Model Documentation →

User Services

35 microservices for common application needs:

CategoryServices
Authauth, profile, rbac, social
Paymentspayment, subscription, billing, wallet
Storagestorage, album, media, document
Socialorganization, invitation, membership
IoTdevice, ota, telemetry
AImemory (cognitive memory system)

User Services Documentation →

Creative Service

AI-powered creative agents for content production and brand management:

AgentPurpose
Content CreatorGenerates written content (articles, posts, scripts)
Visual DesignerProduces visual assets and design concepts
Brand StrategistMaintains brand voice and positioning
Copy EditorReviews and refines content for quality
DAM ManagerDigital asset management and organization
Design System AgentEnforces design system consistency

Creative Documentation →

Marketing Service

AI-driven marketing automation and analytics:

AgentPurpose
Campaign ManagerPlans and executes marketing campaigns
SEO AgentSearch engine optimization and keyword strategy
Content AgentMarketing-specific content generation
Audience InsightsAudience segmentation and analysis
Campaign AnalystCampaign performance analytics and reporting
Compliance AgentEnsures marketing content meets regulations
Report GeneratorAutomated marketing reports and dashboards

Marketing Documentation →

Orchestration (isA Orch)

Platform-level tooling for cross-project operations:

ComponentPurpose
Unified Code IndexSingle index spanning all isA projects with symbol resolution
Project RegistryConfiguration and relationships of all sub-projects
Platform CLICross-project indexing, search, and impact analysis

Orchestration Documentation →

Data Service

Data processing and analytics:

ComponentTechnology
Data LakeDuckDB for analytics
Data FabricApache Spark pipelines
RAGQdrant + pgvector
File ProcessingMulti-format extraction

Data Documentation →

isA Cloud

Production infrastructure:

ComponentTechnologyPort
GatewayApache APISIX9080
DiscoveryConsul8500
DatabasePostgreSQL5432
CacheRedis6379
GraphNeo4j7687
MessagingNATS4222
IoTMQTT1883
StorageMinIO9000
VectorsQdrant6333
AnalyticsDuckDB-

Cloud Documentation →

Data Flow

Agent Request Flow

1. User sends request to Agent 2. Agent SDK processes request 3. Agent decides which tools to use 4. Tools call backend services via MCP 5. Model service generates responses 6. Results aggregated and returned

Authentication Flow

1. User authenticates via auth_service 2. JWT token issued 3. Token included in API requests 4. APISIX validates token 5. Request routed to service 6. Response returned

Event Flow

1. Service publishes event to NATS 2. Interested services subscribe 3. Events processed asynchronously 4. State updated across services 5. Notifications sent if needed

Deployment Options

Local Development

# Using KIND (Kubernetes in Docker) cd deployments/kubernetes/local/scripts ./kind-setup.sh ./kind-deploy.sh

Staging/Production

# GitOps with ArgoCD git push origin main # Triggers deployment
EnvironmentClusterAuto-Deploy
LocalKINDManual
StagingEKSYes (main branch)
ProductionEKS/GKEManual approval

Security

Authentication

  • JWT tokens for API access
  • OAuth2/OIDC for SSO
  • API keys for service-to-service

Authorization

  • RBAC with fine-grained permissions
  • Organization-level isolation
  • Resource-level access control

Data Protection

  • Encryption at rest (AES-256)
  • Encryption in transit (TLS 1.3)
  • Secrets in Vault/AWS Secrets Manager

Next Steps