isA Cloud
Cloud-native infrastructure platform for the isA ecosystem.
Overview
isA Cloud provides unified microservices infrastructure with:
- 9 gRPC services wrapping backend infrastructure
- API gateway via Apache APISIX
- Service discovery via Consul
- GitOps deployment via ArgoCD
- Multi-environment support (dev, staging, production)
- 42+ microservices orchestration
Latest Updates (2026-05-17)
- Big-data foundation validation now covers Kafka, PostgreSQL big-data metadata, Hive Metastore, MinIO, Iceberg tools, StarRocks, Apicurio Registry, Flink, Fluss, and Flink CDC jobs on local KIND.
- New Make targets orchestrate setup, readiness, smoke validation, and teardown for the datalake stack.
- Chart coverage now includes cert-manager, External Secrets Operator, and Prometheus Operator.
- Datalake setup preflights cert-manager CRDs and fails fast when required platform dependencies are missing.
Architecture
┌─────────────────────────────────────────────────────────────────────────────┐
│ EXTERNAL TRAFFIC │
└─────────────────────────────────────────────────────────────────────────────┘
│
┌─────────────────────────────────────────────────────────────────────────────┐
│ APISIX GATEWAY (Port 9080) │
│ Rate limiting • Authentication • Dynamic routing • SSL │
└─────────────────────────────────────────────────────────────────────────────┘
│
┌─────────────────────────────────────────────────────────────────────────────┐
│ CONSUL SERVICE DISCOVERY (Port 8500) │
│ Service registration • Health checks • DNS • KV store │
└─────────────────────────────────────────────────────────────────────────────┘
│
┌─────────────────────────────────────────────────────────────────────────────┐
│ gRPC INFRASTRUCTURE SERVICES │
│ postgres-grpc • redis-grpc • neo4j-grpc • nats-grpc • mqtt-grpc │
│ minio-grpc • qdrant-grpc • duckdb-grpc • loki-grpc │
└─────────────────────────────────────────────────────────────────────────────┘
│
┌─────────────────────────────────────────────────────────────────────────────┐
│ BACKEND INFRASTRUCTURE │
│ PostgreSQL • Redis • Neo4j • NATS • MQTT • MinIO • Qdrant • DuckDB • Loki │
└─────────────────────────────────────────────────────────────────────────────┘Components
| Component | Purpose |
|---|---|
| gRPC Services | Unified interface to 9 backend systems |
| APISIX | API gateway with dynamic routing |
| Consul | Service discovery and health checks |
| ArgoCD | GitOps continuous deployment |
| isA_common | Shared Python client library |
| Helm Charts | Kubernetes package management |
gRPC Services
| Service | Port | Backend |
|---|---|---|
| postgres-grpc | 50061 | PostgreSQL |
| redis-grpc | 50055 | Redis |
| neo4j-grpc | 50063 | Neo4j |
| nats-grpc | 50056 | NATS |
| mqtt-grpc | 50053 | MQTT |
| minio-grpc | 50051 | MinIO |
| qdrant-grpc | 50062 | Qdrant |
| duckdb-grpc | 50052 | DuckDB |
| loki-grpc | 50054 | Loki |
Technology Stack
| Category | Technologies |
|---|---|
| Languages | Go 1.23, Python 3.8+ |
| Orchestration | Kubernetes 1.34, Helm |
| IaC | Terraform, Kustomize |
| CI/CD | GitHub Actions, ArgoCD |
| Gateway | Apache APISIX |
| Discovery | Consul |
| Messaging | NATS JetStream, MQTT |
| Databases | PostgreSQL, Redis, Neo4j, DuckDB |
| Storage | MinIO (S3-compatible) |
| Vectors | Qdrant |
| Observability | Loki, Grafana, Prometheus |
Big-Data Foundation
The local KIND big-data stack validates data-lake and streaming infrastructure before higher-level data products depend on it.
| Component | Purpose |
|---|---|
| Kafka | Event streaming backbone |
| PostgreSQL big-data metadata | Metadata store for lake services |
| Hive Metastore | Table metadata catalog |
| MinIO | S3-compatible lake storage |
| Iceberg tools | Table format utilities |
| StarRocks | Analytical query engine |
| Apicurio Registry | Schema registry |
| Flink | Stream processing |
| Fluss | Streaming lakehouse layer |
| Flink CDC jobs | Change-data-capture pipelines |
Environments
| Environment | Cluster | Namespace |
|---|---|---|
| Local | KIND | isa-cloud-staging |
| Staging | EKS | isa-cloud-staging |
| Production | EKS/GKE | isa-cloud-production |
Quick Start
# Local deployment with KIND
cd deployments/kubernetes/local/scripts
./kind-setup.sh
./kind-build-load.sh
./kind-deploy.sh
# Access services
# APISIX: http://localhost:9080
# Consul: http://localhost:8500Next Steps
- Quick Start - Local development setup
- gRPC Services - Infrastructure wrappers
- Gateway - APISIX configuration
- Discovery - Consul integration
- SDK - Python client library
- Deployment - ArgoCD & Helm
- CI/CD - GitHub Actions
- Testing - Contract-driven development
- Operations - Scripts & monitoring