InstallationArchitecture

Architecture

MOSTLY AI runs as a set of containerized applications and services that you can deploy in a Kubernetes cluster and maintain a fault-tolerant and highly available application.

MOSTLY AI architecture diagram

Application Nodes

Pod and image name
DescriptionPod Lifecycle
Web frontendmostly-ui

mostly-app-ui
Contains the frontend of MOSTLY AI. Reachable over port 8080.Service
Terminal icon Backendmostly-app

mostly-app-enterprise
Contains the backend and public APIs of MOSTLY AI.Service
Coordinator Servicemostly-coordinator

mostly-coordinator
Component that takes all requests from the web application and coordinates execution of tasks on the main AI engine.Service
Storage icon Data discoverymostly-core-api

mostly-core-api
Component that reads metadata and analyzes data sources and destinations.Service
Keycloakmostly-keycloak

mostly-keycloak
Keycloak is an open-source identity management, authentication, and authorization tool. This container has a pre-configured Keycloak instance for MOSTLY AI.Service
PostgreSQLmostly-psql

postgres
Database instance of the system. Contains databases for app, coordinator, and Keycloak.Service
MinIOmostly-minio

minio
Shared storage service.Service

AI Worker nodes

Pod and image nameDescriptionPod Lifecycle
AI jobengine-task-<task-id>

mostly-core
• Reads from data sources and writes into data destinations
• Performs AI training and data generation.
• Create Model and Data reports
Job

Third-party integrations and connections

Active Directory is an optional integration that can help you manage the authentication of users to MOSTLY AI. With this integration, end users do not need to create new credentials to log in to MOSTLY AI.

Image repository

The MOSTLY AI image repository contains the deployment images of all containers and makes it easy to deploy MOSTLY AI to various types of Kubernetes clusters.

Corporate databases

MOSTLY AI can connect to your internal databases (with the help of connectors) and read original data or deliver the generated synthetic data in the same or another database.

Cloud storage buckets

In addition to databases, you can also read original data and deliver synthetic data from and to cloud storage buckets (AWS S3, Azure blob storage, Google Cloud storage buckets).

Storage requirements

MOSTLY AI uses two types of storage.

  • Block Storage. Used by single pods, such as PostgreSQL. Typically, this is automatically provisioned by the Kubernetes cluster.
  • Shared Storage. Shared by various pods to store models, synthetic data, and others. Two options exist for using shared storage:
    • MinIO. MOSTLY AI provides shared storage via MinIO. This uses the block storage provisioned by the Kubernetes cluster.
    • External S3 storage. You can use an external S3 storage solution instead of MinIO.