Architecture
MOSTLY AI runs as a set of containerized applications and services that you can deploy in a Kubernetes cluster and maintain a fault-tolerant and highly available application.
Application Nodes
Pod and image name | Description | Pod Lifecycle | |
|---|---|---|---|
| Web frontend | mostly-uimostly-app-ui | Contains the frontend of MOSTLY AI. Reachable over port 8080. | Service |
 Backend | mostly-appmostly-app-enterprise | Contains the backend and public APIs of MOSTLY AI. | Service |
| Coordinator Service | mostly-coordinatormostly-coordinator | Component that takes all requests from the web application and coordinates execution of tasks on the main AI engine. | Service |
 Data | mostly-datamostly-data | Component that reads metadata and analyzes data sources and destinations. | Service |
| Keycloak | mostly-keycloakmostly-keycloak | Keycloak is an open-source identity management, authentication, and authorization tool. This container has a pre-configured Keycloak instance for MOSTLY AI. | Service |
| PostgreSQL | mostly-psqlpostgres | Database instance of the system. Contains databases for app, coordinator, and Keycloak. | Service |
| Rabbit MQ | mostly-rabbitmqrabbitmq | Message queue handling communications between the AI engine and the application. | Service |
AI Worker nodes
| Pod and image name | Description | Pod Lifecycle | |
|---|---|---|---|
| Task agent job | agent‑<task‑id>mostly-agent | Job that runs the steps to synthesize data. | Job |
| Data job | engine‑step‑<step‑id>mostly-data | Component that reads from data sources and writes into data destinations. | Job |
| AI job | engine-step-<step-id>mostly-engine-v2 | The main engine component, which does the AI training and data generation. | Job |
| QA job | engine-step-<step-id>mostly-qa | Engine component, which creates the Quality Assurance report for privacy and accuracy of the generated data versus the original data. | Job |
Third-party integrations and connections
Active Directory Active Directory is an optional integration that can help you manage the authentication of users to MOSTLY AI. With this integration, end users do not need to create new credentials to log in to MOSTLY AI.
Image repository
The MOSTLY AI image repository contains the deployment images of all containers and makes it easy to deploy MOSTLY AI to various types of Kubernetes clusters.
Corporate databases
MOSTLY AI can connect to your internal databases (with the help of ) and read original data or deliver the generated synthetic data in the same or another database.
MOSTLY AI can generate synthetic data that preserves the correlations, structure, and referential integrity of multi-table data. The synthesis of data stored in databases is where MOSTLY AI excels.
Cloud storage buckets and NFS drives
In addition to databases, you can also read original data and deliver synthetic data from and to cloud storage buckets (AWS S3, Azure blob storage, Google Cloud storage buckets) as well NFS drives local to the server where MOSTLY AI is deployed.