feat(cloud): single-shot deploy.sh + FROST stack + healthchecks
Stage 5 — make the cloud composition spin up in one command and add
the SensorThings (FROST) stack as a fully segregated tenant.
cloud/deploy.sh — idempotent, 7-step bring-up:
preflight → validate → up + wait → cert state → issue/renew →
service status → endpoint smoke test. Reissues LE cert only when
current issuer no longer matches ACME_CA_URI. Move-aside-then-
restore-on-failure so the bootstrap cert survives a failed certbot.
stacks/frost — new stack, segregated from shared sql/rabbitmq:
- dedicated postgis container (frost-db)
- dedicated internal mosquitto bus (frost-mosquitto)
- frost-http + frost-mqtt on a private frost-internal network,
joined to cloud-app only for nginx ingress at frost.wbd-rd.nl
- shared mosquitto stack deleted; rabbitmq remains the only public
MQTT broker (mqtt.wbd-rd.nl:8883 via stream proxy)
stacks/sql — pg_isready healthcheck so keycloak/gitea/mlflow can gate
on service_healthy via cloud-level depends_on overrides.
stacks/nginx-proxy:
- nginx-init service generates a self-signed bootstrap cert on
fresh deploy so nginx starts before certbot has issued a real one
- frost.wbd-rd.nl vhost (/FROST-Server → frost-http:8080,
/mqtt → frost-mqtt:9876 WebSocket)
stacks/mlflow — custom Dockerfile (upstream + psycopg2-binary) so the
official image can speak to the shared sql backend.
stacks/jupyterhub — DummyAuthenticator stub gated by
JUPYTERHUB_ADMIN_PASSWORD; TODO comments point at OIDC + DockerSpawner.
stacks/rabbitmq — config/{enabled_plugins,rabbitmq.conf} stubs
(management + mqtt plugins, MQTT auth required).
stacks/portainer — ports unpublished; nginx now the only ingress.
stacks/node-red — pin to 4.1 (the floating "4" tag does not exist).
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
znetsixe
42
stacks/frost/README.md
Normal file
42
stacks/frost/README.md
Normal file
@@ -0,0 +1,42 @@
|
||||
# frost
|
||||
|
||||
[FROST-Server](https://github.com/FraunhoferIOSB/FROST-Server) — an OGC SensorThings API server. Stores sensors, observations, datastreams in postgis; exposes REST + MQTT.
|
||||
|
||||
- **Public hostname**: `frost.wbd-rd.nl`
|
||||
- `/FROST-Server` → REST + admin UI (frost-http:8080)
|
||||
- `/mqtt` → WebSocket MQTT for SensorThings clients (frost-mqtt:9876)
|
||||
- **Networks**: `frost-internal` (private bus) + `app` (nginx ingress)
|
||||
- **Backend**: dedicated `postgis/postgis:16-3.4-alpine` container — segregated from the shared `sql` stack
|
||||
- **Internal bus**: dedicated `eclipse-mosquitto` for frost-http ↔ frost-mqtt sync (not reachable from outside the stack)
|
||||
- **Public MQTT broker for SCADA/IoT clients**: that's `rabbitmq` (port 8883 TLS via nginx stream), NOT this stack
|
||||
|
||||
## Volumes (persistent)
|
||||
|
||||
- `frost-db-data` — postgis data dir
|
||||
- `frost-mosquitto-data`, `frost-mosquitto-log` — internal bus state
|
||||
|
||||
Container can be recreated freely; no data loss as long as volumes are kept.
|
||||
|
||||
## First-run
|
||||
|
||||
1. `docker compose up -d frost-db frost-mosquitto` (or just `up -d` for the full stack — frost-http waits on the db healthcheck)
|
||||
2. `frost-http` will auto-create the schema (`persistence_autoUpdateDatabase=true`) on first start
|
||||
3. Create the admin user (one-time, post-deploy — the USERS table is created by FROST itself):
|
||||
|
||||
```bash
|
||||
docker compose exec frost-db psql -U sensorthings -d sensorthings -c \
|
||||
"INSERT INTO \"USERS\" (\"USER_NAME\", \"USER_PASS\") VALUES ('admin', crypt('CHANGE_ME', gen_salt('bf', 12)));"
|
||||
```
|
||||
|
||||
Subsequent password rotations:
|
||||
```bash
|
||||
docker compose exec frost-db psql -U sensorthings -d sensorthings -c \
|
||||
"UPDATE \"USERS\" SET \"USER_PASS\"=crypt('NEW_PW', gen_salt('bf', 12)) WHERE \"USER_NAME\"='admin';"
|
||||
```
|
||||
|
||||
## TODO
|
||||
|
||||
- Switch from `BasicAuthProvider` to Keycloak OIDC (FROST has a plugin)
|
||||
- Bootstrap admin user automatically (post-init container that waits for FROST schema, then runs the SQL above with `${FROST_ADMIN_PASSWORD}`)
|
||||
- Document the SensorThings client examples (Things, Datastreams, Observations)
|
||||
- pgadmin / db inspection: use shared portainer or a one-off `psql` exec
|
||||
130
stacks/frost/compose.yml
Normal file
130
stacks/frost/compose.yml
Normal file
@@ -0,0 +1,130 @@
|
||||
# frost — FROST-Server (OGC SensorThings API) (cloud only)
|
||||
# Public hostname: frost.wbd-rd.nl (reverse-proxied via nginx-proxy)
|
||||
# /FROST-Server → frost-http:8080 (REST + UI)
|
||||
# /mqtt → frost-mqtt:9876 (WebSocket MQTT for STA clients)
|
||||
#
|
||||
# Networks:
|
||||
# frost-internal : private bus (db ↔ frost-* ↔ mosquitto). No outside reach.
|
||||
# app : where frost-http / frost-mqtt expose ports to nginx.
|
||||
#
|
||||
# Dedicated postgis DB + dedicated mosquitto bus — maximum segregation from the
|
||||
# shared sql / rabbitmq stacks. Public MQTT for SCADA clients goes via rabbitmq.
|
||||
|
||||
services:
|
||||
# --- DB: dedicated postgis instance for FROST ---------------------------------
|
||||
frost-db:
|
||||
image: postgis/postgis:16-3.4-alpine
|
||||
restart: unless-stopped
|
||||
networks: [frost-internal]
|
||||
environment:
|
||||
POSTGRES_DB: sensorthings
|
||||
POSTGRES_USER: sensorthings
|
||||
POSTGRES_PASSWORD: ${FROST_DB_PASSWORD}
|
||||
TZ: ${TZ:-Europe/Amsterdam}
|
||||
volumes:
|
||||
- frost-db-data:/var/lib/postgresql/data
|
||||
healthcheck:
|
||||
test: ["CMD-SHELL", "pg_isready -d sensorthings -U sensorthings"]
|
||||
interval: 5s
|
||||
timeout: 5s
|
||||
retries: 12
|
||||
start_period: 30s
|
||||
|
||||
# --- Internal message bus ------------------------------------------------------
|
||||
# Used solely for frost-http ↔ frost-mqtt synchronisation. Not for external clients.
|
||||
frost-mosquitto:
|
||||
image: eclipse-mosquitto:2.0
|
||||
restart: unless-stopped
|
||||
networks: [frost-internal]
|
||||
volumes:
|
||||
- ./config/mosquitto.conf:/mosquitto/config/mosquitto.conf:ro
|
||||
- frost-mosquitto-data:/mosquitto/data
|
||||
- frost-mosquitto-log:/mosquitto/log
|
||||
|
||||
# --- HTTP (REST + admin UI) ---------------------------------------------------
|
||||
frost-http:
|
||||
image: fraunhoferiosb/frost-server-http:latest
|
||||
restart: unless-stopped
|
||||
networks: [frost-internal, app]
|
||||
depends_on:
|
||||
frost-db:
|
||||
condition: service_healthy
|
||||
frost-mosquitto:
|
||||
condition: service_started
|
||||
environment:
|
||||
serviceRootUrl: ${FROST_SERVICE_ROOT_URL:-https://frost.wbd-rd.nl/FROST-Server}
|
||||
queueLoggingInterval: "1000"
|
||||
plugins_multiDatastream_enable: "false"
|
||||
http_cors_enable: "true"
|
||||
http_cors_allowed_origins: "*"
|
||||
|
||||
bus_busImplementationClass: de.fraunhofer.iosb.ilt.frostserver.messagebus.MqttMessageBus
|
||||
bus_mqttBroker: tcp://frost-mosquitto:1883
|
||||
bus_sendQueueSize: "2000"
|
||||
bus_sendWorkerPoolSize: "10"
|
||||
bus_maxInFlight: "2000"
|
||||
|
||||
persistence_db_driver: org.postgresql.Driver
|
||||
persistence_db_url: jdbc:postgresql://frost-db:5432/sensorthings
|
||||
persistence_db_username: sensorthings
|
||||
persistence_db_password: ${FROST_DB_PASSWORD}
|
||||
persistence_autoUpdateDatabase: "true"
|
||||
|
||||
# BasicAuth against USERS table in postgis. Swap to Keycloak OIDC later.
|
||||
auth_provider: de.fraunhofer.iosb.ilt.frostserver.auth.basic.BasicAuthProvider
|
||||
auth_db_driver: org.postgresql.Driver
|
||||
auth_db_url: jdbc:postgresql://frost-db:5432/sensorthings
|
||||
auth_db_username: sensorthings
|
||||
auth_db_password: ${FROST_DB_PASSWORD}
|
||||
auth_plainTextPassword: "false"
|
||||
auth_autoUpdateDatabase: "true"
|
||||
TZ: ${TZ:-Europe/Amsterdam}
|
||||
|
||||
# --- MQTT (SensorThings MQTT endpoint, with WebSocket on 9876) -----------------
|
||||
frost-mqtt:
|
||||
image: fraunhoferiosb/frost-server-mqtt:latest
|
||||
restart: unless-stopped
|
||||
networks: [frost-internal, app]
|
||||
depends_on:
|
||||
frost-db:
|
||||
condition: service_healthy
|
||||
frost-mosquitto:
|
||||
condition: service_started
|
||||
environment:
|
||||
serviceRootUrl: ${FROST_SERVICE_ROOT_URL:-https://frost.wbd-rd.nl/FROST-Server}
|
||||
queueLoggingInterval: "1000"
|
||||
plugins_multiDatastream_enable: "false"
|
||||
|
||||
bus_busImplementationClass: de.fraunhofer.iosb.ilt.frostserver.messagebus.MqttMessageBus
|
||||
bus_mqttBroker: tcp://frost-mosquitto:1883
|
||||
|
||||
mqtt_CreateThreadPoolSize: "10"
|
||||
mqtt_CreateMessageQueueSize: "10000"
|
||||
mqtt_SubscribeThreadPoolSize: "20"
|
||||
mqtt_SubscribeMessageQueueSize: "10000"
|
||||
|
||||
persistence_persistenceManagerImplementationClass: de.fraunhofer.iosb.ilt.sta.persistence.postgres.PostgresPersistenceManager
|
||||
persistence_db_driver: org.postgresql.Driver
|
||||
persistence_db_url: jdbc:postgresql://frost-db:5432/sensorthings
|
||||
persistence_db_username: sensorthings
|
||||
persistence_db_password: ${FROST_DB_PASSWORD}
|
||||
|
||||
auth_provider: de.fraunhofer.iosb.ilt.frostserver.auth.basic.BasicAuthProvider
|
||||
auth_db_driver: org.postgresql.Driver
|
||||
auth_db_url: jdbc:postgresql://frost-db:5432/sensorthings
|
||||
auth_db_username: sensorthings
|
||||
auth_db_password: ${FROST_DB_PASSWORD}
|
||||
auth_plainTextPassword: "false"
|
||||
auth_autoUpdateDatabase: "true"
|
||||
TZ: ${TZ:-Europe/Amsterdam}
|
||||
|
||||
networks:
|
||||
app:
|
||||
frost-internal:
|
||||
driver: bridge
|
||||
internal: true
|
||||
|
||||
volumes:
|
||||
frost-db-data:
|
||||
frost-mosquitto-data:
|
||||
frost-mosquitto-log:
|
||||
13
stacks/frost/config/mosquitto.conf
Normal file
13
stacks/frost/config/mosquitto.conf
Normal file
@@ -0,0 +1,13 @@
|
||||
# Internal FROST message bus. Reached only from frost-http / frost-mqtt over the
|
||||
# frost-internal docker network. No external listener, no auth needed.
|
||||
|
||||
listener 1883
|
||||
allow_anonymous true
|
||||
|
||||
persistence true
|
||||
persistence_location /mosquitto/data/
|
||||
|
||||
log_dest stdout
|
||||
log_type error
|
||||
log_type warning
|
||||
log_type notice
|
||||
Reference in New Issue
Block a user