ci: switch openbao loading to approle
CI / Rust Checks (push) Has been cancelled
CI / UI Checks (push) Has been cancelled
CI / Frontend E2E (push) Has been cancelled
CI / Deployment Manifests (push) Has been cancelled
Deploy / build-images (apps/admin-api/Dockerfile, git.itexp.me/bsodfather/crank-community-admin-api, admin-api) (push) Has been cancelled
Deploy / build-images (apps/mcp-server/Dockerfile, git.itexp.me/bsodfather/crank-community-mcp-server, mcp-server) (push) Has been cancelled
Deploy / build-images (apps/ui/Dockerfile, git.itexp.me/bsodfather/crank-community-ui, ui) (push) Has been cancelled
Deploy / deploy (push) Has been cancelled
CI / Rust Checks (push) Has been cancelled
CI / UI Checks (push) Has been cancelled
CI / Frontend E2E (push) Has been cancelled
CI / Deployment Manifests (push) Has been cancelled
Deploy / build-images (apps/admin-api/Dockerfile, git.itexp.me/bsodfather/crank-community-admin-api, admin-api) (push) Has been cancelled
Deploy / build-images (apps/mcp-server/Dockerfile, git.itexp.me/bsodfather/crank-community-mcp-server, mcp-server) (push) Has been cancelled
Deploy / build-images (apps/ui/Dockerfile, git.itexp.me/bsodfather/crank-community-ui, ui) (push) Has been cancelled
Deploy / deploy (push) Has been cancelled
This commit is contained in:
@@ -36,13 +36,17 @@ jobs:
|
|||||||
uses: actions/checkout@v5
|
uses: actions/checkout@v5
|
||||||
|
|
||||||
- name: Verify runner toolchain
|
- name: Verify runner toolchain
|
||||||
run: docker --version
|
run: |
|
||||||
|
docker --version
|
||||||
|
command -v bao
|
||||||
|
bao version
|
||||||
|
|
||||||
- name: Load deployment secrets from OpenBao
|
- name: Load deployment secrets from OpenBao
|
||||||
env:
|
env:
|
||||||
BAO_ADDR: ${{ secrets.BAO_ADDR }}
|
BAO_ADDR: ${{ secrets.BAO_ADDR }}
|
||||||
BAO_TOKEN: ${{ secrets.BAO_TOKEN }}
|
BAO_ROLE_ID: ${{ secrets.BAO_ROLE_ID }}
|
||||||
BAO_SECRET_PATH: ${{ secrets.BAO_SECRET_PATH }}
|
BAO_SECRET_ID: ${{ secrets.BAO_SECRET_ID }}
|
||||||
|
OPENBAO_APP: crank
|
||||||
run: scripts/load-openbao-env.sh
|
run: scripts/load-openbao-env.sh
|
||||||
|
|
||||||
- name: Login to registry
|
- name: Login to registry
|
||||||
@@ -68,11 +72,17 @@ jobs:
|
|||||||
- name: Checkout
|
- name: Checkout
|
||||||
uses: actions/checkout@v5
|
uses: actions/checkout@v5
|
||||||
|
|
||||||
|
- name: Verify OpenBao CLI
|
||||||
|
run: |
|
||||||
|
command -v bao
|
||||||
|
bao version
|
||||||
|
|
||||||
- name: Load deployment secrets from OpenBao
|
- name: Load deployment secrets from OpenBao
|
||||||
env:
|
env:
|
||||||
BAO_ADDR: ${{ secrets.BAO_ADDR }}
|
BAO_ADDR: ${{ secrets.BAO_ADDR }}
|
||||||
BAO_TOKEN: ${{ secrets.BAO_TOKEN }}
|
BAO_ROLE_ID: ${{ secrets.BAO_ROLE_ID }}
|
||||||
BAO_SECRET_PATH: ${{ secrets.BAO_SECRET_PATH }}
|
BAO_SECRET_ID: ${{ secrets.BAO_SECRET_ID }}
|
||||||
|
OPENBAO_APP: crank
|
||||||
run: scripts/load-openbao-env.sh
|
run: scripts/load-openbao-env.sh
|
||||||
|
|
||||||
- name: Configure SSH key
|
- name: Configure SSH key
|
||||||
|
|||||||
@@ -29,6 +29,8 @@ jobs:
|
|||||||
node --version
|
node --version
|
||||||
npm --version
|
npm --version
|
||||||
docker --version
|
docker --version
|
||||||
|
command -v bao
|
||||||
|
bao version
|
||||||
|
|
||||||
- name: Build release binaries
|
- name: Build release binaries
|
||||||
run: cargo build --release -p admin-api -p mcp-server
|
run: cargo build --release -p admin-api -p mcp-server
|
||||||
@@ -64,8 +66,9 @@ jobs:
|
|||||||
- name: Load deployment secrets from OpenBao
|
- name: Load deployment secrets from OpenBao
|
||||||
env:
|
env:
|
||||||
BAO_ADDR: ${{ secrets.BAO_ADDR }}
|
BAO_ADDR: ${{ secrets.BAO_ADDR }}
|
||||||
BAO_TOKEN: ${{ secrets.BAO_TOKEN }}
|
BAO_ROLE_ID: ${{ secrets.BAO_ROLE_ID }}
|
||||||
BAO_SECRET_PATH: ${{ secrets.BAO_SECRET_PATH }}
|
BAO_SECRET_ID: ${{ secrets.BAO_SECRET_ID }}
|
||||||
|
OPENBAO_APP: crank
|
||||||
run: scripts/load-openbao-env.sh
|
run: scripts/load-openbao-env.sh
|
||||||
|
|
||||||
- name: Login to registry
|
- name: Login to registry
|
||||||
|
|||||||
@@ -101,7 +101,7 @@ Crank - платформа для публикации внешних API в в
|
|||||||
|
|
||||||
- workflows лежат в `.gitea/workflows`;
|
- workflows лежат в `.gitea/workflows`;
|
||||||
- Gitea Actions в этом репозитории рассчитаны только на `self-hosted` runner;
|
- Gitea Actions в этом репозитории рассчитаны только на `self-hosted` runner;
|
||||||
- Gitea secrets содержат только bootstrap-доступ к OpenBao: `BAO_ADDR`, `BAO_TOKEN`, `BAO_SECRET_PATH`;
|
- Gitea secrets содержат только AppRole-доступ к OpenBao: `BAO_ADDR`, `BAO_ROLE_ID`, `BAO_SECRET_ID`;
|
||||||
- внешние GitHub-specific механики вроде `workflow_run`, `actions/upload-artifact`, `softprops/action-gh-release` и `ghcr.io` intentionally не используются.
|
- внешние GitHub-specific механики вроде `workflow_run`, `actions/upload-artifact`, `softprops/action-gh-release` и `ghcr.io` intentionally не используются.
|
||||||
|
|
||||||
## Поддерживаемые протоколы
|
## Поддерживаемые протоколы
|
||||||
|
|||||||
+24
-10
@@ -253,25 +253,32 @@ CD для MVP должен:
|
|||||||
В Gitea secrets хранится только bootstrap-доступ к OpenBao:
|
В Gitea secrets хранится только bootstrap-доступ к OpenBao:
|
||||||
|
|
||||||
- `BAO_ADDR`
|
- `BAO_ADDR`
|
||||||
- `BAO_TOKEN`
|
- `BAO_ROLE_ID`
|
||||||
- `BAO_SECRET_PATH`
|
- `BAO_SECRET_ID`
|
||||||
|
|
||||||
Workflow читает `BAO_SECRET_PATH` через `scripts/load-openbao-env.sh` и получает оттуда deploy,
|
Workflow получает short-lived token через OpenBao AppRole и читает deploy, registry и runtime
|
||||||
registry и runtime значения. Это оставляет Gitea runner без прямого списка прикладных секретов.
|
значения через `scripts/load-openbao-env.sh`. Это оставляет Gitea runner без прямого списка
|
||||||
|
прикладных секретов.
|
||||||
|
|
||||||
Минимальный рекомендуемый путь секрета:
|
OpenBao mount:
|
||||||
|
|
||||||
```text
|
```text
|
||||||
kv/data/crank/community/deploy
|
ci/
|
||||||
```
|
```
|
||||||
|
|
||||||
Секрет может быть KV v1 или KV v2. Для KV v2 workflow ожидает стандартный ответ вида
|
Workflow читает KV v2 секреты:
|
||||||
`data.data`.
|
|
||||||
|
```text
|
||||||
|
shared/registry
|
||||||
|
shared/deploy-ssh
|
||||||
|
projects/crank/deploy
|
||||||
|
projects/crank/runtime
|
||||||
|
```
|
||||||
|
|
||||||
В OpenBao должны лежать:
|
В OpenBao должны лежать:
|
||||||
|
|
||||||
- `DEPLOY_REGISTRY_USER`
|
- `REGISTRY_USERNAME`
|
||||||
- `DEPLOY_REGISTRY_TOKEN`
|
- `REGISTRY_PASSWORD`
|
||||||
- `DEPLOY_SSH_KEY`
|
- `DEPLOY_SSH_KEY`
|
||||||
- `DEPLOY_HOST`
|
- `DEPLOY_HOST`
|
||||||
- `DEPLOY_PORT`
|
- `DEPLOY_PORT`
|
||||||
@@ -279,6 +286,13 @@ kv/data/crank/community/deploy
|
|||||||
- `DEPLOY_PATH`
|
- `DEPLOY_PATH`
|
||||||
- `DEPLOY_KNOWN_HOSTS`, optional
|
- `DEPLOY_KNOWN_HOSTS`, optional
|
||||||
|
|
||||||
|
`scripts/load-openbao-env.sh` маппит registry credentials для существующего workflow:
|
||||||
|
|
||||||
|
```text
|
||||||
|
REGISTRY_USERNAME -> DEPLOY_REGISTRY_USER
|
||||||
|
REGISTRY_PASSWORD -> DEPLOY_REGISTRY_TOKEN
|
||||||
|
```
|
||||||
|
|
||||||
Workflow доставляет именно `deploy/community/docker-compose.yml` как public Community deployment manifest
|
Workflow доставляет именно `deploy/community/docker-compose.yml` как public Community deployment manifest
|
||||||
и собирает `.env` на сервере из значений OpenBao. Для runtime-переменных нужно
|
и собирает `.env` на сервере из значений OpenBao. Для runtime-переменных нужно
|
||||||
создавать ключи с теми же именами, что и у приложений:
|
создавать ключи с теми же именами, что и у приложений:
|
||||||
|
|||||||
@@ -235,9 +235,9 @@ Demo/deployment:
|
|||||||
|
|
||||||
В deployment workflow больше не используется монолитный `DEPLOY_ENV_FILE`.
|
В deployment workflow больше не используется монолитный `DEPLOY_ENV_FILE`.
|
||||||
|
|
||||||
`.env` на сервере собирается из OpenBao. В Gitea Actions хранятся только bootstrap credentials
|
`.env` на сервере собирается из OpenBao. В Gitea Actions хранятся только AppRole credentials
|
||||||
`BAO_ADDR`, `BAO_TOKEN` и `BAO_SECRET_PATH`, а внутри OpenBao ключи совпадают с именами
|
`BAO_ADDR`, `BAO_ROLE_ID` и `BAO_SECRET_ID`, а внутри OpenBao ключи проекта
|
||||||
runtime env-переменных. Это значит, что:
|
`projects/crank/runtime` совпадают с именами runtime env-переменных. Это значит, что:
|
||||||
|
|
||||||
- `CRANK_MASTER_KEY` хранится в OpenBao как ключ `CRANK_MASTER_KEY`;
|
- `CRANK_MASTER_KEY` хранится в OpenBao как ключ `CRANK_MASTER_KEY`;
|
||||||
- `CRANK_DEMO_SEED` хранится в OpenBao как ключ `CRANK_DEMO_SEED`;
|
- `CRANK_DEMO_SEED` хранится в OpenBao как ключ `CRANK_DEMO_SEED`;
|
||||||
|
|||||||
+13
-4
@@ -40,16 +40,25 @@ Usage:
|
|||||||
|
|
||||||
## load-openbao-env.sh
|
## load-openbao-env.sh
|
||||||
|
|
||||||
Loads one OpenBao KV secret into a local shell env file.
|
Logs in to OpenBao with AppRole and loads Community deploy/runtime secrets into a local shell env file.
|
||||||
|
|
||||||
Required environment variables:
|
Required environment variables:
|
||||||
|
|
||||||
- `BAO_ADDR`
|
- `BAO_ADDR`
|
||||||
- `BAO_TOKEN`
|
- `BAO_ROLE_ID`
|
||||||
- `BAO_SECRET_PATH`
|
- `BAO_SECRET_ID`
|
||||||
|
- `OPENBAO_APP`
|
||||||
|
|
||||||
Optional environment variables:
|
Optional environment variables:
|
||||||
|
|
||||||
- `OPENBAO_ENV_FILE`, defaults to `.openbao-env`
|
- `OPENBAO_ENV_FILE`, defaults to `.openbao-env`
|
||||||
|
|
||||||
The script supports both KV v1 and KV v2 response shapes.
|
The script reads KV v2 secrets from mount `ci`:
|
||||||
|
|
||||||
|
- `shared/registry`
|
||||||
|
- `shared/deploy-ssh`
|
||||||
|
- `projects/${OPENBAO_APP}/deploy`
|
||||||
|
- `projects/${OPENBAO_APP}/runtime`
|
||||||
|
|
||||||
|
It also exposes `REGISTRY_USERNAME` and `REGISTRY_PASSWORD` as the workflow-compatible
|
||||||
|
aliases `DEPLOY_REGISTRY_USER` and `DEPLOY_REGISTRY_TOKEN`.
|
||||||
|
|||||||
+47
-18
@@ -2,36 +2,67 @@
|
|||||||
set -euo pipefail
|
set -euo pipefail
|
||||||
|
|
||||||
: "${BAO_ADDR:?BAO_ADDR is required}"
|
: "${BAO_ADDR:?BAO_ADDR is required}"
|
||||||
: "${BAO_TOKEN:?BAO_TOKEN is required}"
|
: "${BAO_ROLE_ID:?BAO_ROLE_ID is required}"
|
||||||
: "${BAO_SECRET_PATH:?BAO_SECRET_PATH is required}"
|
: "${BAO_SECRET_ID:?BAO_SECRET_ID is required}"
|
||||||
|
: "${OPENBAO_APP:?OPENBAO_APP is required}"
|
||||||
|
|
||||||
output="${OPENBAO_ENV_FILE:-.openbao-env}"
|
output="${OPENBAO_ENV_FILE:-.openbao-env}"
|
||||||
payload="$(mktemp)"
|
payload="$(mktemp)"
|
||||||
trap 'rm -f "$payload"' EXIT
|
merged="$(mktemp)"
|
||||||
|
trap 'rm -f "$payload" "$merged"' EXIT
|
||||||
|
|
||||||
curl --fail --silent --show-error \
|
export BAO_ADDR
|
||||||
--header "X-Vault-Token: ${BAO_TOKEN}" \
|
BAO_TOKEN="$(bao write -field=token auth/approle/login role_id="$BAO_ROLE_ID" secret_id="$BAO_SECRET_ID")"
|
||||||
"${BAO_ADDR%/}/v1/${BAO_SECRET_PATH#/}" \
|
export BAO_TOKEN
|
||||||
> "$payload"
|
|
||||||
|
|
||||||
python3 - "$payload" "$output" <<'PY'
|
printf '{}\n' > "$merged"
|
||||||
|
|
||||||
|
merge_secret() {
|
||||||
|
local path="$1"
|
||||||
|
|
||||||
|
bao kv get -mount=ci -format=json "$path" > "$payload"
|
||||||
|
|
||||||
|
python3 - "$payload" "$merged" <<'PY'
|
||||||
|
import json
|
||||||
|
import sys
|
||||||
|
from pathlib import Path
|
||||||
|
|
||||||
|
payload = json.loads(Path(sys.argv[1]).read_text(encoding="utf-8"))
|
||||||
|
merged_path = Path(sys.argv[2])
|
||||||
|
merged = json.loads(merged_path.read_text(encoding="utf-8"))
|
||||||
|
|
||||||
|
data = payload.get("data", {})
|
||||||
|
if isinstance(data, dict) and isinstance(data.get("data"), dict):
|
||||||
|
data = data["data"]
|
||||||
|
|
||||||
|
if not isinstance(data, dict):
|
||||||
|
raise SystemExit("OpenBao response does not contain an object secret payload")
|
||||||
|
|
||||||
|
merged.update({key: value for key, value in data.items() if value is not None})
|
||||||
|
merged_path.write_text(json.dumps(merged), encoding="utf-8")
|
||||||
|
PY
|
||||||
|
}
|
||||||
|
|
||||||
|
merge_secret "shared/registry"
|
||||||
|
merge_secret "shared/deploy-ssh"
|
||||||
|
merge_secret "projects/${OPENBAO_APP}/deploy"
|
||||||
|
merge_secret "projects/${OPENBAO_APP}/runtime"
|
||||||
|
|
||||||
|
python3 - "$merged" "$output" <<'PY'
|
||||||
import json
|
import json
|
||||||
import re
|
import re
|
||||||
import shlex
|
import shlex
|
||||||
import sys
|
import sys
|
||||||
from pathlib import Path
|
from pathlib import Path
|
||||||
|
|
||||||
payload_path = Path(sys.argv[1])
|
data = json.loads(Path(sys.argv[1]).read_text(encoding="utf-8"))
|
||||||
output_path = Path(sys.argv[2])
|
output_path = Path(sys.argv[2])
|
||||||
|
|
||||||
payload = json.loads(payload_path.read_text(encoding="utf-8"))
|
if "REGISTRY_USERNAME" in data and "DEPLOY_REGISTRY_USER" not in data:
|
||||||
data = payload.get("data", {})
|
data["DEPLOY_REGISTRY_USER"] = data["REGISTRY_USERNAME"]
|
||||||
|
|
||||||
if isinstance(data, dict) and isinstance(data.get("data"), dict):
|
if "REGISTRY_PASSWORD" in data and "DEPLOY_REGISTRY_TOKEN" not in data:
|
||||||
data = data["data"]
|
data["DEPLOY_REGISTRY_TOKEN"] = data["REGISTRY_PASSWORD"]
|
||||||
|
|
||||||
if not isinstance(data, dict):
|
|
||||||
raise SystemExit("OpenBao response does not contain an object secret payload")
|
|
||||||
|
|
||||||
name_re = re.compile(r"^[A-Za-z_][A-Za-z0-9_]*$")
|
name_re = re.compile(r"^[A-Za-z_][A-Za-z0-9_]*$")
|
||||||
lines = [
|
lines = [
|
||||||
@@ -43,8 +74,6 @@ for key in sorted(data):
|
|||||||
if not name_re.match(key):
|
if not name_re.match(key):
|
||||||
raise SystemExit(f"Unsupported environment variable name from OpenBao: {key}")
|
raise SystemExit(f"Unsupported environment variable name from OpenBao: {key}")
|
||||||
value = data[key]
|
value = data[key]
|
||||||
if value is None:
|
|
||||||
continue
|
|
||||||
if isinstance(value, bool):
|
if isinstance(value, bool):
|
||||||
value = "true" if value else "false"
|
value = "true" if value else "false"
|
||||||
elif not isinstance(value, str):
|
elif not isinstance(value, str):
|
||||||
|
|||||||
Reference in New Issue
Block a user