Kubernetes部署
版本: 2.1.0-alpha2 作者: @yutiansut @quantaxis 更新日期: 2025-10-25
本文档介绍如何在Kubernetes集群上部署QUANTAXIS完整系统。
🎯 部署架构
系统组件
┌─────────────────────────────────────────────┐
│ Kubernetes Cluster │
│ │
│ ┌─────────────┐ ┌─────────────┐ │
│ │ Ingress │ │ Service │ │
│ └──────┬──────┘ └──────┬──────┘ │
│ │ │ │
│ ┌──────▼──────────────────▼──────┐ │
│ │ XWebServer (3 replicas) │ │
│ └──────┬──────────────────┬──────┘ │
│ │ │ │
│ ┌──────▼──────┐ ┌─────▼──────┐ │
│ │ MongoDB │ │ RabbitMQ │ │
│ │ StatefulSet │ │ StatefulSet│ │
│ └─────────────┘ └────────────┘ │
│ │
│ ┌─────────────────────────────────┐ │
│ │ XQuant (Strategy Pods) │ │
│ └─────────────────────────────────┘ │
└─────────────────────────────────────────────┘📦 前置要求
1. Kubernetes集群
# 检查集群版本
kubectl version
# 推荐版本
Kubernetes: v1.24+2. 存储配置
# storage-class.yaml
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
name: quantaxis-storage
provisioner: kubernetes.io/aws-ebs # 根据云厂商调整
parameters:
type: gp3
fsType: ext4
reclaimPolicy: Retain
volumeBindingMode: WaitForFirstConsumerkubectl apply -f storage-class.yaml🚀 快速部署
1. 创建命名空间
kubectl create namespace quantaxis
kubectl config set-context --current --namespace=quantaxis2. 部署MongoDB
# mongodb-statefulset.yaml
apiVersion: v1
kind: Service
metadata:
name: mongodb
namespace: quantaxis
spec:
ports:
- port: 27017
name: mongodb
clusterIP: None
selector:
app: mongodb
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
name: mongodb
namespace: quantaxis
spec:
serviceName: mongodb
replicas: 1
selector:
matchLabels:
app: mongodb
template:
metadata:
labels:
app: mongodb
spec:
containers:
- name: mongodb
image: mongo:5.0
ports:
- containerPort: 27017
name: mongodb
env:
- name: MONGO_INITDB_ROOT_USERNAME
value: "admin"
- name: MONGO_INITDB_ROOT_PASSWORD
valueFrom:
secretKeyRef:
name: mongodb-secret
key: password
volumeMounts:
- name: mongodb-data
mountPath: /data/db
resources:
requests:
memory: "4Gi"
cpu: "2"
limits:
memory: "8Gi"
cpu: "4"
volumeClaimTemplates:
- metadata:
name: mongodb-data
spec:
accessModes: [ "ReadWriteOnce" ]
storageClassName: quantaxis-storage
resources:
requests:
storage: 100Gi# 创建Secret
kubectl create secret generic mongodb-secret \
--from-literal=password='your-password-here' \
-n quantaxis
# 部署MongoDB
kubectl apply -f mongodb-statefulset.yaml3. 部署RabbitMQ
# rabbitmq-statefulset.yaml
apiVersion: v1
kind: Service
metadata:
name: rabbitmq
namespace: quantaxis
spec:
ports:
- port: 5672
name: amqp
- port: 15672
name: management
clusterIP: None
selector:
app: rabbitmq
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
name: rabbitmq
namespace: quantaxis
spec:
serviceName: rabbitmq
replicas: 1
selector:
matchLabels:
app: rabbitmq
template:
metadata:
labels:
app: rabbitmq
spec:
containers:
- name: rabbitmq
image: rabbitmq:3.11-management
ports:
- containerPort: 5672
name: amqp
- containerPort: 15672
name: management
env:
- name: RABBITMQ_DEFAULT_USER
value: "admin"
- name: RABBITMQ_DEFAULT_PASS
valueFrom:
secretKeyRef:
name: rabbitmq-secret
key: password
volumeMounts:
- name: rabbitmq-data
mountPath: /var/lib/rabbitmq
resources:
requests:
memory: "2Gi"
cpu: "1"
limits:
memory: "4Gi"
cpu: "2"
volumeClaimTemplates:
- metadata:
name: rabbitmq-data
spec:
accessModes: [ "ReadWriteOnce" ]
storageClassName: quantaxis-storage
resources:
requests:
storage: 20Gi# 创建Secret
kubectl create secret generic rabbitmq-secret \
--from-literal=password='your-password-here' \
-n quantaxis
# 部署RabbitMQ
kubectl apply -f rabbitmq-statefulset.yaml4. 部署Web服务
# xwebserver-deployment.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: xwebserver-config
namespace: quantaxis
data:
config.yml: |
server:
host: 0.0.0.0
port: 8010
mongodb:
host: mongodb
port: 27017
username: admin
password: ${MONGO_PASSWORD}
rabbitmq:
host: rabbitmq
port: 5672
username: admin
password: ${RABBITMQ_PASSWORD}
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: xwebserver
namespace: quantaxis
spec:
replicas: 3
selector:
matchLabels:
app: xwebserver
template:
metadata:
labels:
app: xwebserver
spec:
containers:
- name: xwebserver
image: quantaxis/xwebserver:2.1.0
ports:
- containerPort: 8010
name: http
env:
- name: MONGO_PASSWORD
valueFrom:
secretKeyRef:
name: mongodb-secret
key: password
- name: RABBITMQ_PASSWORD
valueFrom:
secretKeyRef:
name: rabbitmq-secret
key: password
volumeMounts:
- name: config
mountPath: /app/config
resources:
requests:
memory: "1Gi"
cpu: "500m"
limits:
memory: "2Gi"
cpu: "1"
livenessProbe:
httpGet:
path: /health
port: 8010
initialDelaySeconds: 30
periodSeconds: 10
readinessProbe:
httpGet:
path: /ready
port: 8010
initialDelaySeconds: 10
periodSeconds: 5
volumes:
- name: config
configMap:
name: xwebserver-config
---
apiVersion: v1
kind: Service
metadata:
name: xwebserver
namespace: quantaxis
spec:
type: ClusterIP
ports:
- port: 80
targetPort: 8010
name: http
selector:
app: xwebserverkubectl apply -f xwebserver-deployment.yaml5. 配置Ingress
# ingress.yaml
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: quantaxis-ingress
namespace: quantaxis
annotations:
nginx.ingress.kubernetes.io/rewrite-target: /
cert-manager.io/cluster-issuer: letsencrypt-prod
spec:
ingressClassName: nginx
tls:
- hosts:
- quantaxis.example.com
secretName: quantaxis-tls
rules:
- host: quantaxis.example.com
http:
paths:
- path: /
pathType: Prefix
backend:
service:
name: xwebserver
port:
number: 80kubectl apply -f ingress.yaml📊 策略Pod部署
策略Deployment
# strategy-deployment.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: strategy-config
namespace: quantaxis
data:
strategy.py: |
from QUANTAXIS.QAStrategy import QAStrategyCtaBase
import QUANTAXIS as QA
class MyStrategy(QAStrategyCtaBase):
def user_init(self):
self.fast_period = 5
self.slow_period = 20
def on_bar(self, bar):
market_data = self.get_code_marketdata(bar.code)
if len(market_data) < self.slow_period:
return
close_prices = [x['close'] for x in market_data]
ma_fast = QA.MA(close_prices, self.fast_period)
ma_slow = QA.MA(close_prices, self.slow_period)
positions = self.acc.positions
if ma_fast[-1] > ma_slow[-1] and bar.code not in positions:
self.BuyOpen(bar.code, 1)
elif ma_fast[-1] < ma_slow[-1] and bar.code in positions:
self.SellClose(bar.code, 1)
if __name__ == '__main__':
strategy = MyStrategy(
code='rb2501',
frequence='5min',
model='live',
data_host='rabbitmq',
trade_host='rabbitmq'
)
strategy.run()
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: strategy-runner
namespace: quantaxis
spec:
replicas: 2
selector:
matchLabels:
app: strategy
template:
metadata:
labels:
app: strategy
spec:
containers:
- name: strategy
image: quantaxis/python:2.1.0
command: ["python", "/app/strategy.py"]
volumeMounts:
- name: strategy-code
mountPath: /app
env:
- name: MONGO_HOST
value: "mongodb"
- name: RABBITMQ_HOST
value: "rabbitmq"
resources:
requests:
memory: "512Mi"
cpu: "250m"
limits:
memory: "1Gi"
cpu: "500m"
volumes:
- name: strategy-code
configMap:
name: strategy-configkubectl apply -f strategy-deployment.yaml🔧 配置管理
1. ConfigMap管理
# 查看ConfigMap
kubectl get configmap -n quantaxis
# 更新ConfigMap
kubectl edit configmap xwebserver-config -n quantaxis
# 重启Pod应用配置
kubectl rollout restart deployment/xwebserver -n quantaxis2. Secret管理
# 查看Secret
kubectl get secret -n quantaxis
# 更新Secret
kubectl create secret generic mongodb-secret \
--from-literal=password='new-password' \
--dry-run=client -o yaml | kubectl apply -f -
# 重启相关Pod
kubectl rollout restart statefulset/mongodb -n quantaxis📈 监控和日志
1. 部署Prometheus
# prometheus-config.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: prometheus-config
namespace: quantaxis
data:
prometheus.yml: |
global:
scrape_interval: 15s
scrape_configs:
- job_name: 'xwebserver'
kubernetes_sd_configs:
- role: pod
namespaces:
names:
- quantaxis
relabel_configs:
- source_labels: [__meta_kubernetes_pod_label_app]
action: keep
regex: xwebserver2. 查看日志
# 查看Pod日志
kubectl logs -f deployment/xwebserver -n quantaxis
# 查看特定容器日志
kubectl logs -f statefulset/mongodb -n quantaxis
# 查看最近100行日志
kubectl logs --tail=100 deployment/strategy-runner -n quantaxis
# 导出所有日志
kubectl logs deployment/xwebserver -n quantaxis > xwebserver.log3. 事件监控
# 查看事件
kubectl get events -n quantaxis --sort-by='.lastTimestamp'
# 监控Pod状态
kubectl get pods -n quantaxis -w🔄 维护操作
1. 滚动更新
# 更新镜像
kubectl set image deployment/xwebserver \
xwebserver=quantaxis/xwebserver:2.1.1 \
-n quantaxis
# 查看更新状态
kubectl rollout status deployment/xwebserver -n quantaxis
# 回滚
kubectl rollout undo deployment/xwebserver -n quantaxis
# 查看历史版本
kubectl rollout history deployment/xwebserver -n quantaxis2. 扩缩容
# 手动扩容
kubectl scale deployment/xwebserver --replicas=5 -n quantaxis
# 自动扩容（HPA）
kubectl autoscale deployment/xwebserver \
--min=3 --max=10 \
--cpu-percent=80 \
-n quantaxis3. 数据备份
# MongoDB备份
kubectl exec -it mongodb-0 -n quantaxis -- \
mongodump --out /backup/$(date +%Y%m%d)
# 复制备份到本地
kubectl cp quantaxis/mongodb-0:/backup ./mongodb-backup⚠️ 故障排查
常见问题
Q1: Pod无法启动
# 查看Pod详情
kubectl describe pod <pod-name> -n quantaxis
# 查看事件
kubectl get events -n quantaxis
# 常见原因：
# 1. 镜像拉取失败 → 检查镜像名称和权限
# 2. 资源不足 → kubectl top nodes
# 3. 配置错误 → kubectl logs <pod-name>Q2: 服务连接失败
# 检查Service
kubectl get svc -n quantaxis
# 测试连接
kubectl run -it --rm debug \
--image=busybox \
--restart=Never \
-n quantaxis \
-- sh
# 在Pod内测试
nslookup mongodb
telnet rabbitmq 5672Q3: 存储问题
# 查看PVC状态
kubectl get pvc -n quantaxis
# 查看PV
kubectl get pv
# 如果PVC处于Pending状态，检查StorageClass
kubectl describe pvc <pvc-name> -n quantaxis🔗 相关资源
📝 总结
Kubernetes部署QUANTAXIS提供：
✅ 高可用: 多副本部署，自动故障转移 ✅ 可扩展: 水平扩展，弹性伸缩 ✅ 易维护: 滚动更新，版本管理 ✅ 监控完善: Prometheus + Grafana ✅ 存储持久化: StatefulSet + PV/PVC
作者: @yutiansut @quantaxis 最后更新: 2025-10-25
Last updated
Was this helpful?