cronicle minio s3 存储配置集成

cronicle 后端存储是可配置的 ,通过使用不同的存储配置,我们可以解决多实例部署以及数据共享的问题
cronicle 的后端存储模型,设计的特别方便,包含了基于文件的,基于s3 的,同时我们也可以开发自己的
存储引擎

以下是一个集成minio s3 部署单master,多slave 实际上我们可以扩展为多master

环境准备

  • docker-compose 文件
 
version: "3"
services:  
  s3:
      image: minio/minio
      command: server /data
      ports: 
      - "9000:9000"
      environment:
      - "MINIO_ACCESS_KEY=dalongapp"
      - "MINIO_SECRET_KEY=dalongapp"
      volumes: 
      - "./data:/data" 
  cronicle:
      build: ./
      hostname: master
      image: dalongrong/cronicle
      volumes:
      - "./config.json:/opt/cronicle/conf/config.json"
      ports:
      - "3012:3012"
  cronicle2:
      build: ./
      hostname: cronicle2
      image: dalongrong/cronicle
      volumes:
      - "./config.json:/opt/cronicle/conf/config.json"
      ports:
      - "3013:3012"
  cronicle3:
      build: ./
      hostname: cronicle3
      image: dalongrong/cronicle
      volumes:
      - "./config.json:/opt/cronicle/conf/config.json"
      ports:
      - "3014:3012"
  • cronicle dockerfile
    添加了aws sdk
 
FROM node:12.10.0-stretch-slim
LABEL AUTHOR="rongfengliang"
LABEL EMAIL="1141591465@qq.com"
RUN npm config set registry https://registry.npm.taobao.org
RUN curl -s https://raw.githubusercontent.com/jhuckaby/Cronicle/master/bin/install.js | node
RUN cd /opt/cronicle && npm install aws-sdk
EXPOSE 3012
ENTRYPOINT ["tail", "-f", "/dev/null"]
 
  • 存储配置
    config.json ,以下截取部分关于存储的配置
 
"Storage": {
    "engine": "S3",
    "AWS": {
      "accessKeyId": "dalongapp", 
      "secretAccessKey": "dalongapp", 
      "region": "us-east-1",
      "correctClockSkew": true,
      "endpoint": "s3:9000",
      "sslEnabled": false,
      "s3ForcePathStyle": true,
      "maxRetries": 5,
      "httpOptions": {
        "connectTimeout": 5000,
        "timeout": 5000
      }
    },
    "S3": {
      "keyPrefix": "cronicle",
      "fileExtensions": true,
      "params": {
        "Bucket": "cronicle"
      }
    }
  }

启动&&运行

  • 启动
docker-compose up -d
  • 创建s3桶
    通过UI
  • 启动master
docker-compose exec cronicle /opt/cronicle/bin/control.sh setup
docker-compose exec cronicle /opt/cronicle/bin/control.sh start
  • s3 内容

  • 启动slave
docker-compose exec cronicle2 /opt/cronicle/bin/control.sh start
docker-compose exec cronicle3 /opt/cronicle/bin/control.sh start
  • 添加slave 节点

  • 配置一个简单的调度任务

  • 执行调度效果

说明

以上是一个简单的基于minio s3 实现的配置共享,实际上基于s3 我们可以配置cronicle 的多master

参考资料

https://github.com/jhuckaby/Cronicle
https://github.com/awsdocs/aws-doc-sdk-examples/blob/master/javascript/example_code/s3/s3_setcors.js
https://github.com/rongfengliang/cronicle-docker

原文地址:https://www.cnblogs.com/rongfengliang/p/11541492.html