Worker Connect to remote Cadence inside docker #5440

DemoonLXW · 2023-11-03T15:19:15Z

DemoonLXW
Nov 3, 2023

Question

Currently, I want to develop a web app with Cadence and setup Cadence using docker-compose in my remote server. But my worker or workflow can not connect to the Cadence server. I want to how to solve the problem and know why?

Worker:

 WARN    internal/internal_worker.go:215 unable to verify if domain exist        {"Domain": "up-learning", "TaskList": "sample-list", "WorkerID": "198480@DESKTOP-3R68BM6@sample-list@ec3aaf77-2c24-4a2e-857f-85fd9c8e568d", "WorkerType": "LocallyDispatchedActivityWorker", "domain": "up-learning", "error": "code:unavailable message:connection error: desc = \"error reading server preface: read tcp 192.168.203.52:39404->x.x.x.x:7833: wsarecv: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.\""}

Workflow:

start workflow failed: code:unavailable message:connection error: desc = "error reading server preface: read tcp 192.168.203.52:39442->x.x.x.x:7833: use of closed network connection"

Cadence setup log:

cadence-cadence-1        | {"level":"info","ts":"2023-11-03T14:51:48.649Z","msg":"history started","service":"cadence-history","logging-call-at":"service.go:105"}
cadence-cadence-1        | {"level":"warn","ts":1699023113.4553208,"logger":"scanner","caller":"internal/internal_worker.go:262","msg":"unable to verify if domain exist","Domain":"cadence-system","TaskList":"cadence-sys-tl-scanner-tasklist-0","WorkerID":"1@b1dd64eecd14@cadence-sys-tl-scanner-tasklist-0@ed9823cd-e386-4209-90a7-9ba10453d834","WorkerType":"DecisionWorker","domain":"cadence-system","error":"code:unavailable message:connection closed before server preface received"}
cadence-cadence-1        | {"level":"info","ts":1699023113.4556527,"logger":"scanner","caller":"internal/internal_worker.go:834","msg":"Started Workflow Worker","Domain":"cadence-system","TaskList":"cadence-sys-tl-scanner-tasklist-0","WorkerID":"1@b1dd64eecd14@cadence-sys-tl-scanner-tasklist-0@ed9823cd-e386-4209-90a7-9ba10453d834"}
cadence-cadence-1        | {"level":"warn","ts":1699023113.455934,"logger":"scanner","caller":"internal/internal_worker.go:262","msg":"unable to verify if domain exist","Domain":"cadence-system","TaskList":"cadence-sys-tl-scanner-tasklist-0","WorkerID":"1@b1dd64eecd14@cadence-sys-tl-scanner-tasklist-0@ed9823cd-e386-4209-90a7-9ba10453d834","WorkerType":"ActivityWorker","domain":"cadence-system","error":"code:unavailable message:connection closed before server preface received"}
cadence-cadence-1        | {"level":"warn","ts":1699023113.4560525,"logger":"scanner","caller":"internal/internal_worker.go:262","msg":"unable to verify if domain exist","Domain":"cadence-system","TaskList":"cadence-sys-tl-scanner-tasklist-0","WorkerID":"1@b1dd64eecd14@cadence-sys-tl-scanner-tasklist-0@ed9823cd-e386-4209-90a7-9ba10453d834","WorkerType":"LocallyDispatchedActivityWorker","domain":"cadence-system","error":"code:unavailable message:connection closed before server preface received"}
cadence-cadence-1        | {"level":"info","ts":1699023113.4560804,"logger":"scanner","caller":"internal/internal_worker.go:859","msg":"Started Activity Worker","Domain":"cadence-system","TaskList":"cadence-sys-tl-scanner-tasklist-0","WorkerID":"1@b1dd64eecd14@cadence-sys-tl-scanner-tasklist-0@ed9823cd-e386-4209-90a7-9ba10453d834"}
cadence-cadence-1        | {"level":"warn","ts":1699023113.457457,"logger":"data-corruption-workflow","caller":"internal/internal_worker.go:262","msg":"unable to verify if domain exist","Domain":"cadence-system","TaskList":"check-data-corruption-workflow-tl","WorkerID":"1@b1dd64eecd14@check-data-corruption-workflow-tl@1c4504a1-d0ce-48ea-9c3d-bb5d4e9a9490","WorkerType":"DecisionWorker","domain":"cadence-system","error":"code:unavailable message:connection closed before server preface received"}
cadence-cadence-1        | {"level":"info","ts":1699023113.4581187,"logger":"data-corruption-workflow","caller":"internal/internal_worker.go:834","msg":"Started Workflow Worker","Domain":"cadence-system","TaskList":"check-data-corruption-workflow-tl","WorkerID":"1@b1dd64eecd14@check-data-corruption-workflow-tl@1c4504a1-d0ce-48ea-9c3d-bb5d4e9a9490"}
cadence-cadence-1        | {"level":"warn","ts":1699023113.4583313,"logger":"data-corruption-workflow","caller":"internal/internal_worker.go:262","msg":"unable to verify if domain exist","Domain":"cadence-system","TaskList":"check-data-corruption-workflow-tl","WorkerID":"1@b1dd64eecd14@check-data-corruption-workflow-tl@1c4504a1-d0ce-48ea-9c3d-bb5d4e9a9490","WorkerType":"ActivityWorker","domain":"cadence-system","error":"code:unavailable message:connection closed before server preface received"}
cadence-cadence-1        | {"level":"warn","ts":1699023113.4585016,"logger":"data-corruption-workflow","caller":"internal/internal_worker.go:262","msg":"unable to verify if domain exist","Domain":"cadence-system","TaskList":"check-data-corruption-workflow-tl","WorkerID":"1@b1dd64eecd14@check-data-corruption-workflow-tl@1c4504a1-d0ce-48ea-9c3d-bb5d4e9a9490","WorkerType":"LocallyDispatchedActivityWorker","domain":"cadence-system","error":"code:unavailable message:connection closed before server preface received"}
cadence-cadence-1        | {"level":"info","ts":1699023113.4585488,"logger":"data-corruption-workflow","caller":"internal/internal_worker.go:859","msg":"Started Activity Worker","Domain":"cadence-system","TaskList":"check-data-corruption-workflow-tl","WorkerID":"1@b1dd64eecd14@check-data-corruption-workflow-tl@1c4504a1-d0ce-48ea-9c3d-bb5d4e9a9490"}
cadence-cadence-1        | {"level":"info","ts":"2023-11-03T14:51:53.461Z","caller":"internal/internal_worker.go:223","msg":"No logger configured for cadence worker. Created default one."}
cadence-cadence-1        | {"level":"warn","ts":"2023-11-03T14:51:53.461Z","caller":"internal/internal_worker.go:262","msg":"unable to verify if domain exist","Domain":"cadence-batcher","TaskList":"cadence-sys-batcher-tasklist","WorkerID":"1@b1dd64eecd14@cadence-sys-batcher-tasklist@2f573aeb-825f-4943-bcb1-2a790fbedac1","WorkerType":"DecisionWorker","domain":"cadence-batcher","error":"code:unavailable message:connection closed before server preface received"}
cadence-cadence-1        | {"level":"info","ts":"2023-11-03T14:51:53.461Z","caller":"internal/internal_worker.go:834","msg":"Started Workflow Worker","Domain":"cadence-batcher","TaskList":"cadence-sys-batcher-tasklist","WorkerID":"1@b1dd64eecd14@cadence-sys-batcher-tasklist@2f573aeb-825f-4943-bcb1-2a790fbedac1"}
cadence-cadence-1        | {"level":"warn","ts":"2023-11-03T14:51:53.461Z","caller":"internal/internal_worker.go:262","msg":"unable to verify if domain exist","Domain":"cadence-batcher","TaskList":"cadence-sys-batcher-tasklist","WorkerID":"1@b1dd64eecd14@cadence-sys-batcher-tasklist@2f573aeb-825f-4943-bcb1-2a790fbedac1","WorkerType":"ActivityWorker","domain":"cadence-batcher","error":"code:unavailable message:connection closed before server preface received"}

docker-compose.yml:

version: '3'
services:
  prometheus:
    image: prom/prometheus:latest
    volumes:
      - ./prometheus:/etc/prometheus
    command:
      - '--config.file=/etc/prometheus/prometheus.yml'
    ports:
      - '9090:9090'
  node-exporter:
    image: prom/node-exporter
ports:
  - '9100:9100'
  cadence:
    image: ubercadence/server:v1.2.5-auto-setup
    ports:
     - "8000:8000"
     - "8001:8001"
     - "8002:8002"
     - "8003:8003"
     - "7933:7933"
     - "7934:7934"
     - "7935:7935"
     - "7939:7939"
     - "7833:7833"
    environment:
      - "DB=mysql"
      - "MYSQL_USER=uber"
      - "MYSQL_PWD=uber"
      - "MYSQL_SEEDS=172.17.0.1"
      - "PROMETHEUS_ENDPOINT_0=0.0.0.0:8000"
      - "PROMETHEUS_ENDPOINT_1=0.0.0.0:8001"
      - "PROMETHEUS_ENDPOINT_2=0.0.0.0:8002"
      - "PROMETHEUS_ENDPOINT_3=0.0.0.0:8003"
      - "DYNAMIC_CONFIG_FILE_PATH=config/dynamicconfig/development.yaml"
    depends_on:
      - prometheus
  cadence-web:
    image: ubercadence/web:latest
    environment:
      - "CADENCE_TCHANNEL_PEERS=cadence:7933"
    ports:
      - "8088:8088"
    depends_on:
  - cadence
  grafana:
    image: grafana/grafana
    volumes:
      - ./grafana:/etc/grafana
    user: "1000"
    depends_on:
      - prometheus
    ports:
      - '3000:3000'

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Worker Connect to remote Cadence inside docker #5440

{{title}}

Replies: 0 comments

Select a reply

Worker Connect to remote Cadence inside docker #5440

DemoonLXW Nov 3, 2023

Question

Replies: 0 comments

DemoonLXW
Nov 3, 2023