Skip to content

[求助/Help] 部署完master后添加node出错,疑似内部dns问题 #23277

@yw9381

Description

@yw9381

我使用的是esxi上运行的vm进行部署,分别开了两个VM,具体信息如下

主机 ip 系统版本 CPU MEM HDD
cloudpods-master 30.0.50.102 Debian 11 x64 4 vCPU 8 GB 100 GB
cloudpods-node-1 30.0.50.103 Debian 11 x64 8 vCPU 16 GB 200 GB

按照文档添加计算节点后,ansible部分跑完没问题,已经在IP子网新增了node的IP,但宿主机始终未加入

查看对应pods的日志发现对应的host pod上8885端口未开

Image

进一步查看日志在对应的health的pod上看到DNS错误,无法解析到default-keystone
Image

#22000 相同问题,但该issue中并未提供解决方案

进一步分析发现node的calico pod似乎有问题,运行在node上的所有pod都无法正常对外访问(包括访问公网、内网及pod网络),相关日志如下

2025-09-11 21:22:37.221 [INFO][76] felix/route_table.go 916: Deleting from expected targets cidr=10.40.17.66/32 ifaceName="calibbcc7d0182b" ifaceRegex="^cali.*" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.221 [INFO][76] felix/route_table.go 916: Deleting from expected targets cidr=10.40.245.192/26 ifaceName="vxlan.calico" ifaceRegex="^vxlan.calico$" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.221 [INFO][76] felix/route_table.go 922: No pending target update, adding back in as an update cidr=10.40.17.66/32 ifaceName="calibbcc7d0182b" ifaceRegex="^cali.*" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.221 [INFO][76] felix/route_table.go 922: No pending target update, adding back in as an update cidr=10.40.245.192/26 ifaceName="vxlan.calico" ifaceRegex="^vxlan.calico$" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.221 [INFO][76] felix/route_table.go 916: Deleting from expected targets cidr=10.40.17.67/32 ifaceName="caliac36b502640" ifaceRegex="^cali.*" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.221 [INFO][76] felix/route_table.go 916: Deleting from expected targets cidr=10.40.245.192/26 ifaceName="vxlan.calico" ifaceRegex="^vxlan.calico$" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.221 [INFO][76] felix/route_table.go 922: No pending target update, adding back in as an update cidr=10.40.17.67/32 ifaceName="caliac36b502640" ifaceRegex="^cali.*" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.221 [INFO][76] felix/route_table.go 922: No pending target update, adding back in as an update cidr=10.40.245.192/26 ifaceName="vxlan.calico" ifaceRegex="^vxlan.calico$" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.221 [WARNING][76] felix/route_table.go 723: Failed to add route error=invalid argument ifaceName="vxlan.calico" ifaceRegex="^vxlan.calico$" ipVersion=0x4 route={Ifindex: 9 Dst: 10.40.245.192/26 Src: 30.0.50.102 Gw: 10.40.245.192 Flags: [onlink] Table: 254 Realm: 0} tableIndex=254
2025-09-11 21:22:37.221 [INFO][76] felix/route_table.go 916: Deleting from expected targets cidr=10.40.17.66/32 ifaceName="calibbcc7d0182b" ifaceRegex="^cali.*" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.221 [INFO][76] felix/route_table.go 922: No pending target update, adding back in as an update cidr=10.40.17.66/32 ifaceName="calibbcc7d0182b" ifaceRegex="^cali.*" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.221 [WARNING][76] felix/route_table.go 1207: Failed to access interface but it appears to be up error=netlink update operation failed ifaceName="vxlan.calico" ifaceRegex="^vxlan.calico$" ipVersion=0x4 link=&netlink.Vxlan{LinkAttrs:netlink.LinkAttrs{Index:9, MTU:1450, TxQLen:1000, Name:"vxlan.calico", HardwareAddr:net.HardwareAddr{0x66, 0x4d, 0x2d, 0x5e, 0x99, 0x15}, Flags:0x13, RawFlags:0x11043, ParentIndex:0, MasterIndex:0, Namespace:interface {}(nil), Alias:"", Statistics:(*netlink.LinkStatistics)(0xc000c195c0), Promisc:0, Allmulti:0, Multi:1, Xdp:(*netlink.LinkXdp)(0xc0008b9398), EncapType:"ether", Protinfo:(*netlink.Protinfo)(nil), OperState:0x0, PhysSwitchID:0, NetNsID:-1, NumTxQueues:1, NumRxQueues:1, GSOMaxSize:0x10000, GSOMaxSegs:0xffff, GROMaxSize:0x0, Vfs:[]netlink.VfInfo(nil), Group:0x0, Slave:netlink.LinkSlave(nil)}, VxlanId:4096, VtepDevIndex:6, SrcAddr:net.IP{0x1e, 0x0, 0x32, 0x67}, Group:net.IP(nil), TTL:0, TOS:0, Learning:false, Proxy:false, RSC:false, L2miss:false, L3miss:false, UDPCSum:true, UDP6ZeroCSumTx:false, UDP6ZeroCSumRx:false, NoAge:false, GBP:false, FlowBased:false, Age:300, Limit:0, Port:4789, PortLow:0, PortHigh:0} tableIndex=254
2025-09-11 21:22:37.221 [WARNING][76] felix/route_table.go 723: Failed to add route error=invalid argument ifaceName="calibbcc7d0182b" ifaceRegex="^cali.*" ipVersion=0x4 route={Ifindex: 4 Dst: 10.40.17.66/32 Src: 30.0.50.102 Gw: <nil> Flags: [] Table: 254 Realm: 0} tableIndex=254
2025-09-11 21:22:37.221 [WARNING][76] felix/route_table.go 606: Failed to sync routes to interface even after retries. Leaving it dirty, requiring a full sync. ifaceName="vxlan.calico" ifaceRegex="^vxlan.calico$" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.222 [WARNING][76] felix/route_table.go 619: Some interfaces still out-of sync. ifaceRegex="^vxlan.calico$" ipVersion=0x4 tableIndex=254
2025-09-11 21:22:37.222 [WARNING][76] felix/route_table.go 1207: Failed to access interface but it appears to be up error=netlink update operation failed ifaceName="calibbcc7d0182b" ifaceRegex="^cali.*" ipVersion=0x4 link=&netlink.Veth{LinkAttrs:netlink.LinkAttrs{Index:4, MTU:1450, TxQLen:1000, Name:"calibbcc7d0182b", HardwareAddr:net.HardwareAddr{0xee, 0xee, 0xee, 0xee, 0xee, 0xee}, Flags:0x13, RawFlags:0x11043, ParentIndex:2, MasterIndex:0, Namespace:interface {}(nil), Alias:"", Statistics:(*netlink.LinkStatistics)(0xc000bb9b00), Promisc:0, Allmulti:0, Multi:1, Xdp:(*netlink.LinkXdp)(0xc00019d578), EncapType:"ether", Protinfo:(*netlink.Protinfo)(nil), OperState:0x6, PhysSwitchID:0, NetNsID:0, NumTxQueues:1, NumRxQueues:1, GSOMaxSize:0x10000, GSOMaxSegs:0xffff, GROMaxSize:0x0, Vfs:[]netlink.VfInfo(nil), Group:0x0, Slave:netlink.LinkSlave(nil)}, PeerName:"", PeerHardwareAddr:net.HardwareAddr(nil), PeerNamespace:interface {}(nil)} tableIndex=254
2025-09-11 21:22:37.222 [WARNING][76] felix/int_dataplane.go 2196: Failed to synchronize routing table, will retry...

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions