Open
Description
What happened:
pod ip in edge node still be docker ip not configured CIDR ip. for example:
root@master:~# kubectl describe pod lm-mpi-job-mpiworker-0
Name: lm-mpi-job-mpiworker-0
...
Status: Running
IP: 128.128.0.5
IPs:
IP: 128.128.0.5
Controlled By: Job/lm-mpi-job
...
What you expected to happen:
It's ip should be 10.x.x.x(In UNIFIED controlled cidr ip)
How to reproduce it (as minimally and precisely as possible):
deploy any pod after configure edgemesh
Anything else we need to know?:
if i configure edgemesh wrongly?
Environment:
-
EdgeMesh version: 1.17(newest)
-
Kubernetes version (use
kubectl version):1.23.17 -
KubeEdge version(e.g.
cloudcore --versionandedgecore --version):1.13.0 -
Cloud nodes Environment:
- Hardware configuration (e.g.
lscpu):amd64 in cloud - OS (e.g.
cat /etc/os-release):ubuntu22.04.3 in edge - Kernel (e.g.
uname -a):6.5.0-35-generic in cloud, - Go version (e.g.
go version): 1.22 - Others:temprarory nothing
- Hardware configuration (e.g.
-
Edge nodes Environment:
- edgecore version (e.g.
edgecore --version):.1.13.0 - Hardware configuration (e.g.
lscpu): arm64 in edges - OS (e.g.
cat /etc/os-release):, kylin os in edges - Kernel (e.g.
uname -a):5.4.18-53-generic in egdes - Go version (e.g.
go version):1.22 - Others:temprarory nothing
- edgecore version (e.g.
** Detail
Document for edgemesh： https://edgemesh.netlify.app/
This document lacks a lot of new featues such as edge cni. I still cannot use the feature even if i use edgemesh-1.17. Pod in edge node still be allocated with docker ip rather than unified cidr. The configuration file as follow:
modules:
edgeProxy:
enable: true
edgeTunnel:
enable: true
edgeCNI:
enable: true
meshCIDRConfig:
cloudCIDR:
- 10.244.1.0/24
- 10.244.1.0/24
edgeCIDR:
- 10.244.5.0/24
- 10.244.6.0/24The part of the log of the agent in master:
I0617 10:26:25.158475 1 server.go:58] Version: v1.17.0-dirty
I0617 10:26:25.158585 1 server.go:94] [1] Prepare agent to run
I0617 10:26:25.158921 1 netif.go:96] bridge device edgemesh0 already exists
I0617 10:26:25.159102 1 server.go:98] edgemesh-agent running on CloudMode
I0617 10:26:25.159130 1 server.go:101] [2] New clients
W0617 10:26:25.159198 1 client_config.go:617] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
I0617 10:26:25.160309 1 server.go:108] [3] Register beehive modules
W0617 10:26:25.160373 1 module.go:55] Module EdgeDNS is disabled, do not register
I0617 10:26:25.161848 1 server.go:68] Using userspace Proxier.
I0617 10:26:25.270569 1 module.go:52] Module EdgeProxy registered successfully
I0617 10:26:25.273278 1 util.go:273] Listening to docker0 is meaningless, skip it.
I0617 10:26:25.273378 1 util.go:273] Listening to kube-ipvs0 is meaningless, skip it.
I0617 10:26:25.274635 1 util.go:273] Listening to tunl0 is meaningless, skip it.
I0617 10:26:25.274847 1 util.go:273] Listening to edgemesh0 is meaningless, skip it.
I0617 10:26:25.275068 1 module.go:128] Configure libp2p.ForceReachabilityPrivate()
I0617 10:26:25.307746 1 module.go:189] I'm {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/169.254.25.10/tcp/20006 /ip4/192.168.137.195/tcp/20006]}
I0617 10:26:25.307790 1 module.go:211] Bootstrapping the DHT
I0617 10:26:25.313975 1 tunnel.go:85] Starting MDNS discovery service
I0617 10:26:25.314021 1 tunnel.go:98] Starting DHT discovery service
I0617 10:26:25.314208 1 module.go:52] Module EdgeTunnel registered successfully
I0617 10:26:25.314303 1 adapter.go:53] the cloud CIDRs are [10.244.1.0/24 10.244.1.0/24], the edge CIDRs are [10.244.5.0/24 10.244.6.0/24]
I0617 10:26:25.314656 1 tunnel.go:496] Starting relay finder
I0617 10:26:25.321820 1 adapter.go:59] local CIDR is 10.233.64.0/24
I0617 10:26:25.355874 1 tun.go:66] create TunInterface edge_tun0 successfully
I0617 10:26:25.360473 1 tun.go:74] set dev edge_tun0 up successfully
I0617 10:26:25.360551 1 tun.go:96] Tun Interface Name: edge_tun0
I0617 10:26:25.361765 1 tun.go:114] set dev edge_tun0 up succeed
I0617 10:26:25.404231 1 tunnel.go:210] Discovery service got a new stream from {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/192.168.137.233/tcp/20006]}
I0617 10:26:25.404459 1 tunnel.go:239] [MDNS] Discovery from node01 : {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/192.168.137.233/tcp/20006]}
I0617 10:26:25.405589 1 tun.go:141] ip route add table main 10.244.5.0/24 dev edge_tun0 succeed
I0617 10:26:25.408689 1 tun.go:141] ip route add table main 10.244.6.0/24 dev edge_tun0 succeed
I0617 10:26:25.411445 1 tun.go:141] ip route add table main 10.244.1.0/24 dev edge_tun0 succeed
E0617 10:26:25.414057 1 tun.go:123] failed to execute Command ip route add 10.244.1.0/24 dev edge_tun0 , err: %!(EXTRA *exec.ExitError=exit status 2)
E0617 10:26:25.414095 1 adapter.go:160] failed to add route to TunDev, error: failed to exec 'ip route add 10.244.1.0/24 dev edge_tun0', error: exit status 2
E0617 10:26:25.415362 1 module.go:75] add route to table failed%!(EXTRA *errors.errorString=failed to insert iptable rule, error: error checking rule: exit status 2: Bad argument `1'
Try `iptables -h' or 'iptables --help' for more information.
)
I0617 10:26:25.415397 1 module.go:52] Module EdgeCNI registered successfully
I0617 10:26:25.415406 1 server.go:114] [4] Cache beehive modules
I0617 10:26:25.415422 1 server.go:121] [5] Start all modules
I0617 10:26:25.415489 1 core.go:46] starting module EdgeTunnel
I0617 10:26:25.415530 1 core.go:46] starting module EdgeCNI
I0617 10:26:25.415604 1 core.go:46] starting module EdgeProxy
I0617 10:26:25.415790 1 adapter.go:144] [CNI] Start Meshadapter
E0617 10:26:25.415876 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
I0617 10:26:25.416183 1 config.go:135] "Starting endpoints config controller"
I0617 10:26:25.416219 1 shared_informer.go:240] Waiting for caches to sync for endpoints config
I0617 10:26:25.416261 1 config.go:317] "Starting service config controller"
I0617 10:26:25.416279 1 shared_informer.go:240] Waiting for caches to sync for service config
I0617 10:26:25.416346 1 loadbalancer.go:348] "Starting loadBalancer destinationRule controller"
I0617 10:26:25.416473 1 shared_informer.go:240] Waiting for caches to sync for loadBalancer destinationRule
I0617 10:26:25.416433 1 tunnel.go:712] not relay, skip metrics server!
I0617 10:26:25.416405 1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.233/tcp/20006]}
I0617 10:26:25.416603 1 tunnel.go:161] [MDNS] New stream between peer {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.233/tcp/20006]} success
I0617 10:26:25.417729 1 tunnel.go:197] [MDNS] Discovery to node01 : {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.233/tcp/20006]}
I0617 10:26:25.517325 1 shared_informer.go:247] Caches are synced for service config
I0617 10:26:25.517358 1 shared_informer.go:247] Caches are synced for endpoints config
I0617 10:26:25.517343 1 shared_informer.go:247] Caches are synced for loadBalancer destinationRule
I0617 10:26:25.589011 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849
I0617 10:26:25.596117 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849
I0617 10:26:25.608441 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849
I0617 10:26:25.619796 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000
I0617 10:26:25.623746 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000
I0617 10:26:25.635863 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000
I0617 10:26:25.647697 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001
I0617 10:26:25.652135 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001
I0617 10:26:25.663854 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001
I0617 10:26:25.677279 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002
I0617 10:26:25.681451 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002
I0617 10:26:25.704627 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002
I0617 10:26:25.718520 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003
I0617 10:26:25.722634 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003
I0617 10:26:25.735115 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003
I0617 10:26:25.754455 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004
I0617 10:26:25.760370 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004
I0617 10:26:25.773220 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004
I0617 10:26:25.804061 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880
I0617 10:26:25.808239 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880
I0617 10:26:25.821943 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880
I0617 10:26:25.835632 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848
I0617 10:26:25.839695 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848
I0617 10:26:25.851953 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848
I0617 10:26:26.599322 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:26.600321 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:27.614091 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:27.614291 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:27.615129 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:27.617740 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:27.645470 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:27.646380 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:28.752594 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:28.753440 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
E0617 10:26:29.680198 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
I0617 10:26:30.120302 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:30.121078 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:30.121707 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:30.123084 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:30.732659 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:30.732991 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:30.733919 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:30.734511 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:30.744101 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:30.744968 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:30.773204 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:30.774210 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:30.775421 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:30.776314 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:30.787717 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:30.788862 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:30.799773 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:30.800767 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:30.806618 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:30.807635 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:31.173672 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:31.174553 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:31.312237 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:31.313220 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:32.785320 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:32.786207 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:32.799101 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:32.800080 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:35.005246 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:35.007250 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:36.051004 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:26:36.052168 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
I0617 10:26:36.065991 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
E0617 10:26:38.387939 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
I0617 10:26:55.054061 1 loadbalancer.go:954] Dial legacy network between cloudcore-6d994c976f-nfpz2 - {tcp master 10.233.70.146:10000}
E0617 10:26:57.840160 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
I0617 10:27:10.579913 1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}
I0617 10:27:10.581435 1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}
in edge node 01:
I0617 10:26:24.021357 1 server.go:58] Version: v1.17.0-dirty
I0617 10:26:24.021432 1 server.go:94] [1] Prepare agent to run
I0617 10:26:24.022492 1 netif.go:96] bridge device edgemesh0 already exists
I0617 10:26:24.022603 1 server.go:98] edgemesh-agent running on EdgeMode
I0617 10:26:24.022620 1 server.go:101] [2] New clients
I0617 10:26:24.024116 1 server.go:108] [3] Register beehive modules
I0617 10:26:24.024941 1 module.go:52] Module EdgeDNS registered successfully
I0617 10:26:24.025367 1 server.go:68] Using userspace Proxier.
I0617 10:26:24.073602 1 module.go:52] Module EdgeProxy registered successfully
I0617 10:26:24.081434 1 util.go:273] Listening to docker0 is meaningless, skip it.
I0617 10:26:24.081516 1 util.go:273] Listening to edgemesh0 is meaningless, skip it.
I0617 10:26:24.081529 1 util.go:273] Listening to kube-ipvs0 is meaningless, skip it.
I0617 10:26:24.081618 1 module.go:128] Configure libp2p.ForceReachabilityPrivate()
I0617 10:26:24.098860 1 module.go:189] I'm {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.233/tcp/20006]}
I0617 10:26:24.098938 1 module.go:211] Bootstrapping the DHT
I0617 10:26:24.100225 1 tunnel.go:85] Starting MDNS discovery service
I0617 10:26:24.100253 1 tunnel.go:98] Starting DHT discovery service
I0617 10:26:24.100401 1 module.go:52] Module EdgeTunnel registered successfully
I0617 10:26:24.100434 1 adapter.go:53] the cloud CIDRs are [10.244.1.0/24 10.244.1.0/24], the edge CIDRs are [10.244.5.0/24 10.244.6.0/24]
I0617 10:26:24.100472 1 tunnel.go:496] Starting relay finder
I0617 10:26:24.160319 1 adapter.go:59] local CIDR is 10.233.65.0/24
I0617 10:26:24.161854 1 tun.go:66] create TunInterface edge_tun0 successfully
I0617 10:26:24.164917 1 tun.go:74] set dev edge_tun0 up successfully
I0617 10:26:24.164959 1 tun.go:96] Tun Interface Name: edge_tun0
I0617 10:26:24.165318 1 tunnel.go:210] Discovery service got a new stream from {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/192.168.137.195/tcp/20006]}
I0617 10:26:24.165558 1 tunnel.go:239] [MDNS] Discovery from master : {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/192.168.137.195/tcp/20006]}
I0617 10:26:24.166654 1 tun.go:114] set dev edge_tun0 up succeed
I0617 10:26:24.168938 1 tun.go:141] ip route add table main 10.244.5.0/24 dev edge_tun0 succeed
I0617 10:26:24.170655 1 tun.go:141] ip route add table main 10.244.6.0/24 dev edge_tun0 succeed
I0617 10:26:24.172305 1 tun.go:141] ip route add table main 10.244.1.0/24 dev edge_tun0 succeed
E0617 10:26:24.173916 1 tun.go:123] failed to execute Command ip route add 10.244.1.0/24 dev edge_tun0 , err: %!(EXTRA *exec.ExitError=exit status 2)
E0617 10:26:24.173965 1 adapter.go:160] failed to add route to TunDev, error: failed to exec 'ip route add 10.244.1.0/24 dev edge_tun0', error: exit status 2
E0617 10:26:24.175009 1 module.go:75] add route to table failed%!(EXTRA *errors.errorString=failed to insert iptable rule, error: error checking rule: exit status 2: Bad argument `1'
Try `iptables -h' or 'iptables --help' for more information.
)
I0617 10:26:24.175040 1 module.go:52] Module EdgeCNI registered successfully
I0617 10:26:24.175053 1 server.go:114] [4] Cache beehive modules
I0617 10:26:24.175094 1 server.go:121] [5] Start all modules
I0617 10:26:24.175210 1 core.go:46] starting module EdgeDNS
I0617 10:26:24.175264 1 core.go:46] starting module EdgeProxy
I0617 10:26:24.175314 1 core.go:46] starting module EdgeTunnel
I0617 10:26:24.175365 1 core.go:46] starting module EdgeCNI
I0617 10:26:24.175366 1 dns.go:37] Runs CoreDNS v1.8.0 as a local dns
I0617 10:26:24.175837 1 adapter.go:144] [CNI] Start Meshadapter
I0617 10:26:24.176049 1 config.go:317] "Starting service config controller"
I0617 10:26:24.176084 1 shared_informer.go:240] Waiting for caches to sync for service config
I0617 10:26:24.176118 1 config.go:135] "Starting endpoints config controller"
I0617 10:26:24.176129 1 shared_informer.go:240] Waiting for caches to sync for endpoints config
I0617 10:26:24.177435 1 loadbalancer.go:348] "Starting loadBalancer destinationRule controller"
I0617 10:26:24.177457 1 shared_informer.go:240] Waiting for caches to sync for loadBalancer destinationRule
I0617 10:26:24.177977 1 tunnel.go:712] not relay, skip metrics server!
I0617 10:26:24.178010 1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]}
I0617 10:26:24.178177 1 tunnel.go:161] [MDNS] New stream between peer {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]} success
E0617 10:26:24.178217 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
I0617 10:26:24.179412 1 tunnel.go:197] [MDNS] Discovery to master : {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]}
I0617 10:26:24.277133 1 shared_informer.go:247] Caches are synced for endpoints config
I0617 10:26:24.277150 1 shared_informer.go:247] Caches are synced for service config
.:53 on 169.254.96.16
I0617 10:26:24.277518 1 shared_informer.go:247] Caches are synced for loadBalancer destinationRule
I0617 10:26:24.277728 1 log.go:198] [INFO] plugin/reload: Running configuration MD5 = 4ba233d14e39c5d57b4b7aa950136711
I0617 10:26:24.291712 1 log.go:198] [INFO] 169.254.96.16:60393 - 44074 "HINFO IN 1693435269672312865.2136678649374743405. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.014065669s
I0617 10:26:24.324401 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849
I0617 10:26:24.327502 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849
I0617 10:26:24.330986 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849
I0617 10:26:24.360909 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880
I0617 10:26:24.364458 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880
I0617 10:26:24.367915 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880
I0617 10:26:24.417895 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848
I0617 10:26:24.421397 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848
I0617 10:26:24.424812 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848
I0617 10:26:24.434827 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000
I0617 10:26:24.438082 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000
I0617 10:26:24.441456 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000
I0617 10:26:24.461238 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001
I0617 10:26:24.464710 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001
I0617 10:26:24.468105 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001
I0617 10:26:24.478220 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002
I0617 10:26:24.481694 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002
I0617 10:26:24.485253 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002
I0617 10:26:24.495239 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003
I0617 10:26:24.498653 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003
I0617 10:26:24.502005 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003
I0617 10:26:24.536873 1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004
I0617 10:26:24.540463 1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004
I0617 10:26:24.543925 1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004
I0617 10:26:25.358720 1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]}
I0617 10:26:25.371815 1 tunnel.go:161] [MDNS] New stream between peer {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]} success
I0617 10:26:25.412857 1 tunnel.go:197] [MDNS] Discovery to master : {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]}
I0617 10:26:25.425210 1 tunnel.go:210] Discovery service got a new stream from {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/192.168.137.195/tcp/20006]}
I0617 10:26:25.425348 1 tunnel.go:239] [MDNS] Discovery from master : {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/192.168.137.195/tcp/20006]}
E0617 10:26:28.509315 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
E0617 10:26:36.957306 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
E0617 10:26:54.365297 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
E0617 10:27:27.133304 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
E0617 10:28:32.669320 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
E0617 10:30:39.645321 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
E0617 10:35:07.933317 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
I0617 10:40:12.415019 1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006]}
E0617 10:40:12.464768 1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:
* [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127
* [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
* [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
I0617 10:40:53.384170 1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006]}
E0617 10:40:53.417145 1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:
* [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78
* [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127
* [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73
* [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
* [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
I0617 10:43:09.481421 1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006]}
E0617 10:43:09.567542 1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:
* [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78
* [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73
* [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127
* [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: error reading handshake message: EOF
* [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: error reading handshake message: EOF
E0617 10:44:08.605316 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
I0617 10:45:54.449145 1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006]}
E0617 10:45:54.478894 1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:
* [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127
* [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78
* [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73
* [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
* [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
I0617 10:50:59.480129 1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006]}
E0617 10:50:59.555950 1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:
* [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73
* [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127
* [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78
* [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
* [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
I0617 10:56:01.357609 1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006]}
E0617 10:56:01.379468 1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:
* [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127
* [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73
* [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78
* [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
* [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
I0617 11:01:04.496078 1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006]}
E0617 11:01:04.579095 1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:
* [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73
* [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127
* [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78
* [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: error reading handshake message: read tcp4 192.168.137.233:20006->192.168.137.225:20006: read: connection reset by peer
* [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce
E0617 11:01:53.565326 1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)