ylhyh · March 25, 2019 11:59
diff --git a/kubelet.log b/kubelet.log
 Log file created at: 2019/03/25 19:34:43
 Running on machine: node009
 Binary: Built with gc go1.11.5 for windows/amd64
 Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
 I0325 19:34:42.924063    7528 server.go:407] Version: v1.13.3
 I0325 19:34:42.939056    7528 service.go:60] Running kubelet as a Windows service!
 I0325 19:34:42.939056    7528 plugins.go:103] No cloud provider specified.
 I0325 19:34:42.940057    7528 service.go:70] Service running
 I0325 19:34:42.945062    7528 certificate_store.go:130] Loading cert/key pair from "DE0325 19:35:59.164104    7528 docker_sandbox.go:697] ResolvConfPath is empty.
 28 server.go:730] Kubelet needs to run as uid `0`. It is being run as -1
 W0325 19:34:43.731177    7528 server.go:740] setting OOM scores is unsupported in this build
 E0325 19:34:43.730181    7528 perfcounter_nodestats.go:144] Unable to get cpu perf counter data; err: unable to collect data from counter. Error code is 800007d6
 I0325 19:34:43.731177    7528 kubelet.go:281] Adding pod path: D:/k8s/pods
 E0325 19:34:43.731177    7528 file_unsupported.go:29] Watching source file is unsupported in this build
 I0325 19:34:43.731177    7528 kubelet.go:306] Watching apiserver
 W0325 19:34:43.743177    7528 iptables.go:155] Error checkinW0325 19:34:53.937857    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:03.968485    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:14.000681    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:24.037713    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:34.068706    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:44.099532    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:54.138908    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 E0325 19:35:59.164104    7528 docker_sandbox.go:697] ResolvConfPath is empty.
 W0325 19:35:59.171095    7528 pod_container_deletor.go:75] Container "c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf" not found in pod's containers
 W0325 19:36:09.775291    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:36:21.799445    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:36:33.814480    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:36:45.830565    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:36:57.849316    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:37:09.868007    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:37:21.881324    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:37:33.897118    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:37:45.917084    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:37:57.934663    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:38:09.949545    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:38:21.968481    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 piVersion: 1.39.0
 I0325 19:34:43.823172    7528 server.go:999] Started kubelet
 I0325 19:34:43.824174    7528 server.go:137] Starting to listen on 0.0.0.0:10250
 I0325 19:34:43.824174    7528 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
 I0325 19:34:43.824174    7528 status_manager.go:152] Starting to sync pod status with apiserver
 I0325 19:34:43.824174    7528 kubelet.go:1829] Starting kubelet main sync loop.
 I0325 19:34:43.824174    7528 kubelet.go:1846] skipping pod synchronization - [container runtime status check may not have completed yet PLEG is not healthy: pleg has yet to be successful]
 I0325 19:34:43.825176    7528 volume_manager.go:248] Starting Kubelet Volume Manager
 I0325 19:34:43.825176    7528 server.go:333] Adding debug handlers to kubelet server.
 I0325 19:34:43.825176    7528 desired_state_of_world_populator.go:130] Desired state populator starts to run
 W0325 19:34:43.906170    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 I0325 19:34:43.926161    7528 kuberuntime_manager.go:915] updating runtime config through cri with podcidr 10.112.11.0/24
 I0325 19:34:43.926161    7528 kubelet_node_status.go:278] Setting node annotation to enable volume controller attach/detach
 I0325 19:34:43.926161    7528 docker_service.go:345] docker cri received runtime config &RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:10.112.11.0/24,},}
 I0325 19:34:43.927189    7528 kubelet_network.go:77] Setting Pod CIDR:  -> 10.112.11.0/24
 I0325 19:34:43.934172    7528 kubelet_node_status.go:72] Attempting to register node node009
 I0325 19:34:43.997169    7528 kubelet_node_status.go:114] Node node009 was previously registered
 I0325 19:34:43.997169    7528 kubelet_node_status.go:75] Successfully registered node node009
 I0325 19:34:44.027171    7528 reconciler.go:154] Reconciler: start to sync state
 W0325 19:34:53.937857    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:03.968485    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:14.000681    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:24.037713    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:34.068706    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:44.099532    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:35:54.138908    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 I0325 19:35:56.572986    7528 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-r2xc8" (UniqueName: "kubernetes.io/secret/764d7d35-4ef2-11e9-8194-001dd8b71c07-default-token-r2xc8") pod "rtx-service-6cbd744ddf-vf26b" (UID: "764d7d35-4ef2-11e9-8194-001dd8b71c07") 
 E0325 19:35:59.164104    7528 docker_sandbox.go:697] ResolvConfPath is empty.
 W0325 19:35:59.171095    7528 pod_container_deletor.go:75] Container "c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf" not found in pod's containers
 I0325 19:36:03.326040    7528 fake_cpu_manager.go:40] [fake cpumanager] AddContainer (pod: rtx-service-6cbd744ddf-vf26b, container: rtx-service, container id: fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab)
 W0325 19:36:09.775291    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:36:21.799445    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:36:33.814480    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:36:45.830565    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:36:57.849316    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:37:09.868007    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:37:21.881324    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:37:33.897118    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:37:45.917084    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:37:57.934663    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:38:09.949545    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
 W0325 19:38:21.968481    7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
diff --git a/ovn-kubernetes.log b/ovn-kubernetes.log
 time="2019-03-25T19:34:39+08:00" level=info msg="Parsed config file D:/k8s/ovn_k8s.conf"
 time="2019-03-25T19:34:39+08:00" level=info msg="Parsed config: {Default:{MTU:1400 ConntrackZone:64000 EncapType: EncapIP: InactivityProbe:100000} Logging:{File:D:/k8s/log/ovn-kubernetes.log Level:4} CNI:{ConfDir:D:/k8s/cni/net.d Plugin:ovn-k8s-cni-overlay.exe WinHNSNetworkID:} Kubernetes:{Kubeconfig: CACert:D:/k8s/pki/ca.crt APIServer:https://apiserver.q1lan.k8s:6443 Token:eyJhb...AUg} OvnNorth:{Address:tcp://172.16.126.237:6641 ClientPrivKey: ClientCert: ClientCACert: ServerPrivKey: ServerCert: ServerCACert:} OvnSouth:{Address:tcp://172.16.126.237:6642 ClientPrivKey: ClientCert: ClientCACert: ServerPrivKey: ServerCert: ServerCACert:}}"
 time="2019-03-25T19:34:40+08:00" level=info msg="Node node009 ready for ovn initialization with subnet 10.112.11.0/24"
 time="2019-03-25T19:34:59+08:00" level=info msg="CNI server started"
 time="2019-03-25T19:35:59+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
 time="2019-03-25T19:35:59+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc0006b5040 0xc00061e3c0}"
 time="2019-03-25T19:35:59+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
 time="2019-03-25T19:35:59+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" does not exist"
 time="2019-03-25T19:35:59+08:00" level=info msg="Creating HNS endpoint"
 time="2019-03-25T19:35:59+08:00" level=info msg="hnsConfigBytes: {\"Name\":\"default_rtx-service-6cbd744ddf-vf26b\",\"VirtualNetwork\":\"c3bdff7e-bd77-436b-91ce-557f28940b11\",\"MacAddress\":\"0a-00-00-00-01-74\",\"IPAddress\":\"10.112.11.3\",\"PrefixLength\":24}"
 time="2019-03-25T19:35:59+08:00" level=info msg="Created HNS endpoint with ID: 31778de6-aece-461c-ad74-5a1e2389cd46"
 time="2019-03-25T19:35:59+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf"
 time="2019-03-25T19:36:00+08:00" level=info msg="Endpoint attached successfully to the container"
 time="2019-03-25T19:36:02+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc0006b5040 0xc00061e3c0}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
 time="2019-03-25T19:36:03+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
 time="2019-03-25T19:36:03+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc00029aaa0 0xc0000608a0}"
 time="2019-03-25T19:36:03+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
 time="2019-03-25T19:36:03+08:00" level=info msg="HNS endpoint already exists with name: \"default_rtx-service-6cbd744ddf-vf26b\""
 time="2019-03-25T19:36:03+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf"
 time="2019-03-25T19:36:03+08:00" level=info msg="Endpoint attached successfully to the container"
 time="2019-03-25T19:36:03+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" already set up for container \"c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf\""
 time="2019-03-25T19:36:03+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc00029aaa0 0xc0000608a0}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
 time="2019-03-25T19:36:08+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
 time="2019-03-25T19:36:08+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab container:c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf eth0 0xc000132640 0xc00061e540}"
 time="2019-03-25T19:36:08+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
 time="2019-03-25T19:36:08+08:00" level=info msg="HNS endpoint already exists with name: \"default_rtx-service-6cbd744ddf-vf26b\""
 time="2019-03-25T19:36:08+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab"
 time="2019-03-25T19:36:08+08:00" level=info msg="Endpoint attached successfully to the container"
 time="2019-03-25T19:36:08+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" already set up for container \"fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab\""
 time="2019-03-25T19:36:08+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab container:c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf eth0 0xc000132640 0xc00061e540}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
 time="2019-03-25T19:36:08+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
 time="2019-03-25T19:36:08+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc000064d20 0xc0001586c0}"
 time="2019-03-25T19:36:08+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
 time="2019-03-25T19:36:08+08:00" level=info msg="HNS endpoint already exists with name: \"default_rtx-service-6cbd744ddf-vf26b\""
 time="2019-03-25T19:36:08+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf"
 time="2019-03-25T19:36:08+08:00" level=info msg="Endpoint attached successfully to the container"
 time="2019-03-25T19:36:08+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" already set up for container \"c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf\""
 time="2019-03-25T19:36:08+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc000064d20 0xc0001586c0}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
 time="2019-03-25T19:36:09+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
 time="2019-03-25T19:36:09+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab container:c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf eth0 0xc00037f180 0xc0001b5aa0}"
 time="2019-03-25T19:36:09+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
 time="2019-03-25T19:36:09+08:00" level=info msg="HNS endpoint already exists with name: \"default_rtx-service-6cbd744ddf-vf26b\""
 time="2019-03-25T19:36:09+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab"
 time="2019-03-25T19:36:09+08:00" level=info msg="Endpoint attached successfully to the container"
 time="2019-03-25T19:36:09+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" already set up for container \"fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab\""
 time="2019-03-25T19:36:09+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab container:c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf eth0 0xc00037f180 0xc0001b5aa0}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
 time="2019-03-25T19:36:10+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
 time="2019-03-25T19:36:10+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc00030cc80 0xc00068e660}"
 time="2019-03-25T19:36:10+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
 time="2019-03-25T19:36:10+08:00" level=info msg="HNS endpoint already exists with name: \"default_rtx-service-6cbd744ddf-vf26b\""
 time="2019-03-25T19:36:10+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf"
 time="2019-03-25T19:36:10+08:00" level=info msg="Endpoint attached successfully to the container"
 time="2019-03-25T19:36:10+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" already set up for container \"c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf\""
 time="2019-03-25T19:36:10+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc00030cc80 0xc00068e660}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
	Log file created at: 2019/03/25 19:34:43
	Running on machine: node009
	Binary: Built with gc go1.11.5 for windows/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0325 19:34:42.924063 7528 server.go:407] Version: v1.13.3
	I0325 19:34:42.939056 7528 service.go:60] Running kubelet as a Windows service!
	I0325 19:34:42.939056 7528 plugins.go:103] No cloud provider specified.
	I0325 19:34:42.940057 7528 service.go:70] Service running
	I0325 19:34:42.945062 7528 certificate_store.go:130] Loading cert/key pair from "DE0325 19:35:59.164104 7528 docker_sandbox.go:697] ResolvConfPath is empty.
	28 server.go:730] Kubelet needs to run as uid `0`. It is being run as -1
	W0325 19:34:43.731177 7528 server.go:740] setting OOM scores is unsupported in this build
	E0325 19:34:43.730181 7528 perfcounter_nodestats.go:144] Unable to get cpu perf counter data; err: unable to collect data from counter. Error code is 800007d6
	I0325 19:34:43.731177 7528 kubelet.go:281] Adding pod path: D:/k8s/pods
	E0325 19:34:43.731177 7528 file_unsupported.go:29] Watching source file is unsupported in this build
	I0325 19:34:43.731177 7528 kubelet.go:306] Watching apiserver
	W0325 19:34:43.743177 7528 iptables.go:155] Error checkinW0325 19:34:53.937857 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:03.968485 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:14.000681 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:24.037713 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:34.068706 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:44.099532 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:54.138908 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	E0325 19:35:59.164104 7528 docker_sandbox.go:697] ResolvConfPath is empty.
	W0325 19:35:59.171095 7528 pod_container_deletor.go:75] Container "c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf" not found in pod's containers
	W0325 19:36:09.775291 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:36:21.799445 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:36:33.814480 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:36:45.830565 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:36:57.849316 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:37:09.868007 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:37:21.881324 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:37:33.897118 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:37:45.917084 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:37:57.934663 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:38:09.949545 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:38:21.968481 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	piVersion: 1.39.0
	I0325 19:34:43.823172 7528 server.go:999] Started kubelet
	I0325 19:34:43.824174 7528 server.go:137] Starting to listen on 0.0.0.0:10250
	I0325 19:34:43.824174 7528 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
	I0325 19:34:43.824174 7528 status_manager.go:152] Starting to sync pod status with apiserver
	I0325 19:34:43.824174 7528 kubelet.go:1829] Starting kubelet main sync loop.
	I0325 19:34:43.824174 7528 kubelet.go:1846] skipping pod synchronization - [container runtime status check may not have completed yet PLEG is not healthy: pleg has yet to be successful]
	I0325 19:34:43.825176 7528 volume_manager.go:248] Starting Kubelet Volume Manager
	I0325 19:34:43.825176 7528 server.go:333] Adding debug handlers to kubelet server.
	I0325 19:34:43.825176 7528 desired_state_of_world_populator.go:130] Desired state populator starts to run
	W0325 19:34:43.906170 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	I0325 19:34:43.926161 7528 kuberuntime_manager.go:915] updating runtime config through cri with podcidr 10.112.11.0/24
	I0325 19:34:43.926161 7528 kubelet_node_status.go:278] Setting node annotation to enable volume controller attach/detach
	I0325 19:34:43.926161 7528 docker_service.go:345] docker cri received runtime config &RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:10.112.11.0/24,},}
	I0325 19:34:43.927189 7528 kubelet_network.go:77] Setting Pod CIDR: -> 10.112.11.0/24
	I0325 19:34:43.934172 7528 kubelet_node_status.go:72] Attempting to register node node009
	I0325 19:34:43.997169 7528 kubelet_node_status.go:114] Node node009 was previously registered
	I0325 19:34:43.997169 7528 kubelet_node_status.go:75] Successfully registered node node009
	I0325 19:34:44.027171 7528 reconciler.go:154] Reconciler: start to sync state
	W0325 19:34:53.937857 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:03.968485 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:14.000681 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:24.037713 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:34.068706 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:44.099532 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:35:54.138908 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	I0325 19:35:56.572986 7528 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-r2xc8" (UniqueName: "kubernetes.io/secret/764d7d35-4ef2-11e9-8194-001dd8b71c07-default-token-r2xc8") pod "rtx-service-6cbd744ddf-vf26b" (UID: "764d7d35-4ef2-11e9-8194-001dd8b71c07")
	E0325 19:35:59.164104 7528 docker_sandbox.go:697] ResolvConfPath is empty.
	W0325 19:35:59.171095 7528 pod_container_deletor.go:75] Container "c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf" not found in pod's containers
	I0325 19:36:03.326040 7528 fake_cpu_manager.go:40] [fake cpumanager] AddContainer (pod: rtx-service-6cbd744ddf-vf26b, container: rtx-service, container id: fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab)
	W0325 19:36:09.775291 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:36:21.799445 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:36:33.814480 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:36:45.830565 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:36:57.849316 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:37:09.868007 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:37:21.881324 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:37:33.897118 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:37:45.917084 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:37:57.934663 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:38:09.949545 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	W0325 19:38:21.968481 7528 helpers.go:808] eviction manager: no observation found for eviction signal nodefs.inodesFree
	time="2019-03-25T19:34:39+08:00" level=info msg="Parsed config file D:/k8s/ovn_k8s.conf"
	time="2019-03-25T19:34:39+08:00" level=info msg="Parsed config: {Default:{MTU:1400 ConntrackZone:64000 EncapType: EncapIP: InactivityProbe:100000} Logging:{File:D:/k8s/log/ovn-kubernetes.log Level:4} CNI:{ConfDir:D:/k8s/cni/net.d Plugin:ovn-k8s-cni-overlay.exe WinHNSNetworkID:} Kubernetes:{Kubeconfig: CACert:D:/k8s/pki/ca.crt APIServer:https://apiserver.q1lan.k8s:6443 Token:eyJhb...AUg} OvnNorth:{Address:tcp://172.16.126.237:6641 ClientPrivKey: ClientCert: ClientCACert: ServerPrivKey: ServerCert: ServerCACert:} OvnSouth:{Address:tcp://172.16.126.237:6642 ClientPrivKey: ClientCert: ClientCACert: ServerPrivKey: ServerCert: ServerCACert:}}"
	time="2019-03-25T19:34:40+08:00" level=info msg="Node node009 ready for ovn initialization with subnet 10.112.11.0/24"
	time="2019-03-25T19:34:59+08:00" level=info msg="CNI server started"
	time="2019-03-25T19:35:59+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
	time="2019-03-25T19:35:59+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc0006b5040 0xc00061e3c0}"
	time="2019-03-25T19:35:59+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
	time="2019-03-25T19:35:59+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" does not exist"
	time="2019-03-25T19:35:59+08:00" level=info msg="Creating HNS endpoint"
	time="2019-03-25T19:35:59+08:00" level=info msg="hnsConfigBytes: {\"Name\":\"default_rtx-service-6cbd744ddf-vf26b\",\"VirtualNetwork\":\"c3bdff7e-bd77-436b-91ce-557f28940b11\",\"MacAddress\":\"0a-00-00-00-01-74\",\"IPAddress\":\"10.112.11.3\",\"PrefixLength\":24}"
	time="2019-03-25T19:35:59+08:00" level=info msg="Created HNS endpoint with ID: 31778de6-aece-461c-ad74-5a1e2389cd46"
	time="2019-03-25T19:35:59+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf"
	time="2019-03-25T19:36:00+08:00" level=info msg="Endpoint attached successfully to the container"
	time="2019-03-25T19:36:02+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc0006b5040 0xc00061e3c0}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
	time="2019-03-25T19:36:03+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
	time="2019-03-25T19:36:03+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc00029aaa0 0xc0000608a0}"
	time="2019-03-25T19:36:03+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
	time="2019-03-25T19:36:03+08:00" level=info msg="HNS endpoint already exists with name: \"default_rtx-service-6cbd744ddf-vf26b\""
	time="2019-03-25T19:36:03+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf"
	time="2019-03-25T19:36:03+08:00" level=info msg="Endpoint attached successfully to the container"
	time="2019-03-25T19:36:03+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" already set up for container \"c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf\""
	time="2019-03-25T19:36:03+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc00029aaa0 0xc0000608a0}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
	time="2019-03-25T19:36:08+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
	time="2019-03-25T19:36:08+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab container:c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf eth0 0xc000132640 0xc00061e540}"
	time="2019-03-25T19:36:08+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
	time="2019-03-25T19:36:08+08:00" level=info msg="HNS endpoint already exists with name: \"default_rtx-service-6cbd744ddf-vf26b\""
	time="2019-03-25T19:36:08+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab"
	time="2019-03-25T19:36:08+08:00" level=info msg="Endpoint attached successfully to the container"
	time="2019-03-25T19:36:08+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" already set up for container \"fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab\""
	time="2019-03-25T19:36:08+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab container:c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf eth0 0xc000132640 0xc00061e540}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
	time="2019-03-25T19:36:08+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
	time="2019-03-25T19:36:08+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc000064d20 0xc0001586c0}"
	time="2019-03-25T19:36:08+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
	time="2019-03-25T19:36:08+08:00" level=info msg="HNS endpoint already exists with name: \"default_rtx-service-6cbd744ddf-vf26b\""
	time="2019-03-25T19:36:08+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf"
	time="2019-03-25T19:36:08+08:00" level=info msg="Endpoint attached successfully to the container"
	time="2019-03-25T19:36:08+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" already set up for container \"c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf\""
	time="2019-03-25T19:36:08+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc000064d20 0xc0001586c0}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
	time="2019-03-25T19:36:09+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
	time="2019-03-25T19:36:09+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab container:c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf eth0 0xc00037f180 0xc0001b5aa0}"
	time="2019-03-25T19:36:09+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
	time="2019-03-25T19:36:09+08:00" level=info msg="HNS endpoint already exists with name: \"default_rtx-service-6cbd744ddf-vf26b\""
	time="2019-03-25T19:36:09+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab"
	time="2019-03-25T19:36:09+08:00" level=info msg="Endpoint attached successfully to the container"
	time="2019-03-25T19:36:09+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" already set up for container \"fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab\""
	time="2019-03-25T19:36:09+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b fedb9b2a3268763da40d254221afe8055fa7b4fd66dadcaf991b3de1afe9fcab container:c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf eth0 0xc00037f180 0xc0001b5aa0}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"
	time="2019-03-25T19:36:10+08:00" level=info msg="Waiting for ADD result for pod default/rtx-service-6cbd744ddf-vf26b"
	time="2019-03-25T19:36:10+08:00" level=info msg="Dispatching pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc00030cc80 0xc00068e660}"
	time="2019-03-25T19:36:10+08:00" level=info msg="HNS Network Id found: c3bdff7e-bd77-436b-91ce-557f28940b11"
	time="2019-03-25T19:36:10+08:00" level=info msg="HNS endpoint already exists with name: \"default_rtx-service-6cbd744ddf-vf26b\""
	time="2019-03-25T19:36:10+08:00" level=info msg="Attaching endpoint 31778de6-aece-461c-ad74-5a1e2389cd46 to container c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf"
	time="2019-03-25T19:36:10+08:00" level=info msg="Endpoint attached successfully to the container"
	time="2019-03-25T19:36:10+08:00" level=info msg="HNS endpoint \"default_rtx-service-6cbd744ddf-vf26b\" already set up for container \"c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf\""
	time="2019-03-25T19:36:10+08:00" level=info msg="Returning pod network request &{ADD default rtx-service-6cbd744ddf-vf26b c5151625e0a9e41b6bfbdcf6bb45d7e40be10304caab9d02318318768dc78cdf none eth0 0xc00030cc80 0xc00068e660}, result {\"ips\":[{\"version\":\"4\",\"interface\":1,\"address\":\"10.112.11.3/24\",\"gateway\":\"10.112.11.1\"}],\"dns\":{}} err <nil>"