ALT Orchestra

Тема

Добавление Controlplane узла ​

Создать 2 виртуальные машины Controlplane:

  • Controlplane (2 машины)
    • Name: issue198229-alimektor-alt-orchestra-NEW-CONTROLPLANE--NO-IP
    • vCPU: 4 (2/2) with host
    • RAM: 8 Gb (8192)
    • SSD: 15 Gb
    • BIOS: OVMF (UEFI)
    • Network 1: Internal Network (VLAN)
      • IP for Machine #1: 192.168.1.7
      • IP for Machine #2: 192.168.1.8

Обновить конфигурацию orchestra_controlplane.yaml:

console
# REPO=p11 && \
DEVICE="/dev/sda" && \
INSTALLERIMAGE="altlinux.space/alt-orchestra/installer:v11.0"  && \
KUBELET_VERSION="v1.33.3"
console
$ cat > new_controlplane.patch << PATCH
    .machine.install.disk="$DEVICE" |
    .machine.kubelet.image|="$KUBELETIMAGE" |
    .machine.install.image|="$INSTALLERIMAGE"
PATCH

Создать обновлённую конфигурацию для ALT Orchestra:

console
$ cat orchestra_controlplane.yaml | yq -y "$(cat new_controlplane.patch)" > new_orchestra_controlplane.yaml

Добавить узлы в кластер:

console
$ talosctl apply-config --insecure --nodes 192.168.1.7 --file new_orchestra_controlplane.yaml
$ talosctl apply-config --insecure --nodes 192.168.1.8 --file new_orchestra_controlplane.yaml

Убедиться, что добавленные узлы в статусе Ready:

console
$ kubectl get nodes

Все узлы в статусе Ready:

text
NAME                    STATUS   ROLES           AGE   VERSION
alt-orchestra-3xh-ru8   Ready    <none>          58m   v1.33.3
alt-orchestra-7hd-h2s   Ready    control-plane   36m   v1.33.3
alt-orchestra-jtl-hnk   Ready    control-plane   37m   v1.33.3
alt-orchestra-p31-6dg   Ready    control-plane   58m   v1.33.3
alt-orchestra-v6d-bmi   Ready    control-plane   58m   v1.33.3
alt-orchestra-xwg-xyk   Ready    <none>          58m   v1.33.3
alt-orchestra-yuq-xes   Ready    control-plane   58m   v1.33.3

Выполнить healhcheck для всех узлов Controlplane:

console
$ talosctl health -n 192.168.1.2
$ talosctl health -n 192.168.1.3
$ talosctl health -n 192.168.1.4
$ talosctl health -n 192.168.1.7
$ talosctl health -n 192.168.1.8

Healthcheck выполнен успешно:

text
discovered nodes: ["192.168.1.8" "192.168.1.7" "192.168.1.3" "192.168.1.2" "192.168.1.4" "192.168.1.5" "192.168.1.6"]
waiting for etcd to be healthy: ...
waiting for etcd to be healthy: OK
waiting for etcd members to be consistent across nodes: ...
waiting for etcd members to be consistent across nodes: OK
waiting for etcd members to be control plane nodes: ...
waiting for etcd members to be control plane nodes: OK
waiting for apid to be ready: ...
waiting for apid to be ready: OK
waiting for all nodes memory sizes: ...
waiting for all nodes memory sizes: OK
waiting for all nodes disk sizes: ...
waiting for all nodes disk sizes: OK
waiting for no diagnostics: ...
waiting for no diagnostics: OK
waiting for kubelet to be healthy: ...
waiting for kubelet to be healthy: OK
waiting for all nodes to finish boot sequence: ...
waiting for all nodes to finish boot sequence: OK
waiting for all k8s nodes to report: ...
waiting for all k8s nodes to report: OK
waiting for all control plane static pods to be running: ...
waiting for all control plane static pods to be running: OK
waiting for all control plane components to be ready: ...
waiting for all control plane components to be ready: OK
waiting for all k8s nodes to report ready: ...
waiting for all k8s nodes to report ready: OK
waiting for coredns to report ready: ...
waiting for coredns to report ready: OK
waiting for all k8s nodes to report schedulable: ...
waiting for all k8s nodes to report schedulable: OK

Получить информацию о членах кластера Talos:

console
$ talosctl get members -n 192.168.1.2 -e 192.168.1.2
$ talosctl get members -n 192.168.1.3 -e 192.168.1.3
$ talosctl get members -n 192.168.1.4 -e 192.168.1.4
$ talosctl get members -n 192.168.1.5 -e 192.168.1.5
$ talosctl get members -n 192.168.1.6 -e 192.168.1.6
$ talosctl get members -n 192.168.1.7 -e 192.168.1.7
$ talosctl get members -n 192.168.1.8 -e 192.168.1.8

Присутствуют все узлы кластера:

text
NODE          NAMESPACE   TYPE     ID                      VERSION   HOSTNAME                MACHINE TYPE   OS                        ADDRESSES
192.168.1.2   cluster     Member   alt-orchestra-3xh-ru8   1         alt-orchestra-3xh-ru8   worker         ALT Orchestra (v11.0)   ["192.168.1.5"]
192.168.1.2   cluster     Member   alt-orchestra-7hd-h2s   1         alt-orchestra-7hd-h2s   controlplane   ALT Orchestra (v11.0)   ["192.168.1.8"]
192.168.1.2   cluster     Member   alt-orchestra-jtl-hnk   1         alt-orchestra-jtl-hnk   controlplane   ALT Orchestra (v11.0)   ["192.168.1.7"]
192.168.1.2   cluster     Member   alt-orchestra-p31-6dg   1         alt-orchestra-p31-6dg   controlplane   ALT Orchestra (v11.0)   ["192.168.1.3"]
192.168.1.2   cluster     Member   alt-orchestra-v6d-bmi   1         alt-orchestra-v6d-bmi   controlplane   ALT Orchestra (v11.0)   ["192.168.1.2"]
192.168.1.2   cluster     Member   alt-orchestra-xwg-xyk   1         alt-orchestra-xwg-xyk   worker         ALT Orchestra (v11.0)   ["192.168.1.6"]
192.168.1.2   cluster     Member   alt-orchestra-yuq-xes   1         alt-orchestra-yuq-xes   controlplane   ALT Orchestra (v11.0)   ["192.168.1.4"]

Вывести список всех ресурсов во всех пространствах имён кластера Kubernetes:

console
$ kubectl get all -A

Все поды в состоянии Running (могут присутствовать Completed / ContainerStatusUnknown для cilium-operator):

text
NAMESPACE     NAME                                                READY   STATUS                   RESTARTS        AGE
default       pod/nginx-5557d9f6b4-dfmpc                          1/1     Running                  0               18h
default       pod/nginx-5557d9f6b4-mdz29                          0/1     Completed                0               21h
default       pod/postgres-operator-849bdbdbd8-q9ttp              1/1     Running                  0               18h
kube-system   pod/cilium-64fwj                                    1/1     Running                  0               18h
kube-system   pod/cilium-envoy-4vb9r                              1/1     Running                  0               101s
kube-system   pod/cilium-envoy-898dw                              1/1     Running                  0               18h
kube-system   pod/cilium-envoy-c8knj                              1/1     Running                  0               18h
kube-system   pod/cilium-envoy-fr7cf                              1/1     Running                  1 (18h ago)     21h
kube-system   pod/cilium-envoy-fz9r2                              1/1     Running                  0               18h
kube-system   pod/cilium-envoy-gdwzh                              1/1     Running                  0               28m
kube-system   pod/cilium-envoy-hfd2l                              1/1     Running                  0               18h
kube-system   pod/cilium-envoy-xsqq9                              1/1     Running                  0               18h
kube-system   pod/cilium-k5p7l                                    1/1     Running                  0               28m
kube-system   pod/cilium-m4qlk                                    1/1     Running                  0               101s
kube-system   pod/cilium-mwm76                                    1/1     Running                  0               18h
kube-system   pod/cilium-n7ljb                                    1/1     Running                  0               18h
kube-system   pod/cilium-operator-67f4b4f5fd-297rd                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-69v9t                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-9t2h4                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-b7q8n                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-czhmb                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-dqgvl                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-dtfql                0/1     Completed                0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-f2hkh                1/1     Running                  3 (144m ago)    18h
kube-system   pod/cilium-operator-67f4b4f5fd-fwczt                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-h7c44                1/1     Running                  1 (3h3m ago)    18h
kube-system   pod/cilium-operator-67f4b4f5fd-j52jt                0/1     Completed                1               21h
kube-system   pod/cilium-operator-67f4b4f5fd-j6cn7                0/1     Completed                0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-kd9gj                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-lk77m                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-lpv5m                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-mhllb                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-mnkbm                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-njzjm                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-qk5mx                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-rxqmw                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-ssmn4                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-operator-67f4b4f5fd-zk8x7                0/1     ContainerStatusUnknown   0               22h
kube-system   pod/cilium-qhqxp                                    1/1     Running                  0               18h
kube-system   pod/cilium-t8vkf                                    1/1     Running                  0               18h
kube-system   pod/cilium-tcpbn                                    1/1     Running                  0               18h
kube-system   pod/coredns-5966c6bdcd-5h78q                        1/1     Running                  2 (18h ago)     22h
kube-system   pod/coredns-5966c6bdcd-l7fxt                        1/1     Running                  2 (18h ago)     22h
kube-system   pod/kube-apiserver-alt-orchestra-7qy-gfl            1/1     Running                  0               18h
kube-system   pod/kube-apiserver-alt-orchestra-aof-0ft            1/1     Running                  0               18h
kube-system   pod/kube-apiserver-alt-orchestra-c2l-dze            1/1     Running                  0               18h
kube-system   pod/kube-apiserver-alt-orchestra-h5e-87r            1/1     Running                  0               18h
kube-system   pod/kube-apiserver-alt-orchestra-kga-8vb            1/1     Running                  0               18h
kube-system   pod/kube-apiserver-alt-orchestra-v9c-q75            1/1     Running                  0               65s
kube-system   pod/kube-controller-manager-alt-orchestra-7qy-gfl   1/1     Running                  1 (5h40m ago)   18h
kube-system   pod/kube-controller-manager-alt-orchestra-aof-0ft   1/1     Running                  0               18h
kube-system   pod/kube-controller-manager-alt-orchestra-c2l-dze   1/1     Running                  0               18h
kube-system   pod/kube-controller-manager-alt-orchestra-h5e-87r   1/1     Running                  1 (3h3m ago)    18h
kube-system   pod/kube-controller-manager-alt-orchestra-kga-8vb   1/1     Running                  1 (5h27m ago)   18h
kube-system   pod/kube-controller-manager-alt-orchestra-v9c-q75   1/1     Running                  0               65s
kube-system   pod/kube-scheduler-alt-orchestra-7qy-gfl            1/1     Running                  1 (16h ago)     18h
kube-system   pod/kube-scheduler-alt-orchestra-aof-0ft            1/1     Running                  1 (3h3m ago)    18h
kube-system   pod/kube-scheduler-alt-orchestra-c2l-dze            1/1     Running                  2 (148m ago)    18h
kube-system   pod/kube-scheduler-alt-orchestra-h5e-87r            1/1     Running                  0               18h
kube-system   pod/kube-scheduler-alt-orchestra-kga-8vb            1/1     Running                  1 (5h40m ago)   18h
kube-system   pod/kube-scheduler-alt-orchestra-v9c-q75            1/1     Running                  0               65s

NAMESPACE     NAME                        TYPE        CLUSTER-IP      EXTERNAL-IP   PORT(S)                  AGE
default       service/kubernetes          ClusterIP   10.96.0.1       <none>        443/TCP                  22h
default       service/nginx               ClusterIP   10.111.250.10   <none>        80/TCP                   21h
default       service/postgres-operator   ClusterIP   10.96.67.158    <none>        8080/TCP                 21h
kube-system   service/cilium-envoy        ClusterIP   None            <none>        9964/TCP                 22h
kube-system   service/hubble-peer         ClusterIP   10.98.164.175   <none>        443/TCP                  22h
kube-system   service/kube-dns            ClusterIP   10.96.0.10      <none>        53/UDP,53/TCP,9153/TCP   22h

NAMESPACE     NAME                          DESIRED   CURRENT   READY   UP-TO-DATE   AVAILABLE   NODE SELECTOR            AGE
kube-system   daemonset.apps/cilium         8         8         8       8            8           kubernetes.io/os=linux   22h
kube-system   daemonset.apps/cilium-envoy   8         8         8       8            8           kubernetes.io/os=linux   22h

NAMESPACE     NAME                                READY   UP-TO-DATE   AVAILABLE   AGE
default       deployment.apps/nginx               1/1     1            1           21h
default       deployment.apps/postgres-operator   1/1     1            1           21h
kube-system   deployment.apps/cilium-operator     2/2     2            2           22h
kube-system   deployment.apps/coredns             2/2     2            2           22h

NAMESPACE     NAME                                           DESIRED   CURRENT   READY   AGE
default       replicaset.apps/nginx-5557d9f6b4               1         1         1       21h
default       replicaset.apps/postgres-operator-849bdbdbd8   1         1         1       21h
kube-system   replicaset.apps/cilium-operator-67f4b4f5fd     2         2         2       22h
kube-system   replicaset.apps/coredns-5966c6bdcd             2         2         2       22h

Опубликовано под лицензией GPL-3.0+. Содержание доступно по лицензии CC BY-SA 4.0, если не указано иное. Разработано участниками ALT Orchestra.