# K8S


## K8S部署


## 先创建一个debian模板

![](/media/22/223ca34634a99fb430454d33973efc59ca457d522dad5e8d721f648c8c5dd611.png#vwid=1523&vhei=929)


选择iso
![](/media/5f/5fdb8ba2a15e433abadbfd312c016ea7897cbc864d6c5e830f53ed0da2354291.png#vwid=1526&vhei=889)

快速安装一下即可：

![](/media/56/56a88985ec179f3f9cdb6602f27e96d8f9d49ddc381b1ebfde5177517cf26e10.png#vwid=1573&vhei=925)


安装完成克隆成模板：

![](/media/c0/c00db74e6e1404de5b3aec77f9c1c151397f616584020567424894fa724f0adc.png#vwid=1446&vhei=1075)



## Master节点


直接克隆一个就可以

![](/media/0b/0b080f1eedac782638c969dd5feb796c8cc5e0b721f81e9895e0eade1c7a7ec9.png#vwid=1572&vhei=786)



![](/media/9b/9b962342de4ade3aa26e1b9b48d2c7ec2cffa5e500d98152d1c358d78918f1b6.png#vwid=1137&vhei=659)


## 克隆两个本地node

![](/media/d3/d35112a64a196129f2f07232884e1e775f9529e0bc44f5d6ab08ed03d6090a75.png#vwid=1450&vhei=799)



![](/media/31/31a99e6e3233310f156bf0f5fb199c30ad5be762b2733f6355d31c5db8847230.png#vwid=760&vhei=452)


```bash
sed -i 's/deb.debian.org/mirrors.ustc.edu.cn/g' /etc/apt/sources.list.d/debian.sources
sed -i 's|security.debian.org/debian-security|mirrors.ustc.edu.cn/debian-security|g' /etc/apt/sources.list
echo "export PATH=$PATH:/usr/sbin:/home/$(whoami)/.local/bin" >> ~/.bashrc
source ~/.bashrc
apt install ufw

apt install sudo vim wget curl -y

sudo hostnamectl set-hostname dayi-cloud-k8s-master

```

这里HOSTS用了tailscile 来进行相互访问
```bash
curl -fsSL https://tailscale.com/install.sh | sh
```


![](/media/ff/fff499b0aece27d8fdee7587c53303cda09c6f35891af0549367110c9a7d04cf.png#vwid=1005&vhei=658)


![](/media/6e/6e3174e27f019e3c1b569a9d3f16a3dbb04b4d5c11206b6e12f864466cc0ef17.png#vwid=572&vhei=384)


![](/media/b0/b001d8c9330c9064b608508fca78f5b3ca1aa9294887ca7ac2e5e0ecc2d5db9a.png#vwid=1070&vhei=182)


这样就配好hosts了

![](/media/59/595edc97e2e9fb1a5e1a07025ffc425497299326aeb8f1de0d1ab9393f9eae06.png#vwid=1221&vhei=450)


```bash
dayi-cloud-k8s-master
dayi-cloud-k8s-node1
dayi-cloud-k8s-node2
```


## Master

```bash
sudo ufw allow 6443/tcp
sudo ufw allow 2379/tcp
sudo ufw allow 2380/tcp
sudo ufw allow 10250/tcp
sudo ufw allow 10251/tcp
sudo ufw allow 10252/tcp
sudo ufw allow 10255/tcp
sudo ufw reload

cat <<EOF | sudo tee /etc/modules-load.d/containerd.conf 
overlay 
br_netfilter
EOF

sudo modprobe overlay 
sudo modprobe br_netfilter
cat <<EOF | sudo tee /etc/sysctl.d/99-kubernetes-k8s.conf
net.bridge.bridge-nf-call-iptables = 1
net.ipv4.ip_forward = 1 
net.bridge.bridge-nf-call-ip6tables = 1 
EOF


sudo sysctl --system
```

## Other

```bash
sudo ufw allow 10250/tcp
sudo ufw allow 30000:32767/tcp
sudo ufw reload


cat <<EOF | sudo tee /etc/modules-load.d/containerd.conf 
overlay 
br_netfilter
EOF

sudo modprobe overlay 
sudo modprobe br_netfilter
cat <<EOF | sudo tee /etc/sysctl.d/99-kubernetes-k8s.conf
net.bridge.bridge-nf-call-iptables = 1
net.ipv4.ip_forward = 1 
net.bridge.bridge-nf-call-ip6tables = 1 
EOF


sudo sysctl --system
```


![](/media/1d/1d50e8e22ab2bdb084fccdebd7465e2f8a501f6042746ce513d9ed211201cf80.png#vwid=1294&vhei=768)



## SSH-密钥复制

```
mkdir ~/.ssh
echo "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDk1VvdE9ZZFnK5Bwhi+C74B/rLvT7zKHN4/tUhzLFrMVDQZvsF+8ON9w4xHK1AZyb64GQXs9BtX93N+OJ51t5ZbEl960S0o7BYgcdB7q3+wb9E4uTYNFK7akcBgtxa+3gmZTmttr1l2KT3xzfE9BebkRg+C/DO/PwnaPwOWyeYc90fmcpk7voM2e268wmv6V2eZmIKaA/T7GXCe22qKIcrgWZp78BHL1Je+sqQ72FfzGasDj/iDCcqbW6fsQ4v0QHsuQ4SavcT3xvPDPTwCow4CoV8cQiK4s2nak/5z8lZF07FRJsF0oYcg7m+9qizLv3jBi/P1M26Rhpj5fV6XmdBtIpSY8A958U2bPT/16eAJOcyj+0qFL2E0DWs7Hbh8tni4L51mppQfx4VnozzEzPPaEauGA/GNQ+HlKcaEe43bBia7btW9K9c6EHPvolAf/365gv4BcKArlbOVo4kfxqfX7ybjSnK2pz3kZjFDrXwhQ0LsVqlZIvGu+wkHIVFYHM= root@dayi-cloud-k8s-maste" >> ~/.ssh/authorized_keys

```

## 安装containerd

```bash
apt install containerd
containerd config default | sudo tee /etc/containerd/config.toml >/dev/null 2>&1
sudo vi /etc/containerd/config.toml

scp /etc/containerd/config.toml dayi-cloud-k8s-node1:/etc/containerd/config.toml
scp /etc/containerd/config.toml dayi-cloud-k8s-node2:/etc/containerd/config.toml

sudo systemctl restart containerd
sudo systemctl enable containerd
```

![](/media/f3/f3c3199b9bf85a4abbd0c042e10fceb52316634824fb59a21d9c17391c20eb5b.png#vwid=1344&vhei=801)


## 安装K8S仓库

```bash

sudo apt install gnupg gnupg2 curl software-properties-common -y
curl -s https://packages.cloud.google.com/apt/doc/apt-key.gpg | sudo gpg --dearmour -o /etc/apt/trusted.gpg.d/cgoogle.gpg
apt-add-repository "deb http://apt.kubernetes.io/ kubernetes-xenial main"

```
![](/media/14/14eac826d6a31ca87ca3d7a27bb0151452eb4d79ad1056603096323c1bd45f46.png#vwid=1183&vhei=520)

## 安装K8S

```bash
apt update
apt install kubelet kubeadm kubectl -y
apt-mark hold kubelet kubeadm kubectl
```

![](/media/41/41b886eefea40b73daacab2ae3f2d6a66ab584bd115135fa6d9b07e119d7c6bc.png#vwid=1260&vhei=887)


![](/media/ee/eef84c5df6553495527f763dc96a22406c733139109a9fa3ac7dc72567009a54.png#vwid=1542&vhei=702)


## 初始化集群：

```bash
kubeadm init --image-repository registry.aliyuncs.com/google_containers --pod-network-cidr=10.234.0.0/16 --control-plane-endpoint=dayi-cloud-k8s-master --v=5
```


## 虚拟化K8S安装

```bash
# 设置主机名
hostnamectl set-hostname m1
hostnamectl set-hostname node1
hostnamectl set-hostname node2
、
===== 192.168.0.202 node2

# 使用scp复制/etc/hosts到node1和node2
scp /etc/hosts root@192.168.0.201:/etc/hosts
scp /etc/hosts root@192.168.0.202:/etc/hosts

# 关闭swap并配置内核参数
swapoff -a
sed -i 's/.*swap.*/#&/' /etc/fstab
echo -e 'net.bridge.bridge-nf-call-iptables = 1 \nnet.bridge.bridge-nf-call-ip6tables = 1' >> /etc/sysctl.conf

# 安装基本软件包
yum -y install wget ntpdate

# 配置时间同步
ntpdate ntp1.aliyun.com
crontab -e
# 添加以下内容
*/1 * * * * /usr/sbin/ntpdate ntp1.aliyun.com
systemctl restart crond.service
reboot

# 配置yum源及下载Kubernetes和Docker相关软件包
cd /etc/yum.repos.d
rm -f CentOS-*
wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo
wget -P /etc/yum.repos.d/ http://mirrors.aliyun.com/repo/epel-7.repo
vi /etc/yum.repos.d/kubernetes.repo
# 添加kubernetes源的配置信息
wget https://mirrors.aliyun.com/kubernetes/yum/doc/rpm-package-key.gpg
rpm -import rpm-package-key.gpg
wget https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo
yum clean all
yum makecache fast
cd

# 安装docker-ce并启动服务
yum -y install docker-ce
systemctl start docker
systemctl enable docker

# 配置Docker的镜像加速器
vi /etc/docker/daemon.json
# 添加以下内容
{
    "registry-mirrors": ["https://x3nqjrcg.mirror.aliyuncs.com"]
}

# Docker降级为20.10
yum downgrade --setopt=obsoletes=0 -y docker-ce-20.10.24 docker-ce-selinux-20.10.24 containerd.io

# 修改Docker Cgroup Driver为systemd
vi /etc/docker/daemon.json
# 添加以下内容
{
  "exec-opts": ["native.cgroupdriver=systemd"],
  "registry-mirrors": ["https://x3nqjrcg.mirror.aliyuncs.com"]
}

# 重启docker服务
systemctl daemon-reload
systemctl restart docker

# 安装kubeadm、kubectl、kubelet
yum install -y kubelet-1.23.17 kubeadm-1.23.17 kubectl-1.23.17
systemctl start kubelet
systemctl enable kubelet

# 下载Kubernetes镜像
kubeadm config images list --kubernetes-version v1.23.17
kubeadm config images pull --image-repository=registry.aliyuncs.com/google_containers

# 初始化Kubernetes集群
kubeadm init \
--kubernetes-version=v1.23.17 \
--pod-network-cidr=10.244.0.0/16 \
--service-cidr=10.96.0.0/12 \
--apiserver-advertise-address=192.168.8.10 \
--image-repository=registry.aliyuncs.com/google_containers 

# 配置环境变量
mkdir -p $HOME/.kube
sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config

# 安装Flannel网络
wget https://github.com/flannel-io/flannel/releases/latest/download/kube-flannel.yml
kubectl apply -f kube-flannel.yml

# 将节点加入到集群
kubeadm join 192.168.8.10:6443 --token [token] --discovery-token-ca-cert-hash [hash]

# 查看集群状态
kubectl get nodes

```

## Debian安装



## K8S2

![](/media/56/5640da6445cedff12794316740207132a6c9e9c8529c812b27e807afb11db02c.png#vwid=793&vhei=312)



## 哈哈哈哈哈哈哈哈哈哈哈哈哈哈哈哈哈哈哈哈哈哈哈哈

换CENTOS 

![](/media/ca/cabc49f2c844d6c5b38408d5642b4689a2098b01728d7263125cc9bf763f59e1.png#vwid=1920&vhei=1150)



## 换大牛

![](/media/d8/d8da55ac0adb9a5e49b2b5e6149f561778b86c43b549cea360e86bb8cd60975e.png#vwid=1538&vhei=1009)


##  Rencher
![](/media/7c/7c1bcec9a20188ead8dd6a24b484997c515820ae0758f8a126f26913864f6bc4.png#vwid=1918&vhei=1150)

![](/media/bf/bfb028d9f38bbedbcd8c8a56d92f80dc4d75e010b08689f5f316095d36bfa974.png#vwid=708&vhei=174)

真男人直接下载：

![](/media/5d/5df92212f512a548a1b1928756c33d0c5dc043ec73aa9ddd89fbe0dfcfac63b9.png#vwid=1377&vhei=708)

![](/media/eb/eb9b20041a24518dedcbaa92cbf38e765bee71d2b9cde0e1f53c6052a7484df7.png#vwid=1077&vhei=514)


![](/media/2d/2dcf27f02c744c1c1561dc04002770fd4713b30ded38c4485646a172a8abc8bc.png#vwid=714&vhei=407)


![](/media/56/56c6cf8de1e5434165629ce2bf673f523569e38a58b588c68c6db3ebc054b5dd.png#vwid=1513&vhei=873)


![](/media/ef/efc839e95205b0ef2c6380ff54e50199c9561c800eb81e6b87add557d96f441f.png#vwid=738&vhei=143)


---
修改主机名：

![](/media/af/afbecfd3e569ad10d11e475007ab0393ea108a4613fc2fc4bf1b197a908f0f6b.png#vwid=935&vhei=652)

![](/media/85/8549c2c45b15045d8e2122d45c806a689222b9971856e29d5babd8a9e00ad852.png#vwid=1422&vhei=1140)

```bash
ssh-keygen -t ecdsa -b 256
ssh-copy-id node1
ssh-copy-id node2

```


![](/media/dc/dce7cc4d867ec3f6497023d59b5d06f0521113bc195fb81bd93b8cf208b2b889.png#vwid=790&vhei=577)


![](/media/26/26527999c27d0bf00220b845e300d758e78a262235700b560cfebb112138189a.png#vwid=1244&vhei=423)


复制密钥：
```bash
ssh-copy-id node2
```

![](/media/72/720037297dc9540522ffe198cd303690e20ba42fdc2d92d70cb8c129430f896f.png#vwid=900&vhei=445)

复制hosts

```bash
scp /etc/hosts root@node1:/etc/hosts 
scp /etc/hosts root@node2:/etc/hosts 

```


![](/media/c0/c031af6ac303f51f84d39ccee121a64bbc6eb15f2aeac0a81b126fae6c40e673.png#vwid=1548&vhei=195)


## 修改内核配置

`/etc/sysctl.conf`

vi:
```bash
echo -e 'net.bridge.bridge-nf-call-iptables = 1 \nnet.bridge.bridge-nf-call-ip6tables = 1' >> /etc/sysctl.conf
```

开启模块
```bash
modprobe br_netfilter
ls /proc/sys/net/bridge/
echo "br_netfilter" > /etc/modules-load.d/br_netfilter.conf
sysctl -p
```

![](/media/23/23d370becb77e82949de09aeb8ac618b9863410a4b19e6b3ca0326f96d2b1263.png#vwid=893&vhei=192)


发送到从节点：

```bash
scp /etc/sysctl.conf root@node1:/etc/sysctl.conf
scp /etc/sysctl.conf root@node2:/etc/sysctl.conf 

#从节点执行：
modprobe br_netfilter
ls /proc/sys/net/bridge/
echo "br_netfilter" > /etc/modules-load.d/br_netfilter.conf
sysctl -p
```

![](/media/a5/a51b21d331cc69358b6a01ff8e18556b9f633e25bfc5ae341309f44862865b38.png#vwid=1318&vhei=798)



## 防火墙 SELINUX：

```bash
systemctl stop firewalld
systemctl disable firewalld
systemctl status firewalld



setenforce 0
vi /etc/selinux/config
#修改： SELINUX=disabled

reboot
```

发送到从节点

```bash
scp /etc/selinux/config root@node1:/etc/selinux/config
scp /etc/selinux/config root@node2:/etc/selinux/config
```

![](/media/2f/2fd55c85bfa6a17c63f36efa7d6db6ac30d1b208e23929a1fec47f53dacb8149.png#vwid=961&vhei=531)

![](/media/7f/7f41943851a7a38722c662b27c1587dd802d5068c462fd6c16b83e9775e61558.png#vwid=852&vhei=175)


### 查看SELINUX状态

```bash
sestatus
```

## NTP时间同步

```bash
yum -y install wget ntpdate


crontab -e
*/1 * * * * /usr/sbin/ntpdate ntp1.aliyun.com

systemctl restart crond.service
```

## 添加源

```bash

vi /etc/yum.repos.d/kubernetes.repo

[kubernetes]
name=Kubernetes
baseurl=https://packages.cloud.google.com/yum/repos/kubernetes-el7-x86_64
enabled=1
gpgcheck=1
repo_gpgcheck=1
gpgkey=https://packages.cloud.google.com/yum/doc/yum-key.gpg https://packages.cloud.google.com/yum/doc/rpm-package-key.gpg

```

![](/media/1b/1b226d93cf98742b0226fea65d43c9ce16b7f5193eacea2b48fa42b4f2fd340a.png#vwid=1557&vhei=954)


## 安装

yum downgrade --setopt=obsoletes=0 -y docker-ce-20.10.24 docker-ce-selinux-20.10.24 containerd.io


```bash

yum install -y kubelet-1.23.17 kubeadm-1.23.17 kubectl-1.23.17
systemctl start kubelet
systemctl enable kubelet
systemctl status kubelet
```

```bash
kubeadm config images list --kubernetes-version v1.23.17
```



## 初始化


mv /etc/containerd/config.toml /root/config.toml.bak
systemctl restart containerd


/etc/kubernetes/manifests/kube-scheduler.yaml 

rm -rf /etc/kubernetes/manifests/kube-apiserver.yaml
rm -rf /etc/kubernetes/manifests/kube-controller-manager.yaml 
rm -rf /etc/kubernetes/manifests/kube-scheduler.yaml 
rm -rf /etc/kubernetes/manifests/etcd.yaml


kubeadm init \
--pod-network-cidr=10.244.0.0/16 \
--service-cidr=10.96.0.0/12 \
--apiserver-advertise-address=192.168.59.137 \
--image-repository=registry.aliyuncs.com/google_containers
--v=5

rm -f /etc/kubernetes/controller-manager.conf
rm -f /etc/kubernetes/scheduler.conf
rm -f /etc/kubernetes/scheduler.conf
rm -f /etc/kubernetes/admin.conf
rm -f /etc/kubernetes/kubelet.conf




  mkdir -p $HOME/.kube
  sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  sudo chown $(id -u):$(id -g) $HOME/.kube/config
  
  


![](/media/eb/eb7cd426f48500be169c5e72abd51e11539d022ade720c0a276f30e671d03fa3.png#vwid=1299&vhei=733)


```bash
kubeadm join 192.168.59.137:6443 --token y8m7u7.3ur44mc2ezb87fmq \
        --discovery-token-ca-cert-hash sha256:cb9d1bfa0c3adaabd9a34cd072e1d27c13c9cf9e6e3ef4a0c810b84d6fdf4c9f
```

节点:

![](/media/69/693d4d795cebe9f1c846c4df032310144ba500e2cd3578f448964d479b4d70b4.png#vwid=625&vhei=174)




![](/media/9b/9b338518db3fe41fce603eb41e4912ca98107fc814eaed9511f286d490b4e6a6.png#vwid=1104&vhei=364)


节点：

![](/media/33/333a930c69f3b8ae5667342f7b279cd1eee250d123f73f3746ce73e97038d635.png#vwid=1223&vhei=639)


![](/media/bc/bc3f1e9cd0849ce35e5e0099a828e622e135df93187b823d6dd857e3397539b9.png#vwid=562&vhei=153)


状态：

![](/media/ab/abaa13ee65c37b189c40aaebd2614c54631c372db0059a94393a2af7757545d1.png#vwid=603&vhei=222)


