kubernetes二進制部署（三）負載均衡部署

發布時間：2020-08-06 01:26:30 來源：網絡閱讀：306 作者：wx5d2c2d660c282 欄目：云計算

這是kubernetes二進制部署的第三篇
如果沒有看過前面第一篇的朋友可以看看下面的：
Kubernetes二進制部署（一）單節點部署
kubernetes二進制部署（二）多節點部署

實驗環境：

負載均衡
Nginx1:192.168.35.104/24
Nginx2:192.168.35.105/24

Master節點
master1:192.168.35.100/24
master2:192.168.35.103/24

Node節點
node1：192.168.35.101/24
node2：192.168.35.102/24

nginx安裝部署

lb01和lb02操作

1、關閉防火墻

[root@localhost ~]# systemctl stop firewalld.service?
[root@localhost ~]# setenforce 0

2、安裝nginx服務，把nginx.sh和keepalived.conf腳本拷貝到家目錄

[root@localhost ~]# ls
anaconda-ks.cfg ? ? ? keepalived.conf ?公共 ?視頻 ?文檔 ?音樂
initial-setup-ks.cfg ?nginx.sh ? ? ? ? 模板 ?圖片 ?下載 ?桌面

3、構建nginx的yum源環境

（1）復制配置文件

[root@localhost ~]# vim nginx.sh

cat > /etc/yum.repos.d/nginx.repo << EOF
[nginx]
name=nginx repo
baseurl=http://nginx.org/packages/centos/7/$basearch/
gpgcheck=0? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? #復制四行內容
EOF

stream {

? ?log_format ?main ?'$remote_addr $upstream_addr - [$time_local] $status $upstream_bytes_sent';
? ? access_log ?/var/log/nginx/k8s-access.log ?main;

? ? upstream k8s-apiserver {
? ? ? ? server 10.0.0.3:6443;
? ? ? ? server 10.0.0.8:6443;
? ? }
? ? server {
? ? ? ? ? ? ? ? listen 6443;
? ? ? ? ? ? ? ? proxy_pass k8s-apiserver;
? ? }
? ? }

（2）創建yum源，重新加載yum倉庫，并安裝nginx

[root@localhost ~]# vim /etc/yum.repos.d/nginx.repo

[nginx]
name=nginx repo
baseurl=http://nginx.org/packages/centos/7/$basearch/
gpgcheck=0

[root@localhost ~]# yum list

[root@localhost ~]#?yum install nginx -y

4、添加四層轉發

（1）復制配置文件

[root@localhost ~]# vim nginx.sh

cat > /etc/yum.repos.d/nginx.repo << EOF
[nginx]
name=nginx repo
baseurl=http://nginx.org/packages/centos/7/$basearch/
gpgcheck=0? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?
EOF

stream {

? ?log_format ?main ?'$remote_addr $upstream_addr - [$time_local] $status $upstream_bytes_sent';
? ? access_log ?/var/log/nginx/k8s-access.log ?main;

? ? upstream k8s-apiserver {
? ? ? ? server 10.0.0.3:6443;
? ? ? ? server 10.0.0.8:6443;
? ? }
? ? server {
? ? ? ? ? ? ? ? listen 6443;
? ? ? ? ? ? ? ? proxy_pass k8s-apiserver;
? ? }
? ? }? ? ? ? ? ? ? ? ? ? ? ? ? #復制此段內容

（2）添加配置文件并修改

[root@localhost ~]# vim /etc/nginx/nginx.conf

user ?nginx;
worker_processes ?1;

error_log ?/var/log/nginx/error.log warn;
pid ? ? ? ?/var/run/nginx.pid;

events {
? ? worker_connections ?1024;
}

stream {

? ?log_format ?main ?'$remote_addr $upstream_addr - [$time_local] $status $upstream_bytes_sent';
? ? access_log ?/var/log/nginx/k8s-access.log ?main;

? ? upstream k8s-apiserver {
? ? ? ? server 192.168.35.100:6443;
? ? ? ? server 192.168.35.103:6443;? ? ? ? ? ? ? ? ? #只需修改IP為master1和master2的地址? ? ??
? ? }
? ? server {
? ? ? ? ? ? ? ? listen 6443;
? ? ? ? ? ? ? ? proxy_pass k8s-apiserver;
? ? }
? ? }

http {
? ? include ? ? ? /etc/nginx/mime.types;
? ? default_type ?application/octet-stream;

? ? log_format ?main ?'$remote_addr - $remote_user [$time_local] "$request" '
? ? ? ? ? ? ? ? ? ? ? '$status $body_bytes_sent "$http_referer" '
? ? ? ? ? ? ? ? ? ? ? '"$http_user_agent" "$http_x_forwarded_for"';

? ? access_log ?/var/log/nginx/access.log ?main;

? ? sendfile ? ? ? ?on;
? ? #tcp_nopush ? ? on;

? ? keepalive_timeout ?65;

? ? #gzip ?on;

? ? include /etc/nginx/conf.d/*.conf;
}

（3）驗證語法是否錯誤

[root@localhost ~]# nginx -t
nginx: the configuration file /etc/nginx/nginx.conf syntax is ok
nginx: configuration file /etc/nginx/nginx.conf test is successful

（4）修改首頁，進行區分，一個master，一個backup。

lb01操作：

[root@localhost ~]# cd /usr/share/nginx/html/
[root@localhost html]# ls
50x.html ?index.html
[root@localhost html]# vim index.html?

/14 <h2>Welcome to master ginx!</h2>

lb02操作：

[root@localhost ~]# cd /usr/share/nginx/html/
[root@localhost html]# ls
50x.html ?index.html
[root@localhost html]# vim index.html?

/14 <h2>Welcome to backup?ginx!</h2>

（5）開啟服務，并訪問首頁

lb01：

[root@localhost ~]# systemctl start nginx

用瀏覽器訪問http://192.168.35.104/

kubernetes二進制部署（三）負載均衡部署

lb02：

[root@localhost ~]# systemctl start nginx

用瀏覽器訪問http://192.168.35.105/

kubernetes二進制部署（三）負載均衡部署

keepalived安裝部署

lb01和lb02操作：

1、安裝keepalived

[root@localhost ~]# yum install keepalived -y

2、修改配置文件

[root@localhost ~]# ls
anaconda-ks.cfg ? ? ? keepalived.conf ?公共 ?視頻 ?文檔 ?音樂
initial-setup-ks.cfg ?nginx.sh ? ? ? ? 模板 ?圖片 ?下載 ?桌面
[root@localhost ~]# cp keepalived.conf /etc/keepalived/keepalived.conf
cp：是否覆蓋"/etc/keepalived/keepalived.conf"？ yes

[root@localhost ~]# vim /etc/keepalived/keepalived.conf?

lb01是Master配置如下：

! Configuration File for keepalived

global_defs {
? ?# 接收郵件地址
? ?notification_email {
? ? ?acassen@firewall.loc
? ? ?failover@firewall.loc
? ? ?sysadmin@firewall.loc
? ?}
? ?# 郵件發送地址
? ?notification_email_from Alexandre.Cassen@firewall.loc
? ?smtp_server 127.0.0.1
? ?smtp_connect_timeout 30
? ?router_id NGINX_MASTER
}

vrrp_script check_nginx {
? ? script "/etc/nginx/check_nginx.sh"
}

vrrp_instance VI_1 {
? ? state MASTER?
? ? interface ens33
? ? virtual_router_id 51 # VRRP 路由 ID實例，每個實例是唯一的
? ? priority 100 ? ?# 優先級，備服務器設置 90 ?
? ? advert_int 1 ? ?# 指定VRRP 心跳包通告間隔時間，默認1秒
? ? authentication { ?
? ? ? ? auth_type PASS
? ? ? ? auth_pass 1111
? ? } ??
? ? virtual_ipaddress {
? ? ? ? 192.168.35.200/24
? ? }
? ? track_script {
? ? ? ? check_nginx
? ? }
}

lb02是Backup配置如下：

! Configuration File for keepalived

global_defs {
? ?# 接收郵件地址
? ?notification_email {
? ? ?acassen@firewall.loc
? ? ?failover@firewall.loc
? ? ?sysadmin@firewall.loc
? ?}
? ?# 郵件發送地址
? ?notification_email_from Alexandre.Cassen@firewall.loc
? ?smtp_server 127.0.0.1
? ?smtp_connect_timeout 30
? ?router_id NGINX_MASTER
}

vrrp_script check_nginx {
? ? script "/etc/nginx/check_nginx.sh"
}

vrrp_instance VI_1 {
? ? state?BACKUP?
? ? interface ens33
? ? virtual_router_id 51 # VRRP 路由 ID實例，每個實例是唯一的
? ? priority 90 ? ?# 優先級，備服務器設置 90 ?
? ? advert_int 1 ? ?# 指定VRRP 心跳包通告間隔時間，默認1秒
? ? authentication { ?
? ? ? ? auth_type PASS
? ? ? ? auth_pass 1111
? ? } ??
? ? virtual_ipaddress {
? ? ? ? 192.168.35.200/24
? ? }
? ? track_script {
? ? ? ? check_nginx
? ? }
}

3、制作管理腳本

[root@localhost ~]# vim /etc/nginx/check_nginx.sh

count=$(ps -ef |grep nginx |egrep -cv "grep|$$")

if [ "$count" -eq 0 ];then
? ? ? ? systemctl stop keepalived
fi

4、賦予執行權限并開啟服務

[root@localhost ~]# chmod +x /etc/nginx/check_nginx.sh
[root@localhost ~]# systemctl start keepalived

5、查看地址信息

（1）查看lb01地址信息

[root@localhost ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
? ? link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
? ? inet 127.0.0.1/8 scope host lo
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 ::1/128 scope host?
? ? ? ?valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
? ? link/ether 00:0c:29:ba:e6:18 brd ff:ff:ff:ff:ff:ff
? ? inet 192.168.35.104/24 brd 192.168.35.255 scope global ens33
? ? ? ?valid_lft forever preferred_lft forever
? ? inet 192.168.35.200/24 scope global secondary ens33? ? ? ? ? ? ?#漂移地址在lb01中?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::6ec5:6d7:1b18:466e/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::2a3:b621:ca01:463e/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::d4e2:ef9e:6820:145a/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
3: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN qlen 1000
? ? link/ether 52:54:00:14:39:99 brd ff:ff:ff:ff:ff:ff
? ? inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
? ? ? ?valid_lft forever preferred_lft forever
4: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN qlen 1000
? ? link/ether 52:54:00:14:39:99 brd ff:ff:ff:ff:ff:ff

（2）查看lb02地址信息

[root@localhost ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
? ? link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
? ? inet 127.0.0.1/8 scope host lo
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 ::1/128 scope host?
? ? ? ?valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
? ? link/ether 00:0c:29:1d:ec:b0 brd ff:ff:ff:ff:ff:ff
? ? inet 192.168.35.105/24 brd 192.168.35.255 scope global ens33
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::6ec5:6d7:1b18:466e/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::2a3:b621:ca01:463e/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::d4e2:ef9e:6820:145a/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
3: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN qlen 1000
? ? link/ether 52:54:00:14:39:99 brd ff:ff:ff:ff:ff:ff
? ? inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
? ? ? ?valid_lft forever preferred_lft forever
4: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN qlen 1000
? ? link/ether 52:54:00:14:39:99 brd ff:ff:ff:ff:ff:ff

6、測試故障轉移切換

（1）驗證地址漂移（lb01中使用pkill nginx，再在lb02中使用ip a 查看）

[root@localhost ~]# pkill nginx
[root@localhost ~]# systemctl status nginx
● nginx.service - nginx - high performance web server
? ?Loaded: loaded (/usr/lib/systemd/system/nginx.service; disabled; vendor preset: disabled)
? ?Active: failed (Result: exit-code) since 六 2020-02-08 16:54:45 CST; 11s ago
? ? ?Docs: http://nginx.org/en/docs/
? Process: 13156 ExecStop=/bin/kill -s TERM $MAINPID (code=exited, status=1/FAILURE)
?Main PID: 6930 (code=exited, status=0/SUCCESS)

2月 08 16:54:45 localhost.localdomain kill[13156]: -q, --queue <信號> ? …2)
2月 08 16:54:45 localhost.localdomain kill[13156]: -p, --pid ? ? ? ? ? ?…號
2月 08 16:54:45 localhost.localdomain kill[13156]: -l, --list [=<信號>] …稱
2月 08 16:54:45 localhost.localdomain kill[13156]: -L, --table ? ? ? ? ?…值
2月 08 16:54:45 localhost.localdomain kill[13156]: -h, --help ? ? 顯示此…出
2月 08 16:54:45 localhost.localdomain kill[13156]: -V, --version ?輸出版…出
2月 08 16:54:45 localhost.localdomain kill[13156]: 更多信息請參閱 kill(1)。
2月 08 16:54:45 localhost.localdomain systemd[1]: nginx.service: control...
2月 08 16:54:45 localhost.localdomain systemd[1]: Unit nginx.service ent...
2月 08 16:54:45 localhost.localdomain systemd[1]: nginx.service failed.
Hint: Some lines were ellipsized, use -l to show in full.

[root@localhost ~]# systemctl status keepalived.service? ? ? ? ? ? ?#keepalived服務也隨之關閉，說明nginx中的check_nginx.sh生效
● keepalived.service - LVS and VRRP High Availability Monitor
? ?Loaded: loaded (/usr/lib/systemd/system/keepalived.service; disabled; vendor preset: disabled)
? ?Active: inactive (dead)

2月 08 16:39:26 localhost.localdomain Keepalived_vrrp[7319]: VRRP_Instan...
2月 08 16:39:26 localhost.localdomain Keepalived_vrrp[7319]: Sending gra...
2月 08 16:39:26 localhost.localdomain Keepalived_vrrp[7319]: Sending gra...
2月 08 16:39:26 localhost.localdomain Keepalived_vrrp[7319]: Sending gra...
2月 08 16:39:26 localhost.localdomain Keepalived_vrrp[7319]: Sending gra...
2月 08 16:54:46 localhost.localdomain Keepalived[7317]: Stopping
2月 08 16:54:46 localhost.localdomain systemd[1]: Stopping LVS and VRRP ...
2月 08 16:54:46 localhost.localdomain Keepalived_vrrp[7319]: VRRP_Instan...
2月 08 16:54:46 localhost.localdomain Keepalived_vrrp[7319]: VRRP_Instan...
2月 08 16:54:47 localhost.localdomain systemd[1]: Stopped LVS and VRRP H...
Hint: Some lines were ellipsized, use -l to show in full.

在lb01查看地址：

[root@localhost ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
? ? link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
? ? inet 127.0.0.1/8 scope host lo
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 ::1/128 scope host?
? ? ? ?valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
? ? link/ether 00:0c:29:ba:e6:18 brd ff:ff:ff:ff:ff:ff
? ? inet 192.168.35.104/24 brd 192.168.35.255 scope global ens33
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::6ec5:6d7:1b18:466e/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::2a3:b621:ca01:463e/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::d4e2:ef9e:6820:145a/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
3: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN qlen 1000
? ? link/ether 52:54:00:14:39:99 brd ff:ff:ff:ff:ff:ff
? ? inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
? ? ? ?valid_lft forever preferred_lft forever
4: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN qlen 1000
? ? link/ether 52:54:00:14:39:99 brd ff:ff:ff:ff:ff:ff

在lb02查看地址：

[root@localhost ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
? ? link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
? ? inet 127.0.0.1/8 scope host lo
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 ::1/128 scope host?
? ? ? ?valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
? ? link/ether 00:0c:29:1d:ec:b0 brd ff:ff:ff:ff:ff:ff
? ? inet 192.168.35.105/24 brd 192.168.35.255 scope global ens33
? ? ? ?valid_lft forever preferred_lft forever
? ? inet 192.168.35.200/24 scope global secondary ens33? ? ? ? ? ? ? ? #漂移地址轉移到lb02中
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::6ec5:6d7:1b18:466e/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::2a3:b621:ca01:463e/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::d4e2:ef9e:6820:145a/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
3: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN qlen 1000
? ? link/ether 52:54:00:14:39:99 brd ff:ff:ff:ff:ff:ff
? ? inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
? ? ? ?valid_lft forever preferred_lft forever
4: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN qlen 1000
? ? link/ether 52:54:00:14:39:99 brd ff:ff:ff:ff:ff:ff

（2）恢復操作（在lb01中先啟動nginx服務，再啟動keepalived服務）

[root@localhost ~]# systemctl start nginx
[root@localhost ~]# systemctl start keepalived.service?
[root@localhost ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
? ? link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
? ? inet 127.0.0.1/8 scope host lo
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 ::1/128 scope host?
? ? ? ?valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
? ? link/ether 00:0c:29:ba:e6:18 brd ff:ff:ff:ff:ff:ff
? ? inet 192.168.35.104/24 brd 192.168.35.255 scope global ens33
? ? ? ?valid_lft forever preferred_lft forever
? ? inet 192.168.35.200/24 scope global secondary ens33? ? ? ? ? ? ?? #漂移地址又轉移回lb01中
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::6ec5:6d7:1b18:466e/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::2a3:b621:ca01:463e/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
? ? inet6 fe80::d4e2:ef9e:6820:145a/64 scope link tentative dadfailed?
? ? ? ?valid_lft forever preferred_lft forever
3: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN qlen 1000
? ? link/ether 52:54:00:14:39:99 brd ff:ff:ff:ff:ff:ff
? ? inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
? ? ? ?valid_lft forever preferred_lft forever
4: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN qlen 1000
? ? link/ether 52:54:00:14:39:99 brd ff:ff:ff:ff:ff:ff

（3）nginx站點/usr/share/nginx/html

在宿主機上ping虛擬IP，保證可以ping通，說明可以去進行訪問

kubernetes二進制部署（三）負載均衡部署

在lb01查看index.html

[root@localhost ~]# cat /usr/share/nginx/html/index.html?
<!DOCTYPE html>
<html>
<head>
<title>Welcome to nginx!</title>
<style>
? ? body {
? ? ? ? width: 35em;
? ? ? ? margin: 0 auto;
? ? ? ? font-family: Tahoma, Verdana, Arial, sans-serif;
? ? }
</style>
</head>
<body>
<h2>Welcome to master ginx!</h2>
<p>If you see this page, the nginx web server is successfully installed and
working. Further configuration is required.</p>

<p>For online documentation and support please refer to
<a >nginx.org</a>.<br/>
Commercial support is available at
<a >nginx.com</a>.</p>

<p><em>Thank you for using nginx.</em></p>
</body>
</html>

在lb01查看index.html

[root@localhost ~]# cat /usr/share/nginx/html/index.html?
<!DOCTYPE html>
<html>
<head>
<title>Welcome to nginx!</title>
<style>
? ? body {
? ? ? ? width: 35em;
? ? ? ? margin: 0 auto;
? ? ? ? font-family: Tahoma, Verdana, Arial, sans-serif;
? ? }
</style>
</head>
<body>
<h2>Welcome to backup nginx!</h2>
<p>If you see this page, the nginx web server is successfully installed and
working. Further configuration is required.</p>

<p>For online documentation and support please refer to
<a >nginx.org</a>.<br/>
Commercial support is available at
<a >nginx.com</a>.</p>

<p><em>Thank you for using nginx.</em></p>
</body>
</html>

因為漂移地址是在lb01上，所以訪問漂移地址時現實的nginx首頁應該是包含master的

kubernetes二進制部署（三）負載均衡部署

node節點綁定VIP地址

1、修改node節點配置文件統一VIP（bootstrap.kubeconfig,kubelet.kubeconfig）

[root@localhost ~]# vim /opt/kubernetes/cfg/bootstrap.kubeconfig
[root@localhost ~]# vim /opt/kubernetes/cfg/kubelet.kubeconfig
[root@localhost ~]# vim /opt/kubernetes/cfg/kube-proxy.kubeconfig

#全部都改為VIP地址

server: https://192.168.35.200:6443

2、替換完成直接自檢

[root@localhost ~]# cd /opt/kubernetes/cfg/

[root@localhost cfg]# grep 200 *
bootstrap.kubeconfig: ? ?server: https://192.168.35.200:6443
kubelet.kubeconfig: ? ?server: https://192.168.35.200:6443
kube-proxy.kubeconfig: ? ?server: https://192.168.35.200:6443

3、重啟服務

[root@localhost cfg]# systemctl restart kubelet.service?
[root@localhost cfg]# systemctl restart kube-proxy.service?

4、在lb01上查看nginx的k8s日志

[root@localhost ~]# tail /var/log/nginx/k8s-access.log
192.168.35.102 192.168.35.100:6443 - [08/Feb/2020:17:42:00 +0800] 200 1119
192.168.35.102 192.168.35.103:6443 - [08/Feb/2020:17:42:00 +0800] 200 1121
192.168.35.101 192.168.35.100:6443 - [08/Feb/2020:17:42:14 +0800] 200 1121
192.168.35.101 192.168.35.100:6443 - [08/Feb/2020:17:42:14 +0800] 200 1121

在master01上操作

1、測試創建pod

[root@localhost k8s]# kubectl run nginx --image=nginx
kubectl run --generator=deployment/apps.v1beta1 is DEPRECATED and will be removed in a future version. Use kubectl create instead.
deployment.apps/nginx created

2、查看狀態

[root@localhost k8s]# kubectl get pods
NAME ? ? ? ? ? ? ? ? ? ?READY ? STATUS ? ?RESTARTS ? AGE
nginx-dbddb74b8-cfggf ? 1/1? ? ? ? 0 ? ? ContainerCreating? ? ?64s? ? ? ? ? ? ? ? #正在創建中
[root@localhost k8s]# kubectl get pods
NAME ? ? ? ? ? ? ? ? ? ?READY ? STATUS ? ?RESTARTS ? AGE
nginx-dbddb74b8-cfggf ? 1/1 ? ? Running ? 0 ? ? ? ? ?74s? ? ? ? ? ? ? ? ? ?#創建完成，運行中

3、注意日志問題（無法查看，會報錯）

[root@localhost k8s]# kubectl logs nginx-dbddb74b8-cfggf
Error from server (Forbidden): Forbidden (user=system:anonymous, verb=get, resource=nodes, subresource=proxy) ( pods/log nginx-dbddb74b8-cfggf)

解決辦法：

（1）權限提升

[root@localhost k8s]# kubectl create clusterrolebinding cluster-system-anonymous --clusterrole=cluster-admin --user=system:anonymous
clusterrolebinding.rbac.authorization.k8s.io/cluster-system-anonymous created

（2）在去進行日志查看

[root@localhost k8s]# kubectl logs nginx-dbddb74b8-cfggf

//并不會出現報錯，只是因為沒有去訪問，所以沒有產生日志

4、查看pod網絡

[root@localhost k8s]# kubectl get pods -o wide
NAME ? ? ? ? ? ? ? ? ? ?READY ? STATUS ? ?RESTARTS ? AGE ? IP ? ? ? ? ? ?NODE ? ? ? ? ? ? NOMINATED NODE
nginx-dbddb74b8-cfggf ? 1/1 ? ? Running ? 0 ? ? ? ? ?14m ? 172.17.45.2 ? 192.168.35.101 ? <none>

5、在對應網段的node節點上操作可以直接訪問

[root@localhost cfg]# curl 172.17.45.2
<!DOCTYPE html>
<html>
<head>
<title>Welcome to nginx!</title>
<style>
? ? body {
? ? ? ? width: 35em;
? ? ? ? margin: 0 auto;
? ? ? ? font-family: Tahoma, Verdana, Arial, sans-serif;
? ? }
</style>
</head>
<body>
<h2>Welcome to nginx!</h2>
<p>If you see this page, the nginx web server is successfully installed and
working. Further configuration is required.</p>

<p>For online documentation and support please refer to
<a >nginx.org</a>.<br/>
Commercial support is available at
<a >nginx.com</a>.</p>

<p><em>Thank you for using nginx.</em></p>
</body>
</html>

6、訪問就會產生日志，回到master01操作

[root@localhost k8s]# kubectl logs nginx-dbddb74b8-cfggf
172.17.45.1 - - [08/Feb/2020:10:10:29 +0000] "GET / HTTP/1.1" 200 612 "-" "curl/7.29.0" "-"

向AI問一下細節

亚洲激情专区-91九色丨porny丨老师-久久久久久久女国产乱让韩-国产精品午夜小视频观看

kubernetes二進制部署（三）負載均衡部署

實驗環境：

nginx安裝部署

lb01和lb02操作

1、關閉防火墻

2、安裝nginx服務，把nginx.sh和keepalived.conf腳本拷貝到家目錄

3、構建nginx的yum源環境

（1）復制配置文件

（2）創建yum源，重新加載yum倉庫，并安裝nginx

4、添加四層轉發

（1）復制配置文件

（2）添加配置文件并修改

（3）驗證語法是否錯誤

（4）修改首頁，進行區分，一個master，一個backup。

lb01操作：

lb02操作：

（5）開啟服務，并訪問首頁

lb01：

用瀏覽器訪問http://192.168.35.104/

lb02：

用瀏覽器訪問http://192.168.35.105/

keepalived安裝部署

lb01和lb02操作：

1、安裝keepalived

2、修改配置文件

lb01是Master配置如下：

lb02是Backup配置如下：

3、制作管理腳本

4、賦予執行權限并開啟服務

5、查看地址信息

（1）查看lb01地址信息

（2）查看lb02地址信息

6、測試故障轉移切換

（1）驗證地址漂移（lb01中使用pkill nginx，再在lb02中使用ip a 查看）

在lb01查看地址：

在lb02查看地址：

（2）恢復操作（在lb01中先啟動nginx服務，再啟動keepalived服務）

（3）nginx站點/usr/share/nginx/html

在宿主機上ping虛擬IP，保證可以ping通，說明可以去進行訪問

在lb01查看index.html

因為漂移地址是在lb01上，所以訪問漂移地址時現實的nginx首頁應該是包含master的

node節點綁定VIP地址

1、修改node節點配置文件統一VIP（bootstrap.kubeconfig,kubelet.kubeconfig）

2、替換完成直接自檢

3、重啟服務

4、在lb01上查看nginx的k8s日志

在master01上操作

1、測試創建pod

2、查看狀態

3、注意日志問題（無法查看，會報錯）

解決辦法：

（1）權限提升

（2）在去進行日志查看

4、查看pod網絡

5、在對應網段的node節點上操作可以直接訪問

6、訪問就會產生日志，回到master01操作

猜你喜歡

最新資訊

相關推薦

相關標簽