最近被业务折腾的死去活来,实在没时间发帖,花了好多个晚上才写好这篇帖子,后续会加油的!
【利用K8S技术栈打造个人私有云系列文章目录】
- 利用K8S技术栈打造个人私有云(连载之:初章)
- 利用K8S技术栈打造个人私有云(连载之:K8S集群搭建)
- 利用K8S技术栈打造个人私有云(连载之:K8S环境理解和练手)(Coming Soon...)
- 利用K8S技术栈打造个人私有云(连载之:基础镜像制作与实验)(Coming Soon...)
- 利用K8S技术栈打造个人私有云(连载之:资源控制研究)(Coming Soon...)
- 利用K8S技术栈打造个人私有云(连载之:私有云客户端打造)(Coming Soon...)
- 利用K8S技术栈打造个人私有云(连载之:总结与升华)(Coming Soon...)
环境介绍
玩集群嘛,当然要搞几台机器做节点!无赖自己并没有性能很强劲的多余机器,在家里翻箱倒柜,找出了几台破旧的本子,试试看吧,与其垫桌脚不如拿出来遛遛弯...
总体环境安排如下图所示:
各部分简介如下:
Master节点 ( 一台08年买的Hedy笔记本 Centos7.3 64bit )
- docker
- etcd
- flannel
- kube-apiserver
- kube-scheduler
- kube-controller-manager
Slave节点 ( 一台二手Thinkpad T420s Centos7.3 64bit )
- docker
- flannel
- kubelet
- kube-proxy
Client节点( 一台12年的Sony Vaio SVS13 Win7 Ultimate)
- 客户端嘛,毕竟甲方,不需要安装啥东西,有个ssh客户端能连到master和slave节点就OK
Docker镜像仓库
- 一般企业内部应用的话,其会搭建自己的docker registry,用作镜像仓库,我这里就直接用Docker Gub作为镜像仓库,自己不搭建了(其实主要是没机子啊!)
Wireless Router (雷猴子家的小米路由器3)
- 最好能穿墙,因为我家路由器放在客厅,但我实验是在卧室里做的啊!
各部分全部都是由wifi进行互联,我个人不太喜欢一大堆线绕来绕去
环境准备
- 先设置master节点和所有slave节点的主机名
master上执行:
hostnamectl --static set-hostname k8s-master
slave上执行:
hostnamectl --static set-hostname k8s-node-1
- 修改master和slave上的hosts
在master和slave的/etc/hosts
文件中均加入以下内容:
192.168.31.166 k8s-master 192.168.31.166 etcd 192.168.31.166 registry 192.168.31.199 k8s-node-1
- 关闭master和slave上的防火墙
systemctl disable firewalld.service systemctl stop firewalld.service
部署Master节点
master节点需要安装以下组件:
- etcd
- flannel
- docker
- kubernets
下面按顺序阐述
1. etcd安装
- 安装命令:
yum install etcd -y
- 编辑etcd的默认配置文件
/etc/etcd/etcd.conf
# [member] ETCD_NAME=master ETCD_DATA_DIR="/var/lib/etcd/default.etcd" #ETCD_WAL_DIR="" #ETCD_SNAPSHOT_COUNT="10000" #ETCD_HEARTBEAT_INTERVAL="100" #ETCD_ELECTION_TIMEOUT="1000" #ETCD_LISTEN_PEER_URLS="http://localhost:2380" ETCD_LISTEN_CLIENT_URLS="http://0.0.0.0:2379,http://0.0.0.0:4001" #ETCD_MAX_SNAPSHOTS="5" #ETCD_MAX_WALS="5" #ETCD_CORS="" # #[cluster] #ETCD_INITIAL_ADVERTISE_PEER_URLS="http://localhost:2380" # if you use different ETCD_NAME (e.g. test), set ETCD_INITIAL_CLUSTER value for this name, i.e. "test=http://..." #ETCD_INITIAL_CLUSTER="default=http://localhost:2380" #ETCD_INITIAL_CLUSTER_STATE="new" #ETCD_INITIAL_CLUSTER_TOKEN="etcd-cluster" ETCD_ADVERTISE_CLIENT_URLS="http://etcd:2379,http://etcd:4001" #ETCD_DISCOVERY="" #ETCD_DISCOVERY_SRV="" #ETCD_DISCOVERY_FALLBACK="proxy" #ETCD_DISCOVERY_PROXY="" #ETCD_STRICT_RECONFIG_CHECK="false" #ETCD_AUTO_COMPACTION_RETENTION="0" #ETCD_ENABLE_V2="true" # #[proxy] #ETCD_PROXY="off" #ETCD_PROXY_FAILURE_WAIT="5000" #ETCD_PROXY_REFRESH_INTERVAL="30000" #ETCD_PROXY_DIAL_TIMEOUT="1000" #ETCD_PROXY_WRITE_TIMEOUT="5000" #ETCD_PROXY_READ_TIMEOUT="0" # #[security] #ETCD_CERT_FILE="" #ETCD_KEY_FILE="" #ETCD_CLIENT_CERT_AUTH="false" #ETCD_TRUSTED_CA_FILE="" #ETCD_AUTO_TLS="false" #ETCD_PEER_CERT_FILE="" #ETCD_PEER_KEY_FILE="" #ETCD_PEER_CLIENT_CERT_AUTH="false" #ETCD_PEER_TRUSTED_CA_FILE="" #ETCD_PEER_AUTO_TLS="false" # #[logging] #ETCD_DEBUG="false" # examples for -log-package-levels etcdserver=WARNING,security=DEBUG #ETCD_LOG_PACKAGE_LEVELS="" # #[profiling] #ETCD_ENABLE_PPROF="false" #ETCD_METRICS="basic" # #[auth] #ETCD_AUTH_TOKEN="simple"
首先启动etcd服务
systemctl start etcd // 启动etcd服务
再获取etcd的健康指标看看:
etcdctl -C http://etcd:2379 cluster-health etcdctl -C http://etcd:4001 cluster-health
2. flannel安装
- 安装命令:
yum install flannel
- 配置flannel:
/etc/sysconfig/flanneld
# Flanneld configuration options # etcd url location. Point this to the server where etcd runs FLANNEL_ETCD_ENDPOINTS="http://etcd:2379" # etcd config key. This is the configuration key that flannel queries # For address range assignment FLANNEL_ETCD_PREFIX="/atomic.io/network" # Any additional options that you want to pass #FLANNEL_OPTIONS=""
etcdctl mk /atomic.io/network/config '{ "Network": "10.0.0.0/16" }'
systemctl start flanneld.service systemctl enable flanneld.service
3. docker安装
该部分网上教程太多了,主要步骤如下
- 安装命令:
yum install docker -y
- 开启docker服务:
service docker start
- 设置docker开启自启动:
chkconfig docker on
4. kubernets安装
k8s的安装命令很简单,执行:
yum install kubernetes
但k8s需要配置的东西比较多,正如第一节“环境介绍”中提及的,毕竟master上需要运行以下组件:
- kube-apiserver
- kube-scheduler
- kube-controller-manager
下面详细阐述:
- 配置
/etc/kubernetes/apiserver
文件
### # kubernetes system config # # The following values are used to configure the kube-apiserver # # The address on the local server to listen to. KUBE_API_ADDRESS="--address=0.0.0.0" # The port on the local server to listen on. KUBE_API_PORT="--port=8080" # Port minions listen on KUBELET_PORT="--kubelet-port=10250" # Comma separated list of nodes in the etcd cluster KUBE_ETCD_SERVERS="--etcd-servers=http://etcd:2379" # Address range to use for services KUBE_SERVICE_ADDRESSES="--service-cluster-ip-range=10.254.0.0/16" # default admission control policies # KUBE_ADMISSION_CONTROL="--admission-control=NamespaceLifecycle,NamespaceExists,LimitRanger,SecurityContextDeny,ServiceAccount,ResourceQuota" KUBE_ADMISSION_CONTROL="--admission-control=NamespaceLifecycle,NamespaceExists,LimitRanger,SecurityContextDeny,ResourceQuota" # Add your own! KUBE_API_ARGS=""
- 配置
/etc/kubernetes/config
文件
### # kubernetes system config # # The following values are used to configure various aspects of all # kubernetes services, including # # kube-apiserver.service # kube-controller-manager.service # kube-scheduler.service # kubelet.service # kube-proxy.service # logging to stderr means we get it in the systemd journal KUBE_LOGTOSTDERR="--logtostderr=true" # journal message level, 0 is debug KUBE_LOG_LEVEL="--v=0" # Should this cluster be allowed to run privileged docker containers KUBE_ALLOW_PRIV="--allow-privileged=false" # How the controller-manager, scheduler, and proxy find the apiserver KUBE_MASTER="--master=http://k8s-master:8080"
systemctl start kube-apiserver.service systemctl start kube-controller-manager.service systemctl start kube-scheduler.service
systemctl enable kube-apiserver.service systemctl enable kube-controller-manager.service systemctl enable kube-scheduler.service
部署Slave节点
slave节点需要安装以下组件:
- flannel
- docker
- kubernetes
下面按顺序阐述:
1. flannel安装
- 安装命令:
yum install flannel
- 配置flannel:
/etc/sysconfig/flanneld
# Flanneld configuration options # etcd url location. Point this to the server where etcd runs FLANNEL_ETCD_ENDPOINTS="http://etcd:2379" # etcd config key. This is the configuration key that flannel queries # For address range assignment FLANNEL_ETCD_PREFIX="/atomic.io/network" # Any additional options that you want to pass #FLANNEL_OPTIONS=""
systemctl start flanneld.service systemctl enable flanneld.service
2. docker安装
参考前文master节点上部署docker过程,此处不再赘述
3. kubernetes安装
安装命令:yum install kubernetes
不同于master节点,slave节点上需要运行kubernetes的如下组件:
下面详细阐述要配置的东西:
### # kubernetes system config # # The following values are used to configure various aspects of all # kubernetes services, including # # kube-apiserver.service # kube-controller-manager.service # kube-scheduler.service # kubelet.service # kube-proxy.service # logging to stderr means we get it in the systemd journal KUBE_LOGTOSTDERR="--logtostderr=true" # journal message level, 0 is debug KUBE_LOG_LEVEL="--v=0" # Should this cluster be allowed to run privileged docker containers KUBE_ALLOW_PRIV="--allow-privileged=false" # How the controller-manager, scheduler, and proxy find the apiserver KUBE_MASTER="--master=http://k8s-master:8080"
- 配置
/etc/kubernetes/kubelet
### # kubernetes kubelet (minion) config # The address for the info server to serve on (set to 0.0.0.0 or "" for all interfaces) KUBELET_ADDRESS="--address=0.0.0.0" # The port for the info server to serve on # KUBELET_PORT="--port=10250" # You may leave this blank to use the actual hostname KUBELET_HOSTNAME="--hostname-override=k8s-node-1" # location of the api-server KUBELET_API_SERVER="--api-servers=http://k8s-master:8080" # pod infrastructure container KUBELET_POD_INFRA_CONTAINER="--pod-infra-container-image=registry.access.redhat.com/rhel7/pod-infrastructure:latest" # Add your own! KUBELET_ARGS=""
systemctl start kubelet.service systemctl start kube-proxy.service
systemctl enable kubelet.service systemctl enable kube-proxy.service
至此为止,k8s集群的搭建过程就完成了,下面来验证一下集群是否搭建成功了
验证集群状态
- 查看端点信息:
kubectl get endpoints
- 查看集群信息:
kubectl cluster-info
- 获取集群中的节点状态:
kubectl get nodes
OK,节点已经就绪,可以在上面做实验了!
参考文献