容器技术之Docker私有镜像仓库harbor

时间：2020-06-08来源：www.pcxitongcheng.com作者：电脑系统城

从前文的搭建和使用过程来看，docker-distribution搭建的仓库非常简陋，它甚至连一个用户认证都没有，更别提多用户；今天我们来介绍另外一款docker仓库工具harbor；harbor这款工具相对docker-distribution来讲功能上丰富了许多；它支持多租户，可扩展的API和web ui ，支持跨多个harbor实例的镜像复制，支持身份集成和基于角色的访问控制等等特征；接下来我们来安装看看harbor吧；

　　首先我们要去官网下载安装器，目前最新版本是2.0；下载地址https://github.com/goharbor/harbor/releases/tag/v2.0.0；harbor的安装器有在线和离线两个版本，在线包通常较小，适用于网络环境较好地环境中使用，离线包是所有的安装文件和脚本等等打包在一起的；

　　1、上传已经下载好的安装器到服务器

　　2、解压安装器，并进入到解压后的目录中

1
2
3
4
5
6
7 [root@docker_node01 ~]# tar xf harbor-offline-installer-v2.0.0.tgz -C /usr/local/
[root@docker_node01 ~]# ls /usr/local/
bin etc games harbor include lib lib64 libexec sbin share src
[root@docker_node01 ~]# cd /usr/local/harbor/
[root@docker_node01 harbor]# ls
common.sh harbor.v2.0.0.tar.gz harbor.yml.tmpl install.sh LICENSE prepare
[root@docker_node01 harbor]#

　　3、编辑harbor.yml.tmpl文件，更改必要的配置

　　提示：以上我只修改了hostname的值，后面的我都是用默认值；有关这个配置文件的说明，可参考官方文档说明去配置；这里需要注意一点使用https需要自己手动的去申请证书，没有证书文件harbor是不能够正常安装的；

　　4、把harbor.yml.tmpl重命名为harbor.yml

1
2
3
4 [root@docker_node01 harbor]# ls
common.sh harbor.v2.0.0.tar.gz harbor.yml.tmpl install.sh LICENSE prepare
[root@docker_node01 harbor]# mv harbor.yml.tmpl harbor.yml
[root@docker_node01 harbor]#

　　5、运行install.sh

　　提示：如果运行install.sh脚本出现以上错误，我们需要先安装好docker-compose;

　　6、安装docker-compose

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32 [root@docker_node01 harbor]# yum install docker-compose -y
Loaded plugins: fastestmirror
base | 3.6 kB 00:00:00
docker-ce-stable | 3.5 kB 00:00:00
epel | 4.7 kB 00:00:00
extras | 2.9 kB 00:00:00
updates | 2.9 kB 00:00:00
(1/3): updates/7/x86_64/primary_db | 2.1 MB 00:00:00
(2/3): epel/x86_64/updateinfo | 1.0 MB 00:00:01
(3/3): epel/x86_64/primary_db | 6.8 MB 00:00:03
Loading mirror speeds from cached hostfile
* base: mirrors.aliyun.com
* extras: mirrors.aliyun.com
* updates: mirror.bit.edu.cn
Resolving Dependencies
--> Running transaction check
---> Package docker-compose.noarch 0:1.18.0-4.el7 will be installed
--> Processing Dependency: python36-cached_property >= 1.2.0 for package: docker-compose-1.18.0-4.el7.noarch
--> Processing Dependency: python36-docker >= 2.6.1 for package: docker-compose-1.18.0-4.el7.noarch
……省略部分内容
Installed:
docker-compose.noarch 0:1.18.0-4.el7

Dependency Installed:
python36-PyYAML.x86_64 0:3.13-1.el7 python36-cached_property.noarch 0:1.5.1-2.el7 python36-chardet.noarch 0:3.0.4-1.el7
python36-docker.noarch 0:2.6.1-3.el7 python36-docker-pycreds.noarch 0:0.2.1-2.el7 python36-dockerpty.noarch 0:0.4.1-18.el7
python36-docopt.noarch 0:0.6.2-8.el7 python36-idna.noarch 0:2.7-2.el7 python36-jsonschema.noarch 0:2.5.1-4.el7
python36-pysocks.noarch 0:1.6.8-7.el7 python36-requests.noarch 0:2.14.2-2.el7 python36-six.noarch 0:1.14.0-2.el7
python36-texttable.noarch 0:1.6.2-1.el7 python36-urllib3.noarch 0:1.25.6-1.el7 python36-websocket-client.noarch 0:0.47.0-2.el7

Complete!
[root@docker_node01 harbor]#

　　提示：docker-compose是docker容器的单机编排工具；

　　7、再运行install.sh脚本

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169 [root@docker_node01 harbor]# ./install.sh

[Step 0]: checking if docker is installed ...

Note: docker version: 19.03.8

[Step 1]: checking docker-compose is installed ...

Note: docker-compose version: 1.18.0

[Step 2]: loading Harbor images ...
dbaf2c918102: Loading layer [==================================================>] 34.5MB/34.5MB
1f3458bb7308: Loading layer [==================================================>] 8.435MB/8.435MB
74e91bd5ca15: Loading layer [==================================================>] 6.317MB/6.317MB
82da861dccd3: Loading layer [==================================================>] 14.61MB/14.61MB
8d62f2bfdf94: Loading layer [==================================================>] 28.25MB/28.25MB
40510e398799: Loading layer [==================================================>] 22.02kB/22.02kB
6941a908d292: Loading layer [==================================================>] 49.17MB/49.17MB
Loaded image: goharbor/notary-signer-photon:v2.0.0
bd70463b9e5a: Loading layer [==================================================>] 8.441MB/8.441MB
d3927e3c53ea: Loading layer [==================================================>] 3.584kB/3.584kB
a3b2acbb8f7d: Loading layer [==================================================>] 3.072kB/3.072kB
de14f7f144ce: Loading layer [==================================================>] 9.71MB/9.71MB
94c03f31b276: Loading layer [==================================================>] 10.53MB/10.53MB
Loaded image: goharbor/clair-adapter-photon:v2.0.0
935e17d700d1: Loading layer [==================================================>] 8.44MB/8.44MB
eef8d67e9248: Loading layer [==================================================>] 42.3MB/42.3MB
a181769f3c52: Loading layer [==================================================>] 3.072kB/3.072kB
4b801e4d76d7: Loading layer [==================================================>] 3.584kB/3.584kB
7f7c81a33722: Loading layer [==================================================>] 43.12MB/43.12MB
Loaded image: goharbor/chartmuseum-photon:v2.0.0
4076b322e7f5: Loading layer [==================================================>] 49.89MB/49.89MB
da16bbe3a170: Loading layer [==================================================>] 3.584kB/3.584kB
f8967a1d9155: Loading layer [==================================================>] 3.072kB/3.072kB
6b7eaf984fde: Loading layer [==================================================>] 2.56kB/2.56kB
4406aea83cb2: Loading layer [==================================================>] 3.072kB/3.072kB
78566a971bf2: Loading layer [==================================================>] 3.584kB/3.584kB
e4e05e2ffdad: Loading layer [==================================================>] 12.29kB/12.29kB
f3bcf1de026d: Loading layer [==================================================>] 5.632kB/5.632kB
Loaded image: goharbor/harbor-log:v2.0.0
101133a0a2e6: Loading layer [==================================================>] 8.441MB/8.441MB
40eb3ab360dd: Loading layer [==================================================>] 3.584kB/3.584kB
172ace267ace: Loading layer [==================================================>] 20.94MB/20.94MB
cb361129c579: Loading layer [==================================================>] 3.072kB/3.072kB
f0221c34f9dc: Loading layer [==================================================>] 8.721MB/8.721MB
1880cedc9407: Loading layer [==================================================>] 30.48MB/30.48MB
Loaded image: goharbor/harbor-registryctl:v2.0.0
15f399ca8b42: Loading layer [==================================================>] 8.441MB/8.441MB
182251d62618: Loading layer [==================================================>] 3.584kB/3.584kB
c72ce5e8bba9: Loading layer [==================================================>] 3.072kB/3.072kB
6cb620513867: Loading layer [==================================================>] 20.94MB/20.94MB
8f68617c13e6: Loading layer [==================================================>] 21.76MB/21.76MB
Loaded image: goharbor/registry-photon:v2.0.0
464d98f962d2: Loading layer [==================================================>] 115.2MB/115.2MB
6f577ce93b49: Loading layer [==================================================>] 12.15MB/12.15MB
468b747374fb: Loading layer [==================================================>] 3.072kB/3.072kB
c7d4e40274a2: Loading layer [==================================================>] 49.15kB/49.15kB
349c2528bf8f: Loading layer [==================================================>] 3.584kB/3.584kB
50765adb1994: Loading layer [==================================================>] 13.03MB/13.03MB
Loaded image: goharbor/clair-photon:v2.0.0
f3ae9281f64f: Loading layer [==================================================>] 16.04MB/16.04MB
79de921bba64: Loading layer [==================================================>] 28.25MB/28.25MB
a4826ccd0680: Loading layer [==================================================>] 22.02kB/22.02kB
527c0492bb8a: Loading layer [==================================================>] 50.6MB/50.6MB
Loaded image: goharbor/notary-server-photon:v2.0.0
da380ff7675f: Loading layer [==================================================>] 39.44MB/39.44MB
3e72063a3c12: Loading layer [==================================================>] 3.072kB/3.072kB
87063a362784: Loading layer [==================================================>] 59.9kB/59.9kB
12042912d563: Loading layer [==================================================>] 61.95kB/61.95kB
Loaded image: goharbor/redis-photon:v2.0.0
497d39fd8ed4: Loading layer [==================================================>] 10.28MB/10.28MB
Loaded image: goharbor/nginx-photon:v2.0.0
db89bcd4a7aa: Loading layer [==================================================>] 12.22MB/12.22MB
a3c69d8e6487: Loading layer [==================================================>] 3.072kB/3.072kB
22888c961e12: Loading layer [==================================================>] 2.56kB/2.56kB
15c04c0d67b3: Loading layer [==================================================>] 46.5MB/46.5MB
5e59e5738914: Loading layer [==================================================>] 5.632kB/5.632kB
2fb21742e876: Loading layer [==================================================>] 51.2kB/51.2kB
ebe005c22385: Loading layer [==================================================>] 47.32MB/47.32MB
e91a77a1cc5d: Loading layer [==================================================>] 2.56kB/2.56kB
Loaded image: goharbor/harbor-core:v2.0.0
c9ad3414e408: Loading layer [==================================================>] 63.57MB/63.57MB
0aea7ae12d77: Loading layer [==================================================>] 60.58MB/60.58MB
c3be2cda3349: Loading layer [==================================================>] 5.632kB/5.632kB
970c1e4372ae: Loading layer [==================================================>] 2.048kB/2.048kB
51e00ddbcdac: Loading layer [==================================================>] 2.56kB/2.56kB
27d44e884cd0: Loading layer [==================================================>] 2.56kB/2.56kB
3086c2ee0489: Loading layer [==================================================>] 2.56kB/2.56kB
efd18d9ef79c: Loading layer [==================================================>] 10.24kB/10.24kB
Loaded image: goharbor/harbor-db:v2.0.0
ad0a4ed99dd0: Loading layer [==================================================>] 12.22MB/12.22MB
50121125e459: Loading layer [==================================================>] 3.072kB/3.072kB
6d05b39a8c44: Loading layer [==================================================>] 2.56kB/2.56kB
5380ddc5210f: Loading layer [==================================================>] 35.68MB/35.68MB
e8053e60aee7: Loading layer [==================================================>] 36.5MB/36.5MB
Loaded image: goharbor/harbor-jobservice:v2.0.0
9fefe33a31db: Loading layer [==================================================>] 9.741MB/9.741MB
a52a9b417697: Loading layer [==================================================>] 3.584kB/3.584kB
9b6c54642038: Loading layer [==================================================>] 3.072kB/3.072kB
6a32c528face: Loading layer [==================================================>] 20.34MB/20.34MB
526552ecb5a3: Loading layer [==================================================>] 9.317MB/9.317MB
bc3e72205f25: Loading layer [==================================================>] 30.48MB/30.48MB
Loaded image: goharbor/trivy-adapter-photon:v2.0.0
51193d3ba093: Loading layer [==================================================>] 77.29MB/77.29MB
398b7c3413c0: Loading layer [==================================================>] 48.31MB/48.31MB
cb902b44bae6: Loading layer [==================================================>] 2.56kB/2.56kB
11d3bf655c22: Loading layer [==================================================>] 1.536kB/1.536kB
3d373d988076: Loading layer [==================================================>] 18.43kB/18.43kB
755d5115a4fd: Loading layer [==================================================>] 3.751MB/3.751MB
5d456b2e2b47: Loading layer [==================================================>] 249.3kB/249.3kB
Loaded image: goharbor/prepare:v2.0.0
2128feaae029: Loading layer [==================================================>] 10.28MB/10.28MB
c1e2c6faf4a4: Loading layer [==================================================>] 8.487MB/8.487MB
8728e424e45b: Loading layer [==================================================>] 178.7kB/178.7kB
243de4b81324: Loading layer [==================================================>] 157.2kB/157.2kB
1909dd7d54dc: Loading layer [==================================================>] 33.28kB/33.28kB
e91e103cac7d: Loading layer [==================================================>] 17.41kB/17.41kB
ef43ac036ce0: Loading layer [==================================================>] 15.36kB/15.36kB
3205feaa4e7b: Loading layer [==================================================>] 3.584kB/3.584kB
Loaded image: goharbor/harbor-portal:v2.0.0

[Step 3]: preparing environment ...

[Step 4]: preparing harbor configs ...
prepare base dir is set to /usr/local/harbor
WARNING:root:WARNING: HTTP protocol is insecure. Harbor will deprecate http protocol in the future. Please make sure to upgrade to https
Clearing the configuration file: /config/log/logrotate.conf
Clearing the configuration file: /config/log/rsyslog_docker.conf
Clearing the configuration file: /config/nginx/nginx.conf
Clearing the configuration file: /config/core/env
Clearing the configuration file: /config/core/app.conf
Clearing the configuration file: /config/registry/passwd
Clearing the configuration file: /config/registry/config.yml
Clearing the configuration file: /config/registry/root.crt
Clearing the configuration file: /config/registryctl/env
Clearing the configuration file: /config/registryctl/config.yml
Clearing the configuration file: /config/db/env
Clearing the configuration file: /config/jobservice/env
Clearing the configuration file: /config/jobservice/config.yml
Generated configuration file: /config/log/logrotate.conf
Generated configuration file: /config/log/rsyslog_docker.conf
Generated configuration file: /config/nginx/nginx.conf
Generated configuration file: /config/core/env
Generated configuration file: /config/core/app.conf
Generated configuration file: /config/registry/config.yml
Generated configuration file: /config/registryctl/env
Generated configuration file: /config/registryctl/config.yml
Generated configuration file: /config/db/env
Generated configuration file: /config/jobservice/env
Creating harbor-log ... done
loaded secret from file: /data/secret/keys/secretkey
Generated configuration file: /compose_location/docker-compose.yml
Clean up the input dir

Creating harbor-db ... done
Creating harbor-core ... done
[Step 5]: starting Harbor ...
Creating nginx ... done
Creating registry ...
Creating harbor-db ...
Creating redis ...
Creating harbor-portal ...
Creating registryctl ...
Creating harbor-core ...
Creating harbor-jobservice ...
Creating nginx ...
✔ ----Harbor has been installed and started successfully.----
[root@docker_node01 harbor]#

　　提示：从上面的信息可以看到harbor导入了很多镜像，然后基于各个镜像间的关系提供配置文件，然后按照一定的依赖关系顺序启动为容器；我们用docker images 可以来看看它导入了那些镜像

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30 [root@docker_node01 harbor]# docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
goharbor/chartmuseum-photon v2.0.0 4db8d6aa63e9 3 weeks ago 127MB
goharbor/redis-photon v2.0.0 c89ea2e53cc0 3 weeks ago 72.2MB
goharbor/trivy-adapter-photon v2.0.0 6122c52b7e48 3 weeks ago 103MB
goharbor/clair-adapter-photon v2.0.0 dd2210cb7f53 3 weeks ago 62MB
goharbor/clair-photon v2.0.0 f7c7fcc52278 3 weeks ago 171MB
goharbor/notary-server-photon v2.0.0 983ac10ed8be 3 weeks ago 143MB
goharbor/notary-signer-photon v2.0.0 bee1b6d75e0d 3 weeks ago 140MB
goharbor/harbor-registryctl v2.0.0 c53c32d58d04 3 weeks ago 102MB
goharbor/registry-photon v2.0.0 afdc1b7ada36 3 weeks ago 84.5MB
goharbor/nginx-photon v2.0.0 17892f03e56c 3 weeks ago 43.6MB
goharbor/harbor-log v2.0.0 5f8ff08e795c 3 weeks ago 82MB
goharbor/harbor-jobservice v2.0.0 c68a2495bf55 3 weeks ago 116MB
goharbor/harbor-core v2.0.0 3aa3af64baf8 3 weeks ago 138MB
goharbor/harbor-portal v2.0.0 e0b1d3c894c4 3 weeks ago 52.4MB
goharbor/harbor-db v2.0.0 5c76f0296cec 3 weeks ago 154MB
goharbor/prepare v2.0.0 7266d49995ed 3 weeks ago 158MB
[root@docker_node01 harbor]# docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
909486114bab goharbor/nginx-photon:v2.0.0 "nginx -g 'daemon of…" 2 minutes ago Up 2 minutes (healthy) 0.0.0.0:80->8080/tcp nginx
201af4781190 goharbor/harbor-jobservice:v2.0.0 "/harbor/entrypoint.…" 2 minutes ago Up 2 minutes (healthy) harbor-jobservice
d926598a1b4b goharbor/harbor-core:v2.0.0 "/harbor/entrypoint.…" 2 minutes ago Up 2 minutes (healthy) harbor-core
b655e8bb9da3 goharbor/harbor-portal:v2.0.0 "nginx -g 'daemon of…" 2 minutes ago Up 2 minutes (healthy) 8080/tcp harbor-portal
596d050acf8b goharbor/registry-photon:v2.0.0 "/home/harbor/entryp…" 2 minutes ago Up 2 minutes (healthy) 5000/tcp registry
88a6b3335d25 goharbor/harbor-registryctl:v2.0.0 "/home/harbor/start.…" 2 minutes ago Up 2 minutes (healthy) registryctl
cf8db1840524 goharbor/harbor-db:v2.0.0 "/docker-entrypoint.…" 2 minutes ago Up 2 minutes (healthy) 5432/tcp harbor-db
5d522f8f3c38 goharbor/redis-photon:v2.0.0 "redis-server /etc/r…" 2 minutes ago Up 2 minutes (healthy) 6379/tcp redis
020fbf3571a2 goharbor/harbor-log:v2.0.0 "/bin/sh -c /usr/loc…" 2 minutes ago Up 2 minutes (healthy) 127.0.0.1:1514->10514/tcp harbor-log
[root@docker_node01 harbor]#

　　提示：可以看到本地仓库中多了很多镜像，同时也启动了很多容器；其中名为nginx的容器把80端口暴露到数组机上了；到此harbor就安装好了；接下来我们访问宿主机的80端口看看是否能够访问到harbor

　　提示：以上就是harbor的web 页面，默认用户名是admin密码是Harbor12345

　　登录harbor web页面

　　提示：我们就可以基于这个web页面来做管理了；接下来我们先创建一个用户和项目，然后在通过docker push上传镜像到harbor上

　　创建用户

　　提示：填写好以上信息，点击确定用户就创建好了；

　　创建项目

　　提示：如果创建的项目是私有的，把访问级别后面的公开对勾取消即可

　　从别的docker主机上上传镜像到harbor

　　提示：使用非https的仓库必须要在daemon.json文件中配置insecure-registries来声明不安全的镜像仓库地址；

　　提示：这里提示我们未授权；接下来我们去web管理页面授权qiuhom是test项目的成员；

　　提示：现在我们把qiuhom这个用户设置为test这个项目的管理员，现在我们在以qiuhom的身份推镜像到test项目中，看看是否能够成功把进行推送到harbor上？

1
2
3
4
5
6
7
8 [root@docker_node02 ~]# docker push node01.docker-registry.io/test/nginx:1.14-alpine
The push refers to repository [node01.docker-registry.io/test/nginx]
076c58d2644f: Pushed
b2cbae4b8c15: Pushed
5ac9a5170bf2: Pushed
a464c54f93a9: Pushed
1.14-alpine: digest: sha256:a3a0c4126587884f8d3090efca87f5af075d7e7ac8308cffc09a5a082d5f4760 size: 1153
[root@docker_node02 ~]#

　　提示：这次推送镜像没有报错，我们去web页面中看看镜像是否推送到test项目中去了？

　　验证：在harborweb界面看看是否有我们推上去的镜像？

　　用其他docker主机下载harbor上的镜像

　　提示：可以看到现在我们搭建的harbor是可以正常下载和上传镜像的；管理镜像我们可以通过web页面管理即可，我这里就不去演示了；接下来我们再来说说在命令行用docker-compose启动harbor和停止harbor吧

　　停止harbor

　　提示：用docker-compose停止harbor需要先进入到harbor目录下，然后执行docker-compose stop 这条命令会去寻找docker-compose.yml文件，根据文件中定义的服务来停止容器；这个有点类似docker build命令，找Dockerfile文件，而docker-compose 是找docker-compose.yml；这里还需要注意一点的是这个文件名必须是docker-compose.yml；

　　启动harbor