zaki work log

作業ログやら生活ログやらなんやら

Red Hat CodeReady Containers(1.0.0-rc)を入れてOpenShift 4をローカルで動かしてみた(成功編)

昨夜~今朝でストレージ不足で成功しなかったRed Hat CodeReady ContainersでローカルOpenShift 4にチャレンジ。
必要なのはRed Hatの開発者アカウント(無料)

細かい手順は失敗編のこちら zaki-hmkc.hatenablog.com

VMの準備(主にストレージ)

[zaki@codeready ~]$ df -h
Filesystem               Size  Used Avail Use% Mounted on
/dev/mapper/centos-root   76G  978M   75G   2% /
devtmpfs                 3.9G     0  3.9G   0% /dev
tmpfs                    3.9G     0  3.9G   0% /dev/shm
tmpfs                    3.9G  8.9M  3.9G   1% /run
tmpfs                    3.9G     0  3.9G   0% /sys/fs/cgroup
/dev/sda1               1014M  142M  873M  14% /boot
tmpfs                    783M     0  783M   0% /run/user/1000
[zaki@codeready ~]$ 

よし、やるぞ。

手順おさらい

バイナリのダウンロードとPATH設定

$ curl -LO https://mirror.openshift.com/pub/openshift-v4/clients/crc/1.0.0-rc.0/crc-linux-amd64.tar.xz
$ sudo tar xf crc-linux-amd64.tar.xz -C /usr/local/
$ sudo ln -s /usr/local/crc-linux-1.0.0-rc.0-amd64/crc /usr/local/bin/
$ crc version

実行例

[zaki@codeready ~]$ crc version
version: 1.0.0-rc.0+34371d3
OpenShift version: 4.2.0-0.nightly-2019-09-26-192831 (embedded in binary)

設定ファイルも勝手に作成される

[zaki@codeready ~]$ ls .crc/
crc.json  crc.log

必要ソフトウェア

$ rpm -qa | grep NetworkManager
$ rpm -qa | grep libvirt

NetworkManagerは最初から入ってるはず。
libvirtは入っていなくても次のCodeReadyのセットアップでinstallされるので大丈夫。 おそらくNetworkManagerも入ってなければinstallされそう。

CodeReadyのセットアップ

$ crc setup

こんな感じ

[zaki@codeready ~]$ crc setup
INFO Checking if running as non-root              
INFO Caching oc binary                            
INFO Setting up virtualization                    
INFO Setting up KVM                               
INFO Installing libvirt service and dependencies  
INFO Will use root access: install virtualization related packages 
INFO Adding user to libvirt group                 
INFO Will use root access: add user to libvirt group 
INFO Enabling libvirt                             
INFO Starting libvirt service                     
INFO Will use root access: start libvirtd service 
INFO Checking if a supported libvirt version is installed 
INFO Installing crc-driver-libvirt                
INFO Removing older system-wide crc-driver-libvirt 
INFO Setting up libvirt 'crc' network             
INFO Starting libvirt 'crc' network               
INFO Checking if NetworkManager is installed      
INFO Checking if NetworkManager service is running 
INFO Writing Network Manager config for crc       
INFO Will use root access: write NetworkManager config in /etc/NetworkManager/conf.d/crc-nm-dnsmasq.conf 
INFO Will use root access: execute systemctl daemon-reload command 
INFO Will use root access: execute systemctl stop/start command 
INFO Writing dnsmasq config for crc               
INFO Will use root access: write dnsmasq configuration in /etc/NetworkManager/dnsmasq.d/crc.conf 
INFO Will use root access: execute systemctl daemon-reload command 
INFO Will use root access: execute systemctl stop/start command 
INFO Unpacking bundle from the CRC binary         
Setup is complete, you can now run 'crc start' to start a CodeReady Containers instance
[zaki@codeready ~]$ 

VMの起動

[zaki@codeready ~]$ crc start 
INFO Checking if running as non-root              
INFO Checking if oc binary is cached              
INFO Checking if Virtualization is enabled        
INFO Checking if KVM is enabled                   
INFO Checking if libvirt is installed             
INFO Checking if user is part of libvirt group    
INFO Checking if libvirt is enabled               
INFO Checking if libvirt daemon is running        
INFO Checking if a supported libvirt version is installed 
INFO Checking if crc-driver-libvirt is installed  
INFO Checking if libvirt 'crc' network is available 
INFO Checking if libvirt 'crc' network is active  
INFO Checking if NetworkManager is installed      
INFO Checking if NetworkManager service is running 
INFO Checking if /etc/NetworkManager/conf.d/crc-nm-dnsmasq.conf exists 
INFO Checking if /etc/NetworkManager/dnsmasq.d/crc.conf exists 
? Image pull secret [? for help] *******************************************************************************************************************************
:
:

INFO Loading bundle: crc_libvirt_4.2.0-0.nightly-2019-09-26-192831.crcbundle ... 
INFO Creating CodeReady Containers VM for OpenShift 4.2.0-0.nightly-2019-09-26-192831... 
INFO Verifying validity of the cluster certificates ... 
INFO Check internal and public dns query ...      
INFO Copying kubeconfig file to instance dir ...  
INFO Adding user's pull secret and cluster ID ... 
INFO Starting OpenShift cluster ... [waiting 3m]  
INFO                                              
INFO To access the cluster, first set up your environment by following 'crc oc-env' instructions 
INFO Then you can access it by running 'oc login -u developer -p developer https://api.crc.testing:6443' 
INFO To login as an admin, username is 'kubeadmin' and password is ************ 
INFO                                              
INFO You can now run 'crc console' and use these credentials to access the OpenShift web console 
CodeReady Containers instance is running
[zaki@codeready ~]$

やった!ばんざーい!

[zaki@codeready ~]$ ls -a
.   .bash_history  .bash_profile  .crc                    .kube
..  .bash_logout   .bashrc        crc-linux-amd64.tar.xz  .pki
[zaki@codeready ~]$ ls .kube/
cache  http-cache
[zaki@codeready ~]$ 

.kube/はあるけどconfigはないね。

ちなみにストレージ使用状態

[zaki@codeready ~]$ df -h
Filesystem               Size  Used Avail Use% Mounted on
/dev/mapper/centos-root   76G   39G   37G  52% /
devtmpfs                 3.9G     0  3.9G   0% /dev
tmpfs                    3.9G     0  3.9G   0% /dev/shm
tmpfs                    3.9G  9.0M  3.9G   1% /run
tmpfs                    3.9G     0  3.9G   0% /sys/fs/cgroup
/dev/sda1               1014M  142M  873M  14% /boot
tmpfs                    783M     0  783M   0% /run/user/1000

35GBじゃ足りなかった!!

OpenShiftクラスタの状態

ocコマンド

[zaki@codeready ~]$ ls .crc/bin/
crc-driver-libvirt  oc
[zaki@codeready ~]$ 

ocコマンドはここにあった。 というか(minishift使ったことあったらわかるやつだけど)crc startの出力にcrc oc-envとあるので、これを叩くとocの場所が分かるようになってる。

[zaki@codeready ~]$ crc oc-env
export PATH="/home/zaki/.crc/bin:$PATH"
# Run this command to configure your shell:
# eval $(crc oc-env)

つまり

[zaki@codeready ~]$ eval $(crc oc-env)
[zaki@codeready ~]$ which oc
~/.crc/bin/oc
[zaki@codeready ~]$ 
[zaki@codeready ~]$ oc version
Client Version: v4.3.0

oc login

oc loginのアクセス先サーバは、crc startの最後に出力されてるので、その通り実行すればOK

[zaki@codeready ~]$ oc login -u developer -p developer https://api.crc.testing:6443
The server uses a certificate signed by an unknown authority.
You can bypass the certificate check, but any data you send to the server could be intercepted by others.
Use insecure connections? (y/n): y

Login successful.

You don't have any projects. You can try to create a new project, by running

    oc new-project <projectname>

Welcome! See 'oc help' to get started.
[zaki@codeready ~]$ 
[zaki@codeready ~]$ oc whoami
developer

oc version

[zaki@codeready ~]$ oc version
Client Version: v4.3.0
Kubernetes Version: v1.14.6+73b5d76
[zaki@codeready ~]$ 
[zaki@codeready ~]$ oc get pod --all-namespaces
Error from server (Forbidden): pods is forbidden: User "developer" cannot list resource "pods" in API group "" at the cluster scope

なるほど。

admin権限でoc login

これもoc startの出力の内容を確認してログイン(パスワードも出力されてる)

[zaki@codeready ~]$ oc login -u kubeadmin 
Authentication required for https://api.crc.testing:6443 (openshift)
Username: kubeadmin
Password: 
Login successful.

You have access to 51 projects, the list has been suppressed. You can list all projects with 'oc projects'

Using project "default".
[zaki@codeready ~]$ 

podの状態

[zaki@codeready ~]$ oc get pod -A
NAMESPACE                                               NAME                                                              READY   STATUS      RESTARTS   AGE
openshift-apiserver-operator                            openshift-apiserver-operator-6db995744c-nc5pj                     1/1     Running     0          10d
openshift-apiserver                                     apiserver-d6dm8                                                   1/1     Running     2          10d
openshift-authentication-operator                       authentication-operator-668f5dd5cb-px72d                          1/1     Running     0          10d
openshift-authentication                                oauth-openshift-6b677f566b-4q49c                                  1/1     Running     0          20m
openshift-authentication                                oauth-openshift-6b677f566b-cgznk                                  1/1     Running     0          20m
openshift-cloud-credential-operator                     cloud-credential-operator-846fd45d76-zvr5b                        1/1     Running     0          10d
openshift-cluster-machine-approver                      machine-approver-d599647f4-b9bl5                                  1/1     Running     0          10d
openshift-cluster-node-tuning-operator                  cluster-node-tuning-operator-568db95869-g7g5v                     1/1     Running     0          10d
openshift-cluster-node-tuning-operator                  tuned-vb4pl                                                       1/1     Running     0          22m
openshift-cluster-samples-operator                      cluster-samples-operator-84464ff57-qb9pc                          1/1     Running     0          10d
openshift-cluster-storage-operator                      cluster-storage-operator-6bc658fc74-cq7ph                         1/1     Running     0          10d
openshift-console-operator                              console-operator-cdc56f566-hl6n5                                  1/1     Running     0          10d
openshift-console                                       console-55bf5684d6-hc9xp                                          1/1     Running     0          10d
openshift-console                                       console-55bf5684d6-r7tv8                                          1/1     Running     0          10d
openshift-console                                       downloads-5bb8997d85-brvdv                                        1/1     Running     0          10d
openshift-console                                       downloads-5bb8997d85-lzq78                                        1/1     Running     0          10d
openshift-controller-manager-operator                   openshift-controller-manager-operator-7d857c6dff-gxcfk            1/1     Running     0          10d
openshift-controller-manager                            controller-manager-xmph4                                          1/1     Running     0          9d
openshift-dns-operator                                  dns-operator-566bc5d97b-jrb7h                                     1/1     Running     0          10d
openshift-dns                                           dns-default-jb2bx                                                 2/2     Running     0          10d
openshift-etcd                                          etcd-member-crc-chc9n-master-0                                    2/2     Running     0          10d
openshift-image-registry                                cluster-image-registry-operator-97d8b7fcb-q9fss                   2/2     Running     0          10d
openshift-image-registry                                image-registry-85b59cb6d5-tp4tf                                   1/1     Running     0          10d
openshift-image-registry                                node-ca-246rk                                                     1/1     Running     0          10d
openshift-ingress-operator                              ingress-operator-fbdb949c9-kkm8f                                  1/1     Running     0          10d
openshift-ingress                                       router-default-746885fd94-tknxp                                   1/1     Running     0          10d
openshift-insights                                      insights-operator-d8b996d8f-nmwps                                 1/1     Running     0          10d
openshift-kube-apiserver-operator                       kube-apiserver-operator-5cc9ccd675-9mwfk                          1/1     Running     0          10d
openshift-kube-apiserver                                installer-10-crc-chc9n-master-0                                   0/1     Completed   0          10d
openshift-kube-apiserver                                installer-11-crc-chc9n-master-0                                   0/1     Completed   0          9d
openshift-kube-apiserver                                installer-8-crc-chc9n-master-0                                    0/1     Completed   0          10d
openshift-kube-apiserver                                installer-9-crc-chc9n-master-0                                    0/1     Completed   0          10d
openshift-kube-apiserver                                kube-apiserver-crc-chc9n-master-0                                 3/3     Running     0          9d
openshift-kube-apiserver                                revision-pruner-10-crc-chc9n-master-0                             0/1     Completed   0          10d
openshift-kube-apiserver                                revision-pruner-11-crc-chc9n-master-0                             0/1     Completed   0          9d
openshift-kube-apiserver                                revision-pruner-7-crc-chc9n-master-0                              0/1     Completed   0          10d
openshift-kube-apiserver                                revision-pruner-8-crc-chc9n-master-0                              0/1     Completed   0          10d
openshift-kube-apiserver                                revision-pruner-9-crc-chc9n-master-0                              0/1     Completed   0          10d
openshift-kube-controller-manager-operator              kube-controller-manager-operator-5dd9c9c59-94k96                  1/1     Running     0          10d
openshift-kube-controller-manager                       installer-7-crc-chc9n-master-0                                    0/1     Completed   0          10d
openshift-kube-controller-manager                       kube-controller-manager-crc-chc9n-master-0                        2/2     Running     0          10d
openshift-kube-controller-manager                       revision-pruner-6-crc-chc9n-master-0                              0/1     Completed   0          10d
openshift-kube-controller-manager                       revision-pruner-7-crc-chc9n-master-0                              0/1     Completed   0          10d
openshift-kube-scheduler-operator                       openshift-kube-scheduler-operator-545747d6f-nwwfm                 1/1     Running     0          10d
openshift-kube-scheduler                                openshift-kube-scheduler-crc-chc9n-master-0                       1/1     Running     0          10d
openshift-kube-scheduler                                revision-pruner-6-crc-chc9n-master-0                              0/1     OOMKilled   0          10d
openshift-machine-api                                   machine-api-controllers-fcb76c4d5-wgzgv                           3/3     Running     0          10d
openshift-machine-config-operator                       machine-config-daemon-96hcr                                       1/1     Running     0          10d
openshift-machine-config-operator                       machine-config-server-4vbrr                                       1/1     Running     0          10d
openshift-marketplace                                   certified-operators-66ddbd4db6-jbmw8                              1/1     Running     0          20m
openshift-marketplace                                   community-operators-6b9d5d9877-98955                              1/1     Running     0          20m
openshift-marketplace                                   marketplace-operator-7fd7d89795-2rjj9                             1/1     Running     0          10d
openshift-marketplace                                   redhat-operators-57c4d4656b-ht6cm                                 1/1     Running     0          20m
openshift-monitoring                                    alertmanager-main-0                                               3/3     Running     0          10d
openshift-monitoring                                    alertmanager-main-1                                               3/3     Running     0          10d
openshift-monitoring                                    alertmanager-main-2                                               3/3     Running     0          10d
openshift-monitoring                                    node-exporter-qb7p7                                               2/2     Running     0          10d
openshift-multus                                        multus-admission-controller-vmhqk                                 1/1     Running     0          10d
openshift-multus                                        multus-t5gzr                                                      1/1     Running     0          10d
openshift-network-operator                              network-operator-685d4878c4-bx2pd                                 1/1     Running     0          10d
openshift-operator-lifecycle-manager                    catalog-operator-765c6f78b7-9wq57                                 1/1     Running     0          10d
openshift-operator-lifecycle-manager                    olm-operator-8597cfb57-xztm8                                      1/1     Running     0          10d
openshift-operator-lifecycle-manager                    packageserver-5b76b99f6d-5mtkp                                    1/1     Running     0          20m
openshift-operator-lifecycle-manager                    packageserver-5b76b99f6d-cfxz5                                    1/1     Running     0          22m
openshift-sdn                                           ovs-4xn8v                                                         1/1     Running     0          10d
openshift-sdn                                           sdn-controller-4p7tb                                              1/1     Running     0          10d
openshift-sdn                                           sdn-fgftv                                                         1/1     Running     0          10d
openshift-service-ca-operator                           service-ca-operator-77f4fc8f5d-fxbxx                              1/1     Running     0          10d
openshift-service-ca                                    apiservice-cabundle-injector-5b97d64df-kctxh                      1/1     Running     0          10d
openshift-service-ca                                    configmap-cabundle-injector-79989ddcb9-bn7xw                      1/1     Running     0          10d
openshift-service-ca                                    service-serving-cert-signer-7787d496cf-rdg7m                      1/1     Running     0          10d
openshift-service-catalog-apiserver-operator            openshift-service-catalog-apiserver-operator-8564d47db4-bg6zz     1/1     Running     0          10d
openshift-service-catalog-controller-manager-operator   openshift-service-catalog-controller-manager-operator-797dz8rdw   1/1     Running     0          10d

ひゅー (-Aが使えるのが地味に嬉しいw)

node、PVの状態

[zaki@codeready ~]$ oc get node
NAME                 STATUS   ROLES           AGE   VERSION
crc-chc9n-master-0   Ready    master,worker   10d   v1.14.6+12a7c657c
[zaki@codeready ~]$ 
[zaki@codeready ~]$ oc get pv
NAME     CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS      CLAIM   STORAGECLASS   REASON   AGE
pv0001   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0002   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0003   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0004   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0005   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0006   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0007   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0008   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0009   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0010   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0011   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0012   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0013   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0014   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0015   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0016   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0017   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0018   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0019   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0020   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0021   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0022   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0023   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0024   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0025   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0026   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0027   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0028   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0029   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d
pv0030   10Gi       RWO,ROX,RWX    Recycle          Available                                   10d

imagestreamの状態

[zaki@codeready ~]$ oc get is -A
NAMESPACE   NAME                                           IMAGE REPOSITORY                                                                                                 TAGS                                                  UPDATED
openshift   apicast-gateway                                default-route-openshift-image-registry.apps-crc.testing/openshift/apicast-gateway                                2.1.0.GA,2.2.0.GA,2.3.0.GA,2.4.0.GA + 2 more...       10 days ago
openshift   apicurito-ui                                   default-route-openshift-image-registry.apps-crc.testing/openshift/apicurito-ui                                   1.2,1.3                                               10 days ago
openshift   cli                                            default-route-openshift-image-registry.apps-crc.testing/openshift/cli                                            latest                                                
openshift   cli-artifacts                                  default-route-openshift-image-registry.apps-crc.testing/openshift/cli-artifacts                                  latest                                                10 days ago
openshift   dotnet                                         default-route-openshift-image-registry.apps-crc.testing/openshift/dotnet                                         2.1,2.2,latest                                        10 days ago
openshift   dotnet-runtime                                 default-route-openshift-image-registry.apps-crc.testing/openshift/dotnet-runtime                                 2.1,2.2,latest                                        10 days ago
openshift   eap-cd-openshift                               default-route-openshift-image-registry.apps-crc.testing/openshift/eap-cd-openshift                               12,12.0,13,13.0,14,14.0,15,15.0,16,16.0 + 1 more...   10 days ago
openshift   fis-java-openshift                             default-route-openshift-image-registry.apps-crc.testing/openshift/fis-java-openshift                             1.0,2.0                                               10 days ago
openshift   fis-karaf-openshift                            default-route-openshift-image-registry.apps-crc.testing/openshift/fis-karaf-openshift                            1.0,2.0                                               10 days ago
openshift   fuse-apicurito-generator                       default-route-openshift-image-registry.apps-crc.testing/openshift/fuse-apicurito-generator                       1.2,1.3                                               10 days ago
openshift   fuse7-console                                  default-route-openshift-image-registry.apps-crc.testing/openshift/fuse7-console                                  1.0,1.1,1.2,1.3                                       10 days ago
openshift   fuse7-eap-openshift                            default-route-openshift-image-registry.apps-crc.testing/openshift/fuse7-eap-openshift                            1.0,1.1,1.2,1.3                                       10 days ago
openshift   fuse7-java-openshift                           default-route-openshift-image-registry.apps-crc.testing/openshift/fuse7-java-openshift                           1.0,1.1,1.2,1.3                                       10 days ago
openshift   fuse7-karaf-openshift                          default-route-openshift-image-registry.apps-crc.testing/openshift/fuse7-karaf-openshift                          1.0,1.1,1.2,1.3                                       10 days ago
openshift   golang                                         default-route-openshift-image-registry.apps-crc.testing/openshift/golang                                         1.11.5,latest                                         10 days ago
openshift   httpd                                          default-route-openshift-image-registry.apps-crc.testing/openshift/httpd                                          2.4,latest                                            10 days ago
openshift   installer                                      default-route-openshift-image-registry.apps-crc.testing/openshift/installer                                      latest                                                10 days ago
openshift   installer-artifacts                            default-route-openshift-image-registry.apps-crc.testing/openshift/installer-artifacts                            latest                                                
openshift   java                                           default-route-openshift-image-registry.apps-crc.testing/openshift/java                                           11,8,latest                                           10 days ago
openshift   jboss-amq-62                                   default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-amq-62                                   1.1,1.2,1.3,1.4,1.5,1.6,1.7                           10 days ago
openshift   jboss-amq-63                                   default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-amq-63                                   1.0,1.1,1.2,1.3,1.4                                   10 days ago
openshift   jboss-datagrid65-client-openshift              default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-datagrid65-client-openshift              1.0,1.1                                               10 days ago
openshift   jboss-datagrid65-openshift                     default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-datagrid65-openshift                     1.2,1.3,1.4,1.5,1.6                                   10 days ago
openshift   jboss-datagrid71-client-openshift              default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-datagrid71-client-openshift              1.0                                                   10 days ago
openshift   jboss-datagrid71-openshift                     default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-datagrid71-openshift                     1.0,1.1,1.2,1.3                                       10 days ago
openshift   jboss-datagrid72-openshift                     default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-datagrid72-openshift                     1.0,1.1,1.2                                           10 days ago
openshift   jboss-datagrid73-openshift                     default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-datagrid73-openshift                     1.0,1.1                                               10 days ago
openshift   jboss-datavirt64-driver-openshift              default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-datavirt64-driver-openshift              1.0,1.1,1.2,1.3,1.4,1.5,1.6                           10 days ago
openshift   jboss-datavirt64-openshift                     default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-datavirt64-openshift                     1.0,1.1,1.2,1.3,1.4,1.5,1.6                           10 days ago
openshift   jboss-decisionserver64-openshift               default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-decisionserver64-openshift               1.0,1.1,1.2,1.3,1.4,1.5                               10 days ago
openshift   jboss-eap64-openshift                          default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap64-openshift                          1.1,1.2,1.3,1.4,1.5,1.6,1.7,1.8,1.9 + 1 more...       10 days ago
openshift   jboss-eap70-openshift                          default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap70-openshift                          1.3,1.4,1.5,1.6,1.7                                   10 days ago
openshift   jboss-eap71-openshift                          default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap71-openshift                          1.1,1.2,1.3,1.4,latest                                10 days ago
openshift   jboss-eap72-openshift                          default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap72-openshift                          1.0,latest                                            10 days ago
openshift   jboss-fuse70-console                           default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-fuse70-console                           1.0                                                   10 days ago
openshift   jboss-fuse70-eap-openshift                     default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-fuse70-eap-openshift                     1.0                                                   10 days ago
openshift   jboss-fuse70-java-openshift                    default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-fuse70-java-openshift                    1.0                                                   10 days ago
openshift   jboss-fuse70-karaf-openshift                   default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-fuse70-karaf-openshift                   1.0                                                   10 days ago
openshift   jboss-processserver64-openshift                default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-processserver64-openshift                1.0,1.1,1.2,1.3,1.4,1.5                               10 days ago
openshift   jboss-webserver30-tomcat7-openshift            default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-webserver30-tomcat7-openshift            1.1,1.2,1.3                                           10 days ago
openshift   jboss-webserver30-tomcat8-openshift            default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-webserver30-tomcat8-openshift            1.1,1.2,1.3                                           10 days ago
openshift   jboss-webserver31-tomcat7-openshift            default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-webserver31-tomcat7-openshift            1.0,1.1,1.2,1.3,1.4                                   10 days ago
openshift   jboss-webserver31-tomcat8-openshift            default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-webserver31-tomcat8-openshift            1.0,1.1,1.2,1.3,1.4                                   10 days ago
openshift   jboss-webserver50-tomcat9-openshift            default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-webserver50-tomcat9-openshift            1.0,1.1,1.2,latest                                    10 days ago
openshift   jenkins                                        default-route-openshift-image-registry.apps-crc.testing/openshift/jenkins                                        2,latest                                              10 days ago
openshift   jenkins-agent-maven                            default-route-openshift-image-registry.apps-crc.testing/openshift/jenkins-agent-maven                            latest,v4.0                                           10 days ago
openshift   jenkins-agent-nodejs                           default-route-openshift-image-registry.apps-crc.testing/openshift/jenkins-agent-nodejs                           latest,v4.0                                           10 days ago
openshift   mariadb                                        default-route-openshift-image-registry.apps-crc.testing/openshift/mariadb                                        10.2,latest                                           10 days ago
openshift   modern-webapp                                  default-route-openshift-image-registry.apps-crc.testing/openshift/modern-webapp                                  10.x,latest                                           10 days ago
openshift   mongodb                                        default-route-openshift-image-registry.apps-crc.testing/openshift/mongodb                                        3.2,3.4,3.6,latest                                    10 days ago
openshift   must-gather                                    default-route-openshift-image-registry.apps-crc.testing/openshift/must-gather                                    latest                                                10 days ago
openshift   mysql                                          default-route-openshift-image-registry.apps-crc.testing/openshift/mysql                                          5.7,8.0,latest                                        10 days ago
openshift   nginx                                          default-route-openshift-image-registry.apps-crc.testing/openshift/nginx                                          1.10,1.12,latest                                      10 days ago
openshift   nodejs                                         default-route-openshift-image-registry.apps-crc.testing/openshift/nodejs                                         10,8,8-RHOAR,latest                                   10 days ago
openshift   openjdk-11-rhel7                               default-route-openshift-image-registry.apps-crc.testing/openshift/openjdk-11-rhel7                               1.0                                                   10 days ago
openshift   perl                                           default-route-openshift-image-registry.apps-crc.testing/openshift/perl                                           5.24,5.26,latest                                      10 days ago
openshift   php                                            default-route-openshift-image-registry.apps-crc.testing/openshift/php                                            7.0,7.1,7.2,latest                                    10 days ago
openshift   postgresql                                     default-route-openshift-image-registry.apps-crc.testing/openshift/postgresql                                     10,9.6,latest                                         10 days ago
openshift   python                                         default-route-openshift-image-registry.apps-crc.testing/openshift/python                                         2.7,3.5,3.6,latest                                    10 days ago
openshift   redhat-openjdk18-openshift                     default-route-openshift-image-registry.apps-crc.testing/openshift/redhat-openjdk18-openshift                     1.0,1.1,1.2,1.3,1.4,1.5                               10 days ago
openshift   redhat-sso70-openshift                         default-route-openshift-image-registry.apps-crc.testing/openshift/redhat-sso70-openshift                         1.3,1.4                                               10 days ago
openshift   redhat-sso71-openshift                         default-route-openshift-image-registry.apps-crc.testing/openshift/redhat-sso71-openshift                         1.0,1.1,1.2,1.3                                       10 days ago
openshift   redhat-sso72-openshift                         default-route-openshift-image-registry.apps-crc.testing/openshift/redhat-sso72-openshift                         1.0,1.1,1.2,1.3,1.4                                   10 days ago
openshift   redhat-sso73-openshift                         default-route-openshift-image-registry.apps-crc.testing/openshift/redhat-sso73-openshift                         1.0,latest                                            10 days ago
openshift   redis                                          default-route-openshift-image-registry.apps-crc.testing/openshift/redis                                          3.2,latest                                            10 days ago
openshift   rhdm73-decisioncentral-indexing-openshift      default-route-openshift-image-registry.apps-crc.testing/openshift/rhdm73-decisioncentral-indexing-openshift      1.0,1.1                                               10 days ago
openshift   rhdm73-decisioncentral-openshift               default-route-openshift-image-registry.apps-crc.testing/openshift/rhdm73-decisioncentral-openshift               1.0,1.1                                               10 days ago
openshift   rhdm73-kieserver-openshift                     default-route-openshift-image-registry.apps-crc.testing/openshift/rhdm73-kieserver-openshift                     1.0,1.1                                               10 days ago
openshift   rhdm73-optaweb-employee-rostering-openshift    default-route-openshift-image-registry.apps-crc.testing/openshift/rhdm73-optaweb-employee-rostering-openshift    1.0,1.1                                               10 days ago
openshift   rhpam73-businesscentral-indexing-openshift     default-route-openshift-image-registry.apps-crc.testing/openshift/rhpam73-businesscentral-indexing-openshift     1.0,1.1                                               10 days ago
openshift   rhpam73-businesscentral-monitoring-openshift   default-route-openshift-image-registry.apps-crc.testing/openshift/rhpam73-businesscentral-monitoring-openshift   1.0,1.1                                               10 days ago
openshift   rhpam73-businesscentral-openshift              default-route-openshift-image-registry.apps-crc.testing/openshift/rhpam73-businesscentral-openshift              1.0,1.1                                               10 days ago
openshift   rhpam73-kieserver-openshift                    default-route-openshift-image-registry.apps-crc.testing/openshift/rhpam73-kieserver-openshift                    1.0,1.1                                               10 days ago
openshift   rhpam73-smartrouter-openshift                  default-route-openshift-image-registry.apps-crc.testing/openshift/rhpam73-smartrouter-openshift                  1.0,1.1                                               10 days ago
openshift   ruby                                           default-route-openshift-image-registry.apps-crc.testing/openshift/ruby                                           2.3,2.4,2.5,latest                                    10 days ago
openshift   tests                                          default-route-openshift-image-registry.apps-crc.testing/openshift/tests                                          latest                                                10 days ago
[zaki@codeready ~]$ 

お、minishiftにはなかったjboss-webserver50-tomcat9-openshiftとか入ってるのね。

CodeReady Containersを停止する

[zaki@codeready ~]$ crc stop
Stopping CodeReady Containers instance... this may take a few minutes
CodeReady Containers instance stopped
[zaki@codeready ~]$ 

crc startのオプション、--vm-driver virtualboxとかあるしwin10homeでも動くのかな…?(未確認)


Appendix

DNSサーバの話

ちなみに、CodeReady Containersを入れるとローカルにDnsmasqが入る。

[zaki@codeready ~]$ rpm -qa | grep dnsm
dnsmasq-2.76-9.el7.x86_64
[zaki@codeready ~]$ cat /etc/resolv.conf 
# Generated by NetworkManager
search ocp4.localhost
nameserver 127.0.0.1
[zaki@codeready ~]$ 

この辺はOpenShift ver3(Enterprise)とも同じかな。 試してはないけど、既にDNSサーバが動いているホスト上ではインストールできないかも。


仮想化の機能が不十分の場合のエラー

ホストOS上で仮想化機能が使えるように設定されてないとcrc startでエラーになる。

[zaki@codeready ~]$ crc start 
INFO Checking if running as non-root              
INFO Checking if oc binary is cached              
INFO Checking if Virtualization is enabled        
INFO Checking if KVM is enabled                   
INFO Checking if libvirt is installed             
INFO Checking if user is part of libvirt group    
INFO Checking if libvirt is enabled               
INFO Checking if libvirt daemon is running        
INFO Checking if a supported libvirt version is installed 
INFO Checking if crc-driver-libvirt is installed  
INFO Checking if libvirt 'crc' network is available 
INFO Checking if libvirt 'crc' network is active  
INFO Checking if NetworkManager is installed      
INFO Checking if NetworkManager service is running 
INFO Checking if /etc/NetworkManager/conf.d/crc-nm-dnsmasq.conf exists 
INFO Checking if /etc/NetworkManager/dnsmasq.d/crc.conf exists 
? Image pull secret [? for help] **********************************************************************************************
:
:

INFO Extracting bundle: crc_libvirt_4.2.0-0.nightly-2019-09-26-192831.crcbundle ... 
INFO Creating CodeReady Containers VM for OpenShift 4.2.0-0.nightly-2019-09-26-192831... 
ERRO Error occurred: Error creating host: Error creating the VM. Error creating machine: Error in driver during machine creation: virError(Code=8, Domain=44, Message='無効な引数: could not find capabilities for arch=x86_64 domaintype=kvm ') 

エラーになった…
ログの内容。

[zaki@codeready ~]$ less .crc/crc.log 
:
:
(crc) DBG | Defining VM...
(crc) Failed to create the VM: virError(Code=8, Domain=44, Message='無効な引数: could not find capabilities for arch=x86_64 domaintype=kvm ')
Making call to close driver server
(crc) Calling .Close
(crc) DBG | Closing plugin on server side
Successfully made call to close driver server
Making call to close connection to plugin binary
[zaki@codeready ~]$ 

ESXiの場合は、VMの設定だけでなくESXi上でも仮想化機能を有効にする設定が必要

[root@localhost:~] cat /etc/vmware/config
libdir = "/usr/lib/vmware"
authd.proxy.nfc = "vmware-hostd:ha-nfc"
authd.proxy.nfcssl = "vmware-hostd:ha-nfcssl"
authd.proxy.vpxa-nfcssl = "vmware-vpxa:vpxa-nfcssl"
authd.proxy.vpxa-nfc = "vmware-vpxa:vpxa-nfc"
authd.fullpath = "/sbin/authd"
vhv.enable = TRUE
[root@localhost:~] 
[root@localhost:~] /etc/init.d/hostd restart
watchdog-hostd: Terminating watchdog process with PID 69884
hostd stopped.
hostd started.
[root@localhost:~] 

これでVMを再起動して再度crc startすればOK
参考: vSphere ESXi 上の仮想マシンで VT-x を有効化するには - らくがきちょう