素早く Spring Cloud Dataflow @ Minikuber を構築しましょう

Spring Cloud Data Flowとは

Spring Cloud Data Flow is a toolkit for building data integration and real-time data processing pipelines.

環境

macOS Mojve
[minikube(v1.0.0)]({% post_url 2019-04-12-minikube-over-virtualbox %})
1. Kubernetes(v1.14.0)
helm(v2.13.1)
```
# macOS
brew install kubernetes-helm
```

環境起動

# デフォルトの２Gが不足ので、⭐️4G以上⭐️をご指定ください。
minikube start --memory 4096

ver2

# minikube(namespace:kube-system)にhelmsサーバー（tiller）のサービスをインストール
helm init

# LoadBalanceが使えないため、NodePortへ変更ください。
helm install --name my-release --set server.service.type=NodePort stable/spring-cloud-data-flow

ver3

helm repo add stable https://kubernetes-charts.storage.googleapis.com/

# LoadBalanceが使えないため、NodePortへ変更ください。
helm install my-release --set server.service.type=NodePort stable/spring-cloud-data-flow

環境確認

mysql

An RDBMS service for the application registry, stream and task repositories, and task management.

rabbitmq
```
A messaging middleware
```
server

skipper

Skipper is a tool that allows you to discover applications and manage their lifecycle on multiple Cloud Platforms.

Podsステータスが全部Runningになっている。

$ kubectl get pods
NAME                                           READY   STATUS    RESTARTS   AGE
my-release-data-flow-server-96fccf48c-992mn    1/1     Running   0          105m
my-release-data-flow-skipper-6c584bb9d-s5pxv   1/1     Running   0          105m
my-release-mysql-85bfd59986-jgsqg              1/1     Running   0          105m
my-release-rabbitmq-5657497d7c-ljwms           1/1     Running   0          105m

GUIへのアクセス

kubectlで調べ

アクセスURL（http://<minikubeのIP>:<scdfのServerのNodePort>/dashboard）

HTTP
MinikuberのIP
```
 $ minikube ip
 192.168.99.102
```

Data Flow Serverのkubernetes serverのNodePort

$ kubectl get services -o wide -l app=spring-cloud-data-flow,component=server
NAME                          TYPE       CLUSTER-IP      EXTERNAL-IP   PORT(S)        AGE   SELECTOR
my-release-data-flow-server   NodePort   10.101.21.115   <none>        80:30553/TCP   29m   app=spring-cloud-data-flow,component=server,release=my-release

minikubeで調べ

$ minikube service --url my-release-data-flow-server
http://192.168.99.102:30553

# Macで下記のコマンドを使って、デフォルトのブラウザを開く
$ open $(minikube service --url my-release-data-flow-server)/dashboard

GUI画面

Spring Cloud Data Flow GUI

デモ

App登録

wget -qO- "$(minikube service --url my-release-data-flow-server)/apps" --post-data="uri=https://dataflow.spring.io/rabbitmq-docker-latest&force=true";
echo "Stream apps imported"
wget -qO- "$(minikube service --url my-release-data-flow-server)/apps" --post-data="uri=https://dataflow.spring.io/task-docker-latest&force=true";
echo "Task apps imported"

Stream作成

official's demoをご参考ください。

create ticktock stream

$ kubectl get deployment
NAME                           READY   UP-TO-DATE   AVAILABLE   AGE
my-release-data-flow-server    1/1     1            1           19h
my-release-data-flow-skipper   1/1     1            1           19h
my-release-mysql               1/1     1            1           19h
my-release-rabbitmq            1/1     1            1           19h
ticktock-log-v1                1/1     1            1           2m17s
ticktock-time-v1               1/1     1            1           2m17s