Port Spark template from Helm to K8s templates

This is a simple port of the helm template of spark.
This commit is contained in:
Bill Maxwell 2016-03-28 19:43:04 -07:00 committed by Bill Maxwell
parent 098ac997b9
commit 93a816353a
10 changed files with 160 additions and 0 deletions

View File

@ -0,0 +1,5 @@
# spark
Apache Spark is a fast and general-purpose cluster computing system.
Need for zeppelin service and controller: Apache Zeppelin is a new and incubating multi-purposed web-based notebook which brings data ingestion, data exploration, visualization, sharing and collaboration features to Spark. More information can be found at https://zeppelin.incubator.apache.org/

View File

@ -0,0 +1,12 @@
.catalog:
name: Spark
version: 0.1.0-rancher1
description: "Spark cluster"
maintainer: "Rancher"
questions:
- variable: "SPARK_WORKER_REPLICAS"
type: "string"
default: "1"
label: "Worker Replica Count"
description: "number of Spark workers"
required: true

View File

@ -0,0 +1,27 @@
kind: ReplicationController
apiVersion: v1
metadata:
name: spark-master-controller
labels:
heritage: helm
provider: spark
spec:
replicas: 1
selector:
component: spark-master
template:
metadata:
labels:
component: spark-master
spec:
containers:
- name: spark-master
image: gcr.io/google_containers/spark:1.5.1_v3
command: ["/start-master"]
ports:
- containerPort: 7077
- containerPort: 8080
resources:
requests:
cpu: 100m

View File

@ -0,0 +1,14 @@
kind: Service
apiVersion: v1
metadata:
name: spark-master
labels:
heritage: helm
provider: spark
spec:
ports:
- port: 7077
targetPort: 7077
selector:
component: spark-master

View File

@ -0,0 +1,14 @@
kind: Service
apiVersion: v1
metadata:
name: spark-webui
labels:
heritage: helm
provider: spark
spec:
ports:
- port: 8080
targetPort: 8080
selector:
component: spark-master
type: LoadBalancer

View File

@ -0,0 +1,26 @@
kind: ReplicationController
apiVersion: v1
metadata:
name: spark-worker-controller
labels:
heritage: helm
provider: spark
spec:
replicas: ${SPARK_WORKER_REPLICAS}
selector:
component: spark-worker
template:
metadata:
labels:
component: spark-worker
spec:
containers:
- name: spark-worker
image: gcr.io/google_containers/spark:1.5.1_v3
command: ["/start-worker"]
ports:
- containerPort: 8081
resources:
requests:
cpu: 100m

View File

@ -0,0 +1,25 @@
kind: ReplicationController
apiVersion: v1
metadata:
name: zeppelin-controller
labels:
heritage: helm
provider: spark
spec:
replicas: 1
selector:
component: zeppelin
template:
metadata:
labels:
component: zeppelin
spec:
containers:
- name: zeppelin
image: gcr.io/google_containers/zeppelin:v0.5.5_v2
ports:
- containerPort: 8080
resources:
requests:
cpu: 100m

View File

@ -0,0 +1,14 @@
kind: Service
apiVersion: v1
metadata:
name: zeppelin
labels:
heritage: helm
provider: spark
spec:
ports:
- port: 8080
targetPort: 8080
selector:
component: zeppelin

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 33 KiB

View File

@ -0,0 +1,6 @@
name: spark
version: 0.1.0-rancher1
description: |
Apache Spark is a fast and general-purpose cluster computing system
ported from Helm.
category: Big Data