Move docker/build_all.sh to travis/build_images.sh (#2007)

* Move build_all.sh from docker/ to travis/

* Use $TRAVIS_BUILD_DIR

* Remove +x from build_images.sh

* Update document

Author: wangkuiyi

.travis.yml

@@ -29,7 +29,7 @@ jobs:
       script:
         - set -e
         # Build Docker images.
-        - bash elasticdl/docker/build_all.sh
+        - bash $TRAVIS_BUILD_DIR/scripts/travis/build_images.sh
         # Run pre-commit checks.
         - docker run --rm -it -v $PWD:/work -w /work
           elasticdl:dev /work/scripts/pre-commit.sh

docs/tutorials/elasticdl_local.md

@@ -32,7 +32,8 @@ minikube start --vm-driver=hyperkit --cpus 2 --memory 6144 --disk-size=20gb
 kubectl apply -f elasticdl/manifests/examples/elasticdl-rbac.yaml
 eval $(minikube docker-env)
 export DOCKER_BUILDKIT=1
-bash elasticdl/docker/build_all.sh
+export TRAVIS_BUILD_DIR=$PWD
+bash scripts/travis/build_images.sh
 ```
 
 ### Summit a training job

docs/tutorials/elasticdl_on_prem_cluster.md

@@ -7,7 +7,8 @@ You should install ElasticDL first. Please refer to the installation part in [el
 Then, build needed images.
 
 ```bash
-bash elasticdl/docker/build_all.sh
+export TRAVIS_BUILD_DIR=$PWD
+bash scripts/travis/build_images.sh
 ```
 
 ## Submit job to cluster

elasticdl/docker/build_all.sh

@@ -1,4 +1,4 @@
-# ElasticDL Client: Submit ElasticDL Job to Kubernetes 
+# ElasticDL Client: Submit ElasticDL Job to Kubernetes
 
 ## Prepare Model Definition
 
@@ -29,13 +29,13 @@ For demonstration purposes, we use the data stored on `elasticdl:ci` Docker imag
 First we build all development Docker images, which include `elasticdl:ci` image:
 
 ```bash
-elasticdl/docker/build_all.sh
+export TRAVIS_BUILD_DIR=$PWD
+bash scripts/travis/build_images.sh
 ```
 
-Add `-gpu` if you want to build images with GPU support:
-```bash
-elasticdl/docker/build_all.sh -gpu
-```
+By default, the above script builds images with TensorFlow CPU image as the base
+image.  If you want to switch to other images, for example, Python, Ubuntu, or
+TensorFlow GPU image, please edit `elasticdl/docker/Dockerfile`.
 
 Submit training job (make sure you have packages `kubernetes` and `docker` installed in your running environment):
 
@@ -101,7 +101,7 @@ python -m elasticdl.python.elasticdl.client train \
 
 The difference is that we add a new argument `cluster_spec` which points to a cluster specification file.
 The cluster specification module includes a `cluster` component, and ElasticDL will invoke function
-`cluster.with_cluster(pod)` to add extra specifications to the 
+`cluster.with_cluster(pod)` to add extra specifications to the
 [pod](https://github.com/kubernetes-client/python/blob/master/kubernetes/docs/V1Pod.md) and invoke function
 `cluster.with_service(service)` to add extra specifications to the [service](https://github.com/kubernetes-client/python/blob/master/kubernetes/docs/V1Service.md).
 Here is an example that assigns labels `"app": "elasticdl"` to the `pod` and `service`. Users can implement more customized configurations

elasticdl/python/elasticdl/README.md

@@ -0,0 +1,25 @@
+#!/bin/bash
+# Copyright 2020 The ElasticDL Authors. All rights reserved.
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+docker build --target dev -t elasticdl:dev \
+       -f "$TRAVIS_BUILD_DIR/elasticdl/docker/Dockerfile" \
+       "$TRAVIS_BUILD_DIR"
+
+docker build --target ci -t elasticdl:ci \
+       -f "$TRAVIS_BUILD_DIR/elasticdl/docker/Dockerfile" \
+       "$TRAVIS_BUILD_DIR"
+
+docker build -t elasticdl:dev_allreduce \
+       -f "$TRAVIS_BUILD_DIR/elasticdl/docker/Dockerfile.dev_allreduce" \
+       "$TRAVIS_BUILD_DIR"