Manual Installation
If Docker does not suit your needs, you can manually install the parts you need to run Spring Cloud Data Flow.
If you want to use Spring Cloud Data Flow only for batch and task processing (that is, not for processing streams), see the Batch-only Mode recipe.
Downloading Server Jars
To begin, you need to download the server jars:
-
Download the Spring Cloud Data Flow Server and shell by using the following commands:
wget https://repo.spring.io/release/org/springframework/cloud/spring-cloud-dataflow-server/2.9.2/spring-cloud-dataflow-server-2.9.2.jar wget https://repo.spring.io/release/org/springframework/cloud/spring-cloud-dataflow-shell/2.9.2/spring-cloud-dataflow-shell-2.9.2.jar
-
Download Skipper by running the following command:
wget https://repo.spring.io/release/org/springframework/cloud/spring-cloud-skipper-server/2.8.2/spring-cloud-skipper-server-2.8.2.jar
If you are interested in trying out the latest BUILD-SNAPSHOT
(that is, the snapshot build from the master
branch) of SCDF and Skipper's upstream versions, you can use the following wget
commands:
wget https://repo.spring.io/release/org/springframework/cloud/spring-cloud-dataflow-server/2.9.2/spring-cloud-dataflow-server-2.9.2.jar
wget https://repo.spring.io/release/org/springframework/cloud/spring-cloud-dataflow-shell/2.9.2/spring-cloud-dataflow-shell-2.9.2.jar
wget https://repo.spring.io/release/org/springframework/cloud/spring-cloud-skipper-server/2.8.2/spring-cloud-skipper-server-2.8.2.jar
Install Messaging Middleware
These instructions require that RabbitMQ be running on the same machine as Skipper, Spring Cloud Data Flow server, and Shell.
To install and run the RabbitMQ docker image, use the following command:
docker run -d --hostname rabbitmq --name rabbitmq -p 15672:15672 -p 5672:5672 rabbitmq:3.7.14-management
Starting Server Jars
Now you need to start the applications that comprise the server:
-
Start Skipper. To do so, in the directory where you downloaded Skipper, run the server by using
java -jar
, as follows:java -jar spring-cloud-skipper-server-2.8.2.jar
-
Start the Data Flow Server. To do so, in a different terminal window and in the directory where you downloaded Data Flow, run the server by using
java -jar
, as follows:java -jar spring-cloud-dataflow-server-2.9.2.jar
If Skipper and the Data Flow server are not running on the same host, set the
spring.cloud.skipper.client.serverUri
configuration property to the location of Skipper, as shown in the following example:java -jar spring-cloud-dataflow-server-2.9.2.jar --spring.cloud.skipper.client.serverUri=https://192.51.100.1:7577/api
-
If you want to use the Spring Cloud Data Flow shell, start it with the following command:
java -jar spring-cloud-dataflow-shell-2.9.2.jar
If the Data Flow Server and shell are not running on the same host, you can also point the shell to the Data Flow server URL by using the
dataflow config server
command in Shell, as follows:server-unknown:>dataflow config server https://198.51.100.0 Successfully targeted https://198.51.100.0
Alternatively, you can pass in the
--dataflow.uri
command line option. The shell’s--help
command line option shows what is available.
Proxy Servers
If you run Spring Cloud Data Flow Server behind a proxy server (such
as Zuul), you may also need to set
the server.use-forward-headers
property to true
. An example that
uses Zuul is available in the Spring Cloud Data Flow Samples
repository
on GitHub. Additional information is also available in the Spring Boot Reference Guide.
Accessing Data Flow Dashboard
You can now navigate to Spring Cloud Data Flow Dashboard. In your browser, navigate to the Spring Cloud Data Flow Dashboard URL.