In this section, we demonstrate how to register a Spring Cloud Task application with Data Flow, create a Task definition, and launch the Task definition on Cloud Foundry, Kubernetes, and your local machine.
Before you start on this sample, you need to:
- Install Spring Cloud Data Flow.
- Install the Spring Cloud Task project that we use in this project.
You must you have installed Spring Cloud Data Flow to one of the following platforms:
For this guide, we use the Spring Cloud Task sample, called
Follow the instructions to code and build the task if you have not done so already.
We register a Task application, create a simple Task definition, and launch the task by using the Data Flow server. The Data Flow server provides a comprehensive API to perform the necessary steps. The Data Flow server includes a Data Flow Dashboard web UI client. In addition, there is a Data Flow Shell command line interface (CLI), available as a separate download. The CLI and the UI both expose the complete API functionality. Which one to use is a matter of preference, but the UI is nice, so we feature it here.
Assuming Data Flow is installed and running on one of the supported platforms, open your browser at
<data-flow-url> depends on the platform. See the installation guide to determine the base URL for your installation. If Data Flow is running on your local machine, go to http://localhost:9393/dashboard.
The Data Flow Dashboard lands on the Application Registration view, where we register the sample task. The following image shows adding an application in the dashboard:
Applications in Spring Cloud Data Flow are registered as named resources so that they can be referenced when using the Data Flow DSL to configure and compose tasks.
Registration associates a logical application name and type with a physical resource, given by a URI.
The URI conforms to a schema and may represent a Maven artifact, a Docker image, or an actual
Data Flow defines some logical application types, which indicate the application's role as a streaming component, a task, or a standalone application.
Spring Cloud Task applications are always registered as a
Spring Cloud Data Flow supports Maven, HTTP, file, and Docker resources for local deployments. For this example, we use the Maven resource.
The URI for a Maven artifact is generally of the form
maven://<groupId>:<artifactId>:<version>. The maven URI for the sample application is as follows:
maven: protocol specifies a Maven artifact, which is resolved by using the remote and local Maven repositories configured for the Data Flow server.
To register an application, select ADD APPLICATION(S). Once the Add Application(s) page appears, select
Register one or more applications. Fill in the form and click IMPORT APPLICATION(S), as follows:
Spring Cloud Data Flow supports Maven, HTTP, and Docker resources for local deployments. For this example, we use an HTTP (actually, HTTPS) resource. The URI for an HTTPS resource is of the form
https://<web-path>/<artifactName>-<version>.jar. Spring Cloud Data Flow then pulls the artifact from the HTTPS URI.
The HTTPS URI for the sample app is as follows:
To register an application, select ADD APPLICATION(S). Once the Add Application(s) page appears, select Register one or more applications. Fill in the form and click IMPORT APPLICATION(S), as follows.
Spring Cloud Data Flow supports Docker resources for Kubernetes deployments.
The URI for a Docker image is of the form
docker:<docker-image-path>/<imageName>:<version> and is resolved by using the Docker registry configured for the Data Flow task platform and image pull policy.
The Docker URI for the sample app is as follows:
To register an application, select ADD APPLICATION(S). Once the Add Application(s) page appears, select Register one or more applications. Fill in the form and click IMPORT APPLICATION(S), as follows:
To create a task in the Dashboard UI:
- Select Tasks from the left navigation bar and select Create task(s).
Doing so displays a graphical editor that we can use to compose tasks.
The initial canvas contains
ENDnodes. To the left of the canvas, we see the available task applications, including
bill-setup-task, which we just registered.
- Drag that task to the canvas.
- Connect the task to the
ENDnodes to complete the task definition. In this case, the task definition consists of a single task application. If the application defined configuration properties, we would set them here. The following image shows the task creation UI:
- Click CREATE TASK. Doing so prompts you to name the task definition, which is the logical name for the runtime configuration we want to deploy. In this case, we use the same name as the task application.
- Click CREATE THE TASK. Doing so displays the main Tasks view.
The following image shows the Task UI, which we can use to launch a task:
To launch the task:
- Click the option control on the row of the task you want to launch and select the Launch option. Doing so takes you to a form where you can add command line arguments and deployment properties, but we do not need any for this task.
- Click Launch the task.
Doing so runs the task on the Data Flow server's task platform and records a new task
execution. When the execution is complete, the Status turns to a green color and shows
- Select the Task executions tab to view a summary of executions for this task, as follows: