LATEST VERSION: 1.0 - CHANGELOG
Spring Cloud Data Flow v1.0

Viewing Service Instance Logs

Spring Cloud Data Flow for PCF provides access to the logs generated by each Data Flow server service instance, including logs for each of the three backing applications (Data Flow server application, metrics application, and Skipper application) for each instance. You can view these logs either using the Service Instance Logs cf CLI plugin or by visiting the dashboard of the Spring Cloud Data Flow service broker.

Using the cf CLI Plugin

Install the Service Instance Logs cf CLI plugin, following the instructions in the Installing section of the plugin’s README. The plugin adds a service-logs command, which can be used to tail logs or dump recent logs for a service instance.

To tail logs for a Data Flow service instance, run cf service-logs SERVICE_NAME, where SERVICE_NAME is the name of the service instance:

$ cf service-logs --recent data-flow
Retrieving logs for service instance data-flow in org myorg / space development as user...

To dump recent logs for the instance, use the --recent flag:

$ cf service-logs --recent data-flow
Retrieving logs for service instance data-flow in org myorg / space development as user...

If your Pivotal Cloud Foundry deployment uses a self-signed certificate, you must use the --skip-ssl-validation flag to disable the default validation of the platform’s SSL certificate:

$ cf service-logs --skip-ssl-validation data-flow
Connected, tailing logs for service instance data-flow in org myorg / space development as user...

Using the Service Broker Dashboard

Note: To access the service broker dashboard, you must be a Space Developer in the broker application’s space (this is typically the system org and p-dataflow space).

Visit the Spring Cloud Data Flow service broker’s dashboard. You can access it at the following URL, where apps.wise.com is the application domain of your PCF deployment:

https://p-dataflow.apps.wise.com/

The dashboard shows the name, org, and space of each service instance, as well as a link to view logs for the instance.

Broker dashboard

Click the Logs link to view logs for a particular service instance’s backing application.

Recent logs

You can stream current logs for the instance by clicking the button.

Stream logs

Reading Aggregated Logs

The logs retrieved by the Service Instance Logs cf CLI plugin aggregate logs from three backing applications: a Spring Cloud Data Flow server application, a metrics application, and a Spring Cloud Skipper application. The following excerpt shows logs after deploying a stream:

2018-02-09T11:12:02.45-0600 [RTR/dataflow 0] OUT dataflow-11f71dd3-f902-4e31-b631-fbbbfdb82459.apps.americancanyon.cf-app.com - [2018-02-09T17:12:02.429+0000] "GET /metrics/streams?names=httptest HTTP/1.1" 200 0 14765 "https://dataflow-11f71dd3-f902-4e31-b631-fbbbfdb82459.apps.americancanyon.cf-app.com/dashboard/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36" "130.211.0.191:63089" "10.0.4.8:61018" x_forwarded_for:"71.10.174.240, 35.201.75.216, 130.211.0.191" x_forwarded_proto:"https" vcap_request_id:"adc3ee08-a97a-41ae-71d4-5fc2dff4a82c" response_time:0.025969938 app_id:"7e61bf00-2a8c-4cc9-833a-9dd92442ff47" app_index:"0" x_b3_traceid:"6862348a02fa27db" x_b3_spanid:"6862348a02fa27db" x_b3_parentspanid:"-"

2018-02-09T11:12:02.45-0600 [RTR/metrics 0] OUT df-metrics-11f71dd3-f902-4e31-b631-fbbbfdb82459.apps.americancanyon.cf-app.com - [2018-02-09T17:12:02.444+0000] "GET /collector/metrics/streams HTTP/1.1" 200 0 22261 "-" "Apache-HttpClient/4.5.3 (Java/1.8.0_144)" "130.211.3.158:53467" "10.0.4.35:61004" x_forwarded_for:"35.184.235.101, 35.201.75.216, 130.211.3.158" x_forwarded_proto:"https" vcap_request_id:"87c87336-863e-424d-6ebe-3fa85f6545e0" response_time:0.007074433 app_id:"369ae87c-b9a6-4801-a4c5-61b779ff4f71" app_index:"0" x_b3_traceid:"60c018a7f484a97e" x_b3_spanid:"60c018a7f484a97e" x_b3_parentspanid:"-"

2018-02-09T11:12:02.60-0600 [APP/PROC/WEB/skipper 0] OUT 2018-02-09 17:12:02.603  INFO 15 --- [ry-client-nio-3] o.s.c.d.s.c.CloudFoundryAppDeployer      : Successfully computed status [deployed] for httptest-http-v1
2018-02-09T11:12:02.94-0600 [APP/PROC/WEB/skipper 0] OUT 2018-02-09 17:12:02.940  INFO 15 --- [ry-client-nio-3] o.s.c.d.s.c.CloudFoundryAppDeployer      : Successfully computed status [deployed] for astream-log-v4
2018-02-09T11:12:03.06-0600 [APP/PROC/WEB/skipper 0] OUT 2018-02-09 17:12:03.068  INFO 15 --- [ry-client-nio-1] o.s.c.d.s.c.CloudFoundryAppDeployer      : Successfully computed status [deployed] for astream-time-v4

The Data Flow server application’s logs are identified as belonging to the dataflow application. The metrics application similarly is called metrics. The Spring Cloud Skipper application is called skipper.

Create a pull request or raise an issue on the source for this page in GitHub