LATEST VERSION: 1.10 - CHANGELOG
Pivotal Cloud Foundry v1.7

Configuring System Logging in Elastic Runtime

Page last updated:

This topic explains how to configure the Pivotal Cloud Foundry Loggregator system to scale its maximum throughput, and to forward logs to an external aggregator service.

Scaling Loggregator

Elastic Runtime system components and apps constantly generate log and metrics data. The Metron agent running on each component or application VM collects and sends this data out to Doppler components, which temporarily buffer the data before periodically forwarding it to the Traffic Controller. The Traffic Controller then serves the aggregated data stream through the Firehose WebSocket endpoint.

When the log and metrics data input to a Doppler exceeds its buffer size for a given interval, data can be lost. You can take several actions to minimize this loss.

Increase buffer size

  1. In the Pivotal Cloud Foundry (PCF) Ops Manager Installation Dashboard, click the Elastic Runtime tile.
  2. Select System Logging.
  3. Increase the drain buffer size to prevent loss of log data.
  4. Click Save.
  5. Click Apply Changes. Sys logging

Add additional Doppler instances

  1. In the PCF Ops Manager Installation Dashboard, click the Elastic Runtime tile.
  2. Select Resource Config.
  3. Increase the number in the Instances column and the Doppler Server row. Loggregator config
  4. Click Save.
  5. Click Apply Changes.

Add additional Traffic Controller instances

  1. In the PCF Ops Manager Installation Dashboard, click the Elastic Runtime tile.
  2. Select Resource Config.
  3. Increase the number in the Instances column and the Loggregator Trafficcontroller row. Loggregator config
  4. Click Save.
  5. Click Apply Changes.

Enabling System Log Forwarding

Elastic Runtime can forward log data to an external aggregator service instead of routing it to the Loggregator Firehose. System log forwarding for Pivotal Cloud Foundry (PCF) is managed through the PCF Ops Manager Installation Dashboard. To enable syslog forwarding:

  1. Click the Elastic Runtime tile.
  2. Select System Logging.
  3. Enter the Hostname, Port, and Protocol for your third-party log management service.
  4. (Optional) Increase the drain buffer size to prevent loss of log data.
  5. Click Save.
  6. Click Apply Changes. Sys logging
Create a pull request or raise an issue on the source for this page in GitHub