Introduction to Log Monitoring¶
Logging is a new addition to FusionReactor, allowing you to monitor logs from any location alongside your existing FusionReactor data.
Log monitoring from FusionReactorAPM on Vimeo.
To get started, simply upgrade to FusionReactor 9.0.0 or later and logs will ingest into your Cloud account automatically.
The FusionReactor agent will send application and error logs out of the box, with options to send traditional FusionReactor logs and scrape any additional logs on the server automatically.
If you currently have an on-premise license, you can convert to Cloud here.
How to Visualize your Logs¶
Logs can be viewed within the Cloud from within Log dashboards and via the explore feature.
Log dashboards give you pre-configured, powerful views which you can use to analyse your log data with simple search capabilities, including:
- Dashboards to search and filter logs from sources such as ColdFusion, Application Server or FusionReactor logs
- Dashboards to track down the root cause of error logs
- Dashboards to Query and browse all ingested logs
- Dashboards to see how much data you are ingesting
- Dashboards to identify memory and CPU bottlenecks via logs
Currently, dashboards are read-only. The ability to create and edit dashboards will be added in a later edition of the FusionReactor Cloud.
Exploring your Logs¶
To deep dive into logs, you can use the explore feature to analyse logs using LogQL queries.
Sending Additional Logs to the FusionReactor Cloud¶
Application and error logs will be shipped to the Cloud automatically, to give you high value logs automatically as soon as you upgrade.
These logs include:
- Exception logs
- ColdFusion logs
- Commandbox logs
- Tomcat Logs
- Lucee logs
- Stdout / Stderror logs
Additional logs can be sent either by using the agent as a log shipper, or using a dedicated log shipper such as Promtail, Logback, Log4j or any other log shipper.
Sending Additional Logs from FusionReactor¶
FusionReactor logs will not be sent without additional configuration, as the metrics and transactions from the FusionReactor agent are already available in other views and dashboards.
You can send FusionReactor logs by enabling them in the logging Cloud settings.
The agent can also be utilized to ship any logs stored on the server using its log scraping functionality.
Any logs sent via the agent have the option to be:
Sending logs from non FR sources¶
You can ingest logs from other sources such as nginx, IIS, databases or any other service using a logging agent such as Promtail, Logback or Log4j.
In order to do this:
- Configure an API key within your FusionReactor Cloud account
- Configure a logging agent to ship logs to FusionReactor
Alerting on your Log Behavior¶
Log alerting allows you to create rules based on your log rates or metrics from within logs themselves to detect issues such as:
- Log Floods
- Log Error spikes
- Abnormal log behavior
Log alerts can be dispatched to the same subscriptions as you use for alerting.
In order to do this:
- Create a new alerting Group
- Create an alerting rule
We welcome your feedback and ideas for enhancements and new features going forwards.
This includes changes to:
- The FusionReactor agent
- Log Dashboards
- Log Alerting
- The FusionReactor Cloud
To provide feedback please use the chat feature or email email@example.com.
Below are some Frequently asked questions about the new logging feature.
Can I use the Logs Feature if I do not have a FusionReactor Cloud Account?¶
Log monitoring is only available in the FusionReactor Cloud.
You can convert any existing license to Cloud with no additional cost* here.
Are my Logs Secure in the FusionReactor Cloud?¶
Logs are ingested via https over an encrypted socket.
Logs are Stored in Amazon S3 private buckets, hosted in Dublin Ireland.
How do I stop my logs being sent to the Cloud?¶
Log Data ingest can either be stopped by discarding data in ingest, or by preventing the agent from shipping logs.
How to discard all log data at ingest¶
You can disable log ingest from the FusionReactor Cloud.
This will cause all logs to be discarded at ingest.
How to Stop the Agent Shipping Logs¶
You can disable log shipping by adding the following system property to your JVM arguments:
This will prevent any logs from being shipped from FusionReactor, however any logs sent from dedicated logging agents will still be ingested unless Cloud ingest is disabled.
How do I Remove Sensitive Data from my Logs?¶
Any logs sent from the FusionReactor agent can be obfuscated to remove any sensitive content
How do I Delete Existing Log Data?¶
For the time being, in order to remove log data from your account contact support via chat or by emailing firstname.lastname@example.org.
There is no capability to remove specific log data, all log data will be removed from the account.
How Long are Logs Kept?¶
Log data is stored for 31 days.
Is Log Monitoring Included in my Current Subscription?¶
Initially Log Monitoring will be a free feature in the FusionReactor Cloud.
This free period will run for around 2 - 3 months, allowing you to ingest 50GB of log data per month.
We will use this period to gather feedback on logging and improve the logging platform.
After this period, a free tier of logging will be available with 1GB of included log data per month.
How Much Will Logging cost?¶
Upon completion of the free period, logs will become a billable feature of the FusionReactor Cloud.
Pricing information can be found on the website