An event is a point in time that represents the state of a service, application, or infrastructure component.
The pipeline process starts when BigPanda receives and ingests event data from monitoring and observability tools. These tools can generate events when potential problems are detected in the infrastructure.
This section reviews the volume of events, when events tend to occur, and event compression.
Key event highlights:
BigPanda ingested nearly 6 billion events from inbound monitoring and change integrations.
When we remove the five outliers (fewer than 100,000 and 1 billion or more annual events), BigPanda ingested 4.5 billion events. The median annual events per organization was 9.6 million, and the median daily events per organization was 28,623.
of organizations sent 10M+ events per year to BigPanda
Annual event volume (n=125)
This section reviews when events occur based on the UTC (Coordinated Universal Time, also known as Greenwich Mean Time or GMT) time zone.
The event count ranged from about 374.3 million to 540.2 million per month.
of events occurred in September, October, and November
Percentage of total events by month in UTC (n=114)
As far as what day of the week events tend to happen, the data show that:
of events occurred on a weekend
Percentage of total events by day of the week in UTC (n=114)
Event compression is the number of events compressed into alerts. It consists of deduplication and alert filtering, which help prevent events from becoming alerts. Therefore, higher event compression rates correlate with less alert noise.
The median event compression rate was 87%.
Many organizations had achieved high compression, while others had room to improve (low and average compression):
of organizations achieved a high event compression rate (95+%)
Event compression rate range and tier by organization (n=125)
Also known as event deduplication, deduping is the process by which BigPanda eliminates redundant data to reduce noise and simplify incident investigation. Deduplicated events are events that were removed as precise duplicates.
BigPanda has a built-in deduplication process that reduces noise by intelligently parsing incoming raw events. It groups events into alerts based on matching properties. Exact duplicate matches add clutter to the system and are not actionable. BigPanda discards precise duplicates of existing events immediately. However, it merges updates to existing alerts rather than creating a brand-new alert.
The median deduplication rate was 93.6%.
of organizations benefited from 90+% event deduplication
Deduplication rate per organization
In the context of BigPanda, alert filtering is a feature that allows users to filter out or suppress specific alerts. Filtered-out events are unactionable events that were filtered out using alert filters.
Filtering alerts helps ITOps teams stop duplicate, low-relevance events from being correlated into incidents. Stopping alert noise before it reaches the incident feed enables teams to focus on the most important incidents and spend their time and effort on the most critical issues.
Alert filtering affects alerts after they have been normalized and enriched. The added context of the enrichment process enables teams to filter events based on alert metadata and enrichment tags.
Over half (55%) of organizations had configured at least one alert filter in BigPanda. The remaining 45% likely configured alert filters upstream before they reach BigPanda.
Excluding organizations with no alert filters, the median alert filters per organization was two. Of those organizations that had configured alert filters:
of organizations configured at least one alert filter in BigPanda
Number of configured alert filters per organization (n=72)