Sumo Logic Enhances Data Pipelines Service for Streamlined Telemetry Management
Data analytics software provider Sumo Logic Inc. has launched an upgraded Data Pipelines service enabling clients to effectively filter and redirect telemetry data prior to its ingestion and storage. This enhancement comes as organizations increasingly grapple with the complexities of managing an expanding volume of telemetry data.
The new controls are integrated within Sumo Logic’s platform, eliminating the need for external tools. As security and operations teams collect unprecedented amounts of telemetry, Sumo Logic emphasizes that the rise of artificial intelligence workloads exacerbates data management challenges. The cost of ingesting every data point can rapidly escalate, while reducing data collection can save money—until crucial information becomes necessary during investigations.
A recent report from Gartner Inc., published on September 2, underscores this trend. The firm notes that many organizations default to ingesting all operational data for later analysis, a strategy that has become unsustainable due to soaring ingestion and storage costs. Furthermore, Gartner highlights that the presence of high volumes of low-quality telemetry impairs the performance of generative AI and large language models processing that data.
Sumo Logic currently processes and analyzes approximately seven exabytes of data daily for a diverse clientele in security and operations. With the new features, clients gain the ability to determine what data should be excluded from that influx before it enters the platform.
The release introduces two key capabilities: a live preview tool that illustrates the impact of a pre-activated rule on a data stream, and an AI-assisted rule-writing assistant that significantly reduces the time required to create these rules. This assistant flags anomalies and changes in incoming data formats as they arise, while recommendations for routing, transforming, or discarding data still require human oversight for final approval.
Keith Kuchler, Sumo Logic’s Chief Product and Technology Officer, remarked that the company has dedicated 15 years to converting “exabytes of noise into actionable insights.” He noted that the introduction of AI has added complexity and cost to this process. By shifting data strategy decisions upstream, teams can now define the purpose of their data before incurring costs associated with storage.
Looking ahead, Sumo Logic plans to roll out additional features later this year. These include a visual, AI-assisted framework for shaping telemetry data before it reaches the Sumo Logic platform or a customer’s own cloud storage solutions. Future developments will also encompass controls over data collection from various cloud and edge sources, alongside a platform-agnostic version to manage data directed to tools from other vendors.
Moreover, Sumo Logic intends to implement an OpenTelemetry-native management layer, consolidating collector configuration, monitoring, and deployment into a single console. This advancement aims to eliminate the overhead costs associated with operating additional agents. Sumo Logic is demonstrating its enhanced data pipelines at the Gartner Security & Risk Management Summit in London this week.
Sumo Logic was acquired by Francisco Partners in 2023 for $1.7 billion, transitioning the company to private ownership. This strategic move underscores the growing importance of data management and analytics in the realm of cybersecurity and information security.