StarTree Brings Apache Pinot Real-Time Database to the Cloud
StarTree’s cloud service, a commercially supported platform that allows organizations to run Apache Pinot-based real-time database technology, is now generally available.
Based in Mountain View, California, StarTree is a leading contributor to open source Apache Pinot online analytical processing (OLAP) database, which was originally created at LinkedIn.
LinkedIn contributed Pinot technology to Apache Software Foundation in 2019. Apache Pinot enables users to quickly query data for analytics and operational dashboard use cases. One of the first uses of Apache Pinot at LinkedIn was to allow people to quickly see all the other users who viewed their user profile.
StarTree launched its cloud service on March 22 beginning with what it calls a bring your own cloud (BYOC) model, in which users run the platform on their own. virtual private cloud deployment.
The provider also unveiled a preview of a new database as a service that is not yet generally available.
Organizations increasingly need the kind of real-time analytics technology developed by StarTree, said David Menninger, analyst at Ventana Research. He added that his company’s research predicts that by 2024, half of organizations will integrate real-time analytics into their business processes to help them respond more quickly to market opportunities and threats.
“StarTree often focuses on real-time analytics for services with consumer-facing businesses,” Menninger said. “Being able to perform real-time analysis on huge volumes of data is a challenge and Apache Pinot was designed to solve this problem.”
How StarTree works with Apache Pinot
At the core of the Apache Pinot open source technology is the Star-Tree Index, designed to speed up OLAP queries. StarTree as a company derives its name from Star-Tree indexing technology.
Rohit Agarwallachief product officer at StarTree, said Apache Pinot is well suited to enable real-time queries that can power user-facing apps, such as LinkedIn and Uber Eats.
Apache Pinot is designed to allow data to be ingested quickly from real-time event streaming as well as batch data query sources, and then enable low-latency, high-throughput queries.
Pinot provides the OLAP data store and then it can integrate with other tools including PictureLooker or Apache superset to support analytics, business intelligence or operations.
StarTree Cloud Offerings for Apache Pinot
The BYOC version of StarTree that is now generally available will allow organizations to keep all their data in their own cloud environment, with StarTree managing the platform remotely.
StarTree provides users of its BYOC service with a cloud portal that provides insight into an organization’s Pinot deployment, Agarwalla noted.
The StarTree cloud portal provides insight into the health of an organization’s Pinto data environment as well as observability metrics on the state of operations. Agarwalla said the StarTree cloud also incorporates features that allow organizations to ingest data more easily than they could with open source Apache Pinot technology.
StarTree uses Kubernetes Operators to help deploy and manage BYOC deployments.
“We have operators that are designed to sync with our control plane and ensure that deployment happens with the desired configuration,” Agarwalla said.