Since Druid segments may be partitioned, an incoming query can require data from multiple segments and partitions (or shards) stored on different nodes in the cluster. HDFS, or Amazon S3) for permanent data backup.Ĭlient queries first hit broker nodes, which forward them to the appropriate data nodes (either historical or real-time). MySQL, PostgreSQL, or Derby), and a deep storage facility (e.g.
The cluster includes external dependencies for coordination ( Apache ZooKeeper), metadata storage (e.g. Architecture įully deployed, Druid runs as a cluster of specialized processes (called nodes in Druid) to support a fault-tolerant architecture where data is stored redundantly, and there is no single point of failure. The project was open-sourced under the GPL license in October 2012, and moved to an Apache License in February 2015. History ĭruid was started in 2011 by Eric Tschetter, Fangjin Yang, Gian Merlino and Vadim Ogievetsky to power the analytics product of Metamarkets. Druid is used in production by technology companies such as Alibaba, Airbnb, Cisco, eBay, Lyft, Netflix, PayPal, Pinterest, Reddit, Twitter, Walmart, Wikimedia Foundation and Yahoo.
The name Druid comes from the shapeshifting Druid class in many role-playing games, to reflect that the architecture of the system can shift to solve different types of data problems.ĭruid is commonly used in business intelligence- OLAP applications to analyze high volumes of real-time and historical data. Druid is designed to quickly ingest massive quantities of event data, and provide low-latency queries on top of the data. Druid is a column-oriented, open-source, distributed data store written in Java.
0 kommentar(er)
