Recently, Dremio released version 3.0 of their Data-as-a-Service platform. Since the release of Dremio over one year ago, the company has made several enhancements to the platform aimed at addressing many of the requirements for broader adoption of the platform by the enterprise.
Dremio’s technology is based on the open source project Apache Arrow which is a platform for in-memory data. Dremio is a leading contributor of the Apache Arrow project and leverages it to provide analytics and BI of data from multiple sources and platforms. By keeping data in memory as it is executing queries against it, Dremio is able to provide results very quickly especially with enhancements made in version 3.0.
A new integrated catalog allows customers to track metadata of their source data through use of tags and wiki style descriptions of data. Data will also be automatically indexed regardless of source. This will allow for better searchability of data be it physical or virtual. The idea is to make data more discoverable by anyone rather than the province of a single person or team within an organization.
Dremio’s new data catalog allows addition of wikis and tags to data.
Dremio’s new data catalog allows addition of wikis and tags to data.Key among Dremio’s new features are enhances security controls. Things like end-to-end TLS encryption of intra-cluster communications, row and column-level access control of source data and EC2 Instance control will enable enterprises to have the granular control they wish over access to data.
Coupled with enhanced security controls, the new Kubernetes based deployment option will enable to enterprises to manage deployments from 1 to 1000+ nodes at scale in a manageable fashion. This will bring performance enhancements as clusters can be scaled to meet demand as well as provide high availability of services within a Dremio cluster. Additional performance enhancements come by way of multi-tenant workload controls, which can create VIP users and prevent rogue queries from affecting an entire cluster. And for the enterprise that is really looking for extreme performance enhancements, the Gandiva Initiative has released a new kernel based on LLVM specifically for Apache Arrow that can accelerate performance up to 100x.
In the past 15 months since Dremio’s emergence from stealth mode, the company has released and iterated on a product that felt new and upcoming. With the release of version 3.0, the platform and the company have matured and look to challenge others in the ever growing data analytics and BI space.
For more information about Dremio visit dremio.com.
