4.0 Technical Deep Dive

Speakers

What you will learn:

• Cloud Columnar Cache (C3). Accelerate queries directly on cloud data lake storage. C3 is a real-time distributed caching technology that makes S3 and ADLS perform at the speed of local NVMe. C3 uses the local NVMe storage of EC2 instances and Azure Virtual Machines to dramatically increase read throughput while reducing network traffic.
• Multi-Cluster Isolation. Dremio gives you the ability to fully isolate resources used by different workloads, preventing one set of queries from being impacted by another. With multi-cluster isolation, multiple execution clusters share the same data and catalog and can each be scaled independently.
• Data Reflections on Cloud Data Lake Storage. Like indexes, Reflections enable Dremio to accelerate queries and reduce resource consumption. Starting in Dremio 4.0, users can store Reflections in S3 and ADLS thanks to C3 and Predictive Pipelining.
• Advanced Security for AWS & Azure. We’ve added integration with common AWS and Azure security services – including configurable S3 IAM roles, credential storage in AWS Secrets Manager, server-side encryption with AWS KMS keys, and SSO with Azure AD.
• Dremio Hub. Dremio Hub provides an accessible and easy-to-use listing of community-developed connectors to a wide variety of data sources, ranging from relational databases to SaaS applications.