0%

Book Description

Many organizations today are succeeding with data lakes, not just as storage repositories but as places to organize, prepare, analyze, and secure a wide variety of data. Management and governance is critical for making your data lake work, yet hard to do without a roadmap. With this ebook, you’ll learn an approach that merges the flexibility of a data lake with the management and governance of a traditional data warehouse.

Author Ben Sharma explains the steps necessary to deploy data lakes with robust, metadata-driven data management platforms. You’ll learn best practices for building, maintaining, and deriving value from a data lake in your production environment. Included is a detailed checklist to help you construct a data lake in a controlled yet flexible way.

Managing and governing data in your lake cannot be an afterthought. This ebook explores how integrated data lake management solutions, such as the Zaloni Data Platform (ZDP), deliver necessary controls without making data lakes slow and inflexible.

You’ll examine:

  • A reference architecture for a production-ready data lake
  • An overview of the data lake technology stack and deployment options
  • Key data lake attributes, including ingestion, storage, processing, and access
  • Why implementing management and governance is crucial for the success of your data lake
  • How to curate data lakes through data governance, acquisition, organization, preparation, and provisioning
  • Methods for providing secure self-service access for users across the enterprise
  • How to build a future-proof data lake tech stack that includes storage, processing, data management, and reference architecture
  • Emerging trends that will shape the future of data lakes

Table of Contents

  1. 1. Overview
    1. Succeeding with Big Data
    2. Definition of a Data Lake
    3. The Differences Between Data Warehouses and Data Lakes
      1. The Business Case for Data Lakes
      2. Drawbacks of Data Lakes
    4. Succeeding with Big Data
  2. 2. Designing Your Data Lake
    1. Cloud, On-Premises, Multicloud, or Hybrid
    2. Data Storage and Retention
    3. Data Lake Processing
    4. Data Lake Management and Governance
    5. Advanced Analytics and Enterprise Reporting
    6. The Zaloni Data Lake Reference Architecture
      1. Zone 1: The Transient Landing Zone
      2. Zone 2: The Raw Zone
      3. Zone 3: The Trusted Zone
      4. Zone 4: The Refined Zone
      5. The Sandbox
  3. 3. Curating the Data Lake
    1. Integrating Data Management
    2. Data Ingestion
    3. Data Governance
    4. Data Catalog
    5. Capturing Metadata
    6. Data Privacy
    7. Storage Considerations via Data Life Cycle Management
    8. Data Preparation
    9. Benefits of an Integrated Approach
  4. 4. Deriving Value from the Data Lake
    1. The Executive
    2. The Data Scientist
    3. The Business Analyst
    4. The Downstream System
    5. Self-Service
    6. Controlling Access
    7. Crowdsourcing
    8. Data Lakes in Different Industries
      1. Health and Life Sciences
    9. Financial Services
      1. Telecommunications
      2. Retail
  5. 5. Looking Ahead
    1. Logical Data Lakes
    2. Federated Queries
    3. Enterprise Data Marketplaces
    4. Machine Learning and Intelligent Data Lakes
    5. The Internet of Things
    6. In Conclusion
    7. A Checklist for Success
      1. Business-Benefit Priority List
      2. Architectural Oversight
      3. Security Strategy
      4. I/O and Memory Model
      5. Workforce Skillset Evaluation
      6. Operations Plan
      7. Disaster Recovery Plan
      8. Communications Plan
      9. Five-Year Vision
3.147.193.3