Home Page Icon
Home Page
Table of Contents for
cover
Close
cover
by Himanshu Shah, Nitin Sawant
Big Data Application Architecture Q&A: A Problem - Solution Approach
Title
Contents at a Glance
Contents
About the Authors
About the Technical Reviewer
Acknowledgments
Introduction
CHAPTER 1: Big Data Introduction
Why Big Data
Aspects of Big Data
How Big Data Differs from Traditional BI
How Big Is the Opportunity?
Deriving Insight from Data
Cloud Enabled Big Data
Structured vs. Unstructured Data
Analytics in the Big Data World
Big Data Challenges
Defining a Reference Architecture
Need for Architecture Patterns
Summary
CHAPTER 2: Big Data Application Architecture
Architecting the Right Big Data Solution
Data Sources
Ingestion Layer
Distributed (Hadoop) Storage Layer
Hadoop Infrastructure Layer
Hadoop Platform Management Layer
Security Layer
Monitoring Layer
Analytics Engine
Search Engines
Real-Time Engines
Visualization Layer
Big Data Applications
Summary
CHAPTER 3: Big Data Ingestion and Streaming Patterns
Understanding Data Ingestion
Multisource Extractor Pattern
Protocol Converter Pattern
Multidestination Pattern
Just-in-Time Transformation Pattern
Real-Time Streaming Pattern
ETL Tools for Big Data
Summary
CHAPTER 4: Big Data Storage Patterns
Understanding Big Data Storage
Façade Pattern
Data Appliances
Storage Disks
Data Archive/Purge
Data Partitioning/Indexing and the Lean Pattern
HDFS Alternatives
NoSQL Pattern
Polyglot Pattern
Big Data Storage Infrastructure
Typical Data-Node Configuration
Summary
CHAPTER 5: Big Data Access Patterns
Understanding Big Data Access
Stage Transform Pattern
Connector Pattern
Near Real-Time Access Pattern
Lightweight Stateless Pattern
Service Locator Pattern
Rapid Data Analysis
Secure Data Access
Summary
CHAPTER 6: Data Discovery and Analysis Patterns
Data Queuing Pattern
Index based Insight Pattern
Constellation Search Pattern
Machine Learning Recommendation Pattern
Converger Pattern
Challenges in Big Data Analysis
Log File Analysis
Sentiment Analysis
Data Analysis as a Service (DaaS)
Summary
CHAPTER 7: Big Data Visualization Patterns
Introduction to Big Visualization
Big Data Analysis Patterns
Mashup View Pattern
Compression Pattern
Zoning Pattern
First Glimpse Pattern
Exploder Pattern
Portal Pattern
Service Facilitator Pattern
Summary
CHAPTER 8: Big Data Deployment Patterns
Big Data Infrastructure: Hybrid Architecture Patterns
Traditional Tree Network Pattern
Resource Negotiator Pattern for Security and Data Integrity
Spine Fabric Pattern
Federation Pattern
Lean DevOps Pattern
Big Data on the Cloud and Hybrid Architecture
Big Data Operations
Summary
CHAPTER 9: Big Data NFRs
“ilities”
Security
Parallel Exhaust Pattern
Variety Abstraction Pattern
Real-Time Streaming Using the Appliance Pattern
Distributed Search Optimization Access Pattern
Anything as an API Pattern
Security Challenges
Operability
Big Data System Security Audit
Big Data Security Products
Summary
CHAPTER 10: Big Data Case Studies
Case Study: Mainframe to Hadoop-Based NoSQL Database
Case Study: Geo-Redundancy and Near-Real-Time Data Ingestion
Case Study: Recommendation Engine
Case Study: Video-Streaming Analytics
Case Study: Sentiment Analysis and Log Processing
Case Study: Real-Time Traffic Monitoring
Case Study: Data Exploration for Suspicious Behavior on a Stock Exchange
Case Study: Environment Change Detection
Summary
CHAPTER 11: Resources, References, and Tools
Big Data Product Catalog
Hadoop Distributions
In-memory Hadoop
Hadoop Alternatives
Hadoop SQL Interfaces
Ingestion tools
Map Reduce alternatives
Cloud Options
Table-Style Database Management Services
NoSQL Databases
In-Memory Big Data Management Systems
DataSets
Data Discovery
Visualization
Analytics Tools
Data Integration Tools
Summary
APPENDIX A: References and Bibliography
Index
Search in book...
Toggle Font Controls
Playlists
Add To
Create new playlist
Name your new playlist
Playlist description (optional)
Cancel
Create playlist
Sign In
Email address
Password
Forgot Password?
Create account
Login
or
Continue with Facebook
Continue with Google
Sign Up
Full Name
Email address
Confirm Email Address
Password
Login
Create account
or
Continue with Facebook
Continue with Google
Next
Next Chapter
Title
Add Highlight
No Comment
..................Content has been hidden....................
You can't read the all page of ebook, please click
here
login for view all page.
Day Mode
Cloud Mode
Night Mode
Reset