Название: Streaming Data Mesh: A Model for Optimizing Real-Time Data Services (8th Early Release) Автор: Hubert Dulay, Stephen Mooney Издательство: O’Reilly Media, Inc. Год: 2023 Страниц: 257 Язык: английский Формат: epub (true), mobi Размер: 31.0 MB
Data lakes and warehouses have become increasingly fragile, costly, and difficult to maintain as data gets bigger and moves faster. Data meshes can help your organization decentralize data, giving ownership back to the engineers who produced it. This book provides a concise yet comprehensive overview of data mesh patterns for streaming and real-time data services.
Authors Hubert Dulay and Stephen Mooney examine the vast differences between streaming and batch data meshes. Data engineers, architects, data product owners, and those in DevOps and MLOps roles will learn steps for implementing a streaming data mesh, from defining a data domain to building a good data product. Through the course of the book, you’ll create a complete self-service data platform and devise a data governance system that enables your mesh to work seamlessly.
This book is designed to help you understand the essential concepts around streaming data mesh—the concepts, architectures, and technologies at its core. The book covers all the essential topics related to streaming mesh, from the basics of data architecture, to the use of big data tools for data warehousing, to business-oriented approaches for streaming data mesh architectures. Additionally, we will look at a stack of services involved in a successful streaming data mesh project.
This book does not require you to have pre-knowledge of the pillars that make up a data mesh. We will briefly introduce the pillars at a very high level but specifically define them with streaming in mind.
With this book, you will:
Design a streaming data mesh using Kafka Learn how to identify a domain Build your first data product using self-service tools Apply data governance to the data products you create Learn the differences between synchronous and asynchronous data services Implement self-services that support decentralized data
Preface 1. Data Mesh Introduction 2. Streaming Data Mesh Introduction 3. Domain Ownership 4. Streaming Data Products 5. Federated Computational Data Governance 6. Self-Service Data Infrastructure 7. Architecting a Streaming Data Mesh 8. Building a Decentralized Data Team 9. Feature Stores 10. Streaming Data Mesh in Practice Index