{"product_id":"data-engineering-design-patterns","title":"Data Engineering Design Patterns","description":"\u003cp\u003eData projects are an intrinsic part of an organization's technical ecosystem, but data engineers in many companies are still trying to solve problems that others have already solved. This hands-on guide shows you how to provide valuable data by focusing on various aspects of data engineering, including data ingestion, data quality, idempotency, and more.\u003c\/p\u003e\u003cp\u003eAuthor Bartosz Konieczny guides you through the process of building reliable end-to-end data engineering projects, from data ingestion to data observability, focusing on data engineering design patterns that solve common business problems in a secure and storage-optimized manner. Each pattern includes a user-facing description of the problem, solutions, and consequences that place the pattern into the context of real-life scenarios.\u003c\/p\u003e\u003cp\u003eThroughout this journey, you'll use open source data tools and public cloud services to see how to put each pattern into practice. You'll learn:\u003c\/p\u003e\u003cul\u003e\n\u003cli\u003eChallenges data engineers face and their impact on data systems\u003c\/li\u003e\n\u003cli\u003eHow these challenges relate to data system components\u003c\/li\u003e\n\u003cli\u003eWhat data engineering patterns are for\u003c\/li\u003e\n\u003cli\u003eHow to identify and fix issues with your current data components\u003c\/li\u003e\n\u003cli\u003eTechnology-agnostic solutions to new and existing data projects\u003c\/li\u003e\n\u003cli\u003eHow to implement patterns with Apache Airflow, Apache Spark, Apache Flink, and Delta Lake\u003c\/li\u003e\n\u003c\/ul\u003e\u003cp\u003eBartosz Konieczny is a freelance data engineer who's been coding for more than 15 years. He's held various senior hands-on positions that helped him work on many data engineering problems in batch and stream processing.\u003c\/p\u003e","brand":"O'Reilly Media","offers":[{"title":"Default Title","offer_id":54229847605592,"sku":"9781098165819","price":76.99,"currency_code":"EUR","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0278\/1295\/4195\/files\/9781098165819.jpg?v=1780390820","url":"https:\/\/agendabookshop.com\/products\/data-engineering-design-patterns","provider":"Agenda Bookshop","version":"1.0","type":"link"}