Retail Sales Analytics Pipeline

Build an end-to-end batch and streaming data pipeline to ingest, transform, and analyze retail sales data. Use Cloud Storage for data lake ingestion, Pub/Sub and Dataflow for real-time event processing, and BigQuery as the data warehouse for analytical queries. Create dashboards in Looker Studio to surface business insights such as sales trends and inventory optimization.

IoT Sensor Data Platform

Design a real-time data platform to ingest and process IoT sensor data from thousands of connected devices. Leverage Pub/Sub for message ingestion, Dataflow for stream processing and windowed aggregations, and BigQuery for long-term analytics. Integrate BigQuery ML to build anomaly detection models that trigger predictive maintenance alerts.

Financial Fraud Detection System

Develop a secure, real-time data pipeline to detect fraudulent activities in financial transactions. Use Dataflow for streaming fraud scoring, BigQuery ML for training and deploying predictive classification models, and implement security controls using IAM roles and the Data Loss Prevention API. Apply data governance practices with Data Catalog to ensure compliance with financial regulations.