Hyderabad (INDIVYA) Divyashree,B4 Survey No 66/1 Raidurga Village Serilingampalli Mandal B4 Survey N
India
3-6 months
Time and material
$ 18-20/Hr
Description
Sector - Distribution RTH - Y No of Position - 3 Total Yrs of Exp - 7+ Yrs Detailed JD - Lead design and delivery of enterprise-scale data pipelines on GCP, transforming raw data into analytics-ready assets. Own performance, cost, and reliability across BigQuery, Dataflow, and orchestration layers, aligning every transformation to measurable business KPIs. Key Responsibilities Architect and implement end-to-end ELT/ETL (ingest → transform → serve) aligned to business KPIs. Design star/snowflake models, define facts/dimensions, and maintain semantic contracts for BI. Build high-performance BigQuery assets (SPROCs, views, materialized/agg tables) with partitioning, clustering, and pruning. Optimize pipelines processing TB-scale data (e.g., Finance ACDOCA) for cost and latency SLAs; enable Power BI reporting. Develop batch & streaming pipelines via Dataflow (Beam); orchestrate with Composer/Workflows; manage lakes on Cloud Storage; expose APIs through Cloud Run. Implement CI/CD and IaC using Git and Terraform; enforce IAM least-privilege and dataset-level controls. Drive observability, data quality, lineage, and SLA monitoring across data domains. Must-Have Skills Advanced SQL (BigQuery): window functions, regex, CTEs, pivots/unpivots, deduping, MERGE/UPSERT patterns. BigQuery expertise: SPROCs, UDFs, materialized views, BI Engine, query optimization, cost minimization. Performance engineering: partition/cluster design, join strategies, shuffle reduction, result caching. - IBMFG2JP00017149
Skills:
Advanced SQL,BigQuery expertise,CI/CD and IaC,Data modeling,Data pipeline design,ETL/ELT,Performance engineering,SLAs and KPIs alignment
Interested in this project and numerous others like it?