On Site
Bangalore
India
3-6 months
Time and material
$ 18-20/Hr
Description
Total Yrs of Exp - 7+ Yrs Relv Yrs of Exp - 7+ Yrs Mandatory Skills: Databricks Unity Catalog, SQL, Azure Data Factory " •Design, build, and maintain scalable, reliable, and efficient data pipelines on Azure Databricks. •Implement and manage Databricks Unity Catalog for centralized governance, fine-grained access control, and metadata management. •Develop robust ETL/ELT workflows using Azure Data Factory, Databricks notebooks, and PySpark/SQL. •Collaborate with data architects, analysts, and business stakeholders to define data requirements and translate them into technical solutions. •Enforce data quality, security, and compliance best practices across all datasets. •Optimize performance and cost efficiency of data storage and compute in Azure. •Integrate diverse data sources (structured, semi-stru)Nice to have skills: "• Bachelor’s degree in computer science or related field. • 12+ years of relevant professional experience. • 7year’s experience with Databricks Data Lake and Lakehouse Platform • Strong SQL skills for data manipulation and query optimization • Experience in data modeling, data integration and data quality • Knowledge of data warehouse architectures, design patterns, and performance tuning techniques • Hands on experience on unified data analytics platform with Azure Databricks, Databricks Workspace user interface, managing Notebooks which use Delta Lake. • Expert on Databricks, particularly Unity Catalog for governance, lineage, and secure data sharing. • Strong proficiency in Azure services including Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Synapse Analytics, and Azure. Note - Resource needs to ready for F2F Intv at IBM location based on account request and Day 1 reporting from DOJ." - IBMFG2JP00001913
Skills:
ETL/ELT workflows,data quality,SQL,Azure Data Factory,data integration,Databricks Unity Catalog,Azure Databricks,Azure Data Lake Storage (ADLS)

Interested in this project and numerous others like it?

Register on WorkWall now and get started