Principal Data Engineer - Databricks Focus

Advance your career as a Principal Data Engineer at Tata Consultancy Services, specializing in Databricks and modern data architectures. This position is ideal for those experienced in large-scale data solutions and financial data models in a hybrid role. You will drive the transformation from Cloudera to Databricks, ensuring data governance and integrity throughout the migration process. Your expertise will play a key role in shaping enterprise data platforms and enhancing reporting capabilities. Key Responsibilities:

• Lead transformation initiatives from Cloudera to Databricks
• Design and implement cloud-based data architectures
• Ensure compliance with data quality and governance frameworks
• Optimize data pipelines with Spark SQL and PySpark
• Act as a subject matter expert and mentor for teams

Requirements:

• Proven experience in Data Warehouse and Lakehouse environments
• Strong technical skills in Databricks, Delta Lake, and Spark
• Familiarity with finance and regulatory data models
• Experience with CI/CD pipeline tools
• Effective communication and stakeholder management skills

Utilize your technical authority to influence data solutions at Tata Consultancy Services and make a lasting impact. #J-18808-Ljbffr