Data Engineer – Databricks & PySpark (HCLTech) | Chennai | Salary Based on Profile

HCLTech is recruiting a Senior Data Engineer to build ETL and big-data solutions using Databricks, PySpark and Python.

Job Highlights

• Company: HCLTech
• Role: Senior Data Engineer
• Location: Chennai, Tamil Nadu
• Experience: Relevant senior-level experience
• Employment Type: Full-Time
• Salary: Based on Profile
• Domain: Big Data and ETL Engineering

Roles & Responsibilities

• Build ETL pipelines using Databricks.
• Develop distributed processing jobs with PySpark.
• Write reusable Python data-processing components.
• Transform large structured and unstructured datasets.
• Optimize Spark-job performance.
• Implement data-quality validation rules.
• Monitor scheduled pipelines and investigate failures.
• Support production releases and operational incidents.
• Collaborate with analysts and platform teams.
• Maintain data-flow and support documentation.

Qualifications & Eligibility

• Strong Databricks and PySpark experience.
• Proficiency in Python and SQL.
• Understanding of big-data architecture.
• Experience developing production ETL pipelines.

Required Skills

• Databricks
• PySpark
• Python
• SQL
• ETL
• Big Data
• Data pipelines
• Performance optimization