We are seeking a talented and motivated PySpark and Python Engineer to join our dynamic team. The ideal candidate will have a strong background in big data processing and a passion for building scalable data solutions.
Key responsibilities:
* Design and develop scalable data pipelines using PySpark and Python.
* Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
* Optimize data workflows for performance and efficiency.
* Implement ETL processes to extract, transform, and load data from diverse sources.
* Ensure data quality and integrity through rigorous testing and validation.
* Monitor and troubleshoot data processing jobs to resolve issues promptly.
* Document data architecture and processes for future reference and compliance
Work location : HMCL office Bangalore , 5 Days WFO