Data Engineer (Azure Databricks & Spark)
P
PT Arbeit Infotech Indonesia
60 - 100K PHP
Full-time
Bonifacio Global City, Taguig, Metro Manila, Filipina
Data Engineer (Azure Databricks & Spark)
Work Setup: Onsite – Taguig, Philippines
Industry: Multinational Company (MNC)
Employment Type: Permanent
Only for local candidates in the Philippines
Arbeit Group is currently looking for an experienced Data Engineer to join a leading multinational company in Taguig, Philippines.
We're looking for candidates with proven production-level experience in Azure Databricks and Spark. Strong expertise in PySpark, SQL, Data Lakes, ETL, and data quality is essential for this role.
Key Responsibilities
- Build, develop, and maintain large-scale data pipelines using Azure Databricks and Spark
- Design and optimize ETL processes and data ingestion workflows
- Develop high-performance Python/PySpark and SQL solutions for TB-scale datasets
- Design and maintain modern Data Lake architectures
- Ensure data quality, validation, integrity, and governance across data platforms
- Utilize Azure data services for analytics, storage, and processing
- Prepare technical documentation, requirements documents, and testing artifacts
- Collaborate with business users, stakeholders, and technical teams to deliver data solutions
- Support production environments and performance optimization initiatives
- Manage source control and code versioning using Git
Requirements
- Minimum 5+ years of hands-on experience with Azure Databricks and Apache Spark
- Strong expertise in Python, PySpark, and SQL
- Proven experience handling and optimizing TB-scale data processing workloads
- Strong knowledge of Data Lake architecture and ETL frameworks
- Experience with Azure Data Analytics services
- Strong understanding of data quality, validation, and governance practices
- Experience creating technical documentation and solution designs
- Excellent communication and stakeholder management skills
- Experience with Git version control
- Ability to work effectively with cross-functional teams
Preferred Qualifications
- Experience supporting enterprise-scale production data platforms
- Strong requirements gathering and testing documentation experience
- Exposure to complex analytics and business intelligence environments