Data Integration Engineer
T
Talentium Inc.
Contract
N/A
Scope of Work / Responsibilities
1. Data Integration Pipeline Development
- Design, develop, and test data pipelines to extract, transform, and load (ETL) data from diverse source systems into target data models and destinations
- Collaborate with business analysts to define data mapping and transformation rules
- Ensure data accuracy and integrity through thorough testing, validation, and quality checks
- Produce high-level and detailed technical designs, including comprehensive documentation for all data pipelines
- Explore and evaluate emerging technologies (e.g., agentic AI) to improve the efficiency, accuracy, and automation of data delivery processes
2. Environment Setup & Management
- Design and implement Azure-based, cloud-native solutions, leveraging:
- Azure Data Factory
- Azure Databricks
- Azure Container Apps
- Azure Service Bus
- Support the configuration and maintenance of development and production environments for IRIS data integration projects
- Maintain and optimize CI/CD deployment pipelines in alignment with the company standards
- Ensure scalable, secure, and event-driven data integrations, aligned with banking and enterprise architecture standards, using tools such as:
- Azure Data Factory
- Databricks
- Right Integration Pattern (RIP)
3. Pipeline Operations
- Monitor and maintain data pipelines to ensure continued alignment with evolving source systems
- Troubleshoot and resolve issues to maintain stable and reliable operations
4. Collaboration & Continuous Improvement
- Actively participate in Agile development processes, including Scrum and Kanban ceremonies
- Support project planning activities and manage interdependencies
- Apply industry best practices in:
- Coding
- Testing
- Deployment (including CI/CD pipelines)
- Stay up to date with the latest trends in data engineering and recommend process improvements
- Perform other relevant duties as assigned
Requirements and Qualifications (Education & Work Experience)
Core Requirements
- Bachelor’s degree in Computer Science, Information Systems, or Information Technology
- Minimum of 5 years of experience as an integration developer and/or data engineer, preferably within the banking or financial services sector
- Strong expertise in the Azure Data Ecosystem, including:
- Azure Data Factory
- Azure Data Lake
- Azure Databricks
- Azure Blob Storage
- Azure SQL Databases
- Proficiency in at least one of the following programming languages used for data integration:
- Python
- Quarkus (Java)
- C#
- Node.js
- Golang
- Experience with REST API development in an enterprise environment
- Experience in setting up development and production environments, including CI/CD pipelines
- Hands-on experience with Azure DevOps for version control and deployment automation
- Strong ability to collaborate with IT teams to design and deliver robust data integration solutions
- Excellent written and verbal communication skills in English
- Familiarity with ITIL practices and experience working in Scrum/Agile frameworks
Preferred Qualifications
- Experience with:
- Azure Service Bus
- ADB’s Right Integration Pattern (RIP)
- Quarkus framework for microservices development
- Experience with other cloud platforms such as:
- AWS
- Oracle Cloud Infrastructure (OCI)
- Experience working within the Oracle ecosystem
- Relevant Azure certifications, such as:
- AZ-900
- DP-900 (or higher)
Work Arrangement
- Hybrid setup, requiring to report onsite three (3) times per week. If the requesting unit requires contractors to report to HQ, compliance is mandatory.
- Work schedule: 8:00 AM – 5:00 PM (Manila Time)