Job Description Overview
-
Skill:
Talend Data Integration, ETL, SQL, Data Mapper, Java, Data Transformation, Data Mapping, Data Quality, Data Warehousing, Scripting (Python, Java), Version Control (Git), CI/CD, Cloud Deployment, API Integration, MS-Office, Communication Skills
-
Location:
Remote
-
Experience:
7
Experienced Talend Data Integration Developer with 7-12 years in the industry, specializing in designing, developing, and deploying robust ETL solutions using industry-standard tools like Talend. With 3+ years of hands-on expertise in Talend Data Integration, I have extensive experience in building end-to-end data transformations, managing complex data workflows, and ensuring high-quality data pipelines. Adept at working with Talend Data Mapper, SQL scripting, and Java, with a strong understanding of data integration challenges. Proven leadership abilities with experience leading small teams, conducting code reviews, and implementing best practices. A problem-solver with a can-do attitude and a strong focus on delivering efficient, scalable, and high-performance ETL solutions.
Key Responsibilities:
-
Data Integration:
- Design, develop, and test ETL tasks using Talend Open Studio.
- Extract, transform, and load (ETL) data from various sources, including databases, APIs, flat files, and more.
- Build and maintain efficient, high-performance data pipelines for reliable data flow.
-
Data Mapping:
- Develop and implement data mappings using Talend Data Mapper to convert data between formats and structures.
- Cleanse, transform, and validate data to meet business requirements.
- Ensure that data mapping is optimized for performance and scalability.
-
Development & Deployment:
- Develop custom Talend components and jobs to automate complex data processing tasks.
- Deploy Talend applications to on-premises servers or cloud platforms such as Talend Cloud.
- Ensure seamless integration of the ETL processes into existing systems and business workflows.
-
Data Quality and Monitoring:
- Implement data quality checks and cleansing routines within Talend workflows to ensure clean, accurate, and consistent data.
- Monitor data pipelines regularly for errors and ensure ongoing data integrity.
- Troubleshoot and resolve data-related issues in real-time.
-
Version Control & CI/CD:
- Use Git for version control to manage code changes and track development history.
- Integrate CI/CD pipelines to automate testing, building, and deployment of Talend applications, ensuring continuous integration and delivery.
-
Collaboration and Documentation:
- Work closely with data analysts, business users, and other developers to understand requirements and provide technical solutions.
- Document all data integration processes, including data transformations, workflows, and custom components.
- Communicate technical concepts and updates effectively to stakeholders at all levels.
-
Leadership & Mentorship:
- Lead and mentor small development teams (2-3 developers), conducting code quality reviews and recommending best practices.
- Translate customer requirements into functional data mapping and transformation specifications.
Must Haves:
-
Experience:
- 7-12 years of experience in designing, developing, and deploying ETL solutions using industry-standard ETL tools, particularly Talend Data Integration.
- 3+ years of hands-on experience with Talend Data Integration for end-to-end transformations and workflows.
- Deep expertise in SQL and experience with scripting languages like Python or Java.
- Proficiency with Talend Data Mapper, including working with XML data structures.
- Experience in leading small teams and conducting code reviews to maintain code quality.
-
Technical Skills:
- Strong understanding of data integration, data transformation, and data mapping.
- Experience working with relational databases and data warehousing concepts.
- Familiarity with data governance, data security best practices, and ensuring data quality in ETL processes.
- Experience with Git for version control and CI/CD pipelines for automating development processes.
-
Additional Skills:
- Knowledge of Talend Data Quality components is a plus.
- Familiarity with the insurance industry and actuarial fields is advantageous.
- Experience with ERP systems at a super user level is beneficial.
- Ability to understand complex data models and data structures.