We are seeking an experienced Azure Data Engineer with extensive knowledge of Azure Data Factory, SQL Server database design, and ETL processes. The ideal candidate will have a proven track record in performance optimization and managing data systems. This role involves designing and maintaining scalable data solutions, optimizing SQL Server databases, and managing end-to-end ETL pipelines. Strong PowerShell scripting skills for automation and troubleshooting are essential. The position requires overlap with US CST time zone, and the interview process will include an internal screening followed by a 15-day trial at the client site.
Data Solution Design:
Design, implement, and maintain scalable and secure data solutions using Azure Data Factory and other related services.
ETL Pipeline Management:
Develop and manage end-to-end ETL (Extract, Transform, Load) processes, ensuring data accuracy, completeness, and timely delivery.
SQL Server & Database Optimization:
Design and optimize SQL Server databases for efficient data storage and retrieval, focusing on performance and scalability.
PowerShell Scripting:
Write and optimize PowerShell scripts for automating ETL processes, data extraction, and transformation tasks.
Performance Tuning:
Continuously monitor and optimize the performance of data systems and ETL pipelines to ensure they run efficiently and reliably.
Monitoring & Troubleshooting:
Proactively monitor data infrastructure, troubleshoot issues, and ensure system health and optimal performance.
Data Security & Compliance:
Implement data security practices in line with industry standards and ensure compliance with relevant data protection regulations.
Collaboration & Leadership:
Work closely with cross-functional teams, offering mentorship to junior engineers, and contributing to the overall success of the team.
This role is a great opportunity for a self-motivated data engineer with expertise in cloud data solutions, SQL Server, and ETL processes. If you're passionate about building efficient, scalable data pipelines and optimizing data systems, we encourage you to apply.
