Job Description Overview
-
Skill:
Python, Mysql, Azure Application Insights, Gcp, Devops, Ci/Cd Pipeline, ETL, Hadoop, Hive
-
Location:
Remote
-
Experience:
8
We are seeking an experienced Python Developer with strong expertise in Automation, API creation, ETL processes, and Data Visualization. The ideal candidate should have a strong background in working with complex SQL queries, stored procedures, views, and triggers, along with experience in Cloud technologies such as Azure, AWS, and GCP. Experience with DevOps, CI/CD pipelines, and familiarity with Big Data technologies like Hadoop and Hive will be highly valued. You should also have a good understanding of Machine Learning and Natural Language Processing (NLP) concepts. Strong analytical, communication, and teamwork skills are essential.
Key Responsibilities:
Python Development & Automation:
- Develop and implement automation scripts and processes using Python to streamline workflows and improve operational efficiency.
- Create APIs for integrating various systems and tools, ensuring smooth data exchange and communication between different platforms.
- Work on ETL processes, ensuring data extraction, transformation, and loading from various sources into databases or data warehouses.
Database Management & Development:
- Write and optimize complex SQL queries, stored procedures, views, and triggers to interact with databases effectively.
- Ensure data integrity and performance optimization in the database layer, supporting various data-related needs across projects.
Cloud Technologies:
- Work with cloud platforms such as Azure, AWS, and GCP to build scalable solutions that leverage the power of cloud computing for automation, data processing, and analysis.
- Integrate and manage cloud-based services and databases to support the automation and ETL processes.
DevOps & CI/CD Pipelines:
- Build and maintain CI/CD pipelines to automate testing, deployment, and integration processes, ensuring faster development cycles and high-quality code delivery.
- Collaborate with DevOps teams to ensure continuous integration and delivery of solutions.
Big Data & Machine Learning (Good to Have):
- Work with Big Data technologies like Hadoop and Hive, ensuring efficient data processing and management at scale.
- Experience in Machine Learning or Natural Language Processing (NLP) is a plus, contributing to projects that involve advanced data analytics and AI capabilities.
Qualifications & Skills:
-
Experience:
- 5-8 years of experience in Python development, with a focus on Automation, API creation, and ETL processes.
- Expertise in SQL and database management, including writing complex queries, stored procedures, views, and triggers.
- Hands-on experience with cloud platforms such as Azure, AWS, and GCP.
- Familiarity with DevOps practices and the creation of CI/CD pipelines.
-
Technical Skills:
- Strong proficiency in Python, with solid experience in building automation scripts and integrating systems using APIs.
- Advanced knowledge of ETL processes, data integration, and data warehousing.
- Experience with SQL (complex queries, stored procedures, views, triggers) and relational databases.
- Hands-on experience with cloud-based solutions (Azure, AWS, GCP).
- Familiarity with Big Data technologies (Hadoop, Hive) and experience with machine learning or NLP are desirable.
-
Soft Skills:
- Strong analytical skills, with the ability to troubleshoot and resolve complex technical challenges.
- Excellent communication skills (both oral and written) to effectively collaborate with cross-functional teams.
- Ability to work effectively in a team-oriented environment and contribute to the success of the team.
- High degree of integrity and professionalism in all aspects of work.
Preferred Qualifications:
- Experience in Data Science, Machine Learning, or NLP.
- Familiarity with data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
- Certification in Cloud technologies (AWS Certified Solutions Architect, Azure, or GCP certifications).
- Familiarity with containerization technologies like Docker and Kubernetes.