Job Description Overview
-
Skill:
Azure Devops, Azure Synapse Analytics, Azure Data Factory, Azure Data Bricks, Azure Data Lake, Azure Analysis Services, Spark, sql, Data Modeling,Power Bi/Dax
-
Location:
Remote
-
Experience:
6
We are seeking an experienced Data Architect / Data Scientist to join our team. The ideal candidate will have high-level experience in architecture and data science, with a strong focus on data engineering, big data processing, and data analytics. This role requires proficiency in Azure technologies such as Azure Data Lake (ADL), Azure Data Factory (ADF), Databricks, and Synapse, as well as expertise in ELT pipeline development, data modeling, and data science pipelines. If you are passionate about building and optimizing complex data systems and solving challenging problems, we would love to hear from you.
Key Responsibilities:
Architecture & Data Science:
- Design and implement scalable and efficient data architectures and solutions for large-scale data processing and analytics.
- Lead the development of data science pipelines to process, clean, and analyze large datasets.
- Develop solutions that integrate and process data from various sources, ensuring data quality, accessibility, and usability.
Azure Proficiency:
- Utilize Azure Data Lake (ADL), Azure Data Factory (ADF), Databricks, and Synapse for cloud-based data storage, transformation, and analytics.
- Build, optimize, and manage ELT pipelines using Azure Data Factory, ensuring efficient data movement and transformation.
- Leverage Databricks and Spark SQL/PySpark for big data processing and complex analytics workflows.
Data Warehouse & ELT Pipeline Development:
- Lead the implementation of data warehouse solutions, ensuring effective data storage, retrieval, and transformation.
- Develop and maintain ELT (Extract, Load, Transform) pipelines to efficiently process and integrate data across different platforms.
Big Data & Data Science Pipelines:
- Design and optimize big data processing frameworks for large-scale data science applications.
- Utilize PySpark and Spark SQL to process and analyze large datasets in distributed computing environments.
Data Visualization & Analytics:
- Create and maintain interactive dashboards and reports using PowerBI, Tableau, and other data visualization tools.
- Collaborate with business stakeholders to translate data into actionable insights and recommendations.
Data Modeling & Problem-Solving:
- Develop and implement strong data models that support analytical and business reporting needs.
- Solve complex data-related problems and enhance data-driven decision-making by applying analytics and problem-solving skills.
Collaboration & Communication:
- Work closely with cross-functional teams to understand business requirements and design data systems that meet those needs.
- Communicate technical concepts effectively to non-technical stakeholders, ensuring alignment on project goals and outcomes.
Qualifications & Skills:
- Experience:
- High-level experience in Data Architecture or Data Science, with expertise in large-scale data processing, analytics, and data systems design.
- Proficient in Azure technologies such as ADL (Azure Data Lake), ADF (Azure Data Factory), Databricks, and Synapse.
- Experience with ELT pipeline development using Azure Data Factory and managing data workflows.
- Strong knowledge of data warehouse implementation, data modeling, and complex data processing tasks.
- Experience with PySpark and Spark SQL for big data processing and advanced analytics.
- Technical Skills:
- Strong database and RDBMS skills with hands-on experience in MS SQL Server and Oracle.
- Familiarity with big data frameworks and experience building data science pipelines.
- Experience using data visualization tools such as PowerBI and Tableau to create impactful business reports and dashboards.
- Soft Skills:
- Strong problem-solving and analytical skills with the ability to break down complex issues and find efficient solutions.
- Highly motivated, self-driven, and detail-oriented with the ability to prioritize tasks and manage multiple projects effectively.
- Excellent communication skills to work collaboratively with cross-functional teams and to present technical solutions to non-technical stakeholders.
Preferred Skills:
- Experience with cloud-native architecture and deployment on Azure.
- Knowledge of data governance, data security, and compliance best practices in cloud-based environments.
- Familiarity with machine learning models and deploying analytics solutions at scale