Position Overview
Master Works is seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data engineering best practices and big data technologies. This role involves designing, developing, and maintaining data pipelines, optimizing data processing performance, and collaborating with data scientists and analysts to ensure data quality and integrity.
Key Responsibilities
- Data Pipeline Development: Design, develop, and maintain data pipelines using industry-standard tools and technologies.
- ETL Processes: Extract, transform, and load (ETL) data from various sources into data warehouses and data lakes.
- Performance Optimization: Optimize data processing performance and scalability to handle large volumes of data efficiently.
- Data Quality: Collaborate with data scientists and analysts to ensure data quality, integrity, and accuracy.
- Technical Expertise: Utilize proficiency in SQL and programming languages such as Python to develop data solutions and address technical
Requirements
Qualifications
- Experience: +3 years of experience with big data technologies such as Hadoop, Spark, and Hive.
- Data Modelling: Knowledge of data modelling and data warehousing concepts.
- Programming Skills: Proficiency in SQL and Python programming.
- Data Integration: Familiarity with data integration tools and techniques.