• Design, build, and maintain data pipelines that transform and load disparate data sources into unified data sets for analysis.
• Collaborate with data scientists and analysts to deliver reliable data solutions tailored to their needs.
• Ensure data quality and integrity by implementing data validation and cleansing techniques.
• Optimize performance of data storage and processes to enhance overall system efficiency.
• Create detailed documentation of data pipelines, data processing techniques, and data models.
• Stay current with industry best practices and emerging technologies in data engineering.
Requirements
• Bachelor’s degree in Computer Science, Data Science, or a related discipline.
• 3+ years of experience as a Data Engineer or in a similar role.
• Proficient in programming languages such as Python or Java and experience with ETL tools.
• Strong knowledge of SQL and experience with relational and NoSQL databases.
• Familiarity with cloud services and big data technologies (AWS, Azure, Hadoop).
• Excellent problem-solving skills and ability to work effectively in a team environment.
