Position Overview: 

As a Data Engineer with over 5 years of experience on the AWS platform, you will be responsible for designing, implementing, and managing data solutions that enable the collection, storage, processing, and analysis of data from various sources. Your primary goal will be to ensure that data is accessible, reliable, and ready for analysis, supporting both business intelligence and data science initiatives.

Key Responsibilities:

• Data Architecture: Design, implement, and maintain data architectures and databases on AWS, ensuring scalability, availability, and security.
• ETL Pipeline Development: Create and manage ETL pipelines for data ingestion and transformation using AWS Glue, Lambda, Step Functions, or other suitable AWS services.
• Data Modeling: Develop and maintain data models, schemas, and structures that optimize data storage and access for analytics and reporting.
• Data Integration: Integrate data from various sources such as databases, APIs, logs, and data streams into the AWS environment.
• Data Warehousing: Design and manage data warehousing solutions using services like Amazon Redshift for efficient data retrieval.
• Performance Optimization: Optimize the performance of data processing and storage solutions for faster query responses.
• Data Security: Implement data security and access control measures to protect sensitive data, ensuring compliance with data privacy regulations.
• Data Quality: Monitor and maintain data quality by establishing data validation checks and automated data quality assurance processes.
• Data Governance: Establish data governance and best practices for data management, ensuring data is well-documented and understood within the organization.
• Monitoring and Troubleshooting: Implement monitoring, alerting, and logging solutions to proactively identify and resolve data infrastructure issues.
• Collaboration: Work closely with data analysts, data scientists, and other teams to understand their data needs and provide the necessary support.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or a related field (Master’s degree preferred).
• 5+ years of experience as a Data Engineer with a focus on AWS.
• AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect are a plus.
• Proficiency in data warehousing, ETL, and data pipeline development.
• Strong knowledge of AWS services like S3, Glue, Redshift, Lambda, and EC2.
• Experience with programming languages like Python, SQL, and knowledge of data querying languages.
• Familiarity with big data technologies (e.g., Hadoop, Spark) is beneficial.
• Excellent problem-solving skills and the ability to work independently and collaboratively within a team.
• Strong communication skills to interact with both technical and non-technical stakeholders.