AWS Data Engineer
- Posted 3 months ago
- Be among the first 30 applicants
Job Description
- Help design, build and continuously improve the clients online platform.
- Research, suggest and implement new technology solutions following best practices/standards.
- Take responsibility for the resiliency and availability of different products.
- Be a productive member of the team.
- 5+ years of experience in data engineering, analytics, or backend development
- Design, build, and optimize scalable data pipelines and cloud-based data solutions using AWS and Databricks to support advanced analytics and business needs.
- Develop and refactor reusable data pipelines leveraging AWS and Databricks
- Design and implement data lakes, data warehouses, ETL processes, and backend services for structured and unstructured data
- Collaborate with business analysts, data scientists, architects, developers, and stakeholders to deliver fit-for-purpose solutions
- Optimize data pipelines for performance, scalability, cost efficiency, reliability, and security
- Implement robust testing and monitoring frameworks
- Identify and resolve performance bottlenecks, ensuring efficient workload execution
- Participate in code reviews and maintain high-quality documentation
- Stay updated with emerging data engineering trends and apply best practices
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field
- Hands-on experience with AWS Cloud and Databricks
- Strong proficiency in:, Serverless and orchestration workflows (AWS Lambda, Step Functions), Programming and scripting (Python, Bash, Make), Query languages (SQL, SPARQL)
- Experience with diverse data models: Relational databases (Amazon Redshift), NoSQL databases (DynamoDB), Object storage (Amazon S3), Graph databases (Amazon Neptune)
- Experience with version control and CI/CD tools (Git, GitLab preferred)
- Infrastructure as Code experience, preferably using AWS CDK
- Strong passion for data engineering and solving real-world problems
- Customer-focused and value-driven mindset
- Excellent analytical and problem-solving skills
- Strong collaboration and communication abilities
- Familiarity with Agile/Scrum methodologies
- Proactive approach to continuous improvement and innovation
- A challenging, innovating environment.
- Opportunities for learning where needed.
More Info
Key Skills
About Company
Skills:
Aws Lambda, Aws Redshift, Data Modeling, Pyspark, AWS Glue, Apache Spark, AWS Athena, Sql, ELT, Git, AWS IAM, Data Warehousing, Python, Aws S3, Etl, Airflow, AWS EMR, AWS Step Functions, CI/CD
Skills:
Aws Services, Pyspark, Postgresql, Databricks, MongoDB, Python, Step Functions, Lambda Functions
Skills:
Apache Airflow, AWS Glue, Rest Apis, Python, Apache Iceberg, Amazon Athena, AWS Step Functions, Medallion Architecture
Skills:
Sql, S3, Pyspark, Emr, Redshift, Lambda, Git, Docker, Iam, Databricks, Kubernetes, AWS, Airflow, CI/CD pipelines, Glue
Skills:
snowflake , Sql, Databricks, Pig, Spring Framework, Java, HBase, Hadoop, AWS, BigData, Cassandra, Hive, Python, Azure, Scala, MongoDB, Spark, Redshift, dbt, Influx DB, Map Reduce