Role Description

Generative AI Engineer

Job Purpose

We are seeking a 57year experience AI engineer with a strong background in machine learning programming skills and a deep understanding of generative models The position is responsible for turning research into practical solutions that address realworld problems while ensuring the reliability and ethical use of generative AI in their applications

Key Responsibilities

1 Data Pipeline Development

Design and implement scalable data pipelines using Python to ingest process and transform log data from various sources

2 Context Creation

Develop APIs and services to consume data and provide this as a context to AI Agents

3 Data Monitoring and Maintenance

Set up monitoring and ing systems to ensure the reliability and performance of data pipelines

Troubleshoot and resolve issues related to data ingestion processing and storage

4 Collaboration and Documentation

Work closely with crossfunctional teams to understand requirements and deliver solutions that meet business needs

Document data pipeline architecture processes and best practices for future reference and knowledge sharing

5 Evaluation and Testing

Conduct thorough testing and validation of generative models

6 Azure DevOps Utilization

Design and optimize data storage and retrieval strategies using Azure DevOps

Implement data modeling partitioning and indexing strategies to enhance query performance

7 Research and Innovation

Stay updated with the latest advancements in generative AI and explore innovative techniques to enhance model capabilities

Experiment with different architectures and approaches in Agentic AI

Technical skills requirement

1 Strong proficiency in Python for data processing and automation Ability to write efficient and wellstructured code

2 Experienced with generative AI models and their integration into data workflows

3 Experienced with prompt engineering and LLM models Opensource and licensed Ex Llama OpenAI

4 Experienced with Application development framework like LangChain or similar frameworks

5 Experienced working with REST frameworks like Fast API Flask and Django

6 Good understanding of machine learning workflows and deployment

7 Knowledge of ETL processes data modeling and data warehousing principles

8 Familiarity with containerization and orchestration tools Docker Kubernetes

9 Familiarity with Snowflake for data warehousing and analytics

10 Experienced with cloud platforms AWS GCP Azure and related services is a plus

11 Strong communication and collaboration skills

12 Excellent problemsolving skills and attention to detail

Specialist - Data Engineering