Data Engineer
- Posted a month ago
- Be among the first 10 applicants
Job Description
Responsibilities
- Develop and maintain data pipelines from multiple data sources
- Perform ETL (Extract, Transform, Load) processes for data integration
- Process and manage large volumes of data efficiently
- Develop and optimize database queries using Microsoft SQL Server
- Monitor and troubleshoot data pipelines
- Collaborate with Data Analysts, Business Analysts, and Developers for data requirements
- Perform data validation and ensure data quality
- Create documentation for data pipeline and ETL processes
- Optimize pipeline performance and database queries
- Minimum 1 year of experience as a Data Engineer
- Experience in building data pipelines
- Must have experience using Microsoft SQL Server
- Experience with ETL (Extract, Transform, Load) processes
- Familiar with Data Warehouse and Data Integration concepts
- Strong SQL skills (Join, Stored Procedure, Query Optimization)
- Experience using Informatica is a plus (Preferred)
- Experience with other ETL tools is an advantage
- Strong analytical and problem-solving skills
- Able to work independently and in a team environment
- Experience with ETL tools such as:
- SQL Server Integration Services
- Pentaho Data Integration
- Apache Airflow
- Experience handling large datasets
- Experience in Banking or Financial industry (preferred)
More Info
Key Skills
About Company
Skills:
data masking , snowflake , Java, BigQuery, Oracle Database, Scala, SQL Server, Apache Airflow, Azure Data Factory, MySQL, Python, Google Cloud Workflows, Generative AI, Cloud Composer, IAM roles, API integrations
Skills:
containerization , T-sql, Data Security, Data Profiling, Data Architecture, Metadata Management, Data Integration, Data Cleansing, Data Modelling, Data Collection and Ingestion, Data quality management, Big data framework and tools, Hybrid hosting, API design and development, Dev-Sec-Ops
Skills:
S3, Github, RDS, Workflows, Pyspark, Data Modeling, Redshift, Sql, Pandas, Gitlab, Databricks, Python, AWS, Auto Loader, Aurora, Glue, Delta Lake
Skills:
Odi, Owb, Data pipeline, Data Warehouse, Etl, ELT, Enterprise ETL technologies, GCP Platform
Skills:
Etl Tools, Data Architecture, Python, Sql