Data Engineer
Data Engineer
Ad Astra Consultants- Posted 2 hours ago
- Be among the first 10 applicants
Job Description
Data Engineer AWS+Python+Cloud Management + ETL
EXP : 8-10yrs
Location : Sydney & Banglore
The candidate should be at least below skillset- The resource we are looking for should have the these skillset
1. AWS Cloud Development experience
2. Atleast 3 years of Databases development experience. (Must have)
3. Understanding of Databases, Data warehousing concepts and Implementation experience. (Must have)
4. Experience working in Python or ETL Tool
5. Real time data ingestion experience.
More Info
Key Skills
Databases development
AWS Cloud Development
Real time data ingestion
About Company
Skills:
data engineering , snowflake , Machine Learning, Denodo, Power Bi, Pyspark, Azure Databricks, Automation, Devops, Azure Data Factory, FastAPI, Azure, Python, Azure App Services, Ai, Azure Key Vault, ADLSv2, Vector Databases, CI/CD, Azure Cognitive Services, RAG architectures
Skills:
Java, Apis, Panda, Cloud Technologies, Numpy, Databricks, Azure Cloud services, Python, Operations Manager, JVS Java-based scripting in Endur, modern integration platforms, SQL query development and optimization, Market Risk, ETL processes, Trading Manager, system interfaces, Credit Risk, Settlement Manager, Endur architecture, Accounting modules
Skills:
PostgreSQL, Apache Airflow, Nlp, Hl7, MongoDB, Python, Etl, LangChain, FHIR, Milvus Vector DB, GraphRAG, RAG, Azure technology stack, LlamaIndex
Skills:
Java, BigQuery, Pyspark, Scala, Shell Scripting, Dataproc, Jira, Sql, Apache Airflow, Cloud Storage, Git, Confluence, Gcp, Qlik, DataFlow, Python, Etl, Looker, Pub Sub, Looker Studio, Composer Airflow
Skills:
Data Modelling, Power Bi, Kafka, Azure Databricks, ELT, Spark Streaming, Data Architecture, Advanced Sql, Dax, Python, Etl, Pipelines, CI CD, Azure Data Factory ADF, Unity Catalog, Client Stakeholder Management, Delta Lake