Azure Data Engineer
... Blob Storage. Knowledge of Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics (formerly SQL Data Warehouse), and other Azure data tools. Data Modeling and Database Design: Experience ...
Senior Data Engineer with Databricks
Қала :
Казахстан, Астана
Компания :
Epam Kazakhstan (Эпам Казахстан),ТОО
Жалақы :
Табылды :
13 days ago
Сипаттама
Description
Are you looking for an opportunity to get into a diverse team and work with a leading retail client in Europe with ongoing businesses in numerous countries?
Join our community of Data professionals and become a part of Data Products pipelines migration from Oracle workloads to Databricks.
In this role, you will assess and implement new database technologies: from hybrid cloud and local infrastructures to replication, scalability, resiliency & redundancy.
What You’ll Do
- Develop, monitor, and operate data pipeline - Sales Order Data (with Post-order information: shipment, return, payment)
- Work with engineering teams to build and improve the "Single Source of Truth" KPI for business steering (central Profit Contribution measurement)
- Redevelop old legacy pipelines to new, advanced and standard versions
- Leverage and improve a cloud-based tech stack (AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala)
What You Have
- Background in Apache Spark and Spark streaming
- Hands-on experience with Databricks
- Solid knowledge of Scala programming language
- Expertise in GitHub + CI/CD
- Fluency in English, both written and verbal
Nice to have
- Proficiency in Delta-Lake and SQL
- Familiarity with AWS landscape
- Ability to build Apache Airflow pipelines
- Experience in Presto, Superset, Starburst, Oracle & Exasol
We Offer
- Outstanding career development opportunities with a transparent roadmap to accelerate your journey
- Knowledge sharing within the community of the industry’s top professionals worldwide
- Various opportunities for self-development: hard & soft skills internal training courses, mentoring programs, and unlimited access to 8,000+ LinkedIn Learning courses
- Free English classes with certified teachers
- Competitive compensation in USD, regular assessments, and salary reviews
- Bonuses for participating in the referral program
- Flexible schedule and opportunity to work remotely from any place
- Friendly team and enjoyable working environment
- Relocation opportunities within our offices in 50+ countries with throughout support for you and your family
- 28 vacation days and six trust days per year (sick leave without a medical certificate)
- Medical & family care programs, corporate and social events
About EPAM
- EPAM Kazakhstan is a team of technologists and innovators united by a passion for technology. Today we operate across all cities with offices in Astana, Almaty, and Karaganda and work with the world's leading companies from different industries. EPAM builds a continuously learning organization and helps its employees reach their full potential and achieve their professional goals through learning. Our agile methodologies, customer collaboration frameworks, engineering excellence programs, and hybrid teams offer many career paths and development opportunities
Ұқсас бос орындар
Senior Azure Data Engineer
Scope: Azure services: Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics (formerly Azure SQL Data Warehouse) Azure Blob Storage Azure Data Lake Storage Azure Cosmos DB Azure Event Grid Data processing and analytics: Apache Spark ...
Senior Data Scientist / Machine Learning Engineer with AWS
... for a skilled Senior Data Scientist Machine Learning Engineer to join our team, with a focus on finance-related machine learning processes.Our candidate should have experience in data science, machine learning, MLOps and data engineering, enabling them ...
Research Fellow in Data Analytic (Bishkek, Kyrgyz Republic)
... to the establishment of the Data Hub at the Graduate School ... key terms and concepts of Data Science and Machine Learning. Develop ... years of experience working in data analytics or related area and ...
Senior Data Engineer
... ; - 2 years of experience creating data models, transformation logic, data quality rules, and test cases; - ...
от 4000 до 6000 USDSenior Product Analyst
... with all teams in the Data Department to optimize data flows, control data quality and integrity, and create data marts for the product. Qualifications:— ...
Industrial Data Coordinator
... be the full-time Industrial Data Coordinator in Astana we’re looking ... coordinate a team of 2 data engineers and ensure all the data in Information systems is up- ...
Industrial Data Coordinator
... be the full-time Industrial Data Coordinator in Astana we’re looking ... coordinate a team of 2 data engineers and ensure all the data in Information systems is up- ...
Machine learning engineer
... experienced AI ML Automation Engineer to join our team. The ... fill in all the data (name, description, attributes, cost). Currently, ... . Experience of building data processing automation on top of ... to connect external data sources for model training. Strong ...
Senior Consultant, ESG
... team is looking for a Senior Consultant to support on ESG ... to facilitate the implementation of data analytics in the field of ... development and implementation of ESG data automation and visualization tools • Conduct ...
Reliability Growth Engineer
... equipment by reviewing TCMS data Ability to propose improvement of ... correct completion of the data. Execution phase: Monitoring of the ... support to technical documentation engineer to edit and modify the ... and reflecting these data in the project monthly and ...
Design Engineer
... cars. POSITION OVERVIEW: Design Engineer is an Engineer responsible for carrying out the ... processes using tools and data available; Providing detailed specifications analysis ... ; Recording and evaluating testing data, altering designs as necessary to ...
Senior Payroll Accountant
EPAM is looking for a Senior Payroll Accountant to join our ... analysis and reconciliation of payroll data across internal systems Investigate complex ... years of experience as a Senior Payroll Accountant, Senior Payroll Specialist or Auditor Proficiency ...
Project Configuration and Change Engineer
... -time Project Configuration and Change Engineer in EKZ, Astana we’re looking ... and completeness of configuration items data all along project life cycle; ... . for sub-system target configuration data and ensures consistency. Ensure the ...
Senior Manual QA Engineer AP Essentials (to Montenegro)
... офис компании в Черногории требуется Senior Manual QA Engineer в проект AP Essentials. Обязанности: ...
Senior Accountant / Старший бухгалтер
TITLE: Senior Accountant Your Journey at Crowe ... for the challenge? As a Senior Accountant in Crowe, you have ... applications Experience in processing large data sets, automation of accounting processes ...
2D Middle/Senior Artist (Casual)
... в аналогичной должности (2D Middle Senior Artist) от 1 года; навыки не ниже уровня Middle Senior; знание пайплайнов производства арта в ...
от 1000 до 2000 USDSenior Accountant / Старший бухгалтер
TITLE: Senior Accountant Your Journey at Crowe ... for the challenge? As a Senior Accountant in Crowe, you have ... applications Experience in processing large data sets, automation of accounting processes ...
Senior Project buyer
... self-starter, autonomous and rigorous Senior Project buyer. The Senior Project buyer will work within ... targets Conduct market survey, analyze data and consolidate results Research and ...