Key Data Engineer (Python / Scala / Azure)

Қала : , null,
Компания : Epam
Жалақы :
Табылды : a month ago

Сипаттама

DescriptionWe are looking for a Key Data Engineer to join the project in the financial services industry. This role combines technical and people management skills for the data platform that require knowledge of financial data, big data processing and management, as well as cloud-based data warehouse solutions. What Youll Do Build and maintain secure and compliant production data processing pipelines by using different tools and techniques (cloud services, Python/Scala) Ensure that data pipelines and stores are high-performing, efficient, organized, and reliable, given business requirements and constraints Design, implement, monitor and optimize data platforms to meet the data pipeline needs Responsible for data-related implementation tasks: provisioning data storage services, ingesting streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks and accessing external data sources Design and operationalize large-scale enterprise data solutions and applications using one or more Azure data and analytics services Implement data solutions that use the following Azure services: Azure Cosmos DB, Azure Synapse Analytics, Azure Data Factory, Azure Stream Analytics, Azure Databricks, Azure Blob storage, Microsoft Purview, etc Integrate, transform and consolidate data from various structured and unstructured data systems into a structure suitable for building analytics solutions Design and implement data engineering, ingestion and curation functions on Azure cloud using Azure native or custom programming Create data transformation and loading workflows What You Have Experience in Data Platforms and Azures PaaS offerings (Synapse, Purview, ADF, Databricks, Azure Data Lake Storage) Competency in Azure: Synapse Analytics, Data Factory, Data Lake, Databricks, Microsoft Purview, Monitor, SQL Database, SQL Managed Instance, Stream Analytics, Cosmos DB, Storage Services, ADLS, Azure Functions, Log Analytics, Serverless Architecture, ARM Templates Proficiency in data processing languages such as SQL, Java, Python or Scala Strong notions of security best practices (e.g., using Azure Key Vault, IAM, RBAC, Monitor, etc.) Understanding the data through exploration and experience with data retention, validation, visualization, preparation, matching, fragmentation, segmentation and enhancement processes Familiarity with Azure Networking concepts Certifications Preferred: DP-: Data Engineering on Microsoft Azure and DP-: Microsoft Azure Data Fundamentals We Offer We connect like-minded people: Delivering innovative solutions to industry leaders, making a global impact Enjoyable working environment, whether it is the vibrant office or the comfort of your home Opportunity to work abroad for up to two months per year Relocation opportunities within our offices in 50+ countries Corporate and social events We invest in your growth: Leadership development, career advising, soft skills and well-being programs Certifications, including GCP, Azure and AWS Unlimited access to LinkedIn Learning, Get Abstract, O'Reilly, Cloud Guru Free English classes with certified teachers Discounts in local language schools, including online courses for the Kazakh language We cover it all: Participation in the Employee Stock Purchase Plan Monetary bonuses for engaging in the referral program Comprehensive medical care package Six trust days per year (sick leave without a medical certificate) Coverage of psychology sessions of your choice Discounts for fitness clubs and sports programs Benefits package (hotels, tech stores, food delivery) About EPAM EPAM Kazakhstan is a team of technologists and innovators united by a passion for technology. Today, we operate across all cities with offices in Astana, Almaty, and Karaganda and work with the world's leading companies from different industries. In , EPAM Kazakhstan received the Export Excellence Award at the esteemed Digital Bridge Awards, showcasing our commitment to excellence and innovation

Ұқсас бос орындар

    Azure Data Engineer

    • АтырауТехИнвест
    • Казахстан, Астана
    • 14 days ago

    ... with regulatory standards in Azure data solutions. Data Quality Management: Develop and implement data quality checks and validation processes to maintain high-quality data. Scripting and Automation: Use scripting (Python, PowerShell) for automation of ...

    astana.hh.kz

    Azure Data Engineer

    • АтырауТехИнвест
    • Казахстан, Алматы
    • 14 days ago

    ... with regulatory standards in Azure data solutions. Data Quality Management: Develop and implement data quality checks and validation processes to maintain high-quality data. Scripting and Automation: Use scripting (Python, PowerShell) for automation of ...

    almaty.hh.kz

    Senior Azure Data Engineer

    • АтырауТехИнвест
    • Казахстан, Алматы
    • 21 days ago

    Scope: Azure services: Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics (formerly Azure SQL Data Warehouse) Azure Blob Storage Azure Data Lake Storage Azure Cosmos DB Azure Event Grid Data processing and analytics: Apache Spark ...

    almaty.hh.kz

    Senior Azure Data Engineer

    • АтырауТехИнвест
    • Казахстан, Астана
    • 21 days ago

    Scope: Azure services: Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics (formerly Azure SQL Data Warehouse) Azure Blob Storage Azure Data Lake Storage Azure Cosmos DB Azure Event Grid Data processing and analytics: Apache Spark ...

    astana.hh.kz

    Senior Azure Data Engineer

    • АтырауТехИнвест
    • Казахстан, Атырау
    • 21 days ago

    Scope: Azure services: Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics (formerly Azure SQL Data Warehouse) Azure Blob Storage Azure Data Lake Storage Azure Cosmos DB Azure Event Grid Data processing and analytics: Apache Spark ...

    atyrau.hh.kz

    Senior Azure Data Engineer

    • АтырауТехИнвест
    • Казахстан, Караганда
    • 21 days ago

    Scope: Azure services: Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics (formerly Azure SQL Data Warehouse) Azure Blob Storage Azure Data Lake Storage Azure Cosmos DB Azure Event Grid Data processing and analytics: Apache Spark ...

    karaganda.hh.kz

    Database engineer

    • KT&G GLOBAL KAZAKHSTAN (КЕЙ-ТИ-ЭНД-ДЖИ ГЛОБАЛ КАЗАХСТАН)
    • Казахстан, Алматы
    • 6 days ago

    ... programming language commonly used in data engineering, such as Python, Scala, or Java. Scripting skills for automating tasks and data processing. In-depth knowledge of Microsoft Azure cloud platform services and features. ...

    almaty.hh.kz

    Database engineer

    • KT&G GLOBAL KAZAKHSTAN (КЕЙ-ТИ-ЭНД-ДЖИ ГЛОБАЛ КАЗАХСТАН)
    • Казахстан, Алматы, проспект Аль-Фараби, 17к4Б
    • 7 days ago

    ... programming language commonly used in data engineering, such as Python, Scala, or Java. Scripting skills for automating tasks and data processing. In-depth knowledge of Microsoft Azure cloud platform services and features. ...

    almaty.hh.kz

    Data Engineer

    • Noventiq
    • , Kazakhstan,
    • 8 days ago

    ... experience In Data Engineer roles.Must have SQL knowledge and experience working with relational databases.Must have experience with Azure Fabric (Data Factory, Synapse Data Engineering, Synapse Data Warehouse) and other Azure Data Platform technologies ...

    kz.talent.com

    Data Manager to Data Analytics team

    • PricewaterhouseCoopers
    • Казахстан, Алматы
    • 4 days ago

    ... of the companies and identifying key data problems challenges development Data strategy, based on Data Governance Framework implementing Data Governance Data Management supporting of the data projects acting as a PMO ...

    almaty.hh.kz

    Research Fellow in Data Analytic (Bishkek, Kyrgyz Republic)

    • University of Central Asia
    • Казахстан, Алматы
    • a day ago

    ... and modelling, with proficiency in key libraries like tidyverse, ggplot2 (for R), Pandas, Numpy, Matplotlib (for Python). Utilize SQL to extract and manipulate data with programming abilities from databases ...

    almaty.hh.kz

    Research Fellow in Data Analytic (Bishkek, Kyrgyz Republic)

    • University of Central Asia
    • Казахстан, Астана
    • a day ago

    ... and modelling, with proficiency in key libraries like tidyverse, ggplot2 (for R), Pandas, Numpy, Matplotlib (for Python). Utilize SQL to extract and manipulate data with programming abilities from databases ...

    astana.hh.kz

    Data Analyst in Upstream / Subsurface / Geology

    • ФИЛИАЛ WOOD MAСKENZIE LIMITED /ВУД МАККЕНЗИ ЛИМИТЕД
    • Казахстан, Астана, проспект Кабанбай Батыра, 15/1
    • 12 days ago

    ... delivery Develop relationships with key stakeholders across the wider Data team, including Data Engineers, Product, Research, and Sales ... popular programming language (ideally Python) Experience working with data visualization tools (Spotfire, Power BI) ...

    astana.hh.kz

    Data engineer

    • Autodoc Group (Автодок Казахстан)
    • Казахстан, Алматы
    • 22 hours ago

    ... euros revenue. Catch the ride Data Engineer plays a critical role in data processing, responsible for designing and ... of programming languages such as Python, SQL, and professional knowledge of Big Data technologies such as Hadoop, Spark. - ...

    almaty.hh.kz

    Python Data Engineer

    • Перфект Системс
    • Казахстан, Алматы
    • a day ago

    ... -intermediate), Shell, OOP, Algorithms and Data Structures, Web Development, etc.Data Engineering: Python (upper-intermediate), SQL (advanced), ELT ETL, Query Optimization, Data Architecture, Data Analysis, etc. Кандидат должен обладать ...

    almaty.hh.kz
    от 4000 USD

    Data Engineer

    • Itransition
    • Казахстан, Алматы
    • 22 days ago

    Requirements: 1+ years with Python including strong knowledge of data libraries (pandas, multiprocess, Google Cloud SDK) 1+ years of experience in ETL ELT technologies (REST API, GraphQL, DBT, etc. ) and data pipeline orchestration (e.g., Airflow, ...

    almaty.hh.kz

    Junior Data Analyst

    • Xometry Europe GmbH
    • Казахстан, Алматы
    • 8 days ago

    ... external data miners to obtain data needed to build research. Participate in the development of methodology for defining key metrics, related ... data manipulation and advanced data analysis Experience with SAS, R, Python, and proficiency working with large ...

    almaty.hh.kz

    DX/Shopper Insights Manager

    • PepsiCo Kazakhstan
    • Казахстан, Алматы, проспект Абая, 109В
    • 22 days ago

    ... address; Flawless day-to-day data management for key data sources including Nielsen, In-store ... purchase patterns & profiles in the key customers through transaction data analysis (EYC, etc), continuous Shopper data sources (HHP, etc) and specific ...

    almaty.hh.kz

    DX/Shopper Insights Manager , Алматы

    • PepsiCo
    • , Almaty,
    • a month ago

    ... address;· Flawless day-to-day data management for key data sources including Nielsen, , In-store ... purchase patterns & profiles in the key customers through transaction data analysis (EYC, etc), continuous Shopper data sources (HHP, etc) and specific ...

    kz.talent.com

    Audit Data Advisor

    • International company
    • , Atyrau,
    • a month ago

    ... management system; •Develop and maintain Key Performance Indicators for the action tracking processes; •Monitor and fulfill data requests by Internal Audit Department ...

    kz.talent.com
Top