Azure Data Engineer
... Blob Storage. Knowledge of Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics (formerly SQL Data Warehouse), and other Azure data tools. Data Modeling and Database Design: Experience ...
AUTODOC is the largest and fastest growing auto parts ecommerce platform in Europe. Present across 27 countries with around 5,000 employees, AUTODOC generated revenue of over €1.3 billion in 2023, supplying more than 7.4 million active customers with its 5.8 million vehicle parts and accessories for car, truck, and motorcycle brands. Curious minds, adventurous experts and tech-savvy professionals - one team, one billion euros revenue. Catch the ride!
Data Engineer plays a critical role in data processing, responsible for designing and developing DBMS to transform and connect various data sources into analytical datasets. He is responsible for improving the efficiency and reliability of the ETL process infrastructure, including fault tolerance. He is also responsible for data quality assurance and project management.
Responsibilities:
- Development and optimization of architecture of database processing systems
- Development and support of infrastructure in the Google Cloud Platform environment
- Improving the quality and reliability of data that drives end-to-end cleansing processes
- Create efficient CI/CD and other automated solutions
- Maintenance and enhancement of existing infrastructure
- Infrastructure security and monitoring
Qualifications:
- In-depth knowledge of Data Engineering methodologies
- Ability to work with large datasets, ETL tools and databases
- Experience with cloud tools for data warehousing and processing such as AWS, GCP or Azure
- Ability to design, build and maintain robust and scalable data pipelines
- Interacting with other departments and participating in strategic decision making at the company level in the field of data engineering
- Ability to find innovative ways to solve problems
- Developing solutions for system monitoring
Experience:
- Experience in developing fault tolerance mechanisms - approaches to clustering, replication, scaling, etc.
- Strong understanding and use of programming languages such as Python, SQL, and professional knowledge of Big Data technologies such as Hadoop, Spark.
- Experience with GCP cloud infrastructure
- Experience in Data Science for 3 years or more.
- Understanding of services: GCP, JupyterHub, AirFlow, ClickHouse, Spark, MLFlow
- Finding your way out of the Vim text editor
What do we offer?
- Competitive salaries based on your professional experience
- Fast growing international company with stable employment
- Annual vacation of 24 days and 1 additional day off on your birthday
- Monthly Allowance for cover the costs of medical insurance expenses
- Mental Wellbeing Program – the opportunity for free psychological counseling for you and your family members 24/7 hotline and online sessions
- Opportunities for advancement, further trainings (over 650 courses on soft and hard skills on our e-learning platform) and coaching
- Free English and German language classes
- Flexible working hours and hybrid work
!!! please apply here if you live in Kazakhstan
... Blob Storage. Knowledge of Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics (formerly SQL Data Warehouse), and other Azure data tools. Data Modeling and Database Design: Experience ...
... of work experience in big data or large-scale data projects. Expertise in best practices data design, data structuring, data governance, metadata management, etc. Hands- ...
... Apache Pig Azure Stream Analytics Data visualization: Power BI Tableau QlikView Data management: Azure Data Lake Storage Gen2 Azure Data Factory (ADF) Azure Synapse Analytics (formerly Azure SQL Data Warehouse) Cloud computing: Azure Virtual ...
... in a dedicated Data & Analytics department. At the moment, ... identifying key data problems challenges development Data strategy, based on Data Governance Framework implementing Data Governance Data Management supporting of the data projects acting as a PMO ...
... API, GraphQL, DBT, etc. ) and data pipeline orchestration (e.g., Airflow, ... and transforming large volumes of data, data quality and data validation Experience in SQL (SQL ...
... -intermediate), Shell, OOP, Algorithms and Data Structures, Web Development, etc.Data Engineering: Python (upper-intermediate), SQL ( ... advanced), ELT ETL, Query Optimization, Data Architecture, Data Analysis, etc. Кандидат должен обладать ...
от 4000 USD... and competitive market data by working directly with external data miners to obtain data needed to build research. Participate ... Experience as analyst data science preferably in b2b b2c ... market pricing and competitive data develop an understanding of where ...
Вакансия: Data Engineer Мы ищем опытного Data Engineer для присоединения к нашей команде VILED Если вы готовы взять на себя ответственность за поддержание и развитие нашего Data Warehouse (DWH), то эта вакансия ...
... the stakeholders to understand the data-analysis steps, enabling them to ... - this includes local movements in Data Warehousing, Visualization, and Infrastructure platforms ...
... витрин данных в интересах аналитиков data science Определение и стандартизация стека ...
... for a skilled Senior Data Scientist Machine Learning Engineer to join our team, with a focus on finance-related machine learning processes.Our candidate should have experience in data science, machine learning, MLOps and data engineering, enabling them to ...
... for a skilled Senior Data Scientist Machine Learning Engineer to join our team, with a focus on finance-related machine learning processes.Our candidate should have experience in data science, machine learning, MLOps and data engineering, enabling them to ...
... , correlations, and patterns in marketing data. Collaborate with the marketing team ... -functional teams to understand their data needs and provide appropriate solutions. ...
... to present company data. Data analysis: Researching and analyzing data using Power BI to identify trends, patterns, and insights. Data modeling: Building data models in Power BI to ... that arise during data analysis. Creating user documentation: Developing ...
Компания KMF – лидер на рынке микрофинансирования с большими планами на будущее. Мы открыли более 116 офисов, получили множество наград и активно принимаем участие в важных для экономики Казахстана событиях. Поддерживаем «зеленые технологии», спорт, ...
Sergek Group – казахстанская группа IT-компаний. Наши сотрудники – это разработчики программного обеспечения, компьютерного зрения и искусственного интеллекта, опытные проектные и продуктовые менеджеры, системные аналитики, бизнес аналитики, дата аналитики ...
от 500000 до 800000 KZTMycar Group входит в группу компании Astana Group (Astana Motors, Mega Center, Mycar): В офлайне— автоцентры Mycar по Казахстану, микрокредитная организация Mycar Finance. В онлайне —ИТ продукты mycar.kz, Mycar PRO, MyCredit. Чем предстоит заниматься: ...
... . 2. Unloading and transforming data for analytics into additional data slices and presenting it to ... reports or another BI tools MIDDLE knowledge of statistics Ability to work with large amounts of data. Qualifications (Desired) Experience with DataBase ...
Требования: Опыт работы в области разработки хранилищ больших данных не менее 2 лет; Знание концепций данных и аналитики (например, моделирование, ETL, инструменты отчетности, управление данными, хранение данных, структурированные и ...