З/п не указана
Разрабатывает стратегические решения для многослойных потоков данных, требуется глубокое знание Python и SQL.
Старший инженер по данным
в Bir
О роли
Ümumi məlumat
We are looking for a hands-on Leading / Senior Data Engineer to own critical ingestion and lakehouse workflows in a high-throughput, production-grade data platform.
Öhdəliklər
We are looking for a hands-on Leading / Senior Data Engineer to own critical ingestion and lakehouse workflows in a high-throughput, production-grade data platform.
Öhdəliklər
- Designing a data lake to process and store an array of (un)structured data loaded from raw sources. Development of the data model - properly store the data and access it as needed for business purposes
- Development of the integration process - development of integration with various systems so that they can have a single view of key indicators when making decisions
- Data preparation and ETL - development of a pipeline for extracting, transforming and loading data Developing and monitoring data pipelines to ensure data quality and integrity
- Automation and optimization of the data transformation process
- Working closely with other teams in the organization to ensure data is available and accessible for analytics and decision-making
- Degree in computer science, information science, engineering, mathematics, or related technical discipline
- 5+ years experience with SQL and NoSQL technologies
- Strong experience working with Oracle and PostgreSQL databases
- Extensive experience in ETL development, with strong skills in Python programming
- Advanced knowledge of PySpark for large-scale distributed data processing
- Proficient in Airflow for scheduling, orchestrating and monitoring complex ETL/ELT workflows
- Expertise in Kafka for event streaming and messaging pipelines
- Experience working with MinIO (S3-compatible storage), managing data in Parquet and Iceberg formats
- Familiarity with Lakehouse concepts
- Deep understanding of MPP architecture concepts
- Familiarity with Impala for interactive SQL querying on Big Data
- Experience with Greenplum
- Familiarity with containerization (Docker, Kubernetes)
- Experience with CDC tools like Debezium and Oracle GoldenGate for real-time data replication
- Experience with data visualization tools (e.g. Tableau, PowerBI, etc.)
- Understanding of DataOps and DevOps principles
- Knowledge of data modeling and database design
- Experience with data engineering best practices, such as data security, data access control and data governance
- Knowledge of Grafana for monitoring metrics
- Proficient with GitLab for version control
- Experience mentoring junior data engineers and collaborating with cross-functional teams (Data Scientists, Analysts, DevOps)
Ümumi məlumat
We are looking for a hands-on Leading / Senior Data Engineer to own critical ingestion and lakehouse workflows in a high-throughput, production-grade data platform.
Öhdəliklər
We are looking for a hands-on Leading / Senior Data Engineer to own critical ingestion and lakehouse workflows in a high-throughput, production-grade data platform.
Öhdəliklər
- Designing a data lake to process and store an array of (un)structured data loaded from raw sources. Development of the data model - properly store the data and access it as needed for business purposes
- Development of the integration process - development of integration with various systems so that they can have a single view of key indicators when making decisions
- Data preparation and ETL - development of a pipeline for extracting, transforming and loading data Developing and monitoring data pipelines to ensure data quality and integrity
- Automation and optimization of the data transformation process
- Working closely with other teams in the organization to ensure data is available and accessible for analytics and decision-making
- Degree in computer science, information science, engineering, mathematics, or related technical discipline
- 5+ years experience with SQL and NoSQL technologies
- Strong experience working with Oracle and PostgreSQL databases
- Extensive experience in ETL development, with strong skills in Python programming
- Advanced knowledge of PySpark for large-scale distributed data processing
- Proficient in Airflow for scheduling, orchestrating and monitoring complex ETL/ELT workflows
- Expertise in Kafka for event streaming and messaging pipelines
- Experience working with MinIO (S3-compatible storage), managing data in Parquet and Iceberg formats
- Familiarity with Lakehouse concepts
- Deep understanding of MPP architecture concepts
- Familiarity with Impala for interactive SQL querying on Big Data
- Experience with Greenplum
- Familiarity with containerization (Docker, Kubernetes)
- Experience with CDC tools like Debezium and Oracle GoldenGate for real-time data replication
- Experience with data visualization tools (e.g. Tableau, PowerBI, etc.)
- Understanding of DataOps and DevOps principles
- Knowledge of data modeling and database design
- Experience with data engineering best practices, such as data security, data access control and data governance
- Knowledge of Grafana for monitoring metrics
- Proficient with GitLab for version control
- Experience mentoring junior data engineers and collaborating with cross-functional teams (Data Scientists, Analysts, DevOps)
Локация
Bakı
Опыт
5+ лет
Занятость
Полная занятость
Зарплата
Не указана
Опубликовано
16 июля 2026
О компании
Bir
Technology · 5,001-10,000 · Baku
Навыки и технологии
Ваш отклик
Этот работодатель принимает отклики у себя на сайте. Перейдите на страницу вакансии и заполните форму там.
Перейти на страницу работодателяПохожие по навыкам
Все похожие вакансииВакансии, где совпадает больше всего навыков из этой позиции.
З/п не указанаОсталось 7 дн.
Требуется инженер данных с знанием Python и SQL в департамент ИИ.
ОткликнутьсяПростой откликПростой отклик
З/п не указанаПоследний день
Требуется 3 года опыта в Java для разработки бэкенд-сервисов и API.
З/п не указана
Разрабатывает бэкенд-сервисы и API, требуется минимум 3 года опыта в Java.
