Data Engineer

Specialization Skills

Redis (KeyDB)

Data ManagementAdopt

R

Languages & FrameworksHold

MongoDB

Data ManagementAdopt

Scala

Languages & FrameworksAssess

Kafka

Data ManagementAdopt

ClickHouse

Data ManagementAdopt

PostgreSQL

Data ManagementAdopt

Apache Cassandra

Data ManagementTrial

Elasticsearch

Data ManagementTrial

SQL

Languages & FrameworksAdopt

DynamoDB

Data ManagementTrial

Neo4j

Data ManagementAssess

InfluxDB

Data ManagementAssess

TimescaleDB

Data ManagementAssess

Apache Spark

Data ManagementTrial

Apache Airflow

Data ManagementTrial

dbt

Data ManagementTrial

Data Analytics

Data-driven decision making, BI tools, metrics analysis

Data ManagementAdopt

Experts

Specialists who verify skills within this specialization

Olga Kovaleva

Lead Data Scientist @ Yandex Ads

Questions and answers

What does a Data Engineer do?

A data engineer designs and maintains data infrastructure: ETL/ELT pipelines, warehouses and lakehouse platforms, stream processing (Kafka, Spark, Flink) and orchestration (Airflow, dbt). The specialist is responsible for the quality, integrity and availability of data for analytics and ML teams, and optimizes storage cost and performance. They are fluent in SQL and Python and understand data modeling and data protection requirements.

What skills are included in the Data Engineer specialization?

The specialization includes 18 skills — the full list with proficiency levels is on this page. The skill set is aligned with the association tech radar.

How to verify a Data Engineer qualification with the association?

Apply for membership at the SmartSNG.Dev association and pass the skill check: specialization experts assess your proficiency in each skill and verify the qualification on your public profile.

How much do membership and certification cost?

Association membership is free — no fees or subscriptions. Skill checks are conducted by association experts.

How to verify your qualification

1. 1. Apply for membership

   Joining the association is free: fill in the application form, the admissions committee reviews it within a week.

2. 2. Pass the skill check

   Association experts in this specialization assess your skills and proficiency level in each of them.

3. 3. Get verified

   Verified skills and levels are displayed on your public member profile.