What tools should a data engineer know?
Asked "What tools should a data engineer know?", ChatGPT, Copilot, Gemini, Google AI Mode and Perplexity named 63 distinct tools across 15 answers on September 7, 2026, and 47 of them in two or more answers, and all 5 engines agreed on Snowflake, the only tool every engine named.
47 of 63 names confirmed · named in 2 or more of 15 answers · asked September 7, 2026 · 5 engines
A data engineer should know a core set of tools across categories such as languages, data storage, orchestration, and cloud/platforms, including Python, SQL, Apache Spark, Apache Airflow, and cloud services like AWS, Azure, or GCP. The essential toolkit includes foundational languages like SQL and Python, data warehouses like Snowflake or BigQuery, transformation tools like dbt, and orchestration tools like Apache Airflow. Additionally, knowledge of big-data processing, containers, streaming, data formats, and data quality tools is important.
- 1Snowflakenamed in 15 of 15 answers
- 2dbtnamed in 14 of 15 answers
- 3Apache Airflownamed in 14 of 15 answers
- 4Dockernamed in 14 of 15 answers
- 5Apache Kafkanamed in 13 of 15 answers
- 6Apache Sparknamed in 12 of 15 answers
- 7Prefectnamed in 12 of 15 answers
- 8Terraformnamed in 12 of 15 answers
- 9Dagsternamed in 10 of 15 answers
- 10Kubernetesnamed in 10 of 15 answers
- 11Databricksnamed in 9 of 15 answers
- 12Fivetrannamed in 9 of 15 answers
- 13Airbytenamed in 9 of 15 answers
- 14Pythonnamed in 8 of 15 answers
- 15Google BigQuerynamed in 8 of 15 answers
- 16BigQuerynamed in 7 of 15 answers
- 17Amazon Redshiftnamed in 7 of 15 answers
- 18Delta Lakenamed in 7 of 15 answers
- 19SQLnamed in 6 of 15 answers
- 20PostgreSQLnamed in 6 of 15 answers
- 21Apache Icebergnamed in 6 of 15 answers
- 22MySQLnamed in 5 of 15 answers
- 23Redshiftnamed in 5 of 15 answers
- 24Great Expectationsnamed in 5 of 15 answers
- 25Tableaunamed in 5 of 15 answers
The full measurement
- The position each of the 5 engines gave all 63 names.
- How many of the 15 answers named each of them.
- 257 sampled observations behind this ranking, and where the engines disagree.
- Fan-out — the query each engine actually searched.
- Every citation, and the sources nobody cited.