
Impetus Technologies Data Engineer Interview Questions
& Process
Real candidates share what happened, how many rounds they had,
and how the experience turned out.
Based on 42 interview experiences · FREE TO READ
Candidate interview experiences
First-hand accounts from people who interviewed at Impetus Technologies.
Data Engineer
It was smooth, I got a call for the first round. It started with an intro and discussion about projects I've worked on. Since it was technical, it focused a lot on pyspark and sql, covering data engineering principles and processes.
- Can you give a deep dive into Databricks and Spark architecture?
- How do you optimize SQL queries?
- Write PySpark code to find the 3rd highest salary.
Data Engineer
The first round was a deep dive into Spark. We covered advanced Spark internals, memory management for drivers and executors, and Spark's task scheduling and execution. We also reviewed DAGs in depth, looking at execution plans, physical and logical plans, the Catalyst Optimizer, and AQE with examples. Additionally, we discussed Structured Streaming, dynamic resource allocation in Spark, handling skewed data, job failures and retry mechanisms, different types of schedulers, default join types and their differences, and changes to broadcast join defaults.
No confirmed questions were included in this interview report.
Big Data Engineer
The interview process isn't set in stone and recruiters seem unsure when asked. It involves 2 video interviews that are mostly behavioral, then an HR meet. After that, there are 3 more video interviews covering technical, managerial, and technical aspects, followed by an HR interview. The recruiter schedules each call and you get feedback after about two months. Be aware that the company has many divisions, so the job description might change without notice. The technical folks and managers often don't know the specific projects or technologies used; they might list every Big Data tool, then later say you'll be a Java developer before an offer. There's a lack of coordination among hiring staff.
- Questions about your resume.
- Questions on Hive.
- Can you explain how MapReduce works?
Impetus Technologies Data Engineer Interview Questions
Quoted word for word from Impetus Technologies interview reports.
“Find all prime numbers between 1 and 50 using Python or Java.”
Read reports →“What is the directory structure for a partitioned table in Hive?”
Read reports →“If a new directory with a correct schema is added to HDFS, will the data be visible in HQL?”
Read reports →“Write a SQL query to create a new table that separates positive integers into a 'positive_numbers' column and negative integers into a 'negative_numbers' column from an existing table containing both.”
Read reports →“What are User Defined Functions (UDFs) in the context of Hive and Pig?”
Read report →“Suppose you have 100 partitions in Spark and mistakenly use Coalesce(200) to increase partitions to 200, what would be the outcome?”
Read report →“How would you write a Hive query to create a table and partition it?”
Read report →“For an unsorted array, how can you find the second largest number, both by sorting and without sorting?”
Read report →“How have below 2 tables, we need to find out users who visited a bank but didn't make any transactions? -- Visits table: -- +---------+------------+ -- | user_id | visit_date | -- +---------+------------+ -- | 1 | 2020-01-01 | -- | 2 | 2020-01-02 | -- | 12 | 2020-01-01 | -- | 19 | 2020-01-03 | -- | 1 | 2020-01-02 | -- | 2 | 2020-01-03 | -- | 1 | 2020-01-04 | -- | 7 | 2020-01-11 | -- | 9 | 2020-01-25 | -- | 8 | 2020-01-28 | -- +---------+------------+ -- Transactions table: -- +---------+------------------+--------+ -- | user_id | transaction_date | amount | -- +---------+------------------+--------+ -- | 1 | 2020-01-02 | 120 | -- | 2 | 2020-01-03 | 22 | -- | 7 | 2020-01-11 | 232 | -- | 1 | 2020-01-04 | 7 | -- | 9 | 2020-01-25 | 33 | -- | 9 | 2020-01-25 | 66 | -- | 8 | 2020-01-28 | 1 | -- | 9 | 2020-01-25 | 99 | -- +”
Read report →Formats, difficulty and experience
Across all 42 Impetus Technologies interview reports.