How can you process big CSV files that cannot be contained in the memory?
Senior Data Engineer Interview Questions
2,400 senior data engineer interview questions shared by candidates
1. Previous experiences based on what's written on the CV and current work 2. Tools & skill 3. What will I do in my probation period
Got a simple data file and had to write a Jupyter notebook and answer very basic questions regarding the data, like what was the monthly min/max etc. Very unprofessional home assignment and also redicilous that it's so specific (Jupyter notebook and python).
No questions ! just said we are looking for 6+ years of experience
Simple question from string search.
Previous projects related questions. Some cross question.
SQL: window queries Python: priority queues and min-heaps SD: wallet payments
Lots of intro how to build data pipelines. Not very sophisticated stuff.
Draw DAG graph for particular spark program execution.
Asked questions on Software Development process. Asked questions on Software testing, especially unit testing. What are the challenges you experienced in data transformation with parquet datatype
Viewing 801 - 810 interview questions