Describe a project that you have done. Discuss the overall flow of how it works. Problem: Given a time series data which is a clickstream of user activity is stored in hive, ask is to enrich the data with session id using spark. Session Definition: Session expires after inactivity of 1 hour Data: click_time,user_id 2018-01-01 11:00:00,u1, u1s1 2018-01-01 12:10:00,u1, u1s2 2018-01-01 13:00:00,u1, u1s2 2018-01-01 13:50:00,u1 2018-01-01 14:40:00,u1 2018-01-01 15:30:00,u1 2018-01-01 16:20:00,u1 2018-01-01 16:50:00,u1 2018-01-01 11:00:00,u2 2018-01-02 11:05:00,u2
Senior Data Engineer Interview Questions
2,400 senior data engineer interview questions shared by candidates
Un dataset m'a été envoyé, je dois effectuer les opérations de nettoyage et faire une analyse descriptive des données sur pyspark.
L1: core technical discussion for 1 hour( coding, system design, scenario based) L2: Client interviews ( 2 hours, detailed discussion about system design and integration and analytics, KPI) L3: Client interviews ( 2 hours, live project implementation)
Liquid Clustering, he just asked which framework you have worked, he should be more clear when asking questions
Software Engineering and Data Engineering questions.
How would you encourage business teams to change their mindset from relying on a central data team to developing/managing data projects in a data-mesh context.
Python Coding Question: 1. Reverse a string in python. 2. Take integer input from user and check if the given number is prime or not.
A lot of behavioral and situational questions Technical questions regarding past experiences and dataset handling
tell me something about yourself
Experience, SQL queries based on big data.
Viewing 1561 - 1570 interview questions