In this post, we will see the questions asked in the 2nd round of Impetus Technologies  company Interview for 1.5+ year of experience guy in big data field.

Let’s see the questions:

1. Tell me about Yourself ?
2. Write a code for reading a CSV file from one HDFS location and write into another HDFS location using spark.
3. Write a code for reading a CSV file from one HDFS location and then convert it into parquet format and then save it on another location using spark.
4. Let’s suppose on every one hour we are receiving data/new files at the source location, we need to read that data and write to destination location. How can you approach this by using spark.
5. Let’s suppose when you are writing the first file to another location at the same time you are getting new file in source location, how can you handle this?
6. How to set dependency between the tasks in Airflow?
7. Interviewer shows the datasets and show the code snippets, now I have to tell the code is correct or not, if code is correct but giving error while running then need to debug , fix it and tell the approach to handle it. If code is incorrect then make it correct.
   • Check the code for creating the Spark session?
   • Check the code for Adding new column in the existing dataframe?
   • You are summing price column in the code but it gave error because its data type is String. How you correct it?
   • Let’s suppose your datasets contains bad records then how you handle this?
   • Check the code for finding the sum of price- city wise?
   • Check the code for showing the top 3 prices of hotels for the specific location?
8. Tell me on which different file formats you worked till now?
9. Tell me the scenario in which case we need to use which file formats?
10. Tell me the difference among all file formats (json, parquet, orc, delta)?

 

This interview was held around for 1 hour through Microsoft Teams video call and taken by Technical Architect.

Check out the given link for knowing about this company: Home (impetus.com)

Check out the given link for knowing about this company rating on glassdoor: Impetus Technologies Reviews | Glassdoor

Check out the given link for this company profile on Linkedin: Impetus: Overview | LinkedIn

Thank you for reading this post.