Let’s Write and Grow Together
IBM says if any data can be characterized or classified by these 3 v’s (Volume, Variety and Velocity) then it is called as Big Data.
Volume : Scale of Data.
Variety : Different forms of data.
Velocity : Speed at which new data is generated.
IBM says if any data can be characterized or classified by these 3 v’s (Volume, Variety and Velocity) then it is called as Big Data.
Volume : Scale of Data.
Variety : Different forms of data.
Velocity : Speed at which new data is generated.
Why Big Data?
Example: Suppose we need to store 150 TBs of data, can our traditional system/ laptop which have 1 TB capacity store these huge amounts of data? No Right.
FORMAL DEFINATION GIVEN BY IBM IS:
Any data which is characterized by 3v’s is termed as “BIGDATA”.
These are:
1) Volume
2) Variety
3) Velocity
End to End Data Engineering Roadmap:
Prerequisites:
—————-
1. Basic Linux commands.
2. Programming fundamentals.
3. SQL is very important.
In this post we will see the preparation strategy for Databricks Certified Associate Developer for Apache Spark Exam.
This certification exam assesses the understanding of the Spark DataFrame/SQL API and the ability to apply the Spark DataFrame/SQL API to complete basic data manipulation tasks within a Spark session.
This certification exam assesses the understanding of the Spark DataFrame/SQL API and the ability to apply the Spark DataFrame/SQL API to complete basic data manipulation tasks within a Spark session.
In this post, we will see the common Data Engineer Theoretical Interview Questions asked in Companies. Let’ s see the questions:
Connect 1:1 With Me: Schedule Call
If you have any doubts or would like to discuss anything related to this blog, feel free to reach out to me. I'm here to help! You can schedule a call by clicking on the above given link.
I'm looking forward to hearing from you and assisting you with any inquiries you may have. Your understanding and engagement are important to me!
This will close in 20 seconds