Data Engineering lab
@data_eng_lab
Google Certified Data Engineer | Plumbing Data pipelines | Python | Cloud | BigData
내가 좋아할 만한 콘텐츠
Every PM should be using Claude Code. So I built a HUGE course for you to learn Claude Code... IN Claude Code! 🔹 Complete guide 🔹 Make PRDs, analyze data, create decks Soon, I'll sell it for $149. For the next 24h: FREE! Follow + RT + comment "CC" & I'll DM it.
Do You Need Canva Pro! lifetime Subscription 🚨 If You Need Canva Pro Free Then ; 1. Like 2. Comment "Canva" 3. Repost ( follow me to get it)
Learn for free: HTML → w3schools.com CSS → CSS-tricks.com JavaScript → LearnJavaScript.online Git and GitHub → LearnGitBranching.js.org React → React-tutorial.app API → @Rapid_API SQL → SQLbolt.com Blockchain → cryptozombies.io
If you’re struggling to prioritize your to-do list, try this:
What is partitioning in hadoop MR? No of partitions are equal to no of reducers. Mappers ll store the data in partitions and its selection logic is based on hash func. Same key ll always go to same partition. Each reducer ll process respective partition #BigData #learnHadoop
What is shuffling in hadoop? In distributed system, calculation will hpn in mapper process and aggregation will happen in reducer process. Once the calculations are done in mappers, data ll be transferred to reducers, this transfer is called shuffling. #learnHadoop #BigData
How many mappers will be created for 500mb file in hadoop distributed computing? 1 mapper for 1 block, 500mb file will split into 4 blocks in HDFS (default block size is 128mb), so 4 mapper process can be created and each process one block. #hadoop #BigData
Giveaway time! We are going to send a t-shirt and few goodies to one person who follows @PentesterLab and likes this tweet !! And we are going to give a 1-year voucher to someone who RT this tweet!
Quick way of count the number of column in the csv file line = open("test.csv").readline() print(line.split(",")) # comma seperated What is your way of doing it? #pythonprogramming #DailyOneTip #Python
Whom Should I follow to get latest data engineering, python and cloud relevant content? Any suggestions guys? @saviomartin7 @oliverjumpertz @DailyDevTips1 @VittoStack @sunilc_ @BigData_Fr @VittoStack @heyOnuoha #dataengineering #Python #GoogleCloud
You hear folks talk about BigQuery, but what actually makes it so unique and powerful? This @GoogleCloudTech post from @pvergadia is the best summary I've seen. Here's why BQ makes other data warehouses look incomplete or inefficient by comparison. cloud.google.com/blog/topics/de…
Written my first medium about transferring Large data files from S3 to GCS using airflow medium.com/swlh/transfer-…
United States 트렌드
- 1. Steelers 67.6K posts
- 2. Tucker Kraft 11.5K posts
- 3. Packers 49.6K posts
- 4. Tomlin 7,280 posts
- 5. Jordan Love 8,308 posts
- 6. #GoPackGo 8,462 posts
- 7. Austin Reaves 8,574 posts
- 8. Rodgers 32.6K posts
- 9. #HereWeGo 6,888 posts
- 10. Nixon 13.6K posts
- 11. McManus 3,546 posts
- 12. Teryl Austin 1,381 posts
- 13. Brian Kelly 54.9K posts
- 14. Green Bay 9,229 posts
- 15. #WelcomeToDerry 2,196 posts
- 16. #RHOP 8,035 posts
- 17. Boswell 3,039 posts
- 18. Zeus 17.3K posts
- 19. #BaddiesAfricaReunion 4,323 posts
- 20. Josh Jacobs 1,834 posts
내가 좋아할 만한 콘텐츠
-
Nandini Khandelwal
@nandini2403 -
Jellyfish
@_jellyfish_co -
Gabriel Martín Blázquez
@gabrielmbmb_ -
Alekz Samone
@AlekzSays -
Jake Page
@jakepage91 -
Diji
@Moderubu -
Anointed
@PPaijuk -
Rodrigo Parra
@rparrapy -
Daniel Torkura
@danieltorkura -
دلال
@nn1450n -
Richard
@Don_richard45 -
Alex D'Anna ❄️
@amdanna_01 -
Sebastian Hoitz
@sebastianhoitz
Something went wrong.
Something went wrong.