Bigdata_and_GCP's profile picture. Big Data and Cloud | Python and PySpark | Google certified Professional data  engineer ☁️ | Data to information 0️⃣1️⃣ | Sharing Technology - Code, Videos, Pods

Rahul

@Bigdata_and_GCP

Big Data and Cloud | Python and PySpark | Google certified Professional data engineer ☁️ | Data to information 0️⃣1️⃣ | Sharing Technology - Code, Videos, Pods

Ghim

Hey Guys, I am Rahul. Working on data migration. As part of initial steps data migrated from different legacy technologies such as #Mainframe #Teradata #SQL developer to #BigData 🚔 🏎 Time to move from #Bigdata to #Google #Cloud 🚀 👨‍🚀

Lovely day to start : From today I am starting blogs and details for all technologies needed for Hadoop to Google Cloud data migration. Cover following technologies : 1) Pyspark (Python doubts would be part) 2) Data migration methods 3) Google cloud (Dataproc and BigQuery)



Rahul đã đăng lại

All #Bengaluru people. Beware of frauds by @shadowfax_in They behave in crony way with #customer Both delivery boys and Support team would not help you and your delivery is not in safe hands. Below pic sent by #delivery boy and #Support marked closed Bad #CustomerExperience

NanavatyRahul's tweet image. All #Bengaluru people.  Beware of frauds by @shadowfax_in 

They behave in crony way with #customer
Both delivery boys and Support team would not help you and your delivery is not in safe hands. Below pic sent by #delivery boy and #Support marked closed

Bad #CustomerExperience

Rahul đã đăng lại

Do for this #fraud by #Goibibo @makemytripcare would resolve or @GoibiboSupport I am loosing on 60,000,/- and interest per day 🤦‍♂️🤦‍♂️🤦‍♂️ @Ministry_CA #CivilAviation

@GoibiboSupport @makemytrip @makemytripcare #Goibibo and it's parent company #makemytrip $mmt is running fraud. I have booked international flight of #Emirates from Mumbai-Houston with return journey 1) They don't have option to cancel online 2) On call they provide one

NanavatyRahul's tweet image. @GoibiboSupport @makemytrip @makemytripcare 

#Goibibo and it's parent company #makemytrip $mmt is running fraud. I have booked international flight of #Emirates from Mumbai-Houston with return journey 
1) They don't have option to cancel online
2) On call they provide one
NanavatyRahul's tweet image. @GoibiboSupport @makemytrip @makemytripcare 

#Goibibo and it's parent company #makemytrip $mmt is running fraud. I have booked international flight of #Emirates from Mumbai-Houston with return journey 
1) They don't have option to cancel online
2) On call they provide one


Rahul đã đăng lại

Comparison between different cloud services. World is moving towards multi-cloud with bias towards open source technologies Pic courtesy: @scgupta #aws #gcp #azure #dbt #apachebeam #iceberg #Apache #cloudengineer #CloudComputing

modern_gurukul's tweet image. Comparison between different cloud services.

World is moving towards multi-cloud with bias towards open source technologies 

Pic courtesy: @scgupta 

#aws #gcp #azure #dbt #apachebeam #iceberg #Apache #cloudengineer #CloudComputing

Hi @felipehoffa Just heard your #GoogleCloud podcast guest appearance for #BigData on @GCPPodcast Awesome information on #BigQuery. Thank you very much for wonderful stuff


Attempting another #Google certification after successful completion of #GCP certified Professional #Data Engineer- This time one of the most difficult one Please wish me luck !! 🙏 #GCP #MachineLearning #dataengineer #datascientists


Dear sir @BCNagesh_bjp Garden city has provided a lot us. #AazadiKaAmritMahotsav is perfect time to payback. I am IT professional from last 18 years. Can I get opportunity to train kids in Computers on every weekend in a government school as service ? @PMOIndia @EduMinOfIndia


Google cloud is considered as mostly tool platform. Great thing is they follow that developers thinks in terms of language On #Google cloud they have added pages dedicated to languages For #Python #developers it's as below link #100DaysOfCode #Coding cloud.google.com/python

docs.cloud.google.com

Python documentation  |  Google Cloud Documentation

Google Cloud makes development easy using Python.


Blown my mind. This make me think more in terms of #PySpark 💥

Nice pass time, deepens understanding of Python and helps to catch esoteric bugs. But most quizzes are strong antipatterns for serious work. It may make you a better mechanic but not a better driver. Important is writing simple, stupid, readable code for business problems.



Efficient #Coding in #Python

In today's #Python class, students extracted an IP address from the start of a string, s. My suggested solution: ip_address = s.split()[0] A student suggested we instead use a slice: ip_address = s[:s.index(' ')] Both did the job. But which was faster?



Day n of #100DaysOfCode Explored different ways to migrate #data from HDFS to Google cloud storage #BigData #GCP #google #GoogleCloud #Distcp #Dataproc #bigquery


Subtle point in any #programming language including #Python

You are not removing unwanted numbers from the numbers list, but are creating a new list while skipping the unwanted numbers. The difference between these can be quite significant.



Pretty interesting. Typo can lead to logical error and can eat lots of #development time #Python

A student in today's #Python class was counting vowels in string s: vowels = 0 for c in s: if c in 'aeiou': vowels =+ 1 Why the count always turn out to be 1?



Rahul đã đăng lại

#python #tip: if you need to use a slice more than once you can define and reuse it as a slice object = more DRY (don't repeat yourself):

bbelderbos's tweet image. #python #tip: if you need to use a slice more than once you can define and reuse it as a slice object = more DRY (don't repeat yourself):

Python Regular expressions (RegEx) in action: Today's code contains examples of basic RegEx #Python expressions (part-1) #100DaysOfCode #Coding #100daysofcodechallenge #regex #code #Datamigration #BigData #javascript #development #cloud #GoogleCloud #Gcp github.com/rnanavaty/Pyth…


Today's world is not less on resources. It's lack of concentration which hurts 🚀 Practice daily even with single line of code or concept #Coding #100DaysOfCode #Python

Internet is free university. Design: uxcel .com No-code: makerpad .co Language: duolingo .com Code: freecodecamp .org Academic: khanacademy .org Cooking: bingingwithbabish .com Marketing: marketingexamples .com You just need a laptop and internet connection.



Day 2 of Data migration : RDD of PySpark ✅ parallelized object ✅ Different transformations ✅ Differe actions ✅ RDD as core for Pyspark operations #100DaysOfCode #100daysofcodechallenge #PySpark #Python #Datamigration #Coding #Data #DataAnalytics github.com/rnanavaty/PySp…


Quiz : What would be output of below two "print" statements #PySpark #100DaysOfCode #100daysofcodechallenge #RDD #MapReduce

Bigdata_and_GCP's tweet image. Quiz :

What would be output of below two "print" statements

#PySpark #100DaysOfCode #100daysofcodechallenge #RDD #MapReduce

Loading...

Something went wrong.


Something went wrong.