Bigdata_and_GCP's profile picture. Big Data and Cloud | Python and PySpark | Google certified Professional data  engineer ☁️ | Data to information 0️⃣1️⃣ | Sharing Technology - Code, Videos, Pods

Rahul

@Bigdata_and_GCP

Big Data and Cloud | Python and PySpark | Google certified Professional data engineer ☁️ | Data to information 0️⃣1️⃣ | Sharing Technology - Code, Videos, Pods

Épinglé

Hey Guys, I am Rahul. Working on data migration. As part of initial steps data migrated from different legacy technologies such as #Mainframe #Teradata #SQL developer to #BigData 🚔 🏎 Time to move from #Bigdata to #Google #Cloud 🚀 👨‍🚀

Lovely day to start : From today I am starting blogs and details for all technologies needed for Hadoop to Google Cloud data migration. Cover following technologies : 1) Pyspark (Python doubts would be part) 2) Data migration methods 3) Google cloud (Dataproc and BigQuery)



Rahul a reposté

All #Bengaluru people. Beware of frauds by @shadowfax_in They behave in crony way with #customer Both delivery boys and Support team would not help you and your delivery is not in safe hands. Below pic sent by #delivery boy and #Support marked closed Bad #CustomerExperience

NanavatyRahul's tweet image. All #Bengaluru people.  Beware of frauds by @shadowfax_in 

They behave in crony way with #customer
Both delivery boys and Support team would not help you and your delivery is not in safe hands. Below pic sent by #delivery boy and #Support marked closed

Bad #CustomerExperience

Rahul a reposté

Do for this #fraud by #Goibibo @makemytripcare would resolve or @GoibiboSupport I am loosing on 60,000,/- and interest per day 🤦‍♂️🤦‍♂️🤦‍♂️ @Ministry_CA #CivilAviation

@GoibiboSupport @makemytrip @makemytripcare #Goibibo and it's parent company #makemytrip $mmt is running fraud. I have booked international flight of #Emirates from Mumbai-Houston with return journey 1) They don't have option to cancel online 2) On call they provide one

NanavatyRahul's tweet image. @GoibiboSupport @makemytrip @makemytripcare 

#Goibibo and it's parent company #makemytrip $mmt is running fraud. I have booked international flight of #Emirates from Mumbai-Houston with return journey 
1) They don't have option to cancel online
2) On call they provide one
NanavatyRahul's tweet image. @GoibiboSupport @makemytrip @makemytripcare 

#Goibibo and it's parent company #makemytrip $mmt is running fraud. I have booked international flight of #Emirates from Mumbai-Houston with return journey 
1) They don't have option to cancel online
2) On call they provide one


Rahul a reposté

Comparison between different cloud services. World is moving towards multi-cloud with bias towards open source technologies Pic courtesy: @scgupta #aws #gcp #azure #dbt #apachebeam #iceberg #Apache #cloudengineer #CloudComputing

modern_gurukul's tweet image. Comparison between different cloud services.

World is moving towards multi-cloud with bias towards open source technologies 

Pic courtesy: @scgupta 

#aws #gcp #azure #dbt #apachebeam #iceberg #Apache #cloudengineer #CloudComputing

Hi @felipehoffa Just heard your #GoogleCloud podcast guest appearance for #BigData on @GCPPodcast Awesome information on #BigQuery. Thank you very much for wonderful stuff


Attempting another #Google certification after successful completion of #GCP certified Professional #Data Engineer- This time one of the most difficult one Please wish me luck !! 🙏 #GCP #MachineLearning #dataengineer #datascientists


Dear sir @BCNagesh_bjp Garden city has provided a lot us. #AazadiKaAmritMahotsav is perfect time to payback. I am IT professional from last 18 years. Can I get opportunity to train kids in Computers on every weekend in a government school as service ? @PMOIndia @EduMinOfIndia


Google cloud is considered as mostly tool platform. Great thing is they follow that developers thinks in terms of language On #Google cloud they have added pages dedicated to languages For #Python #developers it's as below link #100DaysOfCode #Coding cloud.google.com/python

docs.cloud.google.com

Python documentation  |  Google Cloud Documentation

Google Cloud makes development easy with Python.


Blown my mind. This make me think more in terms of #PySpark 💥

Nice pass time, deepens understanding of Python and helps to catch esoteric bugs. But most quizzes are strong antipatterns for serious work. It may make you a better mechanic but not a better driver. Important is writing simple, stupid, readable code for business problems.



Efficient #Coding in #Python

In today's #Python class, students extracted an IP address from the start of a string, s. My suggested solution: ip_address = s.split()[0] A student suggested we instead use a slice: ip_address = s[:s.index(' ')] Both did the job. But which was faster?



Day n of #100DaysOfCode Explored different ways to migrate #data from HDFS to Google cloud storage #BigData #GCP #google #GoogleCloud #Distcp #Dataproc #bigquery


Subtle point in any #programming language including #Python

You are not removing unwanted numbers from the numbers list, but are creating a new list while skipping the unwanted numbers. The difference between these can be quite significant.



Pretty interesting. Typo can lead to logical error and can eat lots of #development time #Python

A student in today's #Python class was counting vowels in string s: vowels = 0 for c in s: if c in 'aeiou': vowels =+ 1 Why the count always turn out to be 1?



Rahul a reposté

#python #tip: if you need to use a slice more than once you can define and reuse it as a slice object = more DRY (don't repeat yourself):

bbelderbos's tweet image. #python #tip: if you need to use a slice more than once you can define and reuse it as a slice object = more DRY (don't repeat yourself):

Python Regular expressions (RegEx) in action: Today's code contains examples of basic RegEx #Python expressions (part-1) #100DaysOfCode #Coding #100daysofcodechallenge #regex #code #Datamigration #BigData #javascript #development #cloud #GoogleCloud #Gcp github.com/rnanavaty/Pyth…


Today's world is not less on resources. It's lack of concentration which hurts 🚀 Practice daily even with single line of code or concept #Coding #100DaysOfCode #Python

Internet is free university. Design: uxcel .com No-code: makerpad .co Language: duolingo .com Code: freecodecamp .org Academic: khanacademy .org Cooking: bingingwithbabish .com Marketing: marketingexamples .com You just need a laptop and internet connection.



Day 2 of Data migration : RDD of PySpark ✅ parallelized object ✅ Different transformations ✅ Differe actions ✅ RDD as core for Pyspark operations #100DaysOfCode #100daysofcodechallenge #PySpark #Python #Datamigration #Coding #Data #DataAnalytics github.com/rnanavaty/PySp…


Quiz : What would be output of below two "print" statements #PySpark #100DaysOfCode #100daysofcodechallenge #RDD #MapReduce

Bigdata_and_GCP's tweet image. Quiz :

What would be output of below two "print" statements

#PySpark #100DaysOfCode #100daysofcodechallenge #RDD #MapReduce

Loading...

Something went wrong.


Something went wrong.