GcpPython's profile picture. BI developer moved from MSC to GCP world and tasked with building a data infrastructure from scratch. Learn python and use it to build data pipelines. ForReal

GCP python Data Engineer

@GcpPython

BI developer moved from MSC to GCP world and tasked with building a data infrastructure from scratch. Learn python and use it to build data pipelines. ForReal

GCP python Data Engineer 님이 재게시함

I'm 10y remote now and 99% of all interactions with my heavy remote / async teams are NOT done with calls / video. It almost all in writing. Everyone right now trying to optimize for voice / video communication is optimizing into the wrong thing.


I am preparing to plan and deploy a Cloud Composer in #GCP any tips for compulsory material to research, things to look out for, etc ? @GCPcloud


A very interesting article on #GCP #GoogleCloud providing a look behind the scenes of decision making. Read in full and don't assume content bu its tile. theinformation.com/articles/googl…


"Confidential material: This page is confidential. Do not share or discuss until authorized to do so. " I feel like James Bond 😎

GcpPython's tweet image. "Confidential material: This page is confidential. Do not share or discuss until authorized to do so. "
I feel like James Bond 😎

I just can't get #Dataflow JDBC template to work with SQL server. I have a sqlserver box hosted on #GCP and want to get the data out of it into #bigquery. Any magical syntax you know of or blog/article for this exact case? I will re-post if I find a solution


Really enjoying reading this #bigquery book! I wish I had it a year ago as it would have saved me sooo much time and struggle. At least now I can appreciate much more

GcpPython's tweet image. Really enjoying reading this #bigquery book! I wish I had it a year ago as it would have saved me sooo much time and struggle. At least now I can appreciate much more

Transferring Big Query, intercontinental data sets into a new project and re pointing #GoogleAnalytics sure does have a few gotchas. Main one is the project quota on jobs and removing redundant tables views, one by one. BigQ API + #python to the rescue 😃


Fantastic decision Jesse! I wish more people did that. Thank you for sharing your knowledge and being an example to others

이 트윗은 더 이상 사용할 수 없습니다.

My first #AppacheNiFi data pipeline. Extract JSON files from S3 bucket and load to GCS and local disk. Pretty pleased by it. I am Impressed by speed and looking forward to now exploring the support for python. Not yet hosted in gcp..

GcpPython's tweet image. My first #AppacheNiFi data pipeline. Extract JSON files from S3 bucket and load to GCS and local disk. Pretty pleased by it. I am Impressed by speed and looking forward to now exploring the support for python. Not yet hosted in gcp..

Looking for GUI pipeline builders (business req). Current contender: Apache Nifi. Got a pipeline built to fetch S3 files and store in GCS. Now just figure out the best way to Set NiFi in GCP


I have been struggling to get the Data Fusion to work with S3. If I go through wrangler, I can connect to the S3 bucket. When then moving into studio, no joy. It complains about not seeing the file system. There goes the 'easy drag and drop' #hybridcloud #GCP #DataFusion #AWS


Google Cloud Next 2019 London g.co/cloudnext/UK Who knows, maybe I'll get the invite and company will cover expenses. #GCP #GoogleCloud


Loading...

Something went wrong.


Something went wrong.