Developer Advocate around the data world. Ex-Google BigQuery, Ex-Snowflake, Always Felipe
San Francisco, CA
- Tweets 5,968
- Following 4,876
- Followers 14,669
- Likes 18,118
Pinned Tweet
It’s exactly 10 years since my first day at Google. What I’ve learnt:
1. In 2011 there was a career path for me, but I had to leave Chile to find it.
(thread continues)
13
38
274
Ali is a manager at Google. Ali is a doctor. Ali knows his rights. @aliafshar was brutally attacked by the police. medium.com/@aliafshar/to-the…
62
2,662
2,344
400,000 GitHub repositories, 1 billion files, 14 terabytes of code: Spaces or Tabs? medium.com/@hoffa/400-000-gi… (#BigQuery on @github #holywars)
39
575
679
Angry airport immigration officer:"H-1B? I can't wait until president Trump gets rid of all of you." Welcome to the @realDonaldTrump America
81
835
461
Why do you feel the need to criticize someone in Kyiv telling the stories that they want to share?
Give him your support, or ignore, if that's the best you can do.
5
7
455
Am I the Asshole? Well, teddit.net/r/AmItheAsshole/ is now the 4th most active subreddit.
Turns out most of the posters... are not the assholes.
Data in BigQuery: stackoverflow.com/a/59997899…
(thx @jasonbaumgartne cc @AITA_reddit)
12
53
383
I just published "Reddit AmItheAsshole is nicer to women than to men — a SQL proof":
medium.com/@hoffa/reddit-ami…
"On stories about women, the poster is judged worse than w/stories about men"
An investigation with BigQuery, SQL, and Data Studio.
(thx @jasonbaumgartne @AITA_reddit)
48
45
366
I don't know how to say goodbye, but I'll try it here anyways: Today is my last day at Google
(more details about the new adventure soon)
This is the letter I sent internally 2 weeks ago:
docs.google.com/document/d/1…
110
16
387
So this Brazilian government website eats all my CPU to mine cryptocurrency when I land on their homepage... ouch (thx @rick_viscomi @HTTPArchive #BigQuery #bitcoin)
26
317
336
Best @GCPcloud products, ranked:
13. you
12. can’t
11. rank
10. them
9. as
8. each
7. solves
6. different
5. problems
4. in
3. amazing
2. ways
1. BigQuery
9
50
327
Feels like I've learned more in the last 6 months than in the previous 2 years at Google.
Switching companies took me out of auto-pilot mode, and forced me to question many assumptions I took for granted.
If anything, I'm grateful for my ex-coworkers that pushed me to jump ❤️
13
13
318
It's your 10th birthday BigQuery!
It's a very special day, and some of your friends are here to tell you how much you've meant to them.
(join this thread to share with the team how much BigQuery means to you)
#DecadeinData #BigQuery10
18
112
267
When leading engineers like @takidau and @ElliottBrossard left Google and joined @SnowflakeDB, I was shocked.
Then I chose to do the same.
Oh, hi there!
I'm Felipe Hoffa, Snowflake's new Data Cloud Advocate.
Check Greg Czajkowski's 5 reasons why: snowflake.com/blog/5-reasons… ❄️
44
26
266
Are you ready for a very special BigQuery day?
Starring:
- New features ⭐
- Impressive demos 🌈
- The engineers behind the magic 🧙
meetup.com/Live-with-Google-…
Save the date: 20/5/20, and make sure to join the live conversation on The Data Show.
9
79
230
4 awesome @googlecloud Developer Advocates that you should follow:
- @nyghtowl: ML & AI
- @the_thagomizer: Languages & Operations
- @tekgrrl: Ops & Infrastructure
- @MimmingCodes: Security
(they randomly showed up, and I had to capture the moment)
8
63
210
I just published “The top contributors to GitHub — 2017” medium.com/p/the-top-contrib…
6
100
203
New in @SnowflakeDB's SQL: GROUP BY ALL
This saves time and prevents errors, as the compiler figures out the columns that need aggregation.
E.g., in the pic GROUP BY ALL takes cares of the query - instead of "GROUP BY tag, answered, year" or the obscurer "GROUP BY 1, 3, 4".
9
19
200
40,449
More than 1,000 websites are mining cryptocurrency in their homepage with your browser!!
@dougsillars @rick_viscomi @paulcalvano used BigQuery to dig into @HTTPArchive's data:
discuss.httparchive.org/t/th…
#bitcoin
8
146
197
I was a cover story for the printed @la_segunda today. It has some fun stories and tips about being hired by Google.
I'm happy it goes into what a Developer Advocate does (an engineer who speaks to outside engineers, and also listens for feedback and needs).
Ask me anything :)
16
21
189
Starting again is quite an adventure.
I was BigQuery expert #2 of all time on the @StackOverflow rankings. Now I'm #21 for @SnowflakeDB.
It's like starting a new game, with no legendary weapons, armor, nor unlocked skills. But I'm with a great team, and ready for the challenge.
9
9
185
This is deep!
BigQuery ML now integrates with AI Platform:
- AutoML Tables
- Boosted Tree models using XGBoost
- Deep Neural Network (DNN) models
cloud.google.com/bigquery-ml…
🪄 Pull off all this magic with just one SQL query trick (beta)
5
64
175
BigQuery now has materialized views (beta):
- Zero maintenance (recomputed in background)
- Always fresh (consistent with base table, even streaming)
- Smart tuning (reroute to view)
cloud.google.com/bigquery/do…
With this you get cost reductions and performance improvements 🤯
5
72
171
I just published "Uber datasets in BigQuery: Driving times around SF (and your city too)"
medium.com/@hoffa/uber-datas…
@Uber is adding new cities to their public data program — let’s load them into BigQuery - with GIS functions, clustering, and Data Studio+BI Engine.
(cc @dschnr)
1
47
162
Google Singapore has most interesting way to say "welcome". On our way to #voxxedDaysSingapore! @glaforge @meteatamel @googlecloud represent
2
70
154
I just published "Snowflake tables on Cloudflare R2".
When replicating data to multiple regions, egress costs can be quite significant. So this is exciting: Now @SnowflakeDB can use @Cloudflare R2 as external storage for tables— featuring 0 egress fees❄️
medium.com/@hoffa/snowflake-…
5
26
149
60,685
Analyzing the biggest GitHub communities. See how Docker, Kubernetes, TensorFlow & others interact (Issues+BigQuery) medium.com/@hoffa/analyzing-…
1
76
136
I just published "Coronavirus in Wikipedia by language — visualized"
medium.com/@hoffa/coronaviru…
Dig in to see how the #Coronavirus news has spread and trended around the world — and test some cool new tricks with BigQuery and Data Studio.
(cc @WikiResearch)
3
55
127
Great news for BigQuery + Data Studio: 📈📊🏆
- BI Engine is out of beta! Now in GA w/ SLA.
- Free tier: Up-to 1GB of BI Engine in Data Studio!
- Free tier is ok for testing, not prod. For production, create a BI Engine reservation. lnkd.in/eDqVzV8
4
48
129
A big one from the wishlist: @SnowflakeDB now supports EXCLUDE/RENAME within a SELECT *:
medium.com/snowflake/snowfla…
What would you like to get next?
❄️❤️SQL
11
14
122
Your challenge, if you choose to accept it @polleyg:
- Process 10.6 billion rows 😅
- Before reaching the city 🌇
- While on a tram! 🚊
Are you ready? Featuring @googlecloud #Dataflow. Go #serverless :)
piped.video/watch?v=b4z8xJlT…
4
37
123
I'd like to share a personal accomplishment - I lost 35lbs (16kg) by learning how to use data for my own good:
hoffa.medium.com/data-driven…
15
2
116
8,198
All good things must come to an end: After 3.9 years at @SnowflakeDB, it’s time for me to say goodbye and thanks:
- linkedin.com/feed/update/urn…
❄👋
17
1
113
8,954
I just published "When will Stack Overflow reply: How to predict with BigQuery".
medium.com/@hoffa/when-will-…
3
35
107
All the open source code in @GitHub now shared within BigQuery: Analyze all the code! medium.com/@hoffa/b3576fd2b1… @googlecloud
1
91
102
I love the smell of fresh data in the morning: Now you can schedule your BigQuery queries with BigQuery!
cloud.google.com/bigquery/do…
3
34
104
Stack Overflow has a new CEO, and he wanted to interview me in front of the whole company during their annual all-hands.
I couldn't go to Austin, as I'm in London for #GoogleCloudNext. But we made it happen anyways :)
Thx @pchandraseka and to all my @StackOverflow friends!
5
10
107
I just published "The real top Stack Overflow questions" link.medium.com/zmhcn4vTsU
4
42
101
I just published "Get started with BigQuery and dbt, the easy way"
medium.com/@hoffa/get-starte…
BigQuery+@getdbt are a great mix, and others (@clairebcarroll @lak_gcp @markrittman ...) have written about it. What's new in this post: The easiest way to run dbt in @GCPcloud.
29
99
The #DevFest season is on - 16K+ RSVPs on @meetup!
Congratulations to @GoogleDevsIN for having the largest # of RSVPs! 🏆🇮🇳 @GDGChennai @gdgbbsr @gdgpune @GDGBLR @gdgbaroda
Also Kenya & Argentina: @GDG_Nairobi @gdgbsas
Interactive #datastudio report: datastudio.google.com/report…
14
36
106
I just published “World Cup visualized: All the goals” medium.com/p/world-cup-all-t…
6
41
99
You can win $500 in cloud credits: Just run and paste the results of these 2 BigQuery queries. Want to win $500 more? You might be the winner of the live challenge too!
Join us at goo.gle/bqchallenge - and take the BigQuery challenge
3
39
95
Last week I released my last Google video, and no one noticed this.
Arigato 🎥@kazunori_279!
piped.video/watch?v=XChIl9aw…
"The more you know who you are, and what you want, the less you let things upset you" -- Lost in Translation
ALT Lost in translation homage
4
3
95
The new @SnowflakeDB SQL enhancements are a gift for anyone that has to deal with 100s of columns: SELECT * ILIKE ‘%’ REPLACE() ❄️
E.g, in this query you get an id, all the “feature” columns in the 50s, and a modified `feature_52` – without having to specify each column manually
2
10
94
10,326
I just published “World Cup visualized: The most valuable players” medium.com/p/world-cup-visua…
4
30
95
And it's 2 years since this other Yegge rant
steve-yegge.medium.com/dear-…
2
3
82
A new @kaggle Kaggle challenge with $10,000 in @GCPcloud BQML credits for the winners: Your task is to predict congestion around Atlanta, Boston, Chicago & Philadelphia using data provided by @GEOTAB.
It's your turn to make BigQuery ML shine 🚗🔮🏆
kaggle.com/c/bigquery-geotab…
2
40
88
Wondering how to make your BigQuery queries way faster + significants savings?
I just published “Optimizing BigQuery: Cluster your tables”
medium.com/@hoffa/bigquery-o… #BigQuery
4
35
88
The top 0.1% of all Wikipedia pages earn 25% of the pageviews. The bottom 99% only get 42% of all the views. And the bottom 80% - only get 4%.
I just published "Inequality: How to draw a Lorenz curve with SQL, BigQuery, and Data Studio"
medium.com/@hoffa/inequality…
2
30
91
Should I start making some data analysis videos from home? There's so many cool Data Studio and BigQuery features I want to show off!
First, let's try to fix my lights and audio setup... any advice?
piped.video/watch?v=qKrEESGC…
15
6
88
I just published "10 top tips: Unleash your BigQuery superpowers"
medium.com/@hoffa/10-top-tip…
BigQuery makes you a superhero — discover here 10 superpowers you didn't know you already have!
🦸♀️🦸♂️🦸♀️🦸♂️🦸♀️🦸♂️🦸♀️🦸♂️🦸♀️🦸♂️
27
89
Oh wow! The amazing @trevornoah will join me at the @SnowflakeDB 2020 Data Cloud Summit.
We are going to talk about the power of storytelling and data. What questions should I ask him?
Nov 17, sign-up for free at snowflake.com/data-cloud-sum…
#MobilizeYourData #TheDataCloud
6
15
84
Some of my ❤ guest speakers at #GoogleNext18:
- VP Eng @reddit, @nickcald
- @LookerData founder, @lloydtabb
- @apachekafka super star, @gwenshap
- Director of Eng @nytimes, @bsvingen
- @NOAA Chief Data Officer, @edward_j_kearns
Join us 7/24-7/26 @GCPcloud
6
29
85
.@Pivotal moves from AWS to @googlecloud -> cuts their 8 figures bill in half. @wattersjames (SVP) at #Reinvent. piped.video/watch?v=BUN0wx2e…
3
46
82
I just published "Analyzing the crisis with reddit and BigQuery: The 2019 Chilean protests"
medium.com/@hoffa/analyzing-…
#ChileProtests #DataScience
(h/t @jasonbaumgartne @carnby @cukyperez @polonglin)
3
30
77
I just published "Stack Overflow future trends: Predicting with ARIMA and BigQuery"
medium.com/@hoffa/stack-over…
Can you predict the top @StackOverflow tags of 2023? Sure! Get your time-series analysis started with SQL now.
Plus a Data Studio dashboard and a @getdbt pipeline.
4
29
80
I just published "New in BigQuery: Persistent UDFs" link.medium.com/pTBROzUTZX
(includes some useful new functions and even working NLP inside BigQuery!)
35
85
I just published “These are the real Stack Overflow trends: Use the pageviews” medium.com/p/these-are-the-r…
1
22
77
Robot: You will never be able to perform complex mathematical computations as fast as us.
Me: Yeah, but can you feel love?
R: Well, can you?
Me: 😭
1
9
73
Some useful SQL tricks I learned for @SnowflakeDB this week, thanks to @StackOverflow:
- LEAD/LAG() can IGNORE NULLS, letting you look ahead multiple rows for the first non-null value
stackoverflow.com/questions/…
(my previous fav db doesn't support this)
2
11
74
I just published "Easy pivot() in BigQuery, finally"
medium.com/@hoffa/easy-pivot…
This has been one of the most recurrent BigQuery open questions - and now we can solve it with stored procedures and dynamic SQL. Check it out.
3
22
75
Thx for all your replies! They're really engaging.
If my math and methods are wrong, please tell me so. I'll be delighted if anyone can actually take all this data and prove I'm wrong — or better, deeper results.
Be nice to each other. Most people are not the asshole anyways.
11
1
65
Snowflake vs BigQuery vs Presto vs Redshift benchmarks — 2020-09 update:
fivetran.com/blog/warehouse-…
(spoiler alert: @SnowflakeDB came out as the fastest, and at a lower cost than the rest)
As measured by @frasergeorgew @fivetran, thx!
11
16
71
Pretty outstanding conversation on the future of data.
With:
@Bob_Muglia ex-CEO @SnowflakeDB
@MichelleUfford CEO @noteable_io, ex-@NetflixData
@martin_casado General partner at @a16z
@jthandy CEO @fishtowndata @getdbt
Host:
@frasergeorgew CEO @fivetran
piped.video/t91FEgxdojg?t=42🤯
2
9
71
3 new BigQuery SQL ease-of-use features to celebrate:
SELECT CONCAT('casts to concat needed: ', 0);
SELECT 'hello' || ' world';
SELECT ['arrays', 'can'] || ['concat', 'too'];
cloud.google.com/bigquery/do…
2
26
71
Fight with me all you want, I'm in the comfort of San Francisco, and you are in the comfort of Atlanta.
But if you want to support people in Kyiv right now, be a better person to them on Twitter. It's easy. Let them tell their story, amplify, or just ignore.
3
4
59
Can you name the 14 countries that have more developers per capita than the US? medium.com/@hoffa/github-top… (#BigQuery+@github+@ghtorrent)
80
67
I just delivered a BigQuery tech talk to >100 Twitter employees.
We are in the middle of a crisis, and I'm so proud of being able to empower the data skills of teams behind a critical world communications hub.
Thx @prasadwagle and everyone at @Twitter!
blog.twitter.com/engineering…
2
6
71
I just published "Loading MySQL backup files into BigQuery — straight out of Cloud SQL"
medium.com/@hoffa/loading-my…
(oh yes... BigQuery can now ingest data straight out of MySql and Postgres too)
2
15
65
Team dinner:
me: "I'M LOOKING FOR MY TEAM"
"Name on reservation?"
"THEY LOOK LIKE NERDS"
"Oh, is it @briandorsey?"
1
8
66
Two great releases for #BigQuery:
1. Partition your tables based on any column that is a DATE or TIMESTAMP: You should use this!
cloud.google.com/bigquery/do…
2. Customer Managed Encryption Keys now out of beta (awesome for the few who need this)
piped.video/watch?v=-dlv9wJh…
@GCPcloud
4
31
67
I just published "Interactive: The top 2019 @Wikipedia pages".
medium.com/@hoffa/interactiv…
Go deeper and beyond the top trends - with BigQuery and Data Studio
(@Wikimedia @WikiResearch)
29
68
Trying out the new @googleanalytics Data Studio: reddit April’s gilded comments for Sanders/Trump/Clinton w/BigQuery medium.com/@hoffa/showing-of…
2
37
61
Our vision of modern data warehousing, and how we are making it real with BigQuery - in a 5 minute vid:
- ∞ storage
-🤯compute
-🎢real-time
-👨👩👧👦centralized storage
-🔮predictive
-👐sharing
-🔒security&trust
piped.video/ufJ2W3EHIgA @jrdntgn @GCPcloud
16
64
Learn how to fight spam with machine learning and BigQuery:
piped.video/watch?v=7bW7P-8S…
Thanks @jdiossantos and @lovoo, this was a lot fun!
2
17
65
I have been at Google for 8 years, and I haven't jumped the shark. But the couch in front of 20,000 people? That I did!
piped.video/watch?v=W16iHlo2…
#GoogleNext19 #BigQuery @GCPcloud
11
2
65
This is a great conversation between @kelseyhightower and @pablokbs (the whole thing is in English, except the description).
My fav is Kelsey doubling down on how everything is data. Configuration is not code, but data. Learning how to code? Think data.
#DataIsLife.
El podcast de hoy es con el capo de los capos: @kelseyhightower.
Tenemos una charla super interesante sobre el estado de las tecnologías actuales, Docker Desktop, y si los desarrolladores deberían aprender Docker y Kubernetes para su trabajo.
piped.video/e1bavPwQmVc
1
2
64
"Play Pac-Man inside Data Studio with Vega"
Google Data Studio supports Vega, now it's magic time (3d rendering, Monte Carlo simulations...) — it only takes some JSON configs. Connect it to BigQuery too!
(cc @helpfullee) lnkd.in/gtZWCAK
3
17
64
40% improvement on WordPress performance by migrating to the new C2 @GCPcloud instances (high per-thread performance and memory speeds) - at no extra cost. Check @wpengine Smitha's report:
- wpengine.com/blog/real-world…
(cc @asmartbear h/t @luismisn)
14
59
Mentos Summer science with the girls — part II:
No Coke, but Pepsi vs Pepsi Light vs Pepsi Zero. Which one will be?
Happy New Year you all! Stay curious :)
5
1
62
Excel is for beginners, while Rust/Haskell/Go for the most experienced developers.
With age as in years since @StackOverflow account creation for people in questions vs answers. Check with BigQuery: console.cloud.google.com/big…
Peculiar trend breaker: C (students ask, pros answer?)
3
14
60
It’s the little details that counts: @SnowflakeDB keeps making SQL easier, now with a simpler syntax to construct arrays and objects:
SELECT [1, 2, {'t': 'three'}]
Keep your requests coming!
8
9
57
I just published "Google Analytics 4 in Snowflake: SQL Cookbook": hoffa.medium.com/google-anal…
This shows how to export GA4 from BigQuery into Snowflake, and translate the cookbook sample queries.
Thanks to @_mkazi_ (Developer Advocate for @GoogleAnalytics) for this collaboration!
12
60
A "top public speaking coach" talk: His main advice was to be funny, so just put more memes and funny videos in your technical talks.
Me+teammates advice:
- Don't!
- Being funny is ok if you're. Do what works for you. But it might backfire.
- Above all, be interesting.
#devrel
7
1
59
The news cycle: Wikipedia pageviews correlated to Notre Dame.
datastudio.google.com/u/0/re…
Made with BigQuery, Data Studio, and @Wikimedia data
2
19
60
There are challenges when using BigQuery at a Twitter scale - so I went to Twitter to meet @prasadwagle himself -
to learn from Twitter's data infrastructure team - how they make their data useful to their analysts and PMs - all at a BigQuery scale:
blog.twitter.com/engineering…
3
20
62
I just published "Funnel analytics with SQL: MATCH_RECOGNIZE()"
hoffa.medium.com/funnel-anal…
Figuring out how to analyze an e-commerce shopping funnel with SQL is truly difficult — until now. Find here how to analyze a @googleanalytics e-commerce funnel with SQL and @SnowflakeDB.
1
11
55
It's time for some #AdventOfCode with SQL!
This year with @SnowflakeDB, problem 1 solved:
adventofcode.com/2020
3
8
59
I just published "BigQuery without a credit card: Discover, learn and share"
Now signing up for BQ is easier than ever, read the details from @cwj02 cloud.google.com/blog/produc…
And to start querying right now, see
medium.com/@hoffa/bigquery-w…
5
24
58
Even the taxi cabs in Tokyo are excited for @googlecloud Next - this Wednesday and Thursday! cloudnext.withgoogle.com/tok…
2
16
60
I just published "Forecasts in Snowflake: Facebook Prophet on Cloud Run with SQL"
hoffa.medium.com/forecasts-i…
Make time series forecasts in @SnowflakeDB as easy as:
𝚂𝙴𝙻𝙴𝙲𝚃 𝚙𝚛𝚘𝚙𝚑𝚎𝚝𝚒𝚣𝚎('[[𝟺𝟷,𝟺𝟹,..],["𝟸𝟶𝟷𝟿-𝟷𝟸-𝟹𝟶","𝟸𝟶𝟸𝟶-𝟶𝟷-𝟶𝟼",..]]');
3
16
59
I just published "UNPIVOT multiple columns into tidy pairs with BigQuery and a SQL UDF"
medium.com/@hoffa/how-to-unp…
This post is for anyone dealing with time series in CSVs with one new column for each day. Having tidy data is important! Especially these days, ...
5
13
55