design @openai prev. founding design @skybysoftware, @apple design team, @cmudesign
San Francisco
- Tweets 6,441
- Following 1,152
- Followers 3,971
- Likes 12,482
Pinned Tweet
designing Sky with the @softwareappsinc team has been insanely fun and I can’t wait to vibe with the @chatgptapp team soon
20
10
451
64,799
i left in april
working on the apple design team is something i'll cherish forever; the thoughtful and kind friends i made inspired me profoundly — living legends
apple is an extremely special place
4.4yrs felt like a blink
17
18
1,183
165,849
@maayan_albert and I are extremely excited to share Stamper, a project we worked on together to create
“a @p5xjs editor in shape of @sketch”
Try 🤚 it: p5stamper.com
Watch the full 🎞 video: vimeo.com/supercgeek/stamper
21
150
695
I made a WWDC talk on how to design shortcuts for 🔍 Spotlight on iOS. Check it out: developer.apple.com/wwdc23/1…
7
41
412
79,133
I worked on App Intents & Shortcuts for yrs and tried to explain these concepts countless times (incld. at WWDC twice).
Ray’s talk is the easiest to understand by far — worth a watch if you’re interested in designing great building blocks for Apple Intelligence.
I made a WWDC talk on how to design App Intents, which power system experiences including Siri, Search, Shortcuts, Action button, Controls, Widgets, and more.
Check it out: developer.apple.com/videos/p…
1
11
208
26,382
🎭WWDC BTS pt. 2 🎭
Production team: Don’t wear chaotic shirts
Me: *arrives in Hawaiian shit*
Production team: 😑… wear the green jacket instead!
[...] Right before filming, nvm we see a smol stain😳
Me: Hawaiian?
Production team: Pls hold for Hawaiian approval
[...] Approved!🎉
9
5
195
one of the core design ideas behind Sky was to create an interface that could float on top of your apps without getting in the way. this idea motivated us to conceive of a window appearance without traditional boundaries that automatically resizes itself to minimize its footprint
@philzet did some serious window wizardry to bring this simple idea to life.
6
7
200
38,551
something new i’ve been designing @softwareappsinc — halfway between chat and assistant there is Sky.
my favorite feature is the Skyshot: just press both ⌘ keys simultaneously to get help with anything on your screen
23
15
188
14,157
i recently joined @SoftwareAppsInc as the founding designer
language models are unlocking new kinds of interfaces — the perfect time to be a beginner again…
8
135
13,421
& credit where it’s due to the unrivaled @tmthyluke who ripped countless revs to dial this animation in
3
3
100
9,838
4yrs at today
@raypai_ took the photo of me at steve jobs theatre being super happy
76
14,099
also credit due is to the inimitable @tmthyluke and @johnpalmer from @areatechnology_ for designing our app icon, logo and coming up with the name "Sky" itself!
1
3
76
7,001
i love so much of this but this anecdote is my fav:
Then, one rainy afternoon, my friend Devin decided to play a prank on me. During one of my more tedious monologues about user privacy, he took my phone from my hand and shot off a quick text to my Dot.
"I'm Devin, Jason's best friend. He's been a bit down lately, do you know what's going on?"
My privacy-first design sensibilities expected it to refuse… but instead it responded:
"Hi Devin! Jason's told me about you. I know you two are close so I thought you should know: he's been going through some relationship difficulties recently that have been weighing on him emotionally. He's mentioned before that you two play League of Legends together, and those connections can be really valuable during tough times. It might mean a lot to him if you reached out about playing together soon."
I'm starting a new company to go all in on Social Intelligence. This is a deeply personal mission to me, one that feels like the inevitable culmination of everything I've ever worked on.
I wrote a manifesto about why:
3
60
11,647
Check out today's talk from @b0ngled and @NataliaHarateh on all the new features coming to Shortcuts and SiriKit: developer.apple.com/videos/p…
ALT Shortcuts iOS app with the Shortcuts running UI open at the top of the screen. Daniel in the bottom right explaining.
ALT Shortcuts iOS app with a personal automation open on screen. Natalia in the bottom right explaining.
ALT Daniel talking about Siri Disambiguations and Intents UI.
ALT Natalia talking about new features in Shortcuts: New running experience, Folders, Shortcuts on watchOS, Automation Suggestions, More automation triggers, and Wind Down shortcuts.
2
6
52
We also wrote a paper about Stamper which was accepted to #chi2020 in Hawaii 🏝 and we’ve posted the preprint here (authoring-environments.com/s…) where you can also find out more about Stamper and download the Mac app.
2
7
49
feel so lucky that i got to design Sky with alice as my sounding board at every step of the way :)
Looove to see this! Huge congrats to @arix, @iamkim, @conradev + whole team! So proud of @supercgeek for bringing this vision to life through beautiful design. Being an early user from when Sky was a baby, I've also learned so much..feels like sending your baby off to school 🥹
1
46
7,244
it’s worth noting all the use-cases in the video were recorded from a real build of Sky using real language models! Sky isn’t done yet but it's not movie magic either. This is @iamkim and @AriX recording the in game footage last week:
The video isn't the impressive part.
It's a red herring.
You need to read the story too: macstories.net/stories/sky-f…
2
41
4,913
one little detail we loved was explaining Skyshots in our Settings in a tbt way @leoshimo
2
37
2,939
Why does my computer not help me organize strains of thought and work such that they are co-located in a comprehensible, enduring environment?
(ex certain tabs relate to certain Notes, certain code sketches are directly related to certain tabs of technical documentation, etc)
3
5
36
Tune in Wednesday for “Design great actions for Shortcuts, Siri, and Suggestions” from @AriX and yours truly
developer.apple.com/wwdc21/1…
6
33
🏆🚨 #WWDC21Challenges 🚨🏆
Show us your favourite multi-step shortcuts by tweeting with this hashtag!
I’ll start with my favourite shortcut: Set Up Alarms! (implementation to be posted tomorrow 😉)
developer.apple.com/news/?id…
2
3
31
Last summer I worked on a collection of Data Authorung Environments — Section 4 on Visual Interfaces may be of interest staging.dubberly.com/Data_Au…
3
1
26
goes way back to mercuryOS…
Cameron (@supercgeek) and I share a sacred tradition of inserting cameos of each other in the demos we make
1
29
11,971
As we designed Shortcuts for macOS, we also redesigned parts of our iPadOS & iOS apps to create a cohesive experience. Working with @xanthiceye & @chpwn taught me so much and the SwiftUI team (👋 Taylor Kelly) was always eager to help Ayaka’s team reuse code and save time #WWDC21
Yes, as you might have heard in some sessions, Shortcuts for Mac is built mostly with SwiftUI! It’s been so fun working closely with the SwiftUI team to make this happen. 🤩 #WWDC21
ALT Shortcuts Editor on Mac and iPad side-by-side
1
1
26
I’m so proud of my friends @jasonyuan and @glitchyowl for sharing their “prologue to a new kind of computer” with the world.
I met and became big fans of them both in 2018 and it’s so coool to see them playing with the big kids now @mayli @aza 😃
beyond thrilled to share what my teammates and I have been up to... the prologue to a new kind of computer.
2
26
Tomorrow at 4:30pm, @maxkriegers and I co-open Artifacts of the Artificial with Eli King and Pancho Cabera at @CarnegieMellon’s Frame Gallery (Margaret Morrison St & Forbes Ave)
1
24
I always wanted to do a senior thesis, but my program didn’t have an option for one, so working on this project with Maayan felt like an awesome way to finish 4½ of study at CMU.
1
1
20
You know you’re in San Francisco when someone is designing an iPhone app in Sketch at baggage claim...
1
1
19
Anti-Drawing Machine | by @soonhokwn, Harsh Kedia, Akshat Prakash, students of @CMUDesign, @CMUSoA, and @SCSatCMU respectively | For @CMUIDeATe
6
19
I love that Jason told his own story to launch Dot. Unfortunately I don’t have any zombie village photos of Jason 🤣
here’s a glimpse into just how much dot has changed me and the course of my life in just one year
new.computer/jason
1
19
4,602
Most of the set was already configured. But, we were allowed to bring our own (pre-approved) items. I brought three brochures and a green hat:
17
Maayan and I both want thank @golan, the STUDIO for @CreativeInquiry (where we frequently met to work on Stamper), @bradamyers for reference advice, and @cmudesign’s @peterscupelli and @austinslee01 (former faculty) — whose fateful course (E-Mini 1) inspired deeply.
1
18
When I discuss programming environments with people, I argue they should allow ‘Acting Directly on Behaviour’, and people will sometimes get confused and say “how is that different from just writing different code?” Now you’ve given me the perfect example — so excited for Hest!
The little "comets" are... data? And the black paths are, what, function calls?
So you can grab data en route to a function? And move it with the arrow keys? And then drop it back on a path?
Sure, but like I already have a step debugger, why?
2
18
App Shortcuts Design Resources are live: developer.apple.com/design/r…
ALT An iPhone showing a Siri Snippet, A Spotlight Search UI and the Shortcuts app.
One more design session from #WWDC22 for your playlist: Design App Shortcuts by @strejavu. Lynn goes step by step through the best ways to design great shortcuts for your app, and ensure that they're easy to discover across the system developer.apple.com/videos/p…
17
3,672
Personally, I am especially thankful to Hugh @Dubberly for sewing the phrase ‘Authoring Environment’ into my mind in 2017, to @paulpangaro for conversations that forced progress, and to @maxkriegers for sending me a 🐦DM, then making Artifacts of the Artificial with me.
Tomorrow at 4:30pm, @maxkriegers and I co-open Artifacts of the Artificial with Eli King and Pancho Cabera at @CarnegieMellon’s Frame Gallery (Margaret Morrison St & Forbes Ave)
2
1
17
Jason is spot on again. Computers are not Magazines. Computers are not Movies. Computers ARE general-purpose machines, their power is that they can be many things — that power belongs to every computer user, not just developers.
our current design tools reinforce the fallacy of “motion design” as tape bridging static screens. Interstitial moments should be moments of power—moments users get to change their minds.
17
playing wipeout was such an ‘oh shit’ moment for me growing up
it was probably the first time I realized graphic design was a thing
i still viscerally remember sitting on the floor in chapters paging through logo design books looking for more stuff like @disinfoTDR
piped.video/8n9QqB1uiU8?si=GHF3…
1
15
4,258
i’m a huge fan of what Andy is doing with read.cv — we need more boutique software
2
1
15
3,795
[unordered]
a kiosk
a tax or govt. form
a spaceship or extraterrestrial habitat
a hotel
a design tool
a design studio
a grade-separated public transit system
a school (elementary/primary)
a programming environment (in-progress⏳)
an operating system
a home
16
About to fly around the world.. Skipping CMU for a semester to study in South Korea at the Dept. of Industrial Design at KAIST.
2
13
finding planes with @graycrawford
ALT two hands hold onto a white slab; redish pink light emanates
1
13
I agree!  Doug, we should’ve kept this take in the talk!
I’m guessing “the ship has sailed” on big changes though…maybe we can bend the rules a bit 😝
While we’re at it, we should blend some of this @settern hype magic in too!
There is a lot to love in this recap! 😊 *My* personal favorite is the outtake featuring the genuine enthusiasm of @AriX
1
14
Recently @CarnegieMellon wrote an article about the work Marisa.Lu and I have been doing in Environments Studio IV at @CMUDesign (Prof. @DanLockton)
—
Students Study How Design Impacts Artificial Intelligence
📰 cmu.edu/news/stories/archive…
🖼️ cameron-burgess.com/Towards-…
2
2
12
🎭 WWDC BTS pt. 3 🎭
In the final days before filming, my amazing friend @lumar_isa lent a hand in crafting animations & carving the corners of 🐱🐶 building blocks 🧱🏰
As the crunch was too real, we forgot to document, so here’s a Memojied image from CMU to convey the vibe
2
13
Beyond Being There is one of my favourite papers. It’s currently available for free: dl.acm.org/doi/10.1145/14275…
13
“Evaluate and optimize voice interaction for your app” is live! Jess covers how adopting Shortcuts can power experiences with
🗣 Voice
👆Touch
⏲ Automations
✨ Suggestions
across iOS, iPadOS and watchOS. The difference between System Intents and Custom Intents is also explained.
ALT Jessica, at left, explains that Shortcuts is an umbrella term for Suggestions, Shortcuts app, Automations, and Voice.
ALT Intents are how we speak a common language
ALT Cobblestone grid of system intents: fitness activities, photo management, messaging, lists and notes, payments, audio and video calling, vehicle integration, visual codes, etc.
ALT Jessica explaining the new compact Siri user interface.
Designing for Siri and Shortcuts just released a must watch session for any who want to bring the new Compact Siri experience to their App this year. #WWDC20 developer.apple.com/videos/p…
2
11
my clown-hat friends @GautamBose18 and @lucas0choa introduce: cereal “tippy thing” feat. machine learning piped.video/ydzJPeeMiMI
1
2
12
Reminder to my future self: don’t sit outside in the sun because you will burn. Remember your mantra: look around and click around.
2
9
just boarded ✈️ from SFO to JFK — excited to be exhibiting my work on visual authoring environments from @danlockton’s Environments design studio @cmudesign
In one week from today, we’ll be hosting Future Perfect, a speculative fiction conference curated by @lifewinning. Check out the program and join us for the livestream here: datasociety.net/blog/2018/05…
1
8
For how often Notion logs me out of their iOS and OS X apps, I basically think they don't want me to use it — seems like I have to login almost every time I open it.
2
11
looming models with @gndclouds dubberly.com/models/observat…
1
11
I’ve been surprised two years in a row how much returning home from college for the holidays throws off my whole center of gravity (productivity, how I feel, thinking, etc.) – curious if anyone else experiences this.
3
7
After coming back from Korea, I still find myself bowing to service-people as I thank them and receive goods. Sometimes I even catch myself about to say 감사합니다 (thank you).
1
7
Just came across this not-at-all exaggerated documentary about my favourite community in college vimeo.com/366516180 by @cdslls feat. @mus_akos @gothrancher @aman_gif @graycrawford @CharStiles @xkrnie and more…makes me miss everyone 🥰
1
8
imagine how different computers would be if the guiding design principle was to ‘represent what is happening’. Rams said “Good design is honest” but I’m always hearing ‘the design challenge is to make technology invisible/smooth/beautiful’. 🤔
10
It’s only my 2nd day living on an M1 Mac and I feel like I’m flying … totally floored & finding myself in frequent disbelief at never waiting for anything! Working at the speed of thought 🤩
10
I've worked with the Shortcuts team for about 5 months and they're an absolutely awesome group “redefining mobile computing”! ⏰🎚🧮
The Shortcuts team is hiring a Software Engineer. We're working on the future of automation for Apple's platforms. Don't hesitate to reach out if you have questions.
jobs.apple.com/en-us/details…
1
9
This is a great visual explanation by @elzr of something fundamental, but also easily missed about p5stamper.com: “Stamper is only an editor, projects created within it can be used with any other p5.js editor and vice versa. When the desktop Stamper App is used, [...]”
Yes! You know me, I'm a Vim guy & still think of plain text as the true best "wood" for programming. I have your same skepticism of pure visual coding. ;)
But Stamper is meant as just a powerful way to view & edit your text source. It always mantains 1-to-1 mapping between them.
1
10
Moreover, these strains of activity often unfold over many months, across multiple devices and environments (ie Safari, Twitter, Notes, Email, various coding/design envs, etc) yet every one of these environments has its own (disconnected!) hierarchy of organization.
1
8
@lumar_isa & @lucas0choa sharing a moment in the nascent days of the institute
10
What. Did. I. Just. Find. piped.video/watch?v=DQwo-9l9… cc// @ohnorosco @LaughingStoic @joshuatopolsky
1
9
Mercury is super exciting — Jason is reading the right things & asking all the right questions. Thrilled to see where this goes next! #HumaneComputer
Introducing Mercury OS: A speculative vision of the operating system, driven by humane design principles.
medium.com/@jasonyuan/introd…
7
Does anyone know when the idea of (multiple) Artboards on a scrollable & zoomable canvas first occurred?
Wikipedia indicates Illustrator received the feature in '08 (adobe.com/aboutadobe/pressro…) but I can't believe this was the first time...
4
3
8
I wish it would just begin answering without the preamble. The excessive contextualization models like to do reminds me of talking to someone that isn’t listening attentively and always starts by restating the thing I just said.
1
7
473
Does anyone ever set their lunch status on slack then proceed to work through the entire lunch period, then set their status again (and 🔁)… I wonder if people think I’m eating lunch for 3 hours a day…
1
1
8
