OpenAI just introduced SORA: new text2video #AI model.
While everyone is just posting mind-blowing examples, I want to talk about the consequences.
A thread 🧵🔽
124
934
5,730
7,364,644
Made interactive water surface in #AR. Works in real-time.
75
381
3,312
215,666
Testing raytracing retraction prism in #AR
23
131
1,115
77,374
Ok I made a human duplicator. snapchat.com/unlock/?type=SN… #augmentedreality #snapchat #snapar #ar @SnapAR
27
206
1,017
Amazing AI depth estimation from a single image: Marigold
A thread with links and compare with others and ground truth 🔽
9
99
927
143,097
Finally succeeded in implementing off-axis projection for @SnapAR! 👀 visible with the naked eye
41
85
887
61,198
Sculpting in #AR. So cool! I was working on a similar project a while ago, but never released
Lee Vermeulen
29
135
789
56,512
Dev Khanna
Not #CGI: observable with the naked eye! The 3D space reacts to my eye's position.
Let's leverage some #AI:
1) Image generated by StableDiffusion SDXL
2) Depth map by ZoeDepth
3) Now it runs on MetaSpark which makes it possible to run it as a social augmented reality filter and even #AR ads.
28
69
640
102,034
7. In conclusion, I want to say that you, my dear readers, are among the ~0.01% of people who have a clear understanding of these technologies, their capabilities, and the future.
Deceiving everyone else is a piece of cake.
Use this knowledge for good while you still can. Tell everyone: trusting your own eyes and ears is no longer an option.
19
45
534
187,303
Apple fans are starting to return their Vision Pros.
>open the article
>based on a couple of tweets and one Reddit post
>senior reporter
Absolutely degenerate journalism
50
25
508
66,508
3. Creating a completely non-existent news topic or "properly" heating up the right one will become even easier.
People trust videos. Whip up videos from various "angles," post them, and bots on something like ChatGPT will comment, discuss, and retweet.
We live in a world where not just news is written based on tweets, but political decisions are made based on the same tweets, which, of course, don't represent reality for a second.
4
38
448
277,204
New experiment: real-time magic with floor destruction in #AR — no baked animations, 100% dynamic control by hand gestures. #AugmentedReality
14
66
444
1. Clearly, this isn't the end of the road—generation quality and consistency (the ability to maintain story, style, and details) will get better, and costs will go down.
Videos today are already hard to distinguish from reality, and soon it'll be outright impossible, even with algorithms or other neural networks.
11
23
407
322,767
AI spiral as a 3D parallax illusion. The video is not edited and not AR tracking: you can see the illusion with the naked eye.
It works in real-time by adjusting the 3D scene on screen, based on phone and head position.
17
46
432
37,838
You can prototype #visionOS apps on your Quest or Pico.
Here is a free visionOS UI Kit for #Unity: github.com/jetstyle/Apple-Vi…
9
78
411
80,217
5. As for flesh videographers, directors, and other filmmakers, those who say "AI won't replace you—a person with AI will" are only half right.
This is a transitional period that won't last very long. It's hard to predict, but I give this industry 10, maybe 15 years at most.
A neural network with literally the experience and knowledge of all humanity will be able to create much deeper and more engaging stories. And most importantly, personalized ones.
15
33
376
242,819
Real-time and mobile #AR! Just updated it to work on any surface: floor, walls, and ceiling! Also improved how real-world texture is mapped onto rocks. Wanna try?
22
70
387
35,682
2. Right now, pics of three-fingered kids and six-legged cats as "war victims" are racking up hundreds of thousands of retweets on X.
People are overlooking even such obvious flaws, not to mention the more sophisticated examples above.
And that's despite X having Community Notes, where tweets with fakes or misinformation get tagged with a debunking label and links to trusted sources.
Other social networks don't have anything like this at all!
4
18
368
304,411
New #AR stuff I'm working on: isolated AR portals. There are outer and inner spaces that are entirely isolated, yet we can seamlessly go from one to another.
18
40
371
43,559
AI generates decent textures WITHOUT lighting: problem solved.
As an artist, I will finally can to texture objects in a way that allows them to be relit 👀
Project links below ⬇️
7
60
391
39,758
First prototype of my home VPS navigation #AR
14
34
339
52,473
#AugmentedReality Dr. Strange portal I made early this year. Fully controllable by hand tracking.
24
39
337
4. Don't think OpenAI will be a force for good, imposing censorship and preventing the generation of deepfakes and other disinformation.
Well, they might, but they still don't possess unique and irreplaceable knowledge.
Other researchers and developers with similar solutions are only a couple of years behind.
5
20
308
260,056
Some old #AR surface displacement tests. Works in real-time.
14
32
319
39,638
6. The entertainment industry will change—endless, personalized, interactive multiplayer series on any topic will likely emerge within a few years.
Personalized porn, naturally, will be a thing too (I know you thought of it).
7
19
262
194,358
Finally made this shader work on #VisionPro.
11
7
281
14,758
Just FYI I made Minecraft inside Instagram filter. instagram.com/ar/25311199361… infinite digging, flowing water, more than 50 types of blocks and even save&load feature. Hey @Minecraft what do you think?
10
35
228
bitch wtf. so to make games for #visionOS you have to buy:
- $3500 vision pro
- $2000+ macbook pro
- $2040 unity license
- $100 apple dev account
Unity requires a Unity Pro license for visionOS XR support, also if you try to install the packages Unity will make sure to remove them on initialization, trust me I just tried it 😂
The cool thing is, you have 30 days to try Unity Pro which should give you time to evaluate the tools.
26
29
214
63,739
Finally made #AR surface collisions with correct physical trajectories!
6
19
203
17,799
Dropping new #AR experience! All the stuff works in real-time. No post-production. Link in the thread! #AugmentedReality
9
27
202
A thread about how I've made this cyber-fashion AR garment with cinema-level VFX for @lenslist × @SnapAR Fashion Contest. snapchat.com/unlock/?type=SN… (actually my first clothes design)
13
31
198
Even though it looks cool, no one actually will want this visual garbage persistently float in front of our eyes. That’s why such concepts will never become real.
This is a real location-based AR demo running inside real AR glasses
A glimpse into a future where our lives are more like the games and movies we love
49
14
184
32,491
Have you seen this beautiful #AppleEvent particles animation?
I've made something similar in #AR a while ago.
7
27
189
18,168
Some #AR magic: object passing seamlessly between hand and space!
3
16
175
10,775
I won @SnapAR hackathon! 😱 First Place is really surprising! Thanks team for appreciating my work! Read more about the project: devpost.com/software/voxeliz… #AR #AugmentedReality
27
4
182
14,625
Object capture in iOS 17. We have plenty of scanning apps available but having a native feature from Apple sounds cool. What scanning apps do you use?
Flat Pixel
14
23
169
47,181
This is the upcoming version of human duplicator: 2.0. Even more weird. #snapAR @SnapAR #AugmentedReality
3
29
175
Experimenting with spherical portals in #AugmentedReality
4
18
178
9,068
That's how the illusion runs inside MetaSpark: here I manually move the virtual camera (in reality it's connected to the user's eye position).
The main difference from #ARkit is, that in Spark I have to manually modify the camera view and projection matrices in shaders.
8
14
169
12,298
AR goes to the next level: light and environment estimation. Love this level of realism!
Divesh Naidoo
12
12
166
17,513
1/4 Super excited to share that my work was featured by @Meta in the Top-10 #AR effects of 2022, across millions of effects! #AugmentedReality
7
25
161
17,453
iPhone 15 + External Display + Controller = new console?
Thanks to USB-C and a new GPU with raytracing and MetalFX Upscaling, the new iPhone will run AAA games such as Death Stranding, Resident Evil 4, and Assassin's Creed Mirage. Thoughts?
Vadim Yuryev
13
18
156
21,788
Audio reactive surface in #AugmentedReality. An experiment from 2021! Made in Meta Spark.
9
15
136
9,941
Love how rendering on Apple Vision Pro reacts on the environment just out of the box.
5
11
139
23,302
Today’s update for my #SparkAR hand controller: intersection detection. #AugmentedReality
4
13
137
This is #AR Minecraft I made last year. Link to try in the thread!
5
15
133
8,554
Just built a simple #AR prototype that captures a 360° panorama and uses it for applying reflective materials to objects in real time
9
16
148
20,389
Another old #AugmentedReality test from 2020. Ice!
3
13
120
5,770
Made with GPU particles in #AugmentedReality. Optical flow + particles sampling body color + dynamic attractor!
8
13
118
8,131
Made a real-time painting technique on a 3D model in #AugmentedReality. How would you use it?
11
6
116
8,320
That's how the simulation core looks like: it's basically a plane with a camera image projected onto it. #AR
5
8
116
5,994
Working on #AR voxel scanner. Done: scan with different resolutions, preview, and AR view.
6
12
112
15,159
Side effect! I can now emulate dolly zoom on this #AI spiral!
3
6
109
5,448
8. That's a wrap.
Follow @Enuriru for more expert insights about AI and AR. I don't post bullshit like "how to create AI influencer in two minutes".
Retweet the original tweet if you like it:
OpenAI just introduced SORA: new text2video #AI model.
While everyone is just posting mind-blowing examples, I want to talk about the consequences.
A thread 🧵🔽
18
6
109
238,365
The only reasonable hardware AI assistant is Meta + Rayban smart glasses.
Glasses are a wearable device that you can actually wear for the whole day. Especially with transition lenses (transparent indoors and dark outdoors).
Rabbit is basically a cheap phone without most features an actual $200 phone has. AI pin is just a gimmick with a weird UI.
22
2
106
10,512
New nerdy thread about my generative makeup #AugmentedReality effect: SYNTHETICA.
instagram.com/ar/33013805588…
snapchat.com/unlock/?type=SN…
9
13
105
My #AR portal implementation merges two isolated 3D scenes with a 100% seamless passing experience. No Switching. No transitions.
Portals are double-sided: if there is smth in front or behind the portal, you can see it from the corresponding side.
Multiple portals supported.
4
11
99
6,279
We just launched a new #AR experience for @coachella × @BLACKPINK! Give it a try and let me know what you think: instagram.com/ar/34090117660…
6
9
102
14,270
they've already implemented a simplified version of it in TikTok app (in closed beta for AR developers). Works in real-time. I made a simple world effect with it:
One more turn with this #AR: added underwater transition. All real-time, based on #ML scene depth estimation. Built in @effecthouse.
4
8
106
13,386
We’ve made an #AR package for @coachella! Everyone who gets a welcome box will be able to try!
5
15
105
8,146
Recorded in real-time on a phone. Environmentally accurate light. #AR
11
6
96
4,996
One more turn with this #AR: added underwater transition. All real-time, based on #ML scene depth estimation. Built in @effecthouse.
3
14
100
23,565
Continue working on a hair/fur simulation for #AR. It's fast enough to run on mobiles and HMDs in real time.
6
6
94
8,630
At least we can do simple fresnel-based reflections #VisionPro
3
93
10,048
1/5. How you can make a real-time #AugmentedReality garment with #AI in just 5 minutes. Thread!
4
18
92
About a year ago I spend weeks implementing custom physics for @SnapAR. Here is the video! #AugmentedReality But now they made it native. So cool!
3
8
89
Today's experiment: measure tool using LiDAR on iPhone, built in #LensStudio. #SnapAR @SnapAR
Also working to bring this to @Spectacles
5
13
82
Made real-world #AR collisions in Meta Spark. Unlike Snap Lens Studio, Spark is incapable of doing point cloud and mesh reconstruction: it can only detect planes. So I check collisions with planes manually. The physics is custom too.
4
14
82
7,640
Stop using #AugmentedReality to stick low-poly 3D models to the floor. We can see them on Sketchfab even without AR. Make it interactive instead.
2
5
72