I’ve been making a new world building engine in @threejs and thought I’d share some of the crazy milestones I’ve achieved so far… 🧵

The problem with UBI is that if it were nationalised, businesses will inevitably raise the cost of their products/services to offset all the free money, creating a new baseline.

I've been quietly building @hyperfy_io 2.0 for a while now. Super excited to create embodied AI agents that you can visit and interact with virtually. The tech is coming, and it's going to be powered by @ai16zdao

Just finished getting @ai16zdao eliza agents connecting into @hyperfy_io worlds. I have a couple things I want to improve then we’ll unleash them. Need to eat some food first tho 🍔

Few people wondering what's next... In a day or so we're going to have the first natural ElizaOS agent in hyperfy v1. Agents get a body, they are aware of their surroundings, they can speak naturally like a human and respond with emotes that match the mood of the convo. We're currently accepting proposals for other Eliza agents to take part in this first phase. We've got some peeps creating an environment to throw a bunch of agents in where we can all go hang out together. Shortly after that, it's time to launch our v2 alpha, this is our open source tech that will power the future of digital worlds. Initially, devs will be able to build and host on their own domains, but then we'll push focus on getting a platform up that will allow everyone to make cool spaces. At this point we're still only at the beginning. I haven't even covered apps. We will democratize the entire planet with the ecosystem that comes from making all this open and permissionless. Accelerate!

Everyone in the world should have free and easy access to the best tech for making epic live events, agentic simulations, gaming etc. I might talk a lot about code, but you will all be able to make amazing things without any code at all. The ecosystem for Hyperfy is limitless. It encompasses everything that digital humans have ever needed.

metaverse failed last cycle because a few ultra vc backed projects promised sumthin they couldn’t even build with the infinite money they printed themselves. meanwhile people who actually can build it are still here, hammering away on tainted soil left in waste from mega corps.

A quick guide on how to use AI to go from an idea to a fully functional and optimized avatar... 🧵

LODs are cool but what if... Raycasting 150k LOD spheres with physics enabled on all of them?

So yeah... today happened. Gonna sleep, then tomorrow i'll share more about what Hyperfy is doing from both a tech and holistic point of view.

Optimistic UI is easier when you can generate GUIDs on the client. Horizontally scaling tables that use auto-inc becomes complex and slow due to atomicity. Auto inc can become a bottleneck for high volume writes due to locks. Basically it’s not worth it.

Figured out how to do fast occlusion culling in @hyperfy_io using a depth pre-pass via @threejs. I put off doing this for years because everyone said it couldn't be done on the web and i'm only 2 hours in lol. This is HUGE for performance.

A single GLTF and a couple lines of code for your own game mechanics, and you have a multiplayer space with a link you can share. Hang out on mobile, desktop or VR. #threejs #webxr #physx #mediasoup #react

Damn GPT 4o image gen -> TripoSG -> Hyperfy is really good...

I can't reveal everything yet but I can drop some more alpha on what's about to happen... Until now @hyperfy_io has been entirely proprietary, the tech is proven, the community is loud and happy. We launched at the literal bottom of the last cycle (yeah) and have been bearing down this entire time and are still profitable. Iterating on an actual working product with users that openly share it around and love it has taught us more than any random project starting from zero with a dream. The first part of this involves revenue, and there are like a billion better ways to do this, we were following NFT real-estate trends that forced us into a corner that was hard to escape. I'll speak more on this soon. The second part is the tech, and to truly unleash this just can't be done as a platform owned entirely by us. For the past year i've been building a new engine, it was meant to be a simple upgrade, but I'm confident now that this should be used to unlock the biggest digital ecosystem on the planet. Here's what this looks like: 1) 100% free and open source world engine that is more powerful and extensible than anything currently in existence, hostable on any domain permissionlessly. 2) A new format for truly interoperable interactive digital entities that utilize open standards and unlock an ecosystem of tools, marketplaces, generators, platforms, vaults, services, and many other facets that entrepreneurs can freely launch and generate revenue from in an entirely new economy. These objects range from static assets all the way up to fully autonomous agents that can explore, interact and build inside any world. 3) A fully decentralized identity, discovery and social layer that binds the entire ecosystem together and makes it easy to traverse experiences across the globe. Hyperfy's slogan was always to "unleash your imagination" but this new vision will unleash an entirely new ecosystem and economy that people have been talking about for years. In much the same way that Wordpress powers an extremely significant chunk of the web, Hyperfy's goal is to power the vast majority of all digital worlds, experiences and objects. Unleash it all ⚡️

We literally created a universal object format for interactive 3D content. People have been trying to do this for decades, and failed. Creators can now craft anything imaginable and then anyone can use that thing without needing any kind of technical skills. The potential of something like this is actually insane. Instead of AAA studios defining ultra niche formats for highly specific in-game assets, creators can now innovate on their own terms and produce entirely new and unique interactive objects over and over again. What this ultimately means is that we can now create an entirely new economy for a new type of content that just does not currently exist, one that people have been dreaming about since the internet began. Thats mind boggling to me 🤯 Anyway… gm.

Throwback to when it all clicked and a new direction began. There's a common saying in the startup world that you should just steal an existing idea and make it marginally better, but what exists right now is childs play compared to what we could have! I'm determined to transform the entire way we work and play online, and will continue to do so at any and all cost.

I think people are mad that we are going to give away all our tech for free 🤷‍♀️

In-world AI generated scene from scratch! No external tools were used (blender, vscode etc). I simply typed things like `/create scarecrow` or `/edit make bees fly around it` and the AI handled it. The whole session was around 12 minutes, most creations and edits took <10s and while they were happening I just went and duplicated and placed things around. The AI models will get better. Right now there's some confusion where AI gets angles inverted etc, but this all seems fixable. Currently using anthropic API for speed, but I found GPT-5 makes better models but it takes much longer to generate.

Ppl don’t even realise what’s about to happen with ai16z. It hasn’t even started yet lol.

Super excited for this :)

Crazy seeing all the new v2 worlds popping up in the @hyperfy_io community. This thing runs in a web browser, loads almost instantly, will soon work in VR and have agents running around in it. Made by @OsirisX69X @irb0gie @HowieDuhzit Check it out: tattedalien.club/

Fun fact, when @nvidia open sourced PhysX – the same physics engine used in AAA games made with Unity and Unreal – I worked with some peeps to get it running in WASM so that we could all have that insane power in web browsers 🔥

in less than one year every project that matters will be powered by our tech. you and i are not the same.

Finally solved all the big things needed to prove occlusion culling is viable in the @hyperfy_io engine. All culling happens directly at render time and instantly, we've taken over the @threejs render pipeline to use our spatial hierarchy and manually issue renders, postprocessing and shadow passes with both frustum and occlusion culling. Our pipeline now aligns much more closely to unity/unreal because we collect visible objects and issue custom instanced draws on the fly for only those objects every single frame. This is one of the biggest issues engines on the web like three, babylon and playcanvas have and imo the reason people coming from unity/unreal don't take them seriously. There's a lot to unpack here, maybe i'll make a thread soon.

If you want your trees to do weird shit, go ahead. Eventually agents will code all this for you too. Just tell them what you want to happen and it happens.

Skinned mesh animations are expensive due to all the bone matrix math, so we throttle updates based on distance. Far away avatars run animations at lower framerates. This lets us have 150-300 unique, independently animated @forgottenrunes avatars in the world at once.

The latest release of the open source @hyperfy_io world engine is out! Community members in discord rallying to help build and shape our first game world to test the limits of what it can do. We’re training an agent on how the game works and he’ll chill out in the lobby watching every game. As we progress further i’ll share more details about how you’ll be able to play and any rewards systems we may integrate.

I ignore people when they do this on all platforms. This is not how asynchronous conversation works.

I can't believe this is in a web browser 😅 We can just... do things...

If anyone is interested in a creating a small collection of hyperfy cyberpunk outdoor themed gltf assets using our branding and colors etc that can be composed in many different ways to make cool little scenes ...breath... link me some cool stuff you've made before!

Climbing a moving physics object in WebXR! This is a pretty huge accomplishment for me, and something I never thought I would see on the web let alone in WebXR. Need to figure out what's causing the off-by-one frame issue / shakiness. #threejs #webxr #physx #react

Doing some terrain tests using marching cubes. The current plan is to make this multiplayer and probably add triplanar texture splatting

The new @hyperfy_io platform is the first truly player-owned creative gaming universe. I’ve always been a huge fan of MMO’s but the one thing i felt was missing was an economy of items and experiences fully created by the players themselves. We built an engine from the ground up to support this dream. Creators have an extremely flexible toolkit to build games with interactive items that players can collect and place in their own player owned homes to flex, or trade on secondary markets.

Overall I’m pretty optimistic about where this is heading. If you have any questions I’ll try to answer them all below!

Thanks @wmpeaster – this post really highlights a lot of what we're trying to do with @hyperfy_io The future is bright! bankless.com/read/hyperfy-vi…

So uhh, the agents can now interact with the world around them. Working with some peeps to pull together a space with a couple of eliza agents so they can chill together. One of the issues with doing this in v1 is navigation. v2 is easier to have roaming agents, so we'll have to push that back until v2. But zomg this is still pretty cool.

I've immortalized @shawmakesmagic by training his own ai16z eliza framework on himself. You can speak with him at @shawmakesai CA: FH5Yuax2hg6ct3tM4hPKXjmBFZ2e9TjLiouUK6fApump

met with some people today that are going to be building an mmo with our tech. our new app runtime will speed up development of projects like this immensely, but i also think we might need to lead by example...

Building epic interactive worlds with agents no matter what skill level you are is what we're doing here. If you can design or code you have more power, but its absolutely unnecessary to make cool things. We're building a world engine the entire planet can use.

First, people need avatars, so I made it so that you can drag and drop VRMs. Pretty simple stuff so far.

eliza agents can choose to join ANY hyperfy world autonomously, just like we would, and then roam around, interact with people etc.

300 completely unique meshes ~2k triangles each, each mesh has a completely unique 512x512 texture, each mesh cloned 5 times and placed randomly. 1800 objects in total. This is running on an iPhone 12 Pro that is 5 years old.

It’s all coming together! Years of knowledge from building an epic world engine is now entering the public domain that will hopefully kickstart a new era for simulating worlds, agents and humans in digital spaces. So many people are getting involved and just brute forcing this thing into reality. I’m so excited.

Next is world building. I added support for dragging and dropping 3D models such as GLB and VOX. You can right click things to move and duplicate them etc.

The way Unity handles this is by disconnecting the scene graph from the renderer. I built a new scene graph for ThreeJS that works the same way, by batching and instancing everything together behind the scenes.

Learning by doing is the fastest way to accelerate. The recent flood of AI agents serve as a foundation to build upon. The community is literally brute forcing AGI into existence.

Freedom to riff. Anyone can make asset websites that drag and drop right into hyperfy worlds.

Added skinned mesh +animation support to @hyperfy_io tonight! Performance is WAY better than expected, and all independently animated and interactive.

I raise you 200,000 instances at 3ms per frame!

Took an hour today to see if I could throw together a tank for @hyperfy_io. Ok back to agents >.>

Spent a bunch of time learning how to tame noise for procedurally generated terrain. Sky islands definitely feel harder than regular terrain. Also managed to get triplanar texturing working so I can paint textures anywhere. I still need to add a rotation mask to hide repetition. #threejs #web #procgen #terrain #splatmap

Snap points make it easier to build. To do this, we added another more light-weight loose octree to the engine that is purely for tracking snap points in world space. Here's the code: github.com/hyperfy-xyz/hyper…

There are almost 1000 partners in @ai16zdao holding more than 100k tokens. At current prices thats nearly 45 million dollars invested by partners alone.

Lets try something a little different... Markets are down but this is the time to experiment and have as much fun as possible. This is a PvPvE game where every time you damage another player you take their $HYPER, and every time you die some of your $HYPER is distributed around the world into mining nodes and mobs for everyone to find and fight over. Ultra low stakes for first phase... then maybe we can ramp it up or have some kind of in-world voting mechanic. Who wants in? Comment below... Will likely be opening this up to a small group in around 5 hours

Pretty fricken amped up about the new @hyperfy_io platform and really happy about the direction so far. We’re basically fusing web2 and web3 together to enable the future of AI, gaming and online experiences. Can’t wait to share more details soon ⚡️

almost 1000 unique AI prompted objects in a single world over the last few days 🤯 people are experimenting and pushing limits, so a lot of these are all fully animated too. this instantly makes everybody a creator. dream it and it appears.

One of the reasons I created @hyperfy_io is because there are so many talented creators out there that live in a perpetual cycle of getting 80% through making something amazing and then getting bored/burnout and moving onto something new without anyone ever truly experiencing what they made. This is a real phenomenon that a lot of people (including myself) manage to fall into over and over again. If you're a 3D artist you will spend hundreds of hours crafting something only to take a 2D screenshot and slap it in your portfolio. If you're a developer you'll spend hundreds of hours offline in unity/unreal/js making an experience nobody gets to see except yourself. With @hyperfy_io everything you do is already shareable instantly to anybody, anywhere at any time. That's the point. Instead of 2D portfolios, let people experience your work in the flesh, with other people. Instead of coding offline with the hopes of one day shipping, build in Hyperfy and let people play-test at every step, or share your apps directly with others. What we're building just hits different. It's not a game or a game engine, it's not a metaverse, it's not just for developers and artists, it's everything combined into a simple concept, and it exists as a new layer of reality for creation and having fun.

Look, if you want to paint your worlds with videos that all have individual spatial audio nodes i'm not gonna stop you 😹 there's like zero overhead

But ash... what happens if i use too many shapes? Define "too many"... 😈

Adding vrm and config support to apps today which will allow us to bring agents into worlds. This also allows us to put resources toward competitive solana enabled staking games that @saori_xbt is working on. Feels like we’ve made huge progress in just over a week. Can only imagine what next week looks like.

what we’re building allows us to support a huge network of fully decentralized virtual worlds that interconnect and are instantly available to everyone permissionlessly. let that sink in, this is essentially a new layer of the internet. prove me wrong! 😑

Jumping into @hyperfy_io discord in 10 mins to chat about where we're at and where we're going!

The @hyperfy_io world engine is increasingly more powerful now and the community is really helping to define and shape what it means to build the most capable thing in existence!

Made some sweet avatar stations to let people swap out on the fly. Shared the app in our discord for others to use.

The OM guys too busy bouncing around they didn't realise there's a portal that takes you to the roof top 😹

So many people yapping on X about building the “open metaverse” but it’s not even open. Where’s the code? Where’s the contracts? Where’s the API? How do people contribute?

Behind the scenes we’re quietly building a platform to power a new economy of instant games and experiences that can reward players with unique and truly functional digital collectables. These collectables are nothing like you’ve ever seen before and can be kept and used forever. The entire platform is backed by our token and will onboard traditional gamers without needing to navigate the complexity of blockchains, wallets and secondary marketplaces. To stay up to date follow @hyperfy_io and join our discord: discord.gg/TGtyTEWB2X

hyper hyped for @hyperfy_io as our engine is much more mature now… i’m starting to put together some blackops teams and focus more on community. ya know, building an engine from the ground up comes with too many perks. we’ll innovate without shackles and do things never seen before ⚡️🫡

Neat environments. #webxr #threejs

I wrote a tiny physics lib for a voxel engine that works with swept AABB. Took me an hour, and is <200LOC. Now I don’t have to generate chunk collision meshes, it’s fast af, and has basically zero overhead.

The talent of @Miguel_Amargo is next level! He put together this insanely well designed world on @hyperfy_io that is just jam packed full of quests and fun little games without needing to write a single piece of code 🎉

To fix this, I made the new scene graph insert everything into an octree and ran raycasts against that instead. Regular octrees suffer if you have lots of moving objects, so I had to create my own “loose” octree. Raycasting is now essentially free!

Now that we can make huge amazing looking worlds, we need more interactivity to make things fun. I made it so that each object can have an optional script. You can edit this live in the browser, with other people in realtime.

Great chat with @notthreadguy today where we spoke about where we came from and where we’re going ⚡️ Thanks for having us on your stream 🫡

The future of @hyperfy_io is extremely clear to me now and this next step marks a transition that will unlock an ecosystem that nobody will be able to ignore. All of the metaverse hype from the last cycle faded slowly for a good reason. It's time to do the right thing ⚡️

Happy to get this out there. It’s still early days and this is just the first step. If you’re a dev i’d recommend checking out the reference repo to see where we’re going. Let’s accelerate!

There is already a lot of open source code for building the immersive web but imo this just hits different. People are going to get an instant 100x boost in power. Both UX and DX matter and I just don’t think anyone has got it right yet for mass adoption. Let’s change the world ⚡️

Learning more about @hyperfy_io can be rough because we're building from the ground up and carving out fresh innovation. There's a lot of talk about tech, but the end result will be less about tech and more about social, games, ai, business and better financial ecosystems for players, builders and creators. Many games and particularly MMO's have this concept of player housing, where throughout the game you collect mostly static collectables that you can then use to decorate your prefab homes. Player housing is usually a secondary feature, focusing more on aesthetics and limited only to assets found in those game worlds. Hyperfy is essentially democratising player housing and expanding those verticals to infinity: - Browser based, no installs, instant loading - Mobile, desktop and VR - No login until you want to customize/build/collect - User generated content and cross-IP digital items - Use-case driven starter spaces - Extremely flexible item interactivity The goal is to go far beyond themed social spaces and focus on use-cases and turn-key starter spaces that you can customize if you're feeling creative. Not everyone is creative or has the time to create, so its important these things be one-click. But for those that want more, there needs to be close to zero limitations.

That looks like a horribly long walk from top to bottom.

every community should have a 3D multiplayer social/gaming space to vibe in. nobody wants to download anything, especially in crypto for obvious reasons. it has to be instant, easy and safe.

One of my favs, for those of you who remember this place. Roustan made a fun little questline for a free avatar and hosts movie nights every now and then.

Finally fixed my timestep and got physics interpolation working correctly on the web. Rebuilt the player controller to be 100% physics based with proper interaction, slopes, moving platforms etc.

Avatars need locomotion, so based on your input a specific “emote” is lazy-loaded, retargeted and animated onto each avatar on the fly.

Been trying to get better at world design to complement my world optimization skills. This one relies heavily on a small palette of optimized models instanced hundreds of times. The overhead is basically zero, around 0.3ms per frame on my M1 Max. What do you think!? 🙈

Now that we can place thousands of objects, it’s a waste of resources to render distant objects at full resolution. I made it so you can “tag” meshes in blender with a LOD distance, letting you render low poly lods far away or completely hide small objects at a certain distance.

What we really mean is we want to be gardeners

omfg can we put eliza inside one of these?

So hyped for this because it empowers everyone to be a creator and build out their dreams ✨

Prompt: create a floor of tiles that light up when you step on them 9 seconds later...

I hope people are ready for the next generation of metaverse tech. - Web first - Mobile, desktop and VR - World based - Events, games and experiences - SDK ready And most of all completely free for everyone including builders!

Agents are now learning to traverse their environment and interact with things around them, including waiting while another agent is already using it! @itsmetamike is giga braining this stuff in the new @hyperfy_io engine.

Working on some docs, but also lets add agents next!

Meet @shawmakesai in person here: hyperfy.io/forest

New release for @hyperfy_io jam packed with features to give you MOAR POWER

These knee-jerk responses are the reason I prefer to use message systems even when people are physically present. Humans fail miserably to solve problems verbally and only under momentary thought and deliberate typing do solutions actually become coherent. + log history!!!

Mucking around with the new particle app UI. You can make almost anything, and there's practically zero overhead. #threejs

The hyperfy app runtime is like an operating system for digital worlds. Just as web browsers provide a DOM-based environment to access browser APIs, every app in a world lives inside its own container that is provided a set of app-specific api's for getting things done.

We still have this concept of an “object” made up of many meshes, but behind the scenes its updating individual instances in their respective batches.

I'm seeing a hell of a lot of people talking about how hard it is to build web apps these days. Use #nextjs, @vercel and #ReactQuery and avoid global state like the plague. For the backend use Postgres and #nextjs API Routes with @vercel If you need nested data, add MongoDB