Leaned in way more on the 2d game aspect of it, and have video drop-off too, but the place it came from: "being able to have multiple conversations in the same shared space without hearing everyone at the same time" is the same.
I had a very nice conversation with one of your developers in your app. I hope you folks can build on your tool and find a path to success. Good luck in your endeavors!
I had a lot of really great conversations with completely random people tonight. It was a lot of fun chasing them around the little map, screaming "YOU BETTER RUN!" And then talking about VR and open source and projects and even foreign language learning. It's weird, I didn't set out to have "open office hours for the internet at large", but it's now kind of feeling like a thing, and I'm kind of liking it. Maybe that's the take-away with this stupid project. Maybe everyone should have their own, private voice chat server where anyone else can hop in at any time.
This is really neat. I logged in for a few seconds to check out the interface (should have taken a screenshot). The center of the meeting shows a large white square window and smaller colored squares indicating other meeting participants. You can drag your square (avatar) around the window to place yourself next to others.
I have a standing virtual happy hour with some friends every week. If I can figure out how to get this to work with my docker/traefik deployment, I'll have to try it with my friend group and see how it works.
Jitsi Meet itself is really easy to setup. My "game" is just a static HTML file that uses the Jitsi Meet web API, except for the volume control. Because Jitsi Meet's Web API installs through an iframe, I had to modify the web files for my install slightly.
It's one additional line in `/use/share/jitsi-meet/index.html` to include a very small JS file that sets up a RPC pipe between my window and the Jitsi Meet window.
Other than that, I wore everything in vanilla JS and HTML5, so there aren't any other dependencies to manage, no build systems to run. Just dump the files somewhere (I'm running the front end in Azure CDN right now) and go.
Cool idea! Positional audio is something IMHO underused in todays conference solutions. (Mumble supports it out of the box, but as far as I know its position sources are all game plugins)
Thanks. Positional audio teleconf in the browser was something I hacked on back 5 years ago when WebVR first came out. Unfortunately, Google broke positional audio, then WebVR, then changed a lot of how WebAudio worked.
Lately, I'm involved with a few meetups that miss the dynamic of a real meetup. So I threw this together to hopefully get some semblance of the meetup space again.
It's really simple. Jitsi Meet has a web app API that basically loads a standard Jitsi Meet install in an iframe, with some inter-window communication setup using Window.postMessage. I add a small hack on Jitsi Meet's default install to take my own postMessage calls to sniff out the HTML audio elements Jitsi Meet creates and modifies their volume.
For the position of participants, I use Jitsi Meets inter-user text messaging system to send data packages. Then I just scale each user's audio volume based on a linear scale. Anyone closer than 3 squares is rendered in full volume, and anyone further than 14 is muted. And of course, settings in the scripts to scale these values. They could even be per-user, if they wanted to scale how well they can hear.
There's no stereo pan or ambisonics, but hopefully the volume level scaling is enough to make for useful meetups.
This is great!
I was toying around with the idea of building some sort virtual comedy stage. It would be a web conference with one person streaming audio and video and everyone else is audience with audio only to have audience/laughter track. Anyone build something similar on jitsi?
I made a prototype a week ago with a face recognition engine on the frontend, connecting into the Jitsi JavaScript API, running my own Jitsi server on DigitalOcean.
The result: the video conferencing only showed faces! Imagine the possibilities of moving those faces around a stage, or using virtual cutouts where the faces would appear, etc.
It was very very fun, I have screenshots of 10 people connecting at once -- hit me up if you want to pursue something :-)
Should be pretty easy with the basic iframe API. I spent more time trying to figure out a cheap way to host everything than I did building the functionality.
Awesome! I was thinking along these lines the other day, and picturing a “virtual conference” game where you could walk around and join ad-hoc circles of conversation. Maybe you’d see profile photo avatars for the people near you, and the further away ones would be generic avatars. I think it’d be a cool way to bring some of the serendipity of walking around a conference to online meetings. Maybe introduce a limit to the size of a circle too, so you don’t get 50 people crowded around the 1 famous person.
It made me quite happy to be able to leave the meeting entirely. Do you think you could turn this into an Ad-hoc D&D dungeon so that when you leave, you could take a party out into the rest of the "office" and fight mutated paperclips, overstuffed file cabinets, and disorganized supply closets?
They make tech that takes data from streamed games and lets you use that data to make interactive client side overlays on the stream that sync to the game.
Open for contributions! I just wanted to prove out the core concept of scaling the audio. Now that I know that works, really want to dig into making art assets and interactions for people.
I 90% agree with your opinion. A video does add some useful information, but 90% of the benefit could come from a small window of the person(s) you are talking to- maybe 90px by 90px.
Unfortunately, not going to work with how Jitsi does their Web API through an iframe. Ol' OpenTok, before they got bought out by Vonage, could have been used because they inftected new DOM elements into the current page. But with the Jisti Meet interface timing in an iframe, I just don't have enough access to composite things like that.
Cool, I was looking for something like this but didn't find it.
Also, reminds me that I need to submit a pull request for their iframe API, because I stumbled on some missing information in it. Luckily, was pretty easy to guess at the right values.
Cool! I recently tried Mozilla Hubs [1], which is a similar concept but in 3D. Worked pretty well, although it was a bit awkward to not be able to see facial expressions on your avatar. And I got a bit nauseous after some time.
The backstory to REAMDE is that an MMORPG turns out to also be a really good platform for teleconferencing. Gradually more and more business moves into this MMORPG until the company releases a "business version" and a significant proportion of the world economy is run through what is essentially a professional version of WoW.
https://town.siempre.io/
Leaned in way more on the 2d game aspect of it, and have video drop-off too, but the place it came from: "being able to have multiple conversations in the same shared space without hearing everyone at the same time" is the same.