- As others have said, "1000 tokens" doesn't mean anything to non-technical users and barely means anything to me. Just tell me how many words I can dictate!

- That serif-font LaTeX error rate table is also way too boring. People want something flashy: "Up to 7x fewer errors than macOS dictation" is cool, a comparison table is not.

- Similarly, ".05 Word Error Rate" has to go. Spell out what that means and use percentages.

- "Forgot a name, word, fact, or number? Just ask Aqua to fill it in for you." It would be nice to be able to turn this off, or at least have a clear indication when content that I did not say is inserted into my document. If I'm dictating, I don't usually want anything but the words I say on the page.

Respectfully disagree on this one: as a startup, you can't effectively compete with the likes of Apple on flashiness. However, the very target market of those dictating large amounts of text will include a significant number of people in academia themselves. For those people, Aqua Voice will feel relevant. Those who aren't interested in comparison tables will simply skip over them :)

For example, if you got 70 errors before you now get only 10 errors.

(edited because formatting swallowed asterisk for times)

If new is 1/7 the size of the old, then 7 * new = old. It takes 7 times of new_count to get the value of old_count. 1/7th of the old_count. 7x fewer seems like a shorthand, but I'm not a native English speaker.

  x times != x times fewer

7 times fewer => multiply by fraction

I'm a heavy voice dictation user, and I would switch to this in a heartbeat. I'll tell you why this is so impressive, it means you can make mistakes and correct them with voice, it takes away the overhead of preparing a sentence in your mind before saying it, one of the hardest things about voice dictation.

I often have my shoulder in pain, and I have to reach for my mouse to change a word, I would not if I used this. This software would literally prevent me pain.

However, I cannot use it without a privacy policy. I have to know where the recording of my voice is being saved, if it's being saved, and what is it going to be used for.

I would pay extra for my voice to be entirely deleted and not used afterwards, that could even be an upsell part of your packages. Extra $5 to never save your voice or data.

I love it, but I can't use it for most things without a privacy policy.

I'm sure you get this feedback 100 times a day, but I'd gladly pay a substantial amount to use this in place of the system dictation on my Mac and iPhone. Right now, the main limitation to me using it constantly would be the endless need to copy and paste from this separate new document editor into my email app or into Notion or Google Docs, etc.

- Consider a time-based free trial. As others have said, tokens are confusing, but also your model is unlimited so the chunk of tokens doesn't allow me to see what it might be like to actually use your product. I'm more than halfway through my tokens after writing an HN comment and a brief todo list for work, so I've been able to see what it'd be like to pay the $10 for about 5 minutes worth of work, which feels like a very short trial. A week, say, seems fair? And then you have some kind of cap on tokens that only comes up if someone uses an abusively huge amount (an issue, I'm sure, you'd face with paying customers too, right?)

- I had a bit of trouble with making a todo list—I kept wanting the system to do a "new line" or "next item" and show me a new line with a dash so I know I'm dictating to the right place, but I couldn't coax it into doing that for me. I had to sort of just start on the next item and then use my keyboard to push return. When making lists, it's good to be able to do so fluidly and intentionally as much as possible. Sometimes it did figure out, impressively, that long pauses meant I wanted a new line. But not always.

But I do think that the reliability needs to take a few more steps before it becomes a true keyboard replacer.

You've moved us all a lot closer to my dream: taking a long walk outside, AirPods in, and handling the day's email without even looking at a screen once.

I have a similar dream, we'll make it happen!

One suggestion I have here is to have at least two different sections of the UI. One part would be the actual document and the other would be the scratchpad. It seems like much of what you say would not actually make it into the document (edits, corrections, etc) so those would only be shown in the scratchpad. Once the editor has processed the text from the scratchpad then it can go into the document how it's supposed to. Having text immediately show up in the document as it's dictated is weird.

Your big challenge right now is just that STT is still relatively slow for this usecase. Time will be on your side in that regard as I'm sure you know.

Good luck! Voice is the future of a lot of the interactions we have with computers.

I actually made a demo just like this aqua voice internally (unfortunately didn't get prioritized) but there is really no lag. However it will always be the case where the model will want to "revisit" transcribed words based on what comes next. So if you want the best accuracy you do want to wait a sec or two for the transcription to settle down a bit.

[0]: https://www.houndify.com

I kid. Your comment made me think of a shower thought I had recently where I wished my audiobook had subtitles.

The next most important thing would be the ability to write action routines for grammar. My preference is for Python because it's the easiest target when using chatGPT to write code. However, I could probably learn to live with other languages (except JavaScript, which I hate). I refer you to Joel Gould's "natPython" package he wrote for NaturallySpeaking. Here's the original presentation that people built on. https://slideplayer.com/slide/5924729/

Here's a lesson from the past. In the early days of DragonDictate/NaturallySpeaking, when the Bakers ran Dragon Systems, they regularly had employees drop into the local speech recognition user group meetings and talk to us about what worked for us and what failed. They knew that watching us Crips would give them more information about how to build a good speech recognition environment than almost any other user community. We found the corner cases before anybody else. They did some nice things, such as supporting a couple of speech recognition user group conferences with space and employee time.

It seems like nuance has forgotten those lessons.

Anyway, I was planning on getting work done today, but your announcement shoots that in the head. :-)

[edit] Freaking impressive. It is clear that I should spend more time on this. I can see how my experience of Naturally Speaking limited my view, and you have a much wider view of what the user interface could be.

For those who don't know what happened next, and why Dragon seem to stagnant so much in the aughts, the story about how Goldman Sachs helped them sell to essentially Belgian Enron, months before they collapsed, was quite illuminating to me, and sad.

https://archive.ph/Zck6i

> Professor Gompers opined that at the time the acquisition closed, Dragon was a troubled company that was losing money and had regularly missed its own financial projections. It was highly uncertain whether Dragon could survive as a stand-alone entity. Professor Gompers also showed that technology stocks were on a downward trend, and L&H was the only buyer willing to pay the steep price Dragon demanded. Thus, he concluded that if the company had not accepted the L&H deal, Dragon likely would have declared bankruptcy. The jury found in favor of the defendants and awarded no damages to the plaintiffs.

It just so happens, that many of the interfaces one has to deal with are somewhat low bandwidth. (For example, many spend most of their time stepping over, stepping into, or setting breakpoints in a debugger.) Code completion greatly cuts down the number of options to be navigated second to second. It seems like the time has arrived for an interactive voice operated AI pair programmer agent, where the human is taking the "strategic" role.

We want to get Aqua into as many places as possible — and will go full tilt into that as soon as the core is extremely extremely solid (this is our focus right now).

Great lessons from Dragon Dictation. Would love to learn more about the speech recognition user group meetings! Are those still running? Are you a part of any?

FWIW, I am fleeing Fusebase, formally known as Nimbus, because they "pivoted" and messed up my notetaking environment. In the beginning, I went with Nimbus because it was the only notetaking environment that worked with Dragon. After the pivot, not so much. I'm giving Joplin a try. Aqua might work well as an extension to Joplin, especially if there was a WYSIMWYG (what you see is mostly what you get) front-end like Rich Markdown. I'd also look at heynote.

My use case is dictating text into various applications and correcting that text within the text area. If I have to, I can use the dictation box and then paste it into the target application.

When you talk about using speech recognition for creating code, I've been through enough brute-force solutions like Talon to know they are the wrong way because they always focus the user on the wrong thing. When creating code, you should be thinking about the data structure and the environment in which it operates. When you use speech-driven programming systems, you focus on what you have to say to get the syntax you need to make it compile correctly. As a result, you lose your connection to the problem you're trying to solve.

Whether you like it or not, ChatGPT is currently the best solution as long as you never edit the code directly.

I would really happily pay $10 / month for this, but what I really want is either: - A Raycast plugin or Desktop app that lets this interact with any editable text area in my environment - An API that I can pass existing text / context + audio stream to and get back a heartbeat of full document updates. Then, the community can build Obsidian/VSCode/browser plugins for the huge surface area of text entry

Going to give you $10 later this afternoon regardless, and congrats!

That would let me quickly build an interface for editing basically any application state, which would be awesome!

>Certainly - let me grok your text!!... OK - I am ready!

BLAH BLAH BLAH...

etc

Have you explored this market segment?

> Less time spent taking notes == more time with patient.

This can be true in some cases, but from what I understand, industry wide it would end up more like:

Less time spent taking notes == more patients scheduled.

Which is still of value, but fails to solve the original point of a physician's frustration, and possibly makes it worse (assuming the physician is still the one generating, handling and verifying the notes, but with better efficiency).

Now I have:

    - vetrec.io
    - Abridge
    - Scribeberry
    - Scribematic
    - Notezap
    - Lytte
    - Deepscribe
    - FreedAI
    - s10 AI
    - Nable
    - DeepCura
    - DAX copilot
    - Suki
    - M*Modal
    - Amazon Healthscribe

    - Overnight Scribe
    - Rev.ai

It's less about how quickly all that transpires and more about presenting the product in a way that doesn't require a lot of talking around it. Well done.

My first thought, when reading the headline, was that this could be useful for my coworker that got RSI in both hands and codes using special commands to a mic. But after having watched it I think it can be much more than such a niche product.

I absolutely love the idea, as a fellow neurodivergent who works much better over voice than text. My only feedback is... I'd love to run this with more control. I already run LLMs locally (LM Studio), and I can run something like whisper too. I understand that open-sourcing (or even making the source code available) might go against any commercialization attempt. However, there are some options (Red Hat-esque) where it may be possible to charge for business use and allow local running for free for personal use.

On one hand you've got a solid first-mover advantage in a field where lots can benefit and use this, however if someone can bork together several layers of LLM output they might be able to offer competition (and such projects are often opensource, albeit sometimes less "polished".) If you offer a good deal you might have a good chance of major success. Best of luck!

My own use case is a bit different from many others who have commented here. I'm a reasonably fast typist and don't currently have any physical or neurological issues that might make typing difficult. I have tried voice input methods a number of times over the years, as I thought speaking would be faster than typing, but I always went back to typing due to accuracy problems and difficulty editing.

Aqua Voice does seem to be a significant advance. I'm going to try it out from time to time to see if I can get comfortable with voice input. If I can, I will subscribe.

I drafted this comment using Aqua Voice, but I ended up editing it quite a bit with a keyboard before posting.

I think the preference for voice versus typing is something that hits everyone differently, and I think as the reliability and speed improves, more and more people will find themselves using voice as a "tool in the toolbox," which aside from the occasional "Hey Siri, set a timer," isn't the case today.

This seems like it would be particularly good on a telephone or my watch. In those places it seems like a real game changer in terms of ability to take notes when the keyboard experience is less than awesome.

Have you tried using it to write code? This could be amazing as a IDE/text editor plugin.

It's nice to see someone do something that's not regrettable with AI. So many of the applications we see are horrible. What you've made is brilliant and very far from being just another cursed chocolate factory experience.

Three suggestions:

1. If I try the demo on the landing page, and then sign up, I wanted it to automatically have the contents from my demo usage on the landing page copied into my newly created account.

2. I would like another option than an auto renewing subscription. If I could have loaded 5$ or 10$ that my usage would deduct from, instead of having to subscribe, I would have paid money right then and there, but I didn’t because I have too many damn subscriptions (alternative is to offer a non auto renew $10 one month trial).

3. iOS app please :)

1. Good call on demo page, would be slick to sync that up with account. 2. Subscription exhaustion is a real thing — credits/usage based billing is an interesting 3. asap!

Excellent demo and great-looking product btw!

Also I really enjoyed your analysis

- it consistently uses word two instead of to

- forcing Google OAuth as the only way to sign up is not a good idea. That prevented me from signing up.

I use voice-to-text in the workshop and when taking notes and reviewing a PR. And all the current options are pretty much what you would expect. More focused on accuracy, which is usually quite poor, which, to paraphrase, "It's Erin with an E. Oh for **s sake, Erin. ERIN! E. R. I. N. <pause> N. I said N. Eh-rin. Fine. Whatever." so anything that can improve on that experience will be immensely helpful.

Looking forward to seeing where you go with this, and I hope at some point you make a native desktop application.

On pure WER we are state-of-the-art in our testing, but more importantly, mistakes in Aqua are correctable.

So you can speak your mind instead of having to wait until you have the perfect sentence and then dictate it.

That said, we know it's not perfect, but we know a few more months of work will have it really solid.

I would love to use this in healthcare for dictating patient letters etc. I guess a local model / HIPAA compliance is some way off?

So let's say I work in a quiet home office by myself. Could I just have Aqua open throughout the day and give it notes / to-dos without having to click the microphone on/off each time?

I was then able to go through my list very quickly and add times to each item.

The one failure I had was when I asked it to add whitespace to visually align the table columns.

The table was, however, converted back into a list when I asked it to turn the text into an email.

It's not exactly punching numbers into a spreadsheet, but it worked pretty well for the simple use case I tried.

That said, I would still think it's very doable to set reserved keywords to navigate it ourselves while keeping it conversational.

What does the actual app look like though? Is it only in a browser or can I use this anywhere on my Mac?

A difference in error rate from 20-something percent down to less than 5 percent sounds incredible.

[0] https://apps.apple.com/fr/app/aiko/id1672085276

(Personally, I would! Email me at matt@syntheticdreamlabs.com if you're interested in offering it as an API, I'd be pretty curious about pricing.)

Some Feature Requests:

- Please implement proper undo/redo history and allow us to use it with voice, GUI and keyboard.

- When I take over with keyboard, do not mess while I'm writing.

- When I start speaking, if the text cursor is in between words, I'd expect it to insert, not append. (if you want to avoid this from happening accidentally, after some idle time, you may move cursor to end of the text)

- A little advanced feature; It would be very nice to have some form of tagging for sentences and/or paragraphs with numbers, text or colors. So it would be easier to delete, reorganize, move around them by saying like "move the green section before purple one" or "part 12 should go before part 4", then we can let the language model to do it's magic and rephrase/reformat it a bit. Your AI probably smart enough to understand which sentence we are referring to by just hearing part of it, but as a user we may feel too lazy for that.

- Add a cheat-sheet for what's possible next to editor. Something more succinct than the notion doc.

- Allow pausing/resuming dictation with voice command.

Note: I would really like to be able to benefit from its smart features while I'm not sitting in front of my computer or holding my phone. But I'm not sure there will be a day when Apple let us interface with smarter AI agents like ChatGPT or Aqua Voice on iOS while the screen is locked. IMO, this is gatekeeping of an inferior feature (Siri) in the name of protecting my privacy. I hope some day EU will also intervene with that.

"Error: NotSupportedError: AudioContext.createMediaStreamSource: Connecting AudioNodes from AudioContexts with different sample-rate is currently not supported."

edit: I refreshed and then it did load with the blue mic button

I played writing an intro for some documentation I'm creating, and it was amazing. It felt very conversational, very different than traditional dictation software.

1. I have the same question as others, what's the privacy policy? Where is this being used? I'd like to expend for work but their first question is where the content is going.

2. And straying from focusing on core functionality, do you have a vision of a code specific version of this? Do you feel like a specialized model/tool is needed or do you believe this can take care of it.

Currently, I tried asking it to write out `def func():[newline]pass` and then correcting it but didn't get very far:

> "Just my funk. Oh no the word death try type the letters DEF FU. Okay, no let's stop."

Overall, great work!

2024 Bridge2A Voice Symposium | Voice as a Biomarker of Health

https://www.eventsquid.com/event.cfm?id=22807

The 2024 Voice AI Symposium will be a groundbreaking 2-day event and unique opportunity to connect with stakeholders invested in artificial intelligence and voice biomarkers. This year's symposium will serve as a nexus for dialogue, collaboration, awareness, and engagement across diverse sectors and members of the community about the use voice of artificial intelligence in healthcare. Attendees will experience dynamic speakers, panels, and networking opportunities. Innovative interactive events include a Call for Science with 3 submission categories, a Voice AI Tech Fair, and a patient challenge competition.

Words? Minutes? Number of edits? Eg

Free - try 10 minutes active editing a month, great for trying it out

Light use - 120 minutes a month, perfect for jotting down a few things daily

Pro - 600 minutes a month, write an entire essay by voice

Ultra - unlimited. Make voice editing your main workflow and work 10 times faster

How do you price based on value without a corollary to tokens? If you charged $40 for this service then maybe you don’t provide enough value for the casual user who does the occasional school report. On the other hand you may be unprofitable for the doctor that decides to dictate all of her interactions every day or the author who dictates an entire book.

A customer sees "word count", they understand what's going on perfectly, right away. Tokens? More than half of them will think "what, like, game tokens? do I have to buy them in advance?"

Generously, 10% of potential customers are going to have even an approximate idea of what a token means in this context, maybe 1% could tell you that words and tokens aren't quite the same thing.

Congrats!

The sandbox doesn't have typing, but the full app does - you can switch between typing and talking seamlessly there.

(written with Aqua)

I develop a very similar natural language voice interaction tool using the OpenAI API and Talon as the engine[0]. (i.e you apply any voice command transformation with AI on any text, or use it alongside Cursorless for semantically targeting scopes in the AST) You can use my solution with offline LLM models too.

If you are interested in chatting, please reach out[1], as I am very interested and experienced in this space.

[0] https://github.com/c-loftus/talon-ai-tools

[1] https://colton.bio/contact/

Do I have to use a specific Aqua Voice text editor, or can I use it in apps like JetBrains Rider and Visual Studio Code? If so, are there some kind of plugins that would allow using IDE-specific features? (e.g. "build and run the API project")

I wish there was a clear way of sending you feedback though, there are some details that annoy me a lot.

I'm transcribing some recorded sound, and after I have had it transcribed and I am editing it, every time I tab away from the browser the cursor position gets lost. The focus on the textarea is also lost, and when I click it, it doesn't insert the cursor where I click but at the start of the document so I even loose my scroll position.

As a paying customer I'd hope to have a way to give you this kind of feedback. It should be fairly easy to make this a much better experience.

Really cool product all in all though! I don't often subscribe to stuff.

Also latency seems to be a bit slow, wish it was faster, maybe thats due to traffic now

NO NOTES.

This is the sort of the thing that I forward to people who are skeptical about the disruptive capacity AI has, to take long-standing seemingly intractable problems, and "solve" them.

Hats off. Truly inspiring in many senses!

When I was a kid I saw tech as a really aspirational thing (jobs, iPod, touch screens, Skyrim). What can be done with modern GPUs and transformers is making me feel like that again.

Their lead times are long so I’d start establishing trials now, partner with a university on agreement of a discount and use them to develop the software.

Once you’ve got a few uni’s onboard, you can rapidly expand and they are very unlikely to churn as you’re serving such an important niche.

I know a very similar product that has had huge success doing this.

This is definitely worth looking into. We don't want to slow down the pace of development, but this might be a case where the partnership makes too much sense.

A huge portion of what goes on in universities is writing.

edit: Reading this back, I thought I sounded too eager to partner with universities. We're a tech company, and quality and performance will always come first.

But go-to-market, after the initial delay, uni's will drive sales fast at scale.

A few things to try to maximize your accuracy right now are:

- Don't use AirPods, especially not AirPods Pro. Most built-in laptop mics or EarPods or a gaming headset are perfect. It doesn't need to be podcast quality.

- Correct transcription mistakes as you would a person, then "plow through" and often the error will be corrected as you complete the sentence.

I don't even have that strong an accent, and I always try my best to enunciate correctly when talking to others shrug

How's the dictation accuracy compare to Talons latest model, or Microsoft's new voice access? Or dragon? You've got a few comparisons already but nothing that I actually use.

What's the latency like?

At least for me a general voice editor isn't useful, give me something that can send text to wherever my mouse is pointing and that's useful. Then make sure it works with Microsoft's voice without borders, synergy, barrier, input director etc.

Oh and does it support a user dictionary?

On accuracy, we benchmark very well against even large async models, with a WER of .05-.06 and when Aqua does make a mistake you can often correct it by just telling it "no it's our side not outside" and it won't mangle the text.

Jiminy Crickets...

I have SOOO many use cases for your thing.

[edit: what does this mean: https://i.imgur.com/rHQt6ul.png when attempting to demo?]

---

* I want an agent that I can speak to on Mobile headset as I love to think out loud - and air my thoughts and thought process through talking through my internal dialogue - if this could just capture what I am saying and log it and I can refine thoughts as I go.

For example - I ride a lot. I try to cycle 1000 miles a month if I am doing a solid month - but else - I ride daily and its a movement meditation. as I ride - I think through things and I speak through thought processes with differing opposing 'experts' in my internal monologue to self-argue through to a solution....

If I could have this record all that, then random epipehnies I think through while on ride will be captured in a meaningful way.

---

* A meeting-notes-transcriber for whiteboard sessions.

* record everything you say in an interview and be able to review after for self-coaching

* talking through a dish as you wing the ingredients so that you speak out loud what you did (my grandmother was friends with Julia Child - my grandmother taught me to cook and when it came to measurements of things - they always wing it per feel/taste "salt to taste" for example means "eh... whatever"

so to be able to talk through what your 'winging it with' and it captures it into a salient reproducible recipe (i make a mean Chimi Churry (sometimes if I can recall)

* a voice "body cam" for things I may say in situations where I may be too flustered to recall.

* Speak authoring - start telling a story outline so it captures a synopsis that you can further develop

* Speech (like giving a speech) refinement as you can talk through the speech and capture and rework and reiterate etc

and thats just off the top of my head through your demo....

LOVE this.

Sorry about the error you are getting! It's a Firefox thing. We will patch. In the meantime, Chrome/Safari will work

I just want to qualify - you did not inspire these ideas.

These are desires sought which have been there for eons...

You are not inspiring them

You have atool that ENABLES them.

Seek that which already is a flustered pop of ideas waiting for a release valve for such thought.

You are not inspiring - you are enabling that which is already there, think of it as which valve to open - the pressure is mounting upon your dyke.

I wish Siri, Alexa, et al would do this as well. They seem to expect you to speak perfectly the first time.

(we'll also fix the support button)

Are you targeting developers?

My understanding was people who are serious about developing via voice use it pretty exclusively.

Like, yeah you need to learn commands, but "are often not worth it" feels like brushing a pretty massive offering under the rug.

Is learning vi / emacs commands not worth it (or shortcuts in another IDE?)

Is there a middle ground?

Our approach is based around understanding intent from speech alone. We think this will be the ideal division of labor between man and machine going forward - let the person think and the machine fit it into the document/file/text. Over time we think this will reduce the number of commands you have to learn to use it to zero.

But our "command-less" approach isn't reliable for every use case yet - and as a fan of voice interfaces I am rooting for Cursorless - it's super sci-fi.

On another note, I think once you leave school dyslexia can become a wash or even a net positive in the right setting. I think whatever the brain config is can be a huge unlock for creative thinking - it's not always super helpful in the school context, but can be really asymmetric in tech and probably other industries.

Absolutely amazing product by the way! The 1000 free tokens is enough, the fact that people are complaining about running out too soon is good, it shows that they like the product and want to use it more. They do have a point about adding a rough word count, maybe just a subheading that says "on average, X spoken words".

I understand why you have to retain the voice data, however, is there any way you can implement an opt-out feature?

I’m just not comfortable with my voice data lingering in some servers, ready to be used for training ml models.

It would be handy to be able to select various formats and have it know to keep to that format.

Also I really liked it but found it quite slow. Assuming that will improve over time.

also good point on memory. this turns out to be relevant in a lot of cases!

I am really looking forward to the day when dictation like this can be done locally on our phones. I'd really like to do a lot of my basic messaging with my voice but the need to do corrections with that tiny keyboard means it's not much of a time saver.

I noticed a correction that was done retroactively in the demo

'make that H100 GPUs'

and noticed that there was only one instance of the token GPU. Hence the correction was seamless. Had there been a couple more instances I guess all GPU tokens would have been replaced by H100 GPUs. I guess you could say make that NVIDIA H100 GPUs that would be more accurate but if there were multiple instances and you needed the change only in one instance, not sure how that'd fly. I am nitpicking but this could be a common theme.

The fact this can retroactively change the text and also understand a command is quite brilliant. I don't see any trigger word for a command, so wondering if I needed the command as part of actual text, how would that work ?

In the example below I asked it to "make it H100 GPUs" and it only modified the GPU in the list.

Aqua isn't perfect though, and while I think we are mostly solving this case there are plently where we need to do better.

---

Hey Team,

I just had a chat with the marketing people, and they confirmed we should buy enough GPUs to meet the demand.

Our Equipment List:

- 1,000 H100 GPUs

- 1,000 processors

- 500 NVME SSDs

- 200 standard racks

edit: formatting

More input modalities are IMO always better, and being able to switch to this in the future when your fingers get tired would be awesome, my key painpoint from the demo is the speed, but I'm sure that will go up as models and inference speed gets better.

One awesome thing would be to integrate the contextual understanding with a programming copilot, so you can pair program with only your voice as input.

Rooting for you guys!

I think we will be in a much better place speed-wise in a few months; some of that will be our stack, and some of that is what is happening lower down in the stack, but it will be meaningfully faster and more responsive soon.

Do you have any idea of how soon? Not looking for a public commitment to hang you with, just wondering if this is one of those "we're working on it now" (so days) or one of those "it's in the backlog" (months or maybe never depending on priorities).

Will this work for programming languages? I often would like to type code by talking and especially, to talk into AI coding tools that help you complete code.

Will this allow me to add links to text based on context? Like "Go to <mysite>/blog and link to the article on Voice AI" - I do this quite a lot in my article writing.

Will this work over the sound of me cooking a loud fry up?

Take all 3 and I may never leave the kitchen again.

When will we PC peeps get to use it?

any chance of getting this as native apps on mobile? or better yet like global macos utility like dictation so you can "type" in any apps?

I'm think I'm having trouble getting it to edit the existing text when writing though? https://i.imgur.com/IfoWvMG.png

One thing you can try if Aqua doesn't seem to be "getting" what you're after is to say something like "make this the email," or "transform this into the email I want to write." Sometimes it needs an extra push.

Video talks about a Mac App. Where can I get that?

Voice input did not work on Edge browser on Windows, btw.

We had to make a bunch of breaking API changes over the last week and the Mac app isn't ready to go on it quite yet, but we'll bring it back as soon as we can, max two weeks, hopefully sooner.

The fusion model is similar to the architecture described here: https://arxiv.org/abs/2310.13289

Minor friendly heads up, the withaqua.com link in the description of your youtube video is currently not a link.

I was impressed with the live demo on the app's homepage.

I subscribed.

But it is so slow and the actual app was clunky and refused to enter much of the dictated text that I gave it (even though it seemed to be recognizing what I said): the words appeared on the screen, then they disappeared.

I had both the speed problem and the recognition problem on both of the latest versions of Firefox and Safari, even though my connection is ~ 620 Mbps up and down.

I canceled my subscription within about 10 minutes.

Oh, I should also add the following feedback:

* The homepage promises that your subscription will include support, but even when you're subscribed, the support button is greyed out.

* There is no way to manually enter or edit the titles of your documents.

I'm disappointed, because I was very excited about this.

Worth a watch.

NotSupportedError:

AudioContext.createMediaStreamSource:

Connecting AudioNodes from AudioContexts with different sample-rate is currently not supported.

I would add that this really needs to be a native app with ability to use it within Microsoft Word, which itself has a decent voice to text tool built in.

As a side benefit, you get real estate in people’s docks and desktops :)

The way Google's keyboard works on Android, but on my Linux computer (and my Android phone) would be my dream here. I'd pay $10 a month for that for sure.

1. This is an amazing idea!

2. I love that it is browser-based so can work everywhere. Native app would let you integrate more tightly (such as becoming a "keyboard" on the system), but that probably means "a mac app" which doesn't do me any good on Linux. If you could keep the bulk of it in cross-platform tech and just do the small integration part with native code, I think supporting at least "the big three" is doable. I bet if you provided a good API, somebody in the open source world would even do the work for you, on Linux at least.

3. Would really prefer being able to sign up with my email, and not having to log in with a third party account.

4. Online-only access is definitely fine for now, but to stay competitive in the future I would keep an eye toward being able to run inference locally so you don't have to be online to use it. This would also be a way for you to reduce costs and offer a cheaper version. If I were you, my long-term goal would be for this to be used by everybody (though that's years down the road). Local inference does complicate monetization, but that can be figured out.

5. For me to really use this enough to pay out every month, it needs to be relatively easy for me to get the output into whatever app I'm using, whether that is Chrome, Slack, Gmail, Google Docs, Vim, Gedit, or anything else. This is undoubtedly related to item 2 above, but I figured it warranted it's own mention as there may be solutions besides browser-based vs. native.

6. You're gonna have competitors hot on your heels, if they aren't already. Google in particular with GBoard on Android could be absolutely killer. Since it is Android-only, I don't think it's a major competitor now, but if they broadened it absolutely could be.

7. Do you have an exit strategy in mind already? Would you be willing to share anything on that? (I ask because it's relevant because your product could easily become part of my standard workflow, and I'm very conservative about becoming dependent on proprietary products, especially from startups). Please do not go native-only and only release a Mac app. At a minimum, please maintain the web-based version. And please for the love of all that is holy, don't sell to/get acquired by Apple! I want and need your product, and I don't and won't switch platforms (Fedora Linux currently) to get it.

Really amazing idea and great work! It is rare that I see products that I think could actually "change the world" but this one has some potential by changing the way we interact with our computers!

I had a brush with RSI some years ago. I’m good now with an ergonomic keyboard and better habits (water, exercise) but it brings me great comfort knowing something like this exists. Thank you!

Since these commands are self created by the end user they remember them for their specific purposes. These often are high frequency of use commands where low use would still leverage large language model. You have an opportunity here to leverage this workflow. Being able to create commands with large language model is not something many projects have explored.

I work with people with disabilities and iot. If the project is open open source I would love to get in touch.

Back to your question, That largely depends on what kind of interface is being used. Is there a screen or only conveying information text to speech. Users aren't going you want to keep track of their customized commands through just a voice interface.

An example: alias command.

Terminology: Utterance (a series of words) Action (programic action to do something)

1. (Previous utterances)(Some actions)

2. Alias (new utterance)

3. A new command is created by voice to do some action in step 1 with the new to utterance in step 2.

The new command encapsulates both the context of a command (command availability) if there is one and the command itself. Think of it as a voice macro. The essentially it allow you to complete a series of complex tasks in series with a small voice command.

Alternatively the alias command without an utterance could trigger a GUI could pop up showing the history of the last commands where a user can select by voice or touch.

This could work for both LM or Commands. Commands would take priority before the LM for recognition.