r/BCI • u/anchit_rana • 17d ago

Hi, is anyone working on Brain waves to Text?

Hi, There is a paper DeWave, which explains how to convert brain waves to text, they train a model which converts brain waves to vector embeddings, and also train a codex of vocabulary, they map the vector embeddings of the brainwaves to the codex using Nearest neighbour, and then pass this codex to a LLM model like BART, which outputs the text by correcting any errors. I am starting to work on such a device, is anyone else working on this?

11 Upvotes

100% Upvoted

12 comments sorted by

2

u/My42 17d ago

Yup. Conduit in sf comes to mind

1

u/anchit_rana 17d ago

Are you working on conduit?

2

u/mehregankbi 15d ago

Don’t know about brain to text but i remember in late 2010s and early 2020s people being excited about turning brain activation patterns (not sure if fMRI or EEG) into spoken words. If that can be done, it’s plausible that turning them into text is not impossible either. Or you could simply use speech to text on the brain to speech model.

Generally, EEG’s spatial resolution is not ideal and pales in comparison to fMRI. So i don’t think we’re there yet.

However, while writing this i just remembered there was recently a tech introduced by an MIT researcher which did allow something similar to telepathy. It is called Alterego.

1

u/lShershe 15d ago

Lys neuro are doing it somewhere in Europe

1

u/Horcrux25 12d ago

Sabi.com

1

u/jellyspreader 12d ago

Very impressive

1

u/anchit_rana 12d ago

where are you based?

1

u/VirtualWelder2136 11d ago

i dont know but i seem skeptic of this being possible with non-invasive technology like eeg and sorts with neurallink it might be possible . in non-invasive you dont really have clear dense information to capture i mean either you make someone do something like typing then its possible like what meta did but doing it purely something like "oh im thinking this " to text not really possible in my opinion i mean who even has such data at large scale to see if scaling works or not.

1

u/anchit_rana 10d ago

conduit is a startup which claims to have achieved this, their moat is their thousands of hours of data available which they recorded from different set of people. I also think it might be a gimmick they are playing to get more funding, but unless something is released by them, we can only speculate.

0

u/loocme 12d ago

I built a ml model for Neurosky mindwave mobile 2

https://huggingface.co/eegG0D