Neural Intent Lab · Benchmark 02
Reading imagined hand movements from real EEG
20 people. 20 models. One reality check.
What is actually happening?
We are testing whether recorded EEG can identify one of two imagined movements.
A person was shown either “left hand” or “right hand,” imagined that movement, and an EEG cap recorded the electrical activity across their scalp.
We use public EEG recordings from 20 people. Each recording already has the correct left/right answer attached.
We train a separate model for each person using 30 labeled examples. Their model is not shared with other people.
The model receives 15 new examples from a different recording session without seeing their labels.
We compare its left/right guesses with the hidden answers. It got 169 of 300 correct: 56.3%.
Mean participant accuracy
56.3%Only 6.3 percentage points above a two-class coin flip.
The larger test changed the conclusion.
Each person received a separate model trained on runs 4 and 8. Run 12 stayed untouched until evaluation. The pooled result was 169 correct predictions from 300 trials.
The model made 105 wrong predictions at 80% confidence or higher. Confidence cannot rescue this pipeline.
Participant distribution
Performance varies dramatically by person
Replay-first live pipeline
Watch held-out EEG become an intent token
The local app streams run 12 one EEG window at a time through the personalized model, emits a confidence-gated CONFIRM or CANCEL event, and reveals the hidden label afterward. Its second tab still accepts compatible EEGMMIDB EDF files. Everything stays on this computer.
research\eeg\run_predictor.batRecorded source now. The same EEGWindow boundary accepts a future headset adapter.
Inspect Subject 1
Held-out result viewer
This web viewer reveals the recorded predictions from Subject 1's untouched run 12. Use the local EDF predictor above for actual file inference.