2022 SECD Research Roundup - Augmentative & Alternative Communication Translation Lab
The Augmentative and Alternative Communication Translation (AACT) Lab focuses on the development and implementation of AAC devices for adults and children with severe physical impairments. In this video, Austin Spoor, a graduate research assistant in the lab, discusses two of the current studies using brain-computer interface technology – one for children and one for adults.
icon search Searchable Transcript
Toggle between list and paragraph view.
[00:00:00.250]So, this right here,
[00:00:02.002]this display we have is for our
[00:00:04.045]um, the study we do with kids.
[00:00:06.172]So, we have a array of six objects on the screen,
[00:00:10.135]and we'll tell them
[00:00:11.553]that there's going to be one they're looking for.
[00:00:15.265]And so, in this case, it's going to be that lamp.
[00:00:18.518]And we'll show it to them
[00:00:21.855]So we'll say, "That
[00:00:22.772]cord's going to pull down and the light's going to come out."
[00:00:27.318]And then they're watching
[00:00:29.154]as all the objects are moving
[00:00:30.822]just for that lamp
[00:00:33.533]And we tell them, "Every time that lamp
[00:00:35.869]does that, you get excited, you count in your head."
[00:00:39.456]And so you'll
[00:00:40.915]see it move like six times
[00:00:42.500]throughout this little trial,
[00:00:44.002]um, and then it goes to just a rest screen
[00:00:46.588]and we have, like,
[00:00:47.464]little cats and dogs or giraffes and whatnot.
[00:00:51.092]And then let them relax,
[00:00:52.677]get their wiggles out because
[00:00:55.180]muscle movement interferes with um
[00:00:58.516]It kind of gets in the way of
[00:00:59.726]of seeing those brain waves
[00:01:01.102]because they're both electrical but the muscles are
[00:01:03.188]a little stronger,
[00:01:04.105]in terms of what we pick up.
[00:01:05.607]And then we just go to the next one.
[00:01:07.025]And we say, "This time the phone's going to ring.
[00:01:09.527]It's going to look just like that.
[00:01:10.987]It's going to ring."
[00:01:13.281]And then we'll start it.
[00:01:15.366]And it'll go through again.
[00:01:16.868]Everything will move and they pay attention to the phone.
[00:01:19.454]And then we'll do the same thing again.
[00:01:21.164]But this time, instead of it moving,
[00:01:24.167]it's just going to be highlighted.
[00:01:26.711]And I can show you that.
[00:01:34.928]So, this time,
[00:01:35.678]you're looking for the telephone again,
[00:01:37.430]but it's just going to have that green line around it.
[00:01:40.225]So, just watch
[00:01:41.518]and everything else is going to be highlighting,
[00:01:43.770]but you just pay attention to the telephone.
[00:01:46.523]Every time it highlights,
[00:01:48.108]count in your head, get excited, that type of thing.
[00:01:52.195]And then that'll go through.
[00:01:53.571]They'll get another rest period.
[00:01:55.115]And we'll go through
[00:01:56.783]until there's been six runs
[00:02:01.538]look for the phone,
[00:02:02.330]and then the next run they'll be looking for maybe the dog,
[00:02:04.707]and it's all randomized.
[00:02:05.959]And then they just get to look at their screen with
[00:02:08.002]giraffes and cats and
[00:02:09.629]um, get ready for the next one.
[00:02:11.506]For the adult study,
[00:02:13.216]um so the
[00:02:14.592]participant is sitting here with the cap on their head,
[00:02:17.387]and for the calibration,
[00:02:19.347]it'll go through each letter
[00:02:21.266]and it'll flash
[00:02:22.809]um every single row 10 times
[00:02:25.270]and every single column 10 times.
[00:02:27.856]And it'll tell them what letter they're looking at.
[00:02:30.108]So, it starts with the letter Q.
[00:02:32.610]And it'll go through all the flashes.
[00:02:35.029]And then once that's done,
[00:02:36.865]it's going to move on to the letter U.
[00:02:39.617]And so, then the participant
[00:02:41.619]just looks for the letter U
[00:02:43.872]and they find it right there.
[00:02:45.957]And then they're sitting here looking.
[00:02:48.835]And now it's ready for the letter U.
[00:02:51.254]And then every time
[00:02:52.297]either a row or a column of those Einstein heads flashes,
[00:02:56.384]they're supposed to
[00:02:57.719]get excited, count in their head.
[00:02:59.679]Um, and try to count
[00:03:01.890]every time that happens and then that
[00:03:04.017]is supposed to make that P300 wave in their mind,
[00:03:07.395]um, which gets picked up by the cap
[00:03:09.647]and we record it.
[00:03:11.232]And then we go through and
[00:03:13.318]analyze all the data
[00:03:14.777]to see, um,
[00:03:16.863]specifically how their brain is responding
[00:03:19.157]when they're looking for the letter U.
[00:03:21.242]And every time the U flashes
[00:03:23.036]and the brain kind of correlates those two it says
[00:03:25.997]we know they're looking for the letter U
[00:03:27.874]because this is the calibration.
[00:03:29.959]So, every time
[00:03:31.419]that we flash the U, what is their brain doing
[00:03:33.963]in terms of this P300 wave?
[00:03:36.549]Um, and then it goes through all of that
[00:03:38.801]and then we will do
[00:03:40.261]uh, a couple more tests
[00:03:43.973]they have a list of words
[00:03:45.808]that they're spelling.
[00:03:46.726]And then we'll do a test where
[00:03:49.103]we just ask them a question
[00:03:50.396]and they respond
[00:03:52.649]So, we say, like,
[00:03:54.525]"What are you doing after dinner tonight?"
[00:03:56.903]And they'll just write on there like,
[00:03:58.154]"I'm watching the news." or something.
[00:04:00.323]And so then that way they actually get to see
[00:04:03.034]it come to life.
[00:04:03.785]And that's usually when they get kind of excited.
[00:04:05.453]It's like, "Oh!
[00:04:06.537]I can actually communicate with this.
[00:04:08.164]It's not just
[00:04:09.540]I'm saying what the computer tells me to say."
[00:04:12.377]Um, and so we'll get
[00:04:13.878]20 letters from that.
[00:04:15.380]And then they're done.
Log in to post comments