Vision Sensing and Vocal Recognition!!

panther__

These would be SO helpful for programming.
Please consider!!!

-Thanks

DaEpikDude

Well, could you explain a bit on how they'd work?

And all the world over, each nation's the same,
They've simply no notion of playing the game.
They argue with umpires, they cheer when they've won,
And they practice beforehand, which ruins the fun!

panther__

for vision sensing you could have a block like:

<seeing [ face] ?>

and

go to [ face]

(you could replace face with something like: hand, eyes, mouth, nose, just something like that)

and the same thing for vocal recognition.

These blocks would just sense what you want through the camera.
vision sensing would be used for things like Xbox kinect
and vocal recognition like siri

hope this helps!

DaEpikDude

panther__ wrote:
for vision sensing you could have a block like:
<seeing [face v] ?::sensing>
and
go to [face v]
(you could replace face with something like: hand, eyes, mouth, nose, just something like that)

and the same thing for vocal recognition.

These blocks would just sense what you want through the camera.
vision sensing would be used for things like Xbox kinect
and vocal recognition like siri

hope this helps!

Ehhhhh… I can't think of enough uses for these blocks: they both seem really, REALLY specific. Also, how would Scratch detect if it's looking at a face, an arm etc.?
Side note: for the Kinect thing, isn't that what the “video motion on this sprite” is for?
double side note: i fixed your blocks

And all the world over, each nation's the same,
They've simply no notion of playing the game.
They argue with umpires, they cheer when they've won,
And they practice beforehand, which ruins the fun!

-ShadowOfTheFuture-

Facial recognition would require pretty complex artificial intelligence…

██       ██  ██            ██  ██       ██
██       ██  ██            ██  ██       ██
██       ██  ██     ██     ██  ██       ██
██       ██  ██     ██     ██  ██       ██
███     ███   ██   ████   ██   ███     ███
 █████████     █████  █████     █████████

“Though the seasons come and go, and sunshine turns to snow, we will always have tomorrow up ahead.”

cul8er

-ShadowOfTheFuture- wrote:
Facial recognition would require pretty complex artificial intelligence…

…and we haven't even begun to consider privacy concerns.

Gone.

Charles12310

This requires lots of more technology, including detection and a million scripts to find a single thing.

Also:

cul8er wrote:
-ShadowOfTheFuture- wrote:
Facial recognition would require pretty complex artificial intelligence…
…and we haven't even begun to consider privacy concerns.

You might be recorded…

A few internet communication companies want to corrupt the internet by getting rid of net neutrality. Stop Them!

pizzaloverkid

panther__ wrote:
for vision sensing you could have a block like:
<seeing [ face] ?>
and
go to [ face]
(you could replace face with something like: hand, eyes, mouth, nose, just something like that)

and the same thing for vocal recognition.

These blocks would just sense what you want through the camera.
vision sensing would be used for things like Xbox kinect
and vocal recognition like siri

hope this helps!

I like the Idea!

pizzaloverkid

panther__ wrote:
for vision sensing you could have a block like:
<seeing [ face] ?>
and
go to [ face]
(you could replace face with something like: hand, eyes, mouth, nose, just something like that)

and the same thing for vocal recognition.

These blocks would just sense what you want through the camera.
vision sensing would be used for things like Xbox kinect
and vocal recognition like siri

hope this helps!

https://champierre.github.io/scratch3/ Do it on Google Chrome!
I tried it, it worked!!! Posenet2Scratch Speech2Scratch

Last edited by pizzaloverkid (April 25, 2020 06:39:02)

panther__

pizzaloverkid wrote:
panther__ wrote:
for vision sensing you could have a block like:
<seeing [ face] ?>
and
go to [ face]
(you could replace face with something like: hand, eyes, mouth, nose, just something like that)

and the same thing for vocal recognition.

These blocks would just sense what you want through the camera.
vision sensing would be used for things like Xbox kinect
and vocal recognition like siri

hope this helps!
https://champierre.github.io/scratch3/ Do it on Google Chrome!
I tried it, it worked!!! Posenet2Scratch Speech2Scratch

Yes that is exactly what I want!

pizzaloverkid

panther__ wrote:
pizzaloverkid wrote:
panther__ wrote:
for vision sensing you could have a block like:
<seeing [ face] ?>
and
go to [ face]
(you could replace face with something like: hand, eyes, mouth, nose, just something like that)

and the same thing for vocal recognition.

These blocks would just sense what you want through the camera.
vision sensing would be used for things like Xbox kinect
and vocal recognition like siri

hope this helps!
https://champierre.github.io/scratch3/ Do it on Google Chrome!
I tried it, it worked!!! Posenet2Scratch Speech2Scratch
Yes that is exactly what I want!

DID YOU TRY IT?!

Nambaseking01

pizzaloverkid wrote:
DID YOU TRY IT?!

Hi, please don't speak in all caps on the forums. It makes it easier to read for everyone.

—

Well, video sensing technically exists. I think vocal recognition wasn't added because Amazon Web Services had it but apparently it couldn't be trusted..?

I don't know, I'm trash with anything related to Amazon.

Hey there! My name is Nammy. I'm a male Forum Helper and Scratch Wiki Editor.
Profile | Test Account | Talk with me here! | Griffpatch is quitting Scratch?!

pizzaloverkid

Nambaseking01 wrote:
pizzaloverkid wrote:
DID YOU TRY IT?!

Hi, please don't speak in all caps on the forums. It makes it easier to read for everyone.

—

Well, video sensing technically exists. I think vocal recognition wasn't added because Amazon Web Services had it but apparently it couldn't be trusted..?

I don't know, I'm trash with anything related to Amazon.

Ok…

StevenTheSquare

I feel like this might not be safe. Combined with cloud variables, scratchers could like, make projects that see people's faces and recreate them and use it to look at people without their permission…

Please support this suggestion for layer sensing blocks!

<<behind [sprite1 v]? :: sensing> and (layer :: looks)>

Please support this suggestion for the ability to replace bio space with projects!
Please support this suggestion for the ability to customize studio permissions!
“You're entirely bonkers. But I'll tell you a secret; all the best people are.”
Need help with anything? You can totally ask me!

stay awesome :: #FF1493

panther__

StevenTheSquare wrote:
I feel like this might not be safe. Combined with cloud variables, scratchers could like, make projects that see people's faces and recreate them and use it to look at people without their permission…

I don't think this could happen, because there is no way to sense the color of an object and store that number, so all you would be able to do is see the person's face proportions. (the xy coordinates, not the color and exact shape of the object)

panther__

It's not camera detection, but it's a step. I just put together a number detector which detects what number you write down in the box
https://scratch.mit.edu/projects/402223903/

finn55

Facial detection isn't very complex, but it is hard to use scratch to detect colors,

so I would suggest using something like canvasjs.com or processing.com

Oh hello there.

I' am not so much active niow.

kumquats have retreated.

panther__

Here's a “simple”

facial recognition program I made:
https://scratch.mit.edu/projects/402545703/
change the lock image (top left) and tell it yes when it prompts, then try signing in with the sign in button (top right) try to trick it with other images. Please give feedback on if you were able to trick it

-CloudGate-

I made a video camera, that can take a video!!!

box of Asian citrus psyllids and please give me an internet here

notgoodatc0de

Before we begin to consider whether or not it's possible, you have to address privacy concerns.Think about how easily you could be recorded using this, no support for that reason and many others.

Edit: Didn't realize how old this topic was. Sorry.

Last edited by notgoodatc0de (Sept. 16, 2020 23:14:49)

IT'S SPOOKTOBER AND YOU KNOW WHAT THAT MEANS. YUP, I CAN SCARE KIDS WITH STORIES IN THE DARK AND NOT GET IN TROUBLE, HURRAH

select this, and tap control + shift and scroll down to see the rest of my siggy!

Yep, that's me. Notgodatc0de. Certified weirdo. Weeb. Potterhead. Demigod. Tribute. Scratcher. I'm a lot of things.
Anything I say that offended you was either on purpose or an accident. If it's the latter, I apologize. But if I it was on purpose, I'm probably not sorry ;D

hmm? whatcha' doing here kiddo?

don't you understand? My siggy is finished!

finished I say! There's nothing down here except lint

Did I st-st-stutter!!? DON'T GO ANY FURTHER!

WAiT, thIS Is ILLegAl, SToP

S. T. A. H. P!!!!!!!!! (｀0´)

Please! stop ;-;

fine

don't say I didn't warn you

you naughty person, how dare you? might as well take a super-secret message if your gonna break the law “spoopy scary skeletons” B)

Discuss Scratch