Discuss Scratch

jishiha
Scratcher
50 posts

Pose detection extension

I made a custom extension that you can detect the pose of single/multiple people in realtime and get rather accurate positions of 17 parts of the body. Using this extension, you can create a funny project like this:



The capture uses Japanese blocks, but you can use English/Chinese blocks as well.

To use this, open Video Motion extension and PoseNet2Scratch extension on the following customized Scratch 3.

https://champierre.github.io/scratch3/

A manual is available at:

https://github.com/champierre/posenet2scratch

Last edited by jishiha (Aug. 6, 2019 02:05:14)

lunaraemaemae
Scratcher
50 posts

Pose detection extension

seems cool for a dress up game!
say [whaaaaaaaaaaat?]

(^_^)   
this is my kumquat killer.STRIKE THAT DEMON DOWN PAPYRUS!!!!
ottobun
Scratcher
49 posts

Pose detection extension

that sound cool!



click here to play scratch on scratch
Cool--Scratcher
Scratcher
100+ posts

Pose detection extension

Amazing!


█▀▀ █▀█ █▀█ █░░ ▄▄ ▄▄ █▀ █▀▀ █▀█ ▄▀█ ▀█▀ █▀▀ █░█ █▀▀ █▀█
█▄▄ █▄█ █▄█ █▄▄ ░░ ░░ ▄█ █▄▄ █▀▄ █▀█ ░█░ █▄▄ █▀█ ██▄ █▀▄

ᴇxᴘᴇʀɪᴇɴᴄᴇᴅ - 8 ʏᴇᴀʀꜱ! ᴍɪɴᴇᴄʀᴀꜰᴛ! ꜱᴄʀᴀᴛᴄʜ! ʜᴛᴍʟ, ᴄꜱꜱ (kind of)

15 years old // he/him // forumer // video producer // video maker for a certain browser extension

Any questions? Drop by my profile; I'll be happy to help!

stop necroposting i beg you
mopdxteacher
Scratcher
5 posts

Pose detection extension

This is cool, but if we can't use it in “normal” Scratch 3, how is this useful?
jishiha
Scratcher
50 posts

Pose detection extension

mopdxteacher wrote:

This is cool, but if we can't use it in “normal” Scratch 3, how is this useful?

The source code is open, so anyone can add it to their own customized version of Scratch. I see some Scratch mods such as https://stretch3.github.io/ and https://adacraft.org/ includes PoseNet2Scratch in their own extensions. I am not sure the Scratch team saw it and got influence, but recently they released Face sensing block in Scratch Lab(https://lab.scratch.mit.edu/face/), which is very similar to PoseNet2Scratch.
Barthdry
Scratcher
500+ posts

Pose detection extension

jishiha wrote:

mopdxteacher wrote:

This is cool, but if we can't use it in “normal” Scratch 3, how is this useful?

The source code is open, so anyone can add it to their own customized version of Scratch. I see some Scratch mods such as https://stretch3.github.io/ and https://adacraft.org/ includes PoseNet2Scratch in their own extensions. I am not sure the Scratch team saw it and got influence, but recently they released Face sensing block in Scratch Lab(https://lab.scratch.mit.edu/face/), which is very similar to PoseNet2Scratch.
Yes True i think scratch face sensing in scratch labs is becoming similiar to this. Also where is your mod now some japanese text was there

Last edited by Barthdry (April 13, 2021 09:27:00)

jishiha
Scratcher
50 posts

Pose detection extension

Barthdry wrote:

jishiha wrote:

mopdxteacher wrote:

This is cool, but if we can't use it in “normal” Scratch 3, how is this useful?

The source code is open, so anyone can add it to their own customized version of Scratch. I see some Scratch mods such as https://stretch3.github.io/ and https://adacraft.org/ includes PoseNet2Scratch in their own extensions. I am not sure the Scratch team saw it and got influence, but recently they released Face sensing block in Scratch Lab(https://lab.scratch.mit.edu/face/), which is very similar to PoseNet2Scratch.
Yes True i think scratch face sensing in scratch labs is becoming similiar to this. Also where is your mod now some japanese text was there


Actually https://stretch3.github.io/ is my mod and includes Posenet2Scratch and other extensions developed by other developers.
Barthdry
Scratcher
500+ posts

Pose detection extension

jishiha wrote:

Barthdry wrote:

jishiha wrote:

mopdxteacher wrote:

This is cool, but if we can't use it in “normal” Scratch 3, how is this useful?

The source code is open, so anyone can add it to their own customized version of Scratch. I see some Scratch mods such as https://stretch3.github.io/ and https://adacraft.org/ includes PoseNet2Scratch in their own extensions. I am not sure the Scratch team saw it and got influence, but recently they released Face sensing block in Scratch Lab(https://lab.scratch.mit.edu/face/), which is very similar to PoseNet2Scratch.
Yes True i think scratch face sensing in scratch labs is becoming similiar to this. Also where is your mod now some japanese text was there


Actually https://stretch3.github.io/ is my mod and includes Posenet2Scratch and other extensions developed by other developers.
I think stretch3 is the 2nd best modification after Eyangique because it has a lot of features. But missing features is Choosing an extension from URL and also the Change Size.
Mrcakeyman89
Scratcher
1000+ posts

Pose detection extension

Oh hey wow your idea was actually made in scratch lab!

My siggy was made in the Water Otters 2.0 and Feathered Finds!

Shop I Own - |^| - Shop I Work At - |^| - Shop I Work At -|^|- Shop Contest -|^|- My Profile - |^| - Latest Project

Road to 2000 Posts! - 1000 I I I I I I I I I I 2000
70% of the Way!


^ It's cute - Click on it ^


Scratch On!
cwkmichael25045
Scratcher
6 posts

Pose detection extension

its laggy
xanmander02
Scratcher
2 posts

Pose detection extension

jishiha wrote:

I made a custom extension that you can detect the pose of single/multiple people in realtime and get rather accurate positions of 17 parts of the body. Using this extension, you can create a funny project like this:



The capture uses Japanese blocks, but you can use English/Chinese blocks as well.

To use this, open Video Motion extension and PoseNet2Scratch extension on the following customized Scratch 3.

https://champierre.github.io/scratch3/

A manual is available at:

https://github.com/champierre/posenet2scratch
why can't i use cloud variables i want to make a multiplayer game

Last edited by xanmander02 (March 5, 2023 03:22:16)

Powered by DjangoBB