Here is the link: https://fluff-ai.glitch.me/
It's an AI assistant created to answer questions about Scratch rules, policies, and the Community Guidelines. Try it out!
It's still in its experimental stages, but it works pretty okay for now. The rate limit is 25 messages per hour.

Currently working on:

• I am working on a “thinking” feature where, just like ChatGPT and DeepSeek, Fluff will think before replying, taking into account all policies that apply to the specific question and forming a correct answer.
  
• I will soon add a brand-new UI, similar to ChatGPT's but with a Scratch 3.0-styled theme.
  

Demonstration:

• https://u.cubeupload.com/ieatcoffee/8lYLDL.png
  
• https://u.cubeupload.com/ieatcoffee/VOdIBo.png
  
• https://u.cubeupload.com/ieatcoffee/b9sbfp.png
  

What do you think?

Another cool thing is that it's completely open source on Glitch, so it can be shared on Scratch because it clearly shows that no messages are logged & all API requests^^

This is really cool!

Slight issue:
The AI is fine with mentioning things not allowed on Scratch, such as browser extension names.
Maybe add a blacklist and filter the output or something?

Useful idea!
So this is just a wrapper of an OpenAI model (like ChatGPT) using groq as the api?

redspacecat wrote:

This is really cool!

Slight issue:
The AI is fine with mentioning things not allowed on Scratch, such as browser extension names.
Maybe add a blacklist and filter the output or something?

This is fixed

ninjaMAR wrote:

Useful idea!
So this is just a wrapper of an OpenAI model (like ChatGPT) using groq as the api?

Yeah, it uses the llama3 70b model with a set of not only all the rules on Scratch, but also how to reply as an AI and other specifications that are not necessarily set-in-stone rules (e.g. NFE projects, scratcher ranks, etc.)

I think I found an exploit on this website:

So if you insert complex unicode symbols too much, it would cause immense lag on the website. I believe this is called a unicode overflow. You should add some detection for these unicode symbols to prevent any such attacks from occurring in the future.

Are you hosting the AI locally? I know 70B takes some serious hardware to host

Iamnotarobot124 wrote:

I think I found an exploit on this website:

So if you insert complex unicode symbols too much, it would cause immense lag on the website. I believe this is called a unicode overflow. You should add some detection for these unicode symbols to prevent any such attacks from occurring in the future.

The server can process very large amounts of data at once, the only thing crashing would be your browser trying to send the request with said data to the server…………………………………..

oxiti8 wrote:

Are you hosting the AI locally? I know 70B takes some serious hardware to host

Nope, using Groq API
I initially wanted to host a smaller llama model locally but I ended up just using an API to handle requests for accuracy reasons, the smaller models obviously have less processing capacity and will return a lot more incorrect and dumb replies.

i_eat_coffee wrote:

Iamnotarobot124 wrote:

I think I found an exploit on this website:

So if you insert complex unicode symbols too much, it would cause immense lag on the website. I believe this is called a unicode overflow. You should add some detection for these unicode symbols to prevent any such attacks from occurring in the future.

The server can process very large amounts of data at once, the only thing crashing would be your browser trying to send the request with said data to the server…………………………………..

oxiti8 wrote:

Are you hosting the AI locally? I know 70B takes some serious hardware to host

Nope, using Groq API
I initially wanted to host a smaller llama model locally but I ended up just using an API to handle requests for accuracy reasons, the smaller models obviously have less processing capacity and will return a lot more incorrect and dumb replies.

I just tried it, the website lagged for several seconds, but sending requests to other websites was okay.

why do i always get a bunch of this error:
“An error occurred while generating a reply! Type: tokens”

AmpElectrecuted wrote:

why do i always get a bunch of this error:
“An error occurred while generating a reply! Type: tokens”

that's pretty odd, it works perfectly fine for me

i_eat_coffee wrote:

AmpElectrecuted wrote:

why do i always get a bunch of this error:
“An error occurred while generating a reply! Type: tokens”

that's pretty odd, it works perfectly fine for me

It also doesn't work for me. (I get rate_limit_exceeded, although it could have been because of my tests) Have you ran out of tokens?

Iamnotarobot124 wrote:

i_eat_coffee wrote:

AmpElectrecuted wrote:

why do i always get a bunch of this error:
“An error occurred while generating a reply! Type: tokens”

that's pretty odd, it works perfectly fine for me

It also doesn't work for me. (I get rate_limit_exceeded, although it could have been because of my tests) Have you ran out of tokens?

oh yea, I did lol
please check again in a few minutes

i_eat_coffee wrote:

Iamnotarobot124 wrote:

i_eat_coffee wrote:

AmpElectrecuted wrote:

why do i always get a bunch of this error:
“An error occurred while generating a reply! Type: tokens”

that's pretty odd, it works perfectly fine for me

It also doesn't work for me. (I get rate_limit_exceeded, although it could have been because of my tests) Have you ran out of tokens?

oh yea, I did lol
please check again in a few minutes

It works for me now

I found an inaccurate response with this prompt (probably works with similar prompts)

Iamnotarobot124 wrote:

I found an inaccurate response with this prompt (probably works with similar prompts)

Right, Fluff AI does not have a full list of websites that are not allowed, PLUS it cannot scan websites to check what type of functionality they have, and only replies based on the assumption that you did not create the website and it has no private chat functionality. I'll fix this soon.

Iamnotarobot124 wrote:

I found an inaccurate response with this prompt (probably works with similar prompts)

Honestly that's not surprising, as in the second prompt you told the AI something about that platform that it didn't know. It assumed that it was allowed as long as the linked content was appropriate, as this is normally the case with websites being linked on Scratch, but it also assumes that anything with 18+ content isn't allowed to be linked. In the first prompt, it didn't know that the website had 18+ content.

very carefully stepping around the website's name just in case it's filtered

Also I get “please wait an hour”, but it's been more than an hour (about 2 hours)

What data is it trained on? What model is it running?

Chiroyce wrote:

What data is it trained on? What model is it running?

It's alternating between llama3-70b-8192 and llama-3.3-70b-versatile, and it has a basic set of instructions with a list of all scratch policies / community guidelines, and instructions on how to reply to users.
I'm adding a new “thinking mode” soon, where it will be using deepseek-r1-distill-llama-70b to think about the question and take into account all policy details before replying, and it seems to be a bit more accurate than the regular model, but it doesn't make a huge difference–it will be just an experimental feature.