Except it’s even a bit more ridiculous than that because they can technically just scan the files and the metadata as where these are entire models that are not developed or being deployed by hugging face, they’re just downloads hosted… I’m actually not sure what exactly they’re supposed to do about this besides not allow image models I guess? Which I frankly wouldn’t be against
i don’t think the distinction “image model” really holds anymore. most big language models can generate images on their own if you bully them enough. they’ve ingested enough binary data to know what a valid jpeg looks like and you can use that to get base64-encoded images out.
as for banning diffusion models rather than transformers… well we have text diffusion models now.
Except it’s even a bit more ridiculous than that because they can technically just scan the files and the metadata as where these are entire models that are not developed or being deployed by hugging face, they’re just downloads hosted… I’m actually not sure what exactly they’re supposed to do about this besides not allow image models I guess? Which I frankly wouldn’t be against
i don’t think the distinction “image model” really holds anymore. most big language models can generate images on their own if you bully them enough. they’ve ingested enough binary data to know what a valid jpeg looks like and you can use that to get base64-encoded images out.
as for banning diffusion models rather than transformers… well we have text diffusion models now.
You think the model I use knows what a JPEG is? It just wants a picture of a gatdang hot dog
The image generator and llm are separate models
are you talking image diffusion models now? because CLIP isn’t really an llm in the normal sense. it’s just a classifier.
I hadn’t heard of that method.
can you show some examples of such images?
there are some in this paper: https://arxiv.org/html/2408.08459v2