feat: Longcat-Image / Longcat-Image-Edit support #1053
Conversation
|
That does look a bit like a circuit board... |
|
TODO for when image generation works |
|
I can't figure out what I'm doing wrong, I think it is supposed to be working just like Flux1, but with different PE indices and Qwen Text Encoder.... Maybe I'm missing an important detail but I can't find it. |
|
I tried using my SplitAttention thing on a Flux model converted to diffusers format, and |
|
I think I got it? With the padding fixed, but with diffusers format: |
|
With the character-level tokenization trick: Might need testing to make sure the current implementation supports languages that don't use the latin alphabet. Also for now it's applied to text wrapped in single quotes ( |
|
Oh no, why are there so many conflicts now? |
|
Using |
|
Somehow not fully working yet, but it's definitely able to see it's supposed to be a cat holding a sign, maybe because of the vision model
(Also I made the change so it now needs double quotes around literal text) |
Somehow couldn't get it to remove the original text, but there it goes |
|
May I ask which comfyui node is used to load this GGUF model? |
|
Now supports UTF-8 encoding properly for the quoted text. (also quote characters are no longer excluded from the prompt after being parsed, seems to help a bit, especially with longer text.) |
remove debug logs
Fix base rope offset for ref images
@Rocky-Lee-001 I don't think LongCat-Image is natively supported by ComfyUI yet. You could give https://github.com/sooxt98/comfyui_longcat_image a try, maybe it works well with the GGUF node for comfyUI? |
for #1052
sd.exe --diffusion-model ..\ComfyUI\models\unet\LongCat-Image-Q8_0.gguf --vae ..\ComfyUI\models\vae\flux\ae.safetensors --cfg-scale 4.0 --sampling-method euler -v --clip-on-cpu -p "A cinematic, melancholic photograph of a solitary hooded figure walking through a sprawling, rain-slicked metropolis at night. The city lights are a chaotic blur of neon orange and cool blue, reflecting on the wet asphalt. The scene evokes a sense of being a single component in a vast machine. Superimposed over the image in a sleek, modern, slightly glitched font is the philosophical quote: \"THE CITY IS A CIRCUIT BOARD, AND I AM A LONG CAT.\" -- moody, atmospheric, profound, dark academic" --preview proj --steps 20 --qwen2vl ..\ComfyUI\models\clip\Qwen2.5-VL-7B-Instruct.Q4_K_M.gguf --diffusion-fa --color -W 1024 -H 1024Test models (converted to bfl format) can be found there:
Inference for models in diffusers format seem to be still broken