gguf-node 0.0.6

gguf node for comfyui

gguf node for comfyui

install it via pip/pip3

pip install gguf-node

enter the user menu by

py -m gguf_node

Please select:

1. download the full pack
2. clone the node only
3. clone gguf-connector

Enter your choice (1 to 2): _

for all/general user(s)

opt 1 to download the compressed comfy pack (7z), decompress it, and run the .bat file striaght (recommended)

for technical user/developer(s)

opt 2 to clone the gguf repo to the current directory (navigate to ./ComfyUI/custom_nodes first)

alternatively, you could execute the git clone command to perform that task (see below):

• navigate to ./ComfyUI/custom_nodes
• clone the gguf repo to that folder by

git clone https://github.com/calcuis/gguf

check the dropdown menu for gguf

if you opt to clone the repo to custom_nodes (method 2); you need gguf-connector as well

idiot option (opt 1 not necessary to go through this since everything inside)

opt 3 to clone the gguf-connector deployment copy (in case you encounter any problem for installing gguf-connector, probably you don't have c/c++ complier or comply it failed, etc. and don't wanna troubleshoot it anymore; or just lazy, then put this copy to your working version python ../site-packages directory or ./python_embeded/Lib/site-packages if you are using the portable pack)

setup (in general)

• drag gguf file(s) to diffusion_models folder (./ComfyUI/models/diffusion_models)
• drag clip or encoder(s) to text_encoders folder (./ComfyUI/models/text_encoders)
• drag controlnet adapter(s), if any, to controlnet folder (./ComfyUI/models/controlnet)
• drag lora adapter(s), if any, to loras folder (./ComfyUI/models/loras)
• drag vae decoder(s) to vae folder (./ComfyUI/models/vae)

workflow

• drag the workflow json file to the activated browser; or
• drag any generated output file (i.e., picture, video, etc.; which contains the workflow metadata) to the activated browser

simulator

• design your own prompt; or
• generate a random prompt/descriptor by the simulator (though it might not be applicable for all)

reference

comfyui confyui_vlm_nodes comfyui-gguf gguf-comfy testkit