Is anyone into AI? What are you using? Claude Pro? Gemini 2.5? Some amazing applications..

[computerwiz]

15 hours ago, hybridxer0 said:

Sounds like you have a lot of tinkering like me! I used to own an IT firm before I sold it and moved, but I always will be tech-adjacent in whatever I do. Let me know if I can help in any way!  

 

If you find any good offline, portable, tools, I'm all ears.  Things move so fast in the AI world, and there's so many flavors, it helps to get suggestions from others.  Here's what I'm settled on (so far):

KoboldCpp - General all-purpose AI engine.  Good for chats, TTS, Image analysis, simple image gen, and eventually music generation.  Now has video generation ability (though my PCs are too weak to even try).

 

AnythingLLM - Extends the abilities of KoboldCpp, with memories & file reading ability.

 

ComfyUI - Any kind of image generating or editing.

 

GGUFLoader - Similar to KoboldCpp, but much simpler.

 

That's what I have so far.  And I'm taking a break working on it for now.  But definitely feel free to contribute any findings you have that fit what I'm looking for: free, offline, portable, & CPU-friendly.  

 

8 hours ago, Desert Dan said:

 

I have some general chat type models running local on just 8gb of VRAM, including image analysis, etc, but I have yet to successfully figure out text to image generation running locally.  ComfyUI made my brain hurt and it always seems like packages or components are outdated, erroring out, missing, etc.  I have to step back from things like that, or else I will get frustrated.  I like messing with microcontrollers and junk like that as well.

 

I don't know how long ago you messed with ComfyUI, but they have templates now.  Also it may help to have the ComfyUI Manager installed.  All you need is a good image gen model, and a good positive & negative prompts.  Some fine tuning like the # of steps & the CFG value, but that's about it...