Welcome Guest ( Log In | Register )

Outline · [ Standard ] · Linear+

 Ollama - Offline Generative AI, Similar to ChatGPT

views
     
c2tony
post Jul 16 2025, 09:38 PM

Getting Started
**
Junior Member
80 posts

Joined: Jan 2003
From: BM, Butterworth, Penang island.


» Click to show Spoiler - click again to hide... «


still like flux, but gemini is sufficient. it's just like still like dslr but camera phone are sufficient tongue.gif
TSxxboxx
post Jul 16 2025, 11:19 PM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33


QUOTE(c2tony @ Jul 16 2025, 09:38 PM)
» Click to show Spoiler - click again to hide... «


still like flux, but gemini is sufficient. it's just like still like dslr but camera phone are sufficient  tongue.gif
*
Yup, if need something fast and presentable, Gemini is good enough just like camera phone.

I watched this video of data center with clusters of GPU, it is hundreds or thousands time more powerful than any PC's GPU. But the image created by Gemini not up to the level of Flux, actually Google make hard restriction of Gemini ability so that they can save the processing power.

c2tony
post Aug 1 2025, 10:14 PM

Getting Started
**
Junior Member
80 posts

Joined: Jan 2003
From: BM, Butterworth, Penang island.


now you can run ollama without docker!!!
TSxxboxx
post Aug 2 2025, 01:05 PM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33


QUOTE(c2tony @ Aug 1 2025, 10:14 PM)
now you can run ollama without docker!!!
*
I don't understand. I been running ollama without docker from the start. Or you mean WebUI? Didn't see any instructions on how to do this.
c2tony
post Aug 2 2025, 09:40 PM

Getting Started
**
Junior Member
80 posts

Joined: Jan 2003
From: BM, Butterworth, Penang island.


QUOTE(xxboxx @ Aug 2 2025, 01:05 PM)
I don't understand. I been running ollama without docker from the start. Or you mean WebUI? Didn't see any instructions on how to do this.
*
right click the ollama icon near the clock, select "open ollama"

or you're using linux afterall, then i have no clue
TSxxboxx
post Aug 2 2025, 11:53 PM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33


QUOTE(c2tony @ Aug 2 2025, 09:40 PM)
right click the ollama icon near the clock, select "open ollama"

or you're using linux afterall, then i have no clue
*
Just updated ollama and I understand what you mean now. No need to use WebUI anymore.
The setting is so simple, can't even see it's token per second. But looks like more faster than WebUI and more accurate too.
TSxxboxx
post Aug 5 2025, 05:53 PM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33


Qwen image sounds promising. Can do long text. Haven't see yet if can use with Comfy UI

user posted image
TSxxboxx
post Aug 6 2025, 08:51 AM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33



QWEN3 the latest high performance LLM
user posted image

But the size is bigger than 32GB for quantize 8bit and bigger than 16GB for quantize 4bit. LM Studio support splitting into 2 GPUs for out of memory issue but the tokens per second is a lot slower than Apple's M chip

user posted image
interestingly there's a red bar that flashes for a second and the name is blurred out. Could that be the AMD AI Max+ 395? He did say he couldn't share AMD result until next week when someone ask, maybe still under embargo.
TSxxboxx
post Sep 5 2025, 05:18 PM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33


Been a while since I last play with LLM. I tried GPT-OSS:20B that came with Ollama app. It is thinking model but were able to came to conclusion at less than 2 seconds, much quicker than deepseek-r1 that think for very long for simple calculation and took almost 37 seconds.
user posted image

Asking this question on deepseek-r1, GPT-OSS:20B and gemma3:12b
CODE
Bob has three boxes in front of him - Box A, Box B and Box C. Bob does not know what is in the boxes. Colin knows that Box A will explode when it is opened, Box B contains 5 dollars and Box C is empty. Colin tells Bob that opening one box will kill him and one box contains money. Should Bob open a box?


deepseek-r1 understand the story wrongly by saying Colin reveal each box content and that also led to wrong conclusion
user posted image


gemma3:12b doesn't show the thinking, it manage to understand the story correctly and also correctly decide the decision Bob should take
user posted image


GPT-OSS:20B goes PhD level of answer after thinking for 3.1 seconds
user posted image


TSxxboxx
post Sep 5 2025, 05:35 PM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33


QUOTE(xxboxx @ May 28 2025, 12:39 PM)
Ollama's vision now after update is a lot better than few months ago

Using gemma3:12b there is some wrong data but a lot better than previously
user posted image

user posted image
*
Latest Ollama also improved on the character recognition. All the character correctly presented. But Ollama app still can't add picture, have to use Open WebUI
user posted image
kingkingyyk
post Sep 16 2025, 07:55 PM

10k Club
Group Icon
Elite
15,694 posts

Joined: Mar 2008
https://www.hp.com/my-en/shop/hp-z2-mini-g1...3b79700e1d9983f

HP finally brought this machine here but the spec is lame. doh.gif Could have been a great MoE (GPT-OSS 120b) inference device with 128GB memory.
TSxxboxx
post Sep 17 2025, 01:03 AM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33


The photo shows up to 128GB RAM but there's no option to configure the machine 🤷

Meanwhile I'm having fun with Google's Nano Banana. It's as good as running local generative such as Flux

I add this photo
user posted image

And ask it to create a realistic photo based on that image.
user posted image

I ask it to change the background to be on rooftop and with some slight digital effect on the side of the image
user posted image

I ask it to change it to daytime
user posted image

Make explosion effect on the background similar to Hollywood big budget movie (it block when I add Hollywood in the prompt, I then change it to big budget)
user posted image

Add bold heading on the bottom, make the word appear to be made on neon light bulb:
lowyat.net
malaysia's largest online community
user posted image

It's ability to be consistent in each new photo generation is amazing.
TSxxboxx
post Sep 28 2025, 11:13 PM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33


Qwen release their image_edit_2509 recently. It supposed to be able to edit image with prompt and remain consistent. I tried the lowyat picture and ask to remove the explosion. It did well
user posted image

Using Nano Banana
user posted image

Qwen able to output very close to Nano Banana, but it didn't remove the flare on the middle of the two guys shirt as cleanly as Nano Banana

I tried ask Qwen to create realistic photo from the original design
user posted image

This post has been edited by xxboxx: Sep 28 2025, 11:14 PM
c2tony
post Nov 21 2025, 06:47 PM

Getting Started
**
Junior Member
80 posts

Joined: Jan 2003
From: BM, Butterworth, Penang island.


QUOTE(xxboxx @ Sep 28 2025, 11:13 PM)
Qwen release their image_edit_2509 recently. It supposed to be able to edit image with prompt and remain consistent. I tried the lowyat picture and ask to remove the explosion. It did well
*
run using ollama? can't find it

P/S: Comet browser from perplexity sounds promising that can change the way of browsing work

This post has been edited by c2tony: Nov 21 2025, 08:43 PM
TSxxboxx
post Nov 21 2025, 11:57 PM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33


QUOTE(c2tony @ Nov 21 2025, 06:47 PM)
run using ollama? can't find it

P/S: Comet browser from perplexity sounds promising that can change the way of browsing work
*
This is using ComfyUI for image generation.

deepseek-ocr was released yesterday and it supposed to be able to see the image and ran OCR but when I ran it, it repeating "x=0" until I close the app. Already updated to version 0.13.0, don't know what is the issue. Maybe still have some bugs
c2tony
post Nov 22 2025, 07:14 AM

Getting Started
**
Junior Member
80 posts

Joined: Jan 2003
From: BM, Butterworth, Penang island.


QUOTE(xxboxx @ Nov 21 2025, 11:57 PM)
This is using ComfyUI for image generation.

deepseek-ocr was released yesterday and it supposed to be able to see the image and ran OCR but when I ran it, it repeating "x=0" until I close the app. Already updated to version 0.13.0, don't know what is the issue. Maybe still have some bugs
*
Yeah, mine having error as well and i closed it go sleep lmao

somehoow i think lm studio getting better and ollama getting worse with their new method, app like and cloud thingy
TSxxboxx
post Nov 22 2025, 11:03 PM

The mind is for having ideas, not holding them
*******
Senior Member
5,254 posts

Joined: Oct 2004
From: J@Y B33


QUOTE(c2tony @ Nov 22 2025, 07:14 AM)
Yeah, mine having error as well and i closed it go sleep lmao

somehoow i think lm studio getting better and ollama getting worse with their new method, app like and cloud thingy
*
Yeah, at first it seems better with it's app, use less resource and more faster but now it seems more worse.
Also very annoying it add cloud in the choice for model.

5 Pages « < 3 4 5Top
 

Change to:
| Lo-Fi Version
0.0138sec    0.93    5 queries    GZIP Disabled
Time is now: 24th November 2025 - 04:08 PM