running the 1.5bn q4_k_m locally on my NAS
slow af, but it worked so I dont have to work with o1 free-limit
Full DeepSeek R1 At Home 🥳🥳🥳
|
|
 Jan 28 2025, 02:30 PM
Return to original view | IPv6 | Post
#1
|
 
Junior Member
830 posts Joined: Mar 2010 
|
|
Quote|
|
Jan 28 2025, 02:37 PM
Return to original view | Post
#2
|
|
Junior Member
830 posts Joined: Mar 2010
|
QUOTE(hellothere131495 @ Jan 28 2025, 02:32 PM) 1.5b 4bit is slow? what spec are you using? btw, you probably still need the o1. 1.5b 4 bit is a shit model that hallucinates a lot. N100 processor je, no GPU, its truenas machine originally installed ollama just for fun now considering putting it on my desktop |
| Change to: |  0.0180sec
 0.29
 6 queries
 GZIP Disabled
Time is now: 18th December 2025 - 06:05 AM |
All Rights Reserved © 2002- 2025 Vijandren Ramadass (~unite against racism~)
Powered by Invision Power Board © 2025 IPS, Inc.