This post has been edited by ipohps3: Jan 28 2025, 01:22 PM
Full DeepSeek R1 At Home 🥳🥳🥳
Full DeepSeek R1 At Home 🥳🥳🥳
|
|
Jan 28 2025, 01:21 PM, updated 11 months ago
Show posts by this member only | Post
#1
|
![]() ![]() ![]() ![]() ![]() ![]()
Senior Member
1,974 posts Joined: Dec 2011 |
Penamer liked this post
|
|
|
|
|
|
Jan 28 2025, 01:22 PM
Show posts by this member only | Post
#2
|
![]() ![]() ![]() ![]() ![]() ![]()
Senior Member
1,974 posts Joined: Dec 2011 |
moooore memory...
|
|
|
Jan 28 2025, 01:22 PM
Show posts by this member only | Post
#3
|
![]() ![]() ![]() ![]() ![]()
Senior Member
975 posts Joined: Aug 2007 From: Lokap Polis |
slow la. better just use proper graphic card instead.
|
|
|
Jan 28 2025, 01:25 PM
Show posts by this member only | Post
#4
|
![]() ![]() ![]() ![]() ![]() ![]()
Senior Member
1,974 posts Joined: Dec 2011 |
|
|
|
Jan 28 2025, 01:26 PM
Show posts by this member only | Post
#5
|
![]() ![]() ![]() ![]()
Junior Member
651 posts Joined: Mar 2009 |
i have 3 gpu on floor
can i setup r1 ? |
|
|
Jan 28 2025, 01:29 PM
Show posts by this member only | Post
#6
|
![]() ![]() ![]() ![]() ![]()
Senior Member
975 posts Joined: Aug 2007 From: Lokap Polis |
QUOTE(ipohps3 @ Jan 28 2025, 01:25 PM) wonder if it is using the NPU, GPU or CPU in the M4 Mac Mini. if NPU, no need dedicated GPU also can. also, inside the M4 Mac Mini got GPU too. main thing is memory. most likely GPU. they will need extra work to get NPU doing the hard lifting. also NPU is optimized for performance/watt, it wont be faster than GPU with AI accelerator. |
|
|
|
|
|
Jan 28 2025, 02:06 PM
Show posts by this member only | IPv6 | Post
#7
|
![]() ![]()
Junior Member
140 posts Joined: Jul 2007 From: Puchong |
Who need that kind of setup??
Graphic designers? |
|
|
Jan 28 2025, 02:09 PM
Show posts by this member only | Post
#8
|
![]() ![]()
Junior Member
98 posts Joined: Jan 2023 |
Sampah punya AI pun ada hype.
|
|
|
Jan 28 2025, 02:10 PM
Show posts by this member only | Post
#9
|
![]() ![]()
Junior Member
62 posts Joined: Apr 2018 |
dis 1 is localised, no internet
i download ady the android version not bad the chain of tot n reasoning all listed 4 u to see |
|
|
Jan 28 2025, 02:14 PM
|
![]() ![]() ![]() ![]() ![]() ![]()
Senior Member
1,974 posts Joined: Dec 2011 |
|
|
|
Jan 28 2025, 02:19 PM
|
|
Elite
15,694 posts Joined: Mar 2008 |
QUOTE(ipohps3 @ Jan 28 2025, 02:14 PM) Note that the open source model you can run the distilled version, not the full one they hosted in cloud. You need crazy amount of fast GPUs to make the full version workable. Have fun enjoy heating you room. This post has been edited by kingkingyyk: Jan 28 2025, 02:22 PM |
|
|
Jan 28 2025, 02:21 PM
|
![]() ![]() ![]() ![]() ![]() ![]() ![]()
Senior Member
3,833 posts Joined: Oct 2006 From: Shah Alam |
better just pay chatgpt plus. only usd20 per month. lol
|
|
|
Jan 28 2025, 02:22 PM
Show posts by this member only | IPv6 | Post
#13
|
![]()
Junior Member
0 posts Joined: Apr 2022 |
I am running a RM50million business company with just my M1 MacBook Air.
|
|
|
|
|
|
Jan 28 2025, 02:23 PM
|
![]() ![]()
Junior Member
112 posts Joined: Aug 2006 |
|
|
|
Jan 28 2025, 02:23 PM
|
|
Elite
10,672 posts Joined: Jul 2005 From: shah alam - skudai - shah alam |
What does it do? What's the difference between running the one online?
|
|
|
Jan 28 2025, 02:23 PM
|
|
Elite
15,694 posts Joined: Mar 2008 |
|
|
|
Jan 28 2025, 02:26 PM
|
![]() ![]() ![]()
Junior Member
473 posts Joined: Sep 2019 |
QUOTE(kingkingyyk @ Jan 28 2025, 02:19 PM) Note that the open source model you can run the distilled version, not the full one they hosted in cloud. You need crazy amount of fast GPUs to make the full version workable. Have fun enjoy heating you room. Bruh. The full model is also open source:https://github.com/deepseek-ai/DeepSeek-R1 ollama too: https://ollama.com/library/deepseek-r1 Edit: lol you edited This post has been edited by hellothere131495: Jan 28 2025, 02:27 PM |
|
|
Jan 28 2025, 02:29 PM
|
![]() ![]()
Junior Member
239 posts Joined: May 2022 |
|
|
|
Jan 28 2025, 02:30 PM
Show posts by this member only | IPv6 | Post
#19
|
![]() ![]() ![]() ![]() ![]()
Junior Member
830 posts Joined: Mar 2010 |
running the 1.5bn q4_k_m locally on my NAS
slow af, but it worked so I dont have to work with o1 free-limit |
|
|
Jan 28 2025, 02:30 PM
|
![]() ![]() ![]()
Junior Member
473 posts Joined: Sep 2019 |
QUOTE(azarimy @ Jan 28 2025, 02:23 PM) Same. The same model. Just that you probably won't have the chance to run the online one. It's full 32 bit and 671B parameters. What you can run is the distilled (and quantized) version, like the qwen and llama3.1 8b one that has been distilled to respond like the original deepseekr1 |
| Change to: | 0.0176sec
1.24
5 queries
GZIP Disabled
Time is now: 17th December 2025 - 05:59 PM |