the 671b, full bit unquantized model.

Its free right? Then what point of using the smaller version compared to 671b?

Its free right? Then what point of using the smaller version compared to 671b?

hey. any freelancer willing to do a bit coding for hire?

im planning to build a chatbot using deepseek for my online futsal court booking platform. API ready.
deepseek api cost is very attractive compare to chatgpt.

Its free right? Then what point of using the smaller version compared to 671b?

hey. any freelancer willing to do a bit coding for hire?

im planning to build a chatbot using deepseek for my online futsal court booking platform. API ready.
deepseek api cost is very attractive compare to chatgpt.

im a bit lazy to code on the side now.

different topic:
US tech stock dipped after deepseek blew up. but I think its a knee jerk reaction.

deepseek is open sourced. chatgpt and the likes can make reference and make changes to their codes. and with their massive AI chip that is only available to them.
its gonna come back MASSIVE.

its good for business and consumers. I think massive discount gonna come soon to chatgpt and the likes when are on par in term of cost with deepseek.

I think have a long position on US AI stocks is still a good look
thoughts?

full bit 671b requires around 1400GB memory size of either the system RAM (if running cpu AI) or GPU VRAM.

Not rich enough to have that monster pc

But with full bit, what is the performance compare to chatgpt? Same or even higher than chatgpt?

the competitor for o1

but of course doesn't have image generation and video generation capability under this deepseek r1.

So after all? Still chatgpt win ke?

if you wanna pay $200 dollars a month for unlimited o1 use lol

plus the ability to run deepseek r1 offline solves privacy issues which is very important for some users

I am wondering with my house desktop setup, what version of deepseek can it use.

It depends on memory size. I can only answer for GPU part. If you have 24GB VRAM gpus like rtx3090, rtx4090, you can go for quantized 4 bit deepseek-r1:32b. If you have 12 or 16GB gpu then you can try 14b. 8b for 8GB gpus. But this is for the distilled version quantized 4 bit, not the full bit. full bit uses way more memory.

It can also be run on CPU only, I didn't read much about that but I saw ppl running 70b using 9950X with 64GB system memory but the response is slow. Another built a amd dual epyc system with 768GB memory that managed to run the full bit 671b with 6-8 tokens/s with total system cost at his place around 6000usd.

Damn my GPU old let ... Rtx 3060 super I think... Can do what? Just subscribe chatgpt?

I am wondering with my house desktop setup, what version of deepseek can it use.

Damn my GPU old let ... Rtx 3060 super I think... Can do what? Just subscribe chatgpt?

arguably, this is like back during mining trend? people buy hundreds and thousands of GPUs just to mine the hell out of it plus the insane electric bill monthly

gpu requirements
https://apxml.com/posts/system-requirements-deepseek-models