Why would someone want to do this instead of subscribe to their services?

Ok I have locally run deepseek R1 32b Q4 now, this is the response:

There is censor filter in cloud deployment. regardless of vendor.

Don't give them training data, or there are some sensitive data such as IP that you don't want them to see.

This post has been edited by kingkingyyk: Jan 28 2025, 07:06 PM

i got this in 8b

I am sorry, I cannot answer that question. I am an AI assistant designed to provide helpful and harmless responses.

Spoken like a true bukit person

so meaning
ironman arc reactor = deepseek
nuclear reactor = chatgpt?

lower parameter probably more dumb lol

Just matter of time everyone will throw their dataset into the new method.

This post has been edited by kingkingyyk: Jan 28 2025, 07:19 PM

My pc already crapping up with flux nf4, and will fully locked up after several gens lol

Time to throw some more money and make tnb happy

political topics might not be that accurate since it is affected by the training data

for example it is fairly light on the details on gamergate while showing more bias on "toxicity and harassment in gaming culture" which is untrue. toxicity is minor issue on gamergate, I can pull up the real event on inner circle on people preserving the evidences of gamergate that was always being deleted by the woke ppl (it's more about journalism corruption)

This post has been edited by terradrive: Jan 28 2025, 07:46 PM

i'm genuinely hope for it. who the heck can afford nvidia h100, and thousands of them again.

you probably asking something unethical. if you wish to have the response, you need to fine tune the model to be able to answer unethical things, or just simply download a jailbreak version .gguf file from somewhere else.

Wow. The 春晚 got robot group dance. Amazing.

So U guys mean with different 8b, 16b, 32b or 64b all are giving different responses??

for end users probably not worth it.. for enterprise.. they pay only fraction of what it cost if running on chatgpt

of course. the smaller the model, the more it's prone to making mistake, hallucinate, and not following instructions properly

Then to make a comparison with chatgpt, what model would be appropriate to compete?

Main use of AI:
NSFW stories lol

the 671b, full bit unquantized model.

hey. any freelancer willing to do a bit coding for hire?

im planning to build a chatbot using deepseek for my online futsal court booking platform. API ready.
deepseek api cost is very attractive compare to chatgpt.

im a bit lazy to code on the side now.

different topic:
US tech stock dipped after deepseek blew up. but I think its a knee jerk reaction.

deepseek is open sourced. chatgpt and the likes can make reference and make changes to their codes. and with their massive AI chip that is only available to them.
its gonna come back MASSIVE.

its good for business and consumers. I think massive discount gonna come soon to chatgpt and the likes when are on par in term of cost with deepseek.

I think have a long position on US AI stocks is still a good look


thoughts?

This post has been edited by syyang85: Jan 28 2025, 11:16 PM