Talk of The Villages Florida

Talk of The Villages Florida (https://www.talkofthevillages.com/forums/)
-   Computer questions (https://www.talkofthevillages.com/forums/computer-questions-92/)
-   -   Running Deepseek R1 Locally (https://www.talkofthevillages.com/forums/computer-questions-92/running-deepseek-r1-locally-356413/)

MorTech 02-07-2025 03:04 AM

Running Deepseek R1 Locally
 
Run a local Deepseek R1 AI for cheap....

https://www.youtube.com/watch?v=e-EG3B5Uj78

New Englander 02-07-2025 10:50 AM

What the heck is that guy talking about?

Velvet 02-07-2025 12:06 PM

I would advise against it. DeepSeek is Chinese artificial intelligence AI. It’s a sweet operation, I had it summarize Crime and Punishment chapter by chapter because I just could not follow the book etc.

But yesterday the Wall Street Journal wrote that in order to use DeepSeek you have to authorize DeepSeek to access your personal data. It collects everything including key strokes (banking password anybody?) and sends it to a Chinese service. It can store your data even after you have deleted the app. So I deleted DeepSeek, changed all my passwords afterwards that I used in the time DeepSeek had access to all my devices - that’s another thing you have to authorize in order to use it. Now I use ChatGPT. Which is American and is actually a more powerful AI. DeepSeek is not allowed on government issued devices.

Altavia 02-07-2025 12:16 PM

The very geeky video explains how to build, install and run a Deepseek AI locally, without connection to the Internet.

Very cool (and a little bit frightening...) stuff.

CoachKandSportsguy 02-07-2025 12:17 PM

Quote:

Originally Posted by Velvet (Post 2407686)
I would advise against it. DeepSeek is Chinese artificial intelligence AI. It’s a sweet operation, I had it summarize Crime and Punishment chapter by chapter because I just could not follow the book etc.

But yesterday the Wall Street Journal wrote that in order to use DeepSeek you have to authorize DeepSeek to access your personal data. It collects everything including key strokes (banking password anybody?) and sends it to a Chinese service. It can store your data even after you have deleted the app. So I deleted DeepSeek, changed all my passwords afterwards that I used in the time DeepSeek had access to all my devices - that’s another thing you have to authorize in order to use it. Now I use ChatGPT. Which is American and is actually a more powerful AI. DeepSeek is not allowed on government issued devices.

I wouldn' load anything from China, tik-toc, deep seek, anything from China. Although they typically use the data for blackmail purposes, after finding a target, it's not worth the risk at all.

Apple is even finding Malware in some Apple Store products, which is very disappointing. Stupid lawyers trying to break a great product for other competitors.

Velvet 02-07-2025 12:35 PM

Quote:

Originally Posted by Altavia (Post 2407688)
The very geeky video explains how to build, install and run a Deepseek AI locally, without connection to the Internet.

Very cool (and a little bit frightening...) stuff.

If you mean DeepSeek has published an open code - how it runs, to be modified and used for your own purposes, I agree. That is like using Pythagoras’ theorem in your own applied math equation. I admire that decision by Liang Wenfeng, the math whiz who established DeepSeek - so anyone can use his algorithm.

Bill14564 02-07-2025 12:52 PM

Quote:

Originally Posted by Altavia (Post 2407688)
The very geeky video explains how to build, install and run a Deepseek AI locally, without connection to the Internet.

Very cool (and a little bit frightening...) stuff.

Quote:

Originally Posted by Velvet (Post 2407693)
If you mean DeepSeek has published an open code - how it runs, to be modified and used for your own purposes, I agree. That is like using Pythagoras’ theorem in your own applied math equation. I admire that decision by Liang Wenfeng, the math whiz who established DeepSeek - so anyone can use his algorithm.

No, I believe he means Deepseek has published it's actual models (implementations of Deepseek) that you can download onto your own hardware and run with no connection to the internet. If you run it this way it is impossible for any information to be sent anywhere.

Most people will not run it this way. Most people will use a web interface to access an implementation of Deepseek somewhere on the internet. When used in this way there is the potential that some data could be sent to places you aren't aware of. The security researcher identified this potential but according to the articles I could find, did not see it actually sending any info.

Velvet 02-07-2025 12:58 PM

So, are you saying the models can be run off line like Excel, for example? Which is exactly what open code would allow. I can see using these models safely as long as you never intend to send them or their applications online anywhere at any time.

MorTech 02-08-2025 03:55 AM

Quote:

Originally Posted by New Englander (Post 2407654)
What the heck is that guy talking about?

Yeah...He talks fast and with no fluff :) ...Except for Ana De Armas.

MorTech 02-08-2025 03:57 AM

Quote:

Originally Posted by Velvet (Post 2407686)
I would advise against it. DeepSeek is Chinese artificial intelligence AI. It’s a sweet operation, I had it summarize Crime and Punishment chapter by chapter because I just could not follow the book etc.

But yesterday the Wall Street Journal wrote that in order to use DeepSeek you have to authorize DeepSeek to access your personal data. It collects everything including key strokes (banking password anybody?) and sends it to a Chinese service. It can store your data even after you have deleted the app. So I deleted DeepSeek, changed all my passwords afterwards that I used in the time DeepSeek had access to all my devices - that’s another thing you have to authorize in order to use it. Now I use ChatGPT. Which is American and is actually a more powerful AI. DeepSeek is not allowed on government issued devices.

Deepseek R1 is open source and you do not need an Internet connection to run it.

MorTech 02-08-2025 04:37 AM

Deepseek R1 revealed to the world that the $300B total AI investment is perhaps 100X overvalued :) Maybe 80X.

CosmicTrucker 02-08-2025 08:40 AM

Quote:

Originally Posted by MorTech (Post 2407543)
Run a local Deepseek R1 AI for cheap....

https://www.youtube.com/watch?v=e-EG3B5Uj78

I trust Dave and his talent. Despite my long-standing interest in topics like this, I find it beyond my comprehension. I suppose age is catching up with me.

Decadeofdave 02-08-2025 09:29 AM

No thanks, don't need it. I don't like playing with things I don't understand.

MorTech 02-08-2025 12:58 PM

Video on Jetson Orin Nano Super Developer Kit...$250.

https://www.youtube.com/watch?v=fcGD7kHgxqE

Velvet 02-08-2025 02:35 PM

Thank you, but DeepSeek offline models can’t do what I want to do at this time. I am interested in art. Perhaps when they are more developed.

For example, neither ChatGPT nor DeepSeek can sing “Alegria” by Cirque du Soleil translated to English for me. Neither can either one take one of my oil paintings and change the style while maintaining the composition.

They’re pretty good at reasoning though. I could ask why does my golf cart stalls, for example.


All times are GMT -5. The time now is 04:49 AM.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2025, vBulletin Solutions Inc.
Search Engine Optimisation provided by DragonByte SEO v2.0.32 (Pro) - vBulletin Mods & Addons Copyright © 2025 DragonByte Technologies Ltd.