Running Deepseek R1 Locally

Reply
Thread Tools
  #1  
Old 02-07-2025, 03:04 AM
MorTech MorTech is offline
Platinum member
Join Date: Jan 2017
Posts: 1,699
Thanks: 0
Thanked 585 Times in 363 Posts
Default Running Deepseek R1 Locally

Run a local Deepseek R1 AI for cheap....

https://www.youtube.com/watch?v=e-EG3B5Uj78
  #2  
Old 02-07-2025, 10:50 AM
New Englander New Englander is offline
Soaring Eagle member
Join Date: May 2017
Location: Massachusetts, Pinellas, Now Sanibel
Posts: 2,152
Thanks: 732
Thanked 1,413 Times in 489 Posts
Default

What the heck is that guy talking about?
  #3  
Old 02-07-2025, 12:06 PM
Velvet's Avatar
Velvet Velvet is offline
Sage
Join Date: Mar 2019
Posts: 5,751
Thanks: 1,276
Thanked 4,425 Times in 1,949 Posts
Default

I would advise against it. DeepSeek is Chinese artificial intelligence AI. It’s a sweet operation, I had it summarize Crime and Punishment chapter by chapter because I just could not follow the book etc.

But yesterday the Wall Street Journal wrote that in order to use DeepSeek you have to authorize DeepSeek to access your personal data. It collects everything including key strokes (banking password anybody?) and sends it to a Chinese service. It can store your data even after you have deleted the app. So I deleted DeepSeek, changed all my passwords afterwards that I used in the time DeepSeek had access to all my devices - that’s another thing you have to authorize in order to use it. Now I use ChatGPT. Which is American and is actually a more powerful AI. DeepSeek is not allowed on government issued devices.

Last edited by Velvet; 02-07-2025 at 12:12 PM.
  #4  
Old 02-07-2025, 12:16 PM
Altavia Altavia is offline
Sage
Join Date: Jun 2019
Posts: 4,465
Thanks: 1,904
Thanked 3,426 Times in 1,633 Posts
Default

The very geeky video explains how to build, install and run a Deepseek AI locally, without connection to the Internet.

Very cool (and a little bit frightening...) stuff.

Last edited by Altavia; 02-07-2025 at 12:27 PM.
  #5  
Old 02-07-2025, 12:17 PM
CoachKandSportsguy CoachKandSportsguy is online now
Sage
Join Date: Jan 2019
Location: Marsh Bend
Posts: 3,568
Thanks: 641
Thanked 2,579 Times in 1,261 Posts
Default

Quote:
Originally Posted by Velvet View Post
I would advise against it. DeepSeek is Chinese artificial intelligence AI. It’s a sweet operation, I had it summarize Crime and Punishment chapter by chapter because I just could not follow the book etc.

But yesterday the Wall Street Journal wrote that in order to use DeepSeek you have to authorize DeepSeek to access your personal data. It collects everything including key strokes (banking password anybody?) and sends it to a Chinese service. It can store your data even after you have deleted the app. So I deleted DeepSeek, changed all my passwords afterwards that I used in the time DeepSeek had access to all my devices - that’s another thing you have to authorize in order to use it. Now I use ChatGPT. Which is American and is actually a more powerful AI. DeepSeek is not allowed on government issued devices.
I wouldn' load anything from China, tik-toc, deep seek, anything from China. Although they typically use the data for blackmail purposes, after finding a target, it's not worth the risk at all.

Apple is even finding Malware in some Apple Store products, which is very disappointing. Stupid lawyers trying to break a great product for other competitors.
  #6  
Old 02-07-2025, 12:35 PM
Velvet's Avatar
Velvet Velvet is offline
Sage
Join Date: Mar 2019
Posts: 5,751
Thanks: 1,276
Thanked 4,425 Times in 1,949 Posts
Default

Quote:
Originally Posted by Altavia View Post
The very geeky video explains how to build, install and run a Deepseek AI locally, without connection to the Internet.

Very cool (and a little bit frightening...) stuff.
If you mean DeepSeek has published an open code - how it runs, to be modified and used for your own purposes, I agree. That is like using Pythagoras’ theorem in your own applied math equation. I admire that decision by Liang Wenfeng, the math whiz who established DeepSeek - so anyone can use his algorithm.
  #7  
Old 02-07-2025, 12:52 PM
Bill14564 Bill14564 is online now
Sage
Join Date: Nov 2020
Location: Village of Hillsborough
Posts: 6,965
Thanks: 2,141
Thanked 7,410 Times in 2,878 Posts
Default

Quote:
Originally Posted by Altavia View Post
The very geeky video explains how to build, install and run a Deepseek AI locally, without connection to the Internet.

Very cool (and a little bit frightening...) stuff.
Quote:
Originally Posted by Velvet View Post
If you mean DeepSeek has published an open code - how it runs, to be modified and used for your own purposes, I agree. That is like using Pythagoras’ theorem in your own applied math equation. I admire that decision by Liang Wenfeng, the math whiz who established DeepSeek - so anyone can use his algorithm.
No, I believe he means Deepseek has published it's actual models (implementations of Deepseek) that you can download onto your own hardware and run with no connection to the internet. If you run it this way it is impossible for any information to be sent anywhere.

Most people will not run it this way. Most people will use a web interface to access an implementation of Deepseek somewhere on the internet. When used in this way there is the potential that some data could be sent to places you aren't aware of. The security researcher identified this potential but according to the articles I could find, did not see it actually sending any info.
__________________
Why do people insist on making claims without looking them up first, do they really think no one will check? Proof by emphatic assertion rarely works.
Confirmation bias is real; I can find any number of articles that say so.


Victor, NY
Randallstown, MD
Yakima, WA
Stevensville, MD
Village of Hillsborough
  #8  
Old 02-07-2025, 12:58 PM
Velvet's Avatar
Velvet Velvet is offline
Sage
Join Date: Mar 2019
Posts: 5,751
Thanks: 1,276
Thanked 4,425 Times in 1,949 Posts
Default

So, are you saying the models can be run off line like Excel, for example? Which is exactly what open code would allow. I can see using these models safely as long as you never intend to send them or their applications online anywhere at any time.

Last edited by Velvet; 02-07-2025 at 01:10 PM.
  #9  
Old 02-08-2025, 03:55 AM
MorTech MorTech is offline
Platinum member
Join Date: Jan 2017
Posts: 1,699
Thanks: 0
Thanked 585 Times in 363 Posts
Default

Quote:
Originally Posted by New Englander View Post
What the heck is that guy talking about?
Yeah...He talks fast and with no fluff ...Except for Ana De Armas.

Last edited by MorTech; 02-08-2025 at 04:06 AM.
  #10  
Old 02-08-2025, 03:57 AM
MorTech MorTech is offline
Platinum member
Join Date: Jan 2017
Posts: 1,699
Thanks: 0
Thanked 585 Times in 363 Posts
Default

Quote:
Originally Posted by Velvet View Post
I would advise against it. DeepSeek is Chinese artificial intelligence AI. It’s a sweet operation, I had it summarize Crime and Punishment chapter by chapter because I just could not follow the book etc.

But yesterday the Wall Street Journal wrote that in order to use DeepSeek you have to authorize DeepSeek to access your personal data. It collects everything including key strokes (banking password anybody?) and sends it to a Chinese service. It can store your data even after you have deleted the app. So I deleted DeepSeek, changed all my passwords afterwards that I used in the time DeepSeek had access to all my devices - that’s another thing you have to authorize in order to use it. Now I use ChatGPT. Which is American and is actually a more powerful AI. DeepSeek is not allowed on government issued devices.
Deepseek R1 is open source and you do not need an Internet connection to run it.
  #11  
Old 02-08-2025, 04:37 AM
MorTech MorTech is offline
Platinum member
Join Date: Jan 2017
Posts: 1,699
Thanks: 0
Thanked 585 Times in 363 Posts
Default

Deepseek R1 revealed to the world that the $300B total AI investment is perhaps 100X overvalued Maybe 80X.
  #12  
Old 02-08-2025, 08:40 AM
CosmicTrucker's Avatar
CosmicTrucker CosmicTrucker is offline
Senior Member
Join Date: Mar 2021
Location: Hawkins
Posts: 166
Thanks: 679
Thanked 109 Times in 66 Posts
Default

Quote:
Originally Posted by MorTech View Post
Run a local Deepseek R1 AI for cheap....

https://www.youtube.com/watch?v=e-EG3B5Uj78
I trust Dave and his talent. Despite my long-standing interest in topics like this, I find it beyond my comprehension. I suppose age is catching up with me.
  #13  
Old 02-08-2025, 09:29 AM
Decadeofdave Decadeofdave is offline
Senior Member
Join Date: Mar 2019
Location: Marblehead, Ohio / Virginia Trace
Posts: 471
Thanks: 268
Thanked 554 Times in 236 Posts
Default

No thanks, don't need it. I don't like playing with things I don't understand.
  #14  
Old 02-08-2025, 12:58 PM
MorTech MorTech is offline
Platinum member
Join Date: Jan 2017
Posts: 1,699
Thanks: 0
Thanked 585 Times in 363 Posts
Default

Video on Jetson Orin Nano Super Developer Kit...$250.

https://www.youtube.com/watch?v=fcGD7kHgxqE
  #15  
Old 02-08-2025, 02:35 PM
Velvet's Avatar
Velvet Velvet is offline
Sage
Join Date: Mar 2019
Posts: 5,751
Thanks: 1,276
Thanked 4,425 Times in 1,949 Posts
Default

Thank you, but DeepSeek offline models can’t do what I want to do at this time. I am interested in art. Perhaps when they are more developed.

For example, neither ChatGPT nor DeepSeek can sing “Alegria” by Cirque du Soleil translated to English for me. Neither can either one take one of my oil paintings and change the style while maintaining the composition.

They’re pretty good at reasoning though. I could ask why does my golf cart stalls, for example.

Last edited by Velvet; 02-09-2025 at 11:30 AM.
Reply

Tags
deepseek, running, locally, run, local


You are viewing a new design of the TOTV site. Click here to revert to the old version.

All times are GMT -5. The time now is 01:53 PM.