/g/ - How can I run 670Billion ...

Sitewide Rules
You must be 18 or older to post.
Sharing personal details or engaging in doxing is strictly prohibited.
Political discussions should be confined to /pol/.
Off-topic discussions, thread derailment, or spam may result in a ban and IP blacklist.
Pornographic content is strictly prohibited.
Any activity violating local laws is not allowed.
If you are not an Indian, you can only post in /int/. Or create and account and ask for approval to post in other boards.

Anonymous

ReAqXj

13/04/25 (Sun) 19:21| Last Reply: 7 months 18 days ago

No.701

Select Post

How can I run 670Billion parameters model of deepseek r1 locally? i am tired of getting busy server on reasoning model.

Anonymous

h6opeY

13/04/25 (Sun) 19:40

No.702

Select Post

There are some open-source ai platforms.

Whats your spec, it needs beefy gpu anyway

Anonymous

5MfGID

13/04/25 (Sun) 20:06

No.703

Select Post

>>702

Well it's a low end laptop with nvidia rtx 2050 4gbvram and 16gb ram and i5 11th gen.

https://vicharak.in/axon

I also saw on Twitter saying something that you can run models on this. So if any anon is aware I would like to know.

Anonymous

ScyjhP

13/04/25 (Sun) 20:08

No.704

Select Post

>>701(OP)

>670Billion parameters

max 67 billion parameters

you can't run it on any laptop

Anonymous

ScyjhP

13/04/25 (Sun) 20:08

No.705

Select Post

>>704

>max 67 billion parameters

in case of deepseek

/g/ - Technology

Board dedicated to discussions related to everyday Technology!

Recent Posts

Gemini+Figma for UI

/emacs/ general

Simple Linux General /slg/ - Useful Commands editi...

Jio Fiber

LEARNING SPREADSHEETS

My Biggest Project (till date)

AI image gen

Zerodha just donated 100,000 usd to FFMPEG

ITS HAPPENING

CAN SOMEONE EXPLAIN ME HOW THESE JOB DESCRIPTIONS ...

the best android browser has arrived!!

/compiler_develoment/ thread

Pajeet doval

/g/ - Laptops

Esp32 Jammer

Help me move away from winblows

दोमेन

the hmd touch 4g

I am done. It's over.

Jokes write themselves

AWS outage

took them long enough

just installed Arch Linux bros

Where to apply

Is the battery of my laptop dead?

OpenCL

Where are we heading towards?

does this ever end?

Zoho appreciation thread

new discord server for pair-programming

Looking to Buy a Decent Gaming Laptop

which llm subscription is the best

RSS feed for Bharatchan ?

Sketch - A simple 2D graphics library in C

/g/ - Technology

Board dedicated to discussions related to everyday Technology!

Notice

A poster on BharatChan must abide by the following rules:

Recent Posts

Gemini+Figma for UI

/emacs/ general

Simple Linux General /slg/ - Useful Commands editi...

Jio Fiber

LEARNING SPREADSHEETS

My Biggest Project (till date)

AI image gen

Zerodha just donated 100,000 usd to FFMPEG

ITS HAPPENING

CAN SOMEONE EXPLAIN ME HOW THESE JOB DESCRIPTIONS ...

the best android browser has arrived!!

/compiler_develoment/ thread

Pajeet doval

/g/ - Laptops

Esp32 Jammer

Help me move away from winblows

दोमेन

the hmd touch 4g

I am done. It's over.

Jokes write themselves

AWS outage

took them long enough

just installed Arch Linux bros

Where to apply

Is the battery of my laptop dead?

OpenCL

Where are we heading towards?

does this ever end?

Zoho appreciation thread

new discord server for pair-programming

Looking to Buy a Decent Gaming Laptop

which llm subscription is the best

RSS feed for Bharatchan ?

Sketch - A simple 2D graphics library in C