Machine learning set up

[panatha1369]

Επειδη το machine learning ειναι το νεο trend και σκεφτομαι να ξεκινησω και εγω θα ηθελα πληροφοριες απο ατομα που εχουν ηδη στησει τετοια μηχανακια..Τι μοντελο llm δουλευουν hardware που εχουν κλπ..Σκεφτομαι να ξεκινησω με deepseek R1 και   Llama 3.3..

[daemonix]

On 03/02/2025 at 09:53, panatha1369 said:

Επειδη το machine learning ειναι το νεο trend και σκεφτομαι να ξεκινησω και εγω θα ηθελα πληροφοριες απο ατομα που εχουν ηδη στησει τετοια μηχανακια..Τι μοντελο llm δουλευουν hardware που εχουν κλπ..Σκεφτομαι να ξεκινησω με deepseek R1 και   Llama 3.3..

I just posted something on this thread (maybe its useful for you too) 

 

 

Depending on your hardware first.. I would start with ollama (or maybe LM Studio? Im not sure if there is a Windows version though).

You first need to understand the level of intelligence you need for your tasks. This in most cases dictates the size (3b, 14b etc) of the model you need.

Start with Gemma3 or Phi4 models. Llama3 is also an option.

Whats your current system? 

[panatha1369]

32 λεπτά πριν, daemonix είπε

I just posted something on this thread (maybe its useful for you too) 

 

 

Depending on your hardware first.. I would start with ollama (or maybe LM Studio? Im not sure if there is a Windows version though).

You first need to understand the level of intelligence you need for your tasks. This in most cases dictates the size (3b, 14b etc) of the model you need.

Start with Gemma3 or Phi4 models. Llama3 is also an option.

Whats your current system? 

5600gt onboard gpu 32gb ram

i have lm studio in windows 11 and as lm model i have gemma 3 Granite llamma 3.2 and dolphin

[daemonix]

14 hours ago, panatha1369 said:

5600gt onboard gpu 32gb ram

i have lm studio in windows 11 and as lm model i have gemma 3 Granite llamma 3.2 and dolphin

How's the performance?

What sort of tasks do you need to run?