I want to enhance my GPU performance- Acer A515 58GM

sunnyman · March 2024

I have Acer A515 58GM, but i am not able to run even 7B LLM models or even 3B models for my college project and i want to know what are my upgrade options and what kind of tools and devices i need to upgrade it

OS is windows 11, has i7 1355U(obviously not cool), 16GB RAM, and RTX 2050 has VRAM 4GB Dedicated and 12GB Shared RAM + Intel Iris Xe which has shared GPU Memory 8GB. has thunderbolt port 4, HDMI port 2.1, USB 3.0 aswell i think should give enough bandwidth and support to connect and run almost anything

Any help is appreciated as i am new to PC components and do not know what to buy for my particular usecase as i do not understand all the tech around all the PC components.

Thank you

StevenGen · March 2024

https://community.acer.com/en/discussion/701615/i-want-to-enhance-my-gpu-performance-acer-a515-58gm

The Aspire A515 58GM hasn't got the specs to run 7B LLM models or even 3B models, its gpu the RTX2050 4GB VRAM is not adequate enough, you need at least 6GB VRAM for the gpu memory for these software's to run properly. Upgrade your laptop to either a Nitro or a Predator laptop that has a minimum spec RTX 3060 with a 6GB VRAM gpu so that it can run 7B LLM models or 3B models software perfectly, btw, all this is written in these software's specifications:

Mistral LLM (7B)

For running Mistral locally with your GPU use the RTX 3060 with its 12GB VRAM variant. With 12GB VRAM you will be able to run the model with 5-bit quantization and still have space for larger context size.
Alternatives like the GTX 1660, RTX 2060, AMD 5700 XT, or RTX 3050 can also do the trick, as long as they pack at least 6GB VRAM.

If this answers your question and solved your query please "Click on Yes" or "Click on Like" if you find my answer useful👍

StevenGen · March 2024

https://community.acer.com/en/discussion/comment/1263029#Comment_1263029

Increasing the VRAM (Video Random Access Memory) of a graphics card is not directly possible. The VRAM is a physical component of the GPU (Graphics Processing Unit) and is soldered onto the card during manufacturing. However, I can provide some insights: VRAM Limitations, the NVIDIA GeForce RTX 2050 typically comes in two variants: one with 6GB of VRAM and another with 4GB of VRAM, unfortunately, you cannot upgrade the 4GB version to 6GB because the VRAM is fixed and cannot be modified after purchase in a laprop like you couyld change the gpu in a desktop, so you are stuck with the RTX2050 4GG VRAM.

If this answers your question and solved your query please "Click on Yes" or "Click on Like" if you find my answer useful👍

Puraw · March 2024

https://community.acer.com/en/discussion/comment/1263028#Comment_1263028

Read this about the soldered memory for your laptop: https://laptopmedia.com/review/acer-aspire-5-a515-58m-review-snappy-device-with-very-good-display-and-low-price/p7/

Puraw · March 2024

https://community.acer.com/en/discussion/701615/i-want-to-enhance-my-gpu-performance-acer-a515-58gm

The memory provided is soldered to the board so you cannot upgrade RAM or VRAM. I recommend upgrading to a new high-end laptop for your work.

StevenGen · March 2024

https://community.acer.com/en/discussion/701615/i-want-to-enhance-my-gpu-performance-acer-a515-58gm

The Aspire A515 58GM hasn't got the specs to run 7B LLM models or even 3B models, its gpu the RTX2050 4GB VRAM is not adequate enough, you need at least 6GB VRAM for the gpu memory for these software's to run properly. Upgrade your laptop to either a Nitro or a Predator laptop that has a minimum spec RTX 3060 with a 6GB VRAM gpu so that it can run 7B LLM models or 3B models software perfectly, btw, all this is written in these software's specifications:

Mistral LLM (7B)

For running Mistral locally with your GPU use the RTX 3060 with its 12GB VRAM variant. With 12GB VRAM you will be able to run the model with 5-bit quantization and still have space for larger context size.
Alternatives like the GTX 1660, RTX 2060, AMD 5700 XT, or RTX 3050 can also do the trick, as long as they pack at least 6GB VRAM.

If this answers your question and solved your query please "Click on Yes" or "Click on Like" if you find my answer useful👍

sunnyman · March 2024

https://community.acer.com/en/discussion/comment/1262989#Comment_1262989

I mean yeah sure, but it clearly says expandable memory on the laptop sticker, and they won't tell a lie like that so RAM should be expandable but I am thinking how can I fit the models in my GPU because the VRAM is clearly not enough to run most LLM/ML models even 3B models, and i want to explore my options of upgradation to be able to run those

Somebody suggested eGPU option but the GPU Deck and other components are costing around 800$ not counting the GPU itself and increasing RAM is another option but it wont' really help because what the programs really need is VRAM and not shared VRAM which has low transfer rate and will only be allocated if the ram is not already using it.

sunnyman · March 2024

https://community.acer.com/en/discussion/comment/1262999#Comment_1262999

I think upgrading to a new laptop could be an option but I bought this just 3 months ago and i don't think can afford that again and plus those with good GPU cost more, if we have some bit cheaper alternatives to solving my problem, that involve using my current specs that would be really cool.

StevenGen · March 2024

https://community.acer.com/en/discussion/comment/1263029#Comment_1263029

Increasing the VRAM (Video Random Access Memory) of a graphics card is not directly possible. The VRAM is a physical component of the GPU (Graphics Processing Unit) and is soldered onto the card during manufacturing. However, I can provide some insights: VRAM Limitations, the NVIDIA GeForce RTX 2050 typically comes in two variants: one with 6GB of VRAM and another with 4GB of VRAM, unfortunately, you cannot upgrade the 4GB version to 6GB because the VRAM is fixed and cannot be modified after purchase in a laprop like you couyld change the gpu in a desktop, so you are stuck with the RTX2050 4GG VRAM.