For anyone arriving from the general PC side: on mobile workstations the thing that decides whether a local model runs acceptably is almost always whether its working set fits in VRAM, not how fast the GPU is.
Once you spill out of VRAM the transfer over the bus dominates and the generation rate collapses. A slower GPU with more memory will frequently beat a faster one with less on the same model.
- Check the actual VRAM figure for your SKU, not the family. Mobile parts vary within the same model name.
- Account for the display using VRAM as well, particularly with external monitors attached.
- Quantisation changes the working set substantially and is usually the first lever worth pulling.