The ssh extension for visual studio code I think can help a lot with some of the complaints you mentioned.

You keep your source code on the remote workstation that is beefy. You run an ssh server on it and from you local environment run a copy of vscode. When you pick an ssh host it spins up a remote code server instance on that workstation and forwards all the important stuff. It really feels like you're working entirely locally.