Specialized models can be made incredibly efficient. The big tech guys are trying to replace humans which is why their crap takes such huge servers to run. Building local-first/only just means you need to specialize the model and the pipeline to match what you’re doing