I have been reading about the low latency path and that it's best to use the native buffer size and sample rate else the resampler would cause high latency?

It's not the resampler which causes high latency, but AudioFlinger uses more buffers and different internal routing. The resampler may cause additional latency, but it's not that significant. The low latency path for audio output consists of low latency AudioTrack (on the client side) and fast mixer (in AudioFlinger).