If you do the math, 64 samples in a 44.1kHz session is 0.00145124717 second of latency, or about 1.5 ms. Plus whatever the hardware latency is and whatnot as well, but yeah.
Well you've got a total of about 9ms (5.2ms in and 4.3ms out = 9.5ms total) at a buffer of 64. But you may have to raise your buffers higher than 64 to get any decent performance from your system. My system will run at about 2ms at a buffer of 64, but I run my buffers up to about 256 for 9ms. My point is to see how your system will run at 64 samples. Mine runs a whole lot more tracks and VSTis at 256. So you may have to raise your buffers to get decent performance which will mean higher latency, but even 20ms is workable. When I'm mixing and Im done running any VSTi's ( that have to monitor in real time), I raise my buffers up as high as 768, at that point the latency doesn't matter. Latency only matters when your monitoring in real time i.e. VSTis amp sims, live effects.