midi controller latency

[bilibilek]

i bought the audiophile 2496, and connected an edirol pcr50 keyboard controller to it. (i do the recording in cubase sx.1)
when i put the mic in, the asio latency with a high sample rate is 6 miliseconds.. thats great.
but when i try to play the keyboard realtime, it is still late. i try fruity loops, whichever synth i run, it's late. i try cubase 5.. now that goes about right... i only click on a midi channel, it's okay. but when i try to choose a different sound, i switch it o GM Voices, and it's late again... is there any way to make it sync or should i just use a different synth software?