You'll want to look at the average to get the rms over the whole track.
However, one should always avoid compressing/processing by the numbers. Use your ears, not your eyes. Wether something 'needs' compression is entirely down to what you want the end result to sound like - there is more than one way to approach dynamics processing and going by the numbers will not get you there by the quickest route.
Get a compressor, experriment with it, see what it does, and then decide if you want to use it.
The numbers can be a bit of a red herring and catch quite a few people out.