Yeah its basically to compare A to B, where A and B can be settings on a plugin, same song before and after processing or even two different songs. The important part of AB testing is that you can switch back and forth from A to B instantly, with a single click, so that you can compare them without any distraction in between. Setting up your DAW to make AB tests can be very helpful to get good results sometimes.