Performance grade counts yes, can check this by selecting the Performance Grade Tab, from there you select per item arrow-drop down for instructions on improving..
i have tested my site with and with out the compressor plugin and it does not make any difference in fact the changes i have made to my htacees file my site runs faster with out the plugin