Smell and safety.
Perfumer’s alcohol is sort of like very strong vodka… very neutral odor. (unlike vodka, it does have a profoundly bitter taste, due to the “denaturing agent” added to deter consumption)
Ethanol is safe for application to the skin. Even if it absorbs, your body knows exactly how to metabolize it into harmless byproducts, like acetic acid (vinegar).
Isopropyl alcohol stinks in a very upleasant way, and is not safe for ingestion, and thus shouldn’t be thought of as safe for skin application.
I know, I know – it’s sold as a topical skin disinfectant at pharmacies. But that’s quite myopic. It’s really NOT safe. It’s an EXCELLENT skin penetrating agent, and you do get some into your bloodstream.
The liver metabolizes isopropyl into acetone (found in nail polish remover, for one), for goodness sake. Would you drink acetone, or put that on your skin? 
That’s why it has toxic warnings on the side of the bottle, telling you not to drink it.
In alternative medicine, it’s even been implicated as being a food source for parasites. Have no idea if that’s true or not (or if it could even easily be proven), but it’s an unpleasant thought, nonetheless.
I’m not going to say that ethanol (perfumer’s alcohol and drinking alcohol) is completely safe, but recent research shows that it could be a valuable stressor. i.e., the relatively low damage it does, could actually be spurring your body on to
One very interesting study published in the International Journal of Neuropsychopharmacology shows that low doses of ethanol actually increased hippocampal cell proliferation and neurogenesis in mouse brains.
So, i.e., mildly “bad things” can be good for the body, because of the beneficial way the body reacts. It’s like exercise. Exercise is a mild stressor, and we react to it wonderfully.
On the other hand, isopropyl alcohol is simply too toxic to put into this category. There’s no good that comes from the bad it does.