Yes, pull the boots off of the coils. Put some dielectric grease around the plastic part of the coil that the boot slides over. Put some grease on the inside of the boot where it goes over the spark plug. It's also good to put some around the insulator of the spark plug.
It seems that many don't understand the purpose of the dielectric grease. It is used to make a good air and water tight, non-conductive seal around the boot, to prevent arching. The grease is an insulator. It shouldn't be used on the spring inside the boot, or on the metal part of the spark plug. You want conductivity there, not insulation. (Yes, it usually still works if you put some between the spring and the plug, but that's in-spite-of, not because-of the grease that it works.