Hello billyjakester,
Had the same problem with mine. I ended up pulling the rubber pcs out and cleaning the inside of them real good with some brake cleaner (or carb cleaner). Either way, really solvent stuff to remove any glue. Then, I lightly roughed up the inside of the rubber pcs with some sandpaper so they weren't so slick.
On the handlebar, I also cleaned it real well with some highly solvent stuff, then (heaven forbid) roughed up the chrome end of the handlebar lightly with sandpaper also.
I think the glue I used was automotive "Amazing Goop", but I've heard of folks using silicone too. Hopefully others will chime in with what they used for adhesive.
Seems like Kuryakyn leaves a slick film of something on the rubber, maybe a release agent sprayed on the mold when they're being fab'd.
Good Luck!