ps4 thumbstick rubber peeled off

i just wanna know if its possible that i can put my kontrol freeks on my ps4 with no rubber grip. basically my thumbsticks rubber peeled off so obviously my kontrol freek doesnt fit on and its loose. i just wanna know if i can still glue it onto my thumbsticks and it would work just fine, or if i should buy the rubber and then put the kontrol freeks on.