I cant stand practicing my rudiments. is this going to become a big problem down the road?
There are plenty of drummers who DON'T practice rudiments. Most of my students who have chosen this path have regretted it later.
Rudiments are the BASIS of drumming just like scales and chords are the basis of playing guitar or keyboard. Ignore them and you will be depriving yourself of an opportunity to be an EXCELLENT drummer.