What power source are you using, how many and wich devices are connected by usb?
Try removing usb devices one by one and check everytime if it gets better. Seems like a power issue. Also read about someone getting constant hickups when he connected a usb ethernet adapter from a certain brand.