I used to get a bit of that due to client side issues, not the game. I beefed up my system and it never happened again.
It was like having a lag between trying to do things and when the commands were executed (so you were already on to something else or had clicked other things etc..)...was hard to play. Things were processing too slowly. The extra RAM I put in seemed to make the biggest diff.