I'm having trouble shifting with my G35...?

I have a six-speed 2006 Infiniti G35 Coupe. It normally shifts well but sometimes when i try to down shift to 1st, 2nd and sometimes 3rd gear it seems really hard and so i wait for the car to slow down and it will go more easily. Any idea why?