Sounds like you are hitting the high current limit on start off. If the only time it does that, you are attempting to run too many amps for the controller so a lighter foot is needed until the motor is spinning. Try the ice technique of revving motor then slip the clutch if you have one.
Could also be the low battery limit due to sag.
Could also be the low battery limit due to sag.