  The idea that gamma-ray bursts might be a kind of phenomena associated with
neutron star kicks was first proposed by Dar & Plaga (1999). Here we study this
mechanism in more detail and point out that the neutron star should be a high
speed one (with proper motion larger than $\sim 1000$ km/s). It is shown that
the model agrees well with observations in many aspects, such as the
energetics, the event rate, the collimation, the bimodal distribution of
durations, the narrowly clustered intrinsic energy, and the association of
gamma-ray bursts with supernovae and star forming regions. We also discuss the
implications of this model on the neutron star kick mechanism, and suggest that
the high kick speed were probably acquired due to the electromagnetic rocket
effect of a millisecond magnetar with an off-centered magnetic dipole.
