  Starting with the first detection of an afterglow from a short-duration
hard-spectrum gamma-ray burst (SHB) by Swift last year, a growing body of
evidence has suggested that SHBs are associated with an older and
lower-redshift galactic population than long-soft GRBs and, in a few cases,
with large (>~ 10 kpc) projected offsets from the centers of their putative
host galaxies. Here we present observations of the field of GRB 060502B, a SHB
detected by Swift and localized by the X-ray Telescope (XRT). We find a massive
red galaxy at a redshift of z=0.287 at an angular distance of 17.1 arcsec from
our revised XRT position. Using associative and probabilistic arguments we
suggest that this galaxy hosted the progenitor of GRB 060502B. If true, this
offset would correspond to a physical displacement of 73 +- 19 kpc in
projection, about twice the largest offset inferred for any SHB to date and
almost an order of magnitude larger than a typical long-soft burst offset.
Spectra and modeling of the star-formation history of this possible host show
it to have undergone a large ancient starburst. If the progenitor of GRB
060502B was formed in this starburst episode, the time of the GRB explosion
since birth is tau = 1.3 +- 0.2 Gyr and the minimum kick velocity of the SHB
progenitor is v_kick = 55 +- 15 km/s.
