  The hypothesis that ultra-high energy (>~ 10^19 eV) cosmic rays (UHECRs) are
accelerated by gamma-ray burst (GRB) blast waves is assumed to be correct.
Implications of this assumption are then derived for the external shock model
of gamma-ray bursts. The evolving synchrotron radiation spectrum in GRB blast
waves provides target photons for the photomeson production of neutrinos and
neutrons. Decay characteristics and radiative efficiencies of the neutral
particles that escape from the blast wave are calculated. The diffuse
high-energy GRB neutrino background and the distribution of high-energy GRB
neutrino events are calculated for specific parameter sets, and a scaling
relation for the photomeson production efficiency in surroundings with
different densities is derived. GRBs provide an intense flux of high-energy
neutrons, with neutron-production efficiencies exceeding ~ 1% of the total
energy release. The radiative characteristics of the neutron beta-decay
electrons from the GRB "neutron bomb" are solved in a special case. Galaxies
with GRB activity should be surrounded by radiation halos of ~ 100 kpc extent
from the outflowing neutrons, consisting of a nonthermal optical/X-ray
synchrotron component and a high-energy gamma-ray component from
Compton-scattered microwave background radiation. The luminosity of sources of
GRBs and relativistic outflows in L* galaxies such as the Milky Way is at the
level of ~10^40+-1 ergs/s. This is sufficient to account for UHECR generation
by GRBs. We briefly speculate on the possibility that hadronic cosmic rays
originate from the subset of supernovae that collapse to form relativistic
outflows and GRBs. (abridged)
