  The High Energy Stereoscopic System (H.E.S.S.) observatory has carried a deep
survey of the Galactic plane, in the course of which the existence of a
significant number of ($\sim$ 78) TeV $\gamma$-ray sources was confirmed, many
of which remain unidentified. HESS J1828-099 is a point-like (Gaussian stand.
dev. $<$ 0.07$^{\circ}$) unidentified source among the 17 confirmed point-like
sources in the H.E.S.S. Galactic Plane Survey (HGPS) catalog. This source is
also unique because it does not seem to have any apparent association with any
object detected at other wavelengths. We investigate the nature and association
of HESS J1828-099 with multi-wavelength observational data. A high mass X-Ray
binary (HMXB) - comprising of pulsar XTE J1829-098 and a companion Be star -
has been observed earlier in the X-ray and infrared bands, 14$'$ away from HESS
J1828-099. With 12 years of $\textit{Fermi}$-LAT $\gamma$-ray data, we explore
the possibility of 4FGL J1830.2-1005 being the GeV counterpart of HESS
J1828-099. Within the RXTE confidence region, a steep spectrum
($\alpha_{radio}$ = - 0.746 $\pm$ 0.284), plausible counterpart is detected in
data from existing radio frequency surveys. In this letter, we probe for the
first time using multi-wavelength data, whether HESS J1828-099, 4FGL
J1830.2-1005 and the HMXB system have a common origin. Our study indicates that
HESS J1828-099 might be a TeV high mass $\gamma$-ray binary source.
