We examined factors that determine the outcome of agonistic encounters between male pygmy swordtail fish. Xiphophorus nigrensis and X. multilineatus males formed dominance relationships based on body size in staged laboratory encounters. There was a significant negative correlation between size asymmetry and fight intensity, suggesting that males assessed size in the encounters. However, a significant proportion of the variation in fight intensity in contests that escalated to bites could not be explained by size asymmetry. Aggressive motivation may also influence the outcome of contests and could be assessed in agonistic encounters. Theory suggests that signals of aggressive intention will be evolutionarily stable if individuals can recognize opponents and encounter one another repeatedly. In addition, individual recognition is one way that dominance hierarchies can be maintained. Here we demonstrate that males from both species can recognize individuals. In addition, at least some X. nigrensis males were site-faithful in the field, suggesting males encounter the same opponents repeatedly.