CaFe₂O₄ is an anisotropic S = ⁵/₂ antiferromagnet with two competing A (↑↑↓↓) and B (↑↓↑↓) magnetic order parameters separated by static antiphase boundaries at low temperatures. Neutron diffraction and bulk susceptibility measurements, show that the spins near these boundaries are weakly correlated and a carry an uncompensated ferromagnetic moment that can be tuned with a magnetic field. Spectroscopic measurements find these spins are bound with excitation energies less than the bulk magnetic spin waves and resemble the spectra from isolated spin clusters. Localized bound orphaned spins separate the two competing magnetic order parameters in CaFe₂O₄.