Motivated by our recent discovery of large gyrotropic signals in some Jahn-Teller manganites, here we explore the interaction of light with spin-mixed $t_{2g}-e_g$ states in a $d^4$ transition metal. We show that spin-orbit mixing enables electronic transitions that are sensitive to circularly polarized light, giving rise to a gyrotropic response that increases with spin-orbit coupling. Interestingly, photoexcited transitions that involve spin reversal are behind such gyrotropic resonances. Additionally, we find that the interaction with the electromagnetic field depends strongly on the relative orientation of the propagation of light with respect to Jahn-Teller distortions and spin quantization. We suggest that such interactions offer the opportunity to use electromagnetic waves at optical wavelengths to entangle orbital and spin degrees of freedom. Our approach, which includes a group-theoretical treatment of spin-orbit coupling, has wide applicability and provides a versatile tool to explore the interaction of electromagnetic fields with electronic states in transition metals with arbitrary spin-orbit coupling strength and point-group symmetries.