We present a set of necessary conditions for the appearance of charge and spin Josephson diode effects across strongly spin-polarized inhomogeneous magnetic materials (FM) placed between two spin-singlet superconductors. Noncoplanarity of the FM’s spin texture gives rise to quantum geometric phases, \(\Delta \varphi '\) , that enter the Josephson current-phase relation (CPR) similarly to the superconducting phase difference, resulting in charge and spin Josephson diode effects. Our study shows that such effects appear if the CPR possesses no phase-inversion center, achieved under the following conditions. First, noncoplanarity of the spin texture is necessary to break the spatial inversion symmetry. Second, strong spin polarization of the FM that leads to different transport characteristics for the two spin bands. Third, both spin bands have to contribute to the transport, i.e., the effect is absent in half-metallic junctions. Finally, higher harmonics in the CPR are necessary, i.e., the effect is absent in the tunneling limit. However, even in this case, the CPR must not have a phase-inversion center, which is ensured by the restriction of the quantum geometric phase to values \(\Delta \varphi '\ne k\pi /2, k\in \mathbb {Z}\) . We formulate a minimal phenomenological model that incorporates all these points, qualitatively illustrating our theory.