Nonstandard η–η′ mixing and the nonleptonic B and Λb decays to η and η′

Radial mixing in the pseudoscalar η–η′ systems can be generated from hyperfine interactions and annihilation terms. For the η–η′ system we find the effects of radial mixing are appreciable and seriously affect the decay branching ratios for B→η(η′)K(K∗), mainly by modifying the B→η(η′) form factors. In particular, the effect of radial mixing in conjunction with the interference effects among penguin amplitudes can resolve puzzles in the B→η(η′)K decays. The decay Λb→Λη(η′) on the other hand is dominated by a single amplitude so that the significant interference effects of B decays are absent here. Moreover, since no Λb→η(η′) form factors are involved here, the effect of radial mixing is essentially negligible. Hence, unlike the B system, we do not predict a large enhancement of Λb→Λη′ relative to Λb→Λη.