Huh, I didn't notice that was happening when I was studying today, though I've been learning kanji recently, and doing more kanji questions, plus I use "tap to reveal choices".
In my opinion, kana questions shouldn't use kanji for any of the answers, like it is with this setting off. I think you should see the words kana only, which I'm just now realizing is how this feature worked before, haha
I don't study both vectors separately, I use the combined "meaning -> japanese" study vector, so if I see a kana selection question, it's most likely a kana-only word anyway, moreso as my kanji coverage expands. That also means that if my selections are three words with kanji, and one kana-only word, it kind of betrays the correct answer.
My use case for this feature is so that when I learn a word, and only know partial kanji, I see the full word in full kanji, as it would be written in the wild, rather than some kanji/kana combination that no native speaker would ever write. Essentially I want to see this:
But nothing like this:
so that I get a better feel for what the word looks like for real (and pick up some recognition along the way for when I actually study the missing kanji!)
If some people want kanji + furigana in the kana questions, perhaps you could split the option?
Disabled | Furigana for Kanji Answers | Kanji + Furigana for All Answers
And then I guess for the kana questions you would force furigana on for all kanji, and leave it unknown-only for Kanji questions. Or you could make another option selector, but that probably overcomplicates things even more.
That's my take on the issue, hope it helps!