As the title says, one of my grammar schedules is giving me more questions than my study goal limit. Here are the settings which I believed would give me one quiz with fifteen questions, five of which are new terms.
My dashboard shows the correct number:
When I start it I get five new terms and then this:
It says 1 of 25. Changing the quiz size to 10 gives me 1 of 20 instead. I also noticed on my other grammar schedule, which is a combination of all the previous grammar schedules, that if the number of questions I need to study is less than the quiz size it will give me the number I need to study and then when the quiz is over it will suddenly have two or three more questions to study. I unfortunately don't have a screenshot of that.
Do you mind doing the following for me? Next time it happens (just once is fine) - tap the ? button at the top of the app, and send in a quiz error report? That'll help me figure out what's going on.
Grammar schedules do have a few things with them that can affect this number, but I'd like to check out the quiz data before saying anything.
I sent a report. I noticed that if I put the quiz size to 5 I get 15 questions. I guess it is adding 10 questions every time. I also noticed that all the questions had to do with the five grammar terms I learned today with none of the sentences being related to the previous terms. I noticed this yesterday as well, but I wasn't sure if it was just a coincidence.
Gotcha, thanks. So it is working as designed, but it's a design choice that I've been struggling with, and trying to decide how to handle going forward.
Because there is only one study vector for grammar, and because grammar is inherently more complex with more usage variation than say recalling info for a word or a kanji character, the system is built a bit differently. While words/kanji will go up one mastery level each time you get it right, grammar goes up 1/3 a level. To balance that out, you get three grammar questions (three sentences) per quiz. So if you're studying ながら, you'll get three ながら questions in one quiz, and if you get all three right, that's your mastery level.
So what is happening is correct in that it's 5 grammar expressions = 15 questions. That doesn't make complete sense from a user perspective, though, and that's where I'm at a bit of a crossroads.
If the quiz size is treated like any other schedule, then you may get an expression that doesn't get all three questions out, and then you'd have the expression show up in the next quiz (although this may be acceptable). However, if I switch the grammar over to "1 question = 1 mastery level", I do not feel that renshuu is going to do a good enough of a job reviewing the grammar expression for the user.
I am continuing to think on it, and I might make a change and see what the user reaction is, but until then, I'm happy to hear comments on the issue.
Oh, and to add a bit more confusion on top of it, the triple questions per expression currently only occurs for newly introduced terms, although I plan to change that immediately.
Ah, so when I originally set the quiz size and study goal to 15 it was giving 15 study questions for the five new terms and then 10 extra review questions? When I dropped to 5 it just gave me the 15 new term questions but didn't give me any review questions since I had already exceeded the study goal. I guess that makes sense, but its not really what you would expect since in all the other schedules putting the quiz size at 15 gives you a quiz of 15 questions. I might have to do some experiments to see how I can make this work. I don't want to make the quiz size too much higher because I have a lot to study every day with all of the other schedules I have and grammar is by the far the hardest one for me, but I also want to be able to review the previous day's lesson and at the current size I only see today's terms.
Another weird thing happened. So, I decided to lower the new terms per quiz to 1 and made the quiz size 5 so I would hopefully get three study questions for the new term and two review questions per quiz (I realize now that this is no different from just having the original 25 questions with five terms, but whatever). This seemed to confuse something because after two quizzes it said I had no more new terms to study today even though I should have three more.
If I change the max new terms per day to 10 it says I have five to learn, so it really does think I studied five new terms even though I only studied two.
I think I am going to go back to 5 new terms and 25 quiz size and I might start the schedule over since I'm worried it might have skipped over three terms somehow, but I thought you should know about the weirdness. I'll send another report with the current setting (quiz size 5, study goal 25, new terms 1, max new terms 10) in case it can give you more information about what is going on.
So I did the above and took one test with one new term. It now says I have three to learn meaning it counted the one new term twice. Also, instead of getting three questions for the new term and two review questions, I only got two questions for the new term (てすみません) the other three were もしも~なら.
