It seems to try to keep the full recipe in it's input. So long as you have more than one item in every stack, it will make things automatically. To have it make the final one (and use up everything in at least one stack), you need to click on the output to confirm that, yes you do want it to do that. I guess the reasoning would be if it used everything up and lost its recipe, automatic setups would break.