It sounds like you might have part of the method figured out but you are missing a big portion that really makes this fooling. The short answer is this, there's no scenario in which the effect doesn't work out. The prediction ALWAYS works no matter what the spectator does during the trick.