Knowing when and how humans should be in the loop will make or break a product going forward.