Anya Taylor-Joy and Miles Teller both answer "Yes" to the question if there is an actor they refuse to act with again