A Bengaluru teacher has been arrested for allegedly blackmailing and extorting money from a student's father with whom she had been having an affair.