Consensual affairs "none of your business," GOP candidate's lawyer tells media.