“She knew it was my way or the highway,” he said