"I'm afraid of my wife!", Jamie Dornan frankly rejected Dakota and claimed to be just a co-star