Augustine of Hippo

(de Con. in Evan. ii. 1.) He however might be called His father in that light in which he is rightly regarded as the husband of Mary, that is, not from any carnal connection, but by reason of the very bond of wedlock, a far closer relationship than that of adoption. For that Joseph was not to be called Christ’s father was not, because he had not begotten Him by cohabitation, since in truth he might be a father to one whom he had not begotten from his wife, but had adopted from another.