Rufus Sargent (1812-1886) was an American architect practicing in Newburyport, Massachusetts during the nineteenth century.