James Albert Duffy (September 13, 1873 – February 12, 1968) was an American prelate of the Roman Catholic Church who served as the first bishop of the Diocese of Grand Island in Nebraska from 1917 to 1931. He previously served as bishop of the Diocese of Kearney in Nebraska from 1913 until its dissolution in 1917.