James Allen "Babe" Brown (July 31, 1900 – June 23, 1965) was an American football and basketball coach and college athletics administrator. He was the head coach in basketball and football at the University of Idaho in Moscow, and later a three-sport coach and athletic director at the College of Idaho in Caldwell. He also coached multiple sports at four high schools in Idaho: Lewiston, Burley, Moscow, and Nampa.