Carthage Jail (USA) See also Smith, Hyrum; Smith, Joseph, Jr. Joseph and Hyrum Smith were murdered by a mob on June 27, 1844, at the jail in Carthage, Illinois, United States of America (D&C 135).