He was 94.
Hill died in Monsey, New York, according to The New York Times.
Hill was part of the "Law & Order" cast for 10 years until he left in 2000.
His character's dry wit made him a fan favorite.