In a media statement, Polye made the promise when he toured the Gloucester Health Centre in West New Britain Province on Friday.
As well as improving the infrastructure, he said their wages and living conditions would be looked into.
"Our Triumph Heritage Empowerment Party wants all the districts to have a hospital each. Also all the LLGs to have a sub-health centre each whilst all wards to have a clinic or an aid post each.
“We will ensure they have specialist doctors, HEOs and nurses to serve our people better," he said.
Meanwhile, Polye expressed shock at the state of deteriorating medical facilities at the health centre.
He was also informed of how drug shortages were caused by late deliveries and that patients had to pay for those on short supply.
Polye says a THE Party led government would build four regional referral hospitals in the country, coupled with sufficient operational funds and drugs.
He added that, better still, he would look into converting some of the existing facilities into children, cancer and women hospitals in each region, as well as an upgrade of the cancer unit in Lae’s Angau Hospital and other similar facilities in the country.