A 47-year-old Cape Town priest is being held by police on a charge of assaulting his neighbour - whose wife he was allegedly trying to have an affair with.

The priest, from the Samora Machel informal settlement, will appear in court soon and cannot be named as he has yet to plead.

Vegetable vendor Lindikhaya Mpehle said the priest, who is his neighbour, had left him with facial scars and a bruised dignity after beating him up without provocation.

To add insult to injury the priest's 16-year-old son allegedly assaulted Mpehle.

"My wife Asanga told me the priest proposed to her several times," Mphele said.

"I told his wife. We had a meeting and the priest apologised.

"I don't know why he attacked me."

Street committee chairperson Norman Ngindoyi said he saw the two beating up Mpehle and intervened.

Nyanga police spokesperson Ntomboxolo Sitshitshi said father and son would appear together, though the priest's son had been released pending their appearance.