The incident happened after an FA Cup match involving Kallon's team, Kallon FC Jr, in Freetown on Thursday.
"I was asked by Isha to talk to Kallon FC fans to leave the ground after the game because the fans were making comments against the referees. But I told her that she should ask them out herself," the ex-Inter Milan and Monaco striker told BBC Sport.
"She then slapped me on the back of my neck. I didn't retaliate and I even restrained my supporters from retaliating.