He was speaking on the latest death of an unarmed civilian involving police action in Embilipitiya.
Senasinghe suggested setting up a special institution to monitor the actions of the Police.
Sri Lanka's police needs an 'internal affairs division' to look into allegations of misconduct and State Minister of International Trade, he added.
"It is essential to have an independent unit that makes sure the police is on the right track," he further said.
Senasinghe said there were many officers in the police who were doing a good job. Some police officers also had financial difficulties which may be causing them to engage in petty corruption.
He said probes were ongoing including an internal one by the police. He said he was not suggesting that an internal investigation into the death of a civilian in Embilipitiya was not conducted fairly.
He expected final reports to be ready after getting court clearance.