放虎归山 (fàng hǔ guī shān): To let a dangerous enemy or threat go free (idiom) — Meaning & Stroke Order

Letting that criminal go is like releasing a tiger back to the mountain; he will definitely commit crimes again.