The second factor is Rehabilitation;
You can't justify committing crimes against a person who is a 'known criminal' who may very well be on the path to rehabilitation. Interacting with society and attempting to reform their ways, they may well have not committed an offence for an exceedingly long period of time (5, 10, 15 years), that they committed one offence doesn't necessarily mean they should be subject to criminal offences, nor should it be acceptable for that. There has to be a period of time that allows the offender to not re-offend, in fact plenty of people don't re-offend, people do minor crimes, usually when young and doing something in the heat of the moment, or down to immaturity and deserve the chance to get back into their lives as the criminal system and society is want to do.
A third factor, is that each crime is an individual incident that requires in-depth examination of the circumstances. Some are victims of circumstances, some are victims of provocation or of a situation they weren't fully aware of. Plus, the legal system in some events do not allow for defences to some offences, for example being an 'illegal alien' in the UK without permission was an offence that only required you to BE in the UK without permission, it had no defences to that charge, (going off memory) a woman was evicted from France border control and put on a plane to England, she was arrested on the spot and charged and convicted of that crime before being deported back to her homeland of Ireland, is she too, now a target that is acceptable? She has the criminal record, for something she had no control over.
The more you know of the intricacies of law, the way it operates, the defences, the non-defences and the purposes of the legal system, the more you can attempt to rationalise whether something is 'acceptable' or not. I think the reasons I've given, more than explain the reasons why the answer to your statement is 'no', and I believe there is no way, an educated person of law could argue otherwise, as a whole and not in 'parts' or in scenarios, how the law would be able to operate within its system on an objective basis and any attempts to do so in a subjective manner would result in the power going to a person, or group of persons who would eventually be the victim of 'he who fights monsters'.