It is absolutely immoral for you to permit anyone to behave badly toward you. Do you think you do something good for someone else when you let him get away with harmful behavior toward you? Of course not! You drive him further away from reality by not being true to yourself and true to Truth.
A Man interrupted one of the Buddha's lectures with a flood of abuse. Buddha waited until he had finished and then asked him, "If a man offered a gift to another but the gift was declined, to whom would the gift belong?"
"To the one who offered it," said the man.
"Then," said the Buddha, "I decline to accept your abuse and request you to keep it for yourself."
Here is a powerful video clip that anyone with kids should watch - "Kids Watch"