How can I create a custom quality check rule?

You can use Rules Assignment under the System Options.