Little Snitch 4 is using a Network Kernel Extension to perform its network filtering. Apple has discontinued the support for this type of kernel extensions in macOS Big Sur. The system therefore refuses to load the unsupported extension.
Starting with version 5, Little Snitch is therefore using the Network Extension technology instead, which is fully compatible with macOS Big Sur and later.