Hi,
Can you please elaborate on which interface you applied the filter.
If you share the config, it might be helpful.
You could also apply the filter as an output filter if you're applying it on the same interface as where the servers reside to filter on outgoing traffic from the RVI interface.
The principle is similar to Cisco, where you apply the access-lists in 'in' or 'out' direction.
Cheers,
Ashvin