You can use ip address and port as firewall filter criteria.
The requirements are where to apply the filter based on what type of interface you are doing the evaluation of the filter.
It sounds like you will be doing a layer 3 interface filter on the switch that routes between the VLANs involved. Probably the RVI interface you have configured. The desired filter would applied with these instructions.