That is the nature of the firewall filters.
"If none of the filters match the traffic, it then applies the default action.
Note: Bydefault, each firewall filter ends with an implicit deny-all term. The final default action is to discard all packets. The packets that do not match any of the configured match conditions in a firewall filter are silently discarded."
Pl refer the kb fyr.
https://kb.juniper.net/InfoCenter/index?page=content&id=KB13057
Hence, based your configuration, it works as expected.
Apart from host to host communication, any other traffic if you would like to allow, then you will have to explicity permit it..Otherwise it will hit the default-deny term which is happening currently.