Right after ipaddr_reset_filter(), filter.family is always AF_UNSPEC.
Signed-off-by: Phil Sutter <phil@nwl.cc>