xtables: fix the broken detection/removal of redundant addresses

	[To observe this issue, populate a hostname (DNS or local db)
	with multiple adresses across multiple subnets (cf. prefixlen
	below)

	# e.g. /etc/hosts
	127.0.0.2       lo-x
	127.0.0.3       lo-x
	127.0.1.4       lo-x
	127.0.1.5       lo-x
	127.0.2.6       lo-x

	Then invoke xtables_ipparse_any by e.g. `-m conntrack
	--ctorigsrc lo-x/24`. -j.eng]

This same block of code, apparently to detect if addresses are
identical after applying the mask, and to skip the duplicates and the
ones made redundant by the mask, has been present and unchanged from
as far back as I could find (circa iptables 1.2).

By inspection, it was wrong, and always has been: once the code finds
a duplicate, it will drop the rest of the array one by one as it
re-detects the same duplicate over and over. When the addresses came
from a single hostname lookup, and their order was random, then this
created unpredictable behaviour by iptables, which seem to ignore some
of those addresses at random times.

I suspect the original idea also involved a swap between the duplicate
and the address from the (current) end of the array, but a line of
code to do that seems to have never existed. I have finally added it.
(Well, as much as is needed: there does not need to be a full swap,
because we are just going to ignore the duplicate, pretend the array
is one shorter, and never look at the contents of the end again. So,
we can get away with just copying from the end.)

[Reword comment about shuffle: replace by mentioning tail copy to
replace dup. -j.eng]

Signed-off-by: Wes Campaigne <westacular@gmail.com>

0 files changed, 0 insertions, 0 deletions