Commits · 95b6a8e402bdb88e7196d5d8c65ddfd908873d75 · nexedi / libloc

09 Mar, 2022 8 commits

Refactor parsing IP addresses · 95b6a8e4
Michael Tremer authored Mar 09, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
95b6a8e4
writer: I forgot to initalize the country list · d57cf1fc
Michael Tremer authored Mar 09, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
d57cf1fc

importer: Improve performance of network export query · 295a7774

Michael Tremer authored Mar 09, 2022

This patch moves the subqueries out of the large query, so that the
database will materialize them for faster lookup.

We also drop the "UNION ALL" and replace it with just "UNION" because we
do not want any duplicate networks. That will save us many iterations
later on.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

295a7774

writer: Use country list internally · 3df5f70a
Michael Tremer authored Mar 09, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
3df5f70a
country-list: Grow like AS list · 7db88f1b
Michael Tremer authored Mar 09, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
7db88f1b
network-list: Grow just like the AS list · 635c344a
Michael Tremer authored Mar 09, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
635c344a
writer: Use AS list internally · 233311e8
Michael Tremer authored Mar 09, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
233311e8

as-list: Grow faster to avoid too many re-allocations · f13c23b7

Michael Tremer authored Mar 09, 2022

When we add a large number of ASes to the list, we will constantly
re-allocate the whole list because we are only growing it by 64 entries
at a time.

This patch changes that we will double the list in size every time we
run out of space and we will start with 1024 elements.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

f13c23b7

07 Mar, 2022 25 commits
- bogons: Skip any subnets of former networks · 8649c654
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  8649c654
- bogons: Add gaps that are only one address wide · c833e45e
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  c833e45e
- address: Add some simple tests · 49da4308
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  49da4308
- address: Fix buffer overwrite · b0f572df
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  b0f572df
- address: Fix decrementing IP addresses · a27c2f72
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  a27c2f72
- address: Simplify functions · 8bcd0712
  Michael Tremer authored Mar 07, 2022
```
This patch improves looping through the octets of an IP address and
avoids that we will read anything that isn't for us.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  8bcd0712
- network-list: Remove debugging line · 8332f92a
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  8332f92a
- network-list: summarize: Break when we exhausted the network range · 0905528e
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  0905528e
- network-list: Simplify debugging output on summarize · a7c71d80
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  a7c71d80
- address: Prevent under/overflow when incrementing/decrementing · 25612764
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  25612764
- address: Initialize all bits of IP addresses · 9820c51f
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  9820c51f
- strings: Statically allocate all address/network strings · 0a0a289a
  Michael Tremer authored Mar 07, 2022
```
This helps us to write less code and spend less time allocating and
freeing memory.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  0a0a289a
- network: Pass prefix in native length · 1fd09d0b
  Michael Tremer authored Mar 07, 2022
```
When creating an IPv4 subnet, the prefix had to be mapped to the mapped
syntax (i.e. add 96). This doesn't seem too intuitive to me.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  1fd09d0b
- address: Rename increment/decrement functions and modify address in place · 5b72642c
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  5b72642c
- addresses: Use loc_address_family which is now available · dd599427
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  dd599427
- address: Rename in6_addr_get_bit/in6_addr_set_bit to loc_address_* · d698ca09
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  d698ca09
- address: Rename in6_addr_cmp into loc_address_cmp · 9c1e2943
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  9c1e2943
- Move all address convenience functions into their own header · 0b1fef38
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  0b1fef38
- bogons: Don't consider a network legitimate without a country code · 5a01e11e
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  5a01e11e
- bogons: Reset after we have reached the end · c0b1f64f
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  c0b1f64f
- address: Correctly subtract IPv4 addresses · 6f060cae
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  6f060cae
- network-list: Cap prefix length based on family · 88a3db10
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  88a3db10
- bogons: Refactor algorithms · 9306c68d
  Michael Tremer authored Mar 07, 2022
```
This changes that we won't compare one network with the previous one,
but instead we will look for gaps starting from the first possible to
the last possible IP address.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  9306c68d
- addresses: Implement subtraction for IPv4 · f39c751d
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  f39c751d
- network: Implement bit length function for IPv4 · b074be0b
  Michael Tremer authored Mar 07, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  b074be0b
06 Mar, 2022 4 commits

network: Allow creating any valid networks · 5559e086

Michael Tremer authored Mar 06, 2022

Formerly, we did not allow creating special networks like ::1/128, ::/0,
127.0.0.0/8, and so on.

In order to represent all bogons, we will have to allow this.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

5559e086

network-list: Rewrite summarize algorithm · d701dcfd

Michael Tremer authored Mar 06, 2022

The former algorithm did a lot of trial and error which is slow and
probably returned wrong results.

This one determines the correct prefix size quickly.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

d701dcfd

network: Drop functions moved in an earlier commit · 7f834833
Michael Tremer authored Mar 06, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
7f834833
network: Add function that counts the bit length of an addres · f69e0c8b
Michael Tremer authored Mar 06, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
f69e0c8b

05 Mar, 2022 3 commits
- network: Move a couple of helper functions into headers · 30f0f0ed
  Michael Tremer authored Mar 05, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  30f0f0ed
- location: Fix output of list-* commands · f1fb21bd
  Michael Tremer authored Mar 05, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  f1fb21bd
- importer: Skip empty lines · b767db8d
  Michael Tremer authored Mar 05, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  b767db8d