- 12 Aug, 2022 6 commits
-
-
Michael Tremer authored
When importing source data fails for one source, we won't import anything at all. This patch changes that behaviour so that we will import all data one after the other but continue if there was a problem with one source. Signed-off-by:Michael Tremer <michael.tremer@ipfire.org>
-
Michael Tremer authored
This patch changes the order of some operations and drops a few redundant ones (potentiall). That should allow us to parse blocked data faster. Signed-off-by: -
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
All imports should have been conducted in one large transaction so that we can remove any previous data. This was not the case because of an indentation issue and could have caused that the transaction was commited without all data being successfully re-imported. Fixes: #12852 Signed-off-by: -
Michael Tremer authored
The downloader used to open a connection to the web server hosting our content which would have been decompressed (if necessary) on the fly and also been parsed on the fly so that it could have been fed into the database easily. Some webservers do not seem to be patient enough to keep the connection open if things take a little bit longer than usual. That caused the import to fail. This patch changes the behaviour that we would download all content first, store it locally, and then start processing it. Fixes: #12852 Signed-off-by: -
Michael Tremer authored
The check block was indented incorrectly and would have never been executed. Signed-off-by:
-
- 13 Jul, 2022 2 commits
-
-
Jochen Sprickerhof authored
-
Jochen Sprickerhof authored
-
- 07 Jul, 2022 2 commits
-
-
Jochen Sprickerhof authored
Signed-off-by: -
Jochen Sprickerhof authored
To comply with the Debian Python policy. Also add a transitional package with the old name. Signed-off-by:
-
- 05 Jul, 2022 2 commits
-
-
Peter Müller authored
These are all assigned to the US Department of Defense. Signed-off-by:
Peter Müller <peter.mueller@ipfire.org> Signed-off-by:
-
Peter Müller authored
The current way of truncating all override data straight away leaves us with no data at all, should a source turn out to be unreachable or returning bogus files (yes, Cloudflare, I _am_ looking at you). It is therefore better to only delete data we know to have a valid replacement for, rather than just dropping the source altogether. Signed-off-by:
-
- 23 Jun, 2022 2 commits
-
-
Michael Tremer authored
For the ipset format, we will rewrite the header after we know the total number of entries that have been written in order to optimise the hash table. When the output stream isn't seekable, we cannot write the header again which is being fixed in this patch. Fixes: #12885 Reported-by:
Jon Murphy <jon.murphy@ipfire.org> Signed-off-by:
-
Michael Tremer authored
Fixes: #12887 Reported-by:
-
- 14 Apr, 2022 4 commits
-
-
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
In order to run the test suite, we need to make the Python module loadable from the build directory so that we first of all test the right code and that it just works without running "make install" first. Signed-off-by: -
Michael Tremer authored
This reverts commit 643b8d06. Signed-off-by:
-
- 12 Apr, 2022 3 commits
-
-
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
Signed-off-by:
-
- 11 Apr, 2022 1 commit
-
-
Michael Tremer authored
When performing checks, it is useful to be able to rely on a flat network plan so that any larger parent networks in some countries/ASes won't match any subnets. Signed-off-by:
-
- 30 Mar, 2022 8 commits
-
-
Michael Tremer authored
We are using a couple of newer Python features which are only available from 3.9 onwards. Signed-off-by: -
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
Otherwise this test runs for forever Signed-off-by: -
Michael Tremer authored
The prefix is being stored as a total number of bits now since it is easier for any bitwise maths later. This is however causing an incorrect prefix being computed when splitting a network into two subnets for IPv4. To get the correct prefix, loc_network_prefix must be called. Introduced in 1fd09d0bReported-by:
Valter Jansons <valter.jansons@gmail.com> Signed-off-by:
-
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
If loc_network_subnets is being called with some invalid input, we just fail without logging a useful message or setting errno accordingly. This is being changed with this patch. Signed-off-by: -
Michael Tremer authored
This is a performance improvement when exporting networks flattened. For the subnet search, we allocate an empty list many times which is often not required. This patch changes this behaviour that (if needed) the lists will be allocated and will stay around and cleared if necessary. Signed-off-by: -
Michael Tremer authored
Signed-off-by:
-
- 23 Mar, 2022 1 commit
-
-
Michael Tremer authored
Signed-off-by:
-
- 09 Mar, 2022 9 commits
-
-
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
This patch moves the subqueries out of the large query, so that the database will materialize them for faster lookup. We also drop the "UNION ALL" and replace it with just "UNION" because we do not want any duplicate networks. That will save us many iterations later on. Signed-off-by: -
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
Signed-off-by: -
Michael Tremer authored
When we add a large number of ASes to the list, we will constantly re-allocate the whole list because we are only growing it by 64 entries at a time. This patch changes that we will double the list in size every time we run out of space and we will start with 1024 elements. Signed-off-by:
-
