Commits · b56bf4bf065130b38968b580e0bea6db809783d8 · nexedi / libloc

27 Sep, 2022 3 commits

importer: Fix potential SQL command injection · b56bf4bf
Michael Tremer authored Sep 27, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
b56bf4bf

location-importer.in: Add new Amazon region codes · c9486b13

Peter Müller authored Sep 26, 2022

Note that the precise location of "ap-southeast-6" is currently
undocumented. However, all IPv4 networks allocated are not routed at the
time of writing, hence our allocation of Asia/Pacific should be
acceptable for the time being.
Signed-off-by: Peter Müller <peter.mueller@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

c9486b13

location-importer.in: Conduct sanity checks per DROP list · 5acac2a4

Peter Müller authored Sep 26, 2022

Previously, the lack of distinction between different DROP lists caused
only the last one to be persisted. The second version of this patch
incorporates suggestions from Michael on the first version.
Tested-by: Peter Müller <peter.mueller@ipfire.org>
Signed-off-by: Peter Müller <peter.mueller@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

5acac2a4

26 Sep, 2022 1 commit
- configure: Bump version to 0.9.15 · ab8a1787
  Michael Tremer authored Sep 26, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  ab8a1787
13 Sep, 2022 2 commits
- python: Add new open() interface to easily open a database · affa4924
  Michael Tremer authored Sep 13, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  affa4924
- configure: Make the default database path configurable · a0e8d454
  Michael Tremer authored Sep 13, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  a0e8d454
09 Sep, 2022 3 commits
- writer: Flush everything to disk after writing finishes · 52580c03
  Michael Tremer authored Sep 09, 2022
```
This might solve a race in the testsuite.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  52580c03
- Revert "database: Increase page size to 64k" · e2dd6428
  Michael Tremer authored Sep 09, 2022
```
This reverts commit 8a330e55.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  e2dd6428
- tests: country: Don't crash when a country could not be found · 766577bb
  Michael Tremer authored Sep 09, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  766577bb
01 Sep, 2022 1 commit
- country: Drop unused CC_LEN · 245b33e2
  Michael Tremer authored Sep 01, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  245b33e2
23 Aug, 2022 19 commits
- Fix compilation on MacOS X · 25f300f7
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  25f300f7
- configure: Check for madvise · 9294469c
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  9294469c
- tests: Add signing key to verify signatures · 8a2c8640
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  8a2c8640
- database: Initialize r on create · 8ee057fd
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  8ee057fd
- database: Drop debug line · 937f6714
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  937f6714
- database: Drop unused offset variable in objects · ff59db8e
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  ff59db8e
- database: Encourage the compiler to inline some functions · 0e0be76c
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  0e0be76c
- database: Call madvise() to tell the kernel that we will randomly access the data · e63d76be
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  e63d76be
- database: Read all data from the large mmap() · 975f280f
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  975f280f
- hexdump: Don't try to dump any empty memory · 6c27aec2
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  6c27aec2
- database: Read header from mapped data · 866ae435
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  866ae435
- database: Map the entire database into memory as a whole · 3496a16c
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  3496a16c
- database: Check if this version of libloc supports the database format · 5acc1d5f
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  5acc1d5f
- database: Refactor checking magic · 546c0ac0
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  546c0ac0
- database: Break opening procedure into smaller parts · 1642ccea
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  1642ccea
- database: Refactor error handling on create · 50c0fbcd
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  50c0fbcd
- tests: database: Expand test coverage · 99a38c7f
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  99a38c7f
- python: Export DatabaseEnumerator type · b4923a31
  Michael Tremer authored Aug 23, 2022
```
This is useful for tests
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  b4923a31
- database: country: Return better error codes · 8fcb5bc7
  Michael Tremer authored Aug 23, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
  8fcb5bc7
22 Aug, 2022 10 commits

stringpool: Drop function to find next offset · 21dfa79e
Michael Tremer authored Aug 22, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
21dfa79e
tests: Add some simple database tests · c8603967
Michael Tremer authored Aug 22, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
c8603967
database: Fall back when mmap() isn't available · 18638ad2
Michael Tremer authored Aug 22, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
18638ad2

stringpool: Implement mmap as optional · e4b6ca42

Michael Tremer authored Aug 22, 2022

This patch will allow mmap() to fail and will make the reader
fall back to read from the given file descriptor.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

e4b6ca42

python: Fix errors for Database.lookup() · a27e1f3d
Michael Tremer authored Aug 22, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
a27e1f3d
database: Improve error reporting when the magic cannot be read · 808d6ac8
Michael Tremer authored Aug 22, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
808d6ac8
python: Correctly raise any errors when opening the database · 34d537b1
Michael Tremer authored Aug 22, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
34d537b1

database: Increase page size to 64k · 8a330e55

Michael Tremer authored Aug 22, 2022

Since libloc is currently only using mmap() to map any databases into
memory, all mapped address range needs to be page aligned.

In the past, every database was aligned to a 4k page boundary. Some
architectures use 64k pages by default which could therefore not open
the database.

This patch changes the alignment to 64k which should hopefully be a
good common denominator. However, older database cannot be opened.

If we would ever have to support an architecture which's page size
is not evenly fitting into 64k, we will have to implement an
alternative to mmap.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

8a330e55

database: Log any errors when mmap() fails · 47dfa832
Michael Tremer authored Aug 22, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
47dfa832
database: Do not try to unmap failed mappings · 06b88d93
Michael Tremer authored Aug 22, 2022
```
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
```
06b88d93

16 Aug, 2022 1 commit

database: Use MAP_PRIVATE with mmap() · bee8c9b3

Michael Tremer authored Aug 16, 2022

We do not have any changes that need to be propagated down to the file.
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

bee8c9b3