Luca Deri
36abf06c6f
Swap from Aho-Corasick to an experimental/home-grown algorithm that uses a probabilistic
...
approach for handling Internet domain names.
For switching back to Aho-Corasick it is necessary to edit
ndpi-typedefs.h and uncomment the line
// #define USE_LEGACY_AHO_CORASICK
[1] With Aho-Corasick
$ ./example/ndpiReader -G ./lists/ -i tests/pcap/ookla.pcap | grep Memory
nDPI Memory statistics:
nDPI Memory (once): 37.34 KB
Flow Memory (per flow): 960 B
Actual Memory: 33.09 MB
Peak Memory: 33.09 MB
[2] With the new algorithm
$ ./example/ndpiReader -G ./lists/ -i tests/pcap/ookla.pcap | grep Memory
nDPI Memory statistics:
nDPI Memory (once): 37.31 KB
Flow Memory (per flow): 960 B
Actual Memory: 7.42 MB
Peak Memory: 7.42 MB
In essence from ~33 MB to ~7 MB
This new algorithm will enable larger lists to be loaded (e.g. top 1M domans
https://s3-us-west-1.amazonaws.com/umbrella-static/index.html )
In ./lists there are file names that are named as <category>_<string>.list
With -G ndpiReader can load all of them at startup
2023-08-29 17:34:04 +02:00
..
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-11 20:26:27 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-08-29 17:34:04 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-05-20 17:23:48 +02:00
2023-05-20 15:12:14 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-05-09 16:42:29 +02:00
2023-04-06 11:30:36 +02:00
2023-07-27 09:05:22 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-31 07:44:43 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-14 23:20:06 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-18 07:41:56 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-05-27 12:13:54 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-05-27 12:13:54 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-25 19:25:07 +02:00
2023-04-22 18:28:43 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-05-05 13:35:20 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-15 14:26:51 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-05-05 13:35:20 +02:00
2023-05-05 13:35:20 +02:00
2023-05-05 13:35:20 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-08-02 19:44:16 +02:00
2023-08-02 19:44:16 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-21 11:30:10 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-08-20 15:18:19 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-27 09:05:22 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-11 10:12:08 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-06-08 17:07:25 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-15 14:26:51 +02:00
2023-04-06 11:30:36 +02:00
2023-06-08 17:07:25 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-18 07:41:56 +02:00
2023-07-13 10:50:13 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-11 10:14:18 +02:00
2023-04-06 11:30:36 +02:00
2023-07-21 03:39:40 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-06-23 08:12:40 +02:00
2023-04-06 11:30:36 +02:00
2023-07-18 07:41:56 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-26 09:09:12 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-18 07:41:56 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-11 14:31:57 +02:00
2023-04-06 11:30:36 +02:00
2023-08-01 08:50:46 +02:00
2023-08-01 08:50:46 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-11 10:12:08 +02:00
2023-07-03 17:21:46 +02:00
2023-07-03 17:21:32 +02:00
2023-04-06 11:30:36 +02:00
2023-06-21 10:38:44 +02:00
2023-06-21 10:38:44 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-06-22 13:07:32 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-21 03:41:43 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-07-21 03:42:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00
2023-04-06 11:30:36 +02:00