Toni
bb59f2e371
Removed Makefile references to legacy code. ( #1591 )
...
- feature removed with f5545a80f9
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-08 13:37:44 +02:00
Luca Deri
5f05054c8a
Added priv_data
...
Cherry pick of https://github.com/ntop/nDPI/commit/2560260a41172a07b6b272027f441ccda01622a5
2022-05-20 11:56:22 +02:00
Vitaliy Ivanov
51b4f5502f
ndpireader: add json output back. ( #1508 )
...
- partial revert of:
commit 51cfdfb0d8
Author: Luca Deri <deri@ntop.org >
Date: Sun Nov 17 17:51:45 2019 +0100
Removed unused JSON-C code
- Json option is changed from 'j' to 'k' as it's used in the new codebase.
- use HAVE_LIBJSON_C instead of HAVE_JSON_C.
- tabs vs spaces clean ups.
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2022-04-01 11:46:15 +02:00
Luca Deri
258fedbca0
Fixed invalid ndpi_serialize_risk() prototype
2022-02-10 20:22:17 +01:00
Luca Deri
3b1c2d8793
Fixes skype (mis)detection
2022-02-09 11:41:10 +01:00
Luca
8b5c6af71b
Updated release to 4.2
2022-02-01 09:14:05 +01:00
Alfredo Cardigliano
03cb8efad6
Update changelog
2022-01-31 18:38:02 +01:00
Ivan Nardi
5bb5bec477
Remove struct ndpi_id_struct ( #1427 )
...
Remove the last uses of `struct ndpi_id_struct`.
That code is not really used and it has not been updated for a very long
time: see #1279 for details.
Correlation among flows is achieved via LRU caches.
This change allows to further reduce memory consumption (see also
91bb77a8 ).
At nDPI 4.0 (more precisly, at a6b10cf , because memory stats
were wrong until that commit):
```
nDPI Memory statistics:
nDPI Memory (once): 221.15 KB
Flow Memory (per flow): 2.94 KB
```
Now:
```
nDPI Memory statistics:
nDPI Memory (once): 235.27 KB
Flow Memory (per flow): 688 B <--------
```
i.e. memory usage per flow has been reduced by 77%.
Close #1279
2022-01-30 19:18:12 +01:00
Ivan Nardi
1fdcddb33d
Remove Playstation VUE protocol ( #1426 )
...
PS VUE service has been discontinued on January 30, 2020
https://en.wikipedia.org/wiki/PlayStation_Vue
2022-01-30 19:17:53 +01:00
Luca Deri
5f745ee425
Commented old code (see https://github.com/ntop/nDPI/pull/1425 )
2022-01-30 19:17:23 +01:00
Ivan Nardi
f455421870
Improve protocol stacks ( #1425 )
...
We should have two protocols in classification results only when the
"master" protocol allows some sub-protocols.
Classifications like `AmazonAWS`, `TLS/AmazonAWS`, `DNS/AmazonAWS` are
fine. However classifications like `NTP/Apple`, `BitTorrent/Azure`,
`DNScrypt.AmazonAWS` or `NestLogSink.Google` are misleading.
For example, `ndpiReader`shows `BitTorrent/Azure` flows under `Azure`
statistics; that seems to be wrong or, at least, very misleading.
This is quite important since we have lots of addresses from CDN
operators.
The only drawback of this solution is that right now ICMP traffic is
classified simply as `ICMP`; if we are really interested in ICMP stuff
we can restore the old behaviour later.
2022-01-30 19:15:42 +01:00
Ivan Nardi
513e386959
Extend protocols support ( #1422 )
...
Add detection of AccuWeather site/app and Google Classroom.
Improve detection of Azure, Zattoo, Whatsapp, MQTT and LDAP.
Fix some RX false positives.
Fix some "Uncommon TLS ALPN"-risk false positives.
Fix "confidence" value for some Zoom/Torrent classifications.
Minor fix in Lua script for Wireshark extcap.
Update .gitignore file.
Let GitHub correctly detect the language type of *.inc files.
Zattoo example has been provided by @subhajit-cdot in #1148 .
2022-01-29 09:19:26 +01:00
Toni
9b8679a320
Fix some race conditions by using atomic operations. ( #1420 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-01-29 09:18:51 +01:00
Ivan Nardi
0c70411b1b
Make some protocols more "big-endian" friendly ( #1402 )
...
See #1312
2022-01-29 09:18:32 +01:00
Ivan Nardi
86b97ffb73
Sync unit tests results ( #1423 )
...
Fix: 7a3aa41a
2022-01-28 17:17:39 +01:00
Luca
7a3aa41afc
Updated alert description case
2022-01-28 15:02:42 +01:00
Toni
c53c82d482
Fixed heap overflow in nDPI realloc wrapper if new size < old size. ( #1421 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-01-27 15:29:16 +01:00
Ivan Nardi
9dcc4a2334
Kerberos, TLS, example: fix some memory errors ( #1419 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43823
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43921
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43925
2022-01-27 10:59:35 +01:00
Toni
011ee3ecbd
Fixed wrong ip tuple comparison. #1386 ( #1418 )
...
* Added u32 pads to `union ip_tuple` so btree search should now work as expected.
The bug caused new flow's when the remote answers, resulting in two Flows per direction. Fail.
* Fixed a race condition during shutdown phase.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-01-26 15:47:38 +01:00
Luca Deri
6d185c052e
Added support for the .goog Google TLD
2022-01-26 15:22:33 +01:00
Toni
2cd0479204
Serializing empty `risk blocks' pollutes the resulting string. ( #1417 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-01-26 13:36:45 +01:00
Luca Deri
81b33f0d06
Updated test results after the risk NDPI_TLS_CERTIFICATE_ABOUT_TO_EXPIRE has been added
2022-01-26 09:46:46 +01:00
Luca Deri
58a9aff17c
Added NDPI_TLS_CERTIFICATE_ABOUT_TO_EXPIRE flow risk
...
Added ndpi_set_tls_cert_expire_days() API call to modify the number of days for triggering the above alert that by default is set to 30 days
2022-01-26 09:23:23 +01:00
Luca Deri
14e8808f03
Removed pandora.tv from pandora protocol as they are different services that shouldd not be mixed
2022-01-25 19:11:16 +01:00
Luca Deri
bbb3b8349f
Improved pandora TV detection
2022-01-24 18:28:43 +01:00
Luca Deri
b6b4967aa6
Improved Zoom protocol detection
2022-01-23 20:59:36 +01:00
Luca Deri
a8fe74e502
Tool for generating automatically the Azure IP list
2022-01-23 18:56:51 +01:00
Alfredo Cardigliano
20b9f01f12
Fix ndpi_serialize_string_int64
2022-01-21 17:35:38 +01:00
Alfredo Cardigliano
a0bb0ab0ca
Add unit test for ndpi_serialize_string_int64
2022-01-21 13:05:58 +01:00
havsah
e16b6a18be
Fix Grease values parsing ( #1416 )
...
The check for grease was too broad and filtered some valid values.
In particular, the value 257 was skipped because it matched the previous check.
This has been discovered while parsing tests/pcap/443-firefox.pcap
expected ja3:
771,4865-4867-4866-49195-49199-52393-52392-49196-49200-49162-49161-49171-49172-51-57-47-53-10,0-23-65281-10-11-35-16-5-51-43-13-45-28-21,29-23-24-25-256-257,0
previously generated ja3:
771,4865-4867-4866-49195-49199-52393-52392-49196-49200-49162-49161-49171-49172-51-57-47-53-10,0-23-65281-10-11-35-16-5-51-43-13-45-28-21,29-23-24-25-256,0
Signed-off-by: Patrick Havelange <patrick.havelange_ext@softathome.com >
2022-01-21 12:40:35 +01:00
Luca Deri
6f336f8307
Added JA3 in risj exceptions
2022-01-20 22:22:56 +01:00
Luca Deri
d91477b18d
Fixed certificate mismatch check
2022-01-19 23:10:10 +01:00
Luca Deri
771b6606c8
Fixed an issue on CentOS 7 introduced by
...
https://github.com/ntop/nDPI/commit/c2b7d77784beeae5f86f19e33ba3da5ddce55898
2022-01-19 10:19:58 +01:00
Luca Deri
9eee257be0
Updated confidence type
2022-01-18 22:28:58 +01:00
Ivan Nardi
9f050fa0a6
TLS, H323, examples: fix some memory errors ( #1414 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=26880
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=26906
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43782
https://oss-fuzz.com/testcase-detail/6334089358082048
2022-01-18 21:52:37 +01:00
Ivan Nardi
bd036f96f9
Netbios, CSGO: fix two memory errors ( #1413 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43754
https://oss-fuzz.com/testcase-detail/5329842395021312
2022-01-18 19:11:01 +01:00
Sam James and Luca Deri
c2b7d77784
build: respect environment options more ( #1392 )
...
* build: update m4/ax_pthread.m4 from serial 23 -> serial 31
Update ax_pthread.m4 to the latest version from the autoconf-archive
project.
Signed-off-by: Sam James <sam@gentoo.org >
* build: properly detect AR, CC, RANLIB
It's necessary to be able to override choice of AR/CC/RANLIB and other toolchain
variables/tools for cross-compilation, testing with other toolchains, and
to ensure the compiler chosen by the user is actually used for the build.
Previously, GNU_PREFIX was kind-of used for this but this isn't a standard
variable (at all) and it wasn't applied consistently anyway.
We now use the standard autoconf mechanisms for finding these tools.
(RANLIB is already covered by LT_INIT.)
Signed-off-by: Sam James <sam@gentoo.org >
* build: use $(MAKE)
This ensures that parallel make works correctly, as otherwise, a fresh
make job will be started without the jobserver fd, and hence
not know about its parent, forcing -j1.
* build: respect CPPFLAGS, LDFLAGS
- CPPFLAGS is for the C preprocessor (usually for setting defines)
- LDFLAGS should be placed before objects for certain flags to work
(e.g. -Wl,--as-needed)
Signed-off-by: Sam James <sam@gentoo.org >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2022-01-18 14:30:14 +01:00
Ivan Nardi
e4a7990a4e
H323: fix a use-after-poison error ( #1412 )
...
Detected by oss-fuzz
See: https://oss-fuzz.com/testcase-detail/6730505580576768
Fix a function prototype
Update a unit test results
2022-01-17 19:47:27 +01:00
Luca Deri
d19bd96555
Improved Badoo detection (missing mobile app domain)
2022-01-17 18:54:27 +01:00
Luca Deri
6877e46273
Added Badoo detection
2022-01-17 15:13:14 +01:00
Luca
6679453d86
Adds some risk exceptions for popular services and domain names
...
via a new (internal) function named ndpi_add_domain_risk_exceptions()
2022-01-17 09:00:25 +01:00
Ivan Nardi
1ff308af09
TLS: fix a use-of-uninitialized-value error ( #1411 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43705
2022-01-16 20:31:48 +01:00
Ivan Nardi
05734f3d31
Zattoo: fix Null-dereference READ with ipv6 traffic ( #1410 )
...
Fix: 20b5f6d7
Detected by oss-fux:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43700
2022-01-16 19:28:39 +01:00
Ivan Nardi
611c753da5
XBox, Diameter: fix dissectors initialization ( #1405 )
...
These dissectors have *never* been triggered because their registration
functions use the wrong parameter/bitmask.
Diameter code is buggy since the origianl commit (1d108234 ), while
XBox code since 5266c726 .
Fix some false positives in Xbox code.
2022-01-16 16:19:00 +01:00
Luca Deri
f3af39ee42
Added performance tests tools
2022-01-16 12:47:56 +01:00
Luca Deri
42d74171b2
Minor cosmetic changes
2022-01-16 12:47:56 +01:00
Luca Deri
dd325248f1
Reduced Patricia tree bucket memory footprint
2022-01-16 12:47:56 +01:00
Ivan Nardi
e46b508a36
Kerberos: fix use-of-uninitialized-value error ( #1409 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43677
2022-01-15 20:53:36 +01:00
Ivan Nardi
eb5d7b07af
TLS: fix heap-buffer-overflow error ( #1408 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43664
2022-01-15 18:47:59 +01:00
Ivan Nardi
63c44a24b6
STUN: fix "confidence" value for some classifications ( #1407 )
2022-01-15 17:35:06 +01:00
Ivan Nardi
20b5f6d7cc
Improve IPv6 support, enabling IPv6 traffic on (almost) all dissectors. ( #1406 )
...
Follow-up of 7cba34a1
2022-01-15 17:34:56 +01:00
Ivan Nardi
7f69de0b51
Restore a unit test result ( #1403 )
...
Deleted, probably by mistake, in 406ac7e8
Fix Makefile and add compilation of `rrdtool` in CI tests
2022-01-13 23:14:28 +01:00
Luca Deri
533b3ab0e3
FreeBSD fixes
2022-01-13 21:15:21 +01:00
Luca Deri
406ac7e8c8
Added the ability to specify trusted issueDN often used in companies to self-signed certificates
...
This allows to avoid triggering alerts for trusted albeit private certificate issuers.
Extended the example/protos.txt with the new syntax for specifying trusted issueDN.
Example:
trusted_issuer_dn:"CN=813845657003339838, O=Code42, OU=TEST, ST=MN, C=US"
2022-01-13 19:06:21 +01:00
Vinicius Silva Nogueira
dc60cd09c4
fix ahocorasick on big-endian machines ( #1401 )
2022-01-13 17:35:06 +01:00
Luca Deri
d59fefd06e
Improved MicrosoftAzure detection
2022-01-12 21:49:31 +01:00
Luca Deri
1e1cfb89d2
Added EthernetIP dissector
2022-01-12 21:48:39 +01:00
Ivan Nardi
d4da3b6516
Run fuzzing tests also on push event (like the CI tests) ( #1400 )
2022-01-12 21:04:01 +01:00
Ivan Nardi
f30fbc3212
Fix DGA false positive ( #1399 )
...
Close #1397
2022-01-12 20:51:29 +01:00
Ivan Nardi
b080a1c136
Fix two use-of-uninitialized-value errors ( #1398 )
...
Found by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=40269
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=41432
Fix fuzz compilation (follow-up of f5545a80 )
2022-01-12 20:24:57 +01:00
Luca Deri
552d199d2e
Removed outdated comment
2022-01-11 21:46:30 +01:00
Luca Deri
f5545a80f9
Removed legacy code
2022-01-11 21:45:27 +01:00
Ivan Nardi
06f3b07909
QUIC: fix an integer overflow ( #1396 )
...
Reported by oss-fuzz:
```
==685288==ERROR: AddressSanitizer: SEGV on unknown address 0x61a100000687 (pc 0x0000005aba64 bp 0x7ffe3f29f510 sp 0x7ffe3f29f400 T0)
==685288==The signal is caused by a READ memory access.
SCARINESS: 20 (wild-addr-read)
#0 0x5aba64 in quic_len ndpi/src/lib/protocols/quic.c:203:12
#1 0x5aba64 in decrypt_initial_packet ndpi/src/lib/protocols/quic.c:993:16
#2 0x5aba64 in get_clear_payload ndpi/src/lib/protocols/quic.c:1302:21
#3 0x5aba64 in ndpi_search_quic ndpi/src/lib/protocols/quic.c:1658:19
#4 0x579f00 in check_ndpi_detection_func ndpi/src/lib/ndpi_main.c:4683:6
#5 0x57abe6 in ndpi_check_flow_func ndpi/src/lib/ndpi_main.c:0
#6 0x583b2c in ndpi_detection_process_packet ndpi/src/lib/ndpi_main.c:5545:15
#7 0x55e75e in LLVMFuzzerTestOneInput ndpi/fuzz/fuzz_process_packet.c:30:3
[...]
```
2022-01-11 17:57:34 +01:00
Ivan Nardi
3a087e951d
Add a "confidence" field about the reliability of the classification. ( #1395 )
...
As a general rule, the higher the confidence value, the higher the
"reliability/precision" of the classification.
In other words, this new field provides an hint about "how" the flow
classification has been obtained.
For example, the application may want to ignore classification "by-port"
(they are not real DPI classifications, after all) or give a second
glance at flows classified via LRU caches (because of false positives).
Setting only one value for the confidence field is a bit tricky: more
work is probably needed in the next future to tweak/fix/improve the logic.
2022-01-11 15:23:39 +01:00
Luca Deri
a2916d2e4c
Readme for using fuzzer with nDPI
2022-01-11 15:12:45 +01:00
Luca Deri
c02574807e
Updated result
2022-01-09 18:52:30 +01:00
Luca Deri
708d4ea33a
Improved user agent analysis
2022-01-09 18:47:47 +01:00
Ivan Nardi
bf69321a29
GTP: fix some false positives ( #1394 )
2022-01-08 20:40:24 +01:00
Ivan Nardi
4d27001d1d
Remove some unused fields ( #1393 )
2022-01-08 20:40:10 +01:00
Luca Deri
eac3ae9ded
Improved bittorrent detection
2022-01-06 19:50:31 +01:00
Luca Deri
f24f68f59d
Invalid check
2022-01-06 07:15:45 +01:00
Luca Deri
8f805a8163
Added missing dependency
2022-01-05 11:11:58 +01:00
Alfredo Cardigliano
948c0367f9
Update issue tempalte
2022-01-03 17:26:23 +01:00
Alfredo Cardigliano
23a4761276
Update copyright
2022-01-03 11:00:45 +01:00
Luca Deri
d72a40a0fc
Improved BitTorrent guess
2021-12-26 19:41:35 +01:00
Luca Deri
c4ac53a03f
Added support for Log4J/Log4Shell detection in nDPI via a new flow risk named NDPI_POSSIBLE_EXPLOIT
2021-12-23 21:30:16 +01:00
Ivan Nardi
fdb6481cd6
Add support for ICloud Private Relay ( #1390 )
...
See:
https://www.apple.com/privacy/docs/iCloud_Private_Relay_Overview_Dec2021.PDF
TODO: an up-to-date list of egress IP ranges is publicly available. Can
we use it somehow?
2021-12-22 19:55:57 +01:00
Ivan Nardi
91bb77a880
A final(?) effort to reduce memory usage per flow ( #1389 )
...
Remove some unused fields and re-organize other ones.
In particular:
* Update the parameters of `ndpi_ssl_version2str()` function
* Zattoo, Thunder: these timestamps aren't really used.
* Ftp/mail: these protocols are dissected only over TCP.
* Attention must be paid to TLS.Bittorrent flows to avoid invalid
read/write to `flow->protos.bittorrent.hash` field.
This is the last(?) commit of a long series (see 22241a1d , 227e586e ,
730c2360 , a8ffcd8b ) aiming to reduce library memory consumption.
Before, at nDPI 4.0 (more precisly, at a6b10cf7 , because memory stats
were wrong until that commit):
```
nDPI Memory statistics:
nDPI Memory (once): 221.15 KB
Flow Memory (per flow): 2.94 KB
```
Now:
```
nDPI Memory statistics:
nDPI Memory (once): 231.71 KB
Flow Memory (per flow): 1008 B <---------
```
i.e. memory usage per flow has been reduced by 66%, dropping below the
psychological threshold of 1 KB.
To further reduce this value, we probably need to look into #1279 :
let's fight this battle another day.
2021-12-22 19:54:06 +01:00
Alfredo Cardigliano
02da143e45
Add links to other user guides
2021-12-22 10:23:14 +01:00
Luca Deri
4c02c81bf4
Improved bittorrent heuristic
2021-12-21 23:04:27 +01:00
Ivan Nardi
a16b4aa564
Fix a global-buffer-overflow when loading Azure list ( #1388 )
2021-12-19 22:29:25 +01:00
Luca Deri
7aad97fffb
Added Microsoft Azure support
2021-12-19 18:59:45 +01:00
Ivan Nardi
7153b8933c
Improve/add several protocols ( #1383 )
...
Improve Microsoft, GMail, Likee, Whatsapp, DisneyPlus and Tiktok
detection.
Add Vimeo, Fuze, Alibaba and Firebase Crashlytics detection.
Try to differentiate between Messenger/Signal standard flows (i.e chat)
and their VOIP (video)calls (like we already do for Whatsapp and
Snapchat).
Add a partial list of some ADS/Tracking stuff.
Fix Cassandra, Radius and GTP false positives.
Fix DNS, Syslog and SIP false negatives.
Improve GTP (sub)classification: differentiate among GTP-U, GTP_C and
GTP_PRIME.
Fix 3 LGTM warnings.
2021-12-18 13:24:51 +01:00
Ivan Nardi
58b33dcb2d
TLS: add support for IPV6 in Subject Alt Names field ( #1385 )
2021-12-18 12:03:46 +01:00
Ivan Nardi
ec6eea0c23
TLS: fix usage of certificate cache ( #1384 )
2021-12-18 12:03:32 +01:00
Luca Deri
74519f6e10
Improved bittorrent detection
2021-12-17 21:17:18 +01:00
Ivan Nardi
f11b215cfb
QUIC: fix old versions of GQUIC on big-endian machines ( #1387 )
...
Credits to @viniciussn (see #1312 )
2021-12-17 12:10:34 +01:00
Luca Deri
8e512ff503
Improved BitTorrent classification
2021-12-07 21:49:00 +01:00
Luca Deri
519d70fa04
Optimized ndpi_serialize_string_int32
2021-12-07 15:54:23 +01:00
Luca Deri
85b396ca43
Fixed issue that prevented alt certificate names to be fully detected when ipAddress and rfc822Name were specified in certificates
2021-12-07 14:45:42 +01:00
Luca Deri
cefcc25b13
Added missing install target
2021-12-07 09:00:58 +01:00
Ivan Nardi
947896ad7d
Fix configure script (after fb85dac9) ( #1381 )
...
Fix/disable some LGTM warnings
2021-12-04 20:22:05 +01:00
Ivan Nardi
7cba34a1e3
Improve IPv6 support, enabling IPv6 traffic on (almost) all dissectors. ( #1380 )
...
There are no valid reasons for a (generic) protocol to ignore IPv6
traffic.
Note that:
* I have not found the specifications of "CheckPoint High Availability
Protocol", so I don't know how/if it supports IPv6
* all LRU caches are still IPv4 only
Even if src_id/dst_id stuff is probably useless (see #1279 ), the right
way to update the protocol classification is via `ndpi_set_detected_protocol()`
2021-12-04 13:30:10 +01:00
Ivan Nardi
6e86e6d924
QUIC: add support for QUICv2 (draft 00) ( #1379 )
...
It is already time to start looking at the new QUIC version.
See: https://datatracker.ietf.org/doc/html/draft-ietf-quic-v2-00
2021-12-04 13:29:30 +01:00
Toni
4d60c70c8b
Make serialize risk and proto not dependant on any flow. ( #1377 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-12-04 13:28:55 +01:00
Luca Deri
fb85dac905
Configure improvements
...
Fixed invalid anomaly detection in rrd_anomaly
2021-12-04 13:21:57 +01:00
Luca Deri
fe2822c6a8
Added example for finding similarities in RRDs using nDPI statistical APIs
2021-12-04 10:09:01 +01:00
Luca Deri
6ab1367846
Added quick mode (-q)
2021-12-03 21:18:03 +01:00
Luca Deri
8c4ae7527b
Updated rrdtool makefile
2021-12-03 21:10:43 +01:00
Luca Deri
1b077ba65f
Demo tool for finding anomalies in RRD files
2021-12-03 17:36:49 +01:00
Alfredo Cardigliano
3dd9b5176e
Remove printf when not required
2021-12-01 10:24:12 +01:00
Alfredo Cardigliano
1d3428d538
Improve JSON serialization
2021-12-01 10:04:17 +01:00
Luca Deri
33557c5fbc
Improved CSV serialization
2021-11-30 22:15:26 +01:00
Luca Deri
5e0befd56c
Fixed seriealizer unit
2021-11-30 17:24:42 +01:00
Luca Deri
4f81cdc103
Removed spaces from some protocol names as they create problems with some applications
2021-11-30 10:12:24 +01:00
Ivan Nardi
b1e9245d94
ndpiReader: slight simplificaton of the output ( #1378 )
2021-11-27 17:32:23 +01:00
Luca Deri
320bcfafa2
Added ndpi_serializer_skip_header() serialization API
2021-11-26 22:18:59 +01:00
Luca Deri
a7b5e09195
Added Salesforce detection
2021-11-26 19:07:45 +01:00
Luca Deri
9d59b8b1a9
HTTP proxy improvement
2021-11-25 23:17:27 +01:00
Luca Deri
ea435c46f5
Reworked HTTP protocol dissection including HTTP proxy and HTTP connect
2021-11-25 22:53:46 +01:00
Luca Deri
772957349b
Aded default port to HTTP_CONNECT
2021-11-25 21:46:00 +01:00
Luca Deri
40ff2c54c1
Added googletagmanager.com to the host_match list
2021-11-25 21:45:38 +01:00
Ivan Nardi
a8ffcd8bb0
Rework how hostname/SNI info is saved ( #1330 )
...
Looking at `struct ndpi_flow_struct` the two bigger fields are
`host_server_name[240]` (mainly for HTTP hostnames and DNS domains) and
`protos.tls_quic.client_requested_server_name[256]`
(for TLS/QUIC SNIs).
This commit aims to reduce `struct ndpi_flow_struct` size, according to
two simple observations:
1) maximum one of these two fields is used for each flow. So it seems safe
to merge them;
2) even if hostnames/SNIs might be very long, in practice they are rarely
longer than a fews tens of bytes. So, using a (single) large buffer is a
waste of memory for all kinds of flows. If we need to truncate the name,
we keep the *last* characters, easing domain matching.
Analyzing some real traffic, it seems safe to assume that the vast
majority of hostnames/SNIs is shorter than 80 bytes.
Hostnames/SNIs are always converted to lowercase.
Attention was given so as to be sure that unit-tests outputs are not
affected by this change.
Because of a bug, TLS/QUIC SNI were always truncated to 64 bytes (the
*first* 64 ones): as a consequence, there were some "Suspicious DGA
domain name" and "TLS Certificate Mismatch" false positives.
2021-11-24 10:46:48 +01:00
Ivan Nardi
fd02e1b304
QUIC: fix extra dissection ( #1376 )
...
When we have fully reassembled the Client Hello, we need to stop extra
dissection.
2021-11-23 10:57:13 +01:00
Luca Deri
4c39ed293e
BitTorrent dissector code cleanup and merge of https://github.com/ntop/nDPI/pull/1374
2021-11-17 23:18:22 +01:00
Luca Deri
2e2d4c911a
BitTorrent detection improvements
2021-11-17 22:41:35 +01:00
Luca Deri
2a6e5c6341
Improved BT hashing to minimize false positives
2021-11-17 10:47:21 +01:00
Luca Deri
a6545ea095
bittorrent old code cleanup. Enlarged BT cache
2021-11-16 10:05:18 +01:00
Luca Deri
f2a279e441
Improved BitTorrent detection
2021-11-15 17:25:13 +01:00
Ivan Nardi
afc2b641eb
Fix writes to flow->protos union fields ( #1354 )
...
We can write to `flow->protos` only after a proper classification.
This issue has been found in Kerberos, DHCP, HTTP, STUN, IMO, FTP,
SMTP, IMAP and POP code.
There are two kinds of fixes:
* write to `flow->protos` only if a final protocol has been detected
* move protocol state out of `flow->protos`
The hard part is to find, for each protocol, the right tradeoff between
memory usage and code complexity.
Handle Kerberos like DNS: if we find a request, we set the protocol
and an extra callback to further parsing the reply.
For all the other protocols, move the state out of `flow->protos`. This
is an issue only for the FTP/MAIL stuff.
Add DHCP Class Identification value to the output of ndpiReader and to
the Jason serialization.
Extend code coverage of fuzz tests.
Close #1343
Close #1342
2021-11-15 16:20:57 +01:00
ragostino
da47357762
Update ndpi_main.c for HTTP line parser optimization and cleaning ( #1372 )
...
* Update ndpi_main.c
HTTP line parser: optimization and cleaning
* Update ndpi_main.c
2021-11-11 12:38:31 +01:00
Ivan Nardi
acb1de69aa
Reduce memory used by ndpiReader ( #1371 )
...
`ndpiReader` is only an example, aiming to show nDPI capabilities
and integration, without any claim about performances.
Nonetheless its memory usage per flow is *huge*, limiting the kinds
of traces that we can test on a "normal" hardware (example: scan
attacks).
The key reason of that behaviour is that we preallocate all the memory
needed for *all* the available features.
Try to reduce memory usage simply allocating some structures only
when they are really needed. Most significant example: JOY algorithms.
This way we should use a lot less memory in the two most common
user-cases:
* `ndpiReader` invoked without any particular flag (i.e `ndpiReader -i
$FILENAME_OR_IFACE`)
* internal unit tests
Before (on x86_64):
```
struct ndpi_flow_info {
[...]
/* size: 7320, cachelines: 115, members: 72 */
```
After:
```
struct ndpi_flow_info {
[...]
/* size: 2128, cachelines: 34, members: 75 */
```
2021-11-11 12:37:25 +01:00
Ivan Nardi
3e5491fa10
Add detection of OCSP ( #1370 )
...
This protocol is detected via HTTP Content-Type header.
Until 89d548f9 , nDPI had a dedicated automa (`content_automa`) to
classify a HTTP flow according to this header. Since then, this automa has
been useless because it is always empty.
Re-enable it to match only a string seems overkilling.
Remove all `content_automa` leftovers.
2021-11-11 12:36:55 +01:00
Ivan Nardi
0f168d9150
IMAP, POP3, SMTP: improve dissection ( #1368 )
...
Avoid NATS false positives
2021-11-11 11:55:56 +01:00
Luca Deri
9abf528c8e
BitTorrent cache debug
2021-11-08 12:42:15 +01:00
Ivan Nardi
5464bad6db
Differentiate between standard Amazon stuff (i.e market) and AWS ( #1369 )
2021-11-04 00:20:45 +01:00
Luca Deri
4173775b60
Improved BitTorrent detection
2021-11-04 00:20:26 +01:00
Ivan Nardi
a8a3c6f7c2
Fix use-of-uninitialized-value ( #1366 )
...
Close #1346
2021-11-03 15:40:07 +01:00
Ivan Nardi
55880e4ae4
TLS: fix two warnings ( #1365 )
...
Disable unit tests on CI for big-endian target. We know we have multiple
issues on big-endian architectures (see #1312 ) and so the unit tests
always fail there. Ignore this error for the time being and let the CI
pass if we don't have other issues.
Remove an unused automa definition
2021-11-02 22:08:15 +01:00
Luca Deri
1f6c94e663
Updated test results
2021-11-02 12:08:20 +01:00
Luca Deri
b11065b2e3
Fixed certificate mismatch for TLS flows with no client hello observed
2021-11-02 12:06:18 +01:00
Luca Deri
9f8c1e8630
BitTorrent detection improvements
2021-10-31 18:45:13 +01:00
Luca Deri
a9aa46287d
Little change in TLS debug traces
2021-10-28 10:16:33 +02:00
Luca Deri
a25d9d871e
Updated results
2021-10-27 23:04:29 +02:00
Luca Deri
5283755afa
Fixed TLS certificate dissection of subjectAltName
2021-10-27 22:51:59 +02:00
Luca Deri
aaa474a37d
Minor code cleanup
2021-10-27 09:32:11 +02:00
Ivan Nardi
6edb7bedd7
Avoid overwriting valid protocol in ndpi_detection_giveup ( #1360 )
...
We should avoid updating any valid protocol in `ndpi_detection_giveup`; we
should try to find a proper classification only if the flow is still
completely unclassified.
For example in the attached pcap there is a valid TLS session, recognized
as such by TLS dissector. However, the `ndpi_detection_giveup`function
updates it to "HTTP/TLS" (!?) simply because the server port is 80.
Note that the real issue is not the wrong classification, but the
wrong access to `flow->protos` union. If we already set some fields of
`flow->protos` and we change the protocol in `ndpi_detection_giveup`, we
might end up freeing some invalid pointers in `ndpi_free_flow_data`
(no wonder this issue has been found while fuzzing #1354 )
Fix GIT and TLS dissectors (issues found by CI fuzzer)
2021-10-27 09:23:07 +02:00
Toni
c4eebaaf5e
Serialize additional information stored in the flow struct. ( #1362 )
...
* Changed function signature of ndpi_flow2json (removed unused vlan_id; API break)
* Serialize NTP information.
* Improved QUIC serialization.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-27 09:22:19 +02:00
Luca Deri
f41d8ac106
Improved STUN and RTP detection
2021-10-27 00:06:05 +02:00
Toni
41765efcf8
Detect invalid characters in text and set a risk. Fixes #1347 . ( #1363 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-26 21:34:01 +02:00
Luca Deri
5ccc61d1cb
Fixed Git protocol dissection ( #1355 )
2021-10-25 18:52:27 +02:00
Ivan Nardi
b6d9536533
Fixed cleartext protocol assignment ( #1357 )
2021-10-25 15:04:04 +02:00
Ivan Nardi
333a6d60e8
TLS: fix a heap-buffer-overflow ( #1356 )
...
Revert of c3d1c697
Error reproducible with the attached pcap and valgrind
2021-10-22 14:57:49 +02:00
Luca Deri
c3d1c69722
Fixed heap-buffer-overflow in TLS dissector
2021-10-20 22:07:47 +02:00
Ivan Nardi
8db8c8ae34
Fix QUIC log and remove SoulSeek leftovers after b97dc6ba ( #1351 )
...
Update .gitignore file
Fix a function prototype
Close #1349
2021-10-19 21:42:55 +02:00
Ivan Nardi
fea3991ad1
Fix some invalid memory reads ( #1350 )
...
`ndpi_detection_giveup()` (and any functions called by it) can't access
`ndpi_detection_module_struct->packet` anymore since 730c236 .
Sync unit tests results
Close #1348
2021-10-19 12:07:47 +02:00
Luca Deri
06f13fd2de
Added clertext alert with telnet
2021-10-19 08:44:29 +02:00
Toni
ed51987e3a
Fix broken fuzz_process_packet fuzzer by adding a call to ndpi_finalize_initialization(). ( #1334 )
...
* fixed several memory errors (heap-overflow, unitialized memory, etc)
* ability to build fuzz_process_packet with a main()
allowing to replay crash data generated with fuzz_process_packet
by LLVMs libfuzzer
* temporarily disable fuzzing if `tests/do.sh`
executed with env FUZZY_TESTING_ENABLED=1
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-18 23:16:32 +02:00
Luca Deri
7d3c3b23f8
Implemented RDP over UDP dissection
2021-10-18 22:12:28 +02:00
Luca Deri
9e97d20c25
Refreshed results list
2021-10-16 12:03:16 +02:00
Luca Deri
b08b6a6a28
Fixed cleartext protocol assignment
2021-10-16 12:02:04 +02:00
Luca Deri
c2e7fbce94
Updated test results after latest commit
2021-10-16 11:57:32 +02:00
Luca Deri
1b3c41a752
Reworked flow risks asignment
...
Added esceptions for windows update and binary application transfer risk
2021-10-16 11:55:08 +02:00
Luca Deri
b97dc6baa4
Removed outdated (and broken) soulseek dissector
2021-10-15 17:27:27 +02:00
Luca Deri
e696f31487
Updated test results
2021-10-14 22:18:34 +02:00
Luca Deri
b1a43cbcff
Added missing call to ndpi_reconcile_protocols() with protocol guess
2021-10-14 22:08:20 +02:00
Luca Deri
6e649e0cb6
Fixed issue on DGA numeric IP detection
2021-10-13 19:21:27 +02:00
Luca Deri
09668496c3
Indemt
2021-10-13 19:18:05 +02:00
Zied Aouini
a2e9730b23
Add issue templates. ( #1340 )
...
* Add issue template.
* Add config log instruction.
2021-10-13 18:39:10 +02:00
Luca Deri
937357e4bc
Implemented ndpi_ses_fitting() and ndpi_des_fitting()
...
for comuting the best alpha/beta values for exponential smoothing
2021-10-12 13:08:58 +02:00
Alfredo Cardigliano
d947437233
Return 0 on ndpi_init_serializer_ll success for consistency
2021-10-12 10:47:44 +00:00
Luca Deri
d13bc0e01a
Fixed DES initialisation
2021-10-12 12:38:40 +02:00
Ivan Nardi
550e6fe6fc
QUIC: fix an integer overflow ( #1337 )
...
Long standing bug: credits to @lnslbrty for digging into it and to
@aouinizied for the CI improvements
2021-10-11 23:08:10 +02:00
Toni
a8f938f7ac
Removed README.protocols because: ( #1333 )
...
* Tor via TLS should be detectable via DGA as a risk
* protocol limitations should be part of the official documentation in `doc/`
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-11 23:07:36 +02:00
Luca Deri
960e8ab22a
Win fix
2021-10-11 20:59:28 +02:00
Zied Aouini
ca827ae548
Fix FuzzCI. ( #1338 )
2021-10-11 20:17:12 +02:00
Zied Aouini
7e0724d576
Enable sanitizers on CIFuzz. ( #1336 )
2021-10-11 19:01:50 +02:00
Luca Deri
246d115d7b
Cleaned up code moving specific includes in files their are using it. Thi prevents ndpi_config.h to be included everywhere in apps using nDPI that might leade to #define redefinitions after the latest changes
2021-10-11 11:45:45 +02:00
Toni
60eca79fdf
Additional fix related to cf931fda6b. ( #1332 )
...
* configure.seed references removed
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-10 14:14:02 +02:00
Toni
549134ef10
Fix make dist and add it to the CI along with make -C doc text. Fixes #1324 ( #1327 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-10 13:15:38 +02:00
Toni
cf931fda6b
Get rid of configure.seed as it comes with some disadvantages. ( #1328 )
...
* using Autotools best-practices to achieve (hopefully) the same result
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-10 13:13:52 +02:00
Toni
6ff67b5043
Add more WindowsUpdate URLs as requested in #698 . ( #1329 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-08 18:29:49 +02:00
Luca Deri
3ffb65a81c
Added extra check
2021-10-07 08:21:40 +02:00
Ivan Nardi
2dfc478ad4
Fix compilation with clang-13 or if some debug macros are enabled ( #1326 )
2021-10-06 18:32:15 +02:00
Luca Deri
944e8ed105
Added check
2021-10-06 18:28:09 +02:00
Luca Deri
2b4821a97b
Compilation fix for old Linux distributions
2021-10-06 09:28:04 +02:00
Luca Deri
d9c72999ee
Test update
2021-10-06 00:06:34 +02:00
Luca Deri
181a03c5ad
Compilation fix
2021-10-05 17:17:12 +02:00
Luca Deri
8957c52a48
Numeric IPs are not considered for DGA checks
2021-10-05 17:14:31 +02:00
Luca Deri
408d78e628
Improved DGA detection for skipping potential DGAs of known/popular domain names
2021-10-05 16:51:24 +02:00
Luca Deri
10576eab0a
TLS obsolete protocol is set when TLS < 1.2 (used to be 1.1)
2021-10-05 16:44:56 +02:00
Ivan Nardi
730c2360bd
Remove struct ndpi_packet_struct from struct ndpi_flow_struct ( #1319 )
...
There are no real reasons to embed `struct ndpi_packet_struct` (i.e. "packet")
in `struct ndpi_flow_struct` (i.e. "flow"). In other words, we can avoid
saving dissection information of "current packet" into the "flow" state,
i.e. in the flow management table.
The nDPI detection module processes only one packet at the time, so it is
safe to save packet dissection information in `struct ndpi_detection_module_struct`,
reusing always the same "packet" instance and saving a huge amount of memory.
Bottom line: we need only one copy of "packet" (for detection module),
not one for each "flow".
It is not clear how/why "packet" ended up in "flow" in the first place.
It has been there since the beginning of the GIT history, but in the original
OpenDPI code `struct ipoque_packet_struct` was embedded in
`struct ipoque_detection_module_struct`, i.e. there was the same exact
situation this commit wants to achieve.
Most of the changes in this PR are some boilerplate to update something
like "flow->packet" into something like "module->packet" throughout the code.
Some attention has been paid to update `ndpi_init_packet()` since we need
to reset some "packet" fields before starting to process another packet.
There has been one important change, though, in ndpi_detection_giveup().
Nothing changed for the applications/users, but this function can't access
"packet" anymore.
The reason is that this function can be called "asynchronously" with respect
to the data processing, i.e in context where there is no valid notion of
"current packet"; for example ndpiReader calls it after having processed all
the traffic, iterating the entire session table.
Mining LRU stuff seems a bit odd (even before this patch): probably we need
to rethink it, as a follow-up.
2021-10-05 15:49:52 +02:00
Ivan Nardi
f3fcf1e7c0
Update unit tests results after da8eed5a ( #1323 )
2021-10-05 15:06:34 +02:00
Luca Deri
da8eed5a32
Updated description
2021-10-05 11:08:16 +02:00
Ivan Nardi
c1e794366f
WHOIS: enhance detection, avoiding false positives ( #1320 )
...
We are interested only in the domain name required, not in the long reply.
2021-10-05 09:35:04 +02:00
Luca Deri
bb7aff6526
Added -a <num> to ndpiReader for generating OPNsense configuration
...
See https://github.com/ntop/opnsense
2021-10-04 22:34:49 +02:00
Luca Deri
fd0e65cb57
Removed trace
2021-10-03 23:41:31 +02:00
Ivan Nardi
bc5be1e76c
Fix how some protocols handle tcp retransmissions ( #1321 )
...
Most (all?) protocols don't care about (tcp) retransmissions.
If a protocol registers itself with a
NDPI_SELECTION_BITMASK_PROTOCOL_*_WITHOUT_RETRANSMISSION value, its
callback is never triggered with a retransmitted packet.
2021-10-03 21:38:49 +02:00
Toni
e84da386c7
Added nDPI pkg-config file to Debian / Ubuntu ndpi-dev packaging. ( #1318 )
...
* Added nDPI pkg-config file to Debian / Ubuntu ndpi-dev packaging.
* fixed missing gcrypt library dependency in libndpi.pc
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-03 21:29:56 +02:00
Simone Mainardi
06f763e6c3
Adds sections labels with risk id to the docs
2021-10-01 15:02:14 +02:00
Luca Deri
a9d4f5d8d0
Warning fix
2021-10-01 11:36:35 +02:00
Luca Deri
8e6de00ce3
Initial attempt to write nDPI documentation. Starting with flow risks. Please contribute
2021-10-01 11:32:27 +02:00
Ivan Nardi
5cf3fef8f7
Remove detected_protocol_stack field from ndpi_packet_struct ( #1317 )
...
This field is an exact copy of `ndpi_flow_struct->detected_protocol_stack[2]`:
* at the very beginning of packet dissection, the value saved in
`flow->detected_protocol_stack` is copied in `packet->detected_protocol_stack`
(via `ndpi_detection_process_packet()` -> `ndpi_init_packet_header()`)
* every time we update `flow->detected_protocol_stack` we update
`packet->detected_protocol_stack` too (via `ndpi_int_change_protocol()`
-> `ndpi_int_change_packet_protocol()`)
These two fields are always in sync: keeping the same value in two
different places is useless.
2021-09-29 13:11:32 +02:00
Alfredo Cardigliano
721031210b
Fix warning
2021-09-28 09:44:31 +02:00
Luca Deri
af35d6b963
Added unit test for bitmap iteration
2021-09-27 12:47:05 +02:00
Luca Deri
b9ccff0761
Compilation fixed on CentOS 7
...
Bitmap APi changes
2021-09-27 12:41:40 +02:00
Luca Deri
241ee32cbc
Bitmap code
2021-09-27 12:06:46 +02:00
Luca Deri
519c69c5cc
Reworked bitmap code
2021-09-27 10:29:03 +02:00
Luca Deri
72df138a7d
Warnign fix
2021-09-27 09:08:04 +02:00
eac7024489
Fix armhf ( #1315 )
...
* Fix unaligned memory accesses with get_u_int64_t at armhf
see: https://bugs.debian.org/993627
* Use get_u_int64_t to avoid unaligned memory access at armhf
see: https://bugs.debian.org/993627
* Update src/include/ndpi_define.h.in
Drop const type from get_u_int64_t, from lnslbrty
Co-authored-by: Bernhard Übelacker <bernhardu@mailbox.org >
Co-authored-by: Toni <matzeton@googlemail.com >
2021-09-26 23:53:00 +02:00
Luca Deri
5ed1930a93
Added include for defining bools (not present on all platforms)
2021-09-26 23:00:13 +02:00
Luca Deri
1efabef4cf
Added API for handling compressed bitmaps
...
ndpi_bitmap* ndpi_bitmap_alloc();
void ndpi_bitmap_free(ndpi_bitmap* b);
u_int64_t ndpi_bitmap_cardinality(ndpi_bitmap* b);
void ndpi_bitmap_set(ndpi_bitmap* b, u_int32_t value);
void ndpi_bitmap_unset(ndpi_bitmap* b, u_int32_t value);
bool ndpi_bitmap_isset(ndpi_bitmap* b, u_int32_t value);
void ndpi_bitmap_clear(ndpi_bitmap* b);
size_t ndpi_bitmap_serialize(ndpi_bitmap* b, char **buf);
ndpi_bitmap* ndpi_bitmap_deserialize(char *buf);
based on https://github.com/RoaringBitmap/CRoaring
2021-09-26 22:55:15 +02:00
Zied Aouini
c40cf4e0ec
Add arm64, armhf and s390x as part of CI. ( #1314 )
...
* Add arm64, armhf and s390x as part on CI.
* Minor fix.
* Fix code inspector complaints.
2021-09-23 14:41:56 +02:00
Ivan Nardi
7eb73bc92a
QUIC: fix old GQUIC versions on big-endian machines ( #1313 )
2021-09-23 13:24:49 +02:00
Zied Aouini
0994771974
Improve CI ( #1303 )
...
* Improve CI pipeline
* Fix branch name.
* Fix branch name.
* Fix libgcrypt configuration.
* Update build.yml
* Move to Github Actions instead of Travis CI.
* Fix mingw on ubuntu bionic.
* Reactivate cross compile on Ubuntu Bionic.
* Switch to single line steps.
* Add several compilers versions
* Minor fix.
* Fix build all and delete cxx
* Fix RCE detection.
* Fix PCRE configuration.
* Add condition on PCRE test pcap.
* Update WebattackRCE.pcap.out
* Add missing SUBST.
* Delete WebattackRCE.pcap.out
* Update WebAttackRCE result.
* Fix typo.
* Extend jobs with pcre+msan+maxminddb.
* Fix code inpector warnings.
* Delete .appveyor.yml
2021-09-22 12:10:52 +02:00
Toni
9717afb2da
Merge pull request #1311 from IvanNardi/ftp-start-tls
...
FTP: fix support for START-TLS sessions
2021-09-22 12:08:04 +02:00
Nardi Ivan
017c1a4239
FTP: fix support for START-TLS sessions
...
When TLS-over-FTP is used, the credentials are encrypted. So we must not
wait for the username and the password commands, otherwise we elaborate a
lot of packets for nothing.
2021-09-21 20:53:04 +02:00
Toni
bb52f1362c
Merge pull request #1309 from IvanNardi/ipv6-headers
...
Fix parsing of ipv6 packets with extension headers
2021-09-20 12:54:01 +02:00
Toni
d74c2739d5
Merge pull request #1310 from IvanNardi/stun-realm
...
STUN: fix extraction of Realm attribute
2021-09-20 11:53:40 +02:00
Nardi Ivan
95ac8fd41a
STUN: fix extraction of Realm attribute
...
While at it, improve detection of Facebook Messenger
2021-09-20 11:04:54 +02:00
Nardi Ivan
03d3e1bafc
Fix parsing of ipv6 packets with extension headers
...
Decoding of ipv6 traffic with extension headers was completely broken,
since the beginning of the L4 header was always set to a wrong value.
Handle the ipv6 fragments in the same way as the ipv4 ones: keep the first
one and drop the others.
2021-09-19 17:29:22 +02:00
Ivan Nardi
994bd0696b
Small fixes after latest commits ( #1308 )
2021-09-18 09:31:00 +02:00
Ivan Nardi
227e586e63
A (tiny) effort to reduce memory usage per flow ( #1304 )
...
Follow-up of 22241a1d
Only trivial changes:
* remove completely unused fields
* remove fields only written (but never read)
* CSGO protocol only handles UDP traffic
2021-09-18 09:29:45 +02:00
Luca Deri
4539e96ce2
Added DNS fragmented test pcap
2021-09-17 15:56:18 +02:00
Luca Deri
3303dac7cf
Improved fragmented DNS detection
2021-09-17 15:17:39 +02:00
Luca Deri
119a14c6e3
DNS dissection fixes
2021-09-17 12:20:19 +02:00
deboracerretini and Luca Deri
8f113c1d37
Progetto esame Gestione di Reti - Debora Cerretini ( #1290 )
...
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2021-09-17 11:01:50 +02:00
Ivan Nardi
6325aebda6
TLS: avoid zeroing large structures ( #1300 )
...
Zeroing large structures (i.e. size > KB) is quite costly (from a CPU point
of view): we can safely avoid doing that for a couple of big structures.
Standard and Valgrind tests have been diverging quite a lot: it is time
to re-sync them. Use the same script and enable Valgrind via an
enviroment variable:
NDPI_TESTS_VALGRIND=1 ./tests/do.sh
2021-09-16 14:34:59 +02:00
Simone Mainardi
978c9cfda3
Adds instructions to update flow risks in ntopng
2021-09-15 17:49:47 +02:00
Ivan Nardi
0eb7a0388c
Hangout: fix usage of STUN function ( #1299 )
2021-09-13 18:25:43 +02:00
Ivan Nardi
3e06e6f5b8
Fix some ndpi_malloc/ndpi_free pairs ( #1298 )
2021-09-13 18:25:22 +02:00
Ivan Nardi
31404f4865
Update the list of default ports for QUIC protocol ( #1297 )
...
There are no reasons to register UDP/80 as a default port for QUIC
2021-09-13 18:25:04 +02:00
Ivan Nardi
17774bf09c
Bittorrent: fix a potential use-of-uninitialized-value error ( #1296 )
...
Not sure if this is the right fix (from a logical point-of-view): this
code hasn't changed since OpenDPI era (!) and I have't found a trace
triggering this code path.
Anyway, the use-of-uninitialized-value error itself should be fixed.
2021-09-13 18:24:42 +02:00
Vitaly Lavrov
22241a1d36
Removing unused fields from the id_struct structure. ( #1293 )
...
Reduced by 40 bytes.
2021-09-13 18:19:09 +02:00
Ivan Nardi
951bcb0c39
Cassandra: fix compilation when "--enable-debug-messages" option is used ( #1294 )
...
Let's try adding a dedicated compilation in GitHub Actions to easily
detect this kind of errors in the future
2021-09-11 11:10:46 +02:00
Ivan Nardi
083e464929
Fix unit test results after 00857abf ( #1295 )
2021-09-11 11:09:55 +02:00
Luca Deri
00857abf2c
Added new risk for clear text credentials
2021-09-10 22:00:04 +02:00
lucasbaile and Lucas Santos
1fadf4754a
Add Cassandra protocol dissector ( #1285 )
...
Co-authored-by: Lucas Santos <lucas.santos@zerum.com >
2021-09-09 22:47:58 +02:00
Luca Deri
36f08b8d2e
Win fix
2021-09-07 22:37:22 +02:00
Alfredo Cardigliano
57fce4e350
Fix unused var
2021-09-03 17:46:04 +02:00
Alfredo Cardigliano
89af9b7e3c
Print API version
2021-09-01 09:48:37 +02:00
Luca Deri
a6b10cf73f
Fixed memory stats
2021-08-26 12:12:22 +02:00
Luca Deri
90c6fd99a7
ARM fixes
2021-08-25 09:46:29 +02:00
Luca Deri
88040f0449
Compilation fix
2021-08-20 22:47:46 +02:00
Ivan Nardi
9e0f0ce3df
Fix access to some TLS fields in flow structure ( #1277 )
...
Fields 'tls.hello_processed` and `tls.subprotocol_detected` are used by
QUIC (i.e UDP...), too.
2021-08-20 18:11:37 +02:00
Ivan Nardi
8fdffbf3a1
Compile everything with "-W -Wall -Wno-unused-parameter" flags ( #1276 )
...
Fix all the warnings.
Getting rid of "-Wno-unused-parameter" is quite complex because some
parameters usage depends on compilation variable (i.e.
`--enable-debug-messages`).
The "-Werror" flag has been added only in Travis builds to avoid
breaking the builds to users using uncommon/untested
OS/compiler/enviroment.
Tested on:
* x86_64; Ubuntu 20.04; gcc 7,8,9,10,11; clang 7,8,9,10,11,12
* x86_64; CentOS 7.7; gcc 4.8.5 (with "--disable-gcrypt" flag)
* Raspberry 4; Debian 10.10; gcc 8.3.0
2021-08-20 18:11:13 +02:00
Ivan Nardi
55eec29c08
wireshark/lua: restore full flow risks dissection ( #1275 )
...
It was partially disabled in 3eba8cc5 .
Wireshark and Wireshark-Lua bindings don't handle 64 bit integer very well.
(see https://www.wireshark.org/docs/wsdg_html_chunked/lua_module_Int64.html ).
As workaround, only for visualization purpose, split the (64 bit) risk mask
into two 32 bit integer values.
2021-08-18 11:34:46 +02:00
Toni
8d0c7b1fae
Fixed Mingw64 build, SonerCloud-CI and more. ( #1273 )
...
* Added ARM build and unit test run for SonarCloud-CI.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Fixed Mingw64 build.
* adapted to SonarCloud-CI workflow
* removed broken and incomplete Windows example (tested on VS2017/VS2019)
* removed unnecessary include (e.g. pthread.h for the library which does not make use of it)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-08-18 11:34:16 +02:00
Luca Deri
677b513f70
Fixes a crash on ARM (Raspberry Pi 4 Model B Rev 1.1)
2021-08-18 11:12:06 +02:00
Luca Deri
821f4c9249
Fixed some invalid TLS guesses
2021-08-17 19:04:07 +02:00
Luca Deri
a2ea67152c
Added check to avoid clases on similar protocols (FTP adn SMTP) on setting hostname
2021-08-11 12:11:58 +02:00
Luca Deri
5c33fbf19b
Added extraction of hostname in SMTP
...
Fixed mail incalid subprotocol calculation
2021-08-11 11:52:24 +02:00
Alfredo Cardigliano
846b546dbc
Fix typo
2021-08-10 11:43:32 +02:00
Luca Deri
c1acb6d801
Typo
2021-08-09 18:36:36 +02:00
Luca Deri
0fbe895103
Addef ETH_ARP definition
2021-08-09 18:33:33 +02:00
Luca Deri
05492ec8e8
Defined more standard ethernet protocol types
2021-08-09 17:01:10 +02:00
Luca Deri
58ca7b5a7f
Added protocol defines
2021-08-09 16:45:03 +02:00
Luca Deri
0df8aa19ec
Clode cleanup (after last merge)
2021-08-08 17:10:08 +02:00
Toni and Luca Deri
259b60f574
Added entropy calculation to check for suspicious (encrypted) payload. ( #1270 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2021-08-08 17:03:23 +02:00
Toni
4e856a41d6
Skip whitespaces between HTTP method and URL. ( #1271 )
...
* be less case-restrictive, RFC2616 wants it that way
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-08-08 17:00:10 +02:00
Toni
8e996f7f7c
Fixed broken SonarCloud-CI. ( #1272 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-08-08 16:59:36 +02:00
Luca Deri
3706267d68
Updated test output
2021-08-07 19:43:55 +02:00
Luca Deri
0522e562e8
Added testing pcap for TLS fatal alert
2021-08-07 19:42:53 +02:00
Luca Deri
4183718952
Added TLS fatal alert flow risk
2021-08-07 19:40:44 +02:00
Luca Deri
e8455236bd
Updated output
2021-08-07 17:38:33 +02:00
Luca Deri
a13f1fe52f
Report whether a protocol is encrypted
2021-08-07 17:35:34 +02:00
Luca Deri
46ebd7128f
Added ability to report whether a protocol is encrypted
...
Added new API calls
- u_int8_t ndpi_is_valid_protoId(u_int16_t protoId);
Cleaned up code and organized in a function.
- u_int8_t ndpi_is_encrypted_proto(struct ndpi_detection_module_struct *ndpi_str, ndpi_protocol proto);
Check whether a protocol is encrypted or not based on master and app protocols
2021-08-07 17:10:18 +02:00
Luca Deri
dc841574af
Win fix
2021-08-03 09:44:50 +02:00
Luca Deri
6b7e5fa8d2
Added legacy whatsapp rules used to match old pcaps that need to be removed in the future
2021-07-31 23:49:48 +02:00
Toni
ad57af9f79
Improved RTSP detection and fixed HTTP false-positive. Fixes #1229 . ( #1266 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-31 23:31:49 +02:00
Fábio Depin
ce597b4806
Updated WhatsAPP and Instagram addresses ( #1264 )
...
* Updated WhatsAPP addresses
* Added Instagram addresses
2021-07-31 23:30:34 +02:00
Toni
13c5d6801e
Improved libm check via Autoconf. ( #1263 )
...
* libm will now be part of @ADDITIONAL_LIBS@ (if required)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-28 22:24:03 +02:00
Luca Deri
cb26a8c82d
Moved to 4.1.0
2021-07-26 09:40:50 +02:00
Luca Deri
4cafa7cb1e
Improved risk detection mask algorithm
2021-07-26 09:38:53 +02:00
Toni
29ec34f66d
Improved TFTP detection. Fixes #1242 , #1256 ( #1262 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-25 21:54:19 +02:00
Luca Deri
a482e1c0be
Typo (Thanks Ivan)
2021-07-24 18:12:09 +02:00
Luca Deri
1d9a830b2f
Update changelog
2021-07-24 17:54:32 +02:00
Luca Deri
51e4888442
Implemented ALPN automa for checking uncommon ALPNs
2021-07-24 17:50:32 +02:00
Luca Deri
526568fcd5
Risk check improvement
2021-07-24 16:18:18 +02:00
Alfredo Cardigliano
c73501f859
Typo
2021-07-23 18:14:11 +02:00
Alfredo Cardigliano
d5a60880d0
Fix prototype
2021-07-23 18:12:54 +02:00
Luca Deri
61fc5be202
Reworked flow risk implementation
2021-07-23 17:27:15 +02:00
Ivan Nardi
4ffe1eb3c0
Fix unit tests when "--disable-gcrypt" flag is used ( #1255 )
2021-07-23 10:37:36 +02:00
Toni
6ad0d6666c
Implemented function to retrieve flow information. #1253 ( #1254 )
...
* fixed [h]euristic typo
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-23 10:37:20 +02:00
Luca Deri
8ea8ba8e9b
Fixed risk mask implementation
2021-07-23 08:29:36 +02:00
Luca Deri
b01b60a2b5
Implementation of flow risk eception (work in progress)
2021-07-22 01:35:57 +02:00
Alfredo Cardigliano
fc9901292d
Update changelog
2021-07-20 17:04:35 +00:00
Toni
32275543c4
Added risk: TLS_EXTENSION_SUSPICIOUS ( #1252 )
...
* validates client/server hello TLS extensions
* inspects content for some extensions
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-19 16:23:24 +02:00
Ivan Nardi
57b8969a3d
Fix setting of flow risks on 32 bit machines ( #1251 )
...
Since 19a29e1e (NDPI_TLS_CERT_VALIDITY_TOO_LONG is 32), unit tests are
failing on 32 bit machines (i.e Raspberry 4)
2021-07-19 16:22:39 +02:00
Luca Deri
0adcd28450
Updated download category name
2021-07-16 14:04:47 +02:00
Vitaly Lavrov
295cb3ee6a
Bug fix. ( #1250 )
...
Restore part of the fields flow->packet after cleaning flow structure.
2021-07-16 13:53:36 +02:00
pacant and pacant
488166833e
Fixed TLS certificate threshold ( #1248 )
...
Co-authored-by: pacant <a.pace97@outlook.com >
2021-07-16 13:52:55 +02:00
Vitaly Lavrov
daf1fbfc7b
Code cleanup. ( #1246 )
...
ndpi_utils.c: use ndpi_malloc,ndpi_calloc,ndpi_free
genshin_impact.c, git.c, hpvirtgrp.c, http.c, z3950.c: removed "#include stdlib.h"
2021-07-16 13:51:54 +02:00
Luca Deri
a6de94a930
hulu and netflix dissection improvements
2021-07-14 12:53:03 +02:00
Luca Deri
3eba8cc5b5
Temporary fix for avoiding wireshark errors
2021-07-14 12:51:42 +02:00
Luca Deri
b95bd0358f
Code cleanup
2021-07-14 11:19:24 +02:00
pacant and pacant
19a29e1e22
TLS Risks - Certificate Validity Too Long ( #1239 )
...
* Added flow risk: TLS certificate too long
* Added flow risk: TLS certificate too long
* Date for TLS limit added
* TLS certificate check fixed
Co-authored-by: pacant <a.pace97@outlook.com >
2021-07-14 11:13:22 +02:00
Toni
c411df523e
Added AVAST SecureDNS protocol. ( #1244 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-14 11:11:59 +02:00
Toni
62bae30a4a
Improved Steam detection (Steam Datagram Relay - SDR). ( #1243 )
...
* improved DNSCrypt midstream detection again (sufficient for all tested use-cases)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-14 11:09:58 +02:00
Toni
e4453938d5
Improved dnscrypt midstream detection. ( #1241 )
...
* fixed skype false-positive detection of dnscrypt traffic
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-13 15:10:18 +02:00
Ivan Nardi
cccf794265
ndpiReader: add statistics about nDPI performance ( #1240 )
...
The goal is to have a (roughly) idea about how many packets nDPI needs
to properly classify a flow.
Log this information (and guessed flows number too) during unit tests,
to keep track of improvements/regressions across commits.
2021-07-13 12:28:39 +02:00
Luca Deri
96b71def49
Minor change
2021-07-12 17:51:25 +02:00
Vitaly Lavrov
c418b7110b
ahoсorasick. Code review. Part 2. ( #1236 )
...
Simplified the process of adding lines to AC_AUTOMATA_t.
Use the ndpi_string_to_automa() function to add patterns with domain names.
For other cases can use ndpi_add_string_value_to_automa().
ac_automata_feature(ac_automa, AC_FEATURE_LC) allows adding
and compare data in a case insensitive manner. For mandatory pattern comparison
from the end of the line, the "ac_pattern.rep.at_end=1" flag is used.
This eliminated unnecessary conversions to lowercase and adding "$" for
end-of-line matching in domain name patterns.
ac_match_handler() has been renamed ac_domain_match_handler() and has been greatly simplified.
ac_domain_match_handler() looks for the template with the highest domain level.
For special cases it is possible to manually specify the domain level.
Added test for checking ambiguous domain names like:
- short.weixin.qq.com is QQ, not Wechat
- instagram.faae1-1.fna.fbcdn.net is Instagram, not Facebook
If you specify a NULL handler when creating the AC_AUTOMATA_t structure,
then a pattern with the maximum length that satisfies the search conditions will be found
(exact match, from the beginning of the string, from the end of the string, or a substring).
Added debugging for ac_automata_search.
To do this, you need to enable debugging globally using ac_automata_enable_debug(1) and
enable debugging in the AC_AUTOMATA_t structure using ac_automata_name("name", AC_FEATURE_DEBUG).
The search will display "name" and a list of matching patterns.
Running "AHO_DEBUG=1 ndpiReader ..." will show the lines that were searched for templates
and which templates were found.
The ac_automata_dump() prototype has been changed. Now it outputs data to a file.
If it is specified as NULL, then the output will be directed to stdout.
If you need to get data as a string, then use open_memstream().
Added the ability to run individual tests via the do.sh script
2021-07-12 17:39:43 +02:00
Luca Deri
78b1295dc1
Fixed false positives in Z39.50
2021-07-09 00:16:48 +02:00
Luca Deri
bec8361638
Updated category labels
2021-07-08 20:05:50 +02:00
Vitaly Lavrov
398ad8e5ff
Fix for #1230 ( #1235 )
...
* Revert "Fix return value of ndpi_match_string_subprotocol() (#1230 )"
This reverts commit 58665e93a9 .
* Checking the return code after calling ndpi_match_string_subprotocol()
ndpi_api.h: Description of the returned error codes for
the ndpi_match_string_subprotocol() function.
If the ndpi_match_string_subprotocol() function returned an error,
then return NDPI_PROTOCOL_UNKNOWN.
http: The "Content-type" header is only checked if it is not empty.
2021-07-07 14:32:57 +02:00
Toni
34d0718bca
Improved RTSP detection the second. ( #1232 ) ( #1233 )
...
* RTSP is no subprotocol of HTTP (most of the time)
* detection patterns should stay in rtsp.c
* set detected HTTP protocol only if at least a valid HTTP method detected
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-07 09:55:36 +02:00
Luca Deri
c408710c52
Added test pcap
2021-07-06 18:57:52 +02:00
Toni
6f29733262
Improved RTSP via HTTP detection. ( #1232 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-06 18:57:04 +02:00
Ivan Nardi
58665e93a9
Fix return value of ndpi_match_string_subprotocol() ( #1230 )
2021-07-06 18:55:14 +02:00
Luca Deri
1ee7355b91
Updated prototype
2021-07-05 22:35:11 +02:00
Luca Deri
e5dacc28e7
Minor fix
2021-07-05 22:02:46 +02:00
Luca Deri
48db44a567
Code cleanup
2021-07-05 21:45:30 +02:00
Alfredo Cardigliano
8e7b063804
Fix possible segfault/leak
2021-07-05 15:09:48 +02:00
Toni
6f7acfcab5
Added protocols to HTTP as subprotocols. ( #1228 )
...
* if HTTP was detected,
all of those defined subprotocol detection routines should called
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-05 09:43:15 +02:00
Ivan Nardi
46c32d2433
TLS: fix a memory error in JA3 code ( #1227 )
...
protocols/tls.c:1856:5: runtime error: index 256 out of bounds for type 'char [256]'
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior protocols/tls.c:1856:5
2021-07-05 09:42:52 +02:00
Ivan Nardi
1116d0e4b1
Improve content match lists ( #1226 )
...
Add support for Likee app (https://likee.video/ ) and GitLab
Improve detection of Google domains ("gtv1.com" added in 6dd42d19f was
likely a typo)
Improve Snapchat and Tiktok detection
2021-07-05 09:42:11 +02:00
Toni
21b2cce715
Improved Z39.50 detection. ( #1225 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-05 09:41:35 +02:00
Toni
ced6fca184
Fixed off-by-one memory error for TLS-JA3. ( #1222 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-06-29 15:33:12 +02:00
Toni
8222ac5bdc
Removed ht_hash as it is not used anymore. ( #1220 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-06-29 15:32:48 +02:00
Toni
1c2a0c36f1
Added Z39.50 protocol. ( #1219 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-06-29 15:32:16 +02:00
vpiserchia and vpiserchia
e5fd86393e
reconcile PPSTREAM protocol category with content_match declarations ( #1218 )
...
* reconcile PPSTREAM protocol category with content_match declarations
* remove duplicate declaration for PPSTREAM protocol
Co-authored-by: vpiserchia <vito.piserchia@dreamlab.net >
2021-06-28 14:58:42 +02:00
Ivan Nardi
f8fe3ee520
QUIC: add basic support for fragmented Client Hello ( #1216 )
...
Only in-order and non overlapping fragments are handled
See #1195
2021-06-24 18:30:34 +02:00
Luca Deri
6a1fd9ad97
Added missing check to prevent crashes
2021-06-23 12:17:21 +02:00
Vitaly Lavrov
2234b97149
ndpiReader: memory leak ( #1215 )
...
Non-critical bugs.
If a file list is used, then all files except the last are not closed.
Opening the next file loses the memory allocated via pcap_open_offline() for the previous file.
If a bpf filter is used, then no memory is freed after pcap_compile.
2021-06-23 12:04:03 +02:00
Vitaly Lavrov
35fc6a6de5
Speed and memory size optimisation ( #1214 )
...
Removed bigram_automata, impossible_bigram_automata, trigram_automata.
The ahocorasick structure is replaced with a bitmap.
The bitmap size for ndpi_en_bigram is 176 bytes.
The bitmap size for ndpi_en_trigram is 2201 bytes.
On the test machine, the test execution time was reduced from 27.3 seconds to 24.7 (9%).
2021-06-23 12:03:52 +02:00
Luca Deri
f19937c8c9
Addesses partial application matching ( #1207 )
2021-06-21 21:59:15 +02:00
Luca Deri
0cbb4b2ffa
Restored 32 bit value in ndpi_match_string_value()
2021-06-21 17:06:22 +02:00
Luca Deri
613e21002a
Upgraded exponential smoothing to 64 bit values
2021-06-18 22:56:56 +02:00
Luca Deri
0afc8ace3d
Added nDPI Score report
2021-06-17 23:52:01 +02:00
martinscheu and tinu
0b9b6a683d
fixed lua errors in non-iec104 packets ( #1209 )
...
* Update iec.lua
fixed lua errors in non iec 104 packets
* Update iec.lua
Co-authored-by: tinu <martin.scheu@switch.ch >
2021-06-17 15:35:31 +02:00
Luca Deri
b0b3e1bc6c
Added bitmap boundary checks
2021-06-17 10:49:11 +02:00
Luca Deri
e89c06256e
Extende nDPI API with ndpi_netbios_name_interpret()
2021-06-17 09:35:19 +02:00
Luca Deri
2eba77e3b0
NetBIOS decoding changes
2021-06-16 19:57:20 +02:00
Vitaly Lavrov
be808c30f3
Code review. ( #1205 )
...
The common actions required to call the ac_automata_search() function
have been moved to the ndpi_match_string_common function. This made it
possible to simplify the ndpi_match_string, ndpi_match_string_protocol_id,
ndpi_match_string_value, ndpi_match_custom_category, ndpi_match_string_subprotocol,
ndpi_match_bigram, ndpi_match_trigram functions.
Using u_int16_t type for protocol identifiers when working with the
ahocorasick library (changes src/include/ndpi_api.h.in and src/include/ndpi_typedefs.h).
Reworked "finalization" of all AC_AUTOMATA_t structures.
Changing the order of fields in the ndpi_call_function_struct structure
reduces the size of the ndpi_detection_module_struct structure by 10 kB (for x86_64).
2021-06-15 11:28:09 +02:00
Luca Deri
09293fabd9
Win fix
2021-06-15 11:26:36 +02:00
Luca Deri
43ccaef2f5
IEC analysis wireshark plugin
2021-06-14 21:18:37 +02:00
Alfredo Cardigliano
4aefbe0c7a
Call ac_automata_release with free_pattern = 1 (malloc'ed patterns expected in ndpi_add_string_to_automa)
2021-06-14 14:41:14 +02:00
Luca Deri
380286c069
Fixes https://github.com/ntop/ntopng/issues/5482
2021-06-11 22:21:03 +02:00
Luca Deri
a79b8ee834
Reimplememnted SNMP dissector
2021-06-11 21:44:51 +02:00
Luca Deri
dee6f90d6c
Syntax error fixes
2021-06-11 21:01:27 +02:00
Luca Deri
c9f582805b
Fixed flow score label
2021-06-11 19:53:07 +02:00
Matteo Biscosi
a01a2b7443
Changed output for the sharkfest lua scripts
2021-06-11 11:00:06 +02:00
Vitaly Lavrov
6704649a75
Bug in ndpi_lru_find_cache ( #1204 )
...
Key value check is missing.
2021-06-10 11:06:19 +02:00
Luca
1a8ae710cf
Minor code cleanup
2021-06-09 08:58:18 +02:00
Toni
65e67a2f88
autoconf: Do not check for json-c if --with-only-libndpi is set. ( #1202 )
...
* json-c is used by a unit test
* required to fix some libnDPI cross compilation issues
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-06-09 08:01:10 +02:00
Luca Deri
77710ed8b4
OpenWRT document fix
2021-06-08 21:39:28 +00:00
Luca Deri
177f9456bd
Win changes
2021-06-08 18:15:46 +02:00
Luca Deri
d3aa3df975
Updated scripts
2021-06-08 17:52:03 +02:00
Luca
41ec807d79
New testing pcap with syn scan attack
2021-06-08 10:39:41 +02:00
Luca
2f8d3ac0b0
Companion scripts written for the Sharkfest conference
2021-06-08 10:39:19 +02:00
Luca Deri
2af7b33de0
Added report on score cli/srv breakdown
2021-06-07 14:59:18 +02:00
Vitaly Lavrov
65678dbeea
New version of the ahocorasick library ( #1200 )
...
The new version is about 25% faster with -O2 and 45% faster with -O3.
No recursion is used (smaller stack size required).
Uses less memory (by valgrind info)
bigram:
- original 1796 allocs, 247864 bytes allocated
- new 1232 allocs, 158880 bytes allocated
host_match:
- original 18038 allocs, 3004576 bytes allocated
- new 6861 allocs, 396624 bytes allocated
The function ac_automata_search() is thread safe.
Optional case-insensitive comparison.
Matching at the beginning and at the end of the string is supported.
One code file and one header file.
2021-06-07 14:19:40 +02:00
Vitaly Lavrov
2fcf641e87
Fixed uninitialized memory use. ( #1198 )
...
The pointer "header" must be initialized before first call pcap_next_ex().
2021-06-07 10:08:39 +02:00
Luca Deri
b241dd5e6b
Fixed expected output
2021-06-03 09:06:01 +02:00
Luca Deri
03ae090d39
Warnign fix
2021-06-03 09:05:53 +02:00
Luca Deri
8761ac1887
Renamed Skyp in Skype_Teams as the protocol is now shared across these apps
2021-06-02 21:47:01 +02:00
Ivan Nardi
654e84ff02
wireshark/lua: improve flow risk visualization ( #1194 )
...
Create a separated proto field entry for each possible flow risk.
This way, filtering will be more natural: you can use something like
"ndpi.flow_risk.desktop_file_sharing_session"
2021-06-02 21:28:50 +02:00
Luca Deri
06c6941f03
Removed xbox and playstation invalid port guesses
2021-06-02 00:24:41 +02:00
Ivan Nardi
9d427faafe
ndpiReader: fix collecting of risks statistics ( #1192 )
2021-06-01 16:50:46 +02:00
Ivan Nardi
f4dbeecba9
TLS: improve check for common ALPNs ( #1191 )
...
Facebook is still using its own ALPN for HTTP2 as well
2021-06-01 16:50:28 +02:00
Luca
c620858671
Reworked ndpi flow risk score adding client and server score
2021-06-01 09:17:26 +02:00
Alfredo Cardigliano
c4084ca3c7
Fix warnings
2021-05-25 15:17:48 +02:00
Luca
eb0115d4e0
Added TLS check to avoid crash with UDP-based traffic
2021-05-25 09:03:24 +02:00
Luca Deri
d485c1cecb
Improved TLS browser detection heuristics
2021-05-19 21:28:33 +02:00
Ivan Nardi
71b81d3799
wireshark/lua: fix offsets ( #1187 )
2021-05-18 21:36:46 +02:00
Luca Deri
732bcecd17
Added flow risk score
2021-05-18 21:05:47 +02:00
Luca Deri
86f3c29d03
Typo
2021-05-18 19:52:33 +02:00
Luca Deri
ca15e3295e
Added risk/score dump (ndpiReader -h)
...
Added ndpi_dump_risks_score() API score
2021-05-18 19:34:17 +02:00
Luca Deri
0b3d627185
Updated API for ndpi_risk2score()
...
Added ndpi_get_upper_proto() API call
2021-05-17 22:39:07 +02:00
Luca Deri
43a8576efb
Reworked human readeable string search in flows
...
Removed fragment manager code
2021-05-17 20:55:06 +02:00
Luca Deri
1ec621c85b
Added further checks
2021-05-15 19:53:46 +02:00
Luca Deri
9c5ba9c060
Updated protocol category
2021-05-15 11:20:15 +02:00
Luca Deri
5646ffa725
Added ndpi_check_subprotocol_risk() API call definition
2021-05-15 11:16:27 +02:00
Luca Deri
abd6bce6f9
Added TLS certifiacate caching
...
Added Fortigate protocol
2021-05-15 10:52:16 +02:00
Luca Deri
ca92660d98
Converted some test .pcapng files to pcap format
2021-05-13 20:51:11 +02:00
Luca Deri
ac1eaca8a6
Added browser TLS heuristic
2021-05-13 20:00:27 +02:00
Luca Deri
a62be9b8ec
Implemented heuristic to detect Safari and Firefox TLS browsing
2021-05-13 12:37:07 +02:00
Toni
87076dcd5b
Fixed obsolete error printing if CTRL-C is pressed. #1165 ( #1184 )
...
* This fix was proposed by @robertsong2019
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-05-11 21:38:56 +02:00
Toni
5918a6542d
Improved SSL certificate name wildcard handling and risk. #1182 ( #1183 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-05-11 21:38:26 +02:00
Luca Deri
a5ecdf9df8
Changes for sonarcloud integration
2021-05-11 21:36:25 +02:00
Luca Deri
5079bb1106
Fixed typo
2021-05-11 21:33:48 +02:00
Luca Deri
4297a65ce8
Implemented flow score in Wireshark integration
2021-05-10 22:43:05 +02:00
Luca Deri
fff60ec317
Added check to reduce MongoDB false positive detection
2021-05-10 21:14:55 +02:00
Luca Deri
66ebe444ae
Added (partial) Activision protocol support (based on tencent cloud)
2021-05-10 15:41:52 +02:00
Ivan Nardi
1deae1132b
Fix some warnings ( #1181 )
...
```
In file included from protocols/fasttrack.c:29:
../include/ndpi_api.h:1504:3: warning: type qualifiers ignored on function return type [-Wignored-qualifiers]
1504 | const ndpi_risk_severity ndpi_risk2severity(ndpi_risk_enum risk);
| ^~~~~
In file included from protocols/amazon_video.c:28:
../include/ndpi_api.h:1504:3: warning: type qualifiers ignored on function return type [-Wignored-qualifiers]
1504 | const ndpi_risk_severity ndpi_risk2severity(ndpi_risk_enum risk);
| ^~~~~
...
ndpi_utils.c: In function ‘ndpi_risk2severity’:
ndpi_utils.c:1834:1: warning: control reaches end of non-void function [-Wreturn-type]
1834 | }
| ^
```
2021-05-09 15:11:05 +02:00
Ivan Nardi
2ca37ff8be
TLS: fix extraction for TLS signature algorithms ( #1180 )
...
```
==69562==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x6100009000fb at pc 0x7f41882003a7 bp 0x7f4183cfbfc0 sp 0x7f4183cfb768
READ of size 32 at 0x6100009000fb thread T1
#0 0x7f41882003a6 in __interceptor_memcpy ../../../../src/libsanitizer/sanitizer_common/sanitizer_common_interceptors.inc:827
#1 0x560b2d7462a1 in processClientServerHello protocols/tls.c:1647
#2 0x560b2d73be6a in processTLSBlock protocols/tls.c:712
#3 0x560b2d73e61f in ndpi_search_tls_udp protocols/tls.c:968
```
2021-05-09 15:10:41 +02:00
Ivan Nardi
12c6ab768d
TLS: fix another use-of-uninitialized-value error in ClientHello parsing ( #1179 )
...
Error detected with valgrind.
==13127== Conditional jump or move depends on uninitialised value(s)
==13127== at 0x483EF58: strlen (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
==13127== by 0x1A93B6: ndpi_strdup (ndpi_main.c:159)
==13127== by 0x1C07CC: processClientServerHello (tls.c:1678)
==13127== by 0x1C0C4C: processTLSBlock (tls.c:712)
==13127== by 0x1C0C4C: ndpi_search_tls_tcp.part.0 (tls.c:849)
See also 8c3674e9
2021-05-09 15:10:14 +02:00
Toni
8c28613eb2
Check datalink during fuzzing to prevent console / logfile spam. See #1175 for more information. ( #1177 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-05-09 15:09:43 +02:00
Bernhard M. Wiedemann
0663544be8
Allow to override build date with SOURCE_DATE_EPOCH ( #1176 )
...
in order to make builds reproducible.
See https://reproducible-builds.org/ for why this is good
and https://reproducible-builds.org/specs/source-date-epoch/
for the definition of this variable.
2021-05-09 15:09:15 +02:00
Luca
ae2470fad4
Initial work towards detection via TLS of browser types
2021-05-06 21:42:06 +02:00
Luca
808050e635
Add extraction for TLS signature algorithms
2021-05-06 08:56:01 +02:00
Luca
ce54a6ab57
Added ndpi_risk2severity() API call
2021-05-02 19:35:01 +02:00
Luca Deri
153d11c920
Enhanced netbios decoding check
2021-04-28 22:58:22 +02:00
Luca Deri
dd65142020
Compilation fix
2021-04-27 08:26:08 +02:00
Luca Deri
70686249c9
Updated code due to https://github.com/ntop/nDPI/pull/1175
2021-04-27 08:12:14 +02:00
Luca Deri
7b62db81c3
Removed DGA check for ipv6 reverse IPs
2021-04-27 07:23:11 +02:00
Toni
da3e6bd61b
Check for common ALPNs and set a flow risk if not known. ( #1175 )
...
* Increased risk bitmask to 64bit (instead of 32bit).
* Removed annoying "Unknown datalink" error message for fuzzers.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-04-27 07:22:04 +02:00
Luca Deri
d5b395f35a
Fixed invalid DNS dissection
2021-04-26 23:08:00 +02:00
Luca Deri
87ad2b58dc
Compilation fix
2021-04-26 10:50:19 +02:00
Luca Deri
4a09707e48
Added flow risk to wireshark dissection
2021-04-26 10:17:29 +02:00
Luca Deri
a04efb7ce7
Added tshark description
2021-04-25 11:47:19 +02:00
Luca Deri
fad246289f
README for the tshark class
2021-04-25 11:45:35 +02:00
Luca Deri
b586c223dd
Lua tshark class and examples
2021-04-25 11:40:53 +02:00
Luca Deri
0ef7998348
Removed protocol space in Genshin Impact
2021-04-25 10:06:22 +02:00
Toni
b4a8c8c63f
Add Genshin Impact protocol. ( #1173 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-04-25 10:02:07 +02:00
Alfredo Cardigliano
d95cd9912c
Add vxlan enum to ndpi_packet_tunnel
2021-04-21 12:43:12 +02:00
Toni
9377991263
Add HP Virtual Machine Group Management (hpvirtgrp) protocol. ( #1170 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-04-20 14:12:16 +02:00
Luca Deri
c6a835746e
Reworked GeoIP API
...
int ndpi_get_geoip_asn(struct ndpi_detection_module_struct *ndpi_str,
char *ip, u_int32_t *asn);
int ndpi_get_geoip_country_continent(struct ndpi_detection_module_struct *ndpi_str, char *ip,
char *country_code, u_int8_t country_code_len,
char *continent, u_int8_t continent_len);
2021-04-19 21:39:55 +02:00
Ivan Nardi
8c3674e9a3
TLS: fix some use-of-uninitialized-value errors in ClientHello parsing ( #1169 )
...
Error detected with valgrind.
==125883== Conditional jump or move depends on uninitialised value(s)
==125883== at 0x438F57: processClientServerHello (tls.c:1421)
==125883== by 0x43B35A: processTLSBlock (tls.c:712)
==125883== by 0x43B1C4: ndpi_search_tls_tcp (tls.c:849)
==125883== by 0x42C60B: check_ndpi_detection_func (ndpi_main.c:4426)
==125883== by 0x42E920: ndpi_detection_process_packet (ndpi_main.c:5301)
==125916== Conditional jump or move depends on uninitialised value(s)
==125916== at 0x438D7D: processClientServerHello (tls.c:1379)
==125916== by 0x43B35A: processTLSBlock (tls.c:712)
==125916== by 0x43B1C4: ndpi_search_tls_tcp (tls.c:849)
==125916== by 0x42C60B: check_ndpi_detection_func (ndpi_main.c:4426)
==125932== Conditional jump or move depends on uninitialised value(s)
==125932== at 0x438C1D: processClientServerHello (tls.c:1298)
==125932== by 0x43B35A: processTLSBlock (tls.c:712)
==125932== by 0x43B1C4: ndpi_search_tls_tcp (tls.c:849)
==125932== by 0x42C60B: check_ndpi_detection_func (ndpi_main.c:4426)
==125950== Conditional jump or move depends on uninitialised value(s)
==125950== at 0x438D4F: processClientServerHello (tls.c:1371)
==125950== by 0x43B35A: processTLSBlock (tls.c:712)
==125950== by 0x43B1C4: ndpi_search_tls_tcp (tls.c:849)
==125950== by 0x42C079: check_ndpi_detection_func (ndpi_main.c:4443)
2021-04-18 21:38:01 +02:00
Ivan Nardi
9ca62ed7ac
Fix detunneling of GTP-U traffic ( #1168 )
...
Fuzzing #1161 exposed some (completely unrelated) issues on GTP-U
detunneling code.
(see https://github.com/ntop/nDPI/actions/runs/719882047 )
2021-04-18 21:37:51 +02:00
Ivan Nardi
d9278d55c3
Improve classification of Outlook/MicrosoftMail traffic ( #1167 )
...
See #1148
2021-04-18 21:37:26 +02:00
Luca Deri
9fcf98c067
GeoIP handlign fixes
2021-04-18 21:36:03 +02:00
Luca Deri
18c6c1c2d6
Added NDPI_DESKTOP_OR_FILE_SHARING_SESSION risk to remote protocols for remote assistance sessions
2021-04-12 18:11:14 +02:00
Luca Deri
bf318e0b86
Added NDPI_DESKTOP_OR_FILE_SHARING_SESSION flow risk
2021-04-11 14:42:27 +02:00
Ivan Nardi
ceb98a3f9c
wireshark/lua: fix handling of VLAN traffic ( #1162 )
2021-04-05 19:23:56 +02:00
Ivan Nardi
0bfe444362
GTP: fix parsing of GTP headers ( #1161 )
...
Message length checks and basic headers are not uniform across GTP-U,
GTP-C and GTP-PRIME.
Note that, even if the length checks were wrong, the GTP sessions were almost
always correctly classified because of the "guessing" algorithm.
This patch has been tested with GTP-U, GTP-C-V1, GTP-C-V2 and GPT-PRIME-V2
traffic using ndpiReader with "-d" flag (to avoid "guessing" algorithm) and
without "-t" flag (to avoid GTP-U de-tunneling).
See #1148
2021-04-05 19:23:03 +02:00
Ivan Nardi
fb74785282
Fix some warnings about unused variables/functions ( #1160 )
2021-04-05 19:21:30 +02:00
Luca Deri
a1dba74346
Trace fix
2021-04-02 12:55:15 +02:00
Luca Deri
4f8ca9485a
Fixed incapoatibilities with the latest extcap/wireshark
2021-04-01 23:53:53 +02:00
Luca Deri
db5aeb0cb1
Readme update
2021-04-01 10:24:44 +02:00
Luca Deri
28879c570e
Reworked ndpi patricia includes to avoid compilation issues on some platforms
2021-03-31 19:43:55 +02:00
Ivan Nardi
1290c40968
Mining: lru cache is ipv4 only (for the time being) ( #1159 )
...
Fix memory error with ipv6 traffic
2021-03-31 14:13:07 +02:00
Luca Deri
48726301e1
Fixed mispelled word
2021-03-31 12:52:54 +02:00
Luca Deri
2b84f28df5
Improved mining results
2021-03-30 17:54:44 +02:00
Luca Deri
c1d6e3f145
Improved mining detection support
2021-03-30 17:50:19 +02:00
Luca Deri
637b2063ed
Added missing tracker/Ads breed
2021-03-30 17:50:03 +02:00
Luca Deri
fcbc16da00
Fixed invalid guess stats
2021-03-30 17:49:48 +02:00
Luca Deri
ffbce931b9
Ignore TLD .local .lan and .home in DGA domain check
2021-03-26 15:53:04 +01:00
Ivan Nardi
a6029d250d
ndpiReader: print an error msg if we found an unsupported datalink type ( #1157 )
2021-03-23 11:47:29 +01:00
Toni
b040407683
Refactored nDPI subprotocol handling and aimini protocol detection. ( #1156 )
...
* Refactored and merged callback buffer routines for non-udp-tcp / udp / tcp / tcp-wo-payload.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Try to detect one subprotocol if a detected protocol can have one.
* This adds a performance overhead due to much more protocol detection routine calls.
See #1148 for more information.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Refactor subprotocol handling (1/2).
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Refactor subprotocol handling (2/2).
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Prevent some code duplication by using macros for ndpi_int_one_line_struct string comparision.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Refactored aimini HTTP detection parts (somehow related to #1148 ).
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Added aimini client/server test pcap.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Removed master protocol as it was only used for STUN and via also removed API function ndpi_get_protocol_id_master_proto
* Adjusted Python code to conform to the changes made during the refactoring process.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-03-23 11:46:12 +01:00
Luca Deri
0cae9bf4a4
Win compilation fix
2021-03-22 21:41:28 +01:00
Luca Deri
627299e4dd
Better DGA detection (slightly decreased accuracy)
2021-03-20 17:56:24 +01:00
Luca Deri
6333bb1702
Removed duplicate extesions len
2021-03-19 22:35:08 +01:00
Luca Deri
d96f4ca736
Added ALPN and elliptic curve in JA3S+
2021-03-19 22:33:04 +01:00
Luca Deri
fa238bbe42
Implemented JA3+ also for JA3S
2021-03-19 22:27:36 +01:00
Luca Deri
e2c3445a20
Reworked JA3
2021-03-19 22:20:52 +01:00
Luca Deri
61f7ec1696
JA3 debug improvements
2021-03-19 19:10:31 +01:00
Luca Deri
9eed0a60d3
Fixed support for custom DGA detection libraryr
2021-03-18 11:32:56 +01:00
Luca Deri
b22cb70a68
Added % of flows with risks
2021-03-14 21:59:33 +01:00
Luca Deri
1b6275005e
Added in stats the number of flows with risks
2021-03-14 21:54:35 +01:00
Luca Deri
3b02cfab69
Added flows risks report
2021-03-14 21:46:23 +01:00
Luca Deri
565a7bfce3
Reworked extendal dependency across testing tools
2021-03-14 20:48:21 +01:00
Luca Deri
e58527536d
Help crash fix
2021-03-14 19:55:21 +01:00
Luca Deri
9419015711
Implemented square erro rollup to avoid overflow
2021-03-14 11:01:51 +01:00
Zied Aouini
7f9a18fd05
Make libmaxminddb build configurable. ( #1154 )
2021-03-14 10:47:28 +01:00
Alfredo Cardigliano
efc5630378
Fix compilation warning
2021-03-12 09:25:00 +01:00
Luca
192fad4402
Added double exponential smoothing implementation
2021-03-11 09:39:52 +01:00
Luca Deri
6833ee2bbe
Added single exponential smoothing API
...
int ndpi_ses_init(struct ndpi_ses_struct *ses, double alpha, float significance);
int ndpi_ses_add_value(struct ndpi_ses_struct *ses, const u_int32_t _value, double *forecast, double *confidence_band);
2021-03-11 00:04:33 +01:00
Luca Deri
5b7fe1360a
Fixed JA3+ computation
2021-03-11 00:04:12 +01:00
Luca Deri
5c6f070097
Fixed nDPI prefs definition
2021-03-09 23:50:31 +01:00
Luca Deri
f6ad16d8f8
Added experiemntal JA3+ implementation that can be used with -z i ndpiReader
2021-03-09 23:38:29 +01:00
Ivan Nardi
8074bc8201
HTTP: fix memory access in ndpi_http_parse_subprotocol() ( #1151 )
2021-03-09 19:46:32 +01:00
Luca Deri
574fc4f09e
Ookla detection improvement
2021-03-09 17:43:12 +01:00
Luca Deri
3032864ec9
Added Ookla detection over IPv6
2021-03-09 12:55:14 +01:00
Luca Deri
db716d0ab0
Ookla fixes
2021-03-09 11:42:23 +01:00
Luca Deri
477e4db650
Improved detection of Ookla speedtest and openspeedtest.com
2021-03-09 11:38:31 +01:00
Luca Deri
bb6423a79f
Added the ability to define a custom DGA detection function by overwriting
...
the value of the function pointer ndpi_dga_function curently set to NULL
(that means the nDPI internal DGA function will be used)
2021-03-08 22:57:30 +01:00
Ivan Nardi
c3490e80a7
Fix some stack-use-after-return errors in automa code ( #1150 )
2021-03-08 21:14:01 +01:00
Ivan Nardi
c50a8d4808
Add support for Snapchat voip calls ( #1147 )
...
* Add support for Snapchat voip calls
Snapchat multiplexes some of its audio/video real time traffic with QUIC
sessions. The peculiarity of these sessions is that they are Q046 and
don't have any SNI.
* Fix tests with libgcrypt disabled
2021-03-06 05:48:36 +01:00
Alfredo Cardigliano
73e4348570
Add ndpi_serialize_binary_boolean for consistency. Fix comments.
2021-03-04 10:31:03 +01:00
Luca Deri
0f8a994841
Improved DGA detection
...
Before
Accuracy 66%, Precision 86%, Recall 38%
After
Accuracy 71%, Precision 89%, Recall 49%
2021-03-03 19:30:01 +01:00
Luca
49843509e5
Added verbose option
2021-03-03 08:12:16 +01:00
Luca Deri
1a37595de0
Removed check for knowns protocols (major and app protocols)
2021-03-03 00:57:56 +01:00
Luca Deri
56bfb439f8
Improved DGA detection with trigrams. Disadvantage: slower startup time
...
Reworked Tor dissector embedded in TLS (fixes #1141 )
Removed false positive on HTTP User-Agent
2021-03-03 00:41:07 +01:00
Ivan Nardi
4c00ff89df
DTLS: improve support ( #1146 )
...
* DTLS: add some pcap tests
* DTLS: fix parsing of Client/Server Helllo message
* DTLS: add parsing of server certificates
2021-03-02 21:15:40 +01:00
Ivan Nardi
2b71a329c1
QUIC: fix mvfst-27 test ( #1145 )
...
Regardless of its name, quic-mvfst-27 trace doesn't contain mvfst-27
traffic
2021-03-02 21:15:02 +01:00
Ivan Nardi
c12a697f2d
TOR: update node list ( #1144 )
...
https://panwdbl.appspot.com/lists/ettor.txt list is no more available
Close #1141
2021-03-02 21:14:36 +01:00
Luca Deri
2d558afb54
Added HW checks
2021-03-01 19:59:14 +01:00
Luca Deri
2724a14bf7
Added further HW checks
2021-03-01 19:34:20 +01:00
Luca Deri
4bff595733
Holt-Winters calculation improvement
2021-02-27 11:32:51 +01:00
Toni
16890a6632
Added NDPI_MALICIOUS_SHA1 flow risk. ( #1142 )
...
* An external file which contains known malicious SSL certificate SHA-1 hashes
can be loaded via ndpi_load_malicious_sha1_file(...)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-02-26 17:00:05 +01:00
Luca Deri
fba61adf5e
Improved DNS dissector
2021-02-26 00:42:15 +01:00
pengtian
28330edb7a
[Fix] replace free to ndpi_free ( #1140 )
...
same as https://github.com/ntop/nDPI/issues/1096
2021-02-25 08:46:55 +01:00
Toni
70c35addcb
Added protocol breed to JSON serializer. ( #1137 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-02-25 08:46:38 +01:00
Alfredo Cardigliano
d898fddea0
Fix ndpi_fill_prefix_v6
2021-02-24 14:43:12 +00:00
Luca Deri
545f270132
Windows code cleanup
2021-02-24 11:04:04 +01:00
Luca Deri
4bd175b07e
Modified JA3 fingerprint message
2021-02-24 10:42:26 +01:00
Alfredo Cardigliano
566d5db402
Add more utility functions to work with patricia trees
2021-02-23 11:53:15 +01:00
Alfredo Cardigliano
888ddfcd17
Update ndpi_patricia_walk_inorder API
2021-02-23 10:23:52 +01:00
Alfredo Cardigliano
f8e83f7e35
Add support for MAC to Patricia tree. Expose full API to applications. Add utility functions.
2021-02-23 10:01:56 +01:00
Luca Deri
b757cf606b
Fixed mispelled API call
2021-02-22 23:59:08 +01:00
Luca Deri
f1b22b199f
Added NDPI_MALICIOUS_JA3 flow risk
...
Added ndpi_load_malicious_ja3_file() API call
2021-02-22 23:19:23 +01:00
Luca Deri
fc3db8f169
Implemented TLS Certificate Sibject matching
...
Improved AnyDesk detection
2021-02-22 22:37:33 +01:00
Luca Deri
a21ad2fbe4
Added new data for risky domains test
2021-02-21 22:08:01 +01:00
Luca Deri
5ad056e99b
Removed unused NDPI_RISKY_COUNTRY
2021-02-21 21:45:46 +01:00
Luca Deri
fc16c9368e
Added risky domain flow-risk support
2021-02-21 21:45:46 +01:00
Luca Deri
6db20b3ba9
Updated dependency
2021-02-19 17:59:40 +01:00
Luca Deri
09559611cc
Fixes #1136
2021-02-19 15:15:02 +01:00
Luca Deri
dee24f7acf
Removed old unused code
2021-02-19 15:12:03 +01:00
Alfredo Cardigliano
e9350d8fc7
Fix leak
2021-02-19 09:27:24 +01:00
Luca Deri
92e8d95f38
Added ndpi_get_geoip() APi call
2021-02-18 23:15:27 +01:00
Luca Deri
bdf95a5c22
Package fix
2021-02-18 22:08:15 +00:00
Luca Deri
393a844c9a
GeoIP support
2021-02-18 22:40:57 +01:00
Luca Deri
bce54079d8
Initial geoip support
2021-02-18 22:35:25 +01:00
Luca Deri
a2c5adc374
Improved nDPI string matching algorithm
2021-02-18 21:47:09 +01:00
Luca Deri
fb4cdecb68
Fixes due to the fragment mananegr code
2021-02-18 13:31:02 +01:00
Luca Deri
413dc287b4
Added paper citation
2021-02-17 08:22:38 +01:00
Luca Deri
4609e2084b
Added new risks (future use)
...
- NDPI_RISKY_ASN
- NDPI_RISKY_DOMAIN
- NDPI_RISKY_COUNTRY
2021-02-16 18:23:19 +01:00
Alfredo Cardigliano
177f1785da
Fix warning
2021-02-12 09:11:14 +01:00
Luca Deri
813df77d07
Performance optimization to avoid un-necessary calls and thus increase the overall performance
2021-02-11 17:54:55 +01:00
Luca Deri
d99d636696
Some optimizations during flow guess
2021-02-10 19:51:26 +01:00
Luca Deri
fffff3760b
Code refactory
2021-02-10 19:28:35 +01:00
Luca Deri
ea0309d21b
Removed now obsolete NDPI_DETECTION_SUPPORT_IPV6: code is more readeable now
2021-02-10 19:09:11 +01:00
Luca Deri
76ac551ed3
Improved FTP_CONTROL detection
2021-02-10 17:55:07 +01:00
Luca Deri
79102ef4f2
Added check for avoiding long dissections
2021-02-10 17:36:09 +01:00
Ivan Nardi
421609475e
Fix small memory leak ( #1133 )
...
Now function definition matches the prototype in ndpi_api.h.in
2021-02-10 15:24:34 +01:00
Toni
1e12c90c66
Fixed memory leaks caused by conditional free'ing for some TLS connec… ( #1132 )
...
* Fixed memory leaks caused by conditional free'ing for some TLS connections.
* Members of tls_quic struct should also free'd if the detected master protocol is IMAPS / POPS / SMTPS / etc.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Prevent reader_util.c from exit()'ing if maximum flow count reached.
This confuses the fuzzer.
* Improved fuzz/Makefile.am to use LDADD for ../example/libndpiReader.a instead of LDFLAGS.
That way, fuzz_ndpi_reader re-links to ../example/libndpiReader.a if something changed there.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-02-10 15:24:11 +01:00
Luca Deri
c408df1b0e
STUN improvements
2021-02-10 15:22:20 +01:00
Luca Deri
e2f6569adb
Fixed CPHA missing protocol initialization
...
Improved IEC104 and IRC detection
2021-02-10 15:22:20 +01:00
Luca Deri
0de3d4c37a
Dissection inprovements
2021-02-09 21:48:46 +01:00
Luca Deri
512f73f381
Added checks for giving up faster on IRC and SMTP
2021-02-09 21:27:09 +01:00
Luca Deri
1a557d0918
IRC test files
2021-02-09 21:25:48 +01:00
Luca Deri
1331e0aec9
Extended the API to calculate jitter
...
- ndpi_jitter_init()
- ndpi_jitter_free()
- ndpi_jitter_add_value()
2021-02-09 15:56:03 +01:00
Luca Deri
b960809d3e
Minor code improvements
2021-02-09 12:55:11 +01:00
Luca Deri
4abaf3e279
Removed debug statement
2021-02-09 10:05:29 +01:00
Luca Deri
732579b72b
Added timeseries forecasting support implementing Holt-Winters with confidence interval
...
New API calls added
- ndpi_hw_init()
- ndpi_hw_add_value()
- ndpi_hw_free()
2021-02-08 19:10:25 +01:00
Luca Deri
d9da752aa8
Updated skype addresses
2021-02-07 19:05:56 +01:00
Luca Deri
3ecda45bc4
IP address matching update
2021-02-07 17:42:31 +01:00
Luca Deri
8297dacfe5
Added Makefile for building the development version of libndpi for OpenWRT
2021-02-07 09:29:01 +00:00
Luca Deri
be58d78417
(Temporarely) Disabled fragment manager ( #1129 )
2021-02-05 23:03:08 +01:00
Luca Deri
45e9c3c438
Partial fix for #1129
2021-02-05 22:22:33 +01:00
Alfredo Cardigliano
95a6a2072b
Code cleanup and safety checks in the fragment manager ( #1129 )
2021-02-05 17:16:11 +01:00
Luca Deri
8dd7716ae5
Implemented more efficient and memory savvy RSI
2021-02-05 12:38:41 +01:00
Luca Deri
60b58dbd67
RSI enhancements
2021-02-05 10:59:09 +01:00
Luca Deri
1eedf734be
Implemented API for computing RSI (Relative Strenght Index)
...
void ndpi_init_rsi(struct ndpi_rsi_struct *s, u_int16_t num_learning_values);
void ndpi_free_rsi(struct ndpi_rsi_struct *s);
float ndpi_rsi_add_value(struct ndpi_rsi_struct *s, const u_int32_t value);
2021-02-04 23:52:33 +01:00
Luca Deri
54636a3213
Improved (partial) TLS dissection
2021-02-04 22:06:18 +01:00
Ivan Nardi
679c317c57
Fix utests when "--disable-gcrypt" flag is used ( #1128 )
...
Fix: d6684f4b
2021-02-04 19:29:48 +01:00
Ivan Nardi
2a65321884
Fix some memory leakes in reassembler code ( #1127 )
2021-02-04 19:29:27 +01:00
Toni and Luca Deri
7255dbe4b7
Added fuzzy targets conditional in tests/do.sh.in which prevents the fuzzer from running if nDPI was configured previously --enable-fuzztargets but not for the current config (may produce invalid results). ( #1126 )
...
* fixed possible NULL pointer dereference for memcpy(), src pointer should never be NULL
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2021-02-04 19:28:52 +01:00
Luca Deri
c68c8c79c9
Added missing check
2021-02-04 18:17:45 +01:00
Luca Deri
6c366d73e2
Fixed leak with DTLS
2021-02-03 23:36:11 +01:00
Luca Deri
6289413fea
Updated results
2021-02-03 11:58:17 +01:00
Ivan Nardi
a772e18977
Fix a warning ( #1125 )
...
Introduced in 5f7b9d802
reader_util.c: In function ‘process_ndpi_collected_info’:
reader_util.c:1148:60: warning: ‘%s’ directive output may be truncated writing up to 255 bytes into a region of size 64 [-Wformat-truncation=]
1148 | sizeof(flow->ssh_tls.client_requested_server_name), "%s",
| ^~
reader_util.c:1147:5: note: ‘snprintf’ output between 1 and 256 bytes into a destination of size 64
1147 | snprintf(flow->ssh_tls.client_requested_server_name,
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1148 | sizeof(flow->ssh_tls.client_requested_server_name), "%s",
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1149 | flow->ndpi_flow->protos.tls_quic_stun.tls_quic.client_requested_server_name);
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-02-03 11:56:37 +01:00
Luca Deri
d6684f4b4c
Added test pcap
2021-02-03 11:56:14 +01:00
Ivan Nardi
8c0ea694f8
HTTP: fix user-agent parsing ( #1124 )
...
User-agent information is used to try to detect the user OS; since the
UA is extracted for QUIC traffic too, the "detected_os" field must be
generic and not associated to HTTP flows only.
Otherwise, you might overwrite some "tls_quic_stun" fields (SNI...) with
random data.
Strangely enough, the "detected_os" field is never used: it is never
logged, or printed, or exported...
2021-02-03 11:54:11 +01:00
Ivan Nardi
8cee718e8b
HTTP: fix logs when NDPI_ENABLE_DEBUG_MESSAGES is defined ( #1123 )
2021-02-03 11:53:41 +01:00
Luca Deri
155b1aaa68
Updated results due to the new fragment manager handler
2021-02-03 11:52:46 +01:00
Luca Deri
6e87daab69
Cosmetic fixes
2021-02-03 11:52:32 +01:00
Luca Deri
1f3ade5923
Increased number of extra packets that is necessary since the frgament mananger introduction
2021-02-03 11:51:55 +01:00
Luca Deri
4b181be58e
Improved debug message
2021-02-03 11:49:14 +01:00
Luca Deri
d19bad1581
Added pcap for testing fragments reassembly
2021-02-03 11:48:53 +01:00
Luca Deri
01f4a57118
Fixes an issue with https://github.com/ntop/nDPI/pull/1122 that misprocsssed packets belonging to flows whose initial part (e.g. the 3WH) was not observed by nDPI (e.g. capture started in the middle of the flow)
2021-02-03 11:47:21 +01:00
b70ad0e2f1
fragments management added ( #1122 )
...
Management of tcp segments managements.
Co-authored-by: ragostino <ragostino73@gmail.com >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2021-02-03 10:28:51 +01:00
ragostino
ee94534906
debug message bugfix ( #1108 )
...
you can not look for memory enlargement if you print debug message after updating the variables
2021-02-03 09:31:17 +01:00
Luca Deri
50f4049b58
Improved wireguard dissection
2021-01-29 16:38:43 +01:00
Luca Deri
bb74b903d0
DCE/RPC improvement to avoid false positives
2021-01-29 16:23:18 +01:00
Luca Deri
aeeccee106
DGA name improvement
2021-01-27 11:43:35 +01:00
Luca Deri
aa5486f5f8
Added missing library
2021-01-22 09:31:37 +01:00
Luca Deri
288ccd6215
Fixes due to datatype rename
2021-01-22 09:17:34 +01:00
Luca Deri
a31bd5ac3c
Cleaned up tls/quic datatypes
2021-01-21 19:17:33 +01:00
Luca Deri
15295ef4c5
Reworked TLS fingerprint calcolation
...
Modified TLS memory free
2021-01-21 19:06:05 +01:00
Toni
399755607d
Disable tests that require libgcrypt if --disable-gcrypt set. ( #1121 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-01-21 08:59:06 +01:00
morefigs
53415c8855
Added missing comma ( #1116 )
...
I presume there is a comma missing in this comma separated list.
2021-01-21 08:58:42 +01:00
Luca Deri
3e5e9569ff
Added simple hash implementation to the nDPI API
2021-01-20 21:30:19 +01:00
Luca Deri
d964c3e081
Code cleanup: third party uthash is at the right place
2021-01-20 19:11:36 +01:00
Luca
0809956e5f
Rewored UPnP protocol that in essence was WSD hence it has been renamed
...
Cleaned up TLS code for DTLS detection by defining a new DTLS protocol
2021-01-20 09:53:30 +01:00
Luca Deri
e9f43516ec
Improves STUN dissection removing an invalid termination condition that prevented Skype calls to be properly identified
2021-01-13 16:46:51 +01:00
Luca Deri
68b6ac7da8
(C) Update
2021-01-07 11:13:36 +01:00
Luca Deri
367184628e
Warning fix
2021-01-07 11:07:17 +01:00
Darryl Sokoloski
5f7b9d8024
Increase SNI hostname buffer length to 256. ( #1111 )
...
According to RFC 4366, SNI host names can be up to 255 bytes.
Previous size of 64 resulted in failed application matches due to truncation.
For example:
0976e041e65b1aece3e720df36ac6bd7.safeframe.googlesyndication.co|m
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2021-01-07 10:58:48 +01:00
Ivan Nardi
ec2735694b
STUN: avoid false positives ( #1110 )
...
STUN traffic doesn't use multicast addresses
2021-01-07 10:58:22 +01:00
Ivan Nardi
1e2b57bed4
HTTP: fix compilation and a memory error when NDPI_ENABLE_DEBUG_MESSAGES is defined ( #1109 )
2021-01-07 10:58:02 +01:00
Ivan Nardi
2080cc7365
QUIC: add suppport for DNS-over-QUIC ( #1107 )
...
Even if it is only an early internet draft, DoQ has already (at least)
one deployed implementation.
See: https://www.zdnet.com/article/ad-blocker-adguard-deploys-worlds-first-dns-over-quic-resolver/
Draft: https://tools.ietf.org/html/draft-huitema-dprive-dnsoquic-00
In the future, if this protocol will be really used, it might be worth to
rename NDPI_PROTOCOL_DOH_DOT in NDPI_PROTOCOL_DOH_DOT_DOQ
2021-01-07 10:56:39 +01:00
Ivan Nardi
00dabce65e
Quic fixes ( #1106 )
...
* QUIC: fix heap-buffer-overflow
* TLS: fix parsing of QUIC Transport Parameters
2021-01-07 10:55:55 +01:00
Ivan Nardi
b8a5358e80
QUIC: improve handling of SNI ( #1105 )
...
* QUIC: SNI should be always saved in flow->protos.stun_ssl.ssl.client_requested_server_name
Close #1077
* QUIC: fix matching of custom categories
* QUIC: add NDPI_TLS_MISSING_SNI support for older GQUIC versions
* QUIC: fix serialization
* QUIC: add DGA check for older GQUIC versions
2021-01-07 10:55:23 +01:00
Luca Deri
eb37f8f1fb
Split HTTP request from response Content-Type. Request Content-Type should be present with POSTs and not with other methods such as GET
2021-01-06 18:28:24 +01:00
Luca Deri
cd21f0d316
Added check for invalid HTTP content
2021-01-06 12:25:32 +01:00
Ivan Nardi
1b524f5538
QUIC: update to draft-33 ( #1104 )
...
QUIC (final!?) constants for v1 are defined in draft-33
2021-01-04 15:50:14 +01:00
Ivan Nardi
3aa16b63e8
Fix some warnings when compiling with "-W -Wall" flags ( #1103 )
2021-01-04 15:49:39 +01:00
Ivan Nardi
23b84cd3ee
Remove FB_ZERO protocol ( #1102 )
...
FB_ZERO was an experimental protocol run by Facebook.
They switched to QUIC/TLS1.3 more than 2 years ago; no one ever used it but
them so it is definitely dead.
See: https://engineering.fb.com/2018/08/06/security/fizz/
2021-01-04 15:49:19 +01:00
Toni
53ee6db795
Added a new API function `ndpi_free_flow_data' which free's all members of ndpi_flow_struct but not the struct itself. ( #1101 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-01-04 12:47:05 +01:00
Ivan Nardi
3bb12fde63
Fix memory leak introduced in b7376cc6 ( #1100 )
2021-01-04 12:46:30 +01:00
Luca Deri
4ddb5f4245
Added TLS test with long certificate
2021-01-04 11:31:25 +01:00
Luca Deri
a91e6179c5
Fixed missing symbol
2021-01-02 21:21:15 +01:00
Luca Deri
05d76525b0
Added HTTP suspicious content securirty risk (useful for tracking trickbot)
2021-01-02 21:11:42 +01:00
Luca Deri
32f0446c9c
Updated ndpi_ptree_match_addr() prototype
2020-12-30 18:23:40 +01:00
Luca Deri
b7376cc690
Restored QUIC stats
2020-12-30 12:12:33 +01:00
Luca Deri
dc401f8a74
Split ptree user data in 32 and 64 bit entries
2020-12-30 12:12:33 +01:00
pengtian
ab037e2c82
Bugfix for host check ( #1097 )
...
this bug is from commit `427002d14` `2020-05-06 00:31:40`
2020-12-29 14:41:41 +01:00
Luca Deri
84132c6735
Added known protocol on unknown port for ntop
2020-12-28 16:11:39 +01:00
Luca Deri
7f944cc43b
Initialization fix
2020-12-28 11:57:20 +01:00
Luca Deri
0fceb6576a
Free flow fix
2020-12-28 09:32:06 +01:00
Luca Deri
9c1827a77b
Fixed output when tLS (nad not QUIC) is used
2020-12-28 09:19:39 +01:00
Luca Deri
cf00ffed32
Removed test code
2020-12-26 18:13:10 +01:00
Luca Deri
e1be363037
Removed space from protocol name
2020-12-23 20:38:02 +00:00
Luca Deri
34fc9d5d50
Introduced fix on TLS for discarding traffic out of sequence that might invalidate dissection
2020-12-22 09:47:39 +01:00
Luca Deri
6462f4671c
Fixed invalid TLS check for extra processing detection
2020-12-21 22:42:05 +01:00
Luca Deri
b231982286
Win fixes
2020-12-17 15:34:17 +01:00
Luca Deri
df1b3367a9
Type change to avoid Windows compilation issues
2020-12-17 12:58:12 +01:00
Luca Deri
2768da0637
Improved HTTP dissection
2020-12-16 14:45:29 +01:00
Luca Deri
a89642ad04
Fixes bug introduced by https://github.com/ntop/nDPI/pull/1085
2020-12-12 12:32:44 +01:00
Zied Aouini
5bd5461f96
Fix minimum packet length condition ( #1087 )
2020-12-12 11:12:59 +01:00
Toni
74a77e7b3d
Added --ignore-vlanid / -I to exclude VLAN ids for flow hash calculation. #1073 ( #1085 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-12-11 21:01:51 +01:00
Toni
edf3a57a6a
Added `fast.com' host pattern to Netflix detection. #1080 ( #1084 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-12-11 21:01:28 +01:00
Ivan Nardi
5587010cfb
soulseek: fix heap buffer overflow ( #1083 )
...
Close #1082
2020-12-11 21:01:07 +01:00
Luca Deri
5cb6ddfd22
Rule changes work in progress
2020-12-11 17:25:57 +01:00
Luca Deri
21ad3a1775
Added initialization
2020-12-11 17:25:57 +01:00
Alfredo Cardigliano
499897219e
Add NDPI_PROTOCOL_ANY_CATEGORY to ndpi_protocol_category_t enum
2020-12-11 15:56:57 +01:00
Luca Deri
9c5fbb5208
Added FreeBSD ibuils instructions
2020-12-10 14:19:59 +00:00
Luca Deri
4cb8712a35
Added --with-mipsel for building nDPI on mipsel devices
2020-12-09 11:01:40 +00:00
Toni
62cd852c6f
Rename Jabber detection name as we are not sure if it is unencrypted e.g. if START_TLS used. ( #1079 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-12-08 15:49:17 +01:00
rafaliusz and rafal
1ecc6d323e
Add a connectionless DCE/RPC detection ( #1078 )
...
* Add connectionless DCE/RPC detection
* Add DCE/RPC pcap file as well as its test result
Co-authored-by: rafal <rafal.burzynski@cryptomage.com >
2020-12-08 15:48:53 +01:00
Ivan Nardi
860ef58ace
QUIC: sync with Wireshark latest changes ( #1074 )
...
Most of the QUIC crypto code has been "copied-and-pasted" from Wireshark;
try to stay in sync with the original sources to ease backporting of fixes.
Only cosmetic changes and code refactoring; no behaviour changes or bugfixes.
See:
https://gitlab.com/wireshark/wireshark/-/commit/5e45f770fd79ca979c41ed397fee72d2e8fb5f1e
https://gitlab.com/wireshark/wireshark/-/commit/5798b91c1526747bf688b6746b33562c1b24a9e0
2020-12-08 15:47:58 +01:00
Luca Deri
1fb1848586
Added chec for avoiding doung ntop_config.h include
2020-12-01 08:57:09 +00:00
Luca Deri
eb689b2069
nDPI rules (work in progress) implementation
2020-11-30 22:01:49 +01:00
Luca Deri
b77a4276f9
Fixed JSON-C check
2020-11-30 16:41:58 +01:00
Luca Deri
d4a42ed733
Improved JSON-C detection
2020-11-30 16:30:38 +01:00
Luca Deri
6b9155589a
Removed unnecessary field
2020-11-29 19:04:26 +01:00
Luca Deri
23a15bae5f
Fixes #1029
2020-11-27 18:51:56 +01:00
Luca Deri
6c119c0b06
Fixes #1032
2020-11-27 18:48:25 +01:00
Toni
daa1c8ef8c
Fix/overflow and libgerror check ( #1068 )
...
* Fixed stack overflow caused by missing buffer space for the trailing \0 added by sprintf()
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Remove the autoconf cache value from the previous and failed check before checking again.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-11-26 19:46:31 +01:00
Alfredo Cardigliano
7437ecaab0
Warning fix
2020-11-23 10:19:35 +01:00
Luca Deri
38984af03e
Updated disney definition
2020-11-22 18:49:28 +01:00
Luca Deri
78f762bd36
Typo
2020-11-22 16:51:13 +01:00
Luca Deri
21a6112b91
Added 129.205.94.0/23 to Facebook network list
2020-11-22 11:33:31 +01:00
Ivan Nardi
53a5c354d8
Quic fixes ( #1067 )
...
* QUIC: fix return value on error path on quic_cipher_init()
* QUIC: allow dissection of sessions forcing version negotiation
Enhance heuristic to avoid false positives.
2020-11-22 11:04:10 +01:00
Ivan Nardi
fb2027cc8e
iec60870-5-104: fix heap-buffer-overflow error ( #1066 )
2020-11-22 11:03:26 +01:00
Luca Deri
fe3d926741
Added prerequisites for Ubuntu/Debian systems
2020-11-18 16:40:45 +01:00
Alfredo Cardigliano
e45f0a4b64
Install ndpi under /usr
2020-11-17 09:19:07 +01:00
Luca Deri
d670850f55
Updated results
2020-11-16 21:25:59 +01:00
Luca Deri
acffd7bd1e
Compilation fix
2020-11-16 21:22:54 +01:00
Zied Aouini and Luca Deri
bfabb0ddf4
Add Virtual Asssitant (Alexa, Siri) support. ( #1057 )
...
* Add AmazonAlexa protocol.
* Add AmazonAlexa test file and result.
* Include pcapng as file format.
* Rename Category to VirtualAssistant.
* Add AppleSiri virtual assistant.
* Fix pcapng test files format support.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:19:38 +01:00
Oleksandr Natalenko
5c8e125f06
lib/ndpi_content_match: update TOR IPs ( #1063 )
...
Signed-off-by: Oleksandr Natalenko <oleksandr@natalenko.name >
2020-11-16 21:18:17 +01:00
Zied Aouini
3d8fd42307
Implement DGA detection performances tracking workflow. ( #1064 )
...
* Implement dga evaluation helper.
* Add test set for DGA classification.
* Add DGA classification performances tracking as part of Travis.
* Add DGA evaluation doc.
* Fix CI on OSX.
* Add missing backquote.
2020-11-16 21:17:16 +01:00
Zied Aouini
76bb83085b
Improve subprotocols detection. ( #1062 )
...
* Improve Spotify detection.
* Improve Skype detection.
* Improve Microsoft detection.
* Fix Microsoft detection categories.
* Improve Waze detection.
* Improve Apple detection.
* Improve WindowsUpdate detection.
* Improve TikTok detection.
* Improve Teams detection.
* Improve Youtube detection.
* Improve Messenger detection.
* Improve Twitch detection.
* Improve Hulu detection.
* Improve Facebook detection.
* Improve AmazonVideo detection.
2020-11-16 21:16:38 +01:00
Zied Aouini and Luca Deri
3529268df8
Add Tumblr support. ( #1061 )
...
* Add Tumblr protocol.
* Add Tumblr test file and result.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:14:06 +01:00
Zied Aouini and Luca Deri
22780da8d5
Add Reddit support. ( #1060 )
...
* Add Reddit protocol.
* Add Reddit test file and result.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:13:01 +01:00
Zied Aouini and Luca Deri
13dab51cc7
Add Pinterest support. ( #1059 )
...
* Add Pinterest protocol.
* Add Pinterest test file and result.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:11:43 +01:00
Zied Aouini
f35fad13c3
Add DisneyPlus protocol. ( #1058 )
2020-11-16 21:10:11 +01:00
Luca Deri
419483f128
File nor necessary and generated by configure
2020-11-12 23:22:15 +01:00
Luca Deri
328ff24657
Renumbered AmongUs protocol
2020-11-09 16:23:01 +01:00
Toni
6b5bdf773d
Added support for AmongUs. ( #1054 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-11-09 16:19:00 +01:00
Toni
af02ffb60f
Support raw IPv4 / IPv6 pcap packet processing. ( #1053 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-11-09 16:18:05 +01:00
Toni
ac18d5a084
Improved SSH protocol detection. ( #1052 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-11-09 16:17:42 +01:00
Don J. Rude
bbf42c3610
fixes issue #1050 Syntax error caused buffer pointer to equal 0x1 ( #1051 )
...
* Syntax error caused buffer pointer to equal 0x1
Possible copy-paste from lines 141-142?
* Another comma operator
* whitespace matching
* another comma operator
* another comma operator
* another comma operator
* Check for non-zero payload
2020-11-09 16:17:10 +01:00
Luca Deri
89a363aff6
Updated ESNI/SNI alarm generation prolicy
2020-11-08 10:07:35 +01:00
Luca Deri
f6cb869c63
Reworked IEC60870 dissector
2020-11-04 14:29:11 +01:00
Luca Deri
044a11faca
IEC60870 dissection improvements
2020-11-04 12:40:31 +01:00
Luca Deri
017e395ed1
Cosmetic changes
2020-11-03 16:46:30 +01:00
Leonn
0576dc2a49
💡 Add mongodb protocol dissector ( #1048 )
2020-11-03 16:16:02 +01:00
Luca Deri
fc58e564f0
Restored Ubuntu/Debian packaging
2020-11-03 16:08:57 +01:00
Toni
8e84abfa0e
Fix/packaging ( #1047 )
...
* Fix OpenWrt build.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Fixed Debian/Ubuntu packaging.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Added DPKG package build to a CI job.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-11-03 11:36:40 +01:00
Ivan Nardi
a9547da138
QUIC: fix dissection of Initial packets coalesced with 0-RTT one ( #1044 )
...
* QUIC: fix dissection of Initial packets coalesced with 0-RTT one
* QUIC: fix a memory leak
2020-11-03 11:35:52 +01:00
Luca Deri
92b80e2468
Updated results with numeric IP detection
2020-11-01 13:31:00 +01:00
Luca Deri
b502bb08e0
Fix for detecting numeric IPs
2020-11-01 13:31:00 +01:00
Luca Deri
50ab34bfe6
Centos8 package fix
2020-10-29 18:36:56 +01:00
Alfredo Cardigliano
53f133f669
Fix libdir on centos8
2020-10-29 18:20:51 +01:00
Alfredo Cardigliano
29dbf78c4e
Removed generation of /usr/lib/.build-id
2020-10-29 17:50:05 +01:00
Luca Deri
efbfb7cbd6
Set /usr as installation prefix
2020-10-29 17:45:55 +01:00
Alfredo Cardigliano
1c4ce8b0f4
Move libraries from /usr/local to /usr
2020-10-29 12:43:33 +01:00
Vitaliy Ivanov
10506b5173
Generate NDPI_API_VERSION based on git commands.
...
https://github.com/ntop/PF_RING/issues/668
Check for .git directory works in case of usual clone of nDPI repo.
But if you integrate is as submodule then .git is a file.
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2020-10-29 12:35:05 +01:00
Luca Deri
94471193c2
Added boundary check
2020-10-27 08:48:12 +01:00
Igor Duarte
ba6a48c9fe
Improve skype detection ( #1039 )
...
* Add new skype pcap
PCAP extracted from SkypeIRC.cap (available in https://wiki.wireshark.org/SampleCaptures?action=AttachFile&do=get&target=SkypeIRC.cap )
* Improve skype detection
2020-10-27 08:45:09 +01:00
Luca Deri
48d640583a
Moved global in reader_util.c
2020-10-27 08:40:00 +01:00
Luca Deri
948a906037
Added -D flag for detecting DoH in the wild
...
Removed heuristic from CiscoVPN as it leads to false positives
2020-10-26 21:40:59 +01:00
Luca Deri
9873972acb
Various improvemement when using ndpi_pref_enable_tls_block_dissection:
...
application data TLS blocks are now ignored when exchanged before
- the end of certificate negotiation (up to TLS 1.2)
- change cipher
2020-10-24 19:22:56 +02:00
Luca Deri
9b85669a64
Added -x for checking patterns
2020-10-22 23:28:18 +02:00
Luca Deri
833d0eee53
Added CPHA - CheckPoint High Availability Protocol protocl support
2020-10-22 18:39:13 +02:00
Ivan Nardi
6027a7c799
Fix parsing of DLT_PPP datalink type ( #1042 )
2020-10-21 22:27:42 +02:00
Luca Deri
9dac9945c9
Fixes #1033
2020-10-21 20:59:02 +02:00
Douglas and Douglas Wordell
efb712c2c0
Added new IPs for TeamViewer ( #1040 )
...
Co-authored-by: Douglas Wordell <douglas.wordell@seti.com.br >
2020-10-21 15:09:14 +02:00
Zied Aouini
43c1f6a3fd
CAPWAP tunnel decoding fix ( #1038 )
...
* Fix CAPWAP processing.
* Update result.
2020-10-21 15:07:20 +02:00
Toni
822c8e56f7
Improved/autoconf ( #1037 )
...
* Switched to PKG_CHECK_MODULES to keep pkg-config checks more portable.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Improved GCrypt autoconf check to detect a possible gpg-error inter-library dependency.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-10-21 15:05:33 +02:00
Hosein Ghahremanzadeh
bb33d57971
Fix a memory leak on fuzzing code ( #1036 )
...
After allocation of pcap_buffer it is necessary to free it
2020-10-21 15:05:11 +02:00
Igor Duarte
13d99a9390
Remove possible invalid read ( #1035 )
2020-10-21 15:04:55 +02:00
Luca Deri
6c0a809de8
Initial 3.5 commit
2020-10-19 16:23:03 +02:00
Luca Deri
64929a75e0
3.4 nDPI Release
2020-10-19 16:18:25 +02:00
Luca Deri
02de8e10ca
Added makefile target for creating changelog
...
Updated Changelog
2020-10-19 15:39:48 +02:00
Toni
c2d8955c18
Fixed missing PCAP include directories in Makefiles. ( #1034 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-10-19 11:25:22 +02:00
Luca Deri
e9721eb4ce
Improved processing of IPv6 header
...
Improved QUIC serialization
2020-10-15 21:57:59 +02:00
Alfredo Cardigliano
88f3519ab3
Handle list items in ndpi_deserialize_get_single_size
2020-10-15 12:02:43 +02:00
Alfredo Cardigliano
031cd04b7c
Add serialization of values list in TLV
2020-10-15 10:45:43 +02:00
aouinizied
d5d2a7e3f3
Fix CAPWAP handling.
2020-10-13 19:13:07 +02:00
Alfredo Cardigliano
2051e51380
Decoupled fuzzy and unit tests
2020-10-12 12:11:35 +02:00
Alfredo Cardigliano
c92e0d13fd
Serialized doxygen doc
2020-10-05 11:25:48 +02:00
Luca
05d93790e4
Added ndpi_quick_16_byte_hash
...
Warning fix
2020-10-05 08:26:24 +02:00
Luca Deri
32e4922c5a
Warning fix
2020-10-03 17:14:40 +02:00
Luca Deri
d4d82c27a5
Tests update
2020-10-02 21:35:15 +02:00
Luca Deri
addc775811
Added fix for invalid SNI check when SNI is missing
2020-10-02 21:26:43 +02:00
Luca Deri
b68a3707f6
Updated serialization test unit
2020-10-02 12:39:08 +02:00
b0c4d01734
don't pass arguments to ./configure as 1 string ( #1027 )
...
this causes the following error if there are arguments after --host :
'checking host system type... config.sub: too many arguments'
Co-authored-by: sahnalys12 <boris.vanhoof_ext@softathome.com >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-09-29 18:02:08 +02:00
Ivan Nardi
2c1b7cf1bd
QUIC: fix dissection of "offset" field ( #1025 )
...
The "offset" field is a variable-length integer.
This bug hasn't any practical effects right now, since we are ignoring any
packet with "offset" != 0 (and the value 0 is always encoded in only one byte).
But extracting a correct "offset" is important if we are ever going to handle
fragmented Client Hello messages.
2020-09-29 17:59:03 +02:00
Toni
656323c334
Added missing files to `make dist' target which are not required to build nDPI but still somehow essential. ( #1024 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-29 17:58:33 +02:00
Luca Deri
8e1a3f5cdc
Added JSON-C check for unit tests
2020-09-26 12:50:30 +02:00
Luca Deri
58538b7d19
Added extra boundary checks
2020-09-26 12:33:57 +02:00
Luca Deri
d0dbcf6dd6
Added back ndpi_check_flow_func (correct) prototype
2020-09-25 10:39:33 +02:00
Luca Deri
8413faf2ef
Boundary fix
2020-09-25 09:56:24 +02:00
Luca Deri
204f3ddff5
Compilation fix
2020-09-25 09:36:10 +02:00
Luca Deri
044ed14b4f
Various optimizations to reduce not-necessary calls
...
Optimized various UDP dissectors
Removed dead protocols such as pando and pplive
2020-09-24 23:26:03 +02:00
Luca Deri
51e86346d3
Added -fno-sanitize=alignment in clang-7
2020-09-24 16:46:28 +02:00
Luca Deri
8e7a707be1
-O0 -> -Og
2020-09-23 18:49:44 +02:00
Luca Deri
837ce7306b
Attempt to avoid errors due to misaligned packet headers
2020-09-23 18:17:51 +02:00
Luca Deri
05dfae6430
Improved boundary check to prevent overflow
2020-09-23 17:14:40 +02:00
Luca Deri
d29a0241ee
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-09-22 12:45:44 +02:00
Luca Deri
cbf1be5789
Macro redefinition
2020-09-22 12:23:44 +02:00
Luca Deri
5f99433ee7
Minor UA handling improvement to avoid heap-overflow
2020-09-22 08:56:35 +02:00
lucaderi
27bad14738
Added missing install target in newly added unit tsts
2020-09-22 08:42:50 +02:00
Luca Deri
362baa6321
Minor change for alignment issue
2020-09-21 21:15:52 +02:00
Luca Deri
60a9f6610d
Added risks for checking
...
- invalid DNS traffic (probably carrying exfiltrated data)
- TLS traffic with no SNI extension
2020-09-21 19:57:23 +02:00
Alfredo Cardigliano
0259ff58e1
Exclude sanitizer on unit tests involving json-c due to a bug in the lib
2020-09-21 17:59:06 +02:00
Alfredo Cardigliano
d700ab3994
Add distdir directive
2020-09-21 17:32:57 +02:00
Alfredo Cardigliano
e6d206fd15
Add unit tests to travis. Move ndpi serializer tests to unit tests.
2020-09-21 17:24:06 +02:00
Luca Deri
a263ac9024
Merge pull request #1022 from lnslbrty/fix/ndpi-mingw-fn-redef
...
Do not re-define libc functions for mingw builds.
2020-09-21 14:42:06 +02:00
Toni Uhlig
87c43450f3
Do not re-define libc functions for mingw builds.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-20 23:29:23 +02:00
Luca Deri
8ba1baace1
Added sample Windows MSVC project
2020-09-20 18:44:57 +02:00
Luca Deri
ff1cc1fa41
Merge pull request #1019 from IvanNardi/quic_fb
...
QUIC: add support for MVFST EXPERIMENTAL version
2020-09-20 18:34:27 +02:00
Luca Deri
ea9177cc93
Merge pull request #1018 from lnslbrty/fix/make-dist
...
Fixed broken `make dist' and added CI check.
2020-09-20 18:33:57 +02:00
Luca Deri
1385f05713
Merge pull request #1017 from lnslbrty/fix/mingw-xcompile
...
Added support for mingw xcompile.
2020-09-20 18:33:40 +02:00
Nardi Ivan
dcac633878
QUIC: add support for MVFST EXPERIMENTAL version
2020-09-20 16:38:28 +02:00
Toni Uhlig
fdef6f3545
Fixed broken `make dist' and added CI check.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-19 02:23:53 +02:00
Toni Uhlig
d0052fd5b2
Using NDPI_I64_FORMAT, NDPI_U64_FORMAT format string to differentiate between Windows and non-Windows.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-18 19:46:20 +02:00
Toni Uhlig
bcce122665
Fixed mingw build w/o examples/tests/fuzzer.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-18 19:46:07 +02:00
Luca Deri
6a7139bb24
Updated results
2020-09-18 00:17:43 +02:00
Luca Deri
b5b4512022
Added MDNS in extra packet dissection function
2020-09-18 00:08:27 +02:00
Luca Deri
d81bc1add6
Reworked MDNS dissector that is not based on the DNS dissector
2020-09-17 23:24:02 +02:00
Luca Deri
753b5dde16
Merge pull request #1012 from IvanNardi/ua
...
QUIC: extract User Agent information
2020-09-17 21:32:25 +02:00
Luca Deri
9189aee83b
Disabled QUIC tracing that pollutes the output
2020-09-17 14:37:56 +02:00
aouinizied
4cc4efa228
Update example.
2020-09-14 16:42:33 +02:00
Luca
ad8318e247
Commented unused function
2020-09-13 09:48:29 +02:00
Alfredo Cardigliano
91e3292e6b
Temporarily keep using snprintf
2020-09-11 19:17:10 +02:00
Luca Deri
98a81cb163
Reworked DGA checks
2020-09-11 10:31:19 +02:00
Alfredo Cardigliano
3a6ba7fa12
Replace snprintf with ndpi_snappend
2020-09-11 10:04:43 +02:00
Luca Deri
37abe0daea
Added boundary check
2020-09-10 20:06:25 +02:00
Luca Deri
1c0e617d80
Added buffer check in DGA analysis
2020-09-10 19:58:31 +02:00
Nardi Ivan
8db084ab06
TLS: fix memory accesses in QUIC transport parameters extension
2020-09-10 18:19:18 +02:00
lucaderi
ea4240055d
Complation fix as not on all platforms isnumber() is available
2020-09-10 00:05:02 +02:00
Luca Deri
5ac870074b
Merge pull request #1014 from lnslbrty/improved/teamspeak
...
Improved Teamspeak(3) protocol detection.
2020-09-09 23:28:21 +02:00
Luca Deri
7086197047
Added extension to detect nested subdomains as used in Browsertunnel attack tool
...
https://github.com/veggiedefender/browsertunnel
2020-09-09 23:25:19 +02:00
Toni Uhlig
8ca13bc46a
Improved Teamspeak(3) protocol detection.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-09 21:57:31 +02:00
Alfredo Cardigliano
842c00e681
Add missing low-level serializer calls to the API
2020-09-09 17:09:01 +02:00
Toni Uhlig
4c776501a6
Fixed shlib xcompile for x86_64-w64-mingw32
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-08 19:52:46 +02:00
Nardi Ivan
7d5a0e1f04
QUIC: extract User Agent information
2020-09-08 11:03:22 +02:00
Nardi Ivan
a1014e8895
http: create a common function to parse User Agent field
...
Prepare the code to handle UA information from flows other than HTTP
2020-09-08 10:34:05 +02:00
Luca Deri
601928cc8e
Merge pull request #1008 from lnslbrty/add/dnscrypt
...
Improved dnscrypt v1/v2 protocol detection (and DoH provider).
2020-09-08 09:53:22 +02:00
Luca Deri
5a3956fe27
Added command for specifying the aux files dir
2020-09-08 09:51:02 +02:00
Toni Uhlig
df14d225f6
Added pcap file which contains dnscrypt-v1 data and resolver update requests/responses (v1/v2).
...
* Renamed dnscrypt.pcap to simple-dnscrypt.pcap
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-07 21:04:23 +02:00
Toni Uhlig
fe5aa7ebca
Added dnscrypt-v2-doh resolver test pcaps.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-07 20:22:52 +02:00
Toni Uhlig
41d35fc7d0
Updated DoT/DoH provider.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-07 20:22:45 +02:00
Toni Uhlig
799a6abfe6
Improved dnscrypt v1/v2 protocol detection.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-06 23:24:55 +02:00
Alfredo Cardigliano
8ed6409b35
Add start_of_block/end_of_block support to TLV
2020-09-04 17:23:04 +02:00
Luca Deri
3f49062db9
Added some additional TLS mappings
2020-09-02 23:35:22 +02:00
Luca Deri
3cca5af8c3
Merge pull request #1003 from lnslbrty/fix/fals-positive-cisco-hsrp-radius-detection
...
Fixed false positive detection for Skype.SkypeCall (affects at least Cisco HSRP and RADIUS).
2020-09-02 12:32:48 +02:00
Toni Uhlig
7051acc0b5
Fixed off-by-one error in Kerberos protocol.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-02 07:37:26 +02:00
Toni Uhlig
580859a47d
Fixed false positive detection for Skype.SkypeCall (affects at least Cisco HSRP and RADIUS).
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-02 07:29:33 +02:00
Luca Deri
5d2551ff3e
Added boundary check
2020-09-01 22:31:34 +02:00
Luca Deri
cefb667d8b
Added trademark information
2020-09-01 18:03:01 +02:00
Luca Deri
8575a07113
Added check for ndpi_ssl_version2str()
2020-08-31 17:23:00 +02:00
Luca Deri
460ff3c7ab
Added (optional) notifier for LRU add
2020-08-31 08:47:16 +02:00
Luca Deri
029448759b
Merge pull request #999 from IvanNardi/quic
...
QUIC: add support for GQUIC T050 and T051
2020-08-30 20:56:15 +02:00
Luca Deri
448265a151
Merge pull request #998 from lnslbrty/fix/ndpireader-opt-sigsegv
...
Fixed invalid memory access leading to a SIGSEGV in ndpiReader's option parser.
2020-08-30 20:55:44 +02:00
Nardi Ivan
7da4abe6ad
QUIC: add support for GQUIC T050 and T051
...
QUIC versioning wasn't complex enough without T05X family...
These versions are very similar to Q050, but use TLS as their handshake
protocol.
2020-08-30 20:51:33 +02:00
Luca Deri
638624869a
Added new risk for NDPI_UNSAFE_PROTOCOL that identifies protocols that are not condidered safe/secure
2020-08-30 20:48:58 +02:00
Luca Deri
647c7d59bb
Improved ntop detection over HTTP
...
Added cap on number of attempts for CiscoVPN
2020-08-30 19:42:09 +02:00
Luca Deri
f597086386
Stddev calculation changes
2020-08-30 12:48:32 +02:00
Luca Deri
dd75060932
Fixed false positive in suspicous user agent
...
Optimized stddev calculation
2020-08-30 12:25:15 +02:00
Luca Deri
8bf95b6198
Merge pull request #996 from lnslbrty/fix/travis-ci
...
Fix travis-ci related errors.
2020-08-28 13:04:26 +02:00
Toni Uhlig
adab0139c2
Fixed invalid memory access leading to a SIGSEGV in ndpiReader's option parser.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-28 06:53:58 +02:00
Toni Uhlig
bf9dbd6ccf
Fixed travis-ci fuzzm job. Might be a false positive related to clang-7's MSAN.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-27 16:42:24 +02:00
Toni Uhlig
e998fc28d1
Fixed use-of-uninitialized-value in QUIC clho decryption probably caused by a BUG in libgcrypt (not verified).
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-27 16:30:05 +02:00
Simone Mainardi
1810281d7f
Fixes control reaches end of non-void function
2020-08-27 10:39:36 +02:00
Simone Mainardi
f0325f713a
Passes method_len param to ndpi_http_str2method
2020-08-27 10:05:38 +02:00
Toni Uhlig
5b27dfdd0c
Moved NDPI_CURRENT_PROTO define before ndpi_api.h include to prevent a redefinition warning.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-27 00:29:44 +02:00
Toni Uhlig
c17463539f
Fixed broken travis-ci YAML.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-27 00:27:31 +02:00
Luca Deri
2e8aa9f08e
Added ndpi_http_method ndpi_http_str2method(const char* method) API call
2020-08-26 23:17:19 +02:00
Luca Deri
487d915262
Added ndpi_http_method2str() API call
2020-08-26 12:25:28 +02:00
Luca Deri
5e1bb0dbc1
Merge pull request #992 from lnslbrty/fix/pkg-config
...
Fixed broken pkg-config file which did not care about gcrypt/pcre.
2020-08-26 10:29:39 +02:00
Toni Uhlig
363ab2259c
Fixed broken pkg-config file which did not care about gcrypt/pcre.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-24 18:12:49 +02:00
Luca Deri
b94e13da43
Merge pull request #991 from IvanNardi/quic2
...
QUIC: minor fixes
2020-08-24 14:45:04 +02:00
Nardi Ivan
97b80a8838
QUIC: minor fixes
...
LGTM found a real issue on a boundary check
Fix unit tests: a pcap ha been uploaded twice (with different names)
Fix compilation when using DPDK (see #990 )
2020-08-24 13:53:36 +02:00
Luca Deri
b8307eb855
Creared IoT-Scada category
...
Minor dnp3 changes
2020-08-23 13:32:36 +02:00
Luca Deri
46ba657562
Cosmetic fix
2020-08-22 23:48:00 +02:00
Luca Deri
4570dbfece
Added QUIC dependency
2020-08-22 17:02:11 +02:00
Luca Deri
35fd4ddb27
Added libgcrypt20-dev dependency to handle QUIC
2020-08-22 16:53:44 +02:00
Luca Deri
fe1e2c241f
Added som GQUIC and IETF QUIC test pcaps
2020-08-22 16:47:05 +02:00
Luca Deri
af3ce74e02
Fixes compilation issues introduced by https://github.com/ntop/nDPI/pull/989
2020-08-22 16:41:51 +02:00
Luca Deri
93003d0523
Warning fix
2020-08-22 16:41:42 +02:00
Luca Deri
519ba7a9d5
Merge pull request #989 from IvanNardi/quic
...
Improve QUIC detection
2020-08-22 16:30:29 +02:00
Nardi Ivan
b23cfd6b84
Add sub-classification for GQUIC >= Q050 and (IETF-)QUIC
...
Add QUIC payload and header decryption: most of the crypto code has been
"copied-and-incolled" from Wireshark. That code has been clearly marked
as such. All credits for that code should go to the original authors.
I tried to keep the Wireshark code as similar as possible to the original,
comments included, to ease future backporting of fixes.
Inevitably, glibc data types and data structures, tvbuff abstraction and
allocation functions have been converted.
2020-08-21 22:04:55 +02:00
Nardi Ivan
7a1147d733
Update TLS dissector to handle QUIC flows
...
Latest QUIC versions use TLS for the encryption layer: reuse existing code
to allow Client Hello parsing and sub-classification based on SNI value.
Side effect: we might have J3AC, TLS negotiated version, SNI value and
supported cipher list for QUIC, too.
2020-08-21 22:04:55 +02:00
Nardi Ivan
d62ae567d1
Add (optional) dependency on external libraries: libgcrypt and libgpg-error
...
To support QUIC payload and header decryption, it is necessary to choose an
external crypto library to handle the low-level crypto stuff. Since we will
use some Wireshark code, it is quite natural to choose the same library used
by Wireshark itself: libgcrypt.
More precisely, we will use libgcrypt and libgpg-error.
Both libraries have LGPL license, so there should be no issue from this point
of view.
These libraries are not required to build nDPI, and their usage is optional:
nDPI will keep working (and compiling) even if they are not available.
However, without them, QUIC sub-classification is next to impossible.
The configure flag "--disable-gcrypt" forces the build system to ignore these
libraries.
libgpg-error is only used for debug to have meaningful error messages and its
usage is trivial.
The same cannot be said for libgcrypt because its initialization is a significant
issue.
The rest of this commit message try explaining how libgcrypt is
initialized.
According to the documentation
https://gnupg.org/documentation/manuals/gcrypt/Initializing-the-library.html
https://gnupg.org/documentation/manuals/gcrypt/Multi_002dThreading.html#Multi_002dThreading
libgcrypt must be initialized before using it, but such initialization should
be performed by the actual application and not by any library.
Forcing the users to proper initialize libgcrypt in their own code seems
unreasonable: most people using nDPI might be complete unaware of any crypto
stuff and update each and every one application linking to nDPI with specific
libgcrypt code should be out of question, anyway.
Fortunately, it seems a workaround exists to initialize libgcrypt in a library
https://lists.gnupg.org/pipermail/gcrypt-devel/2003-August/000458.html
Therefore, we could provide a wrapper to this initialization stuff in a nDPI
function. Unfortunately nDPI API lacks a global init function that must be
called only once, before any other functions. We could add it, but that would
be a major API break.
AFAIK, ndpi_init_detection_module() might be called multiple times, for example
to create multiple independent dpi engines in the same program.
The proposed solution is to (optionally) initialize libgcrypt in
ndpi_init_detection_module() anyway:
* if the actual application doesn't directly use libgcrypt and only calls
ndpi_init_detection_module() once, everything is formally correct and it
should work out of the box [by far the most common user case];
* if the actual application already uses libgcrypt directly, it already
performs the required initialization. In this case the ndpi_prefs.ndpi_dont_init_libgcrypt
flag should be passed to ndpi_init_detection_module() to avoid further
initializations.
The only scenario not supported by this solution is when the application is
unaware of libgcrypt and calls ndpi_init_detection_module() multiple times
concurrently. But this scenario should be uncommon.
A completely different option should be to switch to another crypto library,
with a huge impact on the QUIC dissector code.
Bottom line: crypto is hard, using libgcrypt is complex and the proposed
initialization, even if not perfect, should cover the most frequent user
cases and should work, for the time being.
If anyone has some suggestions...
2020-08-21 22:04:55 +02:00
Nardi Ivan
23ec82b59d
Major rework of QUIC dissector
...
Improve support for GQUIC (up to Q046) and add support for Q050 and (IETF-)QUIC
Still no sub-classification for Q050 and QUIC
2020-08-21 22:04:55 +02:00
Luca Deri
fef199ad45
Added new check for detecting suspicious (too long) names
2020-08-21 19:35:27 +02:00
Luca Deri
b23781e807
Added the ability do identigy as DGA those host/domain names with too many consucutive repeated characters
...
such as ckaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa used fr netbios reflection attacks
https://www.akamai.com/uk/en/multimedia/documents/state-of-the-internet/ddos-reflection-netbios-name-server-rpc-portmap-sentinel-udp-threat-advisory.pdf
2020-08-21 18:41:35 +02:00
Luca Deri
da2684dbe1
MySQL8 update
2020-08-21 07:17:34 +02:00
Luca Deri
7e9354ef23
Merge pull request #988 from lnslbrty/add/mysql-8-manipulated-pkt
...
Added (manipulated) MySQL 8 test pcap.
2020-08-21 06:49:18 +02:00
Toni Uhlig
f4421314b0
Added (manipulated) MySQL 8 test pcap.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-20 23:46:47 +02:00
Luca Deri
59ac73b37f
Configure code cleanup
2020-08-19 22:01:03 +02:00
Luca Deri
115888ef7a
Compilation fix
2020-08-19 21:56:34 +02:00
Luca Deri
248d756e99
Merge pull request #987 from lnslbrty/update/mysql-protocol-detection
...
Updated MySQL protocol detection to support server version 8.
2020-08-19 21:49:53 +02:00
Luca Deri
9f431f9218
Merge pull request #985 from lnslbrty/add/SOAP
...
Added support for SOAP.
2020-08-19 21:49:12 +02:00
Luca Deri
d87bdf9302
Merge pull request #977 from adek05/dev
...
Enable building on OpenBSD 6.7
2020-08-19 21:48:38 +02:00
Toni Uhlig
3a76786121
Updated MySQL protocol detection to support server version 8.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-19 18:33:06 +02:00
Toni Uhlig
8e93f48c43
Added support for SOAP.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-18 16:21:26 +02:00
Luca Deri
673d8b7fac
Updated OpenWRT instructions
2020-08-17 18:17:43 +02:00
Luca Deri
1f921562d1
Added fix for API versions starting with 0
2020-08-17 18:11:18 +02:00
Luca Deri
34a98abcc0
Added --with-only-libndpi configure option to build just lindpi
2020-08-17 18:00:38 +02:00
Luca Deri
b501239d3f
Added README for building libndpi under OpenWRT
2020-08-17 17:17:09 +02:00
Luca Deri
ebf89f46e3
Merge pull request #984 from lnslbrty/fix/invalid-fncall-dpdk
...
Fixed invalid dpdk fn call.
2020-08-16 10:03:55 +02:00
Luca Deri
019a64630b
Merge pull request #983 from lnslbrty/fix/libpcap-obsolete-pcap_lookupdev-usage
...
Replaced obsolete libpcap pcap_lookupdev with pcap_findalldevs.
2020-08-16 10:03:33 +02:00
Luca Deri
98a9afc40c
Added support for discord
2020-08-16 10:01:40 +02:00
Toni Uhlig
13cbd1e4ae
Fixed invalid dpdk fn call.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-15 12:38:47 +02:00
Toni Uhlig
b31fde4bbb
Replaced obsolete libpcap pcap_lookupdev with pcap_findalldevs.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-15 12:35:49 +02:00
Luca Deri
46ec91ca4b
Merge pull request #976 from lnslbrty/fix/ndpi_simpleint_builderr
...
Fix/ndpi simpleint builderr
2020-08-13 10:41:25 +02:00
Luca Deri
8090765a64
Merge pull request #974 from IvanNardi/esni4
...
Suspicious ESNI usage: add a comment and a pcap example
2020-08-13 10:40:51 +02:00
Toni Uhlig
aa856735c0
num_extra_packets_checked check can be 0 for some protocols and therefor requires lesser-or-equal condition for max_extra_packets_to_check
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-13 10:32:31 +02:00
Luca Deri
9edddee0b7
Fixes invalid detection on traffic on non standard ports
2020-08-12 11:08:28 +02:00
Luca Deri
d5cac570d6
Improved DGA detection algoritm
2020-08-11 17:13:40 +02:00
Luca Deri
0e363d0ca6
Added HLL notes
2020-08-11 16:23:35 +02:00
aouinizied
8c2c388d54
Add Connectivity check category and blacklisted host risk.
2020-08-10 21:19:17 +02:00
aouinizied
8fcb49af25
Fix typo.
2020-08-10 21:17:36 +02:00
Luca Deri
dfa9dd66c0
Added case-insensitive substring matching
2020-08-10 19:36:43 +02:00
Adrian Zgorzałek
56a3a33bc0
OpenBSD: Do not redefine __LITTLE_ENDIAN__
...
Will silence omnipresent compiler warnings when building ntopng.
2020-08-09 14:30:12 +01:00
Adrian Zgorzałek
8f74d5733d
OpenBSD: Introduce pkt_timeval to deal with (bpf_)_timeval
...
Some BSD APIs called in example/ return `struct bpf_timeval`, where nDPI
APIs expect `struct timeval`. These two structs, besides having
a different name, share the exact same set of fields.
2020-08-09 14:30:12 +01:00
Toni Uhlig
4ead6d6594
travis-ci: build ndpiSimpleIntegration as well
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-08 12:17:54 +02:00
Toni Uhlig
8da5f42fa0
Changed ndpi_ssl_version2str function call in ndpiSimpleIntegration.
...
Fixes build error introduced with 23c072153 .
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-08 12:05:11 +02:00
Nardi Ivan
2722861d6e
Suspicious ESNI usage: add a comment and a pcap example
...
See: 79b89d2866
2020-08-06 10:29:35 +02:00
Luca Deri
95dfbdc64a
Merge pull request #973 from IvanNardi/esni3
...
Add risk flag about suspicious ESNI usage
2020-08-06 10:18:27 +02:00
Luca Deri
c2156a5161
Added note on memory management
2020-08-06 09:19:04 +02:00
Luca Deri
5b6ffad278
Added new ndpi_string_sha1_hash API call
2020-08-05 21:45:38 +02:00
Luca Deri
d3fb1fb25a
Fixed possible memory leak in TLS certificate handling
2020-08-05 17:57:00 +02:00
Nardi Ivan
79b89d2866
Add risk flag about suspicious ESNI usage
...
In a Client Hello, the presence of both SNI and ESNI may obfuscate the real
domain of an HTTPS connection, fooling DPI engines and firewalls, similarly
to Domain Fronting.
Such technique is reported in a presentation at DEF CON 28:
"Domain Fronting is Dead, Long Live Domain Fronting: Using TLS 1.3 to evade
censors, bypass network defenses, and blend in with the noise"
Full credit for the idea must go the original author
At the moment, the only way to get the pdf presention and related video is via
https://forum.defcon.org/node/234492
Hopefully a direct link (and an example pcap) will be available soon
2020-08-05 17:13:23 +02:00
Luca Deri
07d9fa7f96
Win #define fix
2020-08-05 11:13:27 +02:00
Luca Deri
00b2763399
Added check on payload lenght during extra packet processing
2020-08-04 21:59:45 +02:00
Luca Deri
e16675b700
Added new traffic category for connectivity check detection
2020-08-04 18:09:13 +02:00
Luca Deri
ea10b8e757
Added memory checks
2020-08-02 13:00:31 +02:00
aouinizied
57e28e03ee
Sync TLS definitions.
2020-08-01 01:27:29 +02:00
Luca Deri
2ae4c6675d
Fixed partial TLS dissection
2020-07-30 18:30:07 +02:00
Luca Deri
e71df49b3e
Changed due to bin size extension
2020-07-30 00:06:46 +02:00
Luca Deri
6904935934
Restored TLS dissection
2020-07-30 00:06:35 +02:00
Luca Deri
a828ac0191
Tiny changes for TLS block lenght dissection
2020-07-29 22:36:27 +02:00
aouinizied
c4b19fd6c5
Update CFFI definitions.
2020-07-29 12:31:21 +02:00
Luca Deri
02dc8d5feb
Merge pull request #970 from IvanNardi/fix
...
Minor fixes
2020-07-28 19:38:12 +02:00
Luca Deri
32bd3d7a59
TLS dissection improvements
2020-07-28 01:06:38 +02:00
Luca Deri
da87cc3157
Added NDPI_SMB_INSECURE_VERSION for detecting insecure SMB versions (e.g. v1)
2020-07-27 13:05:06 +02:00
Luca Deri
69f140878c
Boundary check on QUIC
2020-07-27 07:40:50 +02:00
Luca Deri
4b1cae2c2b
Boundary check
2020-07-27 06:52:35 +02:00
Nardi Ivan
7d843f4d17
Minor fixes
...
Fix a memory leak and an issue (re)-introduced in configure script
2020-07-26 21:11:34 +02:00
Luca Deri
95263fc32e
Added parentheses to avoid issues with macro expansion
2020-07-25 18:59:48 +02:00
Luca Deri
1c405e382a
SSH code cleanup
2020-07-25 16:43:54 +02:00
Luca Deri
b26539d65a
Merge pull request #967 from MrRadix/dev
...
Ssh signature checking
2020-07-25 16:17:24 +02:00
MrRadix
6719fa30f9
added other ssh implementations to check
2020-07-24 20:53:02 +02:00
Luca Deri
21e2e57614
Fixed bin similarity
2020-07-24 01:30:58 +02:00
Luca Deri
439558f6a3
Improved bin clustering
2020-07-22 23:56:50 +02:00
Luca Deri
0956badd11
Merge pull request #968 from catenacyber/fuzzci
...
Reenables CI with sanitizers
2020-07-22 19:38:05 +02:00
MrRadix
a9ca47fcdb
added cipher check
2020-07-22 17:17:12 +02:00
MrRadix
1c1be5a0d1
Resolved conflicts on fetch
2020-07-22 16:25:01 +02:00
Philippe Antoine
2723ac70ce
msan cxx
2020-07-22 16:09:13 +02:00
Luca Deri
3cd1ec5c9a
Added changes for handlign SSSH cipher detection
2020-07-22 15:58:46 +02:00
Philippe Antoine
a279423bff
Reenables CI with sanitizers
2020-07-22 15:49:03 +02:00
MrRadix
a3ba9253ef
fixed bug inside set bit macro call
2020-07-22 15:39:44 +02:00
MrRadix
c450caae94
modified new last two risks
2020-07-22 15:38:31 +02:00
Luca Deri
36af97a14c
Minor HLL fixes
2020-07-22 14:40:15 +02:00
MrRadix
af5d792c08
added sscanf error handling
2020-07-22 13:06:08 +02:00
MrRadix
8e2cd9ff43
improved performance and legibility
2020-07-22 12:42:26 +02:00
MrRadix
88dd3ebd62
added modified risks
2020-07-22 12:41:59 +02:00
MrRadix
d9fc4d52e9
merged with remote
2020-07-22 11:56:51 +02:00
MrRadix
a688e36b51
improved ndpi_risk2str output for new risks
2020-07-22 11:44:56 +02:00
Luca Deri
f83d0b18c6
Introduced SSH rick checks
2020-07-22 11:40:57 +02:00
Luca Deri
66178e37cc
Merge pull request #966 from catenacyber/ossfuzzbuild
...
Enables fuzz targets even without sanitizer
2020-07-22 11:36:48 +02:00
Luca Deri
1740042cbb
Merge branch 'dev' into ossfuzzbuild
2020-07-22 11:36:31 +02:00
Luca Deri
f6242f0e46
HLL memory usage notes
2020-07-22 11:28:14 +02:00
MrRadix
0a182c6d18
Merge remote-tracking branch 'ntop_origin/dev' into dev
2020-07-22 11:15:02 +02:00
MrRadix
53b2b08aeb
added new risks to ndpi_risk_enum
2020-07-22 10:56:59 +02:00
MrRadix
9c521c5ddd
added new risks iside ndpi_risk2str function
2020-07-22 10:55:53 +02:00
MrRadix
847eb7b180
improved performance by removing linear scan
2020-07-22 10:54:55 +02:00
Luca Deri
d90b333363
Merge pull request #965 from lnslbrty/fix/autoconf-ubuntu
...
fixes autoconf issue on ubuntu 18 (#953 )
2020-07-21 21:41:02 +02:00
MrRadix
f66cd5aabc
added ssh_analyse_signature_version and ssh_has_old_signature for check old signature version of ssh
2020-07-21 19:31:02 +02:00
MrRadix
4b4dcabeda
added ssh obsolete version risks
2020-07-21 19:29:59 +02:00
Luca Deri
879cec94b2
User agent detection improvements
2020-07-21 12:06:34 +02:00
Luca Deri
9f4f228832
Added skeleton for checking SSH signature
2020-07-20 17:25:17 +02:00
Philippe Antoine
b568c26989
Enables fuzz targets even without sanitizer
...
Should fix ossfuzz build
2020-07-20 10:07:54 +02:00
Toni Uhlig
29315cee6d
fixes autoconf issue on ubuntu 18 ( #953 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-19 20:30:41 +02:00
Luca Deri
f452dabd92
Fix for invalid boundary check
2020-07-17 23:26:28 +02:00
Luca Deri
64fb40d21e
Added ndpi_reset_data_analysis() API call
2020-07-17 13:16:01 +02:00
Luca Deri
6e1dcba9dd
Indendentation fix
2020-07-16 17:56:37 +02:00
Luca Deri
ebf18a0c61
Merge pull request #964 from yskcg/dev
...
1:add free pointer NULL check;2:fix xbox and teredo protocol detected…
2020-07-16 17:05:40 +02:00
ysk
a268952068
remove the unused code
2020-07-16 17:26:46 +08:00
Luca Deri
acd05b171e
Added ndpi_data_last() API call
2020-07-16 11:22:06 +02:00
ysk
69ca98ca35
1:add free pointer NULL check;2:fix xbox and teredo protocol detected error when use the commm udp port 3544
2020-07-16 16:07:04 +08:00
Luca Deri
46e97d5da3
Added ndpi_data_window_variance() and ndpi_data_window_stddev() API calls
2020-07-15 18:13:06 +02:00
Luca Deri
9f3e3e8456
Add ndpi_hll_reset() API call
...
Fixes bug in ndpi_data_window_average() with zero points
2020-07-15 10:30:45 +02:00
Luca Deri
91d132ea3d
Check for avoiding buffer overflow in netbios dissector
2020-07-14 22:16:43 +02:00
Luca Deri
3fd3153089
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-07-13 15:48:53 +02:00
Luca Deri
a8ad99aca5
Fixed makefile error message
...
Code hardedning fix
2020-07-13 15:46:19 +02:00
aouinizied
7744c225f9
Add note for sync with cffi bindings.
2020-07-13 12:51:32 +02:00
aouinizied
e2e0303099
Add ssl_version_str to flow structure.
2020-07-13 12:48:35 +02:00
Luca Deri
802254327a
wrapper cleanup
2020-07-13 10:53:25 +02:00
Luca Deri
9d8717a0c7
Merge pull request #963 from yskcg/dev
...
add improved boundary check and check malloc return is NULL
2020-07-13 10:24:23 +02:00
Luca Deri
9d35364ef1
Merge pull request #961 from lnslbrty/fix/ssl-version2str-race-condition
...
Fixed race condition in ndpi_ssl_version2str() caused by static quali…
2020-07-13 10:23:47 +02:00
Luca Deri
051bdb1957
Merge pull request #960 from lnslbrty/fix/heap-overflow-in-llc-readear-util
...
Fixed heap overflow caused by missing lengthcheck in 802.11 LLC heade…
2020-07-13 10:23:06 +02:00
Toni Uhlig
96c193cf79
Fixed heap overflow caused by missing lengthcheck in 802.11 LLC header parsing.
...
* triggered by fuzz traces from wireshark
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-11 13:10:03 +02:00
Toni Uhlig
23c0721538
Fixed race condition in ndpi_ssl_version2str() caused by static qualifier in the version string buffer.
...
* added also GREASE supported tls versions as specified in
https://tools.ietf.org/html/draft-davidben-tls-grease-01#page-4
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-11 01:05:39 +02:00
ysk
35f1c362b9
add improved boundary check and check malloc return is NULL
2020-07-10 17:49:35 +08:00
Luca Deri
12abcd516b
Updated test results due to bin changes
2020-07-09 17:28:02 +02:00
Luca Deri
014fdd9a02
Various fixes in bins implementation
...
Added -b flag in ndpiReader to test bins
2020-07-09 17:28:02 +02:00
Luca Deri
9d8967236e
Merge pull request #957 from lnslbrty/fix/build
...
Fix/build
2020-07-09 17:27:53 +02:00
Alfredo Cardigliano
6511db8941
Guide update
2020-07-09 15:37:02 +02:00
aouinizied
b8d406b1f8
Update note.
2020-07-09 00:58:48 +02:00
aouinizied
ce02359953
Add NDPI_MALFORMED_PACKET risk.
2020-07-09 00:56:44 +02:00
Toni Uhlig
24fea66a26
travis-ci cleanups
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-09 00:33:20 +02:00
Luca Deri
d658ac9e61
Added -b to ndpiReader to evaluate bins
2020-07-09 00:15:21 +02:00
Toni Uhlig
f75984633b
ndpiSimpleIntegration should not be included in a static library
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-08 23:47:51 +02:00
Toni Uhlig
20fed83e0f
Removed csv_fp as external symbol. Instead passing csv_fp through as argument.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-08 23:21:35 +02:00
Luca Deri
f72b402aa2
Merge pull request #956 from IvanNardi/leak
...
Fix memory leak reported in #955
2020-07-08 17:15:13 +02:00
Luca Deri
4f794aec22
Merge pull request #955 from lnslbrty/fix/heap-overflow-thunder
...
Fixed thunder protocol detection heap overflow caused by missing leng…
2020-07-08 17:14:45 +02:00
Nardi Ivan
fd6a5bc1cd
Fix memory leak reported in #955
...
This leak is clearly happening because of missing/disabled code in "bins"
handling.
This is a trivial workaround useful until such code is completed.
In this way tavis-ci will stop complaining
2020-07-08 11:30:39 +02:00
Alfredo Cardigliano
5be9370cd2
Fix warnings
2020-07-08 09:15:48 +02:00
Toni Uhlig
ccb30a04ad
Fixed thunder protocol detection heap overflow caused by missing lengthcheck.
...
* triggered by fuzz traces from wireshark
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-08 00:21:00 +02:00
Luca Deri
fb04dbbc47
Added testing bin code
2020-07-07 19:18:43 +02:00
Luca Deri
f1dd8bc8c5
Memory allocation fixes
2020-07-07 17:32:26 +02:00
Luca Deri
0c80e6ee3b
Merge pull request #954 from lnslbrty/fix/memleak-cluster-bins
...
fixed memory leak in ndpi_cluster_bins / binUnitTest
2020-07-07 17:18:03 +02:00
Toni Uhlig
e308e59002
fixed memory leak in ndpi_cluster_bins / binUnitTest
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-07 17:07:20 +02:00
Luca Deri
1c60c22893
Added ndpi_cluster_bins() for clustering bins and ancillary functions for bins manipulation
2020-07-07 15:10:51 +02:00
Luca Deri
db707e0829
Merge pull request #932 from IvanNardi/log
...
Log
2020-07-07 14:43:32 +02:00
Luca Deri
540326f3ff
Merge pull request #953 from lnslbrty/fix/broken-autoconf-fsanitizer
...
fix broken sanitizer CFLAGS, --enable-fuzztargets should also set -fs…
2020-07-07 14:42:42 +02:00
Luca Deri
94bf7b0130
Merge pull request #952 from lnslbrty/fix/missing-lengthcheck-in-reader-uutil
...
Fixed heap overflow caused by missing lengthcheck in reader uutil.
2020-07-07 14:42:20 +02:00
Nardi Ivan
030f3f3d48
Fix a memory leak
2020-07-07 10:27:57 +02:00
Toni Uhlig
de25ba7d0b
Fixed heap overflow caused by missing lengthcheck in reader uutil.
...
* triggered by fuzz traces from wireshark
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-06 23:30:40 +02:00
Toni Uhlig
9bbcc2548e
fix broken sanitizer CFLAGS, --enable-fuzztargets should also set -fsanitize
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-06 22:09:11 +02:00
lucaderi
055422503c
configure fixes
2020-07-06 10:38:29 +02:00
Luca Deri
c0b34555c2
Merge pull request #951 from lnslbrty/fix/ossfuzzer
...
ossfuzz.sh: do not use wildcards for fuzzer e.g. fuzz/fuzz*
2020-07-06 10:23:50 +02:00
Luca Deri
b4edb75824
Merge pull request #950 from lnslbrty/improved/http-line-parsing
...
Improved HTTP line parsing if request splitted into multiple packets.
2020-07-06 10:23:29 +02:00
Luca Deri
dfb9e8ec1f
Merge pull request #940 from lnslbrty/fix/small-and-optimistic-improvments
...
Fixed CodeInspector issues.
2020-07-06 10:23:04 +02:00
Toni Uhlig
c17a21359b
Fixed CodeInspector issues.
...
* Added compiler search list for AC_PROG_CC, AM_PROG_CC_C_O, AC_PROG_CXX, AC_PROG_CC_STDC
for Mac OS X only
The list rendered the AX_CHECK_COMPILE_FLAG([-fsanitize=fuzzer]) useless as it did use
clang for AX_CHECK_COMPILE_FLAG but gcc during the compile process. Seems broken somehow.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-05 20:41:02 +02:00
Toni Uhlig
6e8f268873
ossfuzz.sh: do not use wildcards for fuzzer e.g. fuzz/fuzz*
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-05 20:18:16 +02:00
Toni Uhlig
4b8c8608d1
Improved HTTP line parsing if request splitted into multiple packets.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-05 18:36:57 +02:00
Luca Deri
503e3bb495
Added comment on stddev
2020-07-03 14:45:58 +02:00
Luca Deri
513c857631
Added unit test
2020-07-03 14:43:14 +02:00
Luca Deri
f7b91b46fa
Merge pull request #947 from lnslbrty/add/download-script-wireshark-traces
...
added shell script to download wireshark traces, can be used in combi…
2020-07-03 00:45:45 +02:00
Luca Deri
143fcf0b0e
Merge pull request #946 from lnslbrty/fix/teamviewer-iprange
...
Improved TeamViewer IP range (fixes #944 )
2020-07-03 00:45:11 +02:00
Toni Uhlig
ae89831055
added shell script to download wireshark fuzzing traces, can be used in combination with ./tests/do.sh
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-02 20:22:58 +02:00
Toni Uhlig
8f53c231df
Improved TeamViewer IP range ( fixes #944 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-02 18:11:39 +02:00
Nardi Ivan
974c1cc681
Improve help message of --dbg-proto option
...
Make it clear that such option is general, not about extcap
functionality
2020-07-02 09:42:53 +02:00
Nardi Ivan
c08693fda5
Incorporated some feedback
2020-07-01 20:16:16 +02:00
Luca Deri
08698c65e5
Merge pull request #943 from lnslbrty/fix/missing-lengthcheck-in-tls-esni
...
Fixed heap overflow in tls esni extraction triggered by manipulated p…
2020-07-01 12:37:29 +02:00
Luca Deri
2d68f8f635
Merge pull request #942 from lnslbrty/improved/fuzzer-automake-dependency-tracking
...
Added fuzz_*_LDADD to give Automake the opportunity to do some depend…
2020-07-01 12:37:06 +02:00
Luca Deri
2860e3af15
Merge pull request #941 from lnslbrty/add/ossfuzz-script
...
Copy&Paste ./tests/ossfuzz.sh from https://github.com/google/oss-fuzz…
2020-07-01 12:36:42 +02:00
Luca Deri
be35d423b4
Make clean enhancement
2020-07-01 12:34:28 +02:00
Luca Deri
cf9c0b96b8
Indent
2020-06-30 16:25:53 +02:00
Alfredo Cardigliano
ea6332e004
Fix segfault on ndpi_guess_protocol_id with flow = null
2020-06-30 15:54:52 +02:00
Luca Deri
392ce44573
Added ndpi_print_bin() API call
2020-06-29 22:36:46 +02:00
Toni Uhlig
05d7400563
Fixed heap overflow in tls esni extraction triggered by manipulated packets.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-29 21:51:46 +02:00
Toni Uhlig
ea30fcb5de
Added fuzz_*_LDADD to give Automake the opportunity to do some dependency tracking.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-29 21:27:03 +02:00
Toni Uhlig
3068306b60
Copy&Paste ./tests/ossfuzz.sh from https://github.com/google/oss-fuzz/pull/4041
...
* Changing the OSS-Fuzz script from our side is much more easier then
opening a PR to google/oss-fuzz every time we have to change a single line.
* https://github.com/google/oss-fuzz/pull/4041 will be updated once this PR is merged
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-29 20:50:09 +02:00
Luca Deri
0d2d44f1b6
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-06-29 19:51:36 +02:00
Luca Deri
07615903e2
Merge pull request #939 from lnslbrty/improved/fuzzy-reader-smp
...
Improved fuzz_ndpi_reader which supports now SMP/MT w/o race-coniditi…
2020-06-29 19:15:46 +02:00
Luca Deri
2c263bc726
Added ndpi_bin_similarity() for computing bin similarity
2020-06-29 19:09:38 +02:00
Toni Uhlig
4a6c525db8
Improved fuzz_ndpi_reader which supports now SMP/MT w/o race-coniditions.
...
./tests/do.sh can supports SMP/MT via environment variables.
Removed -fno-sanitize=shift as well, was fixed by 317d3ffd .
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-29 19:07:59 +02:00
Luca Deri
93a4a4387a
Merge pull request #938 from IvanNardi/errors
...
Errors
2020-06-28 21:32:08 +02:00
Nardi Ivan
f39e3c98f0
Update test results
2020-06-28 12:47:27 +02:00
Nardi Ivan
317d3ffd3e
Fix undefined behaviour in internal tests
...
Error messages:
ndpiReader.c:3211:2: runtime error: left shift of 1 by 31 places cannot be represented in type 'int'
ndpiReader.c:3207:5: runtime error: left shift of 1 by 31 places cannot be represented in type 'int'
The errors started popping up since 3d9285f1
2020-06-28 12:13:21 +02:00
Nardi Ivan
b24f5c4c0a
Fix memory leak about purged/expired flows
...
Create an helper to avoid similar errors in the future
Fixes: 1a62f4c7
2020-06-28 12:05:12 +02:00
Nardi Ivan
d6a97219ea
Fix use-after-free in http content parsing
2020-06-28 12:05:12 +02:00
Nardi Ivan
3669c14afd
DNP3: add missing initialization
2020-06-28 12:05:12 +02:00
Nardi Ivan
ece5d3e199
Fix (harmless) memory leaks when DPDK is enabled
2020-06-28 12:05:12 +02:00
Nardi Ivan
2cdf7ce806
Fix startup when DPDK is enabled
...
Fixes:a58c838c4
2020-06-28 12:05:12 +02:00
Nardi Ivan
2effa57d8a
ndpiReader: fix ports statistics
...
They should take idle/expired flows into account, too
2020-06-28 12:05:12 +02:00
Nardi Ivan
b68b45f3bb
TLS: extract JA3 signatures in some corner cases
...
In some (rare) cases, Client Hello message contains lots of cipher
suits.
2020-06-28 12:05:12 +02:00
Luca Deri
b2e89e6736
Merge pull request #937 from lnslbrty/re-add-corpus-zipfile-for-google-oss-fuzz
...
Re-Added corpus zipfile generation required for google-oss fuzzer
2020-06-28 07:29:45 +02:00
Luca Deri
1010520cc4
Merge pull request #936 from lnslbrty/fix/h323-off-by-one
...
Fixed off-by-one error in h323.
2020-06-28 07:28:55 +02:00
Toni Uhlig
f028cce209
Re-Added corpus zipfile generation required for google-oss fuzzer
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-27 23:04:20 +02:00
Toni Uhlig
fbfa54eee6
Fixed off-by-one error in h323.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-27 22:58:05 +02:00
Luca Deri
ff67e09101
Restored compiler check for fuzzy targets
2020-06-27 19:34:57 +02:00
Luca Deri
76e6c38459
Use clang where available and fallback to gcc when missing
2020-06-27 19:15:52 +02:00
Luca Deri
243104a8c2
Merge pull request #935 from lnslbrty/fix/fuzzing-tests
...
fixed fuzzing tests in a way that ./tests/do.sh is now able to use co…
2020-06-27 18:57:56 +02:00
Toni Uhlig
1f4523e331
fixed fuzzing tests in a way that ./tests/do.sh is now able to use corpus *.pcap files from ./tests/pcap
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-27 18:41:03 +02:00
Luca Deri
b5f3facf7c
Added notes whenever a new flow risk is added
2020-06-26 23:39:48 +02:00
Luca Deri
8566288e43
Added malformed packet risk support
2020-06-26 22:37:52 +02:00
Luca Deri
8de62c6d34
Values stored in patricia tree are now 32 bit (they used to be 16 bit) long
2020-06-26 17:49:45 +02:00
Nardi Ivan
0cd0905400
mqtt: add boundary check in log message
2020-06-26 12:04:02 +02:00
Nardi Ivan
56d87186f7
Fix compilation with --enable-debug-messages flag
...
NDPI_LOG* macros dereference ndpi_detection_module_struct object which is
private to ndpi library (via NDPI_LIB_COMPILATION define). So we can't use
them outside the library itself, i.e. in ndpiReader code
Therefore, in files in example/, convert all (rare) uses of NDPI_LOG* macros
to a new very simple macro, private to ndpiReader program. If necessary,
such macro may be improved.
According to a comment in ndpi_define.h, each dissector must define its own
NDPI_CURRENT_PROTO macro before including ndpi_api.h file
2020-06-26 12:04:02 +02:00
lucaderi
ebfb5e7f01
Check for CentOS 6
2020-06-26 09:01:58 +02:00
Luca Deri
d805611fcb
Merge pull request #931 from lnslbrty/fix/autogen.sh
...
fixed autoconf version check
2020-06-25 23:31:10 +02:00
Luca Deri
9742dcc45c
Merge pull request #930 from IvanNardi/extcap
...
Extcap
2020-06-25 23:30:20 +02:00
Toni Uhlig
f38a8bd7a5
fixed autoconf version check
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-25 20:02:23 +02:00
Nardi Ivan
3c66ca236b
Make lua script more robust
2020-06-25 18:02:03 +02:00
Nardi Ivan
70a926088f
Fixed harmless memory leak in extcap initialization
2020-06-25 18:02:03 +02:00
Nardi Ivan
6b69e7ebbc
Restore extcap functionality, i.e. integration with wireshark
2020-06-25 18:02:03 +02:00
Luca Deri
0b53bc2aab
Disabled unused code
2020-06-25 10:50:39 +02:00
lucaderi
ecdf7df454
Compilation fixes for non-Linux (or outdated Linux) platforms
2020-06-25 10:25:24 +02:00
lucaderi
3034e53d00
CentOS6 fix (santize won't work as too old system)
...
Fixes warning
2020-06-25 10:22:16 +02:00
Luca Deri
2350daa2dc
Merge pull request #928 from lnslbrty/added/yet-another-ndpi-integration-example
...
PROPOSAL: ndpiSimpleIntegration: added another integration example
2020-06-25 10:05:49 +02:00
Luca Deri
d710b8291d
Merge pull request #927 from lnslbrty/fix/fbzero-missing-length-check
...
Fixed missing length check in fbzero.
2020-06-24 22:17:35 +02:00
Luca Deri
485e56d855
Merge pull request #926 from lnslbrty/added/hulustream-sni-pattern
...
Added hulustream SNI pattern. Fixes #904 .
2020-06-24 22:17:09 +02:00
Luca Deri
38c0d927a9
Merge pull request #925 from lnslbrty/fix/ndpi-rader-unitialized-values
...
Fixed unitialized values in ndpiReader protocol detection bitmask dur…
2020-06-24 22:16:48 +02:00
Luca Deri
94a68451df
Merge pull request #924 from lnslbrty/improved/autoconf-sanitizer-compile-flag-checks
...
Allow -fsanitize for LLVM as well as for GCC.
2020-06-24 22:15:11 +02:00
Toni Uhlig
17c26911fb
ndpiSimpleIntegration: added another integration example
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-24 22:03:18 +02:00
Toni Uhlig
ca68beda85
Fixed missing length check in fbzero.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-23 18:35:50 +02:00
Toni Uhlig
2f5766d2f5
Added hulustream SNI pattern. Fixes #904 .
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-23 17:30:37 +02:00
Toni Uhlig
39800c88fa
Fixed unitialized values in ndpiReader protocol detection bitmask during dga selftest.
...
* make ./tests/vagrind_test.sh directory agnostic
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-23 17:23:56 +02:00
Toni Uhlig
678fbcdfd6
Allow -fsanitize for LLVM as well as for GCC.
...
* renamed --with-llvm-sanitizer to --with-sanitizer
* disable all optimisations (-O0) if --with-sanitizer set,
no functions/paramaters/variables will be optimised, improves debugging
* enable undefined behaviour sanitizer (ubsan)
* enable leak sanitizer (lsan)
* check if -fsanitize=fuzzer is available and --enable-fuzztargets set,
fail if not (only supported by clang)
* include level 3 debugging information (-g3), improves macro debugging
* disabled ubsan misaligned pointer access and lshift overflow
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-23 00:22:33 +02:00
Luca Deri
d9af1562f0
Fixes #906
...
Packet bins are not printed wehn empty
2020-06-22 14:30:26 +02:00
Luca Deri
e29e14b7aa
Merge pull request #921 from lnslbrty/improved/test-sh
...
make tests/do.sh directory agnostic
2020-06-22 12:51:17 +02:00
Luca Deri
c9d8efc2a4
Warning fix
2020-06-22 10:20:05 +02:00
Luca Deri
1a62f4c799
Added ndpi_bin_XXX API
...
Added packet lenght distribution bins
2020-06-22 01:02:54 +02:00
Luca Deri
2a137100da
Merge pull request #922 from lnslbrty/fix/http-content-disposition-crash
...
Fixed use after free caused by dangling pointer
2020-06-22 00:57:15 +02:00
Toni Uhlig
6a9f5e4f7c
Fixed use after free caused by dangling pointer
...
* This fix also improved RCE Injection detection
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-21 20:05:38 +02:00
Luca Deri
fd0591b4fc
Merge pull request #920 from lnslbrty/fix/tls-rdn-crash
...
Fixed stack overflow caused by missing length check
2020-06-19 11:44:37 +02:00
Luca Deri
48758d28ea
Added GoogleDNS DoH on Android 10
2020-06-19 09:55:58 +02:00
Toni Uhlig
14f514134d
make tests/do.sh directory agnostic
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-19 07:15:20 +02:00
Luca Deri
63670927e7
Fixed API documentation: packet tiestamp is expressed in milliseconds
2020-06-18 14:15:18 +02:00
Toni Uhlig
23594f0365
Fixed stack overflow caused by missing length check
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-18 00:52:04 +02:00
Luca Deri
b2c24558c5
DGA detection improvements
2020-06-18 00:17:30 +02:00
Luca Deri
46d96e7f32
Added checks for DGA detection
2020-06-17 19:46:37 +02:00
Luca Deri
ffd20ebdf9
Merge pull request #919 from lnslbrty/new/protocol/anydesk
...
Implemented proprietary AnyDesk protocol
2020-06-17 06:47:35 +02:00
Toni Uhlig
da37f2444f
Implemented proprietary AnyDesk protocol
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-17 01:23:03 +02:00
Alfredo Cardigliano
073e3a027b
Add API ndpi_serializer_get_format
2020-06-16 18:40:17 +02:00
Luca Deri
0ddc3a0052
Fixed invalid assignment (typo)
2020-06-14 09:37:56 +02:00
Luca Deri
38e4910636
Added improved boundary check
2020-06-14 09:29:52 +02:00
aouinizied
4247dd8322
Synchronize type definitions.
2020-06-12 22:58:58 +02:00
Luca Deri
55364ef0b4
Added DGA risk for names that look like a DGA
2020-06-11 18:51:53 +02:00
Luca Deri
60aaa80570
Added HyperLogLog cardinality estimator API calls
...
/* Memory lifecycle */
int ndpi_hll_init(struct ndpi_hll *hll, u_int8_t bits);
void ndpi_hll_destroy(struct ndpi_hll *hll);
/* Add values */
void ndpi_hll_add(struct ndpi_hll *hll, const char *data, size_t data_len);
void ndpi_hll_add_number(struct ndpi_hll *hll, u_int32_t value) ;
/* Get cardinality estimation */
double ndpi_hll_count(struct ndpi_hll *hll);
2020-06-10 23:43:35 +02:00
Luca Deri
0b9e46e65a
Updated (C)
2020-06-08 23:11:20 +02:00
Luca Deri
64fab4a478
Win fixes
2020-06-08 23:08:12 +02:00
Luca Deri
3506a07864
Added check in TLS 1.2+ for reporting a risk when TLS is not used to carry HTTPS
2020-06-08 14:20:10 +02:00
Luca Deri
d318285cae
Added HTTP check
2020-06-07 09:46:27 +02:00
Luca Deri
1479c0a278
Added TLS bounadry check
2020-06-07 09:25:19 +02:00
Luca Deri
43ddbfdfba
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-06-06 11:30:47 +02:00
Luca Deri
801c9481cb
Removed some obsolete protocols (battlefield, oscar, pcanywhere, tvants)
2020-06-06 11:29:03 +02:00
Alfredo Cardigliano
2beecdc8af
Handle EOR in TLV test
2020-06-06 11:18:17 +02:00
Luca Deri
605d548d4a
removed obsolete yahoo plugin
2020-06-06 09:38:19 +02:00
Alfredo Cardigliano
0da76fdac6
Support for multiple records in CSV serialization
2020-06-05 17:28:27 +02:00
Luca Deri
597d6e5d60
Merge pull request #913 from yskcg/fix_segment_fault_dev
...
Fix segment fault dev
2020-06-05 16:57:46 +02:00
Alfredo Cardigliano
67c72a8cb5
Add ndpi_serializer_get_header API (CSV only)
2020-06-05 16:52:26 +02:00
Luca Deri
07c54f9992
Added ndpi_dpi2json() API call
2020-06-05 16:08:23 +02:00
Luca Deri
16ca69733a
Improved teamviewer detection
2020-06-03 10:14:27 +02:00
ysk
40550073ef
fix segment fault cause by the ssl.server_names when it may NULL
2020-06-03 11:19:37 +08:00
ysk
52893d99f6
fix segment fault cause by the ssl.server_names when it may NULL
2020-06-03 10:44:35 +08:00
ysk
86a3dc5bea
Merge branch 'dev' of github.com:yskcg/nDPI into dev
2020-06-03 10:41:40 +08:00
Luca Deri
5afa3ad818
Improved spotify detection
2020-06-02 15:00:14 +02:00
Luca Deri
af2a44ae5f
Added boundary check in kerberos protocol
2020-06-01 18:22:10 +02:00
Luca Deri
241af016e9
Added check for spotify payload lenght
2020-06-01 16:36:12 +02:00
Luca Deri
16dc0ec29e
Check to avoid allocating twice the esni memory
2020-06-01 16:34:24 +02:00
Luca Deri
29d9c2d2c8
Reworked HTTP header processing workflow
2020-06-01 09:54:05 +02:00
Luca Deri
669b7579ff
HTTP comparison optimization
2020-05-31 19:31:01 +02:00
Luca Deri
a4f8d913ea
Minor changes
2020-05-31 19:11:12 +02:00
Luca Deri
dc5b4cbde0
Reworked ndpi_strncasestr
2020-05-31 18:50:25 +02:00
Luca Deri
b0bf66c436
Added offset check in kerberos dissector
2020-05-31 08:30:55 +02:00
Luca Deri
c793e16050
Added extra TLS memory boundary checks
2020-05-31 08:28:02 +02:00
Luca Deri
b6eef17e54
Added check to avoid producing alerts for known protocol on unknown port when using TLS
2020-05-30 19:33:13 +02:00
Luca Deri
374a24a1fb
HTTP dissector improvements
2020-05-30 18:40:15 +02:00
Luca Deri
cbb0b864a2
Minor cleanup
2020-05-29 21:51:51 +02:00
Luca Deri
61066fb106
Added check for heap buffer overflow read
2020-05-29 21:43:06 +02:00
Luca Deri
4ceff1dc77
Fixes for https://github.com/ntop/nDPI/pull/911
...
Added code for dumping invalid HTTP header
2020-05-29 21:23:46 +02:00
Luca Deri
0271e29097
Added references to ESNI
2020-05-29 21:23:34 +02:00
Luca Deri
fcb50dec70
Merge pull request #911 from tmacchioni/dev
...
Added check for suspicious HTTP headers
2020-05-29 21:14:39 +02:00
Tommaso Macchioni
db5cd92fe1
Added check for suspicious HTTP headers
2020-05-29 15:55:52 +02:00
Luca Deri
3085d8e4ff
Refreshed test pcap
2020-05-28 21:23:02 +02:00
Luca Deri
9c3bfeca80
Added support for Encrypted TLS SNI dissection
...
https://datatracker.ietf.org/doc/draft-ietf-tls-sni-encryption/
2020-05-28 17:44:18 +02:00
Luca Deri
f6038c358a
Added ndpi_serialize_risk() API function
2020-05-27 17:35:11 +02:00
Luca Deri
3108c75059
Result update
2020-05-27 15:26:30 +02:00
Luca Deri
811d7a39b5
Added pcap with encrypted SNI
...
- https://blog.cloudflare.com/encrypted-sni/
- https://www.inmotionhosting.com/support/website/security/dns-over-https-encrypted-sni-in-firefox/
2020-05-27 15:00:55 +02:00
Luca Deri
030e9dddb7
Extended the cache for services that need to be reconciled such as Microsoft Teams
...
Added JSON-formatted Microsoft list of IP/services
2020-05-27 12:40:35 +02:00
Alfredo Cardigliano
2dce6cd525
Add ndpi_serialize_start_of_list/ndpi_serialize_end_of_list to serialize simple lists in JSON
2020-05-25 16:37:00 +02:00
Luca Deri
8fa5c31996
Added ndpi_serialize_risk() to the nDPI API
2020-05-24 08:54:38 +02:00
Luca Deri
ee35834be6
Added flow risk serilization
2020-05-24 08:46:10 +02:00
aouinizied
e5c2c400ef
Update APIs and structures.
2020-05-22 23:48:54 +02:00
Luca Deri
bbbc5fdbae
Added memory boundary checks
2020-05-22 07:24:02 +02:00
Luca Deri
3874f0e0e0
Added stub for checking HTTP header
...
Updated Teams result
2020-05-21 15:19:55 +02:00
ysk
83ae5b7256
nDpi#remove build warnings
2020-05-21 14:06:52 +08:00
Luca Deri
c02b00e0ce
MS Teams uses as underlying protocol for voice/video. This commit adds the ability
...
to mark as MS Teams all Skype traffic made by a host with active MS Teams flows
2020-05-21 00:06:22 +02:00
Luca Deri
07d9e4f9ba
Fixed valse positive whatsapp detection
...
Cleaned Microsoft IP addresses list
2020-05-20 23:28:21 +02:00
Luca Deri
e9519c9aca
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-05-20 23:14:46 +02:00
Luca Deri
329eff069e
Removed bittorrent false positive detection
2020-05-20 23:14:09 +02:00
Luca Deri
246ec53bcf
Merge pull request #905 from lnslbrty/dev
...
Fixed docstring typos for ndpi_finalize_initalization
2020-05-20 08:48:49 +02:00
ysk
cd65da69d3
Merge branch 'dev' of github.com:yskcg/nDPI into dev
2020-05-20 13:21:36 +08:00
ysk
068c1b1f22
someip#fix when run across architectures such ARM ,may be occour sigbus error(),Unhandled fault: alignment fault (0x92000021) at 0x00000000f67004aa
2020-05-20 13:15:42 +08:00
Luca Deri
b7e666e465
Added fix to avoid potential heap buffer overflow in H.323 dissector
...
Modified HTTP report information to make it closer to the HTTP field names
2020-05-19 08:31:05 +02:00
Toni Uhlig
c5e16b4ff7
Fixed docstring typos for ndpi_finalize_initalization
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-05-17 16:59:57 +02:00
Luca Deri
3d9285f1be
Added check for invalid HTTP URLs
2020-05-16 00:10:35 +02:00
Luca Deri
c375782b96
Added check for binary scripts
...
Added NDPI_HTTP_NUMERIC_IP_HOST risk
ndpi_risk moved to 32 bit
2020-05-15 22:49:55 +02:00
Luca Deri
8e7b1ea7a1
Fix for potential heap-buffer-overflow in ndpi_search_openvpn
2020-05-15 21:10:37 +02:00
Luca Deri
e90c5c7c32
Added NDPI_HTTP_SUSPICIOUS_USER_AGENT ndpi_risk
2020-05-15 19:19:17 +02:00
Luca Deri
7dfbfff743
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-05-15 18:58:10 +02:00
Luca Deri
da22aa5fc7
Added NDPI_TLS_CERTIFICATE_EXPIRED, NDPI_TLS_CERTIFICATE_MISMATCH, to ndpi_risk
2020-05-15 18:57:49 +02:00
Luca Deri
a183b2ab9b
Added link to nfstream
2020-05-15 18:11:59 +02:00
Luca Deri
adfe6b763c
Gotomeeting address range fix
2020-05-15 11:20:21 +02:00
Luca Deri
9ed94a722c
Improvements on GotoMeeting
...
Added pcap for testing malware
2020-05-15 10:52:23 +02:00
Luca Deri
7037e79604
Merge pull request #903 from Loures/dev
...
Extend packet struct with Content-Disposition HTTP header field
2020-05-14 20:56:07 +02:00
loures
1edf5c49d6
Extend filetype matching for Content-Disposition header
2020-05-14 14:30:34 +02:00
loures
baddfbb6c3
Extend packet struct with Content-Disposition HTTP header field
...
and improve HTTP binary transfer mime type check
2020-05-14 12:47:22 +02:00
Luca Deri
fb64346e28
Code clenup for PR #902
2020-05-14 09:49:47 +02:00
Luca Deri
50be0b0049
Merge pull request #902 from Loures/dev
...
Add check for HTTP transfer of executable files
2020-05-14 09:12:17 +02:00
loures
08f32f2e0e
Set risk field instead of changing protocol when checking for dangerous
...
HTTP traffic
2020-05-13 19:56:49 +02:00
loures
0a4fbb8cfb
Add check for HTTP transfer of executable files
2020-05-13 18:32:29 +02:00
Luca Deri
9dfd0d0071
Code cleanup
2020-05-13 17:49:02 +02:00
Luca Deri
17235d234e
Merge pull request #897 from catenacyber/fuzzoracle
...
Adds bound check in oracle protocol
2020-05-12 13:53:55 +02:00
Luca Deri
db16a987c5
Merge pull request #896 from IvanNardi/nats
...
Fix NATS dissector
2020-05-12 13:52:42 +02:00
Luca Deri
f7f705406f
Invalid TLS check
2020-05-12 12:25:07 +02:00
Luca Deri
cd765c08d6
Added NDPI_XXX_BIT_16
2020-05-11 09:07:30 +02:00
Luca Deri
ee15c6149d
Added TLS weak cipher and obsolete protocol version detection
2020-05-10 21:55:35 +02:00
Luca Deri
ae803c8b51
Added detection of self-signed TLS certificates
2020-05-10 21:40:35 +02:00
Luca Deri
e5e69d0f7a
Added the ability to detect when a known protocol is using a non-standard port
...
Added check to spot executables exchanged via HTTP
2020-05-10 21:25:38 +02:00
Philippe Antoine
b69177be2f
Adds bound check in oracle protocol
...
Found by oss-fuzz
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=21780
2020-05-10 15:04:23 +02:00
Nardi Ivan
f8503da9e9
Fix NATS dissector
2020-05-09 15:41:20 +02:00
Luca Deri
39ae57e6a3
Cleaned hyperscan leftover
...
Added further hyperscan hooks
2020-05-08 18:24:07 +02:00
Luca Deri
c9b37b92f5
Added self signed certificate test pcap
2020-05-08 09:09:58 +02:00
Luca Deri
4a09b4efa0
Added TLS issuerDN and subjectDN
2020-05-07 18:44:51 +02:00
Luca Deri
fd646bd05f
Reworked TLS dissector with a certificate RDN sequence reader
2020-05-07 17:22:01 +02:00
Luca Deri
6a1b8baa00
Fixed category matching
2020-05-06 23:50:35 +02:00
Luca Deri
2ccd2c204b
API cleanup for indetifying explicitly in automa's what we're searching (protocol or category)
...
Removed hyperscan support that is apperently unused
2020-05-06 23:19:59 +02:00
Luca Deri
263547e77d
Updated automa API to use 32 bit values splits from protocol/categpry
2020-05-06 21:57:32 +02:00
Luca Deri
86e34fbf6d
Added support for Telegram v6
2020-05-06 18:06:30 +02:00
Luca Deri
84f66b4d6b
Introduced custom protocols with IP and (optional) port support
...
Example
- Single IP address
ip:213.75.170.11@CustomProtocol
- IP address with CIDR
ip:213.75.170.11/32@CustomProtocol
- IP address with CIDR and port
ip:213.75.170.11/32:443@CustomProtocol
Please note that there are some restrictions on the port
usage. They have been listed in example/protos.txt
2020-05-06 12:51:44 +02:00
Luca Deri
7855e0318d
Various fixes to patricia tree handling
2020-05-06 11:13:57 +02:00
Luca Deri
48282369e2
False positive fixes
2020-05-06 01:34:55 +02:00
Luca Deri
7d63149ced
Updated API
2020-05-06 00:41:07 +02:00
Luca Deri
427002d14f
Reworked protocol handling chnging it is u_int16_t
2020-05-06 00:31:40 +02:00
Luca Deri
4148c5e065
Removed now obsolete MSN protocol
...
Added nats.io protocol dissector
2020-05-03 18:20:21 +02:00
Luca Deri
c120cca662
SSH boundary check rework
2020-04-30 20:08:03 +02:00
Luca Deri
7344bf65bc
Minor cleanup
2020-04-30 19:58:07 +02:00
Luca Deri
6f79b78f71
Merge pull request #891 from catenacyber/ghsl2
...
Better fix for integer overflow in SSH
2020-04-30 19:53:16 +02:00
Philippe Antoine
a70fd6ed3b
Better fix for integer overflow in SSH
...
Credits to GHSL
2020-04-30 18:44:40 +02:00
Luca Deri
bd0fd6cf8d
Merge pull request #883 from leonn/websocket
...
💡 implement WebSocket protocol dissector
2020-04-27 23:28:23 +02:00
Luca Deri
0bf809f8e5
Merge pull request #884 from lnslbrty/dev
...
Added missing ndpiReader dependency for the install target
2020-04-27 23:27:26 +02:00
Luca Deri
44259ab2b9
Merge pull request #887 from IvanNardi/tunnel
...
Tunnel
2020-04-27 23:27:03 +02:00
Alfredo Cardigliano
328016895f
Handle empty blocks
2020-04-27 13:34:54 +00:00
Leonn Paiva
780dc8d1e7
💡 implement websocket protocol dissector
2020-04-26 02:53:12 -03:00
Alfredo Cardigliano
4d746dabe9
Enable IEC 60870-5-104 dissector
2020-04-24 15:31:44 +00:00
Nardi Ivan
097127c31d
Fix heap-overflow error in CAPWAP detunneling code
2020-04-24 10:42:52 +02:00
Nardi Ivan
c2ebbb15ad
Fix "division by zero" runtime error
2020-04-23 14:24:49 +02:00
Nardi Ivan
f965983c23
Add basic support for some ip-in-ip tunnels
...
Add support for 4in4, 6in6 and 4in6 encapsulations
Add support for ipv6 traffic in gtp tunnels, too
To allow gtp unit test, gtp detunneling flag has been globally enabled
in the test suite
2020-04-23 10:55:33 +02:00
Toni Uhlig
8d8e61b256
Added missing ndpiReader dependency for the install target
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-04-22 21:51:57 +02:00
Luca Deri
0b702c20d3
Warning fix
2020-04-22 18:52:36 +02:00
Luca Deri
473a5d1d0b
Merge pull request #881 from leonn/bug_protocol_was_guessed
...
Bug protocol was guessed
2020-04-22 18:49:55 +02:00
Luca Deri
65b428899d
Fix for nDPI code not downlooaded from git
2020-04-22 16:15:15 +02:00
Leonn Paiva
6769168d89
🐛 use protocol_was_guessed in ndpi_detection_giveup
2020-04-22 03:48:12 -03:00
Leonn Paiva
4d5ca2c473
🆒 code ident & style
2020-04-22 03:40:55 -03:00
Luca Deri
e8cae3cff9
Updated results
2020-04-21 19:26:49 +02:00
Luca Deri
019b51bb17
Merge pull request #879 from IvanNardi/warnings
...
Fix some compilation warnings
2020-04-21 19:23:57 +02:00
Luca Deri
e2be7daed6
Merge pull request #880 from catenacyber/fuzz8fix
...
Gets right protocol after IPv6 header
2020-04-21 19:22:50 +02:00
Philippe Antoine
1b73f7372e
Gets right protocol after IPv6 header
2020-04-21 15:34:53 +02:00
Nardi Ivan
b1a6c6b895
Fix some compilation warnings
2020-04-20 16:53:39 +02:00
Luca Deri
e603549967
Office365 renamed to Microsoft365 (by Microsoft)
2020-04-20 15:44:27 +02:00
Luca Deri
3bdec5ae5f
Updated node list ( fixes #766 )
2020-04-20 15:16:31 +02:00
Luca Deri
25cd2a23a6
Compilation fixes
2020-04-20 15:08:51 +02:00
Luca Deri
97badc574b
Merge pull request #877 from catenacyber/fuzz7fix
...
Adds bound check before calling ndpi_handle_ipv6_extension_headers
2020-04-20 13:56:53 +02:00
Luca Deri
493bffb3e0
Added check for pkg-config presence
2020-04-19 21:48:24 +02:00
Philippe Antoine
c2b2692e65
Seeting right flow protocol after IP6 extensions
...
Finally fixing https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=20727
2020-04-18 14:39:57 +02:00
Philippe Antoine
db5f3b38b7
Adds CIFuzz to check PRs
...
cf https://google.github.io/oss-fuzz/getting-started/continuous-integration/
2020-04-18 10:50:56 +02:00
Philippe Antoine
da0889d3ba
Adds bound check before calling ndpi_handle_ipv6_extension_headers
2020-04-17 22:21:03 +02:00
Luca Deri
94eee66a7b
CiscoVPN dissection improvements
2020-04-17 16:56:55 +02:00
Luca Deri
748df7972a
Results update
2020-04-17 10:36:27 +02:00
Luca Deri
a766de7b94
Merge pull request #876 from a-czyrny/dev
...
additional csv semicolon fix
2020-04-17 10:34:41 +02:00
Luca Deri
711ba99eaa
Added detection of Microsoft Teams
2020-04-16 15:23:07 +02:00
Alexander Czyrny
32d25bfdaf
additional csv semicolon fix
...
Created function correct_csv_data_field to pevent duplicated code. Additionally used for _flow->ndpi_flow->protos.stun_ssl.ssl.alpn_ and _flow->ndpi_flow->protos.stun_ssl.ssl.tls_supported_versions_ to guarantee a valid csv output (commas replaced by semicolon) .
2020-04-16 14:12:48 +02:00
Luca Deri
287015ffdc
Fixed invalid check
2020-04-15 22:42:09 +02:00
Luca Deri
f4c24663fc
Merge pull request #874 from catenacyber/fuzz6fix
...
Fuzz6fix
2020-04-15 18:05:16 +02:00
Luca Deri
9f2dabbda4
Merge pull request #873 from a-czyrny/a-czyrny-ndpireader-csv-patch
...
Fix for missing line breaks in CSV file
2020-04-15 18:04:26 +02:00
Philippe Antoine
4f370fe7c4
Adds netbios bound check
2020-04-15 16:40:00 +02:00
Philippe Antoine
9483c842b5
TLS initializes version_str
2020-04-15 16:40:00 +02:00
Philippe Antoine
c1f9f05d33
Adds tls check before reading memory
2020-04-15 16:22:16 +02:00
Philippe Antoine
cf47ba234a
Use ndpi_handle_ipv6_extension_headers in reader_util
2020-04-15 16:19:57 +02:00
Philippe Antoine
98f2d3a73c
Adds bound check for IRC
2020-04-15 15:56:58 +02:00
Philippe Antoine
c1baf1516d
Adds bound check for TZSP
2020-04-15 15:50:58 +02:00
Philippe Antoine
369dc65c1a
Fix integer overflow in quic
2020-04-15 15:45:32 +02:00
Philippe Antoine
4ec3e6c064
Adds bound check in TLS
2020-04-15 15:42:54 +02:00
Philippe Antoine
81e97d7515
Fixes OOB reads in postgres
...
Reported by GHSL
2020-04-15 15:35:34 +02:00
Alexander Czyrny
32ab88a26e
Fix for missing line breaks in CSV file
...
If "-v" is used as an argument, the line breaks are missing in the csv file ("-C"), because the argument "-J" is assumed. Moving the condition for the CSV file handler out of the scope of the "enable_joy_stats" condition removes this dependency and the CSV file is formatted correctly.
2020-04-15 10:12:37 +02:00
Luca Deri
afdae85b30
Restored ndpi_get_api_version() prototype
2020-04-15 09:06:02 +02:00
Luca Deri
63c4eaae9b
Invalid function definition fix
2020-04-13 22:40:20 +02:00
Luca Deri
4e876a4543
Merge pull request #866 from anticomputer/packet_payload_integer_ql
...
ql query to identify suspicious use of network sourced integers
2020-04-15 08:38:23 +02:00
Luca Deri
7b54d028a3
Merge pull request #872 from aouinizied/dev
...
Update python example.
2020-04-15 08:37:28 +02:00
Luca Deri
9cba06a080
Merge pull request #869 from disconnect3d/patch-2
...
Fix incorrect "<iq from=\"' parsing
2020-04-15 08:36:27 +02:00
Luca Deri
794f7fa124
Merge pull request #868 from disconnect3d/patch-1
...
Fix off by one when checking for "GET / HTTP" string
2020-04-15 08:35:59 +02:00
Luca Deri
d3b4b81d6f
Merge pull request #867 from IvanNardi/memory-leaks
...
Memory leaks
2020-04-15 08:35:28 +02:00
Zied Aouini
1bee9d85a4
Fix flow_printer example.
2020-04-15 08:05:03 +02:00
Disconnect3d
fa15e170b4
Fix incorrect "<iq from=\"' parsing
...
This PR fixes a wrong size arg passed to memcmp when checking for "<iq from=\"" and "<iq from \'" strings.
2020-04-13 16:35:03 +02:00
Disconnect3d
b75838b771
Fix off by one when checking for "GET / HTTP" string
2020-04-13 16:33:27 +02:00
Luca Deri
d665df64e2
Added ndpi_serialize_raw_record() API call
2020-04-10 21:39:23 +02:00
Nardi Ivan
e84563f971
ndpiReader: fix memory leak in idle sessions purging
2020-04-08 15:15:34 +02:00
Nardi Ivan
a60854bae6
Fix some debug messages
2020-04-08 15:15:34 +02:00
Nardi Ivan
7b690d8b2d
kerberos: fix heap-overflow error
2020-04-08 15:15:34 +02:00
Nardi Ivan
0c1322a718
s7comm: fix heap-overflow error
2020-04-08 15:15:34 +02:00
Nardi Ivan
b40732d8a5
Fix an harmless memory leak
...
Leak introduced in 90e08b35 , while fixing #845
2020-04-08 15:15:34 +02:00
Luca Deri
db8497778d
Fixes #853 and adds a self check for duplicates
2020-04-07 19:17:37 +02:00
Luca Deri
dea883a25d
Minor refresh
2020-04-07 19:01:38 +02:00
Luca Deri
81a2f54dd7
Merge pull request #865 from catenacyber/ghsl-2020-05x
...
Ghsl 2020 05x
2020-04-05 08:29:43 +02:00
Luca Deri
c2c01b618b
Fix for string serialization with initial empty string
2020-04-03 15:26:24 +02:00
Bas Alberts
fb863c6bfb
ql query to identify suspicious use of network sourced integers
2020-04-02 17:14:49 -04:00
Philippe Antoine
7ce478a58b
ssh: fixing unsigned overflow leading to heap overflow
...
cf GHSL-2020-051
2020-04-02 16:48:35 +02:00
Philippe Antoine
3bbb0cd329
ssh: adds systematic bounds checks in concat_hash_string
...
cf GHSL-2020-052
2020-04-02 16:35:10 +02:00
Luca Deri
56ca71bda9
Merge pull request #863 from IvanNardi/memory-errors
...
Memory errors
2020-03-31 17:51:20 +02:00
Nardi Ivan
498571354d
openvpn: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
3924257f32
telnet: fix another heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
817aa54214
telnet: fix heap-overflow error
...
There is some boilerplate since I removed an if branch and I had to reindent
the code
2020-03-27 11:09:53 +01:00
Nardi Ivan
97fc94c7e8
kerberos: fix use-after-free error
...
After leaving kerberos code, the original packet may be processed from
other dissector (i.e. TLS)
2020-03-27 11:09:53 +01:00
Nardi Ivan
9ec711aa90
tls: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
9c2c04d8ce
ssh: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
4f399356a6
quic: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
45ff2a3f5a
h323: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
58f0f29113
soulseek: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
da5e5a3e2a
ciscovpn: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Luca Deri
17d531e3db
Added s7comm test pcap
2020-03-27 09:35:59 +01:00
Luca Deri
0d223ada3f
Compilation fix
2020-03-27 08:46:03 +01:00
Luca Deri
890e8644ac
Merge pull request #861 from havup/dev
...
pull request with s7comm
2020-03-27 08:38:44 +01:00
havup
1bab8a1c22
Update s7comm.c
2020-03-27 14:02:10 +08:00
havup
24bb0b7f53
Update s7comm.c
2020-03-27 13:09:46 +08:00
havup
803b13a7a8
Update s7comm.c
2020-03-27 12:58:56 +08:00
havup
7841145d9c
Update tls_long_cert.pcap.out
2020-03-27 12:28:15 +08:00
havup
efdac78ddc
Update s7comm.c
2020-03-27 11:19:50 +08:00
havup
74825ffc6e
Update s7comm.c
2020-03-26 13:06:02 +08:00
emanuele-f
1b8f7ed101
Fix API version generation
2020-03-25 14:07:19 +01:00
emanuele-f
9cf016c5f1
Fix ndpi_get_api_version version truncation
2020-03-25 14:00:47 +01:00
Luca Deri
47a4507d9e
NDPI_API_VERSION is now computed automatically
2020-03-25 12:51:06 +01:00
havup
779d9a6e51
Add files via upload
2020-03-25 19:09:14 +08:00
havup
ac17e0bea7
Update ndpi_main.c
2020-03-25 19:06:36 +08:00
havup
4d95dae2ae
Update ndpi_main.c
2020-03-25 19:05:49 +08:00
havup
6c3cbe50e2
Update ndpi_protocols.h
2020-03-25 19:04:35 +08:00
havup
a2b163beca
Update ndpi_protocol_ids.h
2020-03-25 19:04:00 +08:00
Luca Deri
c8a1767465
Fixed invalid allocation
2020-03-24 13:36:03 +01:00
Luca Deri
40be74c629
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-03-23 14:45:08 +01:00
Luca Deri
df5cf59787
Format update
2020-03-23 14:44:33 +01:00
Luca Deri
d26349e082
Format update
2020-03-23 14:37:14 +01:00
Luca Deri
7add3acc53
Added fuzz-2020-02-16-11 fuzzy pcap
2020-03-23 10:27:32 +01:00
Luca Deri
1c1a18d12f
Added fuzz-2006-09-29-2858 fuzzy pcap
2020-03-23 10:25:28 +01:00
Luca Deri
92bd223c34
Added fuzz-2006-06-26-2594.pcap fuzzy pcap
2020-03-23 10:24:11 +01:00
Luca Deri
9d53c3c3b8
Added wa_video.pcap
2020-03-23 10:23:05 +01:00
Luca Deri
906d7fe0c1
Added wa_voice.pcap
2020-03-23 10:22:46 +01:00
Luca Deri
cd78740caf
Added netflow-fritz.pcap
2020-03-23 10:11:51 +01:00
Luca Deri
626ee52049
Added smb_deletefile.pcap
2020-03-23 10:09:47 +01:00
Luca Deri
7a93994802
Added iphone.pcap
2020-03-23 10:09:14 +01:00
Luca Deri
1bb10863e4
Added android.pcap
2020-03-23 10:08:57 +01:00
Luca Deri
924bc9698b
Added badpackets.pcap
2020-03-23 10:06:16 +01:00
Luca Deri
9aba94713c
Added dns_exfiltration.pcap
2020-03-23 10:06:00 +01:00
Luca Deri
00beac6b1a
Added netbios.pcap
2020-03-23 10:05:41 +01:00
Luca Deri
8c2ffc5b37
Added dos_win98_smb_netbeui.pcap
2020-03-23 10:05:24 +01:00
Luca Deri
a845e99720
Merge pull request #859 from catenacyber/fuzzudpfix
...
Checks enough data for UDP header
2020-03-20 18:02:27 +01:00
Luca Deri
8cda02bb14
Fixed loop in serialization
2020-03-20 18:01:37 +01:00
Philippe Antoine
3e259aac98
tls_supported_versions only if version_str is initialized
...
With version_len == (extension_len-1)
2020-03-19 17:19:28 +01:00
Philippe Antoine
2aec630202
Fix use of uninitialized value in TLS
2020-03-19 17:16:41 +01:00
Philippe Antoine
c6acf97bfb
Adds different checks against overflows
2020-03-19 16:54:31 +01:00
Philippe Antoine
e9195589d2
Checks enough data for UDP header
2020-03-19 16:44:53 +01:00
Luca Deri
b2cbe76e71
Added QUIC v046 test pcap
2020-03-17 16:51:25 +01:00
Luca Deri
4227be7989
Update for QUIC 046
2020-03-17 16:48:34 +01:00
Simone Mainardi
e282e43279
Fixes netbios overread
...
This commit inherits from https://github.com/ntop/nDPI/commit/7a2bcd9c395f9fe554109e04add33e9e65564d82
but leaves ndpi_netbios_name_interpret as part of the API as it
is used by ntopng
2020-03-12 22:21:07 +01:00
Simone Mainardi
2f15ce706f
Fixed API change which removed ndpi_netbios_name_interpret
...
This reverts commit 7a2bcd9c39 .
2020-03-12 22:08:59 +01:00
Luca Deri
70ee793ff3
Merge pull request #856 from catenacyber/fuzzfix5
...
Fuzzfix5
2020-03-12 18:13:30 +01:00
Philippe Antoine
7806eb5f5b
Fix infinite loop in tls
2020-03-12 14:31:47 +01:00
Philippe Antoine
9d1340a8e7
Fix buffer overread in yahoo
2020-03-12 14:26:08 +01:00
Philippe Antoine
7a2bcd9c39
Fix buffer overread in netbios
2020-03-12 14:22:46 +01:00
Philippe Antoine
fe513014a8
Fix buffer over read in dns
2020-03-12 14:13:04 +01:00
Philippe Antoine
3c05d4551d
Fix snprintf return value check for tls
2020-03-12 14:05:48 +01:00
Philippe Antoine
4976d93d4e
Fix buffer overread in ndpi_search_setup_capwap
2020-03-12 14:03:31 +01:00
Luca Deri
1e933e8b02
Win fixes
2020-03-12 11:26:38 +01:00
Luca Deri
942a71c7eb
NetBIOS dissection improvements
2020-03-01 11:42:21 +01:00
Luca Deri
7fd135a8c9
Added SMBv1 over NetBIOS detection
2020-03-01 11:32:09 +01:00
Luca Deri
34ad06fef5
Compilation fix
2020-02-28 16:03:27 +01:00
Luca Deri
8f45f51e6c
Compilation fix
2020-02-28 15:28:41 +01:00
Luca Deri
9f72b15fff
Merge pull request #850 from catenacyber/fuzz4fix
...
Fuzz4fix
2020-02-28 14:39:17 +01:00
Philippe Antoine
6fe9535881
Adds check before memcpy for bittorrent
2020-02-26 17:12:46 +01:00
Philippe Antoine
5fc9d41eb0
Run ndpi_detection_process_packet only with payload
...
Real problem is decapsulation of all ipv6 headers
2020-02-26 17:05:08 +01:00
Philippe Antoine
933351840d
Fix off by one in imap
2020-02-26 16:59:04 +01:00
Philippe Antoine
83fdfe24d0
Fix read overflow before UDP header
2020-02-26 16:16:29 +01:00
Alfredo Cardigliano
d4c093e828
Check NULL strings in ndpi_serialize_string_string
2020-02-26 09:55:24 +01:00
Luca Deri
c0ec78885d
Merge pull request #849 from annp1987/fix_ndpi_flow2json_segfault
...
ndpi_flow2json should check http.url before serializer
2020-02-26 08:06:11 +01:00
Luca Deri
a55c410202
Merge pull request #848 from aouinizied/dev
...
nDPI 3.2 support in python cffi bindings
2020-02-26 08:05:45 +01:00
Nguyen Phuong An
e675be1a83
ndpi_flow2json should check http.url before serializer
...
This patch will fix issue: https://github.com/ntop/PF_RING/issues/557
2020-02-26 13:32:13 +07:00
Luca Deri
f07a329447
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-02-23 19:10:14 +01:00
Luca Deri
2ceff3e214
Fixed swapped protocol
2020-02-23 19:09:58 +01:00
Zied Aouini
dcb6fde0c9
Update Python cffi bindings.
2020-02-21 17:28:44 +01:00
Zied Aouini
e67604a583
Remove trailing alignment directives.
2020-02-21 16:37:36 +01:00
Zied Aouini
40896d3d44
Fix docstrings.
2020-02-21 15:51:17 +01:00
Zied Aouini
5a0f609086
Add ndpi_flow_tcp_struct and ndpi_flow_udp_struct api calls.
2020-02-21 15:49:46 +01:00
Alfredo Cardigliano
2972e29097
Moved to 3.3
2020-02-20 10:15:11 +01:00
Luca Deri
dd80ec869a
Fixes #837
2020-02-19 23:44:22 +01:00
Luca Deri
1714d7aa52
Fixes #842
2020-02-19 23:40:53 +01:00
Luca Deri
90e08b3568
Fixes #845
2020-02-19 23:38:33 +01:00
Luca Deri
080e23e30e
Merge pull request #846 from catenacyber/fuzzofix
...
Fix various buffer over reads
2020-02-19 22:55:18 +01:00
Luca Deri
edce5a8c1f
Fix for disabling guess when not requested
2020-02-19 12:24:26 +01:00
Alfredo Cardigliano
c8ccf33f07
nDPI 3.2 changelog
2020-02-19 12:10:49 +01:00
Philippe Antoine
ee979ac14a
Fix kerberos leak
2020-02-18 13:32:20 +01:00
Philippe Antoine
3eb9907dd7
Fix various buffer over reads
2020-02-18 11:50:22 +01:00
Luca Deri
fdf8dd724f
Minor fix
2020-02-17 22:15:36 +01:00
Luca Deri
37121a9b58
Added protocol range check
2020-02-17 19:34:47 +01:00
Luca Deri
bbaf9147b6
Fixed TLS client SNI dissection
2020-02-17 18:48:21 +01:00
Luca Deri
9796fdc0e9
Temporarely disabled x390 s390x as we have no way to debug the code on such platforms
2020-02-15 17:31:30 +01:00
Luca Deri
e0a058af67
Merge pull request #844 from catenacyber/fuzz2fix
...
Fuzz2fix
2020-02-15 17:21:52 +01:00
Alfredo Cardigliano
80e9826040
Add ndpi_serialize_string_raw to add raw json values
2020-02-14 16:32:00 +01:00
Philippe Antoine
bf7dcd63c3
Checks length for next ip header
2020-02-14 14:18:31 +01:00
Philippe Antoine
b287dccecf
Checks l4 size against l3 size
2020-02-14 14:02:19 +01:00
emanuele-f
cb34c6b233
Add fpic in the reader
2020-02-14 12:06:55 +01:00
emanuele-f
fd94270507
Remove decimals in test results for IAT, packet lengths and goodput ratio
2020-02-14 11:42:20 +01:00
Emanuele Faranda
03cf975c07
Merge pull request #840 from xnox/more-tests
...
travis: bump to bionic, add arm64 & s390x.
2020-02-14 10:32:31 +00:00
emanuele-f
428661c00b
Add debug symbols when using --with-llvm-sanitizer
2020-02-14 11:09:00 +01:00
emanuele-f
5c52c00ea4
Add the --with-llvm-sanitizer flag
...
To enable the leaks detector, set the ASAN_OPTIONS=detect_leaks=1
environment variable, e.g:
ASAN_OPTIONS=detect_leaks=1 example/ndpiReader -i test.pcap
2020-02-13 18:42:13 +01:00
Luca Deri
f89f25c118
Added ndpi_is_protocol_detected() API call
2020-02-13 15:20:47 +01:00
emanuele-f
d4ae8a5f16
Fix memory invalid access in SMTP and leaks in TLS
2020-02-13 10:46:30 +01:00
emanuele-f
7234f36949
Fix possible leak
2020-02-13 10:14:57 +01:00
emanuele-f
2efc09a20e
Fix invalid memory read
2020-02-12 19:36:47 +01:00
emanuele-f
3fa61a394b
Fix little leak on the proto_defaults strdup
2020-02-12 17:15:01 +01:00
Dimitri John Ledkov
582a01303f
travis: bump to bionic, add arm64 & s390x.
2020-02-10 18:26:47 +00:00
Luca
97fb50e837
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-02-10 15:26:21 +01:00
Luca Deri
a3da5604a3
Allocation fix in kerberos dissector
2020-02-10 15:25:40 +01:00
Luca
af6c86de28
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-02-10 15:04:37 +01:00
Luca Deri
34984f1aec
Removed outdated AppVeyor link
2020-02-08 11:25:39 +01:00
Luca Deri
83bbb4cb69
Compliation warning fixes
2020-02-08 11:24:40 +01:00
Luca Deri
ff4f32ff48
Merge pull request #839 from catenacyber/fuzzbadge
...
Adds oss-fuzz badge to REAMDE
2020-02-08 11:21:23 +01:00
Luca Deri
33d761a55a
Merge pull request #838 from catenacyber/fix2
...
Adds missing checks
2020-02-08 11:20:54 +01:00
Luca Deri
2bd89be3e2
Added new TLS test files
2020-02-08 10:38:22 +01:00
Luca Deri
5cad39f0e8
Added export of TLS supported version in TLS header
2020-02-07 23:26:03 +01:00
Luca Deri
3be263aafc
Added TLS ALPN support
2020-02-07 21:54:04 +01:00
Luca
452ba1f339
Improvements for DNS continuous flow dissection
2020-02-06 19:19:36 +01:00
emanuele-f
ec15089208
Little enhancements
2020-02-06 18:22:00 +01:00
Philippe Antoine
af661bd652
Adds oss-fuzz badge to REAMDE
2020-02-06 10:56:33 +01:00
Luca Deri
4613515635
Category matching fix
2020-02-05 08:37:24 +01:00
Luca Deri
2009361b89
Fix for IPv6 address format across the various platforms/distributions
2020-02-04 22:51:07 +01:00
Luca Deri
f027ab1ae7
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-02-04 22:50:37 +01:00
Luca Deri
fa26c62b0c
Fix for IPv6 address format across the various platforms/distributions
2020-02-04 22:50:08 +01:00
Luca Deri
0faba29351
Result update
2020-02-04 22:38:56 +01:00
Luca Deri
2701cc9491
Warnign fix
2020-02-04 22:34:08 +01:00
Luca Deri
88fc9232ff
Code improvements
2020-02-04 22:31:02 +01:00
Luca Deri
0703ab5ac5
Improved DNS response decoding
...
The first decoded address is now reported by ndpiReader
2020-02-04 22:16:54 +01:00
Philippe Antoine
418ea234ae
Adds missing checks
...
Found by fuzzing
2020-02-03 22:38:31 +01:00
Luca
3e99b73635
Updte WebattackRCE.pcap.out with libpcre disabled
2020-02-02 22:15:55 +01:00
Luca
6dbe81588f
Added --with-pcre to enable libpcre usage
2020-02-02 22:07:21 +01:00
Luca
2b6a639192
Libfuzz fixes
2020-02-02 21:54:36 +01:00
Luca
9e87645022
PCRE fixes
2020-02-02 19:54:31 +01:00
Luca
626fcf1418
Added missing additiona libs
2020-02-02 17:01:07 +01:00
Luca Deri
5b11c2ffc5
Merge pull request #836 from MrTiz9/dev
...
nDPI now detects RCE injections in HTTP requests
2020-02-02 16:19:26 +01:00
Luca Deri
8486eb08ea
Merge pull request #835 from catenacyber/fuzzfix
...
Fuzz fixes
2020-02-02 16:17:03 +01:00
MrTiz9
ce4f4fbe2f
Added missing pcap.out for RCE detections
2020-02-01 17:23:22 +01:00
MrTiz9
3422574c17
FIXED - nDPI now detect RCE injections via PCRE instead Intel Hyperscan
2020-02-01 17:18:35 +01:00
MrTiz9
b3138d5e3e
Merge branch 'dev' of https://github.com/ntop/nDPI into dev-unstable
2020-02-01 13:47:42 +01:00
Philippe Antoine
0bf2ca56a8
Uses ip_size in get_ndpi_flow_info6
2020-01-31 15:37:36 +01:00
Philippe Antoine
b97360d931
Fix infinite loop in ndpi_workflow_process_packet
2020-01-31 15:26:34 +01:00
Philippe Antoine
579dd7dff9
Fix memcached read overflow
2020-01-31 15:21:03 +01:00
Philippe Antoine
ff89a14b49
Modifies fuzz target to fix leaks
2020-01-31 15:13:35 +01:00
Philippe Antoine
b5b2260f2e
Fix undefined shift in dns
2020-01-31 14:50:18 +01:00
lucaderi
39b1ad3087
PCRE fix
2020-01-31 07:09:54 +01:00
Luca Deri
c68ea3067b
Added libpcre lib if present
2020-01-30 22:24:24 +01:00
Alfredo Cardigliano
4e538b1e4d
Disabeld community id debug
2020-01-30 15:20:52 +01:00
MrTiz9
5c8c2d843a
nDPI now detect RCE injections via PCRE instead Intel Hyperscan - BUGGY, DOES NOT COMPILE
2020-01-30 15:08:26 +01:00
MrTiz9
ea957687e1
Merge branch 'dev' of https://github.com/ntop/nDPI into dev-unstable
2020-01-30 14:57:58 +01:00
Luca Deri
c84ed5a712
Added check for libpcre presence
2020-01-29 00:41:35 +01:00
Alfredo Cardigliano
ab2a011cf9
Community ID hash fixes
2020-01-25 16:04:00 +01:00
Luca Deri
d86d632fe6
Added memory boundary check in HTTP dissector
2020-01-24 21:04:27 +01:00
Luca Deri
87d228f78e
Fixed heap-buffer-overflow in citrix decoder
2020-01-24 19:50:38 +01:00
Luca Deri
a7a4bf32d3
Merge pull request #833 from catenacyber/travisfuzz2
...
Fix sanitizers build on Travis
2020-01-24 19:38:18 +01:00
Alfredo Cardigliano
e20c4acbde
Implement ndpi_flowv6_flow_hash ndpi_flowv4_flow_hash. Add ndpi_base64_encode.
2020-01-24 18:36:38 +01:00
MrTiz9
daf15e70bf
Added missing pcap.out for RCE detections
2020-01-24 17:16:18 +01:00
MrTiz9
daa1171593
nDPI now detect RCE in HTTP GET requests
2020-01-24 17:16:18 +01:00
Philippe Antoine
dc5fecfc92
Use MSAN_SYMBOLIZER_PATH now that it works
2020-01-24 10:15:16 +01:00
Philippe Antoine
79e1ec9f50
Complete absolute path for symbolizer
2020-01-24 10:03:23 +01:00
Philippe Antoine
902a1c7b4c
Trying with ASAN_SYMBOLIZER_PATH
2020-01-24 09:53:06 +01:00
Philippe Antoine
5b88867084
Looking for symbolizer
2020-01-24 09:46:53 +01:00
Philippe Antoine
4749e61bdb
Debug symbols in LDFLAGS
2020-01-24 09:23:56 +01:00
Philippe Antoine
4f230943cf
Debug compilation flag for fuzz targets
...
And adding include file to fuzz_ndpi_reader
2020-01-24 09:10:52 +01:00
Philippe Antoine
6186e1ab01
Only one env
2020-01-24 08:40:05 +01:00
Philippe Antoine
9fe8bf018a
Use clang++7 for fuzz targets in Travis
2020-01-24 08:24:18 +01:00
Philippe Antoine
e082134a0d
Fix sanitizers build on Travis
2020-01-24 08:14:44 +01:00
Luca Deri
cedbf3b636
Merge pull request #832 from catenacyber/travisfuzz
...
Adds fuzz targets build and run to travis
2020-01-23 18:36:40 +01:00
Luca Deri
5f6fd8d2a5
Merge pull request #831 from catenacyber/fuzzcorpus
...
Generates automatically corpus for fuzz target
2020-01-23 18:35:48 +01:00
Philippe Antoine
cbb755666e
Typo fix
2020-01-23 09:09:21 +01:00
Philippe Antoine
1d024ece7a
Adds fuzz targets build and run to travis
...
Build comes with the different sanitizers
2020-01-22 16:36:12 +01:00
Philippe Antoine
77db14fd7a
Generates automatically corpus for fuzz target
2020-01-22 16:12:50 +01:00
Luca Deri
5a40f9b7fd
Minor fixes
2020-01-21 20:52:42 +01:00
Luca Deri
931f51bd77
ndpi_load_categories_file() now returns the number of loaded hosts or -1 in case of error
2020-01-20 23:37:09 +01:00
Luca Deri
283588a37b
Crash fix when not using CSV output
2020-01-19 20:50:23 +01:00
Luca
812505b56b
Added sanity check
2020-01-15 20:49:21 -07:00
Luca Deri
98d9f524f9
Merge pull request #830 from catenacyber/fuzzpcap
...
Adds another fuzz target
2020-01-14 16:37:55 -08:00
Luca Deri
0023a96f80
Merge pull request #828 from vitalivanov/pull_764
...
example: fix compilation of ndpireader on latest dpdk.
2020-01-14 16:37:28 -08:00
Luca Deri
9f7b1c84f2
Merge pull request #829 from vitalivanov/pull_warning_vit
...
example: fix build warning.
2020-01-14 16:36:51 -08:00
Alfredo Cardigliano
e1047b324b
Fix misleading error message
2020-01-14 10:57:05 +01:00
Philippe Antoine
10738a0ca3
New fuzz target : fuzz_ndpi_reader
2020-01-14 08:20:15 +01:00
Philippe Antoine
fe312ffbe1
Compile libndpireader
2020-01-14 08:20:15 +01:00
Vitaliy Ivanov
24f2cd6fc1
example: fix build warning.
...
ndpiReader.c:24:0: warning: "_GNU_SOURCE" redefined
#define _GNU_SOURCE
<command-line>:0:0: note: this is the location of the previous definition
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2020-01-13 16:15:58 +02:00
Vitaliy Ivanov
cbabbd5865
example: fix compilation of ndpireader on latest dpdk.
...
reader_util.c:1708:43: error: 'ETHER_MAX_LEN' undeclared here (not in a function)
.rxmode = { .max_rx_pkt_len = ETHER_MAX_LEN }
^~~~~~~~~~~~~
DPDK before 19.08 had a macro ETHER_MAX_LEN, in later versions it was
changed to RTE_ETHER_MAX_LEN.
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2020-01-13 16:10:09 +02:00
Luca Deri
da5208ee68
Updated results with the new output
2020-01-10 23:21:11 +01:00
Luca Deri
bccf1c433a
Added missing flow extra info export in flows
2020-01-10 23:15:54 +01:00
Luca Deri
cc7593fe5a
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-01-10 22:21:42 +01:00
Luca Deri
5571ce114d
Added flow extra info field
...
Updated tests/results
2020-01-10 22:21:16 +01:00
Luca
4dd887e516
Added further TLS checks
2020-01-10 18:18:07 +01:00
Luca Deri
a3e06da2a8
Minor cleanup
2020-01-10 12:46:53 +01:00
Luca Deri
dc21079851
Fix for invalid TLS leght
2020-01-09 18:51:03 +01:00
Luca Deri
5987ec6014
Added check for preventing TLS misbehavior
2020-01-09 17:14:37 +01:00
Luca
757b0c602f
Fix for avoiding misdetection in TLS
2020-01-09 10:30:14 +01:00
Luca Deri
498b346219
Added bootstrap ethereum nodes
2020-01-08 22:44:30 +01:00
Luca Deri
3e66bbc5bc
Tool for listing the current bitcoin IPv4 nodes
2020-01-08 22:14:34 +01:00
Luca Deri
3ba7667887
Various ethereum improvements
2020-01-08 22:01:45 +01:00
Luca Deri
fd943d6000
Code hardening
2020-01-08 17:13:24 +01:00
Luca Deri
691778df33
Cosmetic fixes
2020-01-06 22:25:20 +01:00
Luca Deri
81c3f5813c
Added check to avoid double allocations with retransmitted packets
2020-01-06 21:27:51 +01:00
Luca Deri
fdf402d027
Added missing RPM files
2020-01-06 18:20:52 +01:00
Luca Deri
f0014a5a24
Removed TLS debug code that could have caused crashes
2020-01-05 21:28:35 +01:00
Luca Deri
53a5be3399
Added packet boundary checks
2020-01-05 20:58:16 +01:00
Luca Deri
f389969c0b
Use share instead of sbin for sample files
...
Fixes #826
2020-01-05 18:50:56 +01:00
Luca Deri
dc02afa3ea
Merge pull request #825 from aouinizied/fix_python_bindings
...
Update Python cffi bindings.
2020-01-05 18:47:43 +01:00
Luca Deri
d1fb41a161
Minor cleanup
2020-01-05 18:42:36 +01:00
Luca Deri
ef16591f3f
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-01-05 18:25:44 +01:00
Luca Deri
29dd45838d
Updated (C)
2020-01-05 18:24:58 +01:00
emanuele-f
798bb6e2e1
Fix leaks and sha1 certificate detection
2020-01-02 14:39:51 +01:00
emanuele-f
2332cbfefe
Fix invalid free on non-tls flows
2020-01-02 14:10:21 +01:00
emanuele-f
a58a135758
Add fingerprint_set flag
2020-01-02 12:56:25 +01:00
Luca
634457615c
Updated TLS support
2020-01-02 10:47:23 +01:00
Luca
cb825766ea
Minor changes
2020-01-02 10:37:53 +01:00
Luca
8b01056b21
Renamed TLS requested server name
2020-01-02 07:37:03 +01:00
Luca
f6c7a33177
Added TLS test
2020-01-01 21:27:18 +01:00
Luca
daae1cc9b1
Reworked TLS dissection
2020-01-01 12:59:19 +01:00
Luca Deri
499c80535b
Minor fix
2019-12-29 22:27:48 +01:00
Luca
9fb3a57a71
Kerberos fixes
...
Minor TLS cleanup
2019-12-29 10:45:42 +01:00
Luca
257ec7cc5f
Removed disable_metadata_export preference that is no longer useful
...
since ndpi_process_extra_packet() can drive limited or full metadata export
2019-12-29 08:07:35 +01:00
emanuele-f
73c7ccdb65
Fix crash in ndpi_fill_ip_protocol_category when both saddr and daddr are 0
...
In this corner case, the "prefix" variable was not initialized leading to a failed assertion and crash:
ndpi_patricia_search_best2: Assertion `prefix->bitlen <= patricia->maxbits' failed.
2019-12-23 15:20:09 +01:00
Zied Aouini
cffb11fbc9
Update ndpi_flow_struct definition.
2019-12-23 11:22:23 +01:00
Luca Deri
23421b47d9
Added snprintf() return code check
2019-12-18 19:49:46 +01:00
Luca Deri
1cab9fe838
Fix for custom protocol detection
2019-12-18 19:35:40 +01:00
Luca Deri
27ea04c08e
Merge pull request #824 from catenacyber/stunfix
...
Fix read buffer overflow in stun
2019-12-18 19:29:23 +01:00
Luca Deri
5c225b8a2e
Merge pull request #821 from aouinizied/win32-lib-appveyor
...
Win32 lib appveyor
2019-12-18 19:22:12 +01:00
Luca Deri
4961241c62
Merge pull request #823 from haroflow/dev
...
Changed 13.64.0.0/11 range from Skype to Microsoft
2019-12-18 19:18:28 +01:00
Philippe Antoine
843204299c
Fix read buffer overflow in stun
2019-12-18 13:48:33 +01:00
Simone Mainardi
09cd95d54a
Fixes informative subprotocols
...
Wrongly marked subprotocols were causing issues on ntopng.
This fixes https://github.com/ntop/ntopng/issues/3129
2019-12-17 18:12:15 +01:00
Renan de Souza
1d3bef41a4
Added *whatsapp-*.fbcdn.net IPs as WhatsApp
2019-12-16 15:32:46 -03:00
Luca Deri
e21fe5d594
Added intrusion_detection.c in DPDK makefile
2019-12-16 17:56:08 +01:00
Renan de Souza
9133955219
Changed 13.64.0.0/11 range from Skype to Microsoft, blocking this range also blocks some azure-hosted websites
2019-12-16 10:50:19 -03:00
Zied Aouini
acb74905a5
Switch to dev branch.
2019-12-16 01:36:02 +01:00
Zied Aouini
ed3fff554a
Add Appveyor build status.
2019-12-16 01:34:42 +01:00
Zied Aouini
7ebe6a0c82
Add LDFLAGS for Win32.
2019-12-16 01:24:42 +01:00
Zied Aouini
87333aa68c
Add branch.
2019-12-16 01:19:37 +01:00
Zied Aouini
e593319ba0
Fix Win32.
2019-12-16 01:14:10 +01:00
Zied Aouini
812a3e7099
Add mingw host target
2019-12-16 01:11:55 +01:00
Zied Aouini
1097f5488d
Add .appveyor.yml
2019-12-16 01:10:26 +01:00
Zied Aouini
b90410e335
Add .gitattributes
2019-12-16 01:09:09 +01:00
Luca Deri
deed27cbef
Implemented nDPI timeline visualizer
2019-12-15 23:35:43 +01:00
Luca Deri
ea001b439a
TLS decoding improvements
2019-12-14 16:17:34 +01:00
Luca Deri
14e5adc7c2
Win fixes
2019-12-14 15:05:47 +01:00
Luca Deri
81012b3201
CSV output enhancements
2019-12-13 12:50:52 +01:00
Luca Deri
406aa12468
Fixed CSV output
2019-12-13 09:45:34 +01:00
Luca
2c2bb11c9b
Fixed output format
2019-12-11 11:27:00 +01:00
Luca Deri
1bd63d68a5
CSV export improvements
2019-12-11 09:45:14 +01:00
Luca Deri
bf5e9b7b0b
Fixed bug that prevented SMTP email to be dissected
2019-12-09 19:04:13 +01:00
Luca Deri
7fe9dddf65
Fixed invalid password report on telnet
2019-12-09 18:43:05 +01:00
Luca Deri
6d7f3976f3
Code cleanup
2019-12-09 18:02:48 +01:00
Luca Deri
65d526d8f6
Code cleanup
2019-12-09 15:28:44 +01:00
Luca Deri
56eeb965bf
Code cleanup
2019-12-09 13:10:21 +01:00
Luca Deri
c4d476cc58
Code improvements
2019-12-09 00:29:02 +01:00
Luca Deri
23b0b8625d
Minor changes to the IDS score calculation
2019-12-09 00:11:32 +01:00
Luca Deri
558983c99c
Merge pull request #813 from SimoneRicci97/dev
...
Fixed intrusion detection
2019-12-09 00:01:09 +01:00
Luca Deri
c8d6f2845f
Improved memory management in the kerberos dissector
2019-12-08 23:59:53 +01:00
Luca Deri
1a115cac5a
Merge pull request #817 from MrTiz9/dev
...
Integration of the libinjection library
2019-12-08 23:49:23 +01:00
Luca Deri
11401edfe7
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-12-08 23:47:25 +01:00
Luca Deri
239842b821
Major kerberos rework
2019-12-08 23:47:04 +01:00
MrTiz9
606ff10ecf
Integration of the libinjection library to detect SQL injections and XSS type attacks in HTTP requests
2019-12-05 18:09:43 +01:00
emanuele-f
d37b69ce9c
Fix corner case causing access to already freed memory
2019-12-04 18:36:54 +01:00
emanuele-f
226a9abf22
Additional memory bounds checks
2019-12-04 18:34:08 +01:00
emanuele-f
f26096ee4c
Fix reversed offset check
2019-12-04 15:20:49 +01:00
emanuele-f
2b3ef7e762
Fix invalid memory access
2019-12-04 14:21:04 +01:00
emanuele-f
d62526f9ed
Fix invalid reads and add valgrind test
2019-12-04 13:06:05 +01:00
Luca Deri
e66d7216b8
Removed header space with JSON serialization
2019-12-04 10:52:51 +01:00
Luca Deri
fbc59c5f81
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-12-01 22:27:26 +01:00
Luca Deri
32dc9e3225
Refreshed Whatsapp server list
2019-12-01 22:26:57 +01:00
Luca Deri
b4468239b9
Merge pull request #814 from aouinizied/python_cffi_bindings
...
Implement cffi bindings.
2019-12-01 21:56:10 +01:00
Luca Deri
95c1282ef4
Improved categories with streaming
2019-12-01 21:52:28 +01:00
Luca Deri
a7b0457753
Improved category detection with HTTP
2019-12-01 21:40:04 +01:00
Luca Deri
7da7ae622b
Improvements to stop dissection when the first protocol is detected
...
Used IP-based detection to compute the application protocol
Improved application detection
2019-11-28 23:20:40 +01:00
aouinizied
a95cfcc989
Implement cffi bindings.
2019-11-28 03:09:13 +01:00
Simone Ricci
a65c959940
Fixed intrusion detection
2019-11-26 21:20:22 +01:00
Luca Deri
d328c3bccc
Overflow fix
2019-11-26 17:58:49 +01:00
Luca Deri
8368568443
Added buffer overflow check in smpp dissector
2019-11-26 17:45:08 +01:00
Luca Deri
c223bb1f10
Fixed buffer overflow in DNS dissection
2019-11-26 17:42:59 +01:00
Luca Deri
c7efd0892f
Fixed buffer overflow in amazon video dissector
2019-11-26 17:30:36 +01:00
Luca
ae9429408b
Added webattacj results
2019-11-25 18:40:14 +01:00
Luca Deri
0ce56d5714
Updated results
2019-11-23 19:55:06 +01:00
Luca Deri
509cfcb556
Fixed invalid category matching in HTTP
...
Fixed overlapping categories
2019-11-23 19:54:06 +01:00
Luca Deri
3b203d57e9
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-11-23 13:28:15 +01:00
Luca Deri
68d66b780c
Added new test pcaps
...
Renamed protocol 104 to IEC60870 (more meaningful)
2019-11-23 13:27:34 +01:00
Luca Deri
f94d6cca7d
Memory fixes
2019-11-23 12:14:52 +01:00
Luca Deri
382217887b
Nested encapsulation dissection
2019-11-23 11:53:00 +01:00
Luca Deri
537c11a985
Fixes for uninitialized variables
2019-11-23 11:39:23 +01:00
Luca Deri
bdc0719e76
Added auth failed support with FTP
2019-11-21 23:31:52 +01:00
Luca Deri
fc82cdfa4a
Implemented telnet password export
2019-11-21 19:36:01 +01:00
Luca Deri
e98b994a39
Updated results
2019-11-21 13:35:04 +01:00
Luca Deri
a58c838c4c
Added flow duration and goodput in output (-v and -c)
2019-11-21 13:31:56 +01:00
Luca Deri
f91f2c57ef
Fixed skype/soom false positives
2019-11-20 23:28:24 +01:00
emanuele-f
68b7986d9b
Expose API to calculate the MD5 hash
2019-11-20 11:57:21 +01:00
Alfredo Cardigliano
ead0325deb
Rounding up serializer buffer to be divisible by 4 (required by zmq encryption)
2019-11-19 19:03:06 +01:00
emanuele-f
0b819badd2
Possible leak fix
2019-11-19 11:42:04 +01:00
Simone Mainardi
3754e6dd12
Fixes crash when searching kerberos usernames
...
Fixes
(gdb) f 0
101 if(cname_str[cname_len-1] == '$') {
(gdb) p cname_len
$3 = 0
2019-11-19 11:34:34 +01:00
Luca Deri
da029607a0
Removed (unreliable) line protocol detection
2019-11-18 21:21:52 +01:00
Luca Deri
803dc6ff77
Minor fix
2019-11-17 22:42:32 +01:00
Luca Deri
65a629304c
Kerberos dissection improvements
2019-11-17 22:35:10 +01:00
Luca Deri
51cfdfb0d8
Removed unused JSON-C code
2019-11-17 17:51:45 +01:00
Luca Deri
53108c9ff1
Merge pull request #811 from aouinizied/python_bindings_fix
...
Python bindings fix and improve
2019-11-15 19:51:15 +01:00
aouinizied
82a186e096
Polish.
2019-11-15 19:30:50 +01:00
aouinizied
e467fe9aa6
Improve python bindings.
2019-11-15 19:18:30 +01:00
Luca Deri
7a1940e1f7
Modified Diameter category to network
...
Updated test results
2019-11-14 15:13:13 +01:00
Alfredo Cardigliano
6b7c56c909
New ndpi_serialize_string_boolean/ndpi_serialize_uint32_boolean
2019-11-13 18:16:44 +01:00
Luca
470d30ac23
Fixed SQL Injection detection
2019-11-13 17:37:48 +01:00
Luca
7e87bfd039
Added support of default /32 in ndpi_load_ipv4_ptree()
2019-11-12 16:37:18 +01:00
Luca Deri
ab9ccf9eb9
Fixed new nDPi API
2019-11-12 12:28:34 +01:00
Luca Deri
15ec013af8
Added ndpi_load_ipv4_ptree() API call
2019-11-11 23:52:24 +01:00
emanuele-f
748f10c0d6
Fix possible crash due to unsigned int number wrapping
2019-11-11 10:18:55 +01:00
Luca Deri
8181d63a95
Added ndpi_init_detection_module() API preferences
2019-11-10 22:57:21 +01:00
Luca
d0e7e69552
Renamed DNSoverHTTPS to handle bot DoH and DoT
2019-11-08 09:23:52 +00:00
Luca
0558d641f2
Added ndpi_finalize_initalization() initialization function
2019-11-07 19:28:16 +00:00
Alfredo Cardigliano
ac46a4dd58
Added L2TP tunnel type. Warning fix.
2019-11-06 09:55:22 +01:00
Luca
fb56b042c0
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-11-05 12:15:27 +00:00
Luca
6298ecc271
Added tunnelling decapsulation
2019-11-05 08:21:31 +00:00
Luca Deri
a26fe08aa6
Updated results
2019-11-04 22:11:33 +01:00
Luca Deri
5b2c0f68fe
Telnet fix
2019-11-04 22:06:02 +01:00
Luca Deri
e695dd6ead
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-11-03 17:15:48 +01:00
Luca Deri
953571e3d8
Added comment
2019-11-03 17:15:40 +01:00
Luca Deri
01455c3188
Merge pull request #808 from oleg-umnik/dev
...
Change type
2019-11-03 17:15:06 +01:00
Luca Deri
a5210af823
Merge pull request #807 from oleg-umnik/fix_3
...
Align CSV header with actual row data
2019-11-03 17:14:38 +01:00
Luca Deri
9e42b525ec
Merge pull request #806 from oleg-umnik/fix_1
...
Don't leak memory in live capture mode
2019-11-03 17:13:49 +01:00
Luca Deri
02d69b72f5
Merge pull request #803 from haroflow/dev
...
Updated Breed's descriptions in ndpi_get_proto_breed_name
2019-11-03 17:13:18 +01:00
Luca Deri
c998e2e9ef
Merge pull request #802 from AndrewKarelin/dev
...
Added some public DNSoverHTTPS servers
2019-11-03 17:07:17 +01:00
Luca Deri
a3a85106a1
Implemented SQL Injection and XSS attack detection
2019-11-01 23:05:11 +01:00
Luca
75302a10bd
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-31 09:31:42 +01:00
Luca
2ab0433aca
Updated content-type parsing
2019-10-31 09:31:26 +01:00
Luca
e272db0f7f
content type parsing fix
2019-10-31 09:15:57 +01:00
Luca Deri
3580765ba3
Updated result
2019-10-31 09:04:52 +01:00
Luca
cb79d89f83
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-31 08:58:03 +01:00
Luca
2e178d0f05
Improved libary initialization for custom protocols
2019-10-31 08:57:33 +01:00
Luca Deri
edf0b171e2
Merge pull request #810 from catenacyber/fuzztarget
...
Adds fuzz target
2019-10-31 08:54:44 +01:00
Philippe Antoine
148506ede8
Adds fuzz target
...
And configur option enable-fuzztargets
2019-10-31 08:37:42 +01:00
Luca
c0a08d9ca2
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-31 00:14:40 +01:00
Luca
4802987178
Initial work towards HTTP content-type export
2019-10-31 00:14:20 +01:00
Luca Deri
1cd7cf9990
Merge pull request #809 from catenacyber/fuzz1fix
...
Fix buffer over read in ndpi_handle_ipv6_extension_headers
2019-10-30 17:31:28 +01:00
Philippe Antoine
4830755fac
Fix buffer over read in ndpi_handle_ipv6_extension_headers
2019-10-30 17:18:21 +01:00
Renan de Souza
124545e1ed
Added twitch.tv website
2019-10-29 16:26:17 -03:00
Luca
af01e61c89
Fixed invalid guess with the top defined protocol
2019-10-29 19:45:15 +01:00
Renan de Souza
9400a3b9ef
Added ranges 20.180.0.0/14, 20.184.0.0/13 to Skype
2019-10-29 15:28:08 -03:00
Luca
6e314ea6d7
Added zabbix dissector
2019-10-29 19:25:46 +01:00
Oleg A. Arkhangelsky
dfd962a8bc
Change type
...
Use double type instead of float when printing time for CSV file.
Float type is too small for 64 bit int time so cast corrupts value.
2019-10-29 21:23:42 +03:00
Oleg A. Arkhangelsky
cfcbfe1e8f
Align CSV header with actual row data
2019-10-29 21:20:56 +03:00
Luca
0e54f87b18
Added telnet dissector
...
Improved data report
2019-10-29 19:12:42 +01:00
Oleg A. Arkhangelsky
9f5e5b90e5
Don't leak memory in live capture mode
2019-10-29 21:11:31 +03:00
Renan de Souza
d619ba0857
Merge remote-tracking branch 'upstream/dev' into dev
2019-10-29 14:59:18 -03:00
Renan de Souza
fbea243e56
Added brasilbandalarga.com.br and .eaqbr.com.br as EAQ on host_match[]
2019-10-29 11:48:23 -03:00
Renan de Souza
d062386656
Added ^pastebin.com to host_match[]
2019-10-29 09:54:42 -03:00
Luca Deri
d2f04f5bdf
Fixed prototype
2019-10-29 10:32:13 +01:00
Luca Deri
42c8d3ac27
Added ability to defien custom protocols
2019-10-29 10:29:12 +01:00
Luca Deri
d53563ab46
Implemented Microsoft range
2019-10-28 00:15:51 +01:00
Luca Deri
3d5f0ee315
Implemented stacked DPI decoding
2019-10-27 23:20:56 +01:00
Luca Deri
ecdb7cdc55
Various improvements in particular for CapWAP and Bloomberg
2019-10-27 23:05:24 +01:00
Luca Deri
fd38b752c4
Added capwap support
2019-10-27 19:03:23 +01:00
Luca Deri
64804a2a24
Fixed some false positivies with skype and stun-based protocols
2019-10-27 12:23:57 +01:00
Luca Deri
b603cb4530
nDPI TLS improvements using the server certificate
2019-10-26 10:54:32 +02:00
Luca Deri
8f2c7c0638
Code cleanup
2019-10-26 08:28:14 +02:00
Luca Deri
044ba7697a
Improved guess
2019-10-25 16:02:44 +02:00
Luca Deri
e6bd64b3ea
Improved HTTP reporting in ndpiReader
2019-10-25 15:56:47 +02:00
Renan de Souza
56db916833
Merge remote-tracking branch 'upstream/dev' into dev
2019-10-25 08:57:49 -03:00
Luca Deri
12cf0c4763
Further SMB improvements
2019-10-25 07:22:29 +02:00
Luca Deri
0a92e0f532
Ficed invalid SMBv1 detection
2019-10-25 07:00:57 +02:00
Luca Deri
e6f9177fdb
SSH dissection improvements
2019-10-25 00:05:18 +02:00
Luca Deri
c3f6a4a57a
SMTP and SSH dissection fixes
2019-10-24 23:28:32 +02:00
Renan de Souza
653c209253
Added 52.84.0.0/14 range as Amazon
2019-10-24 14:50:54 -03:00
Luca Deri
0974075fa0
Major cleanup
...
Removed ndpi_pref_http_dont_dissect_response and ndpi_pref_dns_dont_dissect_response as the ndpi_extra_dissection_possible() call will now handle everything
2019-10-24 19:48:55 +02:00
Renan de Souza
53e1ee3475
Changed Breeds descriptions in ndpi_get_proto_breed_name: Dangerous to Potentially Dangerous, added Dangerous (SMBv1)
2019-10-24 14:43:10 -03:00
Andrew Karelin
46affea055
Added some public DNSoverHTTPS servers
...
List of servers taken from https://github.com/curl/curl/wiki/DNS-over-HTTPS
2019-10-23 18:47:51 +05:00
Luca Deri
0ffe5cf1ff
Added extra processing for POP and SMTP
2019-10-22 00:57:35 +02:00
Luca Deri
d023f9bf2d
Silenced TLS warning
2019-10-21 15:33:20 +02:00
Alfredo Cardigliano
b2832cee8e
rpm-sign fix for centos8
2019-10-21 09:26:40 +02:00
Luca Deri
960aa77b6d
Reworked email metaata extraction
2019-10-21 01:27:07 +02:00
Luca Deri
58daa5ed7d
Added POP3 metadata extraction
2019-10-20 23:06:05 +02:00
Luca Deri
437e8bd706
Implemented IMAP data extraction
2019-10-20 22:46:08 +02:00
Luca Deri
1a5c7daaf6
Implemented FTP user/pwd extraction
2019-10-20 21:49:45 +02:00
Luca Deri
c1ba4764b5
Merge pull request #799 from ntop/ndpi_memleak_fix
...
Fix memory leak in ndpiReader.
2019-10-20 11:47:13 +02:00
Ravi Kerur
7cb3cb7353
Fix memory leak in ndpiReader.
...
Changes in library for strict function prototype.
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-10-19 08:59:48 -07:00
Alfredo Cardigliano
604abaf81c
Disabled debug_package
2019-10-18 12:30:42 +02:00
Luca Deri
8b157bb13f
Ports are not JSON printed when 0 (e.g. with ICMP)
2019-10-17 00:38:42 +02:00
Luca Deri
a8c71dcd20
Improved ndpi_flow2json
2019-10-17 00:29:30 +02:00
Alfredo Cardigliano
363a8f6282
Checking gmtime_r return value
2019-10-16 07:54:33 +02:00
Luca Deri
5b314cf1c3
Updated ndpi_flow2json
2019-10-16 12:31:41 +02:00
Luca Deri
02783bd7c6
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-15 23:06:41 +02:00
Luca Deri
d5c918d258
Initial implementation of ndpi_flow2json APi call
2019-10-15 23:06:30 +02:00
emanuele-f
6b044335cd
Implement nDPI patricia tree API
2019-10-15 01:22:17 +02:00
Luca Deri
cbe20d3740
Fixes for API changes
2019-10-09 22:25:40 +02:00
Luca Deri
21bc84e837
Modified API signatures for
...
- ndpi_ssl_version2str()
- ndpi_detection_giveup()
2019-10-09 22:09:58 +02:00
Luca Deri
203359ed7f
Fixed ndpi_ssl_version2str()
2019-10-08 23:57:56 +02:00
Luca Deri
24a26a2e94
Added NetBIOS metadata export
2019-10-08 23:40:56 +02:00
Luca Deri
0a7521060a
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-08 13:32:43 +02:00
Luca Deri
6b5a9aa992
Implemented Kerberos metadata extraction
2019-10-08 13:32:21 +02:00
emanuele-f
2dfdaa4d70
Replace strtok with reentrant version
2019-10-08 11:59:20 +02:00
emanuele-f
f2504494fe
New API functions: ndpi_load_categories_file and ndpi_load_category
2019-10-08 11:55:47 +02:00
Luca Deri
256858d2e5
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-08 11:36:11 +02:00
Luca Deri
10873bfe35
Added ndpi_get_l4_proto_name() and ndpi_get_l4_proto_info() API calls to print L4 protocol
2019-10-08 11:35:33 +02:00
emanuele-f
e939f1c1d1
Fix leaks in ndpi_load_hostname_category when ac_automata_add fails
2019-10-08 11:07:59 +02:00
emanuele-f
b2c8cb655c
ndpi_load_hostname_category now performs strdup on the name argument
...
This simplifies the API as an application is not required to keep references to the strings to free
2019-10-08 10:23:00 +02:00
emanuele-f
4bdbf02c2d
Fix invalid memory accesses
2019-10-04 14:35:51 +02:00
Luca Deri
f83b2a0940
Fixed ndpi_extra_dissection_possible()
2019-10-04 14:13:53 +02:00
emanuele-f
76ec74cbf1
Fix out of bounds read in ndpi_match_custom_category
2019-10-04 11:54:05 +02:00
Luca Deri
8ae5da1472
Moved to 3.1 release
2019-10-04 07:45:57 +00:00
Luca Deri
d8067cdc1d
Extended changelog for v3
2019-10-04 09:42:43 +02:00
Luca Deri
67dbcb7375
Fixed invalid network searchthat caused categories to be set randomly
2019-10-04 07:19:20 +00:00
Luca Deri
3180f279c8
Merge pull request #792 from ntop/ndpi_streaming
...
Move Hulu and Disney+ to category match.
2019-10-03 22:35:31 +02:00
Simone Mainardi
1982e6cef9
Adds nDPI 3.0 changelog
2019-10-03 20:04:26 +02:00
emanuele-f
d2f0a8d493
Add missing results
2019-10-03 16:26:14 +02:00
emanuele-f
37cb113c45
Handle TCP DNS replies and add is_reply flag
2019-10-03 16:19:15 +02:00
emanuele-f
04a97fa72b
Fix DNS reply dissection issues
2019-10-03 15:52:55 +02:00
Ravi Kerur
8897aa6acb
Move Hulu and Disney+ to category match.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-10-02 20:03:18 -07:00
Luca Deri
c247a9d191
Code cleanup
2019-10-02 23:25:05 +02:00
Luca Deri
4fd7e5734a
Manual merge of pull #769
2019-10-02 23:01:29 +02:00
Luca Deri
3dbf7bbabb
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-02 20:58:02 +02:00
Luca Deri
8f20e482ce
Improved Viber protocol dissection
...
Added Hulu dissection
2019-10-02 20:57:17 +02:00
Luca Deri
329a33ed59
Merge pull request #791 from ntop/ndpi_hs
...
Fix crash due to recent code changes when using hyperscan and mining_…
2019-10-02 20:50:19 +02:00
Ravi Kerur
77edf1f680
Fix crash due to recent code changes when using hyperscan and mining_hosts.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-10-02 09:32:39 -07:00
emanuele-f
7f510c10fe
Fix double free after b19bfa1e20
2019-10-02 16:26:52 +02:00
Luca Deri
a559ba20b1
Merge pull request #790 from emanuele-f/managed_strings
...
Fixes leaks in ndpi_add_host_url_subprotocol
2019-10-02 15:30:33 +02:00
emanuele-f
b19bfa1e20
Fixes leaks in ndpi_add_host_url_subprotocol
...
It is now possible to deallocate strings in ac_automata_release via
an additional parameter
2019-10-02 14:02:19 +02:00
Luca Deri
6a22bee2ca
Added URL in results
2019-10-01 12:26:15 +02:00
Luca Deri
e45237a93f
Removed http:// from HTTP url
...
Reported URL in ndpiReader
2019-10-01 12:25:39 +02:00
Luca Deri
a62cf10233
Added SSH handling in ndpi_extra_dissection_possible()
2019-09-30 23:23:52 +02:00
Luca Deri
1361c8fbdf
Updated the logic of ndpi_is_subprotocol_informative()
2019-09-30 17:28:41 +02:00
Luca Deri
f2a5bbef17
Reworked categories handling
...
Removed GenericProtocol and replaced with categories
Removed ndpi_pref_enable_category_substring_match option: substring matching is now default
2019-09-29 21:46:41 +02:00
Luca Deri
016d568c2b
Merge pull request #787 from bohmax/explanation-file
...
Adding explanation file
2019-09-29 18:32:46 +02:00
bohmax
02609114d3
Add files via upload
2019-09-29 11:10:46 +02:00
Luca Deri
53ea3481ea
Fixed ICMP parsing bug introduced by pull #770
2019-09-29 08:10:12 +02:00
Luca Deri
59b8399923
Merge pull request #778 from choyos/dev
...
Added support for dissection of DNP3 and IEC104 protocols
2019-09-29 08:02:49 +02:00
Luca Deri
3b06d2191c
Merge pull request #770 from ntop/ndpi_icmp
...
Add icmp and icmp6 to calculate splt and bd values.
2019-09-29 07:59:02 +02:00
Luca Deri
e9df2b187c
Merge pull request #786 from ntop/ndpi_ac_vpn
...
Add Cisco anyconnect VPN signature.
2019-09-29 07:58:27 +02:00
Ravi Kerur
bc1b266174
Add Cisco anyconnect VPN signature.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-28 19:52:53 -07:00
Luca Deri
b0c68dc29b
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-09-27 17:35:08 +02:00
Luca Deri
c839dcb74c
Improved category handlign in subprotocols
...
Further DNS dissection fixes
Fixed WeChat invalid category
2019-09-27 17:34:22 +02:00
emanuele-f
05aa27e477
Add test for custom categories match on HTTP and SSL flows
2019-09-27 14:01:12 +02:00
Luca Deri
7c788f0779
Fixed partial string matches
2019-09-27 13:42:41 +02:00
emanuele-f
5099646938
Fix missing strdup on ndpi_load_hostname_category
2019-09-27 12:09:51 +02:00
emanuele-f
277b4a060a
Add categories test PCAP
2019-09-27 10:15:20 +02:00
Luca Deri
17f560a1cd
Added ndpi_extra_dissection_possible() API call
2019-09-26 23:50:02 +02:00
Luca Deri
194cdcf581
Fixed false positive with STUN detection
2019-09-26 22:18:56 +02:00
Luca Deri
7de9fd7170
Updated instagram check
2019-09-26 22:08:21 +02:00
Luca Deri
0e9918464b
Added Zoom protocol support removing invalid STUN/Skype detections
2019-09-26 21:52:42 +02:00
Luca Deri
ce40155377
Merge pull request #783 from ntop/ndpi_ps_vue
...
Ndpi ps vue
2019-09-26 19:37:49 +02:00
emanuele-f
4dc60f151d
Restructure DNS search code
2019-09-26 13:20:13 +02:00
emanuele-f
937dcb38ea
Fix bad protocols returned in ndpi_detection_giveup when detection is already complete
2019-09-26 12:15:49 +02:00
Ravi Kerur
4170eb3a1d
Modified logic and test pcap file included.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-25 16:21:22 -07:00
Ravi Kerur
c3a5650071
Initial PS_VUE support based on public IP.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-25 15:20:19 -07:00
Luca Deri
62fa0908a3
Improved packet datastructure cleanup after packet processing
...
Cleaned up code of steam dissector
Added steam test pcap
2019-09-25 23:59:22 +02:00
Ravi Kerur
d2c0b9872d
Initial Zoom detection based on IP and ports.
...
Following IP and ports are reported by Zoom support
to open up in firewall.
https://support.zoom.us/hc/en-us/articles/201362683-Network-Firewall-or-Proxy-Server-Settings-for-Zoom
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-25 12:59:34 -07:00
Alfredo Cardigliano
3709e673d9
New serializer APIs ndpi_serialize_start_of_block / ndpi_serialize_end_of_block (JSON only)
2019-09-25 17:19:33 +02:00
Luca Deri
0b62c0ad45
Merge pull request #781 from marco-testa/dev
...
Update dissector stun.c
2019-09-24 16:39:46 +02:00
Luca
0ed679e795
Improves IAT calculation
2019-09-24 16:37:42 +02:00
marco-testa
b706730e10
Loaded in the wrong place
2019-09-24 09:45:34 +02:00
marco-testa
bd83847027
Changed the packets handling with STUN msg_type > 0x000C and other fixes.
...
Eliminated double call to the ndpi_int_stun_add_connection function.
2019-09-24 09:43:47 +02:00
marco-testa
d3348ff730
Changed the packets handling with STUN msg_type > 0x000C and other fixes.
...
Eliminated double call to the ndpi_int_stun_add_connection function.
2019-09-24 09:41:58 +02:00
Ravi Kerur
e29032085d
Merge branch 'dev' of https://github.com/ntop/nDPI into ndpi_icmp
2019-09-23 17:06:43 -07:00
Luca Deri
19dbcaa3a9
Fixes #777
2019-09-23 18:04:55 +02:00
Luca Deri
3f56b2476a
Merge pull request #780 from bohmax/fix_wrap
...
Fix wrap
2019-09-23 17:48:02 +02:00
bohmax
8246467022
Add files via upload
2019-09-23 17:40:34 +02:00
bohmax
90c28e9d63
Delete ndpi_typestruct.py
2019-09-23 17:40:16 +02:00
Luca Deri
64513b1c0e
Rewritten qq dissector
2019-09-23 17:39:58 +02:00
Ravi Kerur
e8d501158e
Restore protocol extraction to original method.
...
Add microseconds to time series if milliseconds returns 0.
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-21 10:38:04 -07:00
Ravi Kerur
d92015a092
Merge branch 'dev' of https://github.com/ntop/nDPI into ndpi_icmp
2019-09-21 10:16:10 -07:00
Luca Deri
5c2e495792
ndpiReader now report protocol category and breed
...
Modified TikTok category to Fun
2019-09-21 09:52:44 +02:00
Luca Deri
421f819b8a
Added signal test pcap
2019-09-21 09:40:20 +02:00
Luca Deri
ab9246f51f
Adedd DTLS check in STUN
...
Uodated (C)
2019-09-21 09:16:56 +02:00
Ravi Kerur
e2e05cd499
Merge branch 'dev' of https://github.com/ntop/nDPI into ndpi_icmp
2019-09-20 10:54:58 -07:00
Luca
bdcc6dc173
STUN protocol dissector code cleanup
2019-09-20 18:47:39 +02:00
Luca
f9716c5139
Unified WhatsApp Video and Audio under WhatsAppCall
2019-09-20 17:37:41 +02:00
choyos
bae36d2e25
added dnp3 and iec104 pcaps for tests
2019-09-20 13:35:46 +02:00
choyos
cbda4c2af1
Added support for industrial protocols DNP3, IEC 60780-5-104
2019-09-20 13:29:49 +02:00
Luca
f678486393
Improved STUN-based protocol heuristic both in terms of accuracy and packets necessary for the detection
2019-09-20 07:29:02 +02:00
emanuele-f
518df786ed
Add ndpi_parse_ip_string and ndpi_get_ip_string API
2019-09-19 16:08:47 +02:00
Luca Deri
16da3f58cc
Fixed JA3C compuration wtih SSL (no TLS) traffic
2019-09-19 00:01:44 +02:00
Luca Deri
cf0ca7db51
Improved STUN caching
2019-09-18 23:31:25 +02:00
Luca Deri
0d8a161d15
Further line update
2019-09-18 23:24:41 +02:00
Luca Deri
487110693c
Line protocol update
2019-09-18 23:23:13 +02:00
Luca Deri
3287dfbff4
Added dissection of TLS version in supported_versions of Hello packets
2019-09-18 14:20:01 +02:00
Luca Deri
ac1f7d71dd
New instagram testing set
2019-09-18 12:23:55 +02:00
Luca Deri
a716d5a317
Improved Line protocol heuristic
2019-09-18 12:14:23 +02:00
Ravi Kerur
7e3fd16b0d
Merge branch 'dev' of https://github.com/ntop/nDPI into ndpi_icmp
2019-09-17 17:01:17 -07:00
emanuele-f
e152e687a5
Fix notBefore/notAfter broken in previous commit
2019-09-17 18:43:11 +02:00
emanuele-f
10e560a508
Fix notBefore/notAfter issues
2019-09-17 18:09:17 +02:00
Luca Deri
2fc68a441d
Improved -C output
2019-09-17 12:07:00 +02:00
Luca Deri
64ed0ac6b3
Various STUN improvements
2019-09-17 00:11:17 +02:00
Ravi Kerur
ce79626679
Merge branch 'dev' of https://github.com/ntop/nDPI into ndpi_icmp
2019-09-16 13:56:17 -07:00
Luca Deri
8f4e8d8254
Code cleanup
2019-09-15 22:56:55 +02:00
Luca Deri
62c9766cc1
Warnign fix
2019-09-15 22:43:43 +02:00
Luca Deri
f0013e826e
Added python bindings for nDPI
2019-09-15 22:32:18 +02:00
Luca Deri
5fd79567f0
Merge pull request #767 from LocutusOfBorg/fix-cross-ftbfs
...
Fix cross-build from source, because of direct pkg-config check calls
2019-09-15 20:57:13 +02:00
Luca Deri
11e9fd8cef
As TLS certificate fingerprint is computed, TLS without certificate protocol has been removed
...
Various improvemenets in detection quality
2019-09-15 12:18:24 +02:00
Luca Deri
2b0945b88d
TLS disection improvements
2019-09-15 10:56:08 +02:00
Ravi Kerur
23780a655d
Fix protocol for v4 and v6.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-14 18:38:18 -07:00
Ravi Kerur
9f83bf4624
Add icmp and icmp6 to calculate splt and bd values.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-14 10:06:37 -07:00
Luca Deri
00e639d513
TLS certificate hash is not reported
2019-09-14 15:00:52 +02:00
Luca Deri
659f75138c
TLS cerficate hash calculation
2019-09-14 12:38:58 +02:00
Alfredo Cardigliano
d7c2ced475
Fix ndpi_serializer_rollback_snapshot with single records
2019-09-11 20:04:32 +02:00
Helmut Grohne
2e01a1fe53
Fix cross-build from source, because of direct pkg-config check calls
...
ndpi fails to cross build from source, because configure.seed hard codes
the build architecture pkg-config. It is best to use PKG_CHECK_MODULES
instead. Please consider applying the attached patch.
See: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=939286
2019-09-11 19:11:42 +02:00
Luca Deri
e687a73cb2
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-09-11 17:14:52 +02:00
Luca Deri
6966e0d19b
Added STUN check to avoid false positives
...
Added fingerprint comments in SSH/TLS
Added netflow test pcap
2019-09-11 17:13:49 +02:00
Alfredo Cardigliano
7d9ed162c7
Optimized memory utlization resizing serialization buffer buffer
2019-09-11 16:32:40 +02:00
Alfredo Cardigliano
848c9db4fb
Added ndpi_init_serializer_ll() to specify low-level settings for optimizing memory allocations
2019-09-11 16:10:18 +02:00
Alfredo Cardigliano
16fe2574b1
Fix ndpi_serializer_rollback_snapshot with JSON
2019-09-11 11:32:11 +02:00
Luca Deri
c3c975a51a
Renamed snapshot API call
2019-09-11 09:45:29 +02:00
Alfredo Cardigliano
a265b50a66
Support for nDPI serializer snapshot set/reset
2019-09-10 20:24:36 +02:00
Luca Deri
67a1455619
ndpi_serializer_set_buffer_len() fix
2019-09-10 23:55:00 +02:00
Luca Deri
844e2bab3b
warnng fix
2019-09-10 22:46:37 +02:00
Luca Deri
b1583cc29e
Added ndpi_serializer_set_buffer_len() API call
2019-09-10 22:45:52 +02:00
Luca Deri
0f9107bef3
Fixed timezone conversion
2019-09-10 22:15:23 +02:00
Luca Deri
068611e8ba
Changes in validity format
2019-09-10 21:44:42 +02:00
Luca Deri
1f417fe67d
Validity format fix
2019-09-10 21:44:04 +02:00
Alfredo Cardigliano
8186b72c11
Added ndpi_deserialize_clone_all to the public API
2019-09-10 19:30:52 +02:00
Alfredo Cardigliano
4c0cc80771
New API ndpi_deserialize_clone_all to clone an record from TLV to a different format (e.g. JSON)
2019-09-10 18:57:28 +02:00
Alfredo Cardigliano
9c8c165a2c
Added ndpi_deserialize_clone to the public API
2019-09-10 17:32:13 +02:00
Alfredo Cardigliano
84ce1861a2
New API ndpi_deserialize_clone to clone an element from a deserialized TLV to another TLV
2019-09-10 17:30:15 +02:00
Alfredo Cardigliano
990d06d10c
TLC EOR/Unknown items size
2019-09-10 16:40:29 +02:00
Alfredo Cardigliano
3e1c811780
Added ndpi_deserialize_get_format() to read the serialization format
2019-09-10 15:02:02 +02:00
Alfredo Cardigliano
b96b618443
nDPI serialization: uint key compression, new deserialization API
2019-09-10 14:47:47 +02:00
Luca Deri
65bdd0de9a
Uddated results
2019-09-10 00:43:03 +02:00
Luca Deri
086c511a11
Parsed TLS certificate validity
2019-09-10 00:34:48 +02:00
Luca Deri
c5fffce96c
Added IMO dissector
...
Fixed TLS/UDP detection
Reduced UBNT buffer for saving space
2019-09-09 21:17:53 +02:00
Luca Deri
d457b07f9f
Refreshed Tor node list
2019-09-08 21:42:33 +02:00
Luca
a0a8149833
Skype STUN enhancements
2019-09-06 10:41:53 +02:00
Luca
241cfb319b
Enhanced Signal detection
2019-09-05 10:45:08 +02:00
Luca
9b80c6314d
Enhanced STUN cache
2019-09-05 10:23:07 +02:00
Luca Deri
3d21c33409
Compilation fix when JSON-C is not present
2019-09-03 18:45:51 +02:00
Luca
b3c88a7e24
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-09-03 18:39:36 +02:00
Luca
886d575157
Added -C to generate CSV analysis files
...
Improved IAT and byte distribution
2019-09-03 18:38:54 +02:00
Alfredo Cardigliano
2a8f9c3a81
Return value fix in ndpi_deserialize_*
2019-09-03 11:44:32 +02:00
Alfredo Cardigliano
2cbad47d7b
Added vxlan header
2019-09-03 02:26:40 +02:00
Luca Deri
eb154bac69
Added ndpi_alloc_data_analysis APi call
2019-09-02 22:12:46 +02:00
Alfredo Cardigliano
ab178e62f5
Transparently handle int8/16 deserialization
2019-09-02 17:29:08 +02:00
Luca Deri
bc4c48fa0b
Added packetIDs with -P
2019-09-02 14:47:37 +02:00
Luca Deri
5d5d056849
Added payload memory free
2019-09-02 14:14:13 +02:00
Luca Deri
f1ad951bf6
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-09-02 14:00:45 +02:00
Luca Deri
d0436e7b29
Added new parameter to -P
2019-09-02 14:00:18 +02:00
Alfredo Cardigliano
2616dcb424
TLV signed int compression
2019-09-02 12:33:16 +02:00
Luca Deri
eb6afa17c0
Added ndpi_serialize_string_binary() call
2019-09-02 10:18:54 +02:00
Alfredo Cardigliano
77409a3833
TLV: encoding uint 32/64 as 16/8 bit whenever possible
2019-08-30 11:00:04 +02:00
Alfredo Cardigliano
49a02c9b96
TLV deserialization of uint16/uint8/int16/int8 when deserializing uint32/uint64/int32/int64
2019-08-30 10:31:54 +02:00
emanuele-f
1bf23dc2a8
Fix mangled stack by invalid sscanf
2019-08-29 22:40:29 +02:00
emanuele-f
fce2cd9817
Fix memory corruptions in ndpi_node handler
...
Crash occurred with clang version 6.0.0-1ubuntu2 on ubuntu 18
2019-08-29 20:13:19 +02:00
emanuele-f
2c4495e483
Add missing lib
2019-08-29 17:55:51 +02:00
emanuele-f
6781485c42
Warning fix
2019-08-29 16:49:44 +02:00
emanuele-f
d27e7e2786
Add missing pack_on on ajp struct
2019-08-29 16:47:33 +02:00
Luca Deri
68f6310222
AJP crash fix
2019-08-29 16:17:43 +02:00
Luca
c328452687
Average calculation fix
2019-08-29 16:08:18 +02:00
Luca Deri
536b520750
Added stub for ndpi_free_memory_at_termination() (TODO)
2019-08-29 15:47:34 +02:00
Luca Deri
8b8fd25626
Compilation fix on systems without JSON-C
2019-08-29 15:35:29 +02:00
emanuele-f
e98eb294c7
Add missing json cleanup
2019-08-29 15:25:52 +02:00
Luca
b1270fc7bb
Uodated results
2019-08-29 15:23:01 +02:00
Luca
9eb1676b4b
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-08-29 15:22:46 +02:00
emanuele-f
aea91781aa
Fix alignment issue on IPv6 structs
2019-08-29 14:50:17 +02:00
Luca
9a6f6d9fe4
Implemented IAT (Inter Arrival Time) stats
2019-08-29 13:40:44 +02:00
Luca
e4e40e3c70
Added entropy, average, stddev, variance, bytes ratio calculation
2019-08-28 14:02:39 +02:00
Luca Deri
84aeee49bd
Disable debug code
2019-08-27 10:45:33 +02:00
Luca Deri
6011790d79
Entropy calculation example
2019-08-27 10:44:41 +02:00
Luca
2acffb4163
Initial work towards traffic classification
2019-08-27 12:56:15 +02:00
Luca Deri
b837f3753d
SSH hash fix
2019-08-26 19:13:45 +02:00
Alfredo Cardigliano
d043cd2ac7
Serialization/deserialization of int32/int64/float with uint key
2019-08-26 12:55:23 +02:00
Alfredo Cardigliano
dbf8c24ecb
Fix ndpi_serialize_end_of_record in JSON mode
2019-08-24 03:08:07 +02:00
Alfredo Cardigliano
c50709a8d0
Fix ndpi_reset_serializer
2019-08-24 02:56:17 +02:00
emanuele-f
1231b81839
Add more length checks in HASSH
...
This to prevent possible crashes on invalid packets
2019-08-23 11:36:35 +02:00
Luca Deri
d2fe21ddff
Enhanced -P in ndpiReader so that it can now specify additional parameters
2019-08-22 23:42:07 +02:00
Luca Deri
2134f83948
Warning fixes
2019-08-22 20:04:15 +02:00
Luca Deri
3d3cae1f20
SSH test file
2019-08-22 19:36:36 +02:00
Luca Deri
1e8a43d51e
Merge pull request #758 from tansly/wireguard
...
Add support for WireGuard VPN
2019-08-22 19:31:51 +02:00
Luca Deri
e7c0ac37d8
Implemented HASSH ( https://github.com/salesforce/hassh )
2019-08-22 19:25:58 +02:00
Luca Deri
385e848a0f
Disabled weak (port-based) teamspeak detection
2019-08-22 15:37:31 +02:00
Luca Deri
9f42a4482a
Initial work workards payload analysis
2019-08-21 19:01:56 +02:00
Luca
fdeecf5d41
Implemented STUN cache to enhance matching of STUN-based protocols
2019-08-12 14:16:28 +02:00
Luca
51ac583d83
Improved google duo detection
2019-08-12 11:59:57 +02:00
emanuele-f
e226f99e4e
Fix possible intoaV4 1 byte overflow
2019-08-09 17:02:15 +02:00
emanuele-f
f73dc61ff8
Add NDPI_PROTOCOL_DANGEROUS classification
2019-08-09 10:04:56 +02:00
Luca
90547c4fd2
Added SMBv1 test file
2019-08-08 23:33:40 +02:00
Luca
c6e832be18
Various TLS/STUN improvememnts
2019-08-08 18:09:12 +02:00
Luca
cce8a6026f
Reworked SSL/TLS field naming
2019-08-08 15:20:05 +02:00
Luca
419160f351
Implemented DTLS support
...
Renamed ssl to tls
2019-08-08 12:45:27 +02:00
Luca Deri
3c4a959c1e
Updated results when adding client hello
2019-08-07 20:06:31 +02:00
Luca
800deb3f54
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-08-07 20:00:59 +02:00
Luca
49f5beab84
Added client SSL hello
2019-08-07 19:35:33 +02:00
emanuele-f
a6fe581d48
Change SMBv1 breed to potentially dangerous
...
https://techcommunity.microsoft.com/t5/Storage-at-Microsoft/Stop-using-SMB1/ba-p/425858
2019-08-07 12:39:07 +02:00
Luca Deri
ff1234cce3
Changes in QUIC dissector to avoid miing QUIC with STUN
2019-08-06 23:13:47 +02:00
Luca Deri
32665e6417
Removed non-ASCII chars from JSON header
2019-07-31 00:11:40 +02:00
Luca Deri
b2f7a52f98
Serialization fix
2019-07-30 23:46:20 +02:00
Luca Deri
4ebc8d54f4
Compilation fix
2019-07-30 22:51:54 +02:00
Luca Deri
9c3e623bb4
Split serialization code from ndpi_utils
2019-07-30 22:48:55 +02:00
Luca Deri
e1b7005c2b
Minro change
2019-07-30 10:28:30 +02:00
Luca Deri
398e9718ea
JSON serialization fixes
2019-07-30 08:04:39 +02:00
Luca
a0be9ea639
Fixed wrong detection of RTP as WhatsApp voice
2019-07-29 16:28:56 +02:00
Luca Deri
fbe87ed640
Fixed CSV initialization
2019-07-29 00:41:29 +02:00
Luca Deri
23af4d8211
Initial CSV implementation
2019-07-29 00:33:48 +02:00
Luca Deri
bfc3a00e6c
Fix for ndpi_serialize_string_uint32_format with JSON
2019-07-28 23:02:55 +02:00
Luca Deri
40f55e2d06
Added string/float support in (de)serialization
2019-07-27 17:48:23 +02:00
Luca Deri
3e044a759b
Code cleanup
2019-07-27 17:24:32 +02:00
Luca Deri
5c38e7b126
Better messenger traffic guess
2019-07-25 17:23:32 +02:00
Alfredo Cardigliano
32c61d3ea1
RPM spec cleanup
2019-07-25 14:23:11 +02:00
Alfredo Cardigliano
ea80c4dacc
Removed conflict with nprobe-dev
2019-07-25 11:59:01 +02:00
Luca Deri
7f66f1053f
Updated google docs detection in wechat.pcap
2019-07-25 09:13:46 +02:00
Luca Deri
734305e111
Updated Google docs category
2019-07-25 08:58:44 +02:00
Luca Deri
3369716fc3
Added SPLT (sequence of packet length and time) and BD (byte distribution) with -J
2019-07-24 23:55:07 +02:00
Yağmur Oymak
cdf61de129
Add test for WireGuard
2019-07-24 19:18:20 +03:00
Yağmur Oymak
786ea3c0f9
Merge branch 'dev' into wireguard
...
Conflicts:
src/include/ndpi_protocols.h
src/lib/ndpi_main.c
Get upstream developments.
2019-07-24 19:16:44 +03:00
Yağmur Oymak
9a899c54c9
Harden WireGuard detection
...
Exploit the fixed size handshake messages and sender/receiver indices.
2019-07-24 18:51:29 +03:00
Luca Deri
2148568347
Added int32/int64 (with sign) serialization/deserialization
2019-07-24 15:20:31 +02:00
Luca Deri
5c6c64ed1d
Warnign fix
2019-07-24 14:16:38 +02:00
Luca Deri
b99ef159ed
Added missing result for nest
2019-07-24 11:32:15 +02:00
lucaderi
a9ce7ccb83
Packages fixes
2019-07-24 08:47:36 +02:00
Luca Deri
b715467da6
Added -e option to ndpiReader for searchign human readeable strings lenght
...
Default human readeable strings lenght is not 5 chars (used to be 8)
2019-07-24 00:25:00 +02:00
Luca Deri
63173e7360
Updated results with new dissection
2019-07-24 00:13:07 +02:00
Luca Deri
d398b0aba6
Simplified makefile
...
Fixed warning
2019-07-23 22:45:31 +02:00
Luca Deri
8ff68a58f2
Merge pull request #759 from themadprofessor/patch-2
...
Create CONTRIBUTING.md
2019-07-23 22:33:29 +02:00
Luca Deri
f55391f99d
Merge pull request #760 from ntop/nDPI-SPLT-BD
...
Ndpi splt bd
2019-07-23 22:32:59 +02:00
Ravi Kerur
a262f8dd29
Add SPLT and BD classification to the lib.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 10:00:34 -07:00
Ravi Kerur
c6ca6ec712
Add new datastructures.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 09:56:32 -07:00
Ravi Kerur
1ec160d4c9
nDPI ovs changes.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 09:56:24 -07:00
Ravi Kerur
6b8234d938
Xbox and PS4 static port classification.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 09:56:15 -07:00
Ravi Kerur
b6db991710
Amazon video static classification.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 09:56:05 -07:00
Ravi Kerur
6ff9b8b90e
Add default port based iperf classification.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 09:55:32 -07:00
Stuart Reilly
e781ddfa43
Create CONTRIBUTING.md
...
Add simple contribution guidelines.
2019-07-23 10:47:25 +01:00
Yağmur Oymak
a0d8ce4159
Add support for WireGuard VPN
2019-07-23 12:00:23 +03:00
Luca Deri
974abaa275
Merged Google Hangout and Duo as they are pretty similar from the network standpoint and from the features they implement
2019-07-22 23:24:40 +02:00
Luca Deri
ccea4669de
Improved WhatsApp detection
2019-07-22 23:06:25 +02:00
Luca Deri
db36294dcb
Warnign fix
2019-07-22 21:42:55 +02:00
Alfredo Cardigliano
b13780c6e0
Serialization of arrays in JSON format
2019-07-22 17:24:04 +02:00
Luca Deri
6d00b59bb8
Compilarion fix
...
Updated SIP result
2019-07-22 16:08:44 +02:00
Luca Deri
72b05fed75
STUN, Hangout, Duo dissection improvements
2019-07-21 08:17:28 +02:00
Alfredo Cardigliano
e2d2ca5fe0
Added braces in JSON object serialization
2019-07-19 19:55:21 +02:00
Alfredo Cardigliano
d43cfe1ead
JSON serialization fixes in buffer offset and room computarion, string escape
2019-07-19 17:33:17 +00:00
Luca Deri
11004de056
Restored serializerUnitTest() after fixes
2019-07-19 16:54:48 +02:00
Alfredo Cardigliano
f3faaec9d8
serializer char* parameters are now const
2019-07-19 14:36:41 +00:00
Alfredo Cardigliano
8350b7269f
Fix Makefile.dpdk
2019-07-19 10:00:12 +00:00
Luca Deri
6bce0c4a9c
Added support for Google Duo
2019-07-19 00:48:07 +02:00
Luca Deri
4bda18a079
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-07-18 15:14:06 +02:00
Luca Deri
46499a53aa
Improved Facebook messnger mobile detection
2019-07-18 15:13:48 +02:00
Luca Deri
57ef7c1276
Added QUIC 046 support
2019-07-18 15:00:24 +02:00
Luca Deri
b8867642fc
Refresh after data leak detection
2019-07-18 11:49:53 +02:00
Luca Deri
e902478bd3
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-07-18 11:38:43 +02:00
Luca Deri
b50635cb89
Renamed ndpi_util.c -> reader_util.c
...
Added crash fix with IPv6
2019-07-18 11:38:16 +02:00
Luca Deri
cbb31fa204
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-07-18 11:26:17 +02:00
Luca Deri
20bac32e1f
Improvements for dta dissection
2019-07-18 11:24:44 +02:00
Luca Deri
f394102b80
Merge pull request #752 from marcopiangatello/dev
...
ndpi_has_human_readeable_string Test
2019-07-18 07:32:38 +02:00
Alfredo Cardigliano
dc375aed81
Corruptioon fix
2019-07-18 00:01:52 +02:00
Alfredo Cardigliano
c85f7de2c1
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-07-17 22:06:15 +02:00
Alfredo Cardigliano
ac3a618458
Improved deserialization safety checks
2019-07-17 22:06:00 +02:00
Alfredo Cardigliano
6081e46ad9
Fix memory corruption (reworked space computation and safety checks)
2019-07-17 21:20:51 +02:00
Alfredo Cardigliano
c990d6bbd9
Deserialization boundary check fix, new end_of_record type
2019-07-17 17:58:14 +02:00
marcopiangatello
4ad12dcd19
Update ndpiReader.c
2019-07-17 17:09:33 +02:00
marcopiangatello
dea4f784e2
Update ndpiReader.c
2019-07-17 16:55:49 +02:00
marcopiangatello
20c3d90163
Update ndpiReader.c
2019-07-17 16:53:24 +02:00
marcopiangatello
7053721aae
Add files via upload
2019-07-17 16:50:38 +02:00
marcopiangatello
adcb05d213
Delete ndpiReader.c
2019-07-17 16:50:25 +02:00
marcopiangatello
11639dcc8b
Update ndpiReader.c
2019-07-17 16:34:13 +02:00
marcopiangatello
44dd09b438
Add files via upload
2019-07-17 16:08:22 +02:00
marcopiangatello
7280fc7d31
Delete ndpi_util.h
2019-07-17 16:08:00 +02:00
marcopiangatello
e93ccab279
Delete ndpi_util.c
2019-07-17 16:07:53 +02:00
marcopiangatello
5294945554
Delete ndpiReader.c
2019-07-17 16:07:45 +02:00
Luca Deri
9ca87a620a
Added extar check
...
Warning fix
2019-07-17 15:31:48 +02:00
Luca Deri
b54863edc6
Merge pull request #747 from themadprofessor/travis-gcc
...
Add more compilers to travis
2019-07-17 15:26:47 +02:00
Stuart Reilly
065d0c7e9f
Add ubuntu toolchain to clang builds
2019-07-17 12:14:45 +01:00
Stuart Reilly
e2fcb942e8
Add clang-7
2019-07-17 11:44:44 +01:00
Stuart Reilly
cfdf832d3a
Remove brew update
2019-07-17 11:44:44 +01:00
Stuart Reilly
098c4228fb
Make travis more explicit
2019-07-17 11:44:44 +01:00
Stuart Reilly
79a0cfbcdb
Remove gcc7, add clang 8
2019-07-17 11:44:44 +01:00
Stuart Reilly
e923ca4f17
Add gcc-8 and gcc-9
2019-07-17 11:44:44 +01:00
Stuart Reilly
95ba3fa142
Add gcc-7 to travis.yml
2019-07-17 11:44:38 +01:00
Alfredo Cardigliano
2fcc4f3e73
Added ndpi_serialization_uint32_uint64 and ndpi_serialization_string_uint64
2019-07-17 10:10:41 +00:00
Alfredo Cardigliano
1657686eb4
Moved json2tlv to ntopng
2019-07-17 08:55:46 +00:00
Alfredo Cardigliano
c0835968af
ZMQ export in json2tlv
2019-07-16 16:04:04 +00:00
Alfredo Cardigliano
4b2fbdb277
json2tlv tool to convert from JSON to TLV and run performance tests
2019-07-16 13:31:26 +00:00
Alfredo Cardigliano
2ce4adf09d
Added ndpi_serialization_string_uint32
2019-07-16 12:31:41 +02:00
Luca Deri
1777841ec1
Line dissection improvements
2019-07-16 00:02:34 +02:00
Luca Deri
f570eccf81
Fixes #741
2019-07-15 23:53:28 +02:00
Luca
67dfddd065
Line fix
2019-07-15 16:25:53 +02:00
Luca
9a4d01cb26
Lenght fix
2019-07-15 16:17:23 +02:00
Luca Deri
5c758d4564
Reworked output
...
-v 1 now prints only unknown flows
-v 2 now prints all flows
2019-07-15 14:45:25 +02:00
emanuele-f
fc531334ae
Remove Werror
2019-07-15 09:31:15 +02:00
Luca Deri
5a018e0bc0
Added Line protocol dissection
...
Add fix for discarding STUN over TCP flows
2019-07-15 00:19:45 +02:00
Luca Deri
f8fb1f838c
Fixes #740
2019-07-14 12:25:08 +02:00
Luca Deri
7b16c68e92
JA3 format cleanup
2019-07-13 19:32:51 +02:00
Luca Deri
af2dc0860c
Merge pull request #734 from glpaparelli/dev
...
fixed the printing layout, even with IPv6
2019-07-13 18:44:03 +02:00
Luca Deri
acd3db13f8
Fixes #735
2019-07-13 18:39:18 +02:00
Luca Deri
c8a867bf29
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-07-13 18:38:20 +02:00
Luca Deri
17c49b2e6d
Updated test resultss after export changes
2019-07-13 18:37:57 +02:00
Luca Deri
9bdc021f98
Merge pull request #736 from themadprofessor/patch-1
...
Fix invalid function prototype
2019-07-13 18:36:09 +02:00
Luca Deri
c65025f7b0
Merge pull request #737 from themadprofessor/dev
...
Add compiler warnings and fix them
2019-07-13 18:34:40 +02:00
Luca Deri
ea32d535eb
initial work towards simple serilizer/deserialier
2019-07-13 18:32:22 +02:00
Stuart Reilly
92c769f206
Solve remaining warnings
2019-07-12 16:41:39 +01:00
Stuart Reilly
343ee0c9b6
Merge branch 'dev' of github.com:themadprofessor/nDPI into github
2019-07-12 16:28:38 +01:00
Stuart Reilly
8b1c68aed3
Add compiler warnings and fix them
2019-07-12 16:01:22 +01:00
Stuart Reilly
929cbbb7fc
Add compiler warnings and fix them
2019-07-12 15:59:11 +01:00
Stuart Reilly
22e323528e
Fix invalid function prototype
...
Solves a warning when compiling with strict-prototypes.
2019-07-12 15:02:20 +01:00
Giulio Paparelli
52533c3b66
all fixed
2019-07-12 12:06:10 +02:00
Luca Deri
563215a05e
Compilation fix
2019-07-12 07:24:07 +02:00
Luca Deri
4ac60d88d7
Improved whatsapp dissection
2019-07-11 22:49:24 +02:00
Luca Deri
3e2e616507
Dissection improvents
...
Fixed QUIC dissection
Disabled debug message
2019-07-11 22:35:50 +02:00
Luca Deri
da7e595fcf
Fixed uninitialized variable that caused weird errors
2019-07-10 19:27:27 +02:00
Luca Deri
829a284d48
Fix that caused nDPI to provide false positive results with pattern matching
2019-07-10 16:08:12 +02:00
Luca Deri
c0d9dc9969
Typo
2019-07-03 18:03:44 +02:00
Luca Deri
cc15389729
Improved protocol guess
2019-07-02 23:25:55 +02:00
Luca
edd4f2e37d
Remvoed debug info
2019-07-02 15:28:40 +02:00
Luca Deri
8205f2c6f1
Various TLS improvements
2019-07-02 00:05:17 +02:00
Luca Deri
dd9db5d0b7
SSL ciphers improvements
2019-07-01 23:25:48 +02:00
Luca Deri
9590b18fdd
Fixed invalid changes in ndpi_get_proto_category() and ndpi_get_proto_name() dur to https://github.com/ntop/nDPI/pull/731/commits/4b717276614e20feada22e6fe29ea2099ba9fd37
2019-07-01 23:16:43 +02:00
Luca Deri
7cb7a12f96
Merge pull request #731 from themadprofessor/dev
...
Stability Fixes
2019-07-01 20:02:49 +02:00
Stuart Reilly
5ce5bae99d
Merge remote-tracking branch 'upstream' into dev
2019-07-01 17:49:14 +01:00
Luca Deri
8fdef484f6
Minor change
2019-07-01 12:51:55 +02:00
Luca Deri
65e842effa
Merge pull request #730 from hoermto/hoermto-patch-alpine
...
Alpine linux: "ln -F" not supported in alpine
2019-06-30 15:34:00 +02:00
Luca Deri
2c43b61798
Added DNSoverHTTPS detection
2019-06-30 12:36:58 +02:00
Luca Deri
a1ac31062d
Added ndpi_has_human_readeable_string for detecting human-readeable strings in buffers
2019-06-30 11:59:51 +02:00
Luca Deri
06b05e21c6
Improvemnts in SSL certificate detection
2019-06-30 08:19:51 +02:00
Luca Deri
3f460ad5a9
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-06-29 17:34:45 +02:00
Luca Deri
e9e647f043
ntohl Portability fixes
2019-06-29 17:34:08 +02:00
Luca Deri
e8c84f3c5d
Initial implementation of datasaver protocol support
2019-06-29 13:04:06 +02:00
Stuart Reilly
f3161309ff
Fix missing braces
2019-06-28 16:21:49 +01:00
Stuart Reilly
ef1b8e36a0
Fix potential NULL dref in btlib.c
2019-06-28 16:12:42 +01:00
Stuart Reilly
79634a6789
Fix two resource leaks
2019-06-28 16:11:33 +01:00
Stuart Reilly
d8ec0a9229
Move NULL checks to start of functions
2019-06-28 16:08:36 +01:00
Stuart Reilly
bc1b4885de
Fix potential NULL deref in libcache
2019-06-28 16:00:32 +01:00
Stuart Reilly
4b71727661
Fix two potential OOB reads in ndpi_main.c
2019-06-28 15:55:00 +01:00
Stuart Reilly
cc39ef0946
Remove duplicate defintions and fix function prototypes
2019-06-28 15:53:11 +01:00
hoermto
e47c0c3e49
Makefile: ln -F not supported in alpine
...
removed -F option from makefile for alpine support. Actually not sure the relevance of -F flag for other OS
2019-06-28 15:54:59 +02:00
Luca Deri
81d3fc8a24
Dissection improvements
2019-06-27 16:38:36 +02:00
Luca Deri
cc51253007
Removed debug message
2019-06-25 16:30:51 +02:00
Luca Deri
a4d797f832
WhatsApp improvements for video/audio detection
2019-06-25 15:18:49 +02:00
Luca Deri
6ed8ccfa46
Merge pull request #723 from lance-wyvern/dev
...
OICQ protocol version:0x371b
2019-06-22 15:42:15 +02:00
Luca Deri
c4f513f6e7
Merge pull request #717 from weiyanhua100/dev
...
add null process for malloc.
2019-06-22 15:40:25 +02:00
Luca Deri
4ea8eaf103
Merge pull request #724 from themadprofessor/fix_dhcp_tests
...
Fix tests broken by new DHCP fingerprinting
2019-06-22 15:40:08 +02:00
Luca Deri
00ed2653fe
Further WhatsApp improvements
2019-06-21 19:06:41 +02:00
Luca Deri
179b93d625
Better UDP flow handling
2019-06-21 12:14:57 +02:00
Luca Deri
3e43e77b1c
Cleanup
2019-06-21 12:14:51 +02:00
Luca Deri
b66606bc16
Improved OpenVPN support for UDP-based VPNs
2019-06-21 12:01:07 +02:00
Luca Deri
b6ac750e21
Added WhatsApp Video
2019-06-20 23:16:36 +02:00
Luca Deri
936a95e10e
WhatsApp improvements
2019-06-20 23:11:16 +02:00
Luca Deri
13e8354f37
JSON-C fix
2019-06-20 22:16:53 +02:00
Luca Deri
0fe7f16ecf
Fixed invalid false positive
2019-06-20 21:11:21 +02:00
Stuart Reilly
784f4e4bba
Add dhcp fingerprints to expected results
2019-06-19 13:20:55 +01:00
zhenxian.wang
1e616b227b
new QQ version:0x3823
2019-06-19 15:58:30 +08:00
Luca
4830aa9a14
DHCP fingerprint is now in human readeable format
2019-06-18 17:44:05 +02:00
Luca
5f26149938
Added DHCP fingerpring handling
2019-06-18 17:36:39 +02:00
zhenxian.wang
1891f687b6
new QQ version
2019-06-18 18:04:46 +08:00
Luca Deri
41b75485eb
SSL cipher improvements
2019-06-16 21:42:12 +02:00
Luca Deri
1a3f2b3f0d
Reworked SSL cipher handling
2019-06-16 16:05:13 +02:00
Luca Deri
5b7a08bac3
Added SSL cipher print
2019-06-16 10:08:21 +02:00
weiyanhua
e814cd0b9e
add null process for malloc.
2019-06-13 15:05:22 +08:00
Luca Deri
709a87c8d4
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-06-05 23:15:42 +02:00
Luca Deri
4e8055742e
Added fix for discarding core protocols as subprotocols
2019-06-05 23:15:06 +02:00
lucaderi
3979c28cac
Added missing antimalware category
2019-06-03 19:50:18 +02:00
Luca Deri
e6813846b8
Adds CUSTOM_CATEGORY_ANTIMALWARE category referenced by #710 .
2019-06-03 08:18:24 +02:00
Luca Deri
165decdf6c
Merge pull request #691 from pallas/fix-double-strdup
...
Fix double-strdup memory leak in ndpi_handle_rule
2019-06-03 08:10:01 +02:00
Luca Deri
4441bc7033
Merge pull request #711 from dfranusic/dev
...
Added PUBLISH/SUBSCRIBE/MESSAGE methods to SIP
2019-06-03 08:05:26 +02:00
Damir Franusic
a015cb7f48
Merge remote-tracking branch 'upstream/dev' into dev
2019-05-31 15:21:04 +02:00
Damir Franusic
5c7e0a0319
SIP Message extension
...
* RFC 3248
2019-05-31 15:19:07 +02:00
Luca Deri
c43bec826d
Updated results with the new SSL dissection
...
Added RDP dissector
2019-05-30 11:15:50 +02:00
Luca
a3b564eb92
Warning fix
2019-05-29 18:54:17 +02:00
Damir Franusic
1b9955e9ef
Added PUBLISH/SUBSCRIBE methods to SIP
2019-05-29 17:12:32 +02:00
Luca Deri
5da363cbde
Fixed MySQL dissector
...
SSL dissector now reports the protocol version
Fixed bug in ndpiReader that ivalidates in some cases the protocl dissection and used to slow down the dissection
2019-05-28 23:35:49 +02:00
Luca Deri
53119e71f4
Added ndpi_is_safe_ssl_cipher(0 call
2019-05-23 00:16:05 +02:00
Luca Deri
fcc9c76249
Disabled debug
2019-05-22 21:19:22 +02:00
Luca Deri
f29f9bbb38
Update SSL server ciphers
2019-05-22 12:37:27 +02:00
Luca Deri
04b543caa9
SSL certificate analysis improvement
2019-05-20 22:30:53 +02:00
Luca Deri
3f9383c343
Added missing definitions
2019-05-20 22:13:21 +02:00
Luca Deri
0d2f8f4498
Implements #705
2019-05-20 22:02:21 +02:00
Luca Deri
53e64df8e2
Removed debug code
2019-05-20 15:40:09 +02:00
Luca Deri
f97be61e8b
Fixed JA3 decoding
...
Made ndpi_process_extra_packet() optional
2019-05-20 15:32:50 +02:00
Luca Deri
9604386698
Merge pull request #704 from TelecomsSansFrontieres/dev
...
Adding 2 missing Whatsapp IPs
2019-05-18 11:18:07 +02:00
Luca Deri
7b2d9adbdf
Merge pull request #707 from zyingp/xcode_fix
...
Fix the Xcode project
2019-05-18 11:17:47 +02:00
Luca
d592902553
JA3 hardeding code
2019-05-15 17:55:01 +02:00
Yingpei Zeng
08ca25c9c8
Fix the Xcode project
2019-05-15 09:56:10 +08:00
Luca Deri
e5a95cf92e
Skept GREASE in SSL JA3 fingerprint
2019-05-13 23:22:19 +02:00
Clément BRUGUERA
1a2b8a98a6
Adding 2 missing Whatsapp IPs
2019-05-13 17:26:19 +02:00
Luca Deri
0d0d6893fc
JA3 fixes
2019-05-12 15:25:14 +02:00
Luca Deri
3b185a00fa
Disabled debug traces
2019-05-11 00:53:02 +02:00
Luca Deri
a00ad9fc92
Initial JA3 support ( https://github.com/salesforce/ja3 ) for SSL
2019-05-11 00:50:56 +02:00
Luca Deri
b96e6a9e2d
Merge pull request #696 from pallas/avoid-hyperscan-leak
...
Avoid leaking hyperscan struct
2019-05-08 12:13:23 +02:00
emanuele-f
ea1ea99ce1
Add allowed site category
2019-05-06 12:01:53 +02:00
Luca Deri
e99a0abfba
Hardening fixes for packer parsing
2019-05-03 18:08:12 +02:00
cardigliano
361ab030bc
ndpi_handle_rule accepted formats
2019-04-29 09:44:39 +02:00
Derrick Lyndon Pallas
33d17dbf1f
Avoid leaking hyperscan struct
2019-04-22 17:02:11 +00:00
Alfredo Cardigliano
8a09ca2180
Fixed RPM pkgconfig path
2019-04-19 11:44:10 +02:00
Alfredo Cardigliano
1bbb992ca6
Fixed pkgconfig path (installing libndpi.pc in the default location)
2019-04-19 11:38:34 +02:00
emanuele-f
4dd51a165c
Fix DNS rsp_addr missing in some tiny responses
2019-04-15 19:54:17 +02:00
Luca Deri
8365afee8d
Merge pull request #688 from Dark-Vex/whatsapp
...
Added new Whatsapp addresses ntop/nDPI issue #683
2019-04-12 19:39:20 +02:00
emanuele-f
0961caec1b
Add missing fclose in ndpiReader
2019-04-12 19:39:01 +02:00
Luca Deri
1bf9351a67
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-04-12 19:33:17 +02:00
Luca Deri
3cb0b3fc7b
Fixes #692
2019-04-12 19:32:44 +02:00
Luca Deri
ffb1b9c14f
Merge pull request #690 from pallas/make-path-const
...
Make path const in ndpi_load_protocols_file
2019-04-12 19:25:27 +02:00
Luca Deri
82817c1cac
Merge pull request #687 from Dark-Vex/viber
...
Added Viber IPs issue #684
2019-04-12 19:25:00 +02:00
Luca Deri
173a04007f
Merge pull request #682 from chiehmin/dev
...
Parse HTTP PATCH method
2019-04-12 19:24:14 +02:00
Luca Deri
83d5627c4d
Merge pull request #694 from pallas/avoid-csgo-short-read
...
csgo: fix invalid read on short packet
2019-04-12 19:20:14 +02:00
Luca Deri
6f8a01ca18
Merge pull request #695 from pallas/avoid-memcached-short-read
...
memcached: fix invalid read on short packet
2019-04-12 19:19:46 +02:00
emanuele-f
5b6526cc5a
Add missing newlines
2019-04-12 17:25:38 +02:00
emanuele-f
5e24b32467
Fix category detection
2019-04-12 17:08:32 +02:00
Luca Deri
2f14b8abbf
Added test file for FTP
2019-04-12 12:19:11 +02:00
Derrick Lyndon Pallas
74715b12b0
memcached: fix invalid read on short packet
2019-04-06 01:00:44 +00:00
Derrick Lyndon Pallas
7415af5086
csgo: fix invalid read on short packet
2019-04-06 00:31:41 +00:00
Derrick Lyndon Pallas
85776a532d
Fix double-strdup memory leak in ndpi_handle_rule
...
proto is being strdup'd both in the call to ndpi_set_proto_defaults and
inside of that function as well, leaking the memory.
2019-04-05 19:00:39 +00:00
Derrick Lyndon Pallas
bb2f35fe79
Make path const in ndpi_load_protocols_file
2019-04-05 18:48:42 +00:00
Luca
1290706fad
Tests result fix
...
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-04-05 12:51:59 +02:00
Luca
4e7fa82aff
Fixed false positive with FTP_DATA protocol
...
Added coherency in application protol guess by exploiting the host server name
Various protocol optimizations
2019-04-05 12:47:58 +02:00
emanuele-f
796472cf84
Fix category detection due to missing initialization
2019-04-05 10:11:17 +02:00
Luca Deri
a455e0d8d4
Improved flow category guess
2019-04-02 23:01:03 +02:00
Dark-Vex
55c4108d8b
[FIX] Added new whatsapp addresses ntop/nDPI issue #683
2019-04-02 16:47:49 +02:00
Daniele De Lorenzi
2ef19c7e49
[FIX] Added IPs reported in ntop/nDPI issue #684
2019-04-02 16:04:01 +02:00
Daniele De Lorenzi
e27022b698
Merge pull request #11 from ntop/dev
...
Add all dev branch modifications
2019-04-02 15:49:54 +02:00
Luca Deri
153c77c2cd
Improvements with category detection
2019-04-01 18:40:14 +02:00
Luca Deri
6693151052
Added custom category support to ndpi_get_partial_detection()
2019-04-01 16:12:44 +02:00
Luca Deri
1915a63cf2
Implemented ndpi_process_partial_detection() API call to handle partial matches due to the nDPI specified configuration
2019-04-01 12:30:51 +02:00
emanuele-f
c496c7975f
Add DNS response address
2019-03-29 19:58:10 +01:00
Luca Deri
8dbe7818eb
Improvments for AmazonVideo
2019-03-27 07:00:11 +01:00
chiehminw
1df5b453cb
Parse HTTP PATCH method
...
HTTP PATCH is introduced in RFC 5789 (https://tools.ietf.org/html/rfc5789 )
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-26 11:46:57 +08:00
Luca Deri
0b5e5a5f82
SSL cleanup
2019-03-25 22:08:39 +01:00
Luca Deri
f47be6ef60
Added SSL organization support
2019-03-23 10:32:18 +01:00
Luca Deri
f592b9fc31
Merge pull request #681 from chiehmin/certificate-parsing
...
Parse server certificate organization
2019-03-23 09:58:54 +01:00
Luca Deri
6b1f158322
Merge pull request #675 from chiehmin/dev
...
Respect CXX variable during configure
2019-03-23 09:54:17 +01:00
Luca Deri
99748cddcc
Merge pull request #679 from chiehmin/link-use-relative-path
...
Use relative path for library link
2019-03-23 09:53:35 +01:00
Luca Deri
e2cd89e354
Merge pull request #678 from madpilot78/FreeBSD_endian.h
...
The le32toh() function used in some places on BSD OSes requires sys/en…
2019-03-23 09:53:05 +01:00
Luca Deri
e5f6f68cd6
Merge pull request #677 from chiehmin/add-http-method-prefix
...
Add NDPI prefix for HTTP_METHOD enum to avoid name collisions
2019-03-23 09:52:34 +01:00
Luca Deri
e2ad6bf79f
Merge pull request #673 from vel21ripn/dns_fix_name
...
More accurate hostname verification in a DNS query.
2019-03-23 09:51:53 +01:00
Luca Deri
ef9f395cb6
Merge pull request #665 from vel21ripn/whatsapp
...
Fix whatsapp signature detecting.
2019-03-23 09:49:35 +01:00
Luca Deri
e6f8a66197
Merge pull request #662 from bmwiedemann/date
...
Use ChangeLog date instead of build date
2019-03-23 09:49:06 +01:00
Luca
5656a41f69
Improved snapchat detection
2019-03-22 12:36:42 +01:00
chiehminw
96ed31874d
we only need one dot to confirm it is a valid domain name
...
github.com is valid but can not be retreive by server certificate
parsing
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-20 17:47:51 +08:00
chiehminw
db91837647
retreive ssl certificate origanization
...
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-20 17:47:48 +08:00
emanuele-f
6c9fbc2ddb
Fix invalid categories labels array length and add check
2019-03-18 13:29:59 +01:00
Luca Deri
7237f7081f
Improved FTP dissection
2019-03-14 22:07:21 +01:00
Luca Deri
54f90c7556
Added fix to avoid FTP false positives
2019-03-14 21:50:09 +01:00
chiehminw
43890b31fc
Use relative path for library link
...
relative link path can preserve link relation after packaging and
doplying to new machine
ex:
$ make DESTDIR=/tmp/ndpi install
$ tar czf ndpi.tar.gz /tmp/ndpi
$ tar xf ndpi.tar.gz -C /lib
Orignal install script will caused the /lib/libndpi.so.2 links to
/tmp/ndpi/libndpi.so.2.9.0 which is not intended
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-13 15:04:10 +08:00
Guido Falsi
b1282da542
The le32toh() function used in some places on BSD OSes require sys/endian.h to be included.
2019-03-12 18:12:18 +01:00
Luca
22e431ca67
Sporify fix
2019-03-12 18:01:14 +01:00
chiehminw
b1bd7d6f8c
Add NDPI prefix for HTTP_METHOD enum to avoid name collisions
...
ref: https://stackoverflow.com/questions/35380279/avoid-name-collisions-with-enum-in-c-c99
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-12 16:11:33 +08:00
Luca Deri
6c1d236a03
Category cleanup
2019-03-10 21:44:11 +01:00
Luca Deri
89d548f9d3
Removed categories based on file content
2019-03-10 21:18:19 +01:00
Luca
fde4380422
Proto cleanup
2019-03-08 20:17:11 +01:00
Luca Deri
aaa686b9fe
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-03-08 15:59:26 +00:00
Luca Deri
03b0aa7185
Added new categories
...
- NDPI_PROTOCOL_CATEGORY_MUSIC
- NDPI_PROTOCOL_CATEGORY_VIDEO
- NDPI_PROTOCOL_CATEGORY_SHOPPING
- NDPI_PROTOCOL_CATEGORY_PRODUCTIVITY
- NDPI_PROTOCOL_CATEGORY_FILE_SHARING
Protocol vs category rework
2019-03-08 15:58:21 +00:00
chiehminw
518dbbc96b
Respect CXX variable during configure
...
commit 6ac83ce7eb use CXX to link ndpiReader however CXX is not
properly set in configure step
Fixes: 6ac83ce7eb ("Fixes broken hyperscan compilation")
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-06 15:27:50 +08:00
Simone Mainardi
59f683858b
Fixes possibly broken dissection of invalid DNS responses
2019-03-04 18:48:38 +01:00
Luca Deri
c339211ac7
Re-Added TikTok/Musical.ly protocol
2019-03-03 21:07:54 +01:00
Simone Mainardi
93582a4204
Bump to version 2.9
2019-03-01 18:06:28 +01:00
Simone Mainardi
5bb53cf995
Changelog update
2019-03-01 18:02:24 +01:00
Luca
05ef62781f
Fixes for wireshark 3
2019-03-01 15:19:05 +01:00
Luca
d283538146
Fixed false positive mining detection
2019-03-01 12:56:33 +01:00
Vitaly Lavrov
a99754d88b
More accurate hostname verification in a DNS query.
2019-02-27 15:26:11 +03:00
Luca Deri
de16b01bb2
Improved MDNS dissection
2019-02-24 11:03:06 +01:00
Luca Deri
47669abd44
Added extra check to avoid nDPI wrong matches
2019-02-21 23:29:06 +01:00
emanuele-f
ab3833a708
Fix invalid TCP DNS dissection
2019-02-19 17:17:02 +01:00
Luca Deri
dc8d582b18
Fixes #671
2019-02-14 10:31:42 +01:00
emanuele-f
a035763afd
Change ndpi_fill_ip_protocol_category to pass IPs explicitly
2019-02-12 17:28:30 +01:00
Luca Deri
0c4fada265
Fix for avoid wrong substring match to happen
2019-02-10 23:52:24 +01:00
Luca Deri
ddf0066c11
Aligned DNS to HTTP dissection
2019-02-07 22:44:48 +01:00
Vitaly Lavrov
476fbbfe4e
Fix whatsapp signature detecting.
2019-01-31 11:27:40 +03:00
cardigliano
2ec41c1732
Releasing old buffer if realloc fails
2019-01-31 09:12:04 +01:00
Alfredo Cardigliano
6a98aec2ca
Support for protocol file files of arbitrary length
2019-01-30 08:44:32 +00:00
Bernhard M. Wiedemann
e91123e17a
Use ChangeLog date instead of build date
...
in order to make builds reproducible.
See https://reproducible-builds.org/ for why this is good.
This date call works with GNU date and BSD date.
Also use UTC/gmtime to be independent of timezone.
2019-01-24 14:27:10 +01:00
Luca Deri
e2ffcd7229
Improved HTTP response code handling
2019-01-23 00:53:56 +01:00
Luca Deri
efa96da3e0
Fixes #657
2019-01-20 23:47:24 +01:00
Luca Deri
b9ae650146
Merge pull request #659 from cavedon/direction-endianness
...
Compute packet_direction consistently independently from endianness
2019-01-20 23:18:46 +01:00
Luca Deri
72edc508eb
Merge pull request #661 from pcein/propagate-prefix
...
Propagate prefix settings to Makefiles
2019-01-20 23:17:46 +01:00
Pramode
81649d9979
Propagate prefix settings to Makefiles
...
A "make install" was failing because the --prefix flag
setting was not being propagated to the Makefiles.
2019-01-20 19:09:07 +05:30
Luca Deri
7efe1f06ee
Removed debug code
2019-01-17 22:03:39 +01:00
Luca Deri
85155d5899
Removed debug code
2019-01-17 00:42:45 +01:00
Luca Deri
d088a968a9
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-01-17 00:41:05 +01:00
Luca Deri
efef99cbad
Removed this party LRU and replaced with home grown
2019-01-17 00:40:28 +01:00
Luca Deri
f3b0878a37
Warnign fixes
...
Updated test results
2019-01-17 00:39:45 +01:00
Luca Deri
c856e0a563
Disabled ookla statistics: needs to be improved
2019-01-16 22:30:55 +01:00
Ludovico Cavedon
2c672a4ea2
Compute packet_direction consistently independently from endianness
...
Ensure packet_direction is computed in the same way on little endian and
big endian architectures.
This change will convert IP addresses and port from little endian to host
endian (instead of converting from network endian to host endian) so
that it does not change the behavior on little endian architecture where
ndpi is usually developed.
A better (but more invasive) change would be to use the ntoh*()
functions and then adjust all affected tests.
2019-01-16 01:15:43 -08:00
Ludovico Cavedon
0cb4bae275
QUIC: convert little endian offsets to host endianness
...
Offset in the QUIC protocol are little endian. Reading them as uint32_t
works on little endian architectures, but breaks on big endian ones.
This change applies the proper conversion and fixes running the
http_ipv6 and quic tests on big endian architectures.
2019-01-15 23:49:26 -08:00
Simone Mainardi
2ade0be365
Fixes ookla lru cache use with IPv6
2019-01-15 09:56:33 +01:00
Luca Deri
f2f2dbe381
Fix for IPv6 HTTP traffic
2019-01-14 20:03:06 +01:00
Luca Deri
60eee5f9e9
Merge pull request #649 from Dark-Vex/dev
...
Bank website detected as TOR from SSL Dissector (bigram check)
2019-01-13 11:12:12 +01:00
Luca Deri
4a6b0d7de5
Merge pull request #654 from u-devel/patch-1
...
Update radius.c to RFC2865
2019-01-13 11:11:10 +01:00
Luca Deri
f41ffe136a
Merge pull request #655 from u-devel/dev
...
FIX H.323 broken detection
2019-01-13 11:10:36 +01:00
u-devel
1d155ab2eb
FIX H.323 broken detection
...
TPKT header length field can have value more then 255, and in fact in all of the cases I've met it is more then 255.
Thus checking real H.323 packet like this:
(packet->payload[2] == 0x00)
stop detecting H.323 conversation at all.
2019-01-13 00:07:45 +06:00
u-devel
396f794bf4
Update radius.c to RFC2865
...
According to RFC2865 code can have value up to 13, also payload length ranges should be applied.
2019-01-12 23:49:24 +06:00
Luca Deri
97bdfe295d
nDPi now finally honours dissection of HTTP responses
2019-01-07 00:28:29 +01:00
Luca Deri
5241c9f3cf
Added Modbus over TCP dissector
2018-12-21 18:25:44 +01:00
Luca Deri
91da00f470
Updated results
2018-12-21 17:31:51 +01:00
Alfredo Cardigliano
c7260b6436
Moved to 2.7
2018-12-21 10:50:23 +01:00
Daniele De Lorenzi
c51405e99b
Bank website detected as TOR from SSL Dissector (bigram check)
...
Commented "vp" for vpbank.com
2018-12-20 11:11:32 +01:00
Daniele De Lorenzi
2aea4da9ad
Merge pull request #10 from ntop/dev
...
Repo sync
2018-12-20 11:04:03 +01:00
Alfredo Cardigliano
d3be349fa0
Changelog update
2018-12-20 09:16:59 +01:00
Luca Deri
92ad057332
Added Ookla cache
2018-12-17 22:33:58 +01:00
emanuele-f
d2b2aba6e8
Expose ndpi_fill_ip_protocol_category api to handle ICMP flows category
2018-12-12 11:31:07 +01:00
Luca Deri
c1d31bb409
Fixed eDonkey false positives
2018-12-12 08:58:34 +01:00
Alfredo Cardigliano
181ec4992b
Deb fix (shared lib links)
2018-12-10 16:54:01 +01:00
Alfredo Cardigliano
60337330bf
Creating shared lib with major version
2018-12-10 16:33:09 +01:00
Alfredo Cardigliano
af0fd3b96d
RPM fix
2018-12-10 16:18:53 +01:00
Luca Deri
e7cf989c7a
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-12-10 12:19:53 +01:00
Luca Deri
2a1313ffd5
Improvements in SpeedTest (Ookla) detection
2018-12-10 12:19:34 +01:00
Luca Deri
140ed9887b
Merge pull request #639 from madpilot78/Create_libndpi.so.MAJOR_link
...
Also create the libndpi.so.2 link.
2018-12-10 02:30:05 -08:00
Alfredo Cardigliano
b2c00b3b24
Added script to get the package version
2018-12-07 15:50:23 +01:00
Luca Deri
70d0566480
Build fix
2018-12-05 06:58:29 +01:00
Luca Deri
067c3dad44
Merge pull request #645 from vitalivanov/pull_example_dpdk_cleanups
...
build: cleanup of dpdk examples.
2018-12-04 15:43:18 -08:00
Luca
be2934f9ad
Added the concept of protocols that can have subprotocols. Example Spotify cannot have subprotocols, DNS can (DNS.Spotify)
...
Merged Skype call in/out in Skype Call
2018-11-30 18:41:16 +01:00
Luca
2993d9d37e
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-11-30 08:40:37 +01:00
Luca
bae75c8f9b
Fix for custom protocol load
2018-11-30 08:39:54 +01:00
lucaderi
b6be0eebf6
Fix for shared library symbolic link
2018-11-30 06:53:41 +01:00
Luca Deri
d63e000a45
Fixed package signing
2018-11-30 00:57:34 +01:00
Vitaliy Ivanov
fd963538f3
build: cleanup of dpdk examples.
...
- clean install dependencies on example binary
- add more rules to clean command
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-29 13:40:37 +02:00
Luca
c09284ba27
Improved heuristics
...
Used the host guessed protocol if upper protocol has not been detected
2018-11-29 08:44:41 +01:00
Luca
622519e90e
Warning fix
2018-11-29 07:53:41 +01:00
Luca Deri
f1e5ed4766
Merge pull request #642 from vitalivanov/pull_buildsys_improvements
...
Pull buildsys improvements
2018-11-28 23:20:34 +01:00
Vitaliy Ivanov
a3abbc3ebb
build: do not fail if example app is not present.
...
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-28 19:23:27 +02:00
Vitaliy Ivanov
8df6b5c1bf
build: install example binaries to dst dir.
...
make install DESTDIR=/build/nDPI/
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-28 17:40:01 +02:00
Vitaliy Ivanov
9cbf25a76f
build: cleanup .so.X.X.X if present.
...
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-28 16:56:22 +02:00
Vitaliy Ivanov
923ba84f65
gitignore: ignore dpdk artifacts.
...
Also similarly to shared libraries do not hide static lib.
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-28 16:43:17 +02:00
Vitaliy Ivanov
ea7e7c753b
build: correct example dpdk linking with pcap.
...
- take libpcap from configure information.
- clean up distclean.
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-28 16:40:34 +02:00
Luca
5429063546
Improved WhatsApp detection
2018-11-28 00:24:41 +01:00
Luca
54deb1302d
Added Signal.org dissector
2018-11-28 00:09:44 +01:00
Luca Deri
f15aed6c46
Renamed internal function
2018-11-21 23:25:27 +01:00
Luca Deri
e9dd5985b3
Made configure more friendly
...
Added time measurement in ndpiReader (processing and setup time)
2018-11-21 17:22:15 +01:00
Luca Deri
669fdf6b5f
Improved skype, teredo, netbios heuristics
...
Changed ndpi_detection_giveup() API: guess is now part of the call
2018-11-21 00:32:32 +01:00
Alfredo Cardigliano
21504c8492
rpm spec file
2018-11-19 19:01:53 +01:00
Luca Deri
12adb25665
Improved Skype detection
...
Update test results
Added initialization for some free protocols
2018-11-19 18:28:18 +01:00
Luca Deri
5259ba2bcb
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-11-19 18:28:10 +01:00
Alfredo Cardigliano
babb1c864c
removed -r not supported on all systems
2018-11-19 18:25:12 +01:00
Luca Deri
582da8d4bb
Improved WeChat support
...
Removed Musical.ly protocol as the service has been merged with another one and thus it is no longer used
Improved guess for UDP protocols
2018-11-19 18:24:33 +01:00
Alfredo Cardigliano
1537669178
rpm package
2018-11-19 18:02:06 +01:00
Alfredo Cardigliano
b0cfe0b9cc
settins arch for -dev package as it contains static libs
2018-11-19 15:27:24 +01:00
Alfredo Cardigliano
30305cf4fa
deb dependency fix
2018-11-19 15:13:38 +01:00
Alfredo Cardigliano
219951760f
ubuntu ndpi/ndpi-dev package (testing)
2018-11-19 11:16:28 +01:00
emanuele-f
0ee451040d
Warning fix
2018-11-18 12:50:53 +01:00
Alfredo Cardigliano
22c2568c27
commented out debug print
2018-11-16 19:21:57 +01:00
Luca Deri
6e6b825e92
Improved skype heuristic
2018-11-15 16:18:45 +01:00
Guido Falsi
8c63f25478
Also create the libndpi.so.2 link.
...
This is created bydefault by all build tools for libraries and required in certain cases. FreeBSD linker requires it when using SONAME.
2018-11-15 09:09:52 +01:00
Luca Deri
977751efdb
Added ndpi_flowv4_flow_hash and ndpi_flowv6_flow_hash skeletons for
...
implementing https://github.com/corelight/community-id-spec
2018-11-14 15:24:15 +01:00
Luca Deri
771a6e9aab
Merge pull request #636 from 2miksyn/dev
...
Improve SSL detection, prevent false positive SSL detection
2018-11-14 00:36:29 +01:00
Luca
2b4554ad44
Updated test results
2018-11-13 15:35:17 +01:00
emanuele-f
9e72884c7b
Add OpenWrt Makefile
2018-11-13 09:58:31 +01:00
Luca Deri
71b2c19cf2
Added DPDK support to ndpiReader
2018-11-10 16:10:22 +01:00
kyrol
6d929bf4cc
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-11-09 14:53:33 +01:00
kyrol
de9b2b202e
FIX missing Application Data pkt for TLS
2018-11-09 14:52:32 +01:00
Luca Deri
b31337db4a
Improved Skype detection
2018-11-09 11:31:08 +01:00
Mikhail Smirnov
8f8ca40f63
Improve SSL detection, prevent false positive SSL detection
2018-11-09 00:46:25 +03:00
Luca Deri
b98373f390
Improved Messenger/Hangout detection
2018-11-08 22:31:58 +01:00
Luca Deri
8e6640605a
Removed skype false positives
...
better STUP detection
2018-11-08 22:13:05 +01:00
Luca Deri
9c5a4a6d1f
Added UPnP test pcap
...
updated Nintendo test ourcome
2018-11-07 22:45:29 +01:00
Luca Deri
e240bbd4a4
Implemented UPnP dissector
2018-11-07 22:43:33 +01:00
Luca Deri
f7e7ef2f30
Improved SSL decoding
2018-11-03 10:05:13 +01:00
Luca
875b1e0dd5
Better clang check
2018-11-01 09:36:11 +01:00
Luca Deri
6a4324f451
Merge pull request #628 from madpilot78/Respect_DESTDIR_and_PREFIX
...
Make the examples Makefile respect DESTDIR and PREFIX env vars.
2018-11-01 09:20:38 +01:00
Luca Deri
de37d08c24
Merge pull request #632 from madpilot78/Add_SONAME
...
Add SONAME property to shared library
2018-11-01 09:20:05 +01:00
Guido Falsi
00827903ef
The OS variable was not being populated by default.
2018-10-29 23:15:28 +01:00
Guido Falsi
023830f5ab
Try to fix build on Mac.
2018-10-29 21:24:08 +01:00
Guido Falsi
c2169b3dca
Add command line options to correctly populate the shared object SONAME property.
2018-10-29 17:06:58 +01:00
Luca
01444f79e1
Added NDPI_MIN_NUM_STUN_DETECTION constant
2018-10-29 14:47:53 +01:00
Luca
ecdece83fe
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-10-29 14:44:53 +01:00
Michele Campus
d7478c6ed3
Merge pull request #630 from pchaigno/fix-typo
...
Fix typo in README
2018-10-16 11:01:41 +02:00
Paul Chaignon
b467005fac
Fix typo in README
2018-10-16 10:14:09 +02:00
Guido Falsi
b7b12d5b4e
Make the examples Makefile respect DESTDIR and PREFIX env vars.
2018-10-12 17:22:13 +02:00
Luca
952215c0ac
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-10-11 17:47:10 +02:00
Luca
3e5db956a8
Added further ubuntu servers
2018-10-11 17:47:00 +02:00
kyrol
a62f90073a
fix domain name checking for https://github.com/ntop/nDPI/issues/617
2018-10-11 16:16:55 +02:00
emanuele-f
6789d41993
Fix category match not using client certificate
2018-10-11 12:40:11 +02:00
emanuele-f
4b4f4be3a5
Add -g flag
2018-10-11 12:27:13 +02:00
emanuele-f
40294f3aed
Custom categories have now priority over protocol related categories
2018-10-10 15:56:46 +02:00
emanuele-f
67a1a07ac1
Fix custom categories match by IP not working
2018-10-10 13:33:02 +02:00
emanuele-f
cdf197ccfe
Add function to search host in custom categories
2018-10-10 13:29:49 +02:00
emanuele-f
6ff6c2e5af
Fix category field not accounted in ndpi_get_proto_category
...
Fixes #627
2018-10-10 10:43:51 +02:00
Luca Deri
cf0c8be63d
Merge pull request #616 from wang-xuefei/dev
...
remake clean or remake install failed.
2018-10-09 17:45:23 +03:00
root
1d56c9aa1b
fix remake
2018-10-02 23:54:01 +08:00
Luca Deri
ab2f3cefc8
Merge pull request #612 from xcorail/dev
...
Add LGTM code quality badges
2018-10-02 10:07:04 +02:00
Luca Deri
3cbdbc1db5
Merge pull request #610 from eglooca/pr-nest-log-sink
...
New dissector: Nest Log Sink
2018-10-02 10:06:07 +02:00
Luca Deri
90ca91caa8
Renamed files to avoid name clashes during compilation with other libs
2018-09-29 08:38:00 +02:00
Luca Deri
1f24adc9cd
Renamed source files to avoid clashes
2018-09-29 08:28:26 +02:00
Xavier RENE-CORAIL
a1f7ab776e
Add LGTM.com code quality badges
2018-09-27 13:00:00 +02:00
Luca Deri
f639c237a1
Added check for not going beyond the string lenght
2018-09-24 09:57:51 +02:00
Darryl Sokoloski
46ebf541e1
Removed unused varaibles.
...
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-09-19 22:05:39 -04:00
Darryl Sokoloski
53910f0737
Added missing declarations for nest_log_sink dissector.
...
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-09-19 22:05:03 -04:00
Darryl Sokoloski
31f62c5cf5
New dissector: Nest Log Sink
...
This is a dissector for the Nest Log Sink protocol which is used by the Nest Protect (https://nest.com/ca/smoke-co-alarm/overview/ ).
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-09-19 21:25:16 -04:00
Luca
7117f0532c
Mapped the mining category in ndpi_category_get_name()
2018-09-18 18:32:08 +02:00
Luca
c6b427c252
Implementation of Bitcoin, Ethereum, ZCash, Monero dissectors all identified as mining
...
Implements #503
2018-09-18 18:13:04 +02:00
Luca Deri
b0f9f76b79
Addes support for SMBv1 traffic that has been split from SMBv23
2018-09-17 23:15:44 +02:00
Luca
8689d3293a
Added ndpi_protocol2id() API call
2018-09-17 17:57:47 +02:00
Luca Deri
51fdd12d23
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-09-13 00:11:09 +02:00
Luca Deri
24110acafc
Merge pull request #606 from eglooca/pr-fix-parse-packet-line-info
...
Prevent missing text lines and invalid reads past end-of-buffer.
2018-09-13 01:11:01 +03:00
Michele Campus
f6f242b899
Merge pull request #604 from DanieleDeSensi/dev
...
Bug fix and performance improvement for spotify dissector.
2018-09-13 00:09:56 +02:00
Luca Deri
e8c738282d
Improved Facebook Messenger support
2018-09-13 00:04:19 +02:00
Darryl Sokoloski
c0ed50d5b0
Prevent invalid reads past end-of-buffer.
...
The recent revert commit applied to ndpi_parse_packet_line_info resurrects an old bug where the last lines in packets that end with a CR+NL will not be parsed. This revert commit is an attempt to prevent invalid reads past the end of the packet buffer. This PR moves the end-of-bounds test to before the 16-bit read and returns if true. This fixes the case where a text line ends aligned to the buffer-end boundary, and it fixes the invalid read issue.
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-09-11 17:16:12 -04:00
Daniele De Sensi
f48c7ab8e6
Fixed bug in spotify dissector (subnet /24 was matched as /22).
...
Slight performance improvements in spotify dissector (avoid doing ntohl and masking in each and all if conditions).
2018-09-11 12:41:05 +02:00
诟屍
adcb82d2b5
parse protocol's string_to_match into hex which could be match by hyperscan ( #589 )
...
* if one protocol do not have it's regex (pattern_to_match)
then parse it's string (string_to_match) into hex
so we can match every protocol with hyperscan
* fix string2hex()
* fix init_hyperscan():
check return value of string2hex()
2018-09-11 10:46:13 +02:00
Simone Mainardi
6ac83ce7eb
Fixes broken hyperscan compilation
2018-09-11 10:43:04 +02:00
Luca
b9ae0f8888
Fixes #578
2018-09-11 10:07:39 +03:00
Luca Deri
7b4d335944
Merge pull request #603 from pavlosantoniou/dev
...
Avoid possible NULL pointer dereference in ndpi_detection_process_packet
2018-09-11 10:04:15 +03:00
Luca
9bf05c3534
Indentation fix
2018-09-11 09:33:09 +03:00
Luca
1075283d8e
Fixes #601
2018-09-11 09:26:01 +03:00
Pavlos Antoniou
77ea1c25bd
Avoid possible NULL pointer dereference in ndpi_detection_process_packet
2018-09-09 08:20:54 +00:00
Luca Deri
6373c355cf
Added fix for out of boundary memory access
...
Fixes warning
2018-09-05 23:23:54 +02:00
Campus
225826ce83
FIX: dropbox dissector. UPD: updated pcap file with new dropbox pkts
2018-09-05 16:10:07 +02:00
Luca Deri
0c3989b40f
Merge pull request #596 from madpilot78/Add_back_pkgconfig_file
...
Add back pkgconfig file. It is required by ntopng to find the install…
2018-08-30 11:29:12 +02:00
Luca Deri
4a2525241f
Merge pull request #598 from madpilot78/include_hyperscan_fix
...
Move the configure include file inclusion and code depending on it in…
2018-08-30 11:28:41 +02:00
Luca
ed5b04791e
Added missing -lpthread
2018-08-30 11:26:49 +02:00
Luca
71b28e0774
Cleanup
2018-08-30 11:19:09 +02:00
Luca
33d6f2d52f
Added missing file
2018-08-30 11:17:19 +02:00
Luca
e4f01976a6
Added missing categorization when giveup/guess is called
...
Added optimization for TCP flows that do not start with a SYN packet: early giveup is performed
Code cleanup
2018-08-30 11:10:30 +02:00
Luca
0a33e439bd
Better clang handling
2018-08-30 10:05:53 +02:00
Luca
f948f3525f
Cleaned up makefile
...
Used clang instead of gcc on MacOS
2018-08-30 09:59:39 +02:00
Guido Falsi
396e72f4fe
Move the configure include file inclusion and code depending on it in code protected by the NDPI_LIB_COMPILATION define, this should avoid it polluting the environment when including this file from ntopng.
2018-08-27 17:45:38 +02:00
Guido Falsi
d31a29bf6a
Adapt pkgconfig file include path to new Makefile install location.
2018-08-26 00:35:01 +02:00
Guido Falsi
405e2f8dd0
Add back pkgconfig file. It is required by ntopng to find the installed shared library.
2018-08-25 23:42:20 +02:00
Luca
a98c0a81be
Added target for shared liubrary creation
...
Added target for install
Fixes #593
2018-08-25 10:50:16 +02:00
Campus
2f83375eec
Merge branch 'eglooca-pr-remove-autoconf-include' into dev
2018-08-23 12:09:51 +02:00
Campus
2b9b996148
Merge branch 'pr-remove-autoconf-include' of https://github.com/eglooca/ndpi-pr into eglooca-pr-remove-autoconf-include
2018-08-23 12:01:14 +02:00
Michele Campus
48f3104774
Merge pull request #591 from alm-A/patch-2
...
README add protocol : removed Makefile.am step
2018-08-23 12:00:02 +02:00
Michele Campus
b8571475c9
Merge pull request #592 from alm-A/patch-3
...
ndpi_typedefs.h : missing include
2018-08-23 11:59:31 +02:00
Campus
ff83bfbad0
ADD: add prototype of function ht_free in hash.h - DEL: delete include file .c in ndpi_main.c
2018-08-23 11:22:21 +02:00
alm-A
dd307af215
ndpi_typedefs.h : missing include
...
include to ndpi_protocol_ids.h needed for:
- NDPI_PROTOCOL_SIZE
- NDPI_MAX_SUPPORTED_PROTOCOLS
- NDPI_MAX_NUM_CUSTOM_PROTOCOLS
2018-08-22 16:37:59 +02:00
alm-A
58a784e342
README add protocol : removed Makefile.am step
2018-08-22 16:18:44 +02:00
Luca Deri
89b3b085af
Moved to 2.5.0
2018-08-22 08:45:13 +02:00
Darryl Sokoloski
06befec642
Remove autoconf include from typedefs headers.
...
Including this file in any "public" API header breaks all projects that also use autotools because macros such as PACKAGE_VERSION will be redefined.
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-08-16 22:24:15 -04:00
Daniele De Lorenzi
3b1047b0c8
Merge pull request #9 from ntop/dev
...
updates from dev
2018-05-31 16:29:04 +02:00
Daniele De Lorenzi
7989b8d969
Merge pull request #8 from Dark-Vex/rapidvideo
...
Added RapidVideo
2018-05-25 22:03:14 +02:00