Luca Deri
2c5258b19d
Version 4.4
2022-07-06 12:44:31 +02:00
Toni
175f863665
Label SMTP w/ STARTTLS as SMTPS *and* dissect TLS clho. ( #1639 )
...
* Label SMTP w/ STARTTLS as SMTPS *and* dissect TLS clho.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Revert "SMTP with STARTTLS is now identified as SMTPS"
This reverts commit 52d987b603 .
* Revert "Compilation fix"
This reverts commit c019946f60 .
* Sync unit tests.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-06 12:40:25 +02:00
Luca Deri
c019946f60
Compilation fix
2022-07-05 17:38:32 +02:00
Ivan Nardi
7645909460
Fix handling of NDPI_UNIDIRECTIONAL_TRAFFIC risk ( #1636 )
2022-07-05 17:01:00 +02:00
Luca Deri
52d987b603
SMTP with STARTTLS is now identified as SMTPS
2022-07-05 17:00:21 +02:00
Toni
f4a1739f9c
Detect SMTPs w/ STARTTLS as TLS and dissect client/server hello. Fixes #1630 . ( #1637 )
...
* FTP needs to get updated as well as it has similiar STARTTLS semantics -> follow-up
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-05 16:35:23 +02:00
Toni
388dfb8e13
Run regression tests from different locations at the same time w/o side effects on the results. ( #1638 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-05 15:08:59 +02:00
Luca Deri
7fa8d882d8
Exported username in flow information
2022-07-04 22:52:54 +02:00
Luca Deri
461589517e
Updated ndpi_check_flow_risk_exceptions() signature
2022-07-04 21:38:38 +02:00
Luca Deri
e7a5eaecde
Cleaned-up issuer DN check code adding
...
u_int8_t ndpi_check_issuerdn_risk_exception(struct ndpi_detection_module_struct *ndpi_str, char *issuerDN);
Added new API function for checking nDPI-configured exceptions
u_int8_t ndpi_check_flow_risk_exception(struct ndpi_detection_module_struct *ndpi_str,
u_int num_params,
ndpi_risk_params **params);
2022-07-04 18:41:01 +02:00
Luca Deri
8ff2860601
Set CiscoVPN as a network protocol
2022-07-04 18:41:01 +02:00
Toni Uhlig
b3ab66020f
Updated JA3/SSL fingerprints.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-04 16:05:22 +02:00
Toni Uhlig
b3d3e3b210
Replaced malicious JA3-md5/SSL-cert-sha1 ac automata with hashmaps.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-04 16:05:22 +02:00
Toni
4ff8aa48b2
Added UltraSurf protocol dissector. ( #1618 )
...
* TLSv1.3 UltraSurf flows are not detected by now
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-04 16:04:53 +02:00
Ivan Nardi
5aa3d9126f
Add two new confidence values: confidence by partial DPI ( #1632 )
...
Used for all classifications based on partial/incomplete DPI
information, i.e. all classifications done in `ndpi_detection_giveup()`.
2022-07-04 13:56:51 +02:00
Ivan Nardi
4445989588
Update host content list match ( #1633 )
...
Improve classifications of Outlook, Cachefly, Cloudflare, Tiktok and
Cybersecurity.
2022-07-04 13:21:11 +02:00
Toni
a1de0285eb
Sync Psiphon unit test. ( #1634 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-04 13:20:44 +02:00
Toni
75f7da5c26
Added Psiphon detection patterns. See #566 and #1099 . ( #1631 )
...
* The traces are not up to date, but this is the best we got so far.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-04 10:34:54 +02:00
Ivan Nardi
192a32207c
OCSP: improve detection ( #1629 )
2022-07-04 07:22:56 +02:00
Toni
a74fc089c4
Added i3D and RiotGames protocol dissectors. ( #1609 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-03 20:43:30 +02:00
Ivan Nardi
faaff58620
TargusDataspeed: avoid false positives ( #1628 )
...
TargusDataspeed dissector doesn't perform any real DPI checks but it only
looks at the TCP/UDP ports.
Delete it, and use standard logic to classify these flows by port.
2022-07-03 20:28:58 +02:00
Ivan Nardi
50c0212df1
Update ASN/IPs lists ( #1627 )
2022-07-03 19:50:47 +02:00
Ivan Nardi
b5fb2066cb
bins: add support for 64bit bins ( #1626 )
2022-07-03 19:25:15 +02:00
Ivan Nardi
422d002542
Skinny: rework and improve classification ( #1625 )
2022-07-03 19:25:00 +02:00
Ivan Nardi
eed47acfc8
Skype_Teams, Mining, SnapchatCall: fix flow category ( #1624 )
2022-07-03 18:51:16 +02:00
Ivan Nardi
77ac58e553
Minor changes in how classification results are set ( #1623 )
...
Protocol classification should always be set via
`ndpi_set_detected_protocol()`: this way, the values in
`flow->detected_protocol_stack[]` are always coherent.
2022-07-03 18:45:24 +02:00
Ivan Nardi
060e894d5b
Usenet: improve dissection ( #1622 )
2022-07-03 18:08:04 +02:00
Ivan Nardi
fdb1649a49
Fix category for mail sessions ( #1621 )
...
Close #629
2022-07-03 17:47:58 +02:00
Ivan Nardi
5fe6087686
TLS: add support for old DTLS versions and for detection of mid-sessions ( #1619 )
2022-07-03 17:44:17 +02:00
Ivan Nardi
5f6fa6d164
Fix a compilation warning ( #1620 )
...
With clang-15 (nightly build)
```
In file included from ndpi_bitmap.c:39:
./third_party/src/roaring.cc:14233:13: warning: variable 'run_count' set but not used [-Wunused-but-set-variable]
int run_count = 0;
```
2022-07-03 17:43:38 +02:00
Toni Uhlig
69ccb39741
Generate profiling results as PNG.
...
* use -ltcmalloc_and_profiler and try to get rid of LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libprofiler.so
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-03 17:38:43 +02:00
lns
f2d1edbedf
gprof test/CI integration
...
Signed-off-by: lns <matzeton@googlemail.com >
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-03 17:38:43 +02:00
Toni
1a01e8dc68
Improved TFTP. Dissect Read/Write Request filenames. ( #1617 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-03 14:37:05 +02:00
Toni
5ca82ad84b
Added TSAN support. ( #1613 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-03 14:35:21 +02:00
Toni
59b00b00a7
Fix byte-order issue during ndpiReader tcp/udp src/dst port serialization. Fixes #1608 . ( #1614 )
...
* fixed possible memory leak caused by an invalid call to `node_proto_guess_walker()` during serialization
* execute serialization code while running regression tests
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-03 11:16:52 +02:00
Toni
7c5c811eb0
Added Cloudflare WARP detection patterns. ( #1615 ) ( #1616 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-02 14:57:56 +02:00
Luca Deri
008a1790e4
Fixed SMTP default port 587
2022-07-02 11:49:22 +02:00
Toni
bb72aa4767
Added TunnelBear VPN detection patterns. ( #1615 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-07-01 13:19:17 +02:00
Luca Deri
8f6a006e36
Updated (C)
2022-06-30 14:53:47 +02:00
Luca Deri
6cf7838295
Removed space from "Genshin Impact"
2022-06-30 14:50:05 +02:00
Toni
c96f4512fa
sync unit tests ( #1612 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-06-30 09:37:30 +02:00
Luca Deri
5f1caeb54e
Fix after the protocol name update
2022-06-28 17:26:11 +02:00
Luca
d393fb969d
Renamed Z39.50 -> Z3950 as the '.' breaks the naming convention
...
QUIC is a network protocol
2022-06-28 17:20:58 +02:00
Luca Deri
227ab5c105
Enhanced TLS risk info reported to users
2022-06-28 00:01:00 +02:00
Luca Deri
4296ec969a
Added default port for syslog TCP
2022-06-27 18:36:56 +02:00
Ivan Nardi
b2b61011ae
Fix compilation and sync unit tests results ( #1606 )
2022-06-20 14:27:13 +02:00
Luca Deri
ab09b8ce2e
Added unidirectional traffic flow risk
2022-06-20 00:22:13 +02:00
Toni
c287eb835b
Improved SOAP via HTTP. ( #1605 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-18 17:19:16 +02:00
Toni
6cd8f8cc6d
Improved GenshinImpact protocol dissector. ( #1604 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-18 15:11:59 +02:00
Toni
432de5eb57
Added collectd dissector (again). ( #1601 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-17 19:56:33 +02:00
Toni
9c8b2d63da
Replaced nDPI's internal hashmap with uthash. ( #1602 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-17 19:50:31 +02:00
Toni
20a29c393f
Improved IPSec/ISAKMP detection. ( #1600 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-16 09:16:18 +02:00
Luca
c43360f8e6
Added new test pcaps
2022-06-15 18:57:46 +02:00
claudio_burrafato and Toni
c73a0988cd
Add some statistics to ndpiReader ( #1587 )
...
* Add some statistics to ndpiReader
The purpose of this version of ndpiReader is too adding some other statistics printed by ndpiReader. In this simple version the domain names(in the flows) that are collected are:
flow-> ssh_tls.server_info
flow-> host_server_name
and are placed in a UT_hash_table, ordering them by number of occurrences.
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update example/ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
* Update ndpiReader.c
* Update ndpiReader.c
* Update ndpiReader.c
* Update ndpiReader.c
Co-authored-by: Toni <matzeton@googlemail.com >
2022-06-15 16:36:25 +02:00
Ivan Nardi
e2cc08bfe5
Add support for PIM (Protocol Indipendent Multicast) protocol ( #1599 )
...
Close #1598
2022-06-15 12:25:26 +02:00
Toni
d1773cc8e3
Improved WhatsApp detection. ( #1595 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-14 20:06:48 +02:00
Ivan Nardi
bdf54d725b
Fix invalid memory access ( #1596 )
...
We can access `flow->protos` union only after checking the protocol.
Checking `flow->detected_protocol.master_protocol` is redundant because
we already check it in `is_ndpi_proto`
```
AddressSanitizer:DEADLYSIGNAL
=================================================================
==29739==ERROR: AddressSanitizer: SEGV on unknown address 0x000000353820 (pc 0x7f9b64dd2717 bp 0x7fff161a52f0 sp 0x7fff161a4aa8 T0)
==29739==The signal is caused by a READ memory access.
#0 0x7f9b64dd2717 /build/glibc-SzIz7B/glibc-2.31/string/../sysdeps/x86_64/multiarch/strlen-avx2.S:96
#1 0x555c65e597d8 in __interceptor_strlen (/home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader_with_main+0x6407d8) (BuildId: 11ac8ec30f1d49fb0276c9b03368e491505d2bba)
#2 0x555c65fd85fa in ndpi_strdup /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:269:13
#3 0x555c65f3e8c6 in process_ndpi_collected_info /home/ivan/svnrepos/nDPI/example/reader_util.c:1188:36
#4 0x555c65f52cab in packet_processing /home/ivan/svnrepos/nDPI/example/reader_util.c:1567:2
#5 0x555c65f4b632 in ndpi_workflow_process_packet /home/ivan/svnrepos/nDPI/example/reader_util.c:2110:10
#6 0x555c65f04d29 in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:109:7
#7 0x555c65f054bb in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:181:17
#8 0x7f9b64c6e082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16
#9 0x555c65e4253d in _start (/home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader_with_main+0x62953d) (BuildId: 11ac8ec30f1d49fb0276c9b03368e491505d2bba)
```
Found by oss-fuzzer.
See: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=48020
2022-06-14 11:44:32 +02:00
Ivan Nardi
8dcaa5c0e1
DNS: fix TTL check and sync unit test results ( #1594 )
2022-06-14 09:29:16 +02:00
Luca Deri
defe7d7f79
Updated DNS alert triggered only with TTL == 0
2022-06-14 00:13:05 +02:00
Luca Deri
831562c141
Restored ndpi_set_proto_defaults() prototype
...
Updated test results
2022-06-13 23:53:32 +02:00
Luca Deri
7a172ce11e
Added check for DGA names that resolve to a valid record
2022-06-13 23:42:07 +02:00
Luca Deri
cf5873ffd7
Improved DNS traffic analysis
...
Added ability to identify application and network protocols
2022-06-13 23:19:47 +02:00
Luca Deri
32428026d6
Added DNS record TTL check
2022-06-13 17:05:56 +02:00
Toni
df0ff9bcbd
Added gprof CPU/HEAP profiling support. ( #1592 )
...
* Some small auto{conf,make} improvements
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-12 21:00:41 +02:00
Toni
341f58fd80
Removed Makefile references to legacy code. ( #1589 )
...
- feature removed with f5545a80f9
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-08 13:37:11 +02:00
Luca Deri
11babc7ea3
Added Pragmatic General Multicast (PGM) protocol detection
2022-06-08 09:11:22 +02:00
Toni
bb3c2e82de
Dissect host line if SSDP contains such. ( #1586 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-07 11:15:47 +02:00
Toni
938e89ca33
Reimplemented 1kxun application protocol. ( #1585 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-06 18:04:49 +02:00
Toni
df78e67518
Prevent compilation failure if, for whatever reason, NDPI_API_VERSION is empty. ( #1584 )
...
- This is not a fix for #1494 , just an improvment.
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-06 15:53:48 +02:00
Toni
0b3f8ed849
Fixed syslog false negatives. ( #1582 )
...
- RSH vs Syslog may still happen for midstream traffic
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-05 23:01:56 +02:00
Ivan Nardi
1d492c9ed8
Fix some debug messages ( #1583 )
...
Increase max number of flows handled during fuzzing
2022-06-05 14:45:21 +02:00
Luca Deri
59c084b166
Updated test results
2022-06-05 11:34:10 +02:00
Luca Deri
2202365b95
Fixed invalid DHCP dissection
2022-06-05 11:19:28 +02:00
Luca Deri
b6ae9642d3
Fixed DHCP dissection bug
2022-06-05 11:14:23 +02:00
Toni
7419cfee64
Added RSH dissector. Fixes #202 . ( #1581 )
...
- added syslog false-positive pcap that was missing in 09fbe0a64a
- added NDPI_ARRAY_LENGTH() macro, usable on `type var[]` declarations
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-04 19:12:53 +02:00
Ivan Nardi
338427d712
Add support for GoTo products (mainly GoToMeeting) ( #1580 )
...
There is some overlap with Citrix protocol.
2022-06-04 14:30:52 +02:00
Toni
ff8e1e197e
Fix syslog heap overflow introduced in 09fbe0a64a. ( #1579 )
...
- fixes #1578
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-04 08:47:47 +02:00
Toni
09fbe0a64a
Fixed syslog false positives. ( #1577 )
...
* syslog: removed unnecessary/unreliable printable string check
* added `ndpi_isalnum()`
* splitted `ndpi_is_printable_string()` into `ndpi_is_printable_buffer()` and `ndpi_normalize_printable_string()`
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-03 18:21:29 +02:00
Toni
6149c0f880
Fix heap buffer overflow mentioned in #1574 . ( #1576 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-06-02 13:07:09 +02:00
Ivan Nardi
4ff1bf29df
TLS: fix use-of-uninitialized-value error ( #1573 )
...
Proper fix for the error already reported in 9040bc74
```
Uninitialized bytes in __interceptor_strlen at offset 3 inside [0x7ffc7a147390, 4)
==111876==WARNING: MemorySanitizer: use-of-uninitialized-value
#0 0x55e3e4f32e5b in ndpi_strdup /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:268:13
#1 0x55e3e4ef7391 in ndpi_set_risk /home/ivan/svnrepos/nDPI/src/lib/ndpi_utils.c:2254:12
#2 0x55e3e5022fdf in processClientServerHello /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:1523:8
#3 0x55e3e503af44 in processTLSBlock /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:865:5
#4 0x55e3e50397cd in ndpi_search_tls_tcp /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:1024:2
#5 0x55e3e503570c in ndpi_search_tls_wrapper /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:2453:5
#6 0x55e3e4f84a6a in check_ndpi_detection_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5150:6
#7 0x55e3e4f85778 in check_ndpi_tcp_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5198:12
#8 0x55e3e4f851e1 in ndpi_check_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5217:12
#9 0x55e3e4f96c7a in ndpi_detection_process_packet /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:6076:15
#10 0x55e3e4ed91ef in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:29:5
#11 0x55e3e4eda27e in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:101:17
#12 0x7f5cb3146082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16
#13 0x55e3e4e5140d in _start (/home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet_with_main+0xa340d) (BuildId: 0c02c433e039970dd13a60382b94dd5a8e19f625)
```
2022-06-02 00:15:52 +02:00
Toni
eac11030ac
Removed README.nDPI as it does not provide any new information not covered by README.md ( #1572 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-31 22:11:48 +02:00
Toni
00c62a7c3c
Removed LGTM ql query for packet payload integer arithmetic. ( #1570 )
...
* Detection is unreliable and results in too much false-positives (and false-negatives!)
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-31 16:46:44 +02:00
Toni
d8d806c79f
Force roaring bitmap to use ndpi memory wrappers. ( #1569 )
...
GCC analyzer won't complain about possible use-after-free (false positive).
* tests/do.sh prints word diff's only once and not the same over and over again
* sync unit tests
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-31 12:06:01 +02:00
Ivan Nardi
9040bc74c9
TLS: fix stack-buffer-overflow error ( #1567 )
...
```
==300852==ERROR: AddressSanitizer: stack-buffer-overflow on address 0x7f108951f060 at pc 0x5641db0ee78c bp 0x7fff3b10b910 sp 0x7fff3b10b0d0
WRITE of size 116 at 0x7f108951f060 thread T0
#0 0x5641db0ee78b in __interceptor_strncpy (/home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet_with_main+0x64e78b) (BuildId: 23cb34bbaf8ac11eb97563bbdc12e29ead9fb0fa)
#1 0x5641db28efad in tlsCheckUncommonALPN /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:1224:7
#2 0x5641db27ec76 in processClientServerHello /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:1533:6
#3 0x5641db295677 in processTLSBlock /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:865:5
#4 0x5641db2935bb in ndpi_search_tls_tcp /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:1024:2
#5 0x5641db28f692 in ndpi_search_tls_wrapper /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:2446:5
#6 0x5641db1d87ce in check_ndpi_detection_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5150:6
#7 0x5641db1d91e4 in check_ndpi_tcp_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5198:12
#8 0x5641db1d8e87 in ndpi_check_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5217:12
#9 0x5641db1eb4a7 in ndpi_detection_process_packet /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:6076:15
#10 0x5641db140b45 in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:29:5
#11 0x5641db14130b in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:101:17
#12 0x7f108bcab082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16
#13 0x5641db07f46d in _start (/home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet_with_main+0x5df46d) (BuildId: 23cb34bbaf8ac11eb97563bbdc12e29ead9fb0fa)
Address 0x7f108951f060 is located in stack of thread T0 at offset 96 in frame
#0 0x5641db28ec4f in tlsCheckUncommonALPN /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:1204
This frame has 1 object(s):
[32, 96) 'str' (line 1218) <== Memory access at offset 96 overflows this variable
HINT: this may be a false positive if your program uses some custom stack unwind mechanism, swapcontext or vfork
(longjmp and C++ exceptions *are* supported)
SUMMARY: AddressSanitizer: stack-buffer-overflow (/home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet_with_main+0x64e78b) (BuildId: 23cb34bbaf8ac11eb97563bbdc12e29ead9fb0fa) in __interceptor_strncpy
Shadow bytes around the buggy address:
```
Avoid zeroing the entire string.
Found by oss-fuzzer
See: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=47730
2022-05-31 10:33:42 +02:00
Luca Deri
354addd693
Updated risk results
2022-05-30 23:28:59 +02:00
Luca Deri
b306a4b8ed
Improved message for known proto on non std port
2022-05-30 23:23:18 +02:00
Luca Deri
b3bf695723
Added check
2022-05-30 22:39:23 +02:00
Toni
00ee364a7e
Updated README.md ( #1562 )
...
* make check great again (not so much)
* make doc/doc-view
* CI updates
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-30 19:48:05 +02:00
Ivan Nardi
ca115774c9
TLS: fix use-of-uninitialized-value error ( #1566 )
...
```
Uninitialized bytes in __interceptor_strlen at offset 0 inside [0x7ffc987443a0, 7)
==282918==WARNING: MemorySanitizer: use-of-uninitialized-value
#0 0x5651277e001b in ndpi_strdup /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:268:13
#1 0x5651277a45c1 in ndpi_set_risk /home/ivan/svnrepos/nDPI/src/lib/ndpi_utils.c:2254:12
#2 0x5651278cfaa6 in processClientServerHello /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:1515:8
#3 0x5651278e7834 in processTLSBlock /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:865:5
#4 0x5651278e60bd in ndpi_search_tls_tcp /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:1024:2
#5 0x5651278e1ffc in ndpi_search_tls_wrapper /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:2445:5
#6 0x565127831c2a in check_ndpi_detection_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5150:6
#7 0x565127832938 in check_ndpi_tcp_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5198:12
#8 0x5651278323a1 in ndpi_check_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5217:12
#9 0x565127843e3a in ndpi_detection_process_packet /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:6076:15
#10 0x56512778641f in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:29:5
#11 0x5651277874ae in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:101:17
#12 0x7f4c46794082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16
#13 0x5651276fe40d in _start (/home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet_with_main+0xa340d)
```
Found by oss-fuzzer
See: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=47728
2022-05-30 19:40:47 +02:00
Luca Deri
912b69af60
Redefined type name to avoid conflicts
2022-05-30 18:29:08 +02:00
Luca
34ede63c15
Added ability to return risk info in JSON format in ndpi_get_flow_risk_info()
2022-05-30 17:54:30 +02:00
Toni
48065d80e9
Support word diff for tests/do.sh for better readability. ( #1565 )
...
* Sync unit tests
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-30 17:33:03 +02:00
Toni
32750271c3
Prohibit MPEG-DASH to set HTTP as application protocol. ( #1560 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-30 14:54:27 +02:00
Ivan Nardi
c4f50b2cda
HTTP: fix heap-buffer-overflow error ( #1564 )
...
```
==222479==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x60b000014739 at pc 0x55af06f2364f bp 0x7ffd7b6f4bf0 sp 0x7ffd7b6f4378
READ of size 12 at 0x60b000014739 thread T0
#0 0x55af06f2364e in printf_common(void*, char const*, __va_list_tag*) asan_interceptors.cpp.o
#1 0x55af06f24f70 in __interceptor_snprintf (/home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader_with_main+0x613f70) (BuildId: f6545ec2bd7663bc3f16aeeb87bddc64d173a2a8)
#2 0x55af0720927f in ndpi_check_http_header /home/ivan/svnrepos/nDPI/src/lib/protocols/http.c:982:2
#3 0x55af071f4797 in ndpi_check_http_tcp /home/ivan/svnrepos/nDPI/src/lib/protocols/http.c:1219:5
#4 0x55af071f05c5 in ndpi_search_http_tcp /home/ivan/svnrepos/nDPI/src/lib/protocols/http.c:1402:3
#5 0x55af07080d1e in check_ndpi_detection_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5150:6
#6 0x55af07081734 in check_ndpi_tcp_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5198:12
#7 0x55af070813d7 in ndpi_check_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5217:12
#8 0x55af070939f7 in ndpi_detection_process_packet /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:6076:15
#9 0x55af06fc7e1f in packet_processing /home/ivan/svnrepos/nDPI/example/reader_util.c:1541
#10 0x55af06fc7e1f in ndpi_workflow_process_packet /home/ivan/svnrepos/nDPI/example/reader_util.c:2110
#11 0x55af06fc2859 in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:109:7
#12 0x55af06fc2feb in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:181:17
#13 0x7efe5eaac082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16
#14 0x55af06f0055d in _start (/home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader_with_main+0x5ef55d) (BuildId: f6545ec2bd7663bc3f16aeeb87bddc64d173a2a8)
0x60b000014739 is located 0 bytes to the right of 105-byte region [0x60b0000146d0,0x60b000014739)
allocated by thread T0 here:
#0 0x55af06f84bae in malloc (/home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader_with_main+0x673bae) (BuildId: f6545ec2bd7663bc3f16aeeb87bddc64d173a2a8)
#1 0x55af06fc2673 in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:103:31
#2 0x55af06fc2feb in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:181:17
#3 0x7efe5eaac082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16
```
Fiund by oss-fuzzer.
See: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=47724
2022-05-30 14:39:01 +02:00
Ivan Nardi
3b825fca6d
Certificate timestamps should be printed in UTC ( #1563 )
...
This way, the CI results are consistent
2022-05-30 13:43:05 +02:00
Luca Deri
897f8314b2
Fixed dispay bug for risk_info
2022-05-30 01:12:38 +02:00
Luca Deri
1da9f1a36f
Updated tests results
...
Code cleanup
2022-05-30 00:54:17 +02:00
Luca Deri
f25deeccb1
Added RiskInfo string
2022-05-30 00:32:32 +02:00
Ivan Nardi
a9d7cc4841
Fix dissection of IPv4 header ( #1561 )
...
See: https://github.com/ntop/nDPI/runs/6643914510?check_suite_focus=true
Convert al the `MIN(a,b)` calls to `ndpi_min(a,b)`
2022-05-29 22:39:48 +02:00
Ivan Nardi
9c1a53f39f
Dazn: add support for Dazn streaming service ( #1559 )
...
Update .gitignore file
2022-05-29 17:47:16 +02:00
Luca Deri
406ac81a37
Compilation fixes for old ggc's
2022-05-29 16:40:16 +02:00
Luca Deri
dfbe863f4e
Comment
2022-05-29 16:35:08 +02:00
Luca Deri
1093aafa5f
Added detection for WordPress exploits
...
Fixed ndpi_iph_is_valid_and_not_fragmented() that was bugged with non UDP traffic
2022-05-29 16:31:26 +02:00
Toni
6b7b23b01d
Use Doxygen to generate the API documentation. ( #1558 )
...
* Integrated Doxygen documentation into Sphinx
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-29 13:44:52 +02:00
Toni
33f9729ee4
Added MPEG-DASH dissector. Fixes #1223 . ( #1555 )
...
* Improved HTTP POST detection
* Refactored subprotocol detection
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-29 13:12:13 +02:00
Toni
cfd23e8819
Fixed HTTP lower/upper protocol mess for Aimini/IPP. ( #1557 )
...
* If HTTP was already detected, there is no need to overwrite the detection again
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-28 16:31:35 +02:00
Luca Deri
77dc884a4c
Compilation fixes for old gcc compiler
2022-05-28 16:06:34 +02:00
Luca Deri
7e3d061428
Compilation fixes
2022-05-27 17:35:30 +02:00
Luca Deri
6d543808ad
Version cut fix
2022-05-27 16:58:39 +02:00
Luca Deri
02ba12b0de
Fixes compilation issues on RedHat systems
2022-05-26 23:34:34 +02:00
Ivan Nardi
f81f0c5e69
Sync unit test results ( #1554 )
2022-05-26 20:15:30 +02:00
Luca Deri
cedbd32030
Updated SkypeCall -> Skype_TeamsCall
2022-05-26 19:27:12 +02:00
Luca Deri
1645fea85c
Fixed false positives with NATS
2022-05-26 19:01:13 +02:00
Toni
78dfe959cb
Added script to compare and verify the output of `make dist'. ( #1551 )
...
This fixes some build/test issues resulting when using tarballs.
* nDPI uses autotools (especially autoconf) in a wrong way, see #1163
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-26 15:07:22 +02:00
Toni
9614b66b44
Replaced obsolete autoconf macros. ( #1553 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-26 11:31:09 +02:00
Toni
7010d17ccc
Fixed windows-latest build error. ( #1552 )
...
* The warning itself looks like a bug
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-26 10:19:57 +02:00
Luca Deri
83e1ea2506
Improved invalid host detection
2022-05-24 21:17:33 +02:00
Luca Deri
0c703ef8eb
Added invalid SNI check in QUIC
2022-05-24 19:51:49 +02:00
Luca Deri
4f9dee164e
Improved detection of invalid SNI and hostnames in TLS, HTTP
2022-05-24 19:47:54 +02:00
Luca Deri
2560260a41
Added room for storing information used by custom third-party dissectors
2022-05-19 23:24:42 +02:00
lns
8b750686c9
Moved RTSP http patterns to the protocol source file.
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-19 19:58:11 +02:00
Toni Uhlig
dae7986a37
Yet another approach to fix #1499 (basically a copy&pasta from @socketpair).
...
* Related to #1545 , #1494 and #1189 as well
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-05-16 16:54:18 +02:00
Toni Uhlig
3c08a3c875
Removed MacOS XCode integration.
...
* It is outdated (from 2018) and will most likely not work anymore
due to changed protocol files and outdated API usage in the example integration
* Removal is the only option besides fixing those issues and
provide a CI integration for future automatic checks
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-05-16 16:54:18 +02:00
Toni Uhlig
7162bf6abf
Moved mgcp.pcapng to tests/pcap/ instead of tests/
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-05-16 16:54:18 +02:00
Ivan Nardi
f822aad8b0
DNS-over-QUIC: update default port ( #1548 )
...
Final RFC (https://www.rfc-editor.org/rfc/rfc9250.txt ) changed the
default port to 853 (from the 784 used on the early drafts).
Since there is at least one deployed implementation still stuck at
draft-02, keep also the old value, for the time being.
2022-05-12 14:31:26 +02:00
Toni
054d151373
Improved Viber (TCP) detection. ( #1547 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-10 21:37:03 +02:00
Toni
704920414a
Improved Xiaomi HTTP detection. ( #1546 )
...
* Merged Xiaomi pcap files
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-10 11:10:04 +02:00
Toni
6fc29b3ae8
Removed TLS patterns in the CiscoVPN aka Anyconnect dissector as mentioned in PR #1534 . ( #1543 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-09 10:29:52 +02:00
Toni
915ffebade
Added Softether(-VPN) DDNS service detection. ( #1544 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-09 08:16:19 +02:00
Toni
4319d760e0
Improved TLS alert detection. ( #1542 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-08 20:33:59 +02:00
Toni
34882d9cf0
Improved TLS application data detection. ( #1541 )
...
* #1532 did fx TLS appdata detection only partially
* use flow->l4.tcp.tls.message.buffer_used instead of packet->payload
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-08 19:56:08 +02:00
Toni
b2648a45a3
Added Edgecast and Cachefly CDNs. ( #1540 )
...
* Improved ASN update script
* Ran `utils/update_every_lists.sh'
* `tests/do.sh.in' prints the amount of failed pcap(s)
* `utils/asn_update.sh' prints the amount of failed download(s)
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-07 09:33:25 +02:00
Toni
87f93ea4fd
Replaced ndpiReader's libjson-c support with libnDPI's internal serialization interface. ( #1535 )
...
* Fixes #1528
* Serialization Interface should also fuzzed
* libjson-c may only be used in the unit test to verify the internal serialization interface
* Serialization Interface supports tlv(broken), csv and json
* Unit test does work again and requires libjson-c
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-07 09:26:09 +02:00
Ivan Nardi
2e0dedbaae
Fix compilation (if --enable-debug-messages is used) ( #1539 )
2022-05-04 18:43:37 +02:00
Luca Deri
434c38c74d
Added extra check to make sure that the guessed protocol is the one we expect and not another one
2022-05-04 16:27:36 +02:00
Luca Deri
5996cf1725
Fixes bug that prevents triggering alerts for traffic on non-standard ports that have been defined in the custom protocols file
...
Fixes https://github.com/ntop/ntopng/issues/6458
2022-05-04 16:07:05 +02:00
Luca Deri
81a367f1ae
Fixes outdated description
2022-05-04 16:06:50 +02:00
Luca Deri
5dcb9c1c16
Modified risk labels
2022-05-04 12:10:01 +02:00
Toni
d5b922cfe4
Added some Pluralsight Hostnames/SNIs. May fix #1501 . ( #1538 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-03 13:20:44 +02:00
Luca Deri
65dd052a61
Updated RRD dependencies
2022-05-03 12:37:22 +02:00
Toni
47d6a65522
Improved suspicious http user agent detection. ( #1537 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-05-02 19:17:32 +02:00
Luca Deri
c8f72ef764
Added ndpi_get_flow_error_code() API call
...
Fixed typo
2022-05-02 10:51:08 +02:00
Toni
02d0b5fe13
Improved AES-NI check. ( #1536 )
...
* A library should not open a subshell
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-30 20:46:20 +02:00
Luca Deri
e4318ffc2d
Improved AES-NI check on Linux to avoid crashes on CPUs that do
...
not support it (e.g. Intel Celeron N2930)
2022-04-29 14:50:21 +02:00
Ivan Nardi
71636dcafd
Sync unit tests results ( #1533 )
2022-04-27 18:22:11 +02:00
Toni
10161448bc
Improved TLS application data detection. ( #1532 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-27 17:22:53 +02:00
Luca Deri
3ad989f6a8
Added BPF filtering for discarding non-IP packets
2022-04-27 17:05:33 +02:00
Luca Deri
3d755fce73
String messages have been shrinked
2022-04-27 10:28:06 +02:00
Luca Deri
a7c1152397
Added ability to store custom category file in patricia tree
2022-04-26 14:42:31 +02:00
Alfredo Cardigliano
e8d81123cc
Add ndpi_json_string_escape to the API
2022-04-26 12:25:34 +02:00
Ivan Nardi
d5005f584c
Raknet: fix heap-buffer-overflow ( #1531 )
...
```
==120637==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x606000000488 at pc 0x55a0598d97ec bp 0x7ffcfe13f2e0 sp 0x7ffcfe13f2d8
READ of size 2 at 0x606000000488 thread T0
#0 0x55a0598d97eb in ndpi_search_raknet /home/ivan/svnrepos/nDPI/src/lib/protocols/raknet.c:152:38
#1 0x55a05966c48e in check_ndpi_detection_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5060:6
#2 0x55a05966e428 in check_ndpi_udp_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5119:10
#3 0x55a05966dddc in ndpi_check_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5152:12
#4 0x55a05967fa7a in ndpi_detection_process_packet /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5971:15
#5 0x55a05962b860 in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:24:3
#6 0x55a05962bd9b in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:84:17
#7 0x7f4aad7d80b2 in __libc_start_main /build/glibc-sMfBJT/glibc-2.31/csu/../csu/libc-start.c:308:16
#8 0x55a05956b46d in _start (/home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet_with_main+0x5d746d) (BuildId: 9429d3d08edc3836e5536f93c07f140716d8b82e)
0x606000000488 is located 9 bytes to the right of 63-byte region [0x606000000440,0x60600000047f)
allocated by thread T0 here:
#0 0x55a0595ee80e in malloc (/home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet_with_main+0x65a80e) (BuildId: 9429d3d08edc3836e5536f93c07f140716d8b82e)
#1 0x55a05962bd06 in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:70:17
#2 0x7f4aad7d80b2 in __libc_start_main /build/glibc-sMfBJT/glibc-2.31/csu/../csu/libc-start.c:308:16
```
Found by oss-fuzz
See: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=47000
2022-04-25 19:01:11 +02:00
Toni
bc2ad3407a
Added generic user agent setter. ( #1530 )
...
* ndpiReader: Print user agent if one was set and not just for certain protocols.
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-25 13:00:50 +02:00
Ivan Nardi
075bce5f3d
XIAOMI: add detection of Xiaomi traffic ( #1529 )
...
Most of the credits should go to @utoni (see #1521 )
2022-04-25 11:00:02 +02:00
Toni
ac0f50b561
Added RakNet protocol dissector. ( #1527 )
...
* Frame Set PDU's do not get fully dissected for the sake of simplicity
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-24 13:08:57 +02:00
Luca Deri
9d31b7450b
Code cleanup (removed redundancy)
2022-04-22 19:03:50 +02:00
Toni
d5ae9170ba
Tiny gnutella improvement if gtk-gnutella used. ( #1525 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-22 18:33:27 +02:00
Toni
824c343602
Updated `utils/whatsapp_ip_addresses_download.sh' to scrape the required IP addresses/ranges. ( #1524 )
...
* Replaced return statements in `utils/*.sh' with exit's (such scripts should never source'd)
* Ran `utils/update_every_lists.sh'
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-22 13:27:41 +02:00
Ivan Nardi
42909673ce
Add some scripts to easily update some IPs lists ( #1522 )
...
Follow-up of 8b062295
Add a new protocol id for generic Tencent/Wechat flows
2022-04-21 20:43:52 +02:00
Toni
ddc256b09e
Reduce ndpiReader's -h' spam. -H' does this job now. ( #1523 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-21 20:43:36 +02:00
Toni
c1d46ebc4e
Added proprietary Agora Software Defined Real-time Network (SD-RTN) protocol dissector. ( #1520 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-20 18:31:28 +02:00
Toni
dbf2fb8c9f
Added Toca Boca protocol dissector. ( #1517 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-19 19:32:49 +02:00
Toni
a83ca555fb
Removed superfluous ifdef'd includes. ( #1519 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-19 17:51:48 +02:00
Toni
fa79f07d15
Improved sflow protocol detection false-positives. ( #1518 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-19 17:46:40 +02:00
Ivan Nardi
739dfc54b0
Kerberos: fix Undefined-shift error ( #1516 )
...
Similar to the error fixed in 4775be3d
Found by oss-fuzz.
See: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=46713
2022-04-18 20:54:13 +02:00
Luca Deri
8b2c9860be
DGA improvements
2022-04-16 09:56:08 +02:00
Zied Aouini
9c8a3f270a
Minor fix.
2022-04-15 18:01:34 +02:00
Zied Aouini
fba75a3cf5
Merge pull request #1491 from utoni/fix/windows-msys2
...
Fixed msys2 build and re-activated CI Mingw-w64 build.
2022-04-15 13:22:25 +02:00
Toni Uhlig
c3df3a12aa
Fixed msys2 build warnings and re-activated CI Mingw64 build.
...
* Removed Visual Studio leftovers. Maintaining an autotools project with VS integration requires some additional overhead.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-14 19:17:48 +02:00
Ivan Nardi
4775be3d85
Kerberos: fix some memory access errors ( #1514 )
...
```
==19724==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x60e00000045e at pc 0x5620b8b3d3cc bp 0x7ffe0fda6b50 sp 0x7ffe0fda6310
READ of size 2 at 0x60e00000045e thread T0
#0 0x5620b8b3d3cb in __interceptor_strncpy (/home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet_with_main+0x63f3cb) (BuildId: ee53ff920c8cd4c226d8520a0d4846d8864726b6)
#1 0x5620b8d9b69c in strncpy_lower /home/ivan/svnrepos/nDPI/src/lib/protocols/kerberos.c:208:4
#2 0x5620b8d995a0 in krb_parse /home/ivan/svnrepos/nDPI/src/lib/protocols/kerberos.c:316:5
#3 0x5620b8d97a90 in ndpi_search_kerberos /home/ivan/svnrepos/nDPI/src/lib/protocols/kerberos.c:687:12
#4 0x5620b8bcef35 in check_ndpi_detection_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:4996:4
#5 0x5620b8bd1be8 in check_ndpi_udp_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5072:10
#6 0x5620b8bd159c in ndpi_check_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5105:12
#7 0x5620b8be323a in ndpi_detection_process_packet /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5924:15
#8 0x5620b8b8f7e0 in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:24:3
#9 0x5620b8b8fd1b in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:84:17
#10 0x7f45b32b90b2 in __libc_start_main /build/glibc-sMfBJT/glibc-2.31/csu/../csu/libc-start.c:308:16
#11 0x5620b8acf47d in _start (/home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet_with_main+0x5d147d) (BuildId: ee53ff920c8cd4c226d8520a0d4846d8864726b6)
0x60e00000045e is located 0 bytes to the right of 158-byte region [0x60e0000003c0,0x60e00000045e)
allocated by thread T0 here:
#0 0x5620b8b5283e in malloc (/home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet_with_main+0x65483e) (BuildId: ee53ff920c8cd4c226d8520a0d4846d8864726b6)
#1 0x5620b8b8fc86 in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_process_packet.c:70:17
#2 0x7f45b32b90b2 in __libc_start_main /build/glibc-sMfBJT/glibc-2.31/csu/../csu/libc-start.c:308:16
```
```
protocols/kerberos.c:79:52: runtime error: left shift of 255 by 24 places cannot be represented in type 'int'
```
Found by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=46670
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=46636
2022-04-13 18:10:56 +02:00
Luca Deri
e00997ea7c
Extended list of cybersecurity domains
2022-04-13 18:05:29 +02:00
Wayne and 林文烽
939572c61e
fix(ndpi_main):Fix memory leak about ndpi_str; ( #1513 )
...
Co-authored-by: 林文烽 <wenfeng.lin@baishan.com >
2022-04-12 15:34:37 +02:00
Ivan Nardi
06a0abb6fd
TINC: fix invalid memory read ( #1512 )
...
```
=================================================================
==19324==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x60600061be96 at pc 0x55b4a4cb4460 bp 0x7ffc7b461a70 sp 0x7ffc7b461a68
READ of size 1 at 0x60600061be96 thread T0
#0 0x55b4a4cb445f in ndpi_check_tinc /home/ivan/svnrepos/nDPI/src/lib/protocols/tinc.c:105:9
#1 0x55b4a4cb1888 in ndpi_search_tinc /home/ivan/svnrepos/nDPI/src/lib/protocols/tinc.c:135:5
#2 0x55b4a4b4a6e1 in check_ndpi_detection_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5013:6
#3 0x55b4a4b4c2d4 in check_ndpi_tcp_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5084:12
#4 0x55b4a4b4bf77 in ndpi_check_flow_func /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5103:12
#5 0x55b4a4b5dcca in ndpi_detection_process_packet /home/ivan/svnrepos/nDPI/src/lib/ndpi_main.c:5924:15
#6 0x55b4a4a87734 in packet_processing /home/ivan/svnrepos/nDPI/example/reader_util.c:1519:31
#7 0x55b4a4a80761 in ndpi_workflow_process_packet /home/ivan/svnrepos/nDPI/example/reader_util.c:2093:10
#8 0x55b4a4a39c8d in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:107:7
#9 0x55b4a4a3a46b in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:179:17
#10 0x7f69c63760b2 in __libc_start_main /build/glibc-sMfBJT/glibc-2.31/csu/../csu/libc-start.c:308:16
#11 0x55b4a497954d in _start (/home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader_with_main+0x61654d) (BuildId: 705ebc5c412d267294a65cb01f03a1f012aeaf20)
0x60600061be96 is located 0 bytes to the right of 54-byte region [0x60600061be60,0x60600061be96)
allocated by thread T0 here:
[...]
```
Found by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=46499
2022-04-10 16:59:34 +02:00
Toni
e3faecf9de
Improved ASN.1 parsing for Keberos. Fixes #1492 . ( #1497 )
...
* This is a quick fix, the Kerberos protocol dissector requires some refactoring effort.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-10 10:36:10 +02:00
Vinicius Silva Nogueira
713cdd0b13
QUIC: handle retransmissions and overlapping fragments in reassembler ( #1195 ) ( #1498 )
...
* QUIC: handle retransmissions and overlapping fragments in reassembler
* Trigger CI
* minor fix: parentheses
* Changing ndpi_malloc to ndpi_calloc
* fix memory leak
* quic_reasm_buf calloc to malloc
* change order of is_ch_complete && is_reasm_buf_complete call
* is_reasm_buf_complete: added handling for case where frame size is not multiple of 8
* add extra check
2022-04-07 21:18:58 +02:00
aouinizied
9537788ade
Fix JSON-C.
2022-04-07 17:59:11 +02:00
aouinizied
ff993e2f57
Python bindings fix.
2022-04-07 17:54:41 +02:00
Luca Deri
a6e2f4a15a
Added ndpi_find_outliers() API call using Z-Score
2022-04-04 10:02:45 +02:00
Luca Deri
19019383f0
Added -z flag
2022-04-03 11:45:23 +02:00
Ivan Nardi
e0e231756c
ndpiReader: fix compilation ( #1510 )
...
Not sure why Windows started complaining... anyway, the fixes has been
taken from https://github.com/ntop/nDPI/pull/1491 : credits to @lnslbrty
2022-04-01 22:01:39 +02:00
Luca Deri
8080b3d14f
Removed un-necessary guess in mining
2022-04-01 19:23:13 +02:00
Luca Deri
9f3a6f131b
update
2022-04-01 19:07:46 +02:00
Luca Deri
32a7d42469
Fixed incompatibilities due to https://github.com/ntop/nDPI/pull/1509
2022-04-01 19:07:00 +02:00
Luca Deri
6eb5bd88a7
DGA improvements
2022-04-01 17:39:29 +02:00
Luca Deri
a75d77b536
Waring fixes
2022-04-01 17:35:25 +02:00
Vitaliy Ivanov
61bc9815d5
ndpireader: add json output back. ( #1509 )
...
- partial revert of:
commit 51cfdfb0d8
Author: Luca Deri <deri@ntop.org >
Date: Sun Nov 17 17:51:45 2019 +0100
Removed unused JSON-C code
- Json option is changed from 'j' to 'k' as it's used in the new codebase.
- use HAVE_LIBJSON_C instead of HAVE_JSON_C.
- tabs vs spaces clean ups.
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
Conflicts:
example/ndpiReader.c
2022-04-01 11:47:01 +02:00
Luca Deri
8238e68275
Improvements for CUSTOM_NDPI_PROTOCOLS
2022-04-01 09:02:05 +02:00
Luca Deri
1e8cdd893c
Moved geneated file to a separate folder
2022-04-01 08:58:53 +02:00
Luca Deri
0ff3e77c42
Improved twitter detection
2022-04-01 08:50:56 +02:00
Luca Deri
6677d692c4
Removed SRV record from suspicious DNS traffic
2022-03-31 11:32:30 +02:00
Luca Deri
98a548c642
Improved DGA detection
2022-03-31 11:29:30 +02:00
Darryl Sokoloski
46dc8b5bda
[autoconf] Fixed .git submodule detection test. ( #1507 )
...
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2022-03-31 03:21:51 +02:00
Luca Deri
4e199abd39
Added code for identifiying anomalies with metrics stored in InfluxDB
2022-03-30 22:12:39 +02:00
Ivan Nardi
6bcba118d4
reader_util: add support for userAgent in SSDP ( #1502 )
...
Update unit tests results
Follow-up of d668ab4b
2022-03-28 04:25:34 +02:00
Ivan Nardi
6acf7a6abe
Add support for Pluralsight site ( #1503 )
2022-03-27 15:13:12 +02:00
Ivan Nardi
ec80f1fb3b
Fix CI tests results ( #1504 )
...
CI integration is failing since 856d7d2 .
2022-03-27 15:12:39 +02:00
Vitaly Lavrov
4896dabb6b
Reducing the size of the ndpi_detection_module_struct structure. ( #1490 )
...
The ndpi_detection_module_struct structure contains 5 arrays "struct
ndpi_call_function_struct" size 286*144=41 kB size,
which are occupied by a small number of elements.
At the moment we have callback_buffer_size = 172, tcp_with_payload=114,
tcp_no_payload=8, udp=93, other 8.
NDPI_MAX_SUPPORTED_PROTOCOLS = 285.
Size of struct ndpi_detection_module_struct is 253136 bytes.
Size of all structs ndpi_call_function_struct 5*286*144=205920 bytes.
Real use memory size for struct ndpi_call_function_struct is
(173+224)*144=57168 bytes.
2022-03-27 12:00:21 +02:00
Darryl Sokoloski
d668ab4bec
[SSDP] Extract HTTP user-agent when available. ( #1500 )
...
[SSDP] Added capture file with UA header.
[SSDP] Added pcap test output log file.
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2022-03-27 11:10:44 +02:00
Luca Deri
856d7d2916
Improved DGA detection skipping names containign at least 3 consecutive digits in the first word
2022-03-26 09:59:55 +01:00
Ivan Nardi
aeb5f1f947
QUIC: add support for version 2 draft 01 ( #1493 )
...
Support for v2-00 has been removed (it has never been used in real
networks and it is incompatible with v2-01).
Chrome already supports v2-01 in latest versions in Chrome Beta channel.
2022-03-25 10:16:30 +01:00
Ivan Nardi
af1d20bca1
Mining: cleanup registration ( #1496 )
...
Use the same pattern of all the other dissectors: one registration and
one callback.
Spotted by @dsokoloski
2022-03-25 10:07:47 +01:00
Vinicius Silva Nogueira
26df1403e6
Trying to improve QUIC reassembler ( #1195 ) ( #1489 )
...
* handling QUIC out-of-order fragments
* minor fix
* updated quic_frags_ch_out_of_order_same_packet_craziness.pcapng.out
* quic test: buf_len + last_pos
* QUIC: comment update in __reassemble function and minor change is_ch_complete function
2022-03-24 10:51:31 +01:00
aouinizied
bb12837ca7
Update Python bindings guide.
2022-03-22 15:01:55 +01:00
aouinizied
c7059db84a
Fix typo.
2022-03-22 14:58:22 +01:00
aouinizied
1207ea118a
Add HOWTO Python.
2022-03-22 14:56:44 +01:00
aouinizied
c47d710d8e
Fix python bindings CI.
2022-03-22 13:40:31 +01:00
aouinizied
beef4f997b
Complete rework of nDPI Python bindings (cffi API, automatic generation, packaging and CI integration)
2022-03-22 13:19:27 +01:00
Luca Deri
93f723d50f
Extended the list of cybersecurity protocol
2022-03-21 15:12:50 +01:00
Vitaly Lavrov
8dd70b7023
Bug fixing. ( #1487 )
...
Using the protocol_id instead of its index.
2022-03-15 19:40:18 +01:00
Ivan Nardi
9e22c88e0a
QUIC: convert logs to standard mechanism ( #1485 )
2022-03-15 16:55:47 +01:00
Ivan Nardi
b83e9f20e7
QUIC: fix dissection of draft-34 ( #1484 )
...
QUIC-34 is probably not used in production, but fixing it is trivial and
it doesn't add any noise to the already complex QUIC code.
2022-03-09 22:37:56 +01:00
Ivan Nardi
7aee856aa0
Extend tests coverage ( #1476 )
...
Now there is at least one flow under `tests/pcap` for 249 protocols out
of the 284 ones supported by nDPI.
The 35 protocols without any tests are:
* P2P/sharing protocols: DIRECT_DOWNLOAD_LINK, OPENFT, FASTTRACK,
EDONKEY, SOPCAST, THUNDER, APPLEJUICE, DIRECTCONNECT, STEALTHNET
* games: CSGO, HALFLIFE2, ARMAGETRON, CROSSFIRE, DOFUS, FIESTA,
FLORENSIA, GUILDWARS, MAPLESTORY, WORLD_OF_KUNG_FU
* voip/streaming: VHUA, ICECAST, SHOUTCAST, TVUPLAYER, TRUPHONE
* other: AYIYA, SOAP, TARGUS_GETDATA, RPC, ZMQ, REDIS, VMWARE, NOE,
LOTUS_NOTES, EGP, SAP
Most of these protocols (expecially the P2P and games ones) have been
inherited by OpenDPI and have not been updated since then: even if they
are still used, the detection rules might be outdated.
However code coverage (of `lib/protocols`) only increases from 65.6% to
68.9%.
Improve Citrix, Corba, Fix, Aimini, Megaco, PPStream, SNMP and Some/IP
dissection.
Treat IPP as a HTTP sub protocol.
Fix Cassandra false positives.
Remove `NDPI_PROTOCOL_QQLIVE` and `NDPI_PROTOCOL_REMOTE_SCAN`:
these protocol ids are defined but they are never used.
Remove Collectd support: its code has never been called. If someone is
really interested in this protocol, we can re-add it later, updating the
dissector.
Add decoding of PPI (Per-Packet Information) data link type.
2022-03-09 22:37:35 +01:00
Toni
f646a4bce0
Improved ASN/IP update scripts and CI integration. ( #1474 )
...
* CI will print a warning if ASN/IP addresses changed.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-03-09 13:53:04 +01:00
Zied Aouini
74ae315e36
Implement CI on Windows. ( #1483 )
...
* Switch fail fast to True.
* Windows CI.
2022-03-09 10:57:21 +01:00
Ivan Nardi
269be6c7ef
Some small fixes ( #1481 )
...
FTP: if the authentication fails, stop analyzing the flow
WSD: call the initialization routine; the dissector code has never been
triggered
MINING: fix dissection
2022-03-08 00:21:51 +01:00
sharonenoch and Sharon Enoch
f91218360b
Extracting the Azure Origin url from the download link ( #1480 )
...
* Extracting the Azure Origin url from the download link
* Response code check to address double quotes
Co-authored-by: Sharon Enoch <sharone@amzetta.com >
2022-03-08 00:21:32 +01:00
Vitaly Lavrov
a1451935b8
Errors fixed ( #1482 )
...
Fixed errors for bigendian platforms in ndpiReader.
All address and port comparisons and hash calculations are done with
endian in mind.
The get_ndpi_flow_info() function searched for an existing flow for the
forward and reverse direction of the packet.
The ndpi_workflow_node_cmp() function looked for a flow regardless of
the packet's direction. This is what led to an error in determining the
direction of transmission of the packet.
Fixed error in "synscan" test: the number of packets in the forward and
reverse direction is incorrectly defined (verified via tcpdump).
Fixed bug with icmp protocol checksum check for big endian platforms.
2022-03-08 00:20:56 +01:00
Ivan Nardi
c345b3c7af
EthernetIP: fix integer conversion on big-endian archs ( #1477 )
2022-03-05 15:05:05 +01:00
Vitaly Lavrov
438f04066b
Fixed a bug for BE architectures ( #1478 )
...
Fixed a bug in the internal implementation of libgcrypt for bigendian architectures
2022-03-05 11:44:21 +01:00
Ivan Nardi
a173d3e98f
configure: fix usage of libgpg-error with --with-local-libgcrypt ( #1472 )
...
Right now, using external libgcrypt, nDPI is not linked to libgpg-error
because configure script never checks for it.
```
ivan@ivan-Latitude-E6540:~/svnrepos/nDPI(dev)$ CC=gcc-11 CXX=g++-11 CFLAGS="-O3 -g -Werror" ./autogen.sh --enable-debug-messages --with-pcre --with-local-libgcrypt && make -s -j
[...]
checking for numa_available in -lnuma... yes
checking for pcap_open_live in -lpcap... yes
checking for pthread_setaffinity_np in -lpthread... yes
checking for gcry_cipher_checktag in -lgcrypt... yes <------- missing check for libgpg-error
checking for pcre_compile in -lpcre... yes
checking that generated files are newer than configure... done
[...]
ivan@ivan-Latitude-E6540:~/svnrepos/nDPI(dev)$ grep HAVE_LIBGPG_ERROR src/include/ndpi_config.h
/* #undef HAVE_LIBGPG_ERROR */
```
Make both libgcrypt and libgpg-error mandatory if
`--with-local-libgcrypt` is used.
Technically speaking, libgpg-error might be optional, because it is used
only for debug messages. However having both libraries mandatory
slightly simplified the logic.
In most environments, libgpg-error is a dependency of libgcrypt anyway,
so having both libraries should be the standard case.
2022-03-05 11:41:37 +01:00
Toni
95a3d4fffe
Added autoconf option `--enable-tls-sigs'. ( #1471 )
...
* Testing more code in CI environments.
* Added strict option checking for `./configure' in CI environments.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-03-03 10:16:08 +01:00
Toni
cb62dfd249
Drop support for non-gcrypt builds. ( #1469 )
...
* As there is now a builtin, lightweight libgcrypt
there is no need to disable tls-clho decryption.
* It is still possible to use a host libgcrypt
with `--with-local-libgcrypt'.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-03-02 19:48:46 +01:00
Ivan Nardi
e23507d3e9
Internal crypto: increase size of authentication buffer ( #1468 )
...
Some QUIC flows are not properly decoded while using internal crypto
code: the authentication buffer is too small.
The new value (like the old one) is arbitrary.
Close #1463
2022-03-02 15:14:57 +01:00
Ivan Nardi
6f431057c5
reader_util: fix parsing of MPLS packets ( #1467 )
...
```
==20492==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x60300000578c at pc 0x55c47455e3ea bp 0x7ffc62ca1eb0 sp 0x7ffc62ca1ea8
READ of size 4 at 0x60300000578c thread T0
#0 0x55c47455e3e9 in ndpi_workflow_process_packet /home/ivan/svnrepos/nDPI/example/reader_util.c:1840:16
#1 0x55c47451b9cd in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:107:7
#2 0x55c47451c1ab in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:179:17
#3 0x7f661b50e0b2 in __libc_start_main /build/glibc-sMfBJT/glibc-2.31/csu/../csu/libc-start.c:308:16
#4 0x55c47445b54d in _start (/home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader_with_main+0x61054d) (BuildId: eba4bb4cd43b7101e4f0028ec0fb79087bae0e37)
0x60300000578d is located 0 bytes to the right of 29-byte region [0x603000005770,0x60300000578d)
```
2022-03-02 15:14:41 +01:00
Toni
e8559a4127
Add ICMP checksum check and set risk if mismatch detected. ( #1464 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-03-02 13:12:01 +01:00
Luca Deri
6c4df21238
Typo
2022-03-02 12:47:04 +01:00
Toni
4da1453d90
Added configureable ndpi packet processing limit. ( #1466 )
...
* The current behaviour ignores any user preferences
and was also incorrectly implemented, because the
flow->num_processed_pkts wraps every 65535 and nDPI
will process packets again until
NDPI_MAX_NUM_PKTS_PER_FLOW_TO_DISSECT reached.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-03-02 12:02:09 +01:00
Toni
736a80f9ce
Fix libgcrypt(-light/-internal) compile error. ( #1465 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-03-02 11:03:47 +01:00
Ivan Nardi
7a7e4ee69f
Add a new flow risk NDPI_ANONYMOUS_SUBSCRIBER ( #1462 )
...
The main goal of a DPI engine is usually to determine "what", i.e. which
types of traffic flow on the network.
However the applications using DPI are often interested also in "who",
i.e. which "user/subscriber" generated that traffic.
The association between a flow and a subscriber is usually done via some
kind of DHCP/GTP/RADIUS/NAT mappings. In all these cases the key element
of the flow used to identify the user is the source ip address.
That usually happens for the vast majority of the traffic.
However, depending on the protocols involved and on the position on the net
where the traffic is captured, the source ip address might have been
changed/anonymized. In that case, that address is useless for any
flow-username association.
Example: iCloud Private Relay traffic captured between the exit relay and
the server.
See the picture at page 5 on:
https://www.apple.com/privacy/docs/iCloud_Private_Relay_Overview_Dec2021.PDF
This commit adds new generic flow risk `NDPI_ANONYMOUS_SUBSCRIBER` hinting
that the ip addresses shouldn't be used to identify the user associated
with the flow.
As a first example of this new feature, the entire list of the relay ip
addresses used by Private Relay is added.
A key point to note is that list is NOT used for flow classification
(unlike all the other ip lists present in nDPI) but only for setting this
new flow risk.
TODO: IPv6
2022-02-28 15:25:58 +01:00
Luca Deri
1a8a6aa161
Unless --with-libgcrypt is used, nDPI now uses its internal gcrypt implementation
2022-02-28 15:18:10 +01:00
Ivan Nardi
e193f3713d
Removed some unused fields ( #1461 )
2022-02-28 15:03:49 +01:00
Vitaly Lavrov
c390085f91
Bug fixing. ( #1459 )
...
The '--enable-debug-messages' option works again.
Fixed warning in ahocorasick.c
Fixed integer overflow in ndpiReader.c for 32bit systems.
2022-02-28 15:01:00 +01:00
Toni
00d9a16b6a
Added `--enable-code-coverage' build using lcov for coverage generation. ( #1430 )
...
* CI job generates a coverage report
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-02-28 14:58:45 +01:00
Ivan Nardi
61a3c2eb5b
reader_util: fix TZSP decapsulation ( #1460 )
...
```
==38674==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x60400008957f at pc 0x5653fcee6434 bp 0x7ffe9b554b50 sp 0x7ffe9b554b48
READ of size 1 at 0x60400008957f thread T0
#0 0x5653fcee6433 in ndpi_workflow_process_packet /home/ivan/svnrepos/nDPI/example/reader_util.c:2050:18
#1 0x5653fce9fc0d in LLVMFuzzerTestOneInput /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:107:7
#2 0x5653fcea03eb in main /home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader.c:179:17
#3 0x7fe71dc3d0b2 in __libc_start_main /build/glibc-YbNSs7/glibc-2.31/csu/../csu/libc-start.c:308:16
#4 0x5653fcddf67d in _start (/home/ivan/svnrepos/nDPI/fuzz/fuzz_ndpi_reader_with_main+0x58a67d) (BuildId: 525418a27e8c37d6c492cc3220e0e97809c40f98)
0x60400008957f is located 0 bytes to the right of 47-byte region [0x604000089550,0x60400008957f)
allocated by thread T0 here:
```
Found by oss-fuzz
See: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=45036
2022-02-27 14:18:23 +01:00
Ivan Nardi
8b062295cc
Add some scripts to easily update some IPs lists ( #1449 )
...
While the lists in a6ff0dd0 and 2f5f445f are somehow provided by the
companies themselves (or by some interested parties), these new lists
are directly extracted from BGP information, via AS prefixes.
*Usually*, these new lists are far more stable than the previous ones.
TODO:
* add some other ASNs (see `src/lib/ndpi_content_match.c.inc`)
* IPv6, as usual :-(
2022-02-25 14:26:26 +01:00
Toni
f14dcb8344
Provide some API functions for convenience. ( #1456 )
...
* Extended JSON serializsation: risk, risk score, confidence
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-02-25 14:26:04 +01:00
Luca Deri
34e020ac35
Win fixes
2022-02-23 21:00:53 +01:00
Luca Deri
16ed0fd3f8
Replaced strdup with ndpi_strup
2022-02-23 21:37:52 +01:00
Ivan Nardi
d506a0e12f
Directly drop malformed packets ( #1455 )
...
TCP/UDP/ICMP/ICMPv6 packets with invalid L4 header length should be
ignored.
2022-02-22 22:15:46 +01:00
Ivan Nardi
96f8942f75
reader_util: fix parsing of IPv6 extension headers ( #1453 )
...
Found by oss-fuzz
See: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=44942
2022-02-22 19:58:17 +01:00
Ivan Nardi
279779062c
reader_util: fix infinite loop in packet dissection ( #1454 )
...
Found by oss-fuzz
See: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=44944
2022-02-22 19:56:41 +01:00
Ivan Nardi
fbb9700086
fuzz: purge old sessions ( #1451 )
...
At every fuzz iteration (i.e for every trace file):
* keep the same ndpi context (`ndpi_init_detection_module` is very
slow);
* reset the flow table, otherwise it grows indefinitely.
This change should fix the "out-of-memory" errors reported by oss-fuzz.
2022-02-21 20:32:50 +01:00
Ivan Nardi
6c1accd2bd
DTLS: fix access to certificate cache ( #1450 )
...
```
protocols/tls.c:650:54: runtime error: member access within null pointer of type 'const struct ndpi_tcphdr'
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior protocols/tls.c:650:54 in
protocols/tls.c:650:54: runtime error: load of null pointer of type 'const u_int16_t' (aka 'const unsigned short')
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior protocols/tls.c:650:54 in
AddressSanitizer:DEADLYSIGNAL
=================================================================
==47401==ERROR: AddressSanitizer: SEGV on unknown address 0x000000000000 (pc 0x55f7a61b661c bp 0x7f38190f91b0 sp 0x7f38190f70e0 T1)
==47401==The signal is caused by a READ memory access.
==47401==Hint: address points to the zero page.
#0 0x55f7a61b661c in processCertificateElements /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:650:41
#1 0x55f7a61ac3cc in processCertificate /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:792:7
#2 0x55f7a61d34e1 in processTLSBlock /home/ivan/svnrepos/nDPI/src/lib/protocols/tls.c:846:13
```
2022-02-21 20:30:22 +01:00
Ivan Nardi
59993e294e
EthernetIP: add missing initialization ( #1448 )
...
Fix:1e1cfb89
2022-02-20 10:20:46 +01:00
Ivan Nardi
2f5f445f72
Add support for Google Cloud ( #1447 )
...
Differentiate between Google its own apps/services and Google Cloud.
We already do something similar for Amazon vs AWS and Microsoft vs Azure.
2022-02-20 10:19:52 +01:00
Ivan Nardi
75a53ad064
fuzz: make fuzz_ndpi_reader faster ( #1446 )
...
Initialize ndpi_workflow_init context only once.
On a quite old notebook, before:
```
$ ./fuzz/fuzz_ndpi_reader -max_total_time="${MAX_TOTAL_TIME:-360}" -print_pcs=1 -workers="${FUZZY_WORKERS:-0}" -jobs="${FUZZY_JOBS:-0}" ./tests/pcap/
[...]
Done 3256 runs in 361 second(s)
```
after:
```
Done 5032771 runs in 361 second(s) <----------- ~1400X
```
oss-fuzz will be happy!
2022-02-20 10:19:22 +01:00
Vitaly Lavrov
f2411958d7
Added lightweight implementation of libgcrypt. ( #1444 )
...
Implementation borrowed from the
https://github.com/ARMmbed/mbedtls.git project (v3.1.0)
Speed testing (Xeon(R) CPU E3-1230 V2 @ 3.30GHz):
gcrypt-gnu Test md 2897 ms enc 2777 ms dec 942 ms
gcrypt-int Test md 3668 ms enc 1312 ms dec 2836 ms
gcrypt-int-noaesni Test md 3652 ms enc 1916 ms dec 4458 ms
gcrypt-gnu-nonopt Test md 3763 ms enc 4978 ms dec 3999 ms
gcrypt-gnu-nonopt - libgcrypt compiled without hardware acceleration
--disable-padlock-support --disable-aesni-support \
--disable-shaext-support --disable-pclmul-support \
--disable-sse41-support --disable-drng-support \
--disable-avx-support --disable-avx2-support \
--disable-neon-support --disable-arm-crypto-support \
--disable-ppc-crypto-support
--disable-amd64-as-feature-detection
2022-02-20 10:16:46 +01:00
Ivan Nardi
f28a3b293e
Fix compilation and sync unit tests results ( #1445 )
...
'strcasestr' is not defined in all enviroments: quicker fix is to use
'ndpi_strncasestr' instead.
2022-02-19 19:18:02 +01:00
Luca Deri
a2878af1ee
Added newflow risk NDPI_HTTP_CRAWLER_BOT
2022-02-17 17:20:52 +01:00
Luca Deri
8a2a47e62a
Silenced
...
NDPI_SUSPICIOUS_DGA_DOMAIN,
NDPI_BINARY_APPLICATION_TRANSFER,
NDPI_HTTP_NUMERIC_IP_HOST,
NDPI_MALICIOUS_JA3,
for predefined connectivity check and cybersec categories
2022-02-14 23:38:21 +01:00
Luca Deri
92da30f017
Extended cybersecurity protocol dissection
2022-02-14 23:19:21 +01:00
Luca Deri
c4113ffd7e
Added SNMP error code check
2022-02-14 23:17:51 +01:00
Luca Deri
de6905f41b
Exteended cybersecurity list
2022-02-10 20:16:48 +01:00
Luca Deri
023618c13a
Invalid prototupe fix
2022-02-10 19:38:11 +01:00
Ivan Nardi
ada7d32c50
HSRP: fix dissection over IPv6 ( #1443 )
...
Handle all message types.
2022-02-10 11:46:32 +01:00
Luca Deri
1431aa3d1c
Added cybersecurity category mapping to string
2022-02-10 10:35:34 +01:00
Luca Deri
5ddbbf4dd2
Added cybersecurity protocol and category that groups traffic towards leading cybersecurity companies and CDNs, useful to make destinations that should be marked as trusted in firewalls and security gateways
2022-02-10 09:50:06 +01:00
Ivan Nardi
b5eea436ae
HSRP: add support for IPv6 ( #1440 )
2022-02-09 11:47:37 +01:00
Dmytrii Vitman
4cf853548c
Added VXLAN dissector ( #1439 )
...
* RFC 7348
2022-02-09 11:47:09 +01:00
Ivan Nardi
f229068fd3
Fix memory access in ndpi_strnstr() ( #1438 )
...
Found by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=44482
It should be the same error reported (and only partially fixed) in
79968f32
2022-02-09 11:46:39 +01:00
Ivan Nardi and Luca Deri
a6ff0dd0e3
Add few scripts to easily update some IPs lists ( #1436 )
...
* Add few scripts to easily update some IPs lists
Some IPs lists should be updated frequently: try to easy the process.
The basic idea is taken from d59fefd0 and a8fe74e5 (for Azure
addresses): one specific .c.inc file and one script for each protocol.
Add the possibility to don't load a specific list.
Rename the old NDPI_PROTOCOL_HOTMAIL id to NDPI_PROTOCOL_MS_OUTLOOK,
to identify Hotmail/Outlook/Exchange flows.
TODO: ipv6
Remove the 9 addresses associated to BitTorrent: they have been added in
e2f21116 but it is not clear why all the traffic to/from these ips
should be classified as BitTorrent.
* Added quotes
* Added quotes
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2022-02-09 11:45:48 +01:00
ol-andreyizrailev and Andrey Izrailev
8cc5cb9f76
Increment current/total number of active flows on successful flow insertion ( #1434 )
...
Memory allocation or ndpi_tsearch might fail, so the two values should be
incremented only when insertion actually happened.
Co-authored-by: Andrey Izrailev <Andrey.Izrailev@oktetlabs.ru >
2022-02-09 11:43:10 +01:00
Luca Deri
9838ceb7cd
Added ndpi_serialize_string_string_len() APi call
...
Fixed CSV string serialization
2022-02-08 22:17:26 +01:00
Luca Deri
be5a29ba9d
Added HSRP protocol detection
...
Removed attic directory now obsolete
2022-02-08 18:04:57 +01:00
Luca Deri
922a7be897
Added check to ignore multicast packets marking the as Skype
2022-02-08 17:23:25 +01:00
Toni
d59f0327a5
Improved MDNS/LLMNR detection. ( #1437 )
...
* Checking for port 5353/5355 is not enough.
* Added additional multicast address and header checks.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-02-07 18:05:23 +01:00
Ivan Nardi
ff38d4b980
TLS: fix parsing of certificate elements ( #1435 )
...
Found by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=44280
```
==263603==WARNING: MemorySanitizer: use-of-uninitialized-value
#0 0x592478 in ndpi_is_printable_string ndpi/src/lib/ndpi_utils.c:2200:9
#1 0x5b047c in processCertificateElements ndpi/src/lib/protocols/tls.c:400:7
#2 0x5ac880 in processCertificate ndpi/src/lib/protocols/tls.c:790:7
#3 0x5c3a32 in processTLSBlock ndpi/src/lib/protocols/tls.c:844:13
#4 0x5c2c61 in ndpi_search_tls_tcp ndpi/src/lib/protocols/tls.c:973:2
#5 0x5c117d in ndpi_search_tls_wrapper ndpi/src/lib/protocols/tls.c:2367:5
#6 0x552a50 in check_ndpi_detection_func ndpi/src/lib/ndpi_main.c:4792:6
```
2022-02-07 18:05:12 +01:00
Ivan Nardi
79968f3245
Sync utests ( #1433 )
...
* Sync utest results
* Fix read-heap-buffer-overflow error reported by CI
See: https://github.com/ntop/nDPI/runs/5055876515?check_suite_focus=true
2022-02-04 15:57:17 +01:00
Alfredo Cardigliano
f5035521e8
Add comment
2022-02-03 18:43:31 +01:00
Luca Deri
c40496eaac
Updated test results
2022-02-03 13:54:38 +01:00
Luca Deri
7aef27f85e
Added NDPI_ERROR_CODE_DETECTED risk
2022-02-03 13:20:54 +01:00
Luca Deri
0dd5ac89f8
Renamed DCERPC to more generic RPC protocol so we can use also for other types of RPCs (not limited to DCE)
...
Extended HTTP plugin to support RPC
Improved HTTP crear text detection to limit it to Basic and Digest
2022-02-03 13:06:27 +01:00
Luca Deri
6975f265ec
Typo
2022-02-03 12:21:51 +01:00
Luca Deri
ae09e7fb14
Improved risks description
2022-02-03 12:19:01 +01:00
Luca Deri
a96d7eb180
Updated risk documentation
2022-02-03 12:10:18 +01:00
Luca
37ff626e78
Added new IDN/Punycode risk for spotting internationalized domain names
2022-02-03 09:17:54 +01:00
Luca Deri
cd3d720ae3
Added missing __sync_fetch_and_add() definition in Windows
2022-02-02 10:36:50 +01:00
Luca
46bd093934
Moved to 4.3
2022-02-01 09:13:55 +01:00
Alfredo Cardigliano
03cb8efad6
Update changelog
2022-01-31 18:38:02 +01:00
Ivan Nardi
5bb5bec477
Remove struct ndpi_id_struct ( #1427 )
...
Remove the last uses of `struct ndpi_id_struct`.
That code is not really used and it has not been updated for a very long
time: see #1279 for details.
Correlation among flows is achieved via LRU caches.
This change allows to further reduce memory consumption (see also
91bb77a8 ).
At nDPI 4.0 (more precisly, at a6b10cf , because memory stats
were wrong until that commit):
```
nDPI Memory statistics:
nDPI Memory (once): 221.15 KB
Flow Memory (per flow): 2.94 KB
```
Now:
```
nDPI Memory statistics:
nDPI Memory (once): 235.27 KB
Flow Memory (per flow): 688 B <--------
```
i.e. memory usage per flow has been reduced by 77%.
Close #1279
2022-01-30 19:18:12 +01:00
Ivan Nardi
1fdcddb33d
Remove Playstation VUE protocol ( #1426 )
...
PS VUE service has been discontinued on January 30, 2020
https://en.wikipedia.org/wiki/PlayStation_Vue
2022-01-30 19:17:53 +01:00
Luca Deri
5f745ee425
Commented old code (see https://github.com/ntop/nDPI/pull/1425 )
2022-01-30 19:17:23 +01:00
Ivan Nardi
f455421870
Improve protocol stacks ( #1425 )
...
We should have two protocols in classification results only when the
"master" protocol allows some sub-protocols.
Classifications like `AmazonAWS`, `TLS/AmazonAWS`, `DNS/AmazonAWS` are
fine. However classifications like `NTP/Apple`, `BitTorrent/Azure`,
`DNScrypt.AmazonAWS` or `NestLogSink.Google` are misleading.
For example, `ndpiReader`shows `BitTorrent/Azure` flows under `Azure`
statistics; that seems to be wrong or, at least, very misleading.
This is quite important since we have lots of addresses from CDN
operators.
The only drawback of this solution is that right now ICMP traffic is
classified simply as `ICMP`; if we are really interested in ICMP stuff
we can restore the old behaviour later.
2022-01-30 19:15:42 +01:00
Ivan Nardi
513e386959
Extend protocols support ( #1422 )
...
Add detection of AccuWeather site/app and Google Classroom.
Improve detection of Azure, Zattoo, Whatsapp, MQTT and LDAP.
Fix some RX false positives.
Fix some "Uncommon TLS ALPN"-risk false positives.
Fix "confidence" value for some Zoom/Torrent classifications.
Minor fix in Lua script for Wireshark extcap.
Update .gitignore file.
Let GitHub correctly detect the language type of *.inc files.
Zattoo example has been provided by @subhajit-cdot in #1148 .
2022-01-29 09:19:26 +01:00
Toni
9b8679a320
Fix some race conditions by using atomic operations. ( #1420 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-01-29 09:18:51 +01:00
Ivan Nardi
0c70411b1b
Make some protocols more "big-endian" friendly ( #1402 )
...
See #1312
2022-01-29 09:18:32 +01:00
Ivan Nardi
86b97ffb73
Sync unit tests results ( #1423 )
...
Fix: 7a3aa41a
2022-01-28 17:17:39 +01:00
Luca
7a3aa41afc
Updated alert description case
2022-01-28 15:02:42 +01:00
Toni
c53c82d482
Fixed heap overflow in nDPI realloc wrapper if new size < old size. ( #1421 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-01-27 15:29:16 +01:00
Ivan Nardi
9dcc4a2334
Kerberos, TLS, example: fix some memory errors ( #1419 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43823
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43921
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43925
2022-01-27 10:59:35 +01:00
Toni
011ee3ecbd
Fixed wrong ip tuple comparison. #1386 ( #1418 )
...
* Added u32 pads to `union ip_tuple` so btree search should now work as expected.
The bug caused new flow's when the remote answers, resulting in two Flows per direction. Fail.
* Fixed a race condition during shutdown phase.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-01-26 15:47:38 +01:00
Luca Deri
6d185c052e
Added support for the .goog Google TLD
2022-01-26 15:22:33 +01:00
Toni
2cd0479204
Serializing empty `risk blocks' pollutes the resulting string. ( #1417 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2022-01-26 13:36:45 +01:00
Luca Deri
81b33f0d06
Updated test results after the risk NDPI_TLS_CERTIFICATE_ABOUT_TO_EXPIRE has been added
2022-01-26 09:46:46 +01:00
Luca Deri
58a9aff17c
Added NDPI_TLS_CERTIFICATE_ABOUT_TO_EXPIRE flow risk
...
Added ndpi_set_tls_cert_expire_days() API call to modify the number of days for triggering the above alert that by default is set to 30 days
2022-01-26 09:23:23 +01:00
Luca Deri
14e8808f03
Removed pandora.tv from pandora protocol as they are different services that shouldd not be mixed
2022-01-25 19:11:16 +01:00
Luca Deri
bbb3b8349f
Improved pandora TV detection
2022-01-24 18:28:43 +01:00
Luca Deri
b6b4967aa6
Improved Zoom protocol detection
2022-01-23 20:59:36 +01:00
Luca Deri
a8fe74e502
Tool for generating automatically the Azure IP list
2022-01-23 18:56:51 +01:00
Alfredo Cardigliano
20b9f01f12
Fix ndpi_serialize_string_int64
2022-01-21 17:35:38 +01:00
Alfredo Cardigliano
a0bb0ab0ca
Add unit test for ndpi_serialize_string_int64
2022-01-21 13:05:58 +01:00
havsah
e16b6a18be
Fix Grease values parsing ( #1416 )
...
The check for grease was too broad and filtered some valid values.
In particular, the value 257 was skipped because it matched the previous check.
This has been discovered while parsing tests/pcap/443-firefox.pcap
expected ja3:
771,4865-4867-4866-49195-49199-52393-52392-49196-49200-49162-49161-49171-49172-51-57-47-53-10,0-23-65281-10-11-35-16-5-51-43-13-45-28-21,29-23-24-25-256-257,0
previously generated ja3:
771,4865-4867-4866-49195-49199-52393-52392-49196-49200-49162-49161-49171-49172-51-57-47-53-10,0-23-65281-10-11-35-16-5-51-43-13-45-28-21,29-23-24-25-256,0
Signed-off-by: Patrick Havelange <patrick.havelange_ext@softathome.com >
2022-01-21 12:40:35 +01:00
Luca Deri
6f336f8307
Added JA3 in risj exceptions
2022-01-20 22:22:56 +01:00
Luca Deri
d91477b18d
Fixed certificate mismatch check
2022-01-19 23:10:10 +01:00
Luca Deri
771b6606c8
Fixed an issue on CentOS 7 introduced by
...
https://github.com/ntop/nDPI/commit/c2b7d77784beeae5f86f19e33ba3da5ddce55898
2022-01-19 10:19:58 +01:00
Luca Deri
9eee257be0
Updated confidence type
2022-01-18 22:28:58 +01:00
Ivan Nardi
9f050fa0a6
TLS, H323, examples: fix some memory errors ( #1414 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=26880
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=26906
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43782
https://oss-fuzz.com/testcase-detail/6334089358082048
2022-01-18 21:52:37 +01:00
Ivan Nardi
bd036f96f9
Netbios, CSGO: fix two memory errors ( #1413 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43754
https://oss-fuzz.com/testcase-detail/5329842395021312
2022-01-18 19:11:01 +01:00
Sam James and Luca Deri
c2b7d77784
build: respect environment options more ( #1392 )
...
* build: update m4/ax_pthread.m4 from serial 23 -> serial 31
Update ax_pthread.m4 to the latest version from the autoconf-archive
project.
Signed-off-by: Sam James <sam@gentoo.org >
* build: properly detect AR, CC, RANLIB
It's necessary to be able to override choice of AR/CC/RANLIB and other toolchain
variables/tools for cross-compilation, testing with other toolchains, and
to ensure the compiler chosen by the user is actually used for the build.
Previously, GNU_PREFIX was kind-of used for this but this isn't a standard
variable (at all) and it wasn't applied consistently anyway.
We now use the standard autoconf mechanisms for finding these tools.
(RANLIB is already covered by LT_INIT.)
Signed-off-by: Sam James <sam@gentoo.org >
* build: use $(MAKE)
This ensures that parallel make works correctly, as otherwise, a fresh
make job will be started without the jobserver fd, and hence
not know about its parent, forcing -j1.
* build: respect CPPFLAGS, LDFLAGS
- CPPFLAGS is for the C preprocessor (usually for setting defines)
- LDFLAGS should be placed before objects for certain flags to work
(e.g. -Wl,--as-needed)
Signed-off-by: Sam James <sam@gentoo.org >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2022-01-18 14:30:14 +01:00
Ivan Nardi
e4a7990a4e
H323: fix a use-after-poison error ( #1412 )
...
Detected by oss-fuzz
See: https://oss-fuzz.com/testcase-detail/6730505580576768
Fix a function prototype
Update a unit test results
2022-01-17 19:47:27 +01:00
Luca Deri
d19bd96555
Improved Badoo detection (missing mobile app domain)
2022-01-17 18:54:27 +01:00
Luca Deri
6877e46273
Added Badoo detection
2022-01-17 15:13:14 +01:00
Luca
6679453d86
Adds some risk exceptions for popular services and domain names
...
via a new (internal) function named ndpi_add_domain_risk_exceptions()
2022-01-17 09:00:25 +01:00
Ivan Nardi
1ff308af09
TLS: fix a use-of-uninitialized-value error ( #1411 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43705
2022-01-16 20:31:48 +01:00
Ivan Nardi
05734f3d31
Zattoo: fix Null-dereference READ with ipv6 traffic ( #1410 )
...
Fix: 20b5f6d7
Detected by oss-fux:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43700
2022-01-16 19:28:39 +01:00
Ivan Nardi
611c753da5
XBox, Diameter: fix dissectors initialization ( #1405 )
...
These dissectors have *never* been triggered because their registration
functions use the wrong parameter/bitmask.
Diameter code is buggy since the origianl commit (1d108234 ), while
XBox code since 5266c726 .
Fix some false positives in Xbox code.
2022-01-16 16:19:00 +01:00
Luca Deri
f3af39ee42
Added performance tests tools
2022-01-16 12:47:56 +01:00
Luca Deri
42d74171b2
Minor cosmetic changes
2022-01-16 12:47:56 +01:00
Luca Deri
dd325248f1
Reduced Patricia tree bucket memory footprint
2022-01-16 12:47:56 +01:00
Ivan Nardi
e46b508a36
Kerberos: fix use-of-uninitialized-value error ( #1409 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43677
2022-01-15 20:53:36 +01:00
Ivan Nardi
eb5d7b07af
TLS: fix heap-buffer-overflow error ( #1408 )
...
Detected by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=43664
2022-01-15 18:47:59 +01:00
Ivan Nardi
63c44a24b6
STUN: fix "confidence" value for some classifications ( #1407 )
2022-01-15 17:35:06 +01:00
Ivan Nardi
20b5f6d7cc
Improve IPv6 support, enabling IPv6 traffic on (almost) all dissectors. ( #1406 )
...
Follow-up of 7cba34a1
2022-01-15 17:34:56 +01:00
Ivan Nardi
7f69de0b51
Restore a unit test result ( #1403 )
...
Deleted, probably by mistake, in 406ac7e8
Fix Makefile and add compilation of `rrdtool` in CI tests
2022-01-13 23:14:28 +01:00
Luca Deri
533b3ab0e3
FreeBSD fixes
2022-01-13 21:15:21 +01:00
Luca Deri
406ac7e8c8
Added the ability to specify trusted issueDN often used in companies to self-signed certificates
...
This allows to avoid triggering alerts for trusted albeit private certificate issuers.
Extended the example/protos.txt with the new syntax for specifying trusted issueDN.
Example:
trusted_issuer_dn:"CN=813845657003339838, O=Code42, OU=TEST, ST=MN, C=US"
2022-01-13 19:06:21 +01:00
Vinicius Silva Nogueira
dc60cd09c4
fix ahocorasick on big-endian machines ( #1401 )
2022-01-13 17:35:06 +01:00
Luca Deri
d59fefd06e
Improved MicrosoftAzure detection
2022-01-12 21:49:31 +01:00
Luca Deri
1e1cfb89d2
Added EthernetIP dissector
2022-01-12 21:48:39 +01:00
Ivan Nardi
d4da3b6516
Run fuzzing tests also on push event (like the CI tests) ( #1400 )
2022-01-12 21:04:01 +01:00
Ivan Nardi
f30fbc3212
Fix DGA false positive ( #1399 )
...
Close #1397
2022-01-12 20:51:29 +01:00
Ivan Nardi
b080a1c136
Fix two use-of-uninitialized-value errors ( #1398 )
...
Found by oss-fuzz:
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=40269
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=41432
Fix fuzz compilation (follow-up of f5545a80 )
2022-01-12 20:24:57 +01:00
Luca Deri
552d199d2e
Removed outdated comment
2022-01-11 21:46:30 +01:00
Luca Deri
f5545a80f9
Removed legacy code
2022-01-11 21:45:27 +01:00
Ivan Nardi
06f3b07909
QUIC: fix an integer overflow ( #1396 )
...
Reported by oss-fuzz:
```
==685288==ERROR: AddressSanitizer: SEGV on unknown address 0x61a100000687 (pc 0x0000005aba64 bp 0x7ffe3f29f510 sp 0x7ffe3f29f400 T0)
==685288==The signal is caused by a READ memory access.
SCARINESS: 20 (wild-addr-read)
#0 0x5aba64 in quic_len ndpi/src/lib/protocols/quic.c:203:12
#1 0x5aba64 in decrypt_initial_packet ndpi/src/lib/protocols/quic.c:993:16
#2 0x5aba64 in get_clear_payload ndpi/src/lib/protocols/quic.c:1302:21
#3 0x5aba64 in ndpi_search_quic ndpi/src/lib/protocols/quic.c:1658:19
#4 0x579f00 in check_ndpi_detection_func ndpi/src/lib/ndpi_main.c:4683:6
#5 0x57abe6 in ndpi_check_flow_func ndpi/src/lib/ndpi_main.c:0
#6 0x583b2c in ndpi_detection_process_packet ndpi/src/lib/ndpi_main.c:5545:15
#7 0x55e75e in LLVMFuzzerTestOneInput ndpi/fuzz/fuzz_process_packet.c:30:3
[...]
```
2022-01-11 17:57:34 +01:00
Ivan Nardi
3a087e951d
Add a "confidence" field about the reliability of the classification. ( #1395 )
...
As a general rule, the higher the confidence value, the higher the
"reliability/precision" of the classification.
In other words, this new field provides an hint about "how" the flow
classification has been obtained.
For example, the application may want to ignore classification "by-port"
(they are not real DPI classifications, after all) or give a second
glance at flows classified via LRU caches (because of false positives).
Setting only one value for the confidence field is a bit tricky: more
work is probably needed in the next future to tweak/fix/improve the logic.
2022-01-11 15:23:39 +01:00
Luca Deri
a2916d2e4c
Readme for using fuzzer with nDPI
2022-01-11 15:12:45 +01:00
Luca Deri
c02574807e
Updated result
2022-01-09 18:52:30 +01:00
Luca Deri
708d4ea33a
Improved user agent analysis
2022-01-09 18:47:47 +01:00
Ivan Nardi
bf69321a29
GTP: fix some false positives ( #1394 )
2022-01-08 20:40:24 +01:00
Ivan Nardi
4d27001d1d
Remove some unused fields ( #1393 )
2022-01-08 20:40:10 +01:00
Luca Deri
eac3ae9ded
Improved bittorrent detection
2022-01-06 19:50:31 +01:00
Luca Deri
f24f68f59d
Invalid check
2022-01-06 07:15:45 +01:00
Luca Deri
8f805a8163
Added missing dependency
2022-01-05 11:11:58 +01:00
Alfredo Cardigliano
948c0367f9
Update issue tempalte
2022-01-03 17:26:23 +01:00
Alfredo Cardigliano
23a4761276
Update copyright
2022-01-03 11:00:45 +01:00
Luca Deri
d72a40a0fc
Improved BitTorrent guess
2021-12-26 19:41:35 +01:00
Luca Deri
c4ac53a03f
Added support for Log4J/Log4Shell detection in nDPI via a new flow risk named NDPI_POSSIBLE_EXPLOIT
2021-12-23 21:30:16 +01:00
Ivan Nardi
fdb6481cd6
Add support for ICloud Private Relay ( #1390 )
...
See:
https://www.apple.com/privacy/docs/iCloud_Private_Relay_Overview_Dec2021.PDF
TODO: an up-to-date list of egress IP ranges is publicly available. Can
we use it somehow?
2021-12-22 19:55:57 +01:00
Ivan Nardi
91bb77a880
A final(?) effort to reduce memory usage per flow ( #1389 )
...
Remove some unused fields and re-organize other ones.
In particular:
* Update the parameters of `ndpi_ssl_version2str()` function
* Zattoo, Thunder: these timestamps aren't really used.
* Ftp/mail: these protocols are dissected only over TCP.
* Attention must be paid to TLS.Bittorrent flows to avoid invalid
read/write to `flow->protos.bittorrent.hash` field.
This is the last(?) commit of a long series (see 22241a1d , 227e586e ,
730c2360 , a8ffcd8b ) aiming to reduce library memory consumption.
Before, at nDPI 4.0 (more precisly, at a6b10cf7 , because memory stats
were wrong until that commit):
```
nDPI Memory statistics:
nDPI Memory (once): 221.15 KB
Flow Memory (per flow): 2.94 KB
```
Now:
```
nDPI Memory statistics:
nDPI Memory (once): 231.71 KB
Flow Memory (per flow): 1008 B <---------
```
i.e. memory usage per flow has been reduced by 66%, dropping below the
psychological threshold of 1 KB.
To further reduce this value, we probably need to look into #1279 :
let's fight this battle another day.
2021-12-22 19:54:06 +01:00
Alfredo Cardigliano
02da143e45
Add links to other user guides
2021-12-22 10:23:14 +01:00
Luca Deri
4c02c81bf4
Improved bittorrent heuristic
2021-12-21 23:04:27 +01:00
Ivan Nardi
a16b4aa564
Fix a global-buffer-overflow when loading Azure list ( #1388 )
2021-12-19 22:29:25 +01:00
Luca Deri
7aad97fffb
Added Microsoft Azure support
2021-12-19 18:59:45 +01:00
Ivan Nardi
7153b8933c
Improve/add several protocols ( #1383 )
...
Improve Microsoft, GMail, Likee, Whatsapp, DisneyPlus and Tiktok
detection.
Add Vimeo, Fuze, Alibaba and Firebase Crashlytics detection.
Try to differentiate between Messenger/Signal standard flows (i.e chat)
and their VOIP (video)calls (like we already do for Whatsapp and
Snapchat).
Add a partial list of some ADS/Tracking stuff.
Fix Cassandra, Radius and GTP false positives.
Fix DNS, Syslog and SIP false negatives.
Improve GTP (sub)classification: differentiate among GTP-U, GTP_C and
GTP_PRIME.
Fix 3 LGTM warnings.
2021-12-18 13:24:51 +01:00
Ivan Nardi
58b33dcb2d
TLS: add support for IPV6 in Subject Alt Names field ( #1385 )
2021-12-18 12:03:46 +01:00
Ivan Nardi
ec6eea0c23
TLS: fix usage of certificate cache ( #1384 )
2021-12-18 12:03:32 +01:00
Luca Deri
74519f6e10
Improved bittorrent detection
2021-12-17 21:17:18 +01:00
Ivan Nardi
f11b215cfb
QUIC: fix old versions of GQUIC on big-endian machines ( #1387 )
...
Credits to @viniciussn (see #1312 )
2021-12-17 12:10:34 +01:00
Luca Deri
8e512ff503
Improved BitTorrent classification
2021-12-07 21:49:00 +01:00
Luca Deri
519d70fa04
Optimized ndpi_serialize_string_int32
2021-12-07 15:54:23 +01:00
Luca Deri
85b396ca43
Fixed issue that prevented alt certificate names to be fully detected when ipAddress and rfc822Name were specified in certificates
2021-12-07 14:45:42 +01:00
Luca Deri
cefcc25b13
Added missing install target
2021-12-07 09:00:58 +01:00
Ivan Nardi
947896ad7d
Fix configure script (after fb85dac9) ( #1381 )
...
Fix/disable some LGTM warnings
2021-12-04 20:22:05 +01:00
Ivan Nardi
7cba34a1e3
Improve IPv6 support, enabling IPv6 traffic on (almost) all dissectors. ( #1380 )
...
There are no valid reasons for a (generic) protocol to ignore IPv6
traffic.
Note that:
* I have not found the specifications of "CheckPoint High Availability
Protocol", so I don't know how/if it supports IPv6
* all LRU caches are still IPv4 only
Even if src_id/dst_id stuff is probably useless (see #1279 ), the right
way to update the protocol classification is via `ndpi_set_detected_protocol()`
2021-12-04 13:30:10 +01:00
Ivan Nardi
6e86e6d924
QUIC: add support for QUICv2 (draft 00) ( #1379 )
...
It is already time to start looking at the new QUIC version.
See: https://datatracker.ietf.org/doc/html/draft-ietf-quic-v2-00
2021-12-04 13:29:30 +01:00
Toni
4d60c70c8b
Make serialize risk and proto not dependant on any flow. ( #1377 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-12-04 13:28:55 +01:00
Luca Deri
fb85dac905
Configure improvements
...
Fixed invalid anomaly detection in rrd_anomaly
2021-12-04 13:21:57 +01:00
Luca Deri
fe2822c6a8
Added example for finding similarities in RRDs using nDPI statistical APIs
2021-12-04 10:09:01 +01:00
Luca Deri
6ab1367846
Added quick mode (-q)
2021-12-03 21:18:03 +01:00
Luca Deri
8c4ae7527b
Updated rrdtool makefile
2021-12-03 21:10:43 +01:00
Luca Deri
1b077ba65f
Demo tool for finding anomalies in RRD files
2021-12-03 17:36:49 +01:00
Alfredo Cardigliano
3dd9b5176e
Remove printf when not required
2021-12-01 10:24:12 +01:00
Alfredo Cardigliano
1d3428d538
Improve JSON serialization
2021-12-01 10:04:17 +01:00
Luca Deri
33557c5fbc
Improved CSV serialization
2021-11-30 22:15:26 +01:00
Luca Deri
5e0befd56c
Fixed seriealizer unit
2021-11-30 17:24:42 +01:00
Luca Deri
4f81cdc103
Removed spaces from some protocol names as they create problems with some applications
2021-11-30 10:12:24 +01:00
Ivan Nardi
b1e9245d94
ndpiReader: slight simplificaton of the output ( #1378 )
2021-11-27 17:32:23 +01:00
Luca Deri
320bcfafa2
Added ndpi_serializer_skip_header() serialization API
2021-11-26 22:18:59 +01:00
Luca Deri
a7b5e09195
Added Salesforce detection
2021-11-26 19:07:45 +01:00
Luca Deri
9d59b8b1a9
HTTP proxy improvement
2021-11-25 23:17:27 +01:00
Luca Deri
ea435c46f5
Reworked HTTP protocol dissection including HTTP proxy and HTTP connect
2021-11-25 22:53:46 +01:00
Luca Deri
772957349b
Aded default port to HTTP_CONNECT
2021-11-25 21:46:00 +01:00
Luca Deri
40ff2c54c1
Added googletagmanager.com to the host_match list
2021-11-25 21:45:38 +01:00
Ivan Nardi
a8ffcd8bb0
Rework how hostname/SNI info is saved ( #1330 )
...
Looking at `struct ndpi_flow_struct` the two bigger fields are
`host_server_name[240]` (mainly for HTTP hostnames and DNS domains) and
`protos.tls_quic.client_requested_server_name[256]`
(for TLS/QUIC SNIs).
This commit aims to reduce `struct ndpi_flow_struct` size, according to
two simple observations:
1) maximum one of these two fields is used for each flow. So it seems safe
to merge them;
2) even if hostnames/SNIs might be very long, in practice they are rarely
longer than a fews tens of bytes. So, using a (single) large buffer is a
waste of memory for all kinds of flows. If we need to truncate the name,
we keep the *last* characters, easing domain matching.
Analyzing some real traffic, it seems safe to assume that the vast
majority of hostnames/SNIs is shorter than 80 bytes.
Hostnames/SNIs are always converted to lowercase.
Attention was given so as to be sure that unit-tests outputs are not
affected by this change.
Because of a bug, TLS/QUIC SNI were always truncated to 64 bytes (the
*first* 64 ones): as a consequence, there were some "Suspicious DGA
domain name" and "TLS Certificate Mismatch" false positives.
2021-11-24 10:46:48 +01:00
Ivan Nardi
fd02e1b304
QUIC: fix extra dissection ( #1376 )
...
When we have fully reassembled the Client Hello, we need to stop extra
dissection.
2021-11-23 10:57:13 +01:00
Luca Deri
4c39ed293e
BitTorrent dissector code cleanup and merge of https://github.com/ntop/nDPI/pull/1374
2021-11-17 23:18:22 +01:00
Luca Deri
2e2d4c911a
BitTorrent detection improvements
2021-11-17 22:41:35 +01:00
Luca Deri
2a6e5c6341
Improved BT hashing to minimize false positives
2021-11-17 10:47:21 +01:00
Luca Deri
a6545ea095
bittorrent old code cleanup. Enlarged BT cache
2021-11-16 10:05:18 +01:00
Luca Deri
f2a279e441
Improved BitTorrent detection
2021-11-15 17:25:13 +01:00
Ivan Nardi
afc2b641eb
Fix writes to flow->protos union fields ( #1354 )
...
We can write to `flow->protos` only after a proper classification.
This issue has been found in Kerberos, DHCP, HTTP, STUN, IMO, FTP,
SMTP, IMAP and POP code.
There are two kinds of fixes:
* write to `flow->protos` only if a final protocol has been detected
* move protocol state out of `flow->protos`
The hard part is to find, for each protocol, the right tradeoff between
memory usage and code complexity.
Handle Kerberos like DNS: if we find a request, we set the protocol
and an extra callback to further parsing the reply.
For all the other protocols, move the state out of `flow->protos`. This
is an issue only for the FTP/MAIL stuff.
Add DHCP Class Identification value to the output of ndpiReader and to
the Jason serialization.
Extend code coverage of fuzz tests.
Close #1343
Close #1342
2021-11-15 16:20:57 +01:00
ragostino
da47357762
Update ndpi_main.c for HTTP line parser optimization and cleaning ( #1372 )
...
* Update ndpi_main.c
HTTP line parser: optimization and cleaning
* Update ndpi_main.c
2021-11-11 12:38:31 +01:00
Ivan Nardi
acb1de69aa
Reduce memory used by ndpiReader ( #1371 )
...
`ndpiReader` is only an example, aiming to show nDPI capabilities
and integration, without any claim about performances.
Nonetheless its memory usage per flow is *huge*, limiting the kinds
of traces that we can test on a "normal" hardware (example: scan
attacks).
The key reason of that behaviour is that we preallocate all the memory
needed for *all* the available features.
Try to reduce memory usage simply allocating some structures only
when they are really needed. Most significant example: JOY algorithms.
This way we should use a lot less memory in the two most common
user-cases:
* `ndpiReader` invoked without any particular flag (i.e `ndpiReader -i
$FILENAME_OR_IFACE`)
* internal unit tests
Before (on x86_64):
```
struct ndpi_flow_info {
[...]
/* size: 7320, cachelines: 115, members: 72 */
```
After:
```
struct ndpi_flow_info {
[...]
/* size: 2128, cachelines: 34, members: 75 */
```
2021-11-11 12:37:25 +01:00
Ivan Nardi
3e5491fa10
Add detection of OCSP ( #1370 )
...
This protocol is detected via HTTP Content-Type header.
Until 89d548f9 , nDPI had a dedicated automa (`content_automa`) to
classify a HTTP flow according to this header. Since then, this automa has
been useless because it is always empty.
Re-enable it to match only a string seems overkilling.
Remove all `content_automa` leftovers.
2021-11-11 12:36:55 +01:00
Ivan Nardi
0f168d9150
IMAP, POP3, SMTP: improve dissection ( #1368 )
...
Avoid NATS false positives
2021-11-11 11:55:56 +01:00
Luca Deri
9abf528c8e
BitTorrent cache debug
2021-11-08 12:42:15 +01:00
Ivan Nardi
5464bad6db
Differentiate between standard Amazon stuff (i.e market) and AWS ( #1369 )
2021-11-04 00:20:45 +01:00
Luca Deri
4173775b60
Improved BitTorrent detection
2021-11-04 00:20:26 +01:00
Ivan Nardi
a8a3c6f7c2
Fix use-of-uninitialized-value ( #1366 )
...
Close #1346
2021-11-03 15:40:07 +01:00
Ivan Nardi
55880e4ae4
TLS: fix two warnings ( #1365 )
...
Disable unit tests on CI for big-endian target. We know we have multiple
issues on big-endian architectures (see #1312 ) and so the unit tests
always fail there. Ignore this error for the time being and let the CI
pass if we don't have other issues.
Remove an unused automa definition
2021-11-02 22:08:15 +01:00
Luca Deri
1f6c94e663
Updated test results
2021-11-02 12:08:20 +01:00
Luca Deri
b11065b2e3
Fixed certificate mismatch for TLS flows with no client hello observed
2021-11-02 12:06:18 +01:00
Luca Deri
9f8c1e8630
BitTorrent detection improvements
2021-10-31 18:45:13 +01:00
Luca Deri
a9aa46287d
Little change in TLS debug traces
2021-10-28 10:16:33 +02:00
Luca Deri
a25d9d871e
Updated results
2021-10-27 23:04:29 +02:00
Luca Deri
5283755afa
Fixed TLS certificate dissection of subjectAltName
2021-10-27 22:51:59 +02:00
Luca Deri
aaa474a37d
Minor code cleanup
2021-10-27 09:32:11 +02:00
Ivan Nardi
6edb7bedd7
Avoid overwriting valid protocol in ndpi_detection_giveup ( #1360 )
...
We should avoid updating any valid protocol in `ndpi_detection_giveup`; we
should try to find a proper classification only if the flow is still
completely unclassified.
For example in the attached pcap there is a valid TLS session, recognized
as such by TLS dissector. However, the `ndpi_detection_giveup`function
updates it to "HTTP/TLS" (!?) simply because the server port is 80.
Note that the real issue is not the wrong classification, but the
wrong access to `flow->protos` union. If we already set some fields of
`flow->protos` and we change the protocol in `ndpi_detection_giveup`, we
might end up freeing some invalid pointers in `ndpi_free_flow_data`
(no wonder this issue has been found while fuzzing #1354 )
Fix GIT and TLS dissectors (issues found by CI fuzzer)
2021-10-27 09:23:07 +02:00
Toni
c4eebaaf5e
Serialize additional information stored in the flow struct. ( #1362 )
...
* Changed function signature of ndpi_flow2json (removed unused vlan_id; API break)
* Serialize NTP information.
* Improved QUIC serialization.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-27 09:22:19 +02:00
Luca Deri
f41d8ac106
Improved STUN and RTP detection
2021-10-27 00:06:05 +02:00
Toni
41765efcf8
Detect invalid characters in text and set a risk. Fixes #1347 . ( #1363 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-26 21:34:01 +02:00
Luca Deri
5ccc61d1cb
Fixed Git protocol dissection ( #1355 )
2021-10-25 18:52:27 +02:00
Ivan Nardi
b6d9536533
Fixed cleartext protocol assignment ( #1357 )
2021-10-25 15:04:04 +02:00
Ivan Nardi
333a6d60e8
TLS: fix a heap-buffer-overflow ( #1356 )
...
Revert of c3d1c697
Error reproducible with the attached pcap and valgrind
2021-10-22 14:57:49 +02:00
Luca Deri
c3d1c69722
Fixed heap-buffer-overflow in TLS dissector
2021-10-20 22:07:47 +02:00
Ivan Nardi
8db8c8ae34
Fix QUIC log and remove SoulSeek leftovers after b97dc6ba ( #1351 )
...
Update .gitignore file
Fix a function prototype
Close #1349
2021-10-19 21:42:55 +02:00
Ivan Nardi
fea3991ad1
Fix some invalid memory reads ( #1350 )
...
`ndpi_detection_giveup()` (and any functions called by it) can't access
`ndpi_detection_module_struct->packet` anymore since 730c236 .
Sync unit tests results
Close #1348
2021-10-19 12:07:47 +02:00
Luca Deri
06f13fd2de
Added clertext alert with telnet
2021-10-19 08:44:29 +02:00
Toni
ed51987e3a
Fix broken fuzz_process_packet fuzzer by adding a call to ndpi_finalize_initialization(). ( #1334 )
...
* fixed several memory errors (heap-overflow, unitialized memory, etc)
* ability to build fuzz_process_packet with a main()
allowing to replay crash data generated with fuzz_process_packet
by LLVMs libfuzzer
* temporarily disable fuzzing if `tests/do.sh`
executed with env FUZZY_TESTING_ENABLED=1
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-18 23:16:32 +02:00
Luca Deri
7d3c3b23f8
Implemented RDP over UDP dissection
2021-10-18 22:12:28 +02:00
Luca Deri
9e97d20c25
Refreshed results list
2021-10-16 12:03:16 +02:00
Luca Deri
b08b6a6a28
Fixed cleartext protocol assignment
2021-10-16 12:02:04 +02:00
Luca Deri
c2e7fbce94
Updated test results after latest commit
2021-10-16 11:57:32 +02:00
Luca Deri
1b3c41a752
Reworked flow risks asignment
...
Added esceptions for windows update and binary application transfer risk
2021-10-16 11:55:08 +02:00
Luca Deri
b97dc6baa4
Removed outdated (and broken) soulseek dissector
2021-10-15 17:27:27 +02:00
Luca Deri
e696f31487
Updated test results
2021-10-14 22:18:34 +02:00
Luca Deri
b1a43cbcff
Added missing call to ndpi_reconcile_protocols() with protocol guess
2021-10-14 22:08:20 +02:00
Luca Deri
6e649e0cb6
Fixed issue on DGA numeric IP detection
2021-10-13 19:21:27 +02:00
Luca Deri
09668496c3
Indemt
2021-10-13 19:18:05 +02:00
Zied Aouini
a2e9730b23
Add issue templates. ( #1340 )
...
* Add issue template.
* Add config log instruction.
2021-10-13 18:39:10 +02:00
Luca Deri
937357e4bc
Implemented ndpi_ses_fitting() and ndpi_des_fitting()
...
for comuting the best alpha/beta values for exponential smoothing
2021-10-12 13:08:58 +02:00
Alfredo Cardigliano
d947437233
Return 0 on ndpi_init_serializer_ll success for consistency
2021-10-12 10:47:44 +00:00
Luca Deri
d13bc0e01a
Fixed DES initialisation
2021-10-12 12:38:40 +02:00
Ivan Nardi
550e6fe6fc
QUIC: fix an integer overflow ( #1337 )
...
Long standing bug: credits to @lnslbrty for digging into it and to
@aouinizied for the CI improvements
2021-10-11 23:08:10 +02:00
Toni
a8f938f7ac
Removed README.protocols because: ( #1333 )
...
* Tor via TLS should be detectable via DGA as a risk
* protocol limitations should be part of the official documentation in `doc/`
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-11 23:07:36 +02:00
Luca Deri
960e8ab22a
Win fix
2021-10-11 20:59:28 +02:00
Zied Aouini
ca827ae548
Fix FuzzCI. ( #1338 )
2021-10-11 20:17:12 +02:00
Zied Aouini
7e0724d576
Enable sanitizers on CIFuzz. ( #1336 )
2021-10-11 19:01:50 +02:00
Luca Deri
246d115d7b
Cleaned up code moving specific includes in files their are using it. Thi prevents ndpi_config.h to be included everywhere in apps using nDPI that might leade to #define redefinitions after the latest changes
2021-10-11 11:45:45 +02:00
Toni
60eca79fdf
Additional fix related to cf931fda6b. ( #1332 )
...
* configure.seed references removed
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-10 14:14:02 +02:00
Toni
549134ef10
Fix make dist and add it to the CI along with make -C doc text. Fixes #1324 ( #1327 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-10 13:15:38 +02:00
Toni
cf931fda6b
Get rid of configure.seed as it comes with some disadvantages. ( #1328 )
...
* using Autotools best-practices to achieve (hopefully) the same result
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-10 13:13:52 +02:00
Toni
6ff67b5043
Add more WindowsUpdate URLs as requested in #698 . ( #1329 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-08 18:29:49 +02:00
Luca Deri
3ffb65a81c
Added extra check
2021-10-07 08:21:40 +02:00
Ivan Nardi
2dfc478ad4
Fix compilation with clang-13 or if some debug macros are enabled ( #1326 )
2021-10-06 18:32:15 +02:00
Luca Deri
944e8ed105
Added check
2021-10-06 18:28:09 +02:00
Luca Deri
2b4821a97b
Compilation fix for old Linux distributions
2021-10-06 09:28:04 +02:00
Luca Deri
d9c72999ee
Test update
2021-10-06 00:06:34 +02:00
Luca Deri
181a03c5ad
Compilation fix
2021-10-05 17:17:12 +02:00
Luca Deri
8957c52a48
Numeric IPs are not considered for DGA checks
2021-10-05 17:14:31 +02:00
Luca Deri
408d78e628
Improved DGA detection for skipping potential DGAs of known/popular domain names
2021-10-05 16:51:24 +02:00
Luca Deri
10576eab0a
TLS obsolete protocol is set when TLS < 1.2 (used to be 1.1)
2021-10-05 16:44:56 +02:00
Ivan Nardi
730c2360bd
Remove struct ndpi_packet_struct from struct ndpi_flow_struct ( #1319 )
...
There are no real reasons to embed `struct ndpi_packet_struct` (i.e. "packet")
in `struct ndpi_flow_struct` (i.e. "flow"). In other words, we can avoid
saving dissection information of "current packet" into the "flow" state,
i.e. in the flow management table.
The nDPI detection module processes only one packet at the time, so it is
safe to save packet dissection information in `struct ndpi_detection_module_struct`,
reusing always the same "packet" instance and saving a huge amount of memory.
Bottom line: we need only one copy of "packet" (for detection module),
not one for each "flow".
It is not clear how/why "packet" ended up in "flow" in the first place.
It has been there since the beginning of the GIT history, but in the original
OpenDPI code `struct ipoque_packet_struct` was embedded in
`struct ipoque_detection_module_struct`, i.e. there was the same exact
situation this commit wants to achieve.
Most of the changes in this PR are some boilerplate to update something
like "flow->packet" into something like "module->packet" throughout the code.
Some attention has been paid to update `ndpi_init_packet()` since we need
to reset some "packet" fields before starting to process another packet.
There has been one important change, though, in ndpi_detection_giveup().
Nothing changed for the applications/users, but this function can't access
"packet" anymore.
The reason is that this function can be called "asynchronously" with respect
to the data processing, i.e in context where there is no valid notion of
"current packet"; for example ndpiReader calls it after having processed all
the traffic, iterating the entire session table.
Mining LRU stuff seems a bit odd (even before this patch): probably we need
to rethink it, as a follow-up.
2021-10-05 15:49:52 +02:00
Ivan Nardi
f3fcf1e7c0
Update unit tests results after da8eed5a ( #1323 )
2021-10-05 15:06:34 +02:00
Luca Deri
da8eed5a32
Updated description
2021-10-05 11:08:16 +02:00
Ivan Nardi
c1e794366f
WHOIS: enhance detection, avoiding false positives ( #1320 )
...
We are interested only in the domain name required, not in the long reply.
2021-10-05 09:35:04 +02:00
Luca Deri
bb7aff6526
Added -a <num> to ndpiReader for generating OPNsense configuration
...
See https://github.com/ntop/opnsense
2021-10-04 22:34:49 +02:00
Luca Deri
fd0e65cb57
Removed trace
2021-10-03 23:41:31 +02:00
Ivan Nardi
bc5be1e76c
Fix how some protocols handle tcp retransmissions ( #1321 )
...
Most (all?) protocols don't care about (tcp) retransmissions.
If a protocol registers itself with a
NDPI_SELECTION_BITMASK_PROTOCOL_*_WITHOUT_RETRANSMISSION value, its
callback is never triggered with a retransmitted packet.
2021-10-03 21:38:49 +02:00
Toni
e84da386c7
Added nDPI pkg-config file to Debian / Ubuntu ndpi-dev packaging. ( #1318 )
...
* Added nDPI pkg-config file to Debian / Ubuntu ndpi-dev packaging.
* fixed missing gcrypt library dependency in libndpi.pc
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-10-03 21:29:56 +02:00
Simone Mainardi
06f763e6c3
Adds sections labels with risk id to the docs
2021-10-01 15:02:14 +02:00
Luca Deri
a9d4f5d8d0
Warning fix
2021-10-01 11:36:35 +02:00
Luca Deri
8e6de00ce3
Initial attempt to write nDPI documentation. Starting with flow risks. Please contribute
2021-10-01 11:32:27 +02:00
Ivan Nardi
5cf3fef8f7
Remove detected_protocol_stack field from ndpi_packet_struct ( #1317 )
...
This field is an exact copy of `ndpi_flow_struct->detected_protocol_stack[2]`:
* at the very beginning of packet dissection, the value saved in
`flow->detected_protocol_stack` is copied in `packet->detected_protocol_stack`
(via `ndpi_detection_process_packet()` -> `ndpi_init_packet_header()`)
* every time we update `flow->detected_protocol_stack` we update
`packet->detected_protocol_stack` too (via `ndpi_int_change_protocol()`
-> `ndpi_int_change_packet_protocol()`)
These two fields are always in sync: keeping the same value in two
different places is useless.
2021-09-29 13:11:32 +02:00
Alfredo Cardigliano
721031210b
Fix warning
2021-09-28 09:44:31 +02:00
Luca Deri
af35d6b963
Added unit test for bitmap iteration
2021-09-27 12:47:05 +02:00
Luca Deri
b9ccff0761
Compilation fixed on CentOS 7
...
Bitmap APi changes
2021-09-27 12:41:40 +02:00
Luca Deri
241ee32cbc
Bitmap code
2021-09-27 12:06:46 +02:00
Luca Deri
519c69c5cc
Reworked bitmap code
2021-09-27 10:29:03 +02:00
Luca Deri
72df138a7d
Warnign fix
2021-09-27 09:08:04 +02:00
eac7024489
Fix armhf ( #1315 )
...
* Fix unaligned memory accesses with get_u_int64_t at armhf
see: https://bugs.debian.org/993627
* Use get_u_int64_t to avoid unaligned memory access at armhf
see: https://bugs.debian.org/993627
* Update src/include/ndpi_define.h.in
Drop const type from get_u_int64_t, from lnslbrty
Co-authored-by: Bernhard Übelacker <bernhardu@mailbox.org >
Co-authored-by: Toni <matzeton@googlemail.com >
2021-09-26 23:53:00 +02:00
Luca Deri
5ed1930a93
Added include for defining bools (not present on all platforms)
2021-09-26 23:00:13 +02:00
Luca Deri
1efabef4cf
Added API for handling compressed bitmaps
...
ndpi_bitmap* ndpi_bitmap_alloc();
void ndpi_bitmap_free(ndpi_bitmap* b);
u_int64_t ndpi_bitmap_cardinality(ndpi_bitmap* b);
void ndpi_bitmap_set(ndpi_bitmap* b, u_int32_t value);
void ndpi_bitmap_unset(ndpi_bitmap* b, u_int32_t value);
bool ndpi_bitmap_isset(ndpi_bitmap* b, u_int32_t value);
void ndpi_bitmap_clear(ndpi_bitmap* b);
size_t ndpi_bitmap_serialize(ndpi_bitmap* b, char **buf);
ndpi_bitmap* ndpi_bitmap_deserialize(char *buf);
based on https://github.com/RoaringBitmap/CRoaring
2021-09-26 22:55:15 +02:00
Zied Aouini
c40cf4e0ec
Add arm64, armhf and s390x as part of CI. ( #1314 )
...
* Add arm64, armhf and s390x as part on CI.
* Minor fix.
* Fix code inspector complaints.
2021-09-23 14:41:56 +02:00
Ivan Nardi
7eb73bc92a
QUIC: fix old GQUIC versions on big-endian machines ( #1313 )
2021-09-23 13:24:49 +02:00
Zied Aouini
0994771974
Improve CI ( #1303 )
...
* Improve CI pipeline
* Fix branch name.
* Fix branch name.
* Fix libgcrypt configuration.
* Update build.yml
* Move to Github Actions instead of Travis CI.
* Fix mingw on ubuntu bionic.
* Reactivate cross compile on Ubuntu Bionic.
* Switch to single line steps.
* Add several compilers versions
* Minor fix.
* Fix build all and delete cxx
* Fix RCE detection.
* Fix PCRE configuration.
* Add condition on PCRE test pcap.
* Update WebattackRCE.pcap.out
* Add missing SUBST.
* Delete WebattackRCE.pcap.out
* Update WebAttackRCE result.
* Fix typo.
* Extend jobs with pcre+msan+maxminddb.
* Fix code inpector warnings.
* Delete .appveyor.yml
2021-09-22 12:10:52 +02:00
Toni
9717afb2da
Merge pull request #1311 from IvanNardi/ftp-start-tls
...
FTP: fix support for START-TLS sessions
2021-09-22 12:08:04 +02:00
Nardi Ivan
017c1a4239
FTP: fix support for START-TLS sessions
...
When TLS-over-FTP is used, the credentials are encrypted. So we must not
wait for the username and the password commands, otherwise we elaborate a
lot of packets for nothing.
2021-09-21 20:53:04 +02:00
Toni
bb52f1362c
Merge pull request #1309 from IvanNardi/ipv6-headers
...
Fix parsing of ipv6 packets with extension headers
2021-09-20 12:54:01 +02:00
Toni
d74c2739d5
Merge pull request #1310 from IvanNardi/stun-realm
...
STUN: fix extraction of Realm attribute
2021-09-20 11:53:40 +02:00
Nardi Ivan
95ac8fd41a
STUN: fix extraction of Realm attribute
...
While at it, improve detection of Facebook Messenger
2021-09-20 11:04:54 +02:00
Nardi Ivan
03d3e1bafc
Fix parsing of ipv6 packets with extension headers
...
Decoding of ipv6 traffic with extension headers was completely broken,
since the beginning of the L4 header was always set to a wrong value.
Handle the ipv6 fragments in the same way as the ipv4 ones: keep the first
one and drop the others.
2021-09-19 17:29:22 +02:00
Ivan Nardi
994bd0696b
Small fixes after latest commits ( #1308 )
2021-09-18 09:31:00 +02:00
Ivan Nardi
227e586e63
A (tiny) effort to reduce memory usage per flow ( #1304 )
...
Follow-up of 22241a1d
Only trivial changes:
* remove completely unused fields
* remove fields only written (but never read)
* CSGO protocol only handles UDP traffic
2021-09-18 09:29:45 +02:00
Luca Deri
4539e96ce2
Added DNS fragmented test pcap
2021-09-17 15:56:18 +02:00
Luca Deri
3303dac7cf
Improved fragmented DNS detection
2021-09-17 15:17:39 +02:00
Luca Deri
119a14c6e3
DNS dissection fixes
2021-09-17 12:20:19 +02:00
deboracerretini and Luca Deri
8f113c1d37
Progetto esame Gestione di Reti - Debora Cerretini ( #1290 )
...
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2021-09-17 11:01:50 +02:00
Ivan Nardi
6325aebda6
TLS: avoid zeroing large structures ( #1300 )
...
Zeroing large structures (i.e. size > KB) is quite costly (from a CPU point
of view): we can safely avoid doing that for a couple of big structures.
Standard and Valgrind tests have been diverging quite a lot: it is time
to re-sync them. Use the same script and enable Valgrind via an
enviroment variable:
NDPI_TESTS_VALGRIND=1 ./tests/do.sh
2021-09-16 14:34:59 +02:00
Simone Mainardi
978c9cfda3
Adds instructions to update flow risks in ntopng
2021-09-15 17:49:47 +02:00
Ivan Nardi
0eb7a0388c
Hangout: fix usage of STUN function ( #1299 )
2021-09-13 18:25:43 +02:00
Ivan Nardi
3e06e6f5b8
Fix some ndpi_malloc/ndpi_free pairs ( #1298 )
2021-09-13 18:25:22 +02:00
Ivan Nardi
31404f4865
Update the list of default ports for QUIC protocol ( #1297 )
...
There are no reasons to register UDP/80 as a default port for QUIC
2021-09-13 18:25:04 +02:00
Ivan Nardi
17774bf09c
Bittorrent: fix a potential use-of-uninitialized-value error ( #1296 )
...
Not sure if this is the right fix (from a logical point-of-view): this
code hasn't changed since OpenDPI era (!) and I have't found a trace
triggering this code path.
Anyway, the use-of-uninitialized-value error itself should be fixed.
2021-09-13 18:24:42 +02:00
Vitaly Lavrov
22241a1d36
Removing unused fields from the id_struct structure. ( #1293 )
...
Reduced by 40 bytes.
2021-09-13 18:19:09 +02:00
Ivan Nardi
951bcb0c39
Cassandra: fix compilation when "--enable-debug-messages" option is used ( #1294 )
...
Let's try adding a dedicated compilation in GitHub Actions to easily
detect this kind of errors in the future
2021-09-11 11:10:46 +02:00
Ivan Nardi
083e464929
Fix unit test results after 00857abf ( #1295 )
2021-09-11 11:09:55 +02:00
Luca Deri
00857abf2c
Added new risk for clear text credentials
2021-09-10 22:00:04 +02:00
lucasbaile and Lucas Santos
1fadf4754a
Add Cassandra protocol dissector ( #1285 )
...
Co-authored-by: Lucas Santos <lucas.santos@zerum.com >
2021-09-09 22:47:58 +02:00
Luca Deri
36f08b8d2e
Win fix
2021-09-07 22:37:22 +02:00
Alfredo Cardigliano
57fce4e350
Fix unused var
2021-09-03 17:46:04 +02:00
Alfredo Cardigliano
89af9b7e3c
Print API version
2021-09-01 09:48:37 +02:00
Luca Deri
a6b10cf73f
Fixed memory stats
2021-08-26 12:12:22 +02:00
Luca Deri
90c6fd99a7
ARM fixes
2021-08-25 09:46:29 +02:00
Luca Deri
88040f0449
Compilation fix
2021-08-20 22:47:46 +02:00
Ivan Nardi
9e0f0ce3df
Fix access to some TLS fields in flow structure ( #1277 )
...
Fields 'tls.hello_processed` and `tls.subprotocol_detected` are used by
QUIC (i.e UDP...), too.
2021-08-20 18:11:37 +02:00
Ivan Nardi
8fdffbf3a1
Compile everything with "-W -Wall -Wno-unused-parameter" flags ( #1276 )
...
Fix all the warnings.
Getting rid of "-Wno-unused-parameter" is quite complex because some
parameters usage depends on compilation variable (i.e.
`--enable-debug-messages`).
The "-Werror" flag has been added only in Travis builds to avoid
breaking the builds to users using uncommon/untested
OS/compiler/enviroment.
Tested on:
* x86_64; Ubuntu 20.04; gcc 7,8,9,10,11; clang 7,8,9,10,11,12
* x86_64; CentOS 7.7; gcc 4.8.5 (with "--disable-gcrypt" flag)
* Raspberry 4; Debian 10.10; gcc 8.3.0
2021-08-20 18:11:13 +02:00
Ivan Nardi
55eec29c08
wireshark/lua: restore full flow risks dissection ( #1275 )
...
It was partially disabled in 3eba8cc5 .
Wireshark and Wireshark-Lua bindings don't handle 64 bit integer very well.
(see https://www.wireshark.org/docs/wsdg_html_chunked/lua_module_Int64.html ).
As workaround, only for visualization purpose, split the (64 bit) risk mask
into two 32 bit integer values.
2021-08-18 11:34:46 +02:00
Toni
8d0c7b1fae
Fixed Mingw64 build, SonerCloud-CI and more. ( #1273 )
...
* Added ARM build and unit test run for SonarCloud-CI.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Fixed Mingw64 build.
* adapted to SonarCloud-CI workflow
* removed broken and incomplete Windows example (tested on VS2017/VS2019)
* removed unnecessary include (e.g. pthread.h for the library which does not make use of it)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-08-18 11:34:16 +02:00
Luca Deri
677b513f70
Fixes a crash on ARM (Raspberry Pi 4 Model B Rev 1.1)
2021-08-18 11:12:06 +02:00
Luca Deri
821f4c9249
Fixed some invalid TLS guesses
2021-08-17 19:04:07 +02:00
Luca Deri
a2ea67152c
Added check to avoid clases on similar protocols (FTP adn SMTP) on setting hostname
2021-08-11 12:11:58 +02:00
Luca Deri
5c33fbf19b
Added extraction of hostname in SMTP
...
Fixed mail incalid subprotocol calculation
2021-08-11 11:52:24 +02:00
Alfredo Cardigliano
846b546dbc
Fix typo
2021-08-10 11:43:32 +02:00
Luca Deri
c1acb6d801
Typo
2021-08-09 18:36:36 +02:00
Luca Deri
0fbe895103
Addef ETH_ARP definition
2021-08-09 18:33:33 +02:00
Luca Deri
05492ec8e8
Defined more standard ethernet protocol types
2021-08-09 17:01:10 +02:00
Luca Deri
58ca7b5a7f
Added protocol defines
2021-08-09 16:45:03 +02:00
Luca Deri
0df8aa19ec
Clode cleanup (after last merge)
2021-08-08 17:10:08 +02:00
Toni and Luca Deri
259b60f574
Added entropy calculation to check for suspicious (encrypted) payload. ( #1270 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2021-08-08 17:03:23 +02:00
Toni
4e856a41d6
Skip whitespaces between HTTP method and URL. ( #1271 )
...
* be less case-restrictive, RFC2616 wants it that way
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-08-08 17:00:10 +02:00
Toni
8e996f7f7c
Fixed broken SonarCloud-CI. ( #1272 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-08-08 16:59:36 +02:00
Luca Deri
3706267d68
Updated test output
2021-08-07 19:43:55 +02:00
Luca Deri
0522e562e8
Added testing pcap for TLS fatal alert
2021-08-07 19:42:53 +02:00
Luca Deri
4183718952
Added TLS fatal alert flow risk
2021-08-07 19:40:44 +02:00
Luca Deri
e8455236bd
Updated output
2021-08-07 17:38:33 +02:00
Luca Deri
a13f1fe52f
Report whether a protocol is encrypted
2021-08-07 17:35:34 +02:00
Luca Deri
46ebd7128f
Added ability to report whether a protocol is encrypted
...
Added new API calls
- u_int8_t ndpi_is_valid_protoId(u_int16_t protoId);
Cleaned up code and organized in a function.
- u_int8_t ndpi_is_encrypted_proto(struct ndpi_detection_module_struct *ndpi_str, ndpi_protocol proto);
Check whether a protocol is encrypted or not based on master and app protocols
2021-08-07 17:10:18 +02:00
Luca Deri
dc841574af
Win fix
2021-08-03 09:44:50 +02:00
Luca Deri
6b7e5fa8d2
Added legacy whatsapp rules used to match old pcaps that need to be removed in the future
2021-07-31 23:49:48 +02:00
Toni
ad57af9f79
Improved RTSP detection and fixed HTTP false-positive. Fixes #1229 . ( #1266 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-31 23:31:49 +02:00
Fábio Depin
ce597b4806
Updated WhatsAPP and Instagram addresses ( #1264 )
...
* Updated WhatsAPP addresses
* Added Instagram addresses
2021-07-31 23:30:34 +02:00
Toni
13c5d6801e
Improved libm check via Autoconf. ( #1263 )
...
* libm will now be part of @ADDITIONAL_LIBS@ (if required)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-28 22:24:03 +02:00
Luca Deri
cb26a8c82d
Moved to 4.1.0
2021-07-26 09:40:50 +02:00
Luca Deri
4cafa7cb1e
Improved risk detection mask algorithm
2021-07-26 09:38:53 +02:00
Toni
29ec34f66d
Improved TFTP detection. Fixes #1242 , #1256 ( #1262 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-25 21:54:19 +02:00
Luca Deri
a482e1c0be
Typo (Thanks Ivan)
2021-07-24 18:12:09 +02:00
Luca Deri
1d9a830b2f
Update changelog
2021-07-24 17:54:32 +02:00
Luca Deri
51e4888442
Implemented ALPN automa for checking uncommon ALPNs
2021-07-24 17:50:32 +02:00
Luca Deri
526568fcd5
Risk check improvement
2021-07-24 16:18:18 +02:00
Alfredo Cardigliano
c73501f859
Typo
2021-07-23 18:14:11 +02:00
Alfredo Cardigliano
d5a60880d0
Fix prototype
2021-07-23 18:12:54 +02:00
Luca Deri
61fc5be202
Reworked flow risk implementation
2021-07-23 17:27:15 +02:00
Ivan Nardi
4ffe1eb3c0
Fix unit tests when "--disable-gcrypt" flag is used ( #1255 )
2021-07-23 10:37:36 +02:00
Toni
6ad0d6666c
Implemented function to retrieve flow information. #1253 ( #1254 )
...
* fixed [h]euristic typo
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-23 10:37:20 +02:00
Luca Deri
8ea8ba8e9b
Fixed risk mask implementation
2021-07-23 08:29:36 +02:00
Luca Deri
b01b60a2b5
Implementation of flow risk eception (work in progress)
2021-07-22 01:35:57 +02:00
Alfredo Cardigliano
fc9901292d
Update changelog
2021-07-20 17:04:35 +00:00
Toni
32275543c4
Added risk: TLS_EXTENSION_SUSPICIOUS ( #1252 )
...
* validates client/server hello TLS extensions
* inspects content for some extensions
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-19 16:23:24 +02:00
Ivan Nardi
57b8969a3d
Fix setting of flow risks on 32 bit machines ( #1251 )
...
Since 19a29e1e (NDPI_TLS_CERT_VALIDITY_TOO_LONG is 32), unit tests are
failing on 32 bit machines (i.e Raspberry 4)
2021-07-19 16:22:39 +02:00
Luca Deri
0adcd28450
Updated download category name
2021-07-16 14:04:47 +02:00
Vitaly Lavrov
295cb3ee6a
Bug fix. ( #1250 )
...
Restore part of the fields flow->packet after cleaning flow structure.
2021-07-16 13:53:36 +02:00
pacant and pacant
488166833e
Fixed TLS certificate threshold ( #1248 )
...
Co-authored-by: pacant <a.pace97@outlook.com >
2021-07-16 13:52:55 +02:00
Vitaly Lavrov
daf1fbfc7b
Code cleanup. ( #1246 )
...
ndpi_utils.c: use ndpi_malloc,ndpi_calloc,ndpi_free
genshin_impact.c, git.c, hpvirtgrp.c, http.c, z3950.c: removed "#include stdlib.h"
2021-07-16 13:51:54 +02:00
Luca Deri
a6de94a930
hulu and netflix dissection improvements
2021-07-14 12:53:03 +02:00
Luca Deri
3eba8cc5b5
Temporary fix for avoiding wireshark errors
2021-07-14 12:51:42 +02:00
Luca Deri
b95bd0358f
Code cleanup
2021-07-14 11:19:24 +02:00
pacant and pacant
19a29e1e22
TLS Risks - Certificate Validity Too Long ( #1239 )
...
* Added flow risk: TLS certificate too long
* Added flow risk: TLS certificate too long
* Date for TLS limit added
* TLS certificate check fixed
Co-authored-by: pacant <a.pace97@outlook.com >
2021-07-14 11:13:22 +02:00
Toni
c411df523e
Added AVAST SecureDNS protocol. ( #1244 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-14 11:11:59 +02:00
Toni
62bae30a4a
Improved Steam detection (Steam Datagram Relay - SDR). ( #1243 )
...
* improved DNSCrypt midstream detection again (sufficient for all tested use-cases)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-14 11:09:58 +02:00
Toni
e4453938d5
Improved dnscrypt midstream detection. ( #1241 )
...
* fixed skype false-positive detection of dnscrypt traffic
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-13 15:10:18 +02:00
Ivan Nardi
cccf794265
ndpiReader: add statistics about nDPI performance ( #1240 )
...
The goal is to have a (roughly) idea about how many packets nDPI needs
to properly classify a flow.
Log this information (and guessed flows number too) during unit tests,
to keep track of improvements/regressions across commits.
2021-07-13 12:28:39 +02:00
Luca Deri
96b71def49
Minor change
2021-07-12 17:51:25 +02:00
Vitaly Lavrov
c418b7110b
ahoсorasick. Code review. Part 2. ( #1236 )
...
Simplified the process of adding lines to AC_AUTOMATA_t.
Use the ndpi_string_to_automa() function to add patterns with domain names.
For other cases can use ndpi_add_string_value_to_automa().
ac_automata_feature(ac_automa, AC_FEATURE_LC) allows adding
and compare data in a case insensitive manner. For mandatory pattern comparison
from the end of the line, the "ac_pattern.rep.at_end=1" flag is used.
This eliminated unnecessary conversions to lowercase and adding "$" for
end-of-line matching in domain name patterns.
ac_match_handler() has been renamed ac_domain_match_handler() and has been greatly simplified.
ac_domain_match_handler() looks for the template with the highest domain level.
For special cases it is possible to manually specify the domain level.
Added test for checking ambiguous domain names like:
- short.weixin.qq.com is QQ, not Wechat
- instagram.faae1-1.fna.fbcdn.net is Instagram, not Facebook
If you specify a NULL handler when creating the AC_AUTOMATA_t structure,
then a pattern with the maximum length that satisfies the search conditions will be found
(exact match, from the beginning of the string, from the end of the string, or a substring).
Added debugging for ac_automata_search.
To do this, you need to enable debugging globally using ac_automata_enable_debug(1) and
enable debugging in the AC_AUTOMATA_t structure using ac_automata_name("name", AC_FEATURE_DEBUG).
The search will display "name" and a list of matching patterns.
Running "AHO_DEBUG=1 ndpiReader ..." will show the lines that were searched for templates
and which templates were found.
The ac_automata_dump() prototype has been changed. Now it outputs data to a file.
If it is specified as NULL, then the output will be directed to stdout.
If you need to get data as a string, then use open_memstream().
Added the ability to run individual tests via the do.sh script
2021-07-12 17:39:43 +02:00
Luca Deri
78b1295dc1
Fixed false positives in Z39.50
2021-07-09 00:16:48 +02:00
Luca Deri
bec8361638
Updated category labels
2021-07-08 20:05:50 +02:00
Vitaly Lavrov
398ad8e5ff
Fix for #1230 ( #1235 )
...
* Revert "Fix return value of ndpi_match_string_subprotocol() (#1230 )"
This reverts commit 58665e93a9 .
* Checking the return code after calling ndpi_match_string_subprotocol()
ndpi_api.h: Description of the returned error codes for
the ndpi_match_string_subprotocol() function.
If the ndpi_match_string_subprotocol() function returned an error,
then return NDPI_PROTOCOL_UNKNOWN.
http: The "Content-type" header is only checked if it is not empty.
2021-07-07 14:32:57 +02:00
Toni
34d0718bca
Improved RTSP detection the second. ( #1232 ) ( #1233 )
...
* RTSP is no subprotocol of HTTP (most of the time)
* detection patterns should stay in rtsp.c
* set detected HTTP protocol only if at least a valid HTTP method detected
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-07 09:55:36 +02:00
Luca Deri
c408710c52
Added test pcap
2021-07-06 18:57:52 +02:00
Toni
6f29733262
Improved RTSP via HTTP detection. ( #1232 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-06 18:57:04 +02:00
Ivan Nardi
58665e93a9
Fix return value of ndpi_match_string_subprotocol() ( #1230 )
2021-07-06 18:55:14 +02:00
Luca Deri
1ee7355b91
Updated prototype
2021-07-05 22:35:11 +02:00
Luca Deri
e5dacc28e7
Minor fix
2021-07-05 22:02:46 +02:00
Luca Deri
48db44a567
Code cleanup
2021-07-05 21:45:30 +02:00
Alfredo Cardigliano
8e7b063804
Fix possible segfault/leak
2021-07-05 15:09:48 +02:00
Toni
6f7acfcab5
Added protocols to HTTP as subprotocols. ( #1228 )
...
* if HTTP was detected,
all of those defined subprotocol detection routines should called
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-05 09:43:15 +02:00
Ivan Nardi
46c32d2433
TLS: fix a memory error in JA3 code ( #1227 )
...
protocols/tls.c:1856:5: runtime error: index 256 out of bounds for type 'char [256]'
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior protocols/tls.c:1856:5
2021-07-05 09:42:52 +02:00
Ivan Nardi
1116d0e4b1
Improve content match lists ( #1226 )
...
Add support for Likee app (https://likee.video/ ) and GitLab
Improve detection of Google domains ("gtv1.com" added in 6dd42d19f was
likely a typo)
Improve Snapchat and Tiktok detection
2021-07-05 09:42:11 +02:00
Toni
21b2cce715
Improved Z39.50 detection. ( #1225 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-07-05 09:41:35 +02:00
Toni
ced6fca184
Fixed off-by-one memory error for TLS-JA3. ( #1222 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-06-29 15:33:12 +02:00
Toni
8222ac5bdc
Removed ht_hash as it is not used anymore. ( #1220 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-06-29 15:32:48 +02:00
Toni
1c2a0c36f1
Added Z39.50 protocol. ( #1219 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-06-29 15:32:16 +02:00
vpiserchia and vpiserchia
e5fd86393e
reconcile PPSTREAM protocol category with content_match declarations ( #1218 )
...
* reconcile PPSTREAM protocol category with content_match declarations
* remove duplicate declaration for PPSTREAM protocol
Co-authored-by: vpiserchia <vito.piserchia@dreamlab.net >
2021-06-28 14:58:42 +02:00
Ivan Nardi
f8fe3ee520
QUIC: add basic support for fragmented Client Hello ( #1216 )
...
Only in-order and non overlapping fragments are handled
See #1195
2021-06-24 18:30:34 +02:00
Luca Deri
6a1fd9ad97
Added missing check to prevent crashes
2021-06-23 12:17:21 +02:00
Vitaly Lavrov
2234b97149
ndpiReader: memory leak ( #1215 )
...
Non-critical bugs.
If a file list is used, then all files except the last are not closed.
Opening the next file loses the memory allocated via pcap_open_offline() for the previous file.
If a bpf filter is used, then no memory is freed after pcap_compile.
2021-06-23 12:04:03 +02:00
Vitaly Lavrov
35fc6a6de5
Speed and memory size optimisation ( #1214 )
...
Removed bigram_automata, impossible_bigram_automata, trigram_automata.
The ahocorasick structure is replaced with a bitmap.
The bitmap size for ndpi_en_bigram is 176 bytes.
The bitmap size for ndpi_en_trigram is 2201 bytes.
On the test machine, the test execution time was reduced from 27.3 seconds to 24.7 (9%).
2021-06-23 12:03:52 +02:00
Luca Deri
f19937c8c9
Addesses partial application matching ( #1207 )
2021-06-21 21:59:15 +02:00
Luca Deri
0cbb4b2ffa
Restored 32 bit value in ndpi_match_string_value()
2021-06-21 17:06:22 +02:00
Luca Deri
613e21002a
Upgraded exponential smoothing to 64 bit values
2021-06-18 22:56:56 +02:00
Luca Deri
0afc8ace3d
Added nDPI Score report
2021-06-17 23:52:01 +02:00
martinscheu and tinu
0b9b6a683d
fixed lua errors in non-iec104 packets ( #1209 )
...
* Update iec.lua
fixed lua errors in non iec 104 packets
* Update iec.lua
Co-authored-by: tinu <martin.scheu@switch.ch >
2021-06-17 15:35:31 +02:00
Luca Deri
b0b3e1bc6c
Added bitmap boundary checks
2021-06-17 10:49:11 +02:00
Luca Deri
e89c06256e
Extende nDPI API with ndpi_netbios_name_interpret()
2021-06-17 09:35:19 +02:00
Luca Deri
2eba77e3b0
NetBIOS decoding changes
2021-06-16 19:57:20 +02:00
Vitaly Lavrov
be808c30f3
Code review. ( #1205 )
...
The common actions required to call the ac_automata_search() function
have been moved to the ndpi_match_string_common function. This made it
possible to simplify the ndpi_match_string, ndpi_match_string_protocol_id,
ndpi_match_string_value, ndpi_match_custom_category, ndpi_match_string_subprotocol,
ndpi_match_bigram, ndpi_match_trigram functions.
Using u_int16_t type for protocol identifiers when working with the
ahocorasick library (changes src/include/ndpi_api.h.in and src/include/ndpi_typedefs.h).
Reworked "finalization" of all AC_AUTOMATA_t structures.
Changing the order of fields in the ndpi_call_function_struct structure
reduces the size of the ndpi_detection_module_struct structure by 10 kB (for x86_64).
2021-06-15 11:28:09 +02:00
Luca Deri
09293fabd9
Win fix
2021-06-15 11:26:36 +02:00
Luca Deri
43ccaef2f5
IEC analysis wireshark plugin
2021-06-14 21:18:37 +02:00
Alfredo Cardigliano
4aefbe0c7a
Call ac_automata_release with free_pattern = 1 (malloc'ed patterns expected in ndpi_add_string_to_automa)
2021-06-14 14:41:14 +02:00
Luca Deri
380286c069
Fixes https://github.com/ntop/ntopng/issues/5482
2021-06-11 22:21:03 +02:00
Luca Deri
a79b8ee834
Reimplememnted SNMP dissector
2021-06-11 21:44:51 +02:00
Luca Deri
dee6f90d6c
Syntax error fixes
2021-06-11 21:01:27 +02:00
Luca Deri
c9f582805b
Fixed flow score label
2021-06-11 19:53:07 +02:00
Matteo Biscosi
a01a2b7443
Changed output for the sharkfest lua scripts
2021-06-11 11:00:06 +02:00
Vitaly Lavrov
6704649a75
Bug in ndpi_lru_find_cache ( #1204 )
...
Key value check is missing.
2021-06-10 11:06:19 +02:00
Luca
1a8ae710cf
Minor code cleanup
2021-06-09 08:58:18 +02:00
Toni
65e67a2f88
autoconf: Do not check for json-c if --with-only-libndpi is set. ( #1202 )
...
* json-c is used by a unit test
* required to fix some libnDPI cross compilation issues
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-06-09 08:01:10 +02:00
Luca Deri
77710ed8b4
OpenWRT document fix
2021-06-08 21:39:28 +00:00
Luca Deri
177f9456bd
Win changes
2021-06-08 18:15:46 +02:00
Luca Deri
d3aa3df975
Updated scripts
2021-06-08 17:52:03 +02:00
Luca
41ec807d79
New testing pcap with syn scan attack
2021-06-08 10:39:41 +02:00
Luca
2f8d3ac0b0
Companion scripts written for the Sharkfest conference
2021-06-08 10:39:19 +02:00
Luca Deri
2af7b33de0
Added report on score cli/srv breakdown
2021-06-07 14:59:18 +02:00
Vitaly Lavrov
65678dbeea
New version of the ahocorasick library ( #1200 )
...
The new version is about 25% faster with -O2 and 45% faster with -O3.
No recursion is used (smaller stack size required).
Uses less memory (by valgrind info)
bigram:
- original 1796 allocs, 247864 bytes allocated
- new 1232 allocs, 158880 bytes allocated
host_match:
- original 18038 allocs, 3004576 bytes allocated
- new 6861 allocs, 396624 bytes allocated
The function ac_automata_search() is thread safe.
Optional case-insensitive comparison.
Matching at the beginning and at the end of the string is supported.
One code file and one header file.
2021-06-07 14:19:40 +02:00
Vitaly Lavrov
2fcf641e87
Fixed uninitialized memory use. ( #1198 )
...
The pointer "header" must be initialized before first call pcap_next_ex().
2021-06-07 10:08:39 +02:00
Luca Deri
b241dd5e6b
Fixed expected output
2021-06-03 09:06:01 +02:00
Luca Deri
03ae090d39
Warnign fix
2021-06-03 09:05:53 +02:00
Luca Deri
8761ac1887
Renamed Skyp in Skype_Teams as the protocol is now shared across these apps
2021-06-02 21:47:01 +02:00
Ivan Nardi
654e84ff02
wireshark/lua: improve flow risk visualization ( #1194 )
...
Create a separated proto field entry for each possible flow risk.
This way, filtering will be more natural: you can use something like
"ndpi.flow_risk.desktop_file_sharing_session"
2021-06-02 21:28:50 +02:00
Luca Deri
06c6941f03
Removed xbox and playstation invalid port guesses
2021-06-02 00:24:41 +02:00
Ivan Nardi
9d427faafe
ndpiReader: fix collecting of risks statistics ( #1192 )
2021-06-01 16:50:46 +02:00
Ivan Nardi
f4dbeecba9
TLS: improve check for common ALPNs ( #1191 )
...
Facebook is still using its own ALPN for HTTP2 as well
2021-06-01 16:50:28 +02:00
Luca
c620858671
Reworked ndpi flow risk score adding client and server score
2021-06-01 09:17:26 +02:00
Alfredo Cardigliano
c4084ca3c7
Fix warnings
2021-05-25 15:17:48 +02:00
Luca
eb0115d4e0
Added TLS check to avoid crash with UDP-based traffic
2021-05-25 09:03:24 +02:00
Luca Deri
d485c1cecb
Improved TLS browser detection heuristics
2021-05-19 21:28:33 +02:00
Ivan Nardi
71b81d3799
wireshark/lua: fix offsets ( #1187 )
2021-05-18 21:36:46 +02:00
Luca Deri
732bcecd17
Added flow risk score
2021-05-18 21:05:47 +02:00
Luca Deri
86f3c29d03
Typo
2021-05-18 19:52:33 +02:00
Luca Deri
ca15e3295e
Added risk/score dump (ndpiReader -h)
...
Added ndpi_dump_risks_score() API score
2021-05-18 19:34:17 +02:00
Luca Deri
0b3d627185
Updated API for ndpi_risk2score()
...
Added ndpi_get_upper_proto() API call
2021-05-17 22:39:07 +02:00
Luca Deri
43a8576efb
Reworked human readeable string search in flows
...
Removed fragment manager code
2021-05-17 20:55:06 +02:00
Luca Deri
1ec621c85b
Added further checks
2021-05-15 19:53:46 +02:00
Luca Deri
9c5ba9c060
Updated protocol category
2021-05-15 11:20:15 +02:00
Luca Deri
5646ffa725
Added ndpi_check_subprotocol_risk() API call definition
2021-05-15 11:16:27 +02:00
Luca Deri
abd6bce6f9
Added TLS certifiacate caching
...
Added Fortigate protocol
2021-05-15 10:52:16 +02:00
Luca Deri
ca92660d98
Converted some test .pcapng files to pcap format
2021-05-13 20:51:11 +02:00
Luca Deri
ac1eaca8a6
Added browser TLS heuristic
2021-05-13 20:00:27 +02:00
Luca Deri
a62be9b8ec
Implemented heuristic to detect Safari and Firefox TLS browsing
2021-05-13 12:37:07 +02:00
Toni
87076dcd5b
Fixed obsolete error printing if CTRL-C is pressed. #1165 ( #1184 )
...
* This fix was proposed by @robertsong2019
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-05-11 21:38:56 +02:00
Toni
5918a6542d
Improved SSL certificate name wildcard handling and risk. #1182 ( #1183 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-05-11 21:38:26 +02:00
Luca Deri
a5ecdf9df8
Changes for sonarcloud integration
2021-05-11 21:36:25 +02:00
Luca Deri
5079bb1106
Fixed typo
2021-05-11 21:33:48 +02:00
Luca Deri
4297a65ce8
Implemented flow score in Wireshark integration
2021-05-10 22:43:05 +02:00
Luca Deri
fff60ec317
Added check to reduce MongoDB false positive detection
2021-05-10 21:14:55 +02:00
Luca Deri
66ebe444ae
Added (partial) Activision protocol support (based on tencent cloud)
2021-05-10 15:41:52 +02:00
Ivan Nardi
1deae1132b
Fix some warnings ( #1181 )
...
```
In file included from protocols/fasttrack.c:29:
../include/ndpi_api.h:1504:3: warning: type qualifiers ignored on function return type [-Wignored-qualifiers]
1504 | const ndpi_risk_severity ndpi_risk2severity(ndpi_risk_enum risk);
| ^~~~~
In file included from protocols/amazon_video.c:28:
../include/ndpi_api.h:1504:3: warning: type qualifiers ignored on function return type [-Wignored-qualifiers]
1504 | const ndpi_risk_severity ndpi_risk2severity(ndpi_risk_enum risk);
| ^~~~~
...
ndpi_utils.c: In function ‘ndpi_risk2severity’:
ndpi_utils.c:1834:1: warning: control reaches end of non-void function [-Wreturn-type]
1834 | }
| ^
```
2021-05-09 15:11:05 +02:00
Ivan Nardi
2ca37ff8be
TLS: fix extraction for TLS signature algorithms ( #1180 )
...
```
==69562==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x6100009000fb at pc 0x7f41882003a7 bp 0x7f4183cfbfc0 sp 0x7f4183cfb768
READ of size 32 at 0x6100009000fb thread T1
#0 0x7f41882003a6 in __interceptor_memcpy ../../../../src/libsanitizer/sanitizer_common/sanitizer_common_interceptors.inc:827
#1 0x560b2d7462a1 in processClientServerHello protocols/tls.c:1647
#2 0x560b2d73be6a in processTLSBlock protocols/tls.c:712
#3 0x560b2d73e61f in ndpi_search_tls_udp protocols/tls.c:968
```
2021-05-09 15:10:41 +02:00
Ivan Nardi
12c6ab768d
TLS: fix another use-of-uninitialized-value error in ClientHello parsing ( #1179 )
...
Error detected with valgrind.
==13127== Conditional jump or move depends on uninitialised value(s)
==13127== at 0x483EF58: strlen (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
==13127== by 0x1A93B6: ndpi_strdup (ndpi_main.c:159)
==13127== by 0x1C07CC: processClientServerHello (tls.c:1678)
==13127== by 0x1C0C4C: processTLSBlock (tls.c:712)
==13127== by 0x1C0C4C: ndpi_search_tls_tcp.part.0 (tls.c:849)
See also 8c3674e9
2021-05-09 15:10:14 +02:00
Toni
8c28613eb2
Check datalink during fuzzing to prevent console / logfile spam. See #1175 for more information. ( #1177 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-05-09 15:09:43 +02:00
Bernhard M. Wiedemann
0663544be8
Allow to override build date with SOURCE_DATE_EPOCH ( #1176 )
...
in order to make builds reproducible.
See https://reproducible-builds.org/ for why this is good
and https://reproducible-builds.org/specs/source-date-epoch/
for the definition of this variable.
2021-05-09 15:09:15 +02:00
Luca
ae2470fad4
Initial work towards detection via TLS of browser types
2021-05-06 21:42:06 +02:00
Luca
808050e635
Add extraction for TLS signature algorithms
2021-05-06 08:56:01 +02:00
Luca
ce54a6ab57
Added ndpi_risk2severity() API call
2021-05-02 19:35:01 +02:00
Luca Deri
153d11c920
Enhanced netbios decoding check
2021-04-28 22:58:22 +02:00
Luca Deri
dd65142020
Compilation fix
2021-04-27 08:26:08 +02:00
Luca Deri
70686249c9
Updated code due to https://github.com/ntop/nDPI/pull/1175
2021-04-27 08:12:14 +02:00
Luca Deri
7b62db81c3
Removed DGA check for ipv6 reverse IPs
2021-04-27 07:23:11 +02:00
Toni
da3e6bd61b
Check for common ALPNs and set a flow risk if not known. ( #1175 )
...
* Increased risk bitmask to 64bit (instead of 32bit).
* Removed annoying "Unknown datalink" error message for fuzzers.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-04-27 07:22:04 +02:00
Luca Deri
d5b395f35a
Fixed invalid DNS dissection
2021-04-26 23:08:00 +02:00
Luca Deri
87ad2b58dc
Compilation fix
2021-04-26 10:50:19 +02:00
Luca Deri
4a09707e48
Added flow risk to wireshark dissection
2021-04-26 10:17:29 +02:00
Luca Deri
a04efb7ce7
Added tshark description
2021-04-25 11:47:19 +02:00
Luca Deri
fad246289f
README for the tshark class
2021-04-25 11:45:35 +02:00
Luca Deri
b586c223dd
Lua tshark class and examples
2021-04-25 11:40:53 +02:00
Luca Deri
0ef7998348
Removed protocol space in Genshin Impact
2021-04-25 10:06:22 +02:00
Toni
b4a8c8c63f
Add Genshin Impact protocol. ( #1173 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-04-25 10:02:07 +02:00
Alfredo Cardigliano
d95cd9912c
Add vxlan enum to ndpi_packet_tunnel
2021-04-21 12:43:12 +02:00
Toni
9377991263
Add HP Virtual Machine Group Management (hpvirtgrp) protocol. ( #1170 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-04-20 14:12:16 +02:00
Luca Deri
c6a835746e
Reworked GeoIP API
...
int ndpi_get_geoip_asn(struct ndpi_detection_module_struct *ndpi_str,
char *ip, u_int32_t *asn);
int ndpi_get_geoip_country_continent(struct ndpi_detection_module_struct *ndpi_str, char *ip,
char *country_code, u_int8_t country_code_len,
char *continent, u_int8_t continent_len);
2021-04-19 21:39:55 +02:00
Ivan Nardi
8c3674e9a3
TLS: fix some use-of-uninitialized-value errors in ClientHello parsing ( #1169 )
...
Error detected with valgrind.
==125883== Conditional jump or move depends on uninitialised value(s)
==125883== at 0x438F57: processClientServerHello (tls.c:1421)
==125883== by 0x43B35A: processTLSBlock (tls.c:712)
==125883== by 0x43B1C4: ndpi_search_tls_tcp (tls.c:849)
==125883== by 0x42C60B: check_ndpi_detection_func (ndpi_main.c:4426)
==125883== by 0x42E920: ndpi_detection_process_packet (ndpi_main.c:5301)
==125916== Conditional jump or move depends on uninitialised value(s)
==125916== at 0x438D7D: processClientServerHello (tls.c:1379)
==125916== by 0x43B35A: processTLSBlock (tls.c:712)
==125916== by 0x43B1C4: ndpi_search_tls_tcp (tls.c:849)
==125916== by 0x42C60B: check_ndpi_detection_func (ndpi_main.c:4426)
==125932== Conditional jump or move depends on uninitialised value(s)
==125932== at 0x438C1D: processClientServerHello (tls.c:1298)
==125932== by 0x43B35A: processTLSBlock (tls.c:712)
==125932== by 0x43B1C4: ndpi_search_tls_tcp (tls.c:849)
==125932== by 0x42C60B: check_ndpi_detection_func (ndpi_main.c:4426)
==125950== Conditional jump or move depends on uninitialised value(s)
==125950== at 0x438D4F: processClientServerHello (tls.c:1371)
==125950== by 0x43B35A: processTLSBlock (tls.c:712)
==125950== by 0x43B1C4: ndpi_search_tls_tcp (tls.c:849)
==125950== by 0x42C079: check_ndpi_detection_func (ndpi_main.c:4443)
2021-04-18 21:38:01 +02:00
Ivan Nardi
9ca62ed7ac
Fix detunneling of GTP-U traffic ( #1168 )
...
Fuzzing #1161 exposed some (completely unrelated) issues on GTP-U
detunneling code.
(see https://github.com/ntop/nDPI/actions/runs/719882047 )
2021-04-18 21:37:51 +02:00
Ivan Nardi
d9278d55c3
Improve classification of Outlook/MicrosoftMail traffic ( #1167 )
...
See #1148
2021-04-18 21:37:26 +02:00
Luca Deri
9fcf98c067
GeoIP handlign fixes
2021-04-18 21:36:03 +02:00
Luca Deri
18c6c1c2d6
Added NDPI_DESKTOP_OR_FILE_SHARING_SESSION risk to remote protocols for remote assistance sessions
2021-04-12 18:11:14 +02:00
Luca Deri
bf318e0b86
Added NDPI_DESKTOP_OR_FILE_SHARING_SESSION flow risk
2021-04-11 14:42:27 +02:00
Ivan Nardi
ceb98a3f9c
wireshark/lua: fix handling of VLAN traffic ( #1162 )
2021-04-05 19:23:56 +02:00
Ivan Nardi
0bfe444362
GTP: fix parsing of GTP headers ( #1161 )
...
Message length checks and basic headers are not uniform across GTP-U,
GTP-C and GTP-PRIME.
Note that, even if the length checks were wrong, the GTP sessions were almost
always correctly classified because of the "guessing" algorithm.
This patch has been tested with GTP-U, GTP-C-V1, GTP-C-V2 and GPT-PRIME-V2
traffic using ndpiReader with "-d" flag (to avoid "guessing" algorithm) and
without "-t" flag (to avoid GTP-U de-tunneling).
See #1148
2021-04-05 19:23:03 +02:00
Ivan Nardi
fb74785282
Fix some warnings about unused variables/functions ( #1160 )
2021-04-05 19:21:30 +02:00
Luca Deri
a1dba74346
Trace fix
2021-04-02 12:55:15 +02:00
Luca Deri
4f8ca9485a
Fixed incapoatibilities with the latest extcap/wireshark
2021-04-01 23:53:53 +02:00
Luca Deri
db5aeb0cb1
Readme update
2021-04-01 10:24:44 +02:00
Luca Deri
28879c570e
Reworked ndpi patricia includes to avoid compilation issues on some platforms
2021-03-31 19:43:55 +02:00
Ivan Nardi
1290c40968
Mining: lru cache is ipv4 only (for the time being) ( #1159 )
...
Fix memory error with ipv6 traffic
2021-03-31 14:13:07 +02:00
Luca Deri
48726301e1
Fixed mispelled word
2021-03-31 12:52:54 +02:00
Luca Deri
2b84f28df5
Improved mining results
2021-03-30 17:54:44 +02:00
Luca Deri
c1d6e3f145
Improved mining detection support
2021-03-30 17:50:19 +02:00
Luca Deri
637b2063ed
Added missing tracker/Ads breed
2021-03-30 17:50:03 +02:00
Luca Deri
fcbc16da00
Fixed invalid guess stats
2021-03-30 17:49:48 +02:00
Luca Deri
ffbce931b9
Ignore TLD .local .lan and .home in DGA domain check
2021-03-26 15:53:04 +01:00
Ivan Nardi
a6029d250d
ndpiReader: print an error msg if we found an unsupported datalink type ( #1157 )
2021-03-23 11:47:29 +01:00
Toni
b040407683
Refactored nDPI subprotocol handling and aimini protocol detection. ( #1156 )
...
* Refactored and merged callback buffer routines for non-udp-tcp / udp / tcp / tcp-wo-payload.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Try to detect one subprotocol if a detected protocol can have one.
* This adds a performance overhead due to much more protocol detection routine calls.
See #1148 for more information.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Refactor subprotocol handling (1/2).
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Refactor subprotocol handling (2/2).
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Prevent some code duplication by using macros for ndpi_int_one_line_struct string comparision.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Refactored aimini HTTP detection parts (somehow related to #1148 ).
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Added aimini client/server test pcap.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Removed master protocol as it was only used for STUN and via also removed API function ndpi_get_protocol_id_master_proto
* Adjusted Python code to conform to the changes made during the refactoring process.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-03-23 11:46:12 +01:00
Luca Deri
0cae9bf4a4
Win compilation fix
2021-03-22 21:41:28 +01:00
Luca Deri
627299e4dd
Better DGA detection (slightly decreased accuracy)
2021-03-20 17:56:24 +01:00
Luca Deri
6333bb1702
Removed duplicate extesions len
2021-03-19 22:35:08 +01:00
Luca Deri
d96f4ca736
Added ALPN and elliptic curve in JA3S+
2021-03-19 22:33:04 +01:00
Luca Deri
fa238bbe42
Implemented JA3+ also for JA3S
2021-03-19 22:27:36 +01:00
Luca Deri
e2c3445a20
Reworked JA3
2021-03-19 22:20:52 +01:00
Luca Deri
61f7ec1696
JA3 debug improvements
2021-03-19 19:10:31 +01:00
Luca Deri
9eed0a60d3
Fixed support for custom DGA detection libraryr
2021-03-18 11:32:56 +01:00
Luca Deri
b22cb70a68
Added % of flows with risks
2021-03-14 21:59:33 +01:00
Luca Deri
1b6275005e
Added in stats the number of flows with risks
2021-03-14 21:54:35 +01:00
Luca Deri
3b02cfab69
Added flows risks report
2021-03-14 21:46:23 +01:00
Luca Deri
565a7bfce3
Reworked extendal dependency across testing tools
2021-03-14 20:48:21 +01:00
Luca Deri
e58527536d
Help crash fix
2021-03-14 19:55:21 +01:00
Luca Deri
9419015711
Implemented square erro rollup to avoid overflow
2021-03-14 11:01:51 +01:00
Zied Aouini
7f9a18fd05
Make libmaxminddb build configurable. ( #1154 )
2021-03-14 10:47:28 +01:00
Alfredo Cardigliano
efc5630378
Fix compilation warning
2021-03-12 09:25:00 +01:00
Luca
192fad4402
Added double exponential smoothing implementation
2021-03-11 09:39:52 +01:00
Luca Deri
6833ee2bbe
Added single exponential smoothing API
...
int ndpi_ses_init(struct ndpi_ses_struct *ses, double alpha, float significance);
int ndpi_ses_add_value(struct ndpi_ses_struct *ses, const u_int32_t _value, double *forecast, double *confidence_band);
2021-03-11 00:04:33 +01:00
Luca Deri
5b7fe1360a
Fixed JA3+ computation
2021-03-11 00:04:12 +01:00
Luca Deri
5c6f070097
Fixed nDPI prefs definition
2021-03-09 23:50:31 +01:00
Luca Deri
f6ad16d8f8
Added experiemntal JA3+ implementation that can be used with -z i ndpiReader
2021-03-09 23:38:29 +01:00
Ivan Nardi
8074bc8201
HTTP: fix memory access in ndpi_http_parse_subprotocol() ( #1151 )
2021-03-09 19:46:32 +01:00
Luca Deri
574fc4f09e
Ookla detection improvement
2021-03-09 17:43:12 +01:00
Luca Deri
3032864ec9
Added Ookla detection over IPv6
2021-03-09 12:55:14 +01:00
Luca Deri
db716d0ab0
Ookla fixes
2021-03-09 11:42:23 +01:00
Luca Deri
477e4db650
Improved detection of Ookla speedtest and openspeedtest.com
2021-03-09 11:38:31 +01:00
Luca Deri
bb6423a79f
Added the ability to define a custom DGA detection function by overwriting
...
the value of the function pointer ndpi_dga_function curently set to NULL
(that means the nDPI internal DGA function will be used)
2021-03-08 22:57:30 +01:00
Ivan Nardi
c3490e80a7
Fix some stack-use-after-return errors in automa code ( #1150 )
2021-03-08 21:14:01 +01:00
Ivan Nardi
c50a8d4808
Add support for Snapchat voip calls ( #1147 )
...
* Add support for Snapchat voip calls
Snapchat multiplexes some of its audio/video real time traffic with QUIC
sessions. The peculiarity of these sessions is that they are Q046 and
don't have any SNI.
* Fix tests with libgcrypt disabled
2021-03-06 05:48:36 +01:00
Alfredo Cardigliano
73e4348570
Add ndpi_serialize_binary_boolean for consistency. Fix comments.
2021-03-04 10:31:03 +01:00
Luca Deri
0f8a994841
Improved DGA detection
...
Before
Accuracy 66%, Precision 86%, Recall 38%
After
Accuracy 71%, Precision 89%, Recall 49%
2021-03-03 19:30:01 +01:00
Luca
49843509e5
Added verbose option
2021-03-03 08:12:16 +01:00
Luca Deri
1a37595de0
Removed check for knowns protocols (major and app protocols)
2021-03-03 00:57:56 +01:00
Luca Deri
56bfb439f8
Improved DGA detection with trigrams. Disadvantage: slower startup time
...
Reworked Tor dissector embedded in TLS (fixes #1141 )
Removed false positive on HTTP User-Agent
2021-03-03 00:41:07 +01:00
Ivan Nardi
4c00ff89df
DTLS: improve support ( #1146 )
...
* DTLS: add some pcap tests
* DTLS: fix parsing of Client/Server Helllo message
* DTLS: add parsing of server certificates
2021-03-02 21:15:40 +01:00
Ivan Nardi
2b71a329c1
QUIC: fix mvfst-27 test ( #1145 )
...
Regardless of its name, quic-mvfst-27 trace doesn't contain mvfst-27
traffic
2021-03-02 21:15:02 +01:00
Ivan Nardi
c12a697f2d
TOR: update node list ( #1144 )
...
https://panwdbl.appspot.com/lists/ettor.txt list is no more available
Close #1141
2021-03-02 21:14:36 +01:00
Luca Deri
2d558afb54
Added HW checks
2021-03-01 19:59:14 +01:00
Luca Deri
2724a14bf7
Added further HW checks
2021-03-01 19:34:20 +01:00
Luca Deri
4bff595733
Holt-Winters calculation improvement
2021-02-27 11:32:51 +01:00
Toni
16890a6632
Added NDPI_MALICIOUS_SHA1 flow risk. ( #1142 )
...
* An external file which contains known malicious SSL certificate SHA-1 hashes
can be loaded via ndpi_load_malicious_sha1_file(...)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-02-26 17:00:05 +01:00
Luca Deri
fba61adf5e
Improved DNS dissector
2021-02-26 00:42:15 +01:00
pengtian
28330edb7a
[Fix] replace free to ndpi_free ( #1140 )
...
same as https://github.com/ntop/nDPI/issues/1096
2021-02-25 08:46:55 +01:00
Toni
70c35addcb
Added protocol breed to JSON serializer. ( #1137 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-02-25 08:46:38 +01:00
Alfredo Cardigliano
d898fddea0
Fix ndpi_fill_prefix_v6
2021-02-24 14:43:12 +00:00
Luca Deri
545f270132
Windows code cleanup
2021-02-24 11:04:04 +01:00
Luca Deri
4bd175b07e
Modified JA3 fingerprint message
2021-02-24 10:42:26 +01:00
Alfredo Cardigliano
566d5db402
Add more utility functions to work with patricia trees
2021-02-23 11:53:15 +01:00
Alfredo Cardigliano
888ddfcd17
Update ndpi_patricia_walk_inorder API
2021-02-23 10:23:52 +01:00
Alfredo Cardigliano
f8e83f7e35
Add support for MAC to Patricia tree. Expose full API to applications. Add utility functions.
2021-02-23 10:01:56 +01:00
Luca Deri
b757cf606b
Fixed mispelled API call
2021-02-22 23:59:08 +01:00
Luca Deri
f1b22b199f
Added NDPI_MALICIOUS_JA3 flow risk
...
Added ndpi_load_malicious_ja3_file() API call
2021-02-22 23:19:23 +01:00
Luca Deri
fc3db8f169
Implemented TLS Certificate Sibject matching
...
Improved AnyDesk detection
2021-02-22 22:37:33 +01:00
Luca Deri
a21ad2fbe4
Added new data for risky domains test
2021-02-21 22:08:01 +01:00
Luca Deri
5ad056e99b
Removed unused NDPI_RISKY_COUNTRY
2021-02-21 21:45:46 +01:00
Luca Deri
fc16c9368e
Added risky domain flow-risk support
2021-02-21 21:45:46 +01:00
Luca Deri
6db20b3ba9
Updated dependency
2021-02-19 17:59:40 +01:00
Luca Deri
09559611cc
Fixes #1136
2021-02-19 15:15:02 +01:00
Luca Deri
dee24f7acf
Removed old unused code
2021-02-19 15:12:03 +01:00
Alfredo Cardigliano
e9350d8fc7
Fix leak
2021-02-19 09:27:24 +01:00
Luca Deri
92e8d95f38
Added ndpi_get_geoip() APi call
2021-02-18 23:15:27 +01:00
Luca Deri
bdf95a5c22
Package fix
2021-02-18 22:08:15 +00:00
Luca Deri
393a844c9a
GeoIP support
2021-02-18 22:40:57 +01:00
Luca Deri
bce54079d8
Initial geoip support
2021-02-18 22:35:25 +01:00
Luca Deri
a2c5adc374
Improved nDPI string matching algorithm
2021-02-18 21:47:09 +01:00
Luca Deri
fb4cdecb68
Fixes due to the fragment mananegr code
2021-02-18 13:31:02 +01:00
Luca Deri
413dc287b4
Added paper citation
2021-02-17 08:22:38 +01:00
Luca Deri
4609e2084b
Added new risks (future use)
...
- NDPI_RISKY_ASN
- NDPI_RISKY_DOMAIN
- NDPI_RISKY_COUNTRY
2021-02-16 18:23:19 +01:00
Alfredo Cardigliano
177f1785da
Fix warning
2021-02-12 09:11:14 +01:00
Luca Deri
813df77d07
Performance optimization to avoid un-necessary calls and thus increase the overall performance
2021-02-11 17:54:55 +01:00
Luca Deri
d99d636696
Some optimizations during flow guess
2021-02-10 19:51:26 +01:00
Luca Deri
fffff3760b
Code refactory
2021-02-10 19:28:35 +01:00
Luca Deri
ea0309d21b
Removed now obsolete NDPI_DETECTION_SUPPORT_IPV6: code is more readeable now
2021-02-10 19:09:11 +01:00
Luca Deri
76ac551ed3
Improved FTP_CONTROL detection
2021-02-10 17:55:07 +01:00
Luca Deri
79102ef4f2
Added check for avoiding long dissections
2021-02-10 17:36:09 +01:00
Ivan Nardi
421609475e
Fix small memory leak ( #1133 )
...
Now function definition matches the prototype in ndpi_api.h.in
2021-02-10 15:24:34 +01:00
Toni
1e12c90c66
Fixed memory leaks caused by conditional free'ing for some TLS connec… ( #1132 )
...
* Fixed memory leaks caused by conditional free'ing for some TLS connections.
* Members of tls_quic struct should also free'd if the detected master protocol is IMAPS / POPS / SMTPS / etc.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Prevent reader_util.c from exit()'ing if maximum flow count reached.
This confuses the fuzzer.
* Improved fuzz/Makefile.am to use LDADD for ../example/libndpiReader.a instead of LDFLAGS.
That way, fuzz_ndpi_reader re-links to ../example/libndpiReader.a if something changed there.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-02-10 15:24:11 +01:00
Luca Deri
c408df1b0e
STUN improvements
2021-02-10 15:22:20 +01:00
Luca Deri
e2f6569adb
Fixed CPHA missing protocol initialization
...
Improved IEC104 and IRC detection
2021-02-10 15:22:20 +01:00
Luca Deri
0de3d4c37a
Dissection inprovements
2021-02-09 21:48:46 +01:00
Luca Deri
512f73f381
Added checks for giving up faster on IRC and SMTP
2021-02-09 21:27:09 +01:00
Luca Deri
1a557d0918
IRC test files
2021-02-09 21:25:48 +01:00
Luca Deri
1331e0aec9
Extended the API to calculate jitter
...
- ndpi_jitter_init()
- ndpi_jitter_free()
- ndpi_jitter_add_value()
2021-02-09 15:56:03 +01:00
Luca Deri
b960809d3e
Minor code improvements
2021-02-09 12:55:11 +01:00
Luca Deri
4abaf3e279
Removed debug statement
2021-02-09 10:05:29 +01:00
Luca Deri
732579b72b
Added timeseries forecasting support implementing Holt-Winters with confidence interval
...
New API calls added
- ndpi_hw_init()
- ndpi_hw_add_value()
- ndpi_hw_free()
2021-02-08 19:10:25 +01:00
Luca Deri
d9da752aa8
Updated skype addresses
2021-02-07 19:05:56 +01:00
Luca Deri
3ecda45bc4
IP address matching update
2021-02-07 17:42:31 +01:00
Luca Deri
8297dacfe5
Added Makefile for building the development version of libndpi for OpenWRT
2021-02-07 09:29:01 +00:00
Luca Deri
be58d78417
(Temporarely) Disabled fragment manager ( #1129 )
2021-02-05 23:03:08 +01:00
Luca Deri
45e9c3c438
Partial fix for #1129
2021-02-05 22:22:33 +01:00
Alfredo Cardigliano
95a6a2072b
Code cleanup and safety checks in the fragment manager ( #1129 )
2021-02-05 17:16:11 +01:00
Luca Deri
8dd7716ae5
Implemented more efficient and memory savvy RSI
2021-02-05 12:38:41 +01:00
Luca Deri
60b58dbd67
RSI enhancements
2021-02-05 10:59:09 +01:00
Luca Deri
1eedf734be
Implemented API for computing RSI (Relative Strenght Index)
...
void ndpi_init_rsi(struct ndpi_rsi_struct *s, u_int16_t num_learning_values);
void ndpi_free_rsi(struct ndpi_rsi_struct *s);
float ndpi_rsi_add_value(struct ndpi_rsi_struct *s, const u_int32_t value);
2021-02-04 23:52:33 +01:00
Luca Deri
54636a3213
Improved (partial) TLS dissection
2021-02-04 22:06:18 +01:00
Ivan Nardi
679c317c57
Fix utests when "--disable-gcrypt" flag is used ( #1128 )
...
Fix: d6684f4b
2021-02-04 19:29:48 +01:00
Ivan Nardi
2a65321884
Fix some memory leakes in reassembler code ( #1127 )
2021-02-04 19:29:27 +01:00
Toni and Luca Deri
7255dbe4b7
Added fuzzy targets conditional in tests/do.sh.in which prevents the fuzzer from running if nDPI was configured previously --enable-fuzztargets but not for the current config (may produce invalid results). ( #1126 )
...
* fixed possible NULL pointer dereference for memcpy(), src pointer should never be NULL
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2021-02-04 19:28:52 +01:00
Luca Deri
c68c8c79c9
Added missing check
2021-02-04 18:17:45 +01:00
Luca Deri
6c366d73e2
Fixed leak with DTLS
2021-02-03 23:36:11 +01:00
Luca Deri
6289413fea
Updated results
2021-02-03 11:58:17 +01:00
Ivan Nardi
a772e18977
Fix a warning ( #1125 )
...
Introduced in 5f7b9d802
reader_util.c: In function ‘process_ndpi_collected_info’:
reader_util.c:1148:60: warning: ‘%s’ directive output may be truncated writing up to 255 bytes into a region of size 64 [-Wformat-truncation=]
1148 | sizeof(flow->ssh_tls.client_requested_server_name), "%s",
| ^~
reader_util.c:1147:5: note: ‘snprintf’ output between 1 and 256 bytes into a destination of size 64
1147 | snprintf(flow->ssh_tls.client_requested_server_name,
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1148 | sizeof(flow->ssh_tls.client_requested_server_name), "%s",
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1149 | flow->ndpi_flow->protos.tls_quic_stun.tls_quic.client_requested_server_name);
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2021-02-03 11:56:37 +01:00
Luca Deri
d6684f4b4c
Added test pcap
2021-02-03 11:56:14 +01:00
Ivan Nardi
8c0ea694f8
HTTP: fix user-agent parsing ( #1124 )
...
User-agent information is used to try to detect the user OS; since the
UA is extracted for QUIC traffic too, the "detected_os" field must be
generic and not associated to HTTP flows only.
Otherwise, you might overwrite some "tls_quic_stun" fields (SNI...) with
random data.
Strangely enough, the "detected_os" field is never used: it is never
logged, or printed, or exported...
2021-02-03 11:54:11 +01:00
Ivan Nardi
8cee718e8b
HTTP: fix logs when NDPI_ENABLE_DEBUG_MESSAGES is defined ( #1123 )
2021-02-03 11:53:41 +01:00
Luca Deri
155b1aaa68
Updated results due to the new fragment manager handler
2021-02-03 11:52:46 +01:00
Luca Deri
6e87daab69
Cosmetic fixes
2021-02-03 11:52:32 +01:00
Luca Deri
1f3ade5923
Increased number of extra packets that is necessary since the frgament mananger introduction
2021-02-03 11:51:55 +01:00
Luca Deri
4b181be58e
Improved debug message
2021-02-03 11:49:14 +01:00
Luca Deri
d19bad1581
Added pcap for testing fragments reassembly
2021-02-03 11:48:53 +01:00
Luca Deri
01f4a57118
Fixes an issue with https://github.com/ntop/nDPI/pull/1122 that misprocsssed packets belonging to flows whose initial part (e.g. the 3WH) was not observed by nDPI (e.g. capture started in the middle of the flow)
2021-02-03 11:47:21 +01:00
b70ad0e2f1
fragments management added ( #1122 )
...
Management of tcp segments managements.
Co-authored-by: ragostino <ragostino73@gmail.com >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2021-02-03 10:28:51 +01:00
ragostino
ee94534906
debug message bugfix ( #1108 )
...
you can not look for memory enlargement if you print debug message after updating the variables
2021-02-03 09:31:17 +01:00
Luca Deri
50f4049b58
Improved wireguard dissection
2021-01-29 16:38:43 +01:00
Luca Deri
bb74b903d0
DCE/RPC improvement to avoid false positives
2021-01-29 16:23:18 +01:00
Luca Deri
aeeccee106
DGA name improvement
2021-01-27 11:43:35 +01:00
Luca Deri
aa5486f5f8
Added missing library
2021-01-22 09:31:37 +01:00
Luca Deri
288ccd6215
Fixes due to datatype rename
2021-01-22 09:17:34 +01:00
Luca Deri
a31bd5ac3c
Cleaned up tls/quic datatypes
2021-01-21 19:17:33 +01:00
Luca Deri
15295ef4c5
Reworked TLS fingerprint calcolation
...
Modified TLS memory free
2021-01-21 19:06:05 +01:00
Toni
399755607d
Disable tests that require libgcrypt if --disable-gcrypt set. ( #1121 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-01-21 08:59:06 +01:00
morefigs
53415c8855
Added missing comma ( #1116 )
...
I presume there is a comma missing in this comma separated list.
2021-01-21 08:58:42 +01:00
Luca Deri
3e5e9569ff
Added simple hash implementation to the nDPI API
2021-01-20 21:30:19 +01:00
Luca Deri
d964c3e081
Code cleanup: third party uthash is at the right place
2021-01-20 19:11:36 +01:00
Luca
0809956e5f
Rewored UPnP protocol that in essence was WSD hence it has been renamed
...
Cleaned up TLS code for DTLS detection by defining a new DTLS protocol
2021-01-20 09:53:30 +01:00
Luca Deri
e9f43516ec
Improves STUN dissection removing an invalid termination condition that prevented Skype calls to be properly identified
2021-01-13 16:46:51 +01:00
Luca Deri
68b6ac7da8
(C) Update
2021-01-07 11:13:36 +01:00
Luca Deri
367184628e
Warning fix
2021-01-07 11:07:17 +01:00
Darryl Sokoloski
5f7b9d8024
Increase SNI hostname buffer length to 256. ( #1111 )
...
According to RFC 4366, SNI host names can be up to 255 bytes.
Previous size of 64 resulted in failed application matches due to truncation.
For example:
0976e041e65b1aece3e720df36ac6bd7.safeframe.googlesyndication.co|m
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2021-01-07 10:58:48 +01:00
Ivan Nardi
ec2735694b
STUN: avoid false positives ( #1110 )
...
STUN traffic doesn't use multicast addresses
2021-01-07 10:58:22 +01:00
Ivan Nardi
1e2b57bed4
HTTP: fix compilation and a memory error when NDPI_ENABLE_DEBUG_MESSAGES is defined ( #1109 )
2021-01-07 10:58:02 +01:00
Ivan Nardi
2080cc7365
QUIC: add suppport for DNS-over-QUIC ( #1107 )
...
Even if it is only an early internet draft, DoQ has already (at least)
one deployed implementation.
See: https://www.zdnet.com/article/ad-blocker-adguard-deploys-worlds-first-dns-over-quic-resolver/
Draft: https://tools.ietf.org/html/draft-huitema-dprive-dnsoquic-00
In the future, if this protocol will be really used, it might be worth to
rename NDPI_PROTOCOL_DOH_DOT in NDPI_PROTOCOL_DOH_DOT_DOQ
2021-01-07 10:56:39 +01:00
Ivan Nardi
00dabce65e
Quic fixes ( #1106 )
...
* QUIC: fix heap-buffer-overflow
* TLS: fix parsing of QUIC Transport Parameters
2021-01-07 10:55:55 +01:00
Ivan Nardi
b8a5358e80
QUIC: improve handling of SNI ( #1105 )
...
* QUIC: SNI should be always saved in flow->protos.stun_ssl.ssl.client_requested_server_name
Close #1077
* QUIC: fix matching of custom categories
* QUIC: add NDPI_TLS_MISSING_SNI support for older GQUIC versions
* QUIC: fix serialization
* QUIC: add DGA check for older GQUIC versions
2021-01-07 10:55:23 +01:00
Luca Deri
eb37f8f1fb
Split HTTP request from response Content-Type. Request Content-Type should be present with POSTs and not with other methods such as GET
2021-01-06 18:28:24 +01:00
Luca Deri
cd21f0d316
Added check for invalid HTTP content
2021-01-06 12:25:32 +01:00
Ivan Nardi
1b524f5538
QUIC: update to draft-33 ( #1104 )
...
QUIC (final!?) constants for v1 are defined in draft-33
2021-01-04 15:50:14 +01:00
Ivan Nardi
3aa16b63e8
Fix some warnings when compiling with "-W -Wall" flags ( #1103 )
2021-01-04 15:49:39 +01:00
Ivan Nardi
23b84cd3ee
Remove FB_ZERO protocol ( #1102 )
...
FB_ZERO was an experimental protocol run by Facebook.
They switched to QUIC/TLS1.3 more than 2 years ago; no one ever used it but
them so it is definitely dead.
See: https://engineering.fb.com/2018/08/06/security/fizz/
2021-01-04 15:49:19 +01:00
Toni
53ee6db795
Added a new API function `ndpi_free_flow_data' which free's all members of ndpi_flow_struct but not the struct itself. ( #1101 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-01-04 12:47:05 +01:00
Ivan Nardi
3bb12fde63
Fix memory leak introduced in b7376cc6 ( #1100 )
2021-01-04 12:46:30 +01:00
Luca Deri
4ddb5f4245
Added TLS test with long certificate
2021-01-04 11:31:25 +01:00
Luca Deri
a91e6179c5
Fixed missing symbol
2021-01-02 21:21:15 +01:00
Luca Deri
05d76525b0
Added HTTP suspicious content securirty risk (useful for tracking trickbot)
2021-01-02 21:11:42 +01:00
Luca Deri
32f0446c9c
Updated ndpi_ptree_match_addr() prototype
2020-12-30 18:23:40 +01:00
Luca Deri
b7376cc690
Restored QUIC stats
2020-12-30 12:12:33 +01:00
Luca Deri
dc401f8a74
Split ptree user data in 32 and 64 bit entries
2020-12-30 12:12:33 +01:00
pengtian
ab037e2c82
Bugfix for host check ( #1097 )
...
this bug is from commit `427002d14` `2020-05-06 00:31:40`
2020-12-29 14:41:41 +01:00
Luca Deri
84132c6735
Added known protocol on unknown port for ntop
2020-12-28 16:11:39 +01:00
Luca Deri
7f944cc43b
Initialization fix
2020-12-28 11:57:20 +01:00
Luca Deri
0fceb6576a
Free flow fix
2020-12-28 09:32:06 +01:00
Luca Deri
9c1827a77b
Fixed output when tLS (nad not QUIC) is used
2020-12-28 09:19:39 +01:00
Luca Deri
cf00ffed32
Removed test code
2020-12-26 18:13:10 +01:00
Luca Deri
e1be363037
Removed space from protocol name
2020-12-23 20:38:02 +00:00
Luca Deri
34fc9d5d50
Introduced fix on TLS for discarding traffic out of sequence that might invalidate dissection
2020-12-22 09:47:39 +01:00
Luca Deri
6462f4671c
Fixed invalid TLS check for extra processing detection
2020-12-21 22:42:05 +01:00
Luca Deri
b231982286
Win fixes
2020-12-17 15:34:17 +01:00
Luca Deri
df1b3367a9
Type change to avoid Windows compilation issues
2020-12-17 12:58:12 +01:00
Luca Deri
2768da0637
Improved HTTP dissection
2020-12-16 14:45:29 +01:00
Luca Deri
a89642ad04
Fixes bug introduced by https://github.com/ntop/nDPI/pull/1085
2020-12-12 12:32:44 +01:00
Zied Aouini
5bd5461f96
Fix minimum packet length condition ( #1087 )
2020-12-12 11:12:59 +01:00
Toni
74a77e7b3d
Added --ignore-vlanid / -I to exclude VLAN ids for flow hash calculation. #1073 ( #1085 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-12-11 21:01:51 +01:00
Toni
edf3a57a6a
Added `fast.com' host pattern to Netflix detection. #1080 ( #1084 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-12-11 21:01:28 +01:00
Ivan Nardi
5587010cfb
soulseek: fix heap buffer overflow ( #1083 )
...
Close #1082
2020-12-11 21:01:07 +01:00
Luca Deri
5cb6ddfd22
Rule changes work in progress
2020-12-11 17:25:57 +01:00
Luca Deri
21ad3a1775
Added initialization
2020-12-11 17:25:57 +01:00
Alfredo Cardigliano
499897219e
Add NDPI_PROTOCOL_ANY_CATEGORY to ndpi_protocol_category_t enum
2020-12-11 15:56:57 +01:00
Luca Deri
9c5fbb5208
Added FreeBSD ibuils instructions
2020-12-10 14:19:59 +00:00
Luca Deri
4cb8712a35
Added --with-mipsel for building nDPI on mipsel devices
2020-12-09 11:01:40 +00:00
Toni
62cd852c6f
Rename Jabber detection name as we are not sure if it is unencrypted e.g. if START_TLS used. ( #1079 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-12-08 15:49:17 +01:00
rafaliusz and rafal
1ecc6d323e
Add a connectionless DCE/RPC detection ( #1078 )
...
* Add connectionless DCE/RPC detection
* Add DCE/RPC pcap file as well as its test result
Co-authored-by: rafal <rafal.burzynski@cryptomage.com >
2020-12-08 15:48:53 +01:00
Ivan Nardi
860ef58ace
QUIC: sync with Wireshark latest changes ( #1074 )
...
Most of the QUIC crypto code has been "copied-and-pasted" from Wireshark;
try to stay in sync with the original sources to ease backporting of fixes.
Only cosmetic changes and code refactoring; no behaviour changes or bugfixes.
See:
https://gitlab.com/wireshark/wireshark/-/commit/5e45f770fd79ca979c41ed397fee72d2e8fb5f1e
https://gitlab.com/wireshark/wireshark/-/commit/5798b91c1526747bf688b6746b33562c1b24a9e0
2020-12-08 15:47:58 +01:00
Luca Deri
1fb1848586
Added chec for avoiding doung ntop_config.h include
2020-12-01 08:57:09 +00:00
Luca Deri
eb689b2069
nDPI rules (work in progress) implementation
2020-11-30 22:01:49 +01:00
Luca Deri
b77a4276f9
Fixed JSON-C check
2020-11-30 16:41:58 +01:00
Luca Deri
d4a42ed733
Improved JSON-C detection
2020-11-30 16:30:38 +01:00
Luca Deri
6b9155589a
Removed unnecessary field
2020-11-29 19:04:26 +01:00
Luca Deri
23a15bae5f
Fixes #1029
2020-11-27 18:51:56 +01:00
Luca Deri
6c119c0b06
Fixes #1032
2020-11-27 18:48:25 +01:00
Toni
daa1c8ef8c
Fix/overflow and libgerror check ( #1068 )
...
* Fixed stack overflow caused by missing buffer space for the trailing \0 added by sprintf()
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Remove the autoconf cache value from the previous and failed check before checking again.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-11-26 19:46:31 +01:00
Alfredo Cardigliano
7437ecaab0
Warning fix
2020-11-23 10:19:35 +01:00
Luca Deri
38984af03e
Updated disney definition
2020-11-22 18:49:28 +01:00
Luca Deri
78f762bd36
Typo
2020-11-22 16:51:13 +01:00
Luca Deri
21a6112b91
Added 129.205.94.0/23 to Facebook network list
2020-11-22 11:33:31 +01:00
Ivan Nardi
53a5c354d8
Quic fixes ( #1067 )
...
* QUIC: fix return value on error path on quic_cipher_init()
* QUIC: allow dissection of sessions forcing version negotiation
Enhance heuristic to avoid false positives.
2020-11-22 11:04:10 +01:00
Ivan Nardi
fb2027cc8e
iec60870-5-104: fix heap-buffer-overflow error ( #1066 )
2020-11-22 11:03:26 +01:00
Luca Deri
fe3d926741
Added prerequisites for Ubuntu/Debian systems
2020-11-18 16:40:45 +01:00
Alfredo Cardigliano
e45f0a4b64
Install ndpi under /usr
2020-11-17 09:19:07 +01:00
Luca Deri
d670850f55
Updated results
2020-11-16 21:25:59 +01:00
Luca Deri
acffd7bd1e
Compilation fix
2020-11-16 21:22:54 +01:00
Zied Aouini and Luca Deri
bfabb0ddf4
Add Virtual Asssitant (Alexa, Siri) support. ( #1057 )
...
* Add AmazonAlexa protocol.
* Add AmazonAlexa test file and result.
* Include pcapng as file format.
* Rename Category to VirtualAssistant.
* Add AppleSiri virtual assistant.
* Fix pcapng test files format support.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:19:38 +01:00
Oleksandr Natalenko
5c8e125f06
lib/ndpi_content_match: update TOR IPs ( #1063 )
...
Signed-off-by: Oleksandr Natalenko <oleksandr@natalenko.name >
2020-11-16 21:18:17 +01:00
Zied Aouini
3d8fd42307
Implement DGA detection performances tracking workflow. ( #1064 )
...
* Implement dga evaluation helper.
* Add test set for DGA classification.
* Add DGA classification performances tracking as part of Travis.
* Add DGA evaluation doc.
* Fix CI on OSX.
* Add missing backquote.
2020-11-16 21:17:16 +01:00
Zied Aouini
76bb83085b
Improve subprotocols detection. ( #1062 )
...
* Improve Spotify detection.
* Improve Skype detection.
* Improve Microsoft detection.
* Fix Microsoft detection categories.
* Improve Waze detection.
* Improve Apple detection.
* Improve WindowsUpdate detection.
* Improve TikTok detection.
* Improve Teams detection.
* Improve Youtube detection.
* Improve Messenger detection.
* Improve Twitch detection.
* Improve Hulu detection.
* Improve Facebook detection.
* Improve AmazonVideo detection.
2020-11-16 21:16:38 +01:00
Zied Aouini and Luca Deri
3529268df8
Add Tumblr support. ( #1061 )
...
* Add Tumblr protocol.
* Add Tumblr test file and result.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:14:06 +01:00
Zied Aouini and Luca Deri
22780da8d5
Add Reddit support. ( #1060 )
...
* Add Reddit protocol.
* Add Reddit test file and result.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:13:01 +01:00
Zied Aouini and Luca Deri
13dab51cc7
Add Pinterest support. ( #1059 )
...
* Add Pinterest protocol.
* Add Pinterest test file and result.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:11:43 +01:00
Zied Aouini
f35fad13c3
Add DisneyPlus protocol. ( #1058 )
2020-11-16 21:10:11 +01:00
Luca Deri
419483f128
File nor necessary and generated by configure
2020-11-12 23:22:15 +01:00
Luca Deri
328ff24657
Renumbered AmongUs protocol
2020-11-09 16:23:01 +01:00
Toni
6b5bdf773d
Added support for AmongUs. ( #1054 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-11-09 16:19:00 +01:00
Toni
af02ffb60f
Support raw IPv4 / IPv6 pcap packet processing. ( #1053 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-11-09 16:18:05 +01:00
Toni
ac18d5a084
Improved SSH protocol detection. ( #1052 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-11-09 16:17:42 +01:00
Don J. Rude
bbf42c3610
fixes issue #1050 Syntax error caused buffer pointer to equal 0x1 ( #1051 )
...
* Syntax error caused buffer pointer to equal 0x1
Possible copy-paste from lines 141-142?
* Another comma operator
* whitespace matching
* another comma operator
* another comma operator
* another comma operator
* Check for non-zero payload
2020-11-09 16:17:10 +01:00
Luca Deri
89a363aff6
Updated ESNI/SNI alarm generation prolicy
2020-11-08 10:07:35 +01:00
Luca Deri
f6cb869c63
Reworked IEC60870 dissector
2020-11-04 14:29:11 +01:00
Luca Deri
044a11faca
IEC60870 dissection improvements
2020-11-04 12:40:31 +01:00
Luca Deri
017e395ed1
Cosmetic changes
2020-11-03 16:46:30 +01:00
Leonn
0576dc2a49
💡 Add mongodb protocol dissector ( #1048 )
2020-11-03 16:16:02 +01:00
Luca Deri
fc58e564f0
Restored Ubuntu/Debian packaging
2020-11-03 16:08:57 +01:00
Toni
8e84abfa0e
Fix/packaging ( #1047 )
...
* Fix OpenWrt build.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Fixed Debian/Ubuntu packaging.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Added DPKG package build to a CI job.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-11-03 11:36:40 +01:00
Ivan Nardi
a9547da138
QUIC: fix dissection of Initial packets coalesced with 0-RTT one ( #1044 )
...
* QUIC: fix dissection of Initial packets coalesced with 0-RTT one
* QUIC: fix a memory leak
2020-11-03 11:35:52 +01:00
Luca Deri
92b80e2468
Updated results with numeric IP detection
2020-11-01 13:31:00 +01:00
Luca Deri
b502bb08e0
Fix for detecting numeric IPs
2020-11-01 13:31:00 +01:00
Luca Deri
50ab34bfe6
Centos8 package fix
2020-10-29 18:36:56 +01:00
Alfredo Cardigliano
53f133f669
Fix libdir on centos8
2020-10-29 18:20:51 +01:00
Alfredo Cardigliano
29dbf78c4e
Removed generation of /usr/lib/.build-id
2020-10-29 17:50:05 +01:00
Luca Deri
efbfb7cbd6
Set /usr as installation prefix
2020-10-29 17:45:55 +01:00
Alfredo Cardigliano
1c4ce8b0f4
Move libraries from /usr/local to /usr
2020-10-29 12:43:33 +01:00
Vitaliy Ivanov
10506b5173
Generate NDPI_API_VERSION based on git commands.
...
https://github.com/ntop/PF_RING/issues/668
Check for .git directory works in case of usual clone of nDPI repo.
But if you integrate is as submodule then .git is a file.
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2020-10-29 12:35:05 +01:00
Luca Deri
94471193c2
Added boundary check
2020-10-27 08:48:12 +01:00
Igor Duarte
ba6a48c9fe
Improve skype detection ( #1039 )
...
* Add new skype pcap
PCAP extracted from SkypeIRC.cap (available in https://wiki.wireshark.org/SampleCaptures?action=AttachFile&do=get&target=SkypeIRC.cap )
* Improve skype detection
2020-10-27 08:45:09 +01:00
Luca Deri
48d640583a
Moved global in reader_util.c
2020-10-27 08:40:00 +01:00
Luca Deri
948a906037
Added -D flag for detecting DoH in the wild
...
Removed heuristic from CiscoVPN as it leads to false positives
2020-10-26 21:40:59 +01:00
Luca Deri
9873972acb
Various improvemement when using ndpi_pref_enable_tls_block_dissection:
...
application data TLS blocks are now ignored when exchanged before
- the end of certificate negotiation (up to TLS 1.2)
- change cipher
2020-10-24 19:22:56 +02:00
Luca Deri
9b85669a64
Added -x for checking patterns
2020-10-22 23:28:18 +02:00
Luca Deri
833d0eee53
Added CPHA - CheckPoint High Availability Protocol protocl support
2020-10-22 18:39:13 +02:00
Ivan Nardi
6027a7c799
Fix parsing of DLT_PPP datalink type ( #1042 )
2020-10-21 22:27:42 +02:00
Luca Deri
9dac9945c9
Fixes #1033
2020-10-21 20:59:02 +02:00
Douglas and Douglas Wordell
efb712c2c0
Added new IPs for TeamViewer ( #1040 )
...
Co-authored-by: Douglas Wordell <douglas.wordell@seti.com.br >
2020-10-21 15:09:14 +02:00
Zied Aouini
43c1f6a3fd
CAPWAP tunnel decoding fix ( #1038 )
...
* Fix CAPWAP processing.
* Update result.
2020-10-21 15:07:20 +02:00
Toni
822c8e56f7
Improved/autoconf ( #1037 )
...
* Switched to PKG_CHECK_MODULES to keep pkg-config checks more portable.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
* Improved GCrypt autoconf check to detect a possible gpg-error inter-library dependency.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-10-21 15:05:33 +02:00
Hosein Ghahremanzadeh
bb33d57971
Fix a memory leak on fuzzing code ( #1036 )
...
After allocation of pcap_buffer it is necessary to free it
2020-10-21 15:05:11 +02:00
Igor Duarte
13d99a9390
Remove possible invalid read ( #1035 )
2020-10-21 15:04:55 +02:00
Luca Deri
6c0a809de8
Initial 3.5 commit
2020-10-19 16:23:03 +02:00
Luca Deri
64929a75e0
3.4 nDPI Release
2020-10-19 16:18:25 +02:00
Luca Deri
02de8e10ca
Added makefile target for creating changelog
...
Updated Changelog
2020-10-19 15:39:48 +02:00
Toni
c2d8955c18
Fixed missing PCAP include directories in Makefiles. ( #1034 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-10-19 11:25:22 +02:00
Luca Deri
e9721eb4ce
Improved processing of IPv6 header
...
Improved QUIC serialization
2020-10-15 21:57:59 +02:00
Alfredo Cardigliano
88f3519ab3
Handle list items in ndpi_deserialize_get_single_size
2020-10-15 12:02:43 +02:00
Alfredo Cardigliano
031cd04b7c
Add serialization of values list in TLV
2020-10-15 10:45:43 +02:00
aouinizied
d5d2a7e3f3
Fix CAPWAP handling.
2020-10-13 19:13:07 +02:00
Alfredo Cardigliano
2051e51380
Decoupled fuzzy and unit tests
2020-10-12 12:11:35 +02:00
Alfredo Cardigliano
c92e0d13fd
Serialized doxygen doc
2020-10-05 11:25:48 +02:00
Luca
05d93790e4
Added ndpi_quick_16_byte_hash
...
Warning fix
2020-10-05 08:26:24 +02:00
Luca Deri
32e4922c5a
Warning fix
2020-10-03 17:14:40 +02:00
Luca Deri
d4d82c27a5
Tests update
2020-10-02 21:35:15 +02:00
Luca Deri
addc775811
Added fix for invalid SNI check when SNI is missing
2020-10-02 21:26:43 +02:00
Luca Deri
b68a3707f6
Updated serialization test unit
2020-10-02 12:39:08 +02:00
b0c4d01734
don't pass arguments to ./configure as 1 string ( #1027 )
...
this causes the following error if there are arguments after --host :
'checking host system type... config.sub: too many arguments'
Co-authored-by: sahnalys12 <boris.vanhoof_ext@softathome.com >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-09-29 18:02:08 +02:00
Ivan Nardi
2c1b7cf1bd
QUIC: fix dissection of "offset" field ( #1025 )
...
The "offset" field is a variable-length integer.
This bug hasn't any practical effects right now, since we are ignoring any
packet with "offset" != 0 (and the value 0 is always encoded in only one byte).
But extracting a correct "offset" is important if we are ever going to handle
fragmented Client Hello messages.
2020-09-29 17:59:03 +02:00
Toni
656323c334
Added missing files to `make dist' target which are not required to build nDPI but still somehow essential. ( #1024 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-29 17:58:33 +02:00
Luca Deri
8e1a3f5cdc
Added JSON-C check for unit tests
2020-09-26 12:50:30 +02:00
Luca Deri
58538b7d19
Added extra boundary checks
2020-09-26 12:33:57 +02:00
Luca Deri
d0dbcf6dd6
Added back ndpi_check_flow_func (correct) prototype
2020-09-25 10:39:33 +02:00
Luca Deri
8413faf2ef
Boundary fix
2020-09-25 09:56:24 +02:00
Luca Deri
204f3ddff5
Compilation fix
2020-09-25 09:36:10 +02:00
Luca Deri
044ed14b4f
Various optimizations to reduce not-necessary calls
...
Optimized various UDP dissectors
Removed dead protocols such as pando and pplive
2020-09-24 23:26:03 +02:00
Luca Deri
51e86346d3
Added -fno-sanitize=alignment in clang-7
2020-09-24 16:46:28 +02:00
Luca Deri
8e7a707be1
-O0 -> -Og
2020-09-23 18:49:44 +02:00
Luca Deri
837ce7306b
Attempt to avoid errors due to misaligned packet headers
2020-09-23 18:17:51 +02:00
Luca Deri
05dfae6430
Improved boundary check to prevent overflow
2020-09-23 17:14:40 +02:00
Luca Deri
d29a0241ee
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-09-22 12:45:44 +02:00
Luca Deri
cbf1be5789
Macro redefinition
2020-09-22 12:23:44 +02:00
Luca Deri
5f99433ee7
Minor UA handling improvement to avoid heap-overflow
2020-09-22 08:56:35 +02:00
lucaderi
27bad14738
Added missing install target in newly added unit tsts
2020-09-22 08:42:50 +02:00
Luca Deri
362baa6321
Minor change for alignment issue
2020-09-21 21:15:52 +02:00
Luca Deri
60a9f6610d
Added risks for checking
...
- invalid DNS traffic (probably carrying exfiltrated data)
- TLS traffic with no SNI extension
2020-09-21 19:57:23 +02:00
Alfredo Cardigliano
0259ff58e1
Exclude sanitizer on unit tests involving json-c due to a bug in the lib
2020-09-21 17:59:06 +02:00
Alfredo Cardigliano
d700ab3994
Add distdir directive
2020-09-21 17:32:57 +02:00
Alfredo Cardigliano
e6d206fd15
Add unit tests to travis. Move ndpi serializer tests to unit tests.
2020-09-21 17:24:06 +02:00
Luca Deri
a263ac9024
Merge pull request #1022 from lnslbrty/fix/ndpi-mingw-fn-redef
...
Do not re-define libc functions for mingw builds.
2020-09-21 14:42:06 +02:00
Toni Uhlig
87c43450f3
Do not re-define libc functions for mingw builds.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-20 23:29:23 +02:00
Luca Deri
8ba1baace1
Added sample Windows MSVC project
2020-09-20 18:44:57 +02:00
Luca Deri
ff1cc1fa41
Merge pull request #1019 from IvanNardi/quic_fb
...
QUIC: add support for MVFST EXPERIMENTAL version
2020-09-20 18:34:27 +02:00
Luca Deri
ea9177cc93
Merge pull request #1018 from lnslbrty/fix/make-dist
...
Fixed broken `make dist' and added CI check.
2020-09-20 18:33:57 +02:00
Luca Deri
1385f05713
Merge pull request #1017 from lnslbrty/fix/mingw-xcompile
...
Added support for mingw xcompile.
2020-09-20 18:33:40 +02:00
Nardi Ivan
dcac633878
QUIC: add support for MVFST EXPERIMENTAL version
2020-09-20 16:38:28 +02:00
Toni Uhlig
fdef6f3545
Fixed broken `make dist' and added CI check.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-19 02:23:53 +02:00
Toni Uhlig
d0052fd5b2
Using NDPI_I64_FORMAT, NDPI_U64_FORMAT format string to differentiate between Windows and non-Windows.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-18 19:46:20 +02:00
Toni Uhlig
bcce122665
Fixed mingw build w/o examples/tests/fuzzer.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-18 19:46:07 +02:00
Luca Deri
6a7139bb24
Updated results
2020-09-18 00:17:43 +02:00
Luca Deri
b5b4512022
Added MDNS in extra packet dissection function
2020-09-18 00:08:27 +02:00
Luca Deri
d81bc1add6
Reworked MDNS dissector that is not based on the DNS dissector
2020-09-17 23:24:02 +02:00
Luca Deri
753b5dde16
Merge pull request #1012 from IvanNardi/ua
...
QUIC: extract User Agent information
2020-09-17 21:32:25 +02:00
Luca Deri
9189aee83b
Disabled QUIC tracing that pollutes the output
2020-09-17 14:37:56 +02:00
aouinizied
4cc4efa228
Update example.
2020-09-14 16:42:33 +02:00
Luca
ad8318e247
Commented unused function
2020-09-13 09:48:29 +02:00
Alfredo Cardigliano
91e3292e6b
Temporarily keep using snprintf
2020-09-11 19:17:10 +02:00
Luca Deri
98a81cb163
Reworked DGA checks
2020-09-11 10:31:19 +02:00
Alfredo Cardigliano
3a6ba7fa12
Replace snprintf with ndpi_snappend
2020-09-11 10:04:43 +02:00
Luca Deri
37abe0daea
Added boundary check
2020-09-10 20:06:25 +02:00
Luca Deri
1c0e617d80
Added buffer check in DGA analysis
2020-09-10 19:58:31 +02:00
Nardi Ivan
8db084ab06
TLS: fix memory accesses in QUIC transport parameters extension
2020-09-10 18:19:18 +02:00
lucaderi
ea4240055d
Complation fix as not on all platforms isnumber() is available
2020-09-10 00:05:02 +02:00
Luca Deri
5ac870074b
Merge pull request #1014 from lnslbrty/improved/teamspeak
...
Improved Teamspeak(3) protocol detection.
2020-09-09 23:28:21 +02:00
Luca Deri
7086197047
Added extension to detect nested subdomains as used in Browsertunnel attack tool
...
https://github.com/veggiedefender/browsertunnel
2020-09-09 23:25:19 +02:00
Toni Uhlig
8ca13bc46a
Improved Teamspeak(3) protocol detection.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-09 21:57:31 +02:00
Alfredo Cardigliano
842c00e681
Add missing low-level serializer calls to the API
2020-09-09 17:09:01 +02:00
Toni Uhlig
4c776501a6
Fixed shlib xcompile for x86_64-w64-mingw32
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-08 19:52:46 +02:00
Nardi Ivan
7d5a0e1f04
QUIC: extract User Agent information
2020-09-08 11:03:22 +02:00
Nardi Ivan
a1014e8895
http: create a common function to parse User Agent field
...
Prepare the code to handle UA information from flows other than HTTP
2020-09-08 10:34:05 +02:00
Luca Deri
601928cc8e
Merge pull request #1008 from lnslbrty/add/dnscrypt
...
Improved dnscrypt v1/v2 protocol detection (and DoH provider).
2020-09-08 09:53:22 +02:00
Luca Deri
5a3956fe27
Added command for specifying the aux files dir
2020-09-08 09:51:02 +02:00
Toni Uhlig
df14d225f6
Added pcap file which contains dnscrypt-v1 data and resolver update requests/responses (v1/v2).
...
* Renamed dnscrypt.pcap to simple-dnscrypt.pcap
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-07 21:04:23 +02:00
Toni Uhlig
fe5aa7ebca
Added dnscrypt-v2-doh resolver test pcaps.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-07 20:22:52 +02:00
Toni Uhlig
41d35fc7d0
Updated DoT/DoH provider.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-07 20:22:45 +02:00
Toni Uhlig
799a6abfe6
Improved dnscrypt v1/v2 protocol detection.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-06 23:24:55 +02:00
Alfredo Cardigliano
8ed6409b35
Add start_of_block/end_of_block support to TLV
2020-09-04 17:23:04 +02:00
Luca Deri
3f49062db9
Added some additional TLS mappings
2020-09-02 23:35:22 +02:00
Luca Deri
3cca5af8c3
Merge pull request #1003 from lnslbrty/fix/fals-positive-cisco-hsrp-radius-detection
...
Fixed false positive detection for Skype.SkypeCall (affects at least Cisco HSRP and RADIUS).
2020-09-02 12:32:48 +02:00
Toni Uhlig
7051acc0b5
Fixed off-by-one error in Kerberos protocol.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-02 07:37:26 +02:00
Toni Uhlig
580859a47d
Fixed false positive detection for Skype.SkypeCall (affects at least Cisco HSRP and RADIUS).
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-09-02 07:29:33 +02:00
Luca Deri
5d2551ff3e
Added boundary check
2020-09-01 22:31:34 +02:00
Luca Deri
cefb667d8b
Added trademark information
2020-09-01 18:03:01 +02:00
Luca Deri
8575a07113
Added check for ndpi_ssl_version2str()
2020-08-31 17:23:00 +02:00
Luca Deri
460ff3c7ab
Added (optional) notifier for LRU add
2020-08-31 08:47:16 +02:00
Luca Deri
029448759b
Merge pull request #999 from IvanNardi/quic
...
QUIC: add support for GQUIC T050 and T051
2020-08-30 20:56:15 +02:00
Luca Deri
448265a151
Merge pull request #998 from lnslbrty/fix/ndpireader-opt-sigsegv
...
Fixed invalid memory access leading to a SIGSEGV in ndpiReader's option parser.
2020-08-30 20:55:44 +02:00
Nardi Ivan
7da4abe6ad
QUIC: add support for GQUIC T050 and T051
...
QUIC versioning wasn't complex enough without T05X family...
These versions are very similar to Q050, but use TLS as their handshake
protocol.
2020-08-30 20:51:33 +02:00
Luca Deri
638624869a
Added new risk for NDPI_UNSAFE_PROTOCOL that identifies protocols that are not condidered safe/secure
2020-08-30 20:48:58 +02:00
Luca Deri
647c7d59bb
Improved ntop detection over HTTP
...
Added cap on number of attempts for CiscoVPN
2020-08-30 19:42:09 +02:00
Luca Deri
f597086386
Stddev calculation changes
2020-08-30 12:48:32 +02:00
Luca Deri
dd75060932
Fixed false positive in suspicous user agent
...
Optimized stddev calculation
2020-08-30 12:25:15 +02:00
Luca Deri
8bf95b6198
Merge pull request #996 from lnslbrty/fix/travis-ci
...
Fix travis-ci related errors.
2020-08-28 13:04:26 +02:00
Toni Uhlig
adab0139c2
Fixed invalid memory access leading to a SIGSEGV in ndpiReader's option parser.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-28 06:53:58 +02:00
Toni Uhlig
bf9dbd6ccf
Fixed travis-ci fuzzm job. Might be a false positive related to clang-7's MSAN.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-27 16:42:24 +02:00
Toni Uhlig
e998fc28d1
Fixed use-of-uninitialized-value in QUIC clho decryption probably caused by a BUG in libgcrypt (not verified).
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-27 16:30:05 +02:00
Simone Mainardi
1810281d7f
Fixes control reaches end of non-void function
2020-08-27 10:39:36 +02:00
Simone Mainardi
f0325f713a
Passes method_len param to ndpi_http_str2method
2020-08-27 10:05:38 +02:00
Toni Uhlig
5b27dfdd0c
Moved NDPI_CURRENT_PROTO define before ndpi_api.h include to prevent a redefinition warning.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-27 00:29:44 +02:00
Toni Uhlig
c17463539f
Fixed broken travis-ci YAML.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-27 00:27:31 +02:00
Luca Deri
2e8aa9f08e
Added ndpi_http_method ndpi_http_str2method(const char* method) API call
2020-08-26 23:17:19 +02:00
Luca Deri
487d915262
Added ndpi_http_method2str() API call
2020-08-26 12:25:28 +02:00
Luca Deri
5e1bb0dbc1
Merge pull request #992 from lnslbrty/fix/pkg-config
...
Fixed broken pkg-config file which did not care about gcrypt/pcre.
2020-08-26 10:29:39 +02:00
Toni Uhlig
363ab2259c
Fixed broken pkg-config file which did not care about gcrypt/pcre.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-24 18:12:49 +02:00
Luca Deri
b94e13da43
Merge pull request #991 from IvanNardi/quic2
...
QUIC: minor fixes
2020-08-24 14:45:04 +02:00
Nardi Ivan
97b80a8838
QUIC: minor fixes
...
LGTM found a real issue on a boundary check
Fix unit tests: a pcap ha been uploaded twice (with different names)
Fix compilation when using DPDK (see #990 )
2020-08-24 13:53:36 +02:00
Luca Deri
b8307eb855
Creared IoT-Scada category
...
Minor dnp3 changes
2020-08-23 13:32:36 +02:00
Luca Deri
46ba657562
Cosmetic fix
2020-08-22 23:48:00 +02:00
Luca Deri
4570dbfece
Added QUIC dependency
2020-08-22 17:02:11 +02:00
Luca Deri
35fd4ddb27
Added libgcrypt20-dev dependency to handle QUIC
2020-08-22 16:53:44 +02:00
Luca Deri
fe1e2c241f
Added som GQUIC and IETF QUIC test pcaps
2020-08-22 16:47:05 +02:00
Luca Deri
af3ce74e02
Fixes compilation issues introduced by https://github.com/ntop/nDPI/pull/989
2020-08-22 16:41:51 +02:00
Luca Deri
93003d0523
Warning fix
2020-08-22 16:41:42 +02:00
Luca Deri
519ba7a9d5
Merge pull request #989 from IvanNardi/quic
...
Improve QUIC detection
2020-08-22 16:30:29 +02:00
Nardi Ivan
b23cfd6b84
Add sub-classification for GQUIC >= Q050 and (IETF-)QUIC
...
Add QUIC payload and header decryption: most of the crypto code has been
"copied-and-incolled" from Wireshark. That code has been clearly marked
as such. All credits for that code should go to the original authors.
I tried to keep the Wireshark code as similar as possible to the original,
comments included, to ease future backporting of fixes.
Inevitably, glibc data types and data structures, tvbuff abstraction and
allocation functions have been converted.
2020-08-21 22:04:55 +02:00
Nardi Ivan
7a1147d733
Update TLS dissector to handle QUIC flows
...
Latest QUIC versions use TLS for the encryption layer: reuse existing code
to allow Client Hello parsing and sub-classification based on SNI value.
Side effect: we might have J3AC, TLS negotiated version, SNI value and
supported cipher list for QUIC, too.
2020-08-21 22:04:55 +02:00
Nardi Ivan
d62ae567d1
Add (optional) dependency on external libraries: libgcrypt and libgpg-error
...
To support QUIC payload and header decryption, it is necessary to choose an
external crypto library to handle the low-level crypto stuff. Since we will
use some Wireshark code, it is quite natural to choose the same library used
by Wireshark itself: libgcrypt.
More precisely, we will use libgcrypt and libgpg-error.
Both libraries have LGPL license, so there should be no issue from this point
of view.
These libraries are not required to build nDPI, and their usage is optional:
nDPI will keep working (and compiling) even if they are not available.
However, without them, QUIC sub-classification is next to impossible.
The configure flag "--disable-gcrypt" forces the build system to ignore these
libraries.
libgpg-error is only used for debug to have meaningful error messages and its
usage is trivial.
The same cannot be said for libgcrypt because its initialization is a significant
issue.
The rest of this commit message try explaining how libgcrypt is
initialized.
According to the documentation
https://gnupg.org/documentation/manuals/gcrypt/Initializing-the-library.html
https://gnupg.org/documentation/manuals/gcrypt/Multi_002dThreading.html#Multi_002dThreading
libgcrypt must be initialized before using it, but such initialization should
be performed by the actual application and not by any library.
Forcing the users to proper initialize libgcrypt in their own code seems
unreasonable: most people using nDPI might be complete unaware of any crypto
stuff and update each and every one application linking to nDPI with specific
libgcrypt code should be out of question, anyway.
Fortunately, it seems a workaround exists to initialize libgcrypt in a library
https://lists.gnupg.org/pipermail/gcrypt-devel/2003-August/000458.html
Therefore, we could provide a wrapper to this initialization stuff in a nDPI
function. Unfortunately nDPI API lacks a global init function that must be
called only once, before any other functions. We could add it, but that would
be a major API break.
AFAIK, ndpi_init_detection_module() might be called multiple times, for example
to create multiple independent dpi engines in the same program.
The proposed solution is to (optionally) initialize libgcrypt in
ndpi_init_detection_module() anyway:
* if the actual application doesn't directly use libgcrypt and only calls
ndpi_init_detection_module() once, everything is formally correct and it
should work out of the box [by far the most common user case];
* if the actual application already uses libgcrypt directly, it already
performs the required initialization. In this case the ndpi_prefs.ndpi_dont_init_libgcrypt
flag should be passed to ndpi_init_detection_module() to avoid further
initializations.
The only scenario not supported by this solution is when the application is
unaware of libgcrypt and calls ndpi_init_detection_module() multiple times
concurrently. But this scenario should be uncommon.
A completely different option should be to switch to another crypto library,
with a huge impact on the QUIC dissector code.
Bottom line: crypto is hard, using libgcrypt is complex and the proposed
initialization, even if not perfect, should cover the most frequent user
cases and should work, for the time being.
If anyone has some suggestions...
2020-08-21 22:04:55 +02:00
Nardi Ivan
23ec82b59d
Major rework of QUIC dissector
...
Improve support for GQUIC (up to Q046) and add support for Q050 and (IETF-)QUIC
Still no sub-classification for Q050 and QUIC
2020-08-21 22:04:55 +02:00
Luca Deri
fef199ad45
Added new check for detecting suspicious (too long) names
2020-08-21 19:35:27 +02:00
Luca Deri
b23781e807
Added the ability do identigy as DGA those host/domain names with too many consucutive repeated characters
...
such as ckaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa used fr netbios reflection attacks
https://www.akamai.com/uk/en/multimedia/documents/state-of-the-internet/ddos-reflection-netbios-name-server-rpc-portmap-sentinel-udp-threat-advisory.pdf
2020-08-21 18:41:35 +02:00
Luca Deri
da2684dbe1
MySQL8 update
2020-08-21 07:17:34 +02:00
Luca Deri
7e9354ef23
Merge pull request #988 from lnslbrty/add/mysql-8-manipulated-pkt
...
Added (manipulated) MySQL 8 test pcap.
2020-08-21 06:49:18 +02:00
Toni Uhlig
f4421314b0
Added (manipulated) MySQL 8 test pcap.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-20 23:46:47 +02:00
Luca Deri
59ac73b37f
Configure code cleanup
2020-08-19 22:01:03 +02:00
Luca Deri
115888ef7a
Compilation fix
2020-08-19 21:56:34 +02:00
Luca Deri
248d756e99
Merge pull request #987 from lnslbrty/update/mysql-protocol-detection
...
Updated MySQL protocol detection to support server version 8.
2020-08-19 21:49:53 +02:00
Luca Deri
9f431f9218
Merge pull request #985 from lnslbrty/add/SOAP
...
Added support for SOAP.
2020-08-19 21:49:12 +02:00
Luca Deri
d87bdf9302
Merge pull request #977 from adek05/dev
...
Enable building on OpenBSD 6.7
2020-08-19 21:48:38 +02:00
Toni Uhlig
3a76786121
Updated MySQL protocol detection to support server version 8.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-19 18:33:06 +02:00
Toni Uhlig
8e93f48c43
Added support for SOAP.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-18 16:21:26 +02:00
Luca Deri
673d8b7fac
Updated OpenWRT instructions
2020-08-17 18:17:43 +02:00
Luca Deri
1f921562d1
Added fix for API versions starting with 0
2020-08-17 18:11:18 +02:00
Luca Deri
34a98abcc0
Added --with-only-libndpi configure option to build just lindpi
2020-08-17 18:00:38 +02:00
Luca Deri
b501239d3f
Added README for building libndpi under OpenWRT
2020-08-17 17:17:09 +02:00
Luca Deri
ebf89f46e3
Merge pull request #984 from lnslbrty/fix/invalid-fncall-dpdk
...
Fixed invalid dpdk fn call.
2020-08-16 10:03:55 +02:00
Luca Deri
019a64630b
Merge pull request #983 from lnslbrty/fix/libpcap-obsolete-pcap_lookupdev-usage
...
Replaced obsolete libpcap pcap_lookupdev with pcap_findalldevs.
2020-08-16 10:03:33 +02:00
Luca Deri
98a9afc40c
Added support for discord
2020-08-16 10:01:40 +02:00
Toni Uhlig
13cbd1e4ae
Fixed invalid dpdk fn call.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-15 12:38:47 +02:00
Toni Uhlig
b31fde4bbb
Replaced obsolete libpcap pcap_lookupdev with pcap_findalldevs.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-15 12:35:49 +02:00
Luca Deri
46ec91ca4b
Merge pull request #976 from lnslbrty/fix/ndpi_simpleint_builderr
...
Fix/ndpi simpleint builderr
2020-08-13 10:41:25 +02:00
Luca Deri
8090765a64
Merge pull request #974 from IvanNardi/esni4
...
Suspicious ESNI usage: add a comment and a pcap example
2020-08-13 10:40:51 +02:00
Toni Uhlig
aa856735c0
num_extra_packets_checked check can be 0 for some protocols and therefor requires lesser-or-equal condition for max_extra_packets_to_check
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-13 10:32:31 +02:00
Luca Deri
9edddee0b7
Fixes invalid detection on traffic on non standard ports
2020-08-12 11:08:28 +02:00
Luca Deri
d5cac570d6
Improved DGA detection algoritm
2020-08-11 17:13:40 +02:00
Luca Deri
0e363d0ca6
Added HLL notes
2020-08-11 16:23:35 +02:00
aouinizied
8c2c388d54
Add Connectivity check category and blacklisted host risk.
2020-08-10 21:19:17 +02:00
aouinizied
8fcb49af25
Fix typo.
2020-08-10 21:17:36 +02:00
Luca Deri
dfa9dd66c0
Added case-insensitive substring matching
2020-08-10 19:36:43 +02:00
Adrian Zgorzałek
56a3a33bc0
OpenBSD: Do not redefine __LITTLE_ENDIAN__
...
Will silence omnipresent compiler warnings when building ntopng.
2020-08-09 14:30:12 +01:00
Adrian Zgorzałek
8f74d5733d
OpenBSD: Introduce pkt_timeval to deal with (bpf_)_timeval
...
Some BSD APIs called in example/ return `struct bpf_timeval`, where nDPI
APIs expect `struct timeval`. These two structs, besides having
a different name, share the exact same set of fields.
2020-08-09 14:30:12 +01:00
Toni Uhlig
4ead6d6594
travis-ci: build ndpiSimpleIntegration as well
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-08 12:17:54 +02:00
Toni Uhlig
8da5f42fa0
Changed ndpi_ssl_version2str function call in ndpiSimpleIntegration.
...
Fixes build error introduced with 23c072153 .
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-08-08 12:05:11 +02:00
Nardi Ivan
2722861d6e
Suspicious ESNI usage: add a comment and a pcap example
...
See: 79b89d2866
2020-08-06 10:29:35 +02:00
Luca Deri
95dfbdc64a
Merge pull request #973 from IvanNardi/esni3
...
Add risk flag about suspicious ESNI usage
2020-08-06 10:18:27 +02:00
Luca Deri
c2156a5161
Added note on memory management
2020-08-06 09:19:04 +02:00
Luca Deri
5b6ffad278
Added new ndpi_string_sha1_hash API call
2020-08-05 21:45:38 +02:00
Luca Deri
d3fb1fb25a
Fixed possible memory leak in TLS certificate handling
2020-08-05 17:57:00 +02:00
Nardi Ivan
79b89d2866
Add risk flag about suspicious ESNI usage
...
In a Client Hello, the presence of both SNI and ESNI may obfuscate the real
domain of an HTTPS connection, fooling DPI engines and firewalls, similarly
to Domain Fronting.
Such technique is reported in a presentation at DEF CON 28:
"Domain Fronting is Dead, Long Live Domain Fronting: Using TLS 1.3 to evade
censors, bypass network defenses, and blend in with the noise"
Full credit for the idea must go the original author
At the moment, the only way to get the pdf presention and related video is via
https://forum.defcon.org/node/234492
Hopefully a direct link (and an example pcap) will be available soon
2020-08-05 17:13:23 +02:00
Luca Deri
07d9fa7f96
Win #define fix
2020-08-05 11:13:27 +02:00
Luca Deri
00b2763399
Added check on payload lenght during extra packet processing
2020-08-04 21:59:45 +02:00
Luca Deri
e16675b700
Added new traffic category for connectivity check detection
2020-08-04 18:09:13 +02:00
Luca Deri
ea10b8e757
Added memory checks
2020-08-02 13:00:31 +02:00
aouinizied
57e28e03ee
Sync TLS definitions.
2020-08-01 01:27:29 +02:00
Luca Deri
2ae4c6675d
Fixed partial TLS dissection
2020-07-30 18:30:07 +02:00
Luca Deri
e71df49b3e
Changed due to bin size extension
2020-07-30 00:06:46 +02:00
Luca Deri
6904935934
Restored TLS dissection
2020-07-30 00:06:35 +02:00
Luca Deri
a828ac0191
Tiny changes for TLS block lenght dissection
2020-07-29 22:36:27 +02:00
aouinizied
c4b19fd6c5
Update CFFI definitions.
2020-07-29 12:31:21 +02:00
Luca Deri
02dc8d5feb
Merge pull request #970 from IvanNardi/fix
...
Minor fixes
2020-07-28 19:38:12 +02:00
Luca Deri
32bd3d7a59
TLS dissection improvements
2020-07-28 01:06:38 +02:00
Luca Deri
da87cc3157
Added NDPI_SMB_INSECURE_VERSION for detecting insecure SMB versions (e.g. v1)
2020-07-27 13:05:06 +02:00
Luca Deri
69f140878c
Boundary check on QUIC
2020-07-27 07:40:50 +02:00
Luca Deri
4b1cae2c2b
Boundary check
2020-07-27 06:52:35 +02:00
Nardi Ivan
7d843f4d17
Minor fixes
...
Fix a memory leak and an issue (re)-introduced in configure script
2020-07-26 21:11:34 +02:00
Luca Deri
95263fc32e
Added parentheses to avoid issues with macro expansion
2020-07-25 18:59:48 +02:00
Luca Deri
1c405e382a
SSH code cleanup
2020-07-25 16:43:54 +02:00
Luca Deri
b26539d65a
Merge pull request #967 from MrRadix/dev
...
Ssh signature checking
2020-07-25 16:17:24 +02:00
MrRadix
6719fa30f9
added other ssh implementations to check
2020-07-24 20:53:02 +02:00
Luca Deri
21e2e57614
Fixed bin similarity
2020-07-24 01:30:58 +02:00
Luca Deri
439558f6a3
Improved bin clustering
2020-07-22 23:56:50 +02:00
Luca Deri
0956badd11
Merge pull request #968 from catenacyber/fuzzci
...
Reenables CI with sanitizers
2020-07-22 19:38:05 +02:00
MrRadix
a9ca47fcdb
added cipher check
2020-07-22 17:17:12 +02:00
MrRadix
1c1be5a0d1
Resolved conflicts on fetch
2020-07-22 16:25:01 +02:00
Philippe Antoine
2723ac70ce
msan cxx
2020-07-22 16:09:13 +02:00
Luca Deri
3cd1ec5c9a
Added changes for handlign SSSH cipher detection
2020-07-22 15:58:46 +02:00
Philippe Antoine
a279423bff
Reenables CI with sanitizers
2020-07-22 15:49:03 +02:00
MrRadix
a3ba9253ef
fixed bug inside set bit macro call
2020-07-22 15:39:44 +02:00
MrRadix
c450caae94
modified new last two risks
2020-07-22 15:38:31 +02:00
Luca Deri
36af97a14c
Minor HLL fixes
2020-07-22 14:40:15 +02:00
MrRadix
af5d792c08
added sscanf error handling
2020-07-22 13:06:08 +02:00
MrRadix
8e2cd9ff43
improved performance and legibility
2020-07-22 12:42:26 +02:00
MrRadix
88dd3ebd62
added modified risks
2020-07-22 12:41:59 +02:00
MrRadix
d9fc4d52e9
merged with remote
2020-07-22 11:56:51 +02:00
MrRadix
a688e36b51
improved ndpi_risk2str output for new risks
2020-07-22 11:44:56 +02:00
Luca Deri
f83d0b18c6
Introduced SSH rick checks
2020-07-22 11:40:57 +02:00
Luca Deri
66178e37cc
Merge pull request #966 from catenacyber/ossfuzzbuild
...
Enables fuzz targets even without sanitizer
2020-07-22 11:36:48 +02:00
Luca Deri
1740042cbb
Merge branch 'dev' into ossfuzzbuild
2020-07-22 11:36:31 +02:00
Luca Deri
f6242f0e46
HLL memory usage notes
2020-07-22 11:28:14 +02:00
MrRadix
0a182c6d18
Merge remote-tracking branch 'ntop_origin/dev' into dev
2020-07-22 11:15:02 +02:00
MrRadix
53b2b08aeb
added new risks to ndpi_risk_enum
2020-07-22 10:56:59 +02:00
MrRadix
9c521c5ddd
added new risks iside ndpi_risk2str function
2020-07-22 10:55:53 +02:00
MrRadix
847eb7b180
improved performance by removing linear scan
2020-07-22 10:54:55 +02:00
Luca Deri
d90b333363
Merge pull request #965 from lnslbrty/fix/autoconf-ubuntu
...
fixes autoconf issue on ubuntu 18 (#953 )
2020-07-21 21:41:02 +02:00
MrRadix
f66cd5aabc
added ssh_analyse_signature_version and ssh_has_old_signature for check old signature version of ssh
2020-07-21 19:31:02 +02:00
MrRadix
4b4dcabeda
added ssh obsolete version risks
2020-07-21 19:29:59 +02:00
Luca Deri
879cec94b2
User agent detection improvements
2020-07-21 12:06:34 +02:00
Luca Deri
9f4f228832
Added skeleton for checking SSH signature
2020-07-20 17:25:17 +02:00
Philippe Antoine
b568c26989
Enables fuzz targets even without sanitizer
...
Should fix ossfuzz build
2020-07-20 10:07:54 +02:00
Toni Uhlig
29315cee6d
fixes autoconf issue on ubuntu 18 ( #953 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-19 20:30:41 +02:00
Luca Deri
f452dabd92
Fix for invalid boundary check
2020-07-17 23:26:28 +02:00
Luca Deri
64fb40d21e
Added ndpi_reset_data_analysis() API call
2020-07-17 13:16:01 +02:00
Luca Deri
6e1dcba9dd
Indendentation fix
2020-07-16 17:56:37 +02:00
Luca Deri
ebf18a0c61
Merge pull request #964 from yskcg/dev
...
1:add free pointer NULL check;2:fix xbox and teredo protocol detected…
2020-07-16 17:05:40 +02:00
ysk
a268952068
remove the unused code
2020-07-16 17:26:46 +08:00
Luca Deri
acd05b171e
Added ndpi_data_last() API call
2020-07-16 11:22:06 +02:00
ysk
69ca98ca35
1:add free pointer NULL check;2:fix xbox and teredo protocol detected error when use the commm udp port 3544
2020-07-16 16:07:04 +08:00
Luca Deri
46e97d5da3
Added ndpi_data_window_variance() and ndpi_data_window_stddev() API calls
2020-07-15 18:13:06 +02:00
Luca Deri
9f3e3e8456
Add ndpi_hll_reset() API call
...
Fixes bug in ndpi_data_window_average() with zero points
2020-07-15 10:30:45 +02:00
Luca Deri
91d132ea3d
Check for avoiding buffer overflow in netbios dissector
2020-07-14 22:16:43 +02:00
Luca Deri
3fd3153089
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-07-13 15:48:53 +02:00
Luca Deri
a8ad99aca5
Fixed makefile error message
...
Code hardedning fix
2020-07-13 15:46:19 +02:00
aouinizied
7744c225f9
Add note for sync with cffi bindings.
2020-07-13 12:51:32 +02:00
aouinizied
e2e0303099
Add ssl_version_str to flow structure.
2020-07-13 12:48:35 +02:00
Luca Deri
802254327a
wrapper cleanup
2020-07-13 10:53:25 +02:00
Luca Deri
9d8717a0c7
Merge pull request #963 from yskcg/dev
...
add improved boundary check and check malloc return is NULL
2020-07-13 10:24:23 +02:00
Luca Deri
9d35364ef1
Merge pull request #961 from lnslbrty/fix/ssl-version2str-race-condition
...
Fixed race condition in ndpi_ssl_version2str() caused by static quali…
2020-07-13 10:23:47 +02:00
Luca Deri
051bdb1957
Merge pull request #960 from lnslbrty/fix/heap-overflow-in-llc-readear-util
...
Fixed heap overflow caused by missing lengthcheck in 802.11 LLC heade…
2020-07-13 10:23:06 +02:00
Toni Uhlig
96c193cf79
Fixed heap overflow caused by missing lengthcheck in 802.11 LLC header parsing.
...
* triggered by fuzz traces from wireshark
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-11 13:10:03 +02:00
Toni Uhlig
23c0721538
Fixed race condition in ndpi_ssl_version2str() caused by static qualifier in the version string buffer.
...
* added also GREASE supported tls versions as specified in
https://tools.ietf.org/html/draft-davidben-tls-grease-01#page-4
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-11 01:05:39 +02:00
ysk
35f1c362b9
add improved boundary check and check malloc return is NULL
2020-07-10 17:49:35 +08:00
Luca Deri
12abcd516b
Updated test results due to bin changes
2020-07-09 17:28:02 +02:00
Luca Deri
014fdd9a02
Various fixes in bins implementation
...
Added -b flag in ndpiReader to test bins
2020-07-09 17:28:02 +02:00
Luca Deri
9d8967236e
Merge pull request #957 from lnslbrty/fix/build
...
Fix/build
2020-07-09 17:27:53 +02:00
Alfredo Cardigliano
6511db8941
Guide update
2020-07-09 15:37:02 +02:00
aouinizied
b8d406b1f8
Update note.
2020-07-09 00:58:48 +02:00
aouinizied
ce02359953
Add NDPI_MALFORMED_PACKET risk.
2020-07-09 00:56:44 +02:00
Toni Uhlig
24fea66a26
travis-ci cleanups
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-09 00:33:20 +02:00
Luca Deri
d658ac9e61
Added -b to ndpiReader to evaluate bins
2020-07-09 00:15:21 +02:00
Toni Uhlig
f75984633b
ndpiSimpleIntegration should not be included in a static library
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-08 23:47:51 +02:00
Toni Uhlig
20fed83e0f
Removed csv_fp as external symbol. Instead passing csv_fp through as argument.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-08 23:21:35 +02:00
Luca Deri
f72b402aa2
Merge pull request #956 from IvanNardi/leak
...
Fix memory leak reported in #955
2020-07-08 17:15:13 +02:00
Luca Deri
4f794aec22
Merge pull request #955 from lnslbrty/fix/heap-overflow-thunder
...
Fixed thunder protocol detection heap overflow caused by missing leng…
2020-07-08 17:14:45 +02:00
Nardi Ivan
fd6a5bc1cd
Fix memory leak reported in #955
...
This leak is clearly happening because of missing/disabled code in "bins"
handling.
This is a trivial workaround useful until such code is completed.
In this way tavis-ci will stop complaining
2020-07-08 11:30:39 +02:00
Alfredo Cardigliano
5be9370cd2
Fix warnings
2020-07-08 09:15:48 +02:00
Toni Uhlig
ccb30a04ad
Fixed thunder protocol detection heap overflow caused by missing lengthcheck.
...
* triggered by fuzz traces from wireshark
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-08 00:21:00 +02:00
Luca Deri
fb04dbbc47
Added testing bin code
2020-07-07 19:18:43 +02:00
Luca Deri
f1dd8bc8c5
Memory allocation fixes
2020-07-07 17:32:26 +02:00
Luca Deri
0c80e6ee3b
Merge pull request #954 from lnslbrty/fix/memleak-cluster-bins
...
fixed memory leak in ndpi_cluster_bins / binUnitTest
2020-07-07 17:18:03 +02:00
Toni Uhlig
e308e59002
fixed memory leak in ndpi_cluster_bins / binUnitTest
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-07 17:07:20 +02:00
Luca Deri
1c60c22893
Added ndpi_cluster_bins() for clustering bins and ancillary functions for bins manipulation
2020-07-07 15:10:51 +02:00
Luca Deri
db707e0829
Merge pull request #932 from IvanNardi/log
...
Log
2020-07-07 14:43:32 +02:00
Luca Deri
540326f3ff
Merge pull request #953 from lnslbrty/fix/broken-autoconf-fsanitizer
...
fix broken sanitizer CFLAGS, --enable-fuzztargets should also set -fs…
2020-07-07 14:42:42 +02:00
Luca Deri
94bf7b0130
Merge pull request #952 from lnslbrty/fix/missing-lengthcheck-in-reader-uutil
...
Fixed heap overflow caused by missing lengthcheck in reader uutil.
2020-07-07 14:42:20 +02:00
Nardi Ivan
030f3f3d48
Fix a memory leak
2020-07-07 10:27:57 +02:00
Toni Uhlig
de25ba7d0b
Fixed heap overflow caused by missing lengthcheck in reader uutil.
...
* triggered by fuzz traces from wireshark
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-06 23:30:40 +02:00
Toni Uhlig
9bbcc2548e
fix broken sanitizer CFLAGS, --enable-fuzztargets should also set -fsanitize
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-06 22:09:11 +02:00
lucaderi
055422503c
configure fixes
2020-07-06 10:38:29 +02:00
Luca Deri
c0b34555c2
Merge pull request #951 from lnslbrty/fix/ossfuzzer
...
ossfuzz.sh: do not use wildcards for fuzzer e.g. fuzz/fuzz*
2020-07-06 10:23:50 +02:00
Luca Deri
b4edb75824
Merge pull request #950 from lnslbrty/improved/http-line-parsing
...
Improved HTTP line parsing if request splitted into multiple packets.
2020-07-06 10:23:29 +02:00
Luca Deri
dfb9e8ec1f
Merge pull request #940 from lnslbrty/fix/small-and-optimistic-improvments
...
Fixed CodeInspector issues.
2020-07-06 10:23:04 +02:00
Toni Uhlig
c17a21359b
Fixed CodeInspector issues.
...
* Added compiler search list for AC_PROG_CC, AM_PROG_CC_C_O, AC_PROG_CXX, AC_PROG_CC_STDC
for Mac OS X only
The list rendered the AX_CHECK_COMPILE_FLAG([-fsanitize=fuzzer]) useless as it did use
clang for AX_CHECK_COMPILE_FLAG but gcc during the compile process. Seems broken somehow.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-05 20:41:02 +02:00
Toni Uhlig
6e8f268873
ossfuzz.sh: do not use wildcards for fuzzer e.g. fuzz/fuzz*
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-05 20:18:16 +02:00
Toni Uhlig
4b8c8608d1
Improved HTTP line parsing if request splitted into multiple packets.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-05 18:36:57 +02:00
Luca Deri
503e3bb495
Added comment on stddev
2020-07-03 14:45:58 +02:00
Luca Deri
513c857631
Added unit test
2020-07-03 14:43:14 +02:00
Luca Deri
f7b91b46fa
Merge pull request #947 from lnslbrty/add/download-script-wireshark-traces
...
added shell script to download wireshark traces, can be used in combi…
2020-07-03 00:45:45 +02:00
Luca Deri
143fcf0b0e
Merge pull request #946 from lnslbrty/fix/teamviewer-iprange
...
Improved TeamViewer IP range (fixes #944 )
2020-07-03 00:45:11 +02:00
Toni Uhlig
ae89831055
added shell script to download wireshark fuzzing traces, can be used in combination with ./tests/do.sh
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-02 20:22:58 +02:00
Toni Uhlig
8f53c231df
Improved TeamViewer IP range ( fixes #944 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-07-02 18:11:39 +02:00
Nardi Ivan
974c1cc681
Improve help message of --dbg-proto option
...
Make it clear that such option is general, not about extcap
functionality
2020-07-02 09:42:53 +02:00
Nardi Ivan
c08693fda5
Incorporated some feedback
2020-07-01 20:16:16 +02:00
Luca Deri
08698c65e5
Merge pull request #943 from lnslbrty/fix/missing-lengthcheck-in-tls-esni
...
Fixed heap overflow in tls esni extraction triggered by manipulated p…
2020-07-01 12:37:29 +02:00
Luca Deri
2d68f8f635
Merge pull request #942 from lnslbrty/improved/fuzzer-automake-dependency-tracking
...
Added fuzz_*_LDADD to give Automake the opportunity to do some depend…
2020-07-01 12:37:06 +02:00
Luca Deri
2860e3af15
Merge pull request #941 from lnslbrty/add/ossfuzz-script
...
Copy&Paste ./tests/ossfuzz.sh from https://github.com/google/oss-fuzz…
2020-07-01 12:36:42 +02:00
Luca Deri
be35d423b4
Make clean enhancement
2020-07-01 12:34:28 +02:00
Luca Deri
cf9c0b96b8
Indent
2020-06-30 16:25:53 +02:00
Alfredo Cardigliano
ea6332e004
Fix segfault on ndpi_guess_protocol_id with flow = null
2020-06-30 15:54:52 +02:00
Luca Deri
392ce44573
Added ndpi_print_bin() API call
2020-06-29 22:36:46 +02:00
Toni Uhlig
05d7400563
Fixed heap overflow in tls esni extraction triggered by manipulated packets.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-29 21:51:46 +02:00
Toni Uhlig
ea30fcb5de
Added fuzz_*_LDADD to give Automake the opportunity to do some dependency tracking.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-29 21:27:03 +02:00
Toni Uhlig
3068306b60
Copy&Paste ./tests/ossfuzz.sh from https://github.com/google/oss-fuzz/pull/4041
...
* Changing the OSS-Fuzz script from our side is much more easier then
opening a PR to google/oss-fuzz every time we have to change a single line.
* https://github.com/google/oss-fuzz/pull/4041 will be updated once this PR is merged
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-29 20:50:09 +02:00
Luca Deri
0d2d44f1b6
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-06-29 19:51:36 +02:00
Luca Deri
07615903e2
Merge pull request #939 from lnslbrty/improved/fuzzy-reader-smp
...
Improved fuzz_ndpi_reader which supports now SMP/MT w/o race-coniditi…
2020-06-29 19:15:46 +02:00
Luca Deri
2c263bc726
Added ndpi_bin_similarity() for computing bin similarity
2020-06-29 19:09:38 +02:00
Toni Uhlig
4a6c525db8
Improved fuzz_ndpi_reader which supports now SMP/MT w/o race-coniditions.
...
./tests/do.sh can supports SMP/MT via environment variables.
Removed -fno-sanitize=shift as well, was fixed by 317d3ffd .
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-29 19:07:59 +02:00
Luca Deri
93a4a4387a
Merge pull request #938 from IvanNardi/errors
...
Errors
2020-06-28 21:32:08 +02:00
Nardi Ivan
f39e3c98f0
Update test results
2020-06-28 12:47:27 +02:00
Nardi Ivan
317d3ffd3e
Fix undefined behaviour in internal tests
...
Error messages:
ndpiReader.c:3211:2: runtime error: left shift of 1 by 31 places cannot be represented in type 'int'
ndpiReader.c:3207:5: runtime error: left shift of 1 by 31 places cannot be represented in type 'int'
The errors started popping up since 3d9285f1
2020-06-28 12:13:21 +02:00
Nardi Ivan
b24f5c4c0a
Fix memory leak about purged/expired flows
...
Create an helper to avoid similar errors in the future
Fixes: 1a62f4c7
2020-06-28 12:05:12 +02:00
Nardi Ivan
d6a97219ea
Fix use-after-free in http content parsing
2020-06-28 12:05:12 +02:00
Nardi Ivan
3669c14afd
DNP3: add missing initialization
2020-06-28 12:05:12 +02:00
Nardi Ivan
ece5d3e199
Fix (harmless) memory leaks when DPDK is enabled
2020-06-28 12:05:12 +02:00
Nardi Ivan
2cdf7ce806
Fix startup when DPDK is enabled
...
Fixes:a58c838c4
2020-06-28 12:05:12 +02:00
Nardi Ivan
2effa57d8a
ndpiReader: fix ports statistics
...
They should take idle/expired flows into account, too
2020-06-28 12:05:12 +02:00
Nardi Ivan
b68b45f3bb
TLS: extract JA3 signatures in some corner cases
...
In some (rare) cases, Client Hello message contains lots of cipher
suits.
2020-06-28 12:05:12 +02:00
Luca Deri
b2e89e6736
Merge pull request #937 from lnslbrty/re-add-corpus-zipfile-for-google-oss-fuzz
...
Re-Added corpus zipfile generation required for google-oss fuzzer
2020-06-28 07:29:45 +02:00
Luca Deri
1010520cc4
Merge pull request #936 from lnslbrty/fix/h323-off-by-one
...
Fixed off-by-one error in h323.
2020-06-28 07:28:55 +02:00
Toni Uhlig
f028cce209
Re-Added corpus zipfile generation required for google-oss fuzzer
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-27 23:04:20 +02:00
Toni Uhlig
fbfa54eee6
Fixed off-by-one error in h323.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-27 22:58:05 +02:00
Luca Deri
ff67e09101
Restored compiler check for fuzzy targets
2020-06-27 19:34:57 +02:00
Luca Deri
76e6c38459
Use clang where available and fallback to gcc when missing
2020-06-27 19:15:52 +02:00
Luca Deri
243104a8c2
Merge pull request #935 from lnslbrty/fix/fuzzing-tests
...
fixed fuzzing tests in a way that ./tests/do.sh is now able to use co…
2020-06-27 18:57:56 +02:00
Toni Uhlig
1f4523e331
fixed fuzzing tests in a way that ./tests/do.sh is now able to use corpus *.pcap files from ./tests/pcap
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-27 18:41:03 +02:00
Luca Deri
b5f3facf7c
Added notes whenever a new flow risk is added
2020-06-26 23:39:48 +02:00
Luca Deri
8566288e43
Added malformed packet risk support
2020-06-26 22:37:52 +02:00
Luca Deri
8de62c6d34
Values stored in patricia tree are now 32 bit (they used to be 16 bit) long
2020-06-26 17:49:45 +02:00
Nardi Ivan
0cd0905400
mqtt: add boundary check in log message
2020-06-26 12:04:02 +02:00
Nardi Ivan
56d87186f7
Fix compilation with --enable-debug-messages flag
...
NDPI_LOG* macros dereference ndpi_detection_module_struct object which is
private to ndpi library (via NDPI_LIB_COMPILATION define). So we can't use
them outside the library itself, i.e. in ndpiReader code
Therefore, in files in example/, convert all (rare) uses of NDPI_LOG* macros
to a new very simple macro, private to ndpiReader program. If necessary,
such macro may be improved.
According to a comment in ndpi_define.h, each dissector must define its own
NDPI_CURRENT_PROTO macro before including ndpi_api.h file
2020-06-26 12:04:02 +02:00
lucaderi
ebfb5e7f01
Check for CentOS 6
2020-06-26 09:01:58 +02:00
Luca Deri
d805611fcb
Merge pull request #931 from lnslbrty/fix/autogen.sh
...
fixed autoconf version check
2020-06-25 23:31:10 +02:00
Luca Deri
9742dcc45c
Merge pull request #930 from IvanNardi/extcap
...
Extcap
2020-06-25 23:30:20 +02:00
Toni Uhlig
f38a8bd7a5
fixed autoconf version check
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-25 20:02:23 +02:00
Nardi Ivan
3c66ca236b
Make lua script more robust
2020-06-25 18:02:03 +02:00
Nardi Ivan
70a926088f
Fixed harmless memory leak in extcap initialization
2020-06-25 18:02:03 +02:00
Nardi Ivan
6b69e7ebbc
Restore extcap functionality, i.e. integration with wireshark
2020-06-25 18:02:03 +02:00
Luca Deri
0b53bc2aab
Disabled unused code
2020-06-25 10:50:39 +02:00
lucaderi
ecdf7df454
Compilation fixes for non-Linux (or outdated Linux) platforms
2020-06-25 10:25:24 +02:00
lucaderi
3034e53d00
CentOS6 fix (santize won't work as too old system)
...
Fixes warning
2020-06-25 10:22:16 +02:00
Luca Deri
2350daa2dc
Merge pull request #928 from lnslbrty/added/yet-another-ndpi-integration-example
...
PROPOSAL: ndpiSimpleIntegration: added another integration example
2020-06-25 10:05:49 +02:00
Luca Deri
d710b8291d
Merge pull request #927 from lnslbrty/fix/fbzero-missing-length-check
...
Fixed missing length check in fbzero.
2020-06-24 22:17:35 +02:00
Luca Deri
485e56d855
Merge pull request #926 from lnslbrty/added/hulustream-sni-pattern
...
Added hulustream SNI pattern. Fixes #904 .
2020-06-24 22:17:09 +02:00
Luca Deri
38c0d927a9
Merge pull request #925 from lnslbrty/fix/ndpi-rader-unitialized-values
...
Fixed unitialized values in ndpiReader protocol detection bitmask dur…
2020-06-24 22:16:48 +02:00
Luca Deri
94a68451df
Merge pull request #924 from lnslbrty/improved/autoconf-sanitizer-compile-flag-checks
...
Allow -fsanitize for LLVM as well as for GCC.
2020-06-24 22:15:11 +02:00
Toni Uhlig
17c26911fb
ndpiSimpleIntegration: added another integration example
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-24 22:03:18 +02:00
Toni Uhlig
ca68beda85
Fixed missing length check in fbzero.
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-23 18:35:50 +02:00
Toni Uhlig
2f5766d2f5
Added hulustream SNI pattern. Fixes #904 .
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-23 17:30:37 +02:00
Toni Uhlig
39800c88fa
Fixed unitialized values in ndpiReader protocol detection bitmask during dga selftest.
...
* make ./tests/vagrind_test.sh directory agnostic
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-23 17:23:56 +02:00
Toni Uhlig
678fbcdfd6
Allow -fsanitize for LLVM as well as for GCC.
...
* renamed --with-llvm-sanitizer to --with-sanitizer
* disable all optimisations (-O0) if --with-sanitizer set,
no functions/paramaters/variables will be optimised, improves debugging
* enable undefined behaviour sanitizer (ubsan)
* enable leak sanitizer (lsan)
* check if -fsanitize=fuzzer is available and --enable-fuzztargets set,
fail if not (only supported by clang)
* include level 3 debugging information (-g3), improves macro debugging
* disabled ubsan misaligned pointer access and lshift overflow
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-23 00:22:33 +02:00
Luca Deri
d9af1562f0
Fixes #906
...
Packet bins are not printed wehn empty
2020-06-22 14:30:26 +02:00
Luca Deri
e29e14b7aa
Merge pull request #921 from lnslbrty/improved/test-sh
...
make tests/do.sh directory agnostic
2020-06-22 12:51:17 +02:00
Luca Deri
c9d8efc2a4
Warning fix
2020-06-22 10:20:05 +02:00
Luca Deri
1a62f4c799
Added ndpi_bin_XXX API
...
Added packet lenght distribution bins
2020-06-22 01:02:54 +02:00
Luca Deri
2a137100da
Merge pull request #922 from lnslbrty/fix/http-content-disposition-crash
...
Fixed use after free caused by dangling pointer
2020-06-22 00:57:15 +02:00
Toni Uhlig
6a9f5e4f7c
Fixed use after free caused by dangling pointer
...
* This fix also improved RCE Injection detection
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-21 20:05:38 +02:00
Luca Deri
fd0591b4fc
Merge pull request #920 from lnslbrty/fix/tls-rdn-crash
...
Fixed stack overflow caused by missing length check
2020-06-19 11:44:37 +02:00
Luca Deri
48758d28ea
Added GoogleDNS DoH on Android 10
2020-06-19 09:55:58 +02:00
Toni Uhlig
14f514134d
make tests/do.sh directory agnostic
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-19 07:15:20 +02:00
Luca Deri
63670927e7
Fixed API documentation: packet tiestamp is expressed in milliseconds
2020-06-18 14:15:18 +02:00
Toni Uhlig
23594f0365
Fixed stack overflow caused by missing length check
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-18 00:52:04 +02:00
Luca Deri
b2c24558c5
DGA detection improvements
2020-06-18 00:17:30 +02:00
Luca Deri
46d96e7f32
Added checks for DGA detection
2020-06-17 19:46:37 +02:00
Luca Deri
ffd20ebdf9
Merge pull request #919 from lnslbrty/new/protocol/anydesk
...
Implemented proprietary AnyDesk protocol
2020-06-17 06:47:35 +02:00
Toni Uhlig
da37f2444f
Implemented proprietary AnyDesk protocol
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-06-17 01:23:03 +02:00
Alfredo Cardigliano
073e3a027b
Add API ndpi_serializer_get_format
2020-06-16 18:40:17 +02:00
Luca Deri
0ddc3a0052
Fixed invalid assignment (typo)
2020-06-14 09:37:56 +02:00
Luca Deri
38e4910636
Added improved boundary check
2020-06-14 09:29:52 +02:00
aouinizied
4247dd8322
Synchronize type definitions.
2020-06-12 22:58:58 +02:00
Luca Deri
55364ef0b4
Added DGA risk for names that look like a DGA
2020-06-11 18:51:53 +02:00
Luca Deri
60aaa80570
Added HyperLogLog cardinality estimator API calls
...
/* Memory lifecycle */
int ndpi_hll_init(struct ndpi_hll *hll, u_int8_t bits);
void ndpi_hll_destroy(struct ndpi_hll *hll);
/* Add values */
void ndpi_hll_add(struct ndpi_hll *hll, const char *data, size_t data_len);
void ndpi_hll_add_number(struct ndpi_hll *hll, u_int32_t value) ;
/* Get cardinality estimation */
double ndpi_hll_count(struct ndpi_hll *hll);
2020-06-10 23:43:35 +02:00
Luca Deri
0b9e46e65a
Updated (C)
2020-06-08 23:11:20 +02:00
Luca Deri
64fab4a478
Win fixes
2020-06-08 23:08:12 +02:00
Luca Deri
3506a07864
Added check in TLS 1.2+ for reporting a risk when TLS is not used to carry HTTPS
2020-06-08 14:20:10 +02:00
Luca Deri
d318285cae
Added HTTP check
2020-06-07 09:46:27 +02:00
Luca Deri
1479c0a278
Added TLS bounadry check
2020-06-07 09:25:19 +02:00
Luca Deri
43ddbfdfba
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-06-06 11:30:47 +02:00
Luca Deri
801c9481cb
Removed some obsolete protocols (battlefield, oscar, pcanywhere, tvants)
2020-06-06 11:29:03 +02:00
Alfredo Cardigliano
2beecdc8af
Handle EOR in TLV test
2020-06-06 11:18:17 +02:00
Luca Deri
605d548d4a
removed obsolete yahoo plugin
2020-06-06 09:38:19 +02:00
Alfredo Cardigliano
0da76fdac6
Support for multiple records in CSV serialization
2020-06-05 17:28:27 +02:00
Luca Deri
597d6e5d60
Merge pull request #913 from yskcg/fix_segment_fault_dev
...
Fix segment fault dev
2020-06-05 16:57:46 +02:00
Alfredo Cardigliano
67c72a8cb5
Add ndpi_serializer_get_header API (CSV only)
2020-06-05 16:52:26 +02:00
Luca Deri
07c54f9992
Added ndpi_dpi2json() API call
2020-06-05 16:08:23 +02:00
Luca Deri
16ca69733a
Improved teamviewer detection
2020-06-03 10:14:27 +02:00
ysk
40550073ef
fix segment fault cause by the ssl.server_names when it may NULL
2020-06-03 11:19:37 +08:00
ysk
52893d99f6
fix segment fault cause by the ssl.server_names when it may NULL
2020-06-03 10:44:35 +08:00
ysk
86a3dc5bea
Merge branch 'dev' of github.com:yskcg/nDPI into dev
2020-06-03 10:41:40 +08:00
Luca Deri
5afa3ad818
Improved spotify detection
2020-06-02 15:00:14 +02:00
Luca Deri
af2a44ae5f
Added boundary check in kerberos protocol
2020-06-01 18:22:10 +02:00
Luca Deri
241af016e9
Added check for spotify payload lenght
2020-06-01 16:36:12 +02:00
Luca Deri
16dc0ec29e
Check to avoid allocating twice the esni memory
2020-06-01 16:34:24 +02:00
Luca Deri
29d9c2d2c8
Reworked HTTP header processing workflow
2020-06-01 09:54:05 +02:00
Luca Deri
669b7579ff
HTTP comparison optimization
2020-05-31 19:31:01 +02:00
Luca Deri
a4f8d913ea
Minor changes
2020-05-31 19:11:12 +02:00
Luca Deri
dc5b4cbde0
Reworked ndpi_strncasestr
2020-05-31 18:50:25 +02:00
Luca Deri
b0bf66c436
Added offset check in kerberos dissector
2020-05-31 08:30:55 +02:00
Luca Deri
c793e16050
Added extra TLS memory boundary checks
2020-05-31 08:28:02 +02:00
Luca Deri
b6eef17e54
Added check to avoid producing alerts for known protocol on unknown port when using TLS
2020-05-30 19:33:13 +02:00
Luca Deri
374a24a1fb
HTTP dissector improvements
2020-05-30 18:40:15 +02:00
Luca Deri
cbb0b864a2
Minor cleanup
2020-05-29 21:51:51 +02:00
Luca Deri
61066fb106
Added check for heap buffer overflow read
2020-05-29 21:43:06 +02:00
Luca Deri
4ceff1dc77
Fixes for https://github.com/ntop/nDPI/pull/911
...
Added code for dumping invalid HTTP header
2020-05-29 21:23:46 +02:00
Luca Deri
0271e29097
Added references to ESNI
2020-05-29 21:23:34 +02:00
Luca Deri
fcb50dec70
Merge pull request #911 from tmacchioni/dev
...
Added check for suspicious HTTP headers
2020-05-29 21:14:39 +02:00
Tommaso Macchioni
db5cd92fe1
Added check for suspicious HTTP headers
2020-05-29 15:55:52 +02:00
Luca Deri
3085d8e4ff
Refreshed test pcap
2020-05-28 21:23:02 +02:00
Luca Deri
9c3bfeca80
Added support for Encrypted TLS SNI dissection
...
https://datatracker.ietf.org/doc/draft-ietf-tls-sni-encryption/
2020-05-28 17:44:18 +02:00
Luca Deri
f6038c358a
Added ndpi_serialize_risk() API function
2020-05-27 17:35:11 +02:00
Luca Deri
3108c75059
Result update
2020-05-27 15:26:30 +02:00
Luca Deri
811d7a39b5
Added pcap with encrypted SNI
...
- https://blog.cloudflare.com/encrypted-sni/
- https://www.inmotionhosting.com/support/website/security/dns-over-https-encrypted-sni-in-firefox/
2020-05-27 15:00:55 +02:00
Luca Deri
030e9dddb7
Extended the cache for services that need to be reconciled such as Microsoft Teams
...
Added JSON-formatted Microsoft list of IP/services
2020-05-27 12:40:35 +02:00
Alfredo Cardigliano
2dce6cd525
Add ndpi_serialize_start_of_list/ndpi_serialize_end_of_list to serialize simple lists in JSON
2020-05-25 16:37:00 +02:00
Luca Deri
8fa5c31996
Added ndpi_serialize_risk() to the nDPI API
2020-05-24 08:54:38 +02:00
Luca Deri
ee35834be6
Added flow risk serilization
2020-05-24 08:46:10 +02:00
aouinizied
e5c2c400ef
Update APIs and structures.
2020-05-22 23:48:54 +02:00
Luca Deri
bbbc5fdbae
Added memory boundary checks
2020-05-22 07:24:02 +02:00
Luca Deri
3874f0e0e0
Added stub for checking HTTP header
...
Updated Teams result
2020-05-21 15:19:55 +02:00
ysk
83ae5b7256
nDpi#remove build warnings
2020-05-21 14:06:52 +08:00
Luca Deri
c02b00e0ce
MS Teams uses as underlying protocol for voice/video. This commit adds the ability
...
to mark as MS Teams all Skype traffic made by a host with active MS Teams flows
2020-05-21 00:06:22 +02:00
Luca Deri
07d9e4f9ba
Fixed valse positive whatsapp detection
...
Cleaned Microsoft IP addresses list
2020-05-20 23:28:21 +02:00
Luca Deri
e9519c9aca
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-05-20 23:14:46 +02:00
Luca Deri
329eff069e
Removed bittorrent false positive detection
2020-05-20 23:14:09 +02:00
Luca Deri
246ec53bcf
Merge pull request #905 from lnslbrty/dev
...
Fixed docstring typos for ndpi_finalize_initalization
2020-05-20 08:48:49 +02:00
ysk
cd65da69d3
Merge branch 'dev' of github.com:yskcg/nDPI into dev
2020-05-20 13:21:36 +08:00
ysk
068c1b1f22
someip#fix when run across architectures such ARM ,may be occour sigbus error(),Unhandled fault: alignment fault (0x92000021) at 0x00000000f67004aa
2020-05-20 13:15:42 +08:00
Luca Deri
b7e666e465
Added fix to avoid potential heap buffer overflow in H.323 dissector
...
Modified HTTP report information to make it closer to the HTTP field names
2020-05-19 08:31:05 +02:00
Toni Uhlig
c5e16b4ff7
Fixed docstring typos for ndpi_finalize_initalization
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-05-17 16:59:57 +02:00
Luca Deri
3d9285f1be
Added check for invalid HTTP URLs
2020-05-16 00:10:35 +02:00
Luca Deri
c375782b96
Added check for binary scripts
...
Added NDPI_HTTP_NUMERIC_IP_HOST risk
ndpi_risk moved to 32 bit
2020-05-15 22:49:55 +02:00
Luca Deri
8e7b1ea7a1
Fix for potential heap-buffer-overflow in ndpi_search_openvpn
2020-05-15 21:10:37 +02:00
Luca Deri
e90c5c7c32
Added NDPI_HTTP_SUSPICIOUS_USER_AGENT ndpi_risk
2020-05-15 19:19:17 +02:00
Luca Deri
7dfbfff743
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-05-15 18:58:10 +02:00
Luca Deri
da22aa5fc7
Added NDPI_TLS_CERTIFICATE_EXPIRED, NDPI_TLS_CERTIFICATE_MISMATCH, to ndpi_risk
2020-05-15 18:57:49 +02:00
Luca Deri
a183b2ab9b
Added link to nfstream
2020-05-15 18:11:59 +02:00
Luca Deri
adfe6b763c
Gotomeeting address range fix
2020-05-15 11:20:21 +02:00
Luca Deri
9ed94a722c
Improvements on GotoMeeting
...
Added pcap for testing malware
2020-05-15 10:52:23 +02:00
Luca Deri
7037e79604
Merge pull request #903 from Loures/dev
...
Extend packet struct with Content-Disposition HTTP header field
2020-05-14 20:56:07 +02:00
loures
1edf5c49d6
Extend filetype matching for Content-Disposition header
2020-05-14 14:30:34 +02:00
loures
baddfbb6c3
Extend packet struct with Content-Disposition HTTP header field
...
and improve HTTP binary transfer mime type check
2020-05-14 12:47:22 +02:00
Luca Deri
fb64346e28
Code clenup for PR #902
2020-05-14 09:49:47 +02:00
Luca Deri
50be0b0049
Merge pull request #902 from Loures/dev
...
Add check for HTTP transfer of executable files
2020-05-14 09:12:17 +02:00
loures
08f32f2e0e
Set risk field instead of changing protocol when checking for dangerous
...
HTTP traffic
2020-05-13 19:56:49 +02:00
loures
0a4fbb8cfb
Add check for HTTP transfer of executable files
2020-05-13 18:32:29 +02:00
Luca Deri
9dfd0d0071
Code cleanup
2020-05-13 17:49:02 +02:00
Luca Deri
17235d234e
Merge pull request #897 from catenacyber/fuzzoracle
...
Adds bound check in oracle protocol
2020-05-12 13:53:55 +02:00
Luca Deri
db16a987c5
Merge pull request #896 from IvanNardi/nats
...
Fix NATS dissector
2020-05-12 13:52:42 +02:00
Luca Deri
f7f705406f
Invalid TLS check
2020-05-12 12:25:07 +02:00
Luca Deri
cd765c08d6
Added NDPI_XXX_BIT_16
2020-05-11 09:07:30 +02:00
Luca Deri
ee15c6149d
Added TLS weak cipher and obsolete protocol version detection
2020-05-10 21:55:35 +02:00
Luca Deri
ae803c8b51
Added detection of self-signed TLS certificates
2020-05-10 21:40:35 +02:00
Luca Deri
e5e69d0f7a
Added the ability to detect when a known protocol is using a non-standard port
...
Added check to spot executables exchanged via HTTP
2020-05-10 21:25:38 +02:00
Philippe Antoine
b69177be2f
Adds bound check in oracle protocol
...
Found by oss-fuzz
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=21780
2020-05-10 15:04:23 +02:00
Nardi Ivan
f8503da9e9
Fix NATS dissector
2020-05-09 15:41:20 +02:00
Luca Deri
39ae57e6a3
Cleaned hyperscan leftover
...
Added further hyperscan hooks
2020-05-08 18:24:07 +02:00
Luca Deri
c9b37b92f5
Added self signed certificate test pcap
2020-05-08 09:09:58 +02:00
Luca Deri
4a09b4efa0
Added TLS issuerDN and subjectDN
2020-05-07 18:44:51 +02:00
Luca Deri
fd646bd05f
Reworked TLS dissector with a certificate RDN sequence reader
2020-05-07 17:22:01 +02:00
Luca Deri
6a1b8baa00
Fixed category matching
2020-05-06 23:50:35 +02:00
Luca Deri
2ccd2c204b
API cleanup for indetifying explicitly in automa's what we're searching (protocol or category)
...
Removed hyperscan support that is apperently unused
2020-05-06 23:19:59 +02:00
Luca Deri
263547e77d
Updated automa API to use 32 bit values splits from protocol/categpry
2020-05-06 21:57:32 +02:00
Luca Deri
86e34fbf6d
Added support for Telegram v6
2020-05-06 18:06:30 +02:00
Luca Deri
84f66b4d6b
Introduced custom protocols with IP and (optional) port support
...
Example
- Single IP address
ip:213.75.170.11@CustomProtocol
- IP address with CIDR
ip:213.75.170.11/32@CustomProtocol
- IP address with CIDR and port
ip:213.75.170.11/32:443@CustomProtocol
Please note that there are some restrictions on the port
usage. They have been listed in example/protos.txt
2020-05-06 12:51:44 +02:00
Luca Deri
7855e0318d
Various fixes to patricia tree handling
2020-05-06 11:13:57 +02:00
Luca Deri
48282369e2
False positive fixes
2020-05-06 01:34:55 +02:00
Luca Deri
7d63149ced
Updated API
2020-05-06 00:41:07 +02:00
Luca Deri
427002d14f
Reworked protocol handling chnging it is u_int16_t
2020-05-06 00:31:40 +02:00
Luca Deri
4148c5e065
Removed now obsolete MSN protocol
...
Added nats.io protocol dissector
2020-05-03 18:20:21 +02:00
Luca Deri
c120cca662
SSH boundary check rework
2020-04-30 20:08:03 +02:00
Luca Deri
7344bf65bc
Minor cleanup
2020-04-30 19:58:07 +02:00
Luca Deri
6f79b78f71
Merge pull request #891 from catenacyber/ghsl2
...
Better fix for integer overflow in SSH
2020-04-30 19:53:16 +02:00
Philippe Antoine
a70fd6ed3b
Better fix for integer overflow in SSH
...
Credits to GHSL
2020-04-30 18:44:40 +02:00
Luca Deri
bd0fd6cf8d
Merge pull request #883 from leonn/websocket
...
💡 implement WebSocket protocol dissector
2020-04-27 23:28:23 +02:00
Luca Deri
0bf809f8e5
Merge pull request #884 from lnslbrty/dev
...
Added missing ndpiReader dependency for the install target
2020-04-27 23:27:26 +02:00
Luca Deri
44259ab2b9
Merge pull request #887 from IvanNardi/tunnel
...
Tunnel
2020-04-27 23:27:03 +02:00
Alfredo Cardigliano
328016895f
Handle empty blocks
2020-04-27 13:34:54 +00:00
Leonn Paiva
780dc8d1e7
💡 implement websocket protocol dissector
2020-04-26 02:53:12 -03:00
Alfredo Cardigliano
4d746dabe9
Enable IEC 60870-5-104 dissector
2020-04-24 15:31:44 +00:00
Nardi Ivan
097127c31d
Fix heap-overflow error in CAPWAP detunneling code
2020-04-24 10:42:52 +02:00
Nardi Ivan
c2ebbb15ad
Fix "division by zero" runtime error
2020-04-23 14:24:49 +02:00
Nardi Ivan
f965983c23
Add basic support for some ip-in-ip tunnels
...
Add support for 4in4, 6in6 and 4in6 encapsulations
Add support for ipv6 traffic in gtp tunnels, too
To allow gtp unit test, gtp detunneling flag has been globally enabled
in the test suite
2020-04-23 10:55:33 +02:00
Toni Uhlig
8d8e61b256
Added missing ndpiReader dependency for the install target
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2020-04-22 21:51:57 +02:00
Luca Deri
0b702c20d3
Warning fix
2020-04-22 18:52:36 +02:00
Luca Deri
473a5d1d0b
Merge pull request #881 from leonn/bug_protocol_was_guessed
...
Bug protocol was guessed
2020-04-22 18:49:55 +02:00
Luca Deri
65b428899d
Fix for nDPI code not downlooaded from git
2020-04-22 16:15:15 +02:00
Leonn Paiva
6769168d89
🐛 use protocol_was_guessed in ndpi_detection_giveup
2020-04-22 03:48:12 -03:00
Leonn Paiva
4d5ca2c473
🆒 code ident & style
2020-04-22 03:40:55 -03:00
Luca Deri
e8cae3cff9
Updated results
2020-04-21 19:26:49 +02:00
Luca Deri
019b51bb17
Merge pull request #879 from IvanNardi/warnings
...
Fix some compilation warnings
2020-04-21 19:23:57 +02:00
Luca Deri
e2be7daed6
Merge pull request #880 from catenacyber/fuzz8fix
...
Gets right protocol after IPv6 header
2020-04-21 19:22:50 +02:00
Philippe Antoine
1b73f7372e
Gets right protocol after IPv6 header
2020-04-21 15:34:53 +02:00
Nardi Ivan
b1a6c6b895
Fix some compilation warnings
2020-04-20 16:53:39 +02:00
Luca Deri
e603549967
Office365 renamed to Microsoft365 (by Microsoft)
2020-04-20 15:44:27 +02:00
Luca Deri
3bdec5ae5f
Updated node list ( fixes #766 )
2020-04-20 15:16:31 +02:00
Luca Deri
25cd2a23a6
Compilation fixes
2020-04-20 15:08:51 +02:00
Luca Deri
97badc574b
Merge pull request #877 from catenacyber/fuzz7fix
...
Adds bound check before calling ndpi_handle_ipv6_extension_headers
2020-04-20 13:56:53 +02:00
Luca Deri
493bffb3e0
Added check for pkg-config presence
2020-04-19 21:48:24 +02:00
Philippe Antoine
c2b2692e65
Seeting right flow protocol after IP6 extensions
...
Finally fixing https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=20727
2020-04-18 14:39:57 +02:00
Philippe Antoine
db5f3b38b7
Adds CIFuzz to check PRs
...
cf https://google.github.io/oss-fuzz/getting-started/continuous-integration/
2020-04-18 10:50:56 +02:00
Philippe Antoine
da0889d3ba
Adds bound check before calling ndpi_handle_ipv6_extension_headers
2020-04-17 22:21:03 +02:00
Luca Deri
94eee66a7b
CiscoVPN dissection improvements
2020-04-17 16:56:55 +02:00
Luca Deri
748df7972a
Results update
2020-04-17 10:36:27 +02:00
Luca Deri
a766de7b94
Merge pull request #876 from a-czyrny/dev
...
additional csv semicolon fix
2020-04-17 10:34:41 +02:00
Luca Deri
711ba99eaa
Added detection of Microsoft Teams
2020-04-16 15:23:07 +02:00
Alexander Czyrny
32d25bfdaf
additional csv semicolon fix
...
Created function correct_csv_data_field to pevent duplicated code. Additionally used for _flow->ndpi_flow->protos.stun_ssl.ssl.alpn_ and _flow->ndpi_flow->protos.stun_ssl.ssl.tls_supported_versions_ to guarantee a valid csv output (commas replaced by semicolon) .
2020-04-16 14:12:48 +02:00
Luca Deri
287015ffdc
Fixed invalid check
2020-04-15 22:42:09 +02:00
Luca Deri
f4c24663fc
Merge pull request #874 from catenacyber/fuzz6fix
...
Fuzz6fix
2020-04-15 18:05:16 +02:00
Luca Deri
9f2dabbda4
Merge pull request #873 from a-czyrny/a-czyrny-ndpireader-csv-patch
...
Fix for missing line breaks in CSV file
2020-04-15 18:04:26 +02:00
Philippe Antoine
4f370fe7c4
Adds netbios bound check
2020-04-15 16:40:00 +02:00
Philippe Antoine
9483c842b5
TLS initializes version_str
2020-04-15 16:40:00 +02:00
Philippe Antoine
c1f9f05d33
Adds tls check before reading memory
2020-04-15 16:22:16 +02:00
Philippe Antoine
cf47ba234a
Use ndpi_handle_ipv6_extension_headers in reader_util
2020-04-15 16:19:57 +02:00
Philippe Antoine
98f2d3a73c
Adds bound check for IRC
2020-04-15 15:56:58 +02:00
Philippe Antoine
c1baf1516d
Adds bound check for TZSP
2020-04-15 15:50:58 +02:00
Philippe Antoine
369dc65c1a
Fix integer overflow in quic
2020-04-15 15:45:32 +02:00
Philippe Antoine
4ec3e6c064
Adds bound check in TLS
2020-04-15 15:42:54 +02:00
Philippe Antoine
81e97d7515
Fixes OOB reads in postgres
...
Reported by GHSL
2020-04-15 15:35:34 +02:00
Alexander Czyrny
32ab88a26e
Fix for missing line breaks in CSV file
...
If "-v" is used as an argument, the line breaks are missing in the csv file ("-C"), because the argument "-J" is assumed. Moving the condition for the CSV file handler out of the scope of the "enable_joy_stats" condition removes this dependency and the CSV file is formatted correctly.
2020-04-15 10:12:37 +02:00
Luca Deri
afdae85b30
Restored ndpi_get_api_version() prototype
2020-04-15 09:06:02 +02:00
Luca Deri
63c4eaae9b
Invalid function definition fix
2020-04-13 22:40:20 +02:00
Luca Deri
4e876a4543
Merge pull request #866 from anticomputer/packet_payload_integer_ql
...
ql query to identify suspicious use of network sourced integers
2020-04-15 08:38:23 +02:00
Luca Deri
7b54d028a3
Merge pull request #872 from aouinizied/dev
...
Update python example.
2020-04-15 08:37:28 +02:00
Luca Deri
9cba06a080
Merge pull request #869 from disconnect3d/patch-2
...
Fix incorrect "<iq from=\"' parsing
2020-04-15 08:36:27 +02:00
Luca Deri
794f7fa124
Merge pull request #868 from disconnect3d/patch-1
...
Fix off by one when checking for "GET / HTTP" string
2020-04-15 08:35:59 +02:00
Luca Deri
d3b4b81d6f
Merge pull request #867 from IvanNardi/memory-leaks
...
Memory leaks
2020-04-15 08:35:28 +02:00
Zied Aouini
1bee9d85a4
Fix flow_printer example.
2020-04-15 08:05:03 +02:00
Disconnect3d
fa15e170b4
Fix incorrect "<iq from=\"' parsing
...
This PR fixes a wrong size arg passed to memcmp when checking for "<iq from=\"" and "<iq from \'" strings.
2020-04-13 16:35:03 +02:00
Disconnect3d
b75838b771
Fix off by one when checking for "GET / HTTP" string
2020-04-13 16:33:27 +02:00
Luca Deri
d665df64e2
Added ndpi_serialize_raw_record() API call
2020-04-10 21:39:23 +02:00
Nardi Ivan
e84563f971
ndpiReader: fix memory leak in idle sessions purging
2020-04-08 15:15:34 +02:00
Nardi Ivan
a60854bae6
Fix some debug messages
2020-04-08 15:15:34 +02:00
Nardi Ivan
7b690d8b2d
kerberos: fix heap-overflow error
2020-04-08 15:15:34 +02:00
Nardi Ivan
0c1322a718
s7comm: fix heap-overflow error
2020-04-08 15:15:34 +02:00
Nardi Ivan
b40732d8a5
Fix an harmless memory leak
...
Leak introduced in 90e08b35 , while fixing #845
2020-04-08 15:15:34 +02:00
Luca Deri
db8497778d
Fixes #853 and adds a self check for duplicates
2020-04-07 19:17:37 +02:00
Luca Deri
dea883a25d
Minor refresh
2020-04-07 19:01:38 +02:00
Luca Deri
81a2f54dd7
Merge pull request #865 from catenacyber/ghsl-2020-05x
...
Ghsl 2020 05x
2020-04-05 08:29:43 +02:00
Luca Deri
c2c01b618b
Fix for string serialization with initial empty string
2020-04-03 15:26:24 +02:00
Bas Alberts
fb863c6bfb
ql query to identify suspicious use of network sourced integers
2020-04-02 17:14:49 -04:00
Philippe Antoine
7ce478a58b
ssh: fixing unsigned overflow leading to heap overflow
...
cf GHSL-2020-051
2020-04-02 16:48:35 +02:00
Philippe Antoine
3bbb0cd329
ssh: adds systematic bounds checks in concat_hash_string
...
cf GHSL-2020-052
2020-04-02 16:35:10 +02:00
Luca Deri
56ca71bda9
Merge pull request #863 from IvanNardi/memory-errors
...
Memory errors
2020-03-31 17:51:20 +02:00
Nardi Ivan
498571354d
openvpn: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
3924257f32
telnet: fix another heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
817aa54214
telnet: fix heap-overflow error
...
There is some boilerplate since I removed an if branch and I had to reindent
the code
2020-03-27 11:09:53 +01:00
Nardi Ivan
97fc94c7e8
kerberos: fix use-after-free error
...
After leaving kerberos code, the original packet may be processed from
other dissector (i.e. TLS)
2020-03-27 11:09:53 +01:00
Nardi Ivan
9ec711aa90
tls: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
9c2c04d8ce
ssh: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
4f399356a6
quic: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
45ff2a3f5a
h323: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
58f0f29113
soulseek: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Nardi Ivan
da5e5a3e2a
ciscovpn: fix heap-overflow error
2020-03-27 11:09:53 +01:00
Luca Deri
17d531e3db
Added s7comm test pcap
2020-03-27 09:35:59 +01:00
Luca Deri
0d223ada3f
Compilation fix
2020-03-27 08:46:03 +01:00
Luca Deri
890e8644ac
Merge pull request #861 from havup/dev
...
pull request with s7comm
2020-03-27 08:38:44 +01:00
havup
1bab8a1c22
Update s7comm.c
2020-03-27 14:02:10 +08:00
havup
24bb0b7f53
Update s7comm.c
2020-03-27 13:09:46 +08:00
havup
803b13a7a8
Update s7comm.c
2020-03-27 12:58:56 +08:00
havup
7841145d9c
Update tls_long_cert.pcap.out
2020-03-27 12:28:15 +08:00
havup
efdac78ddc
Update s7comm.c
2020-03-27 11:19:50 +08:00
havup
74825ffc6e
Update s7comm.c
2020-03-26 13:06:02 +08:00
emanuele-f
1b8f7ed101
Fix API version generation
2020-03-25 14:07:19 +01:00
emanuele-f
9cf016c5f1
Fix ndpi_get_api_version version truncation
2020-03-25 14:00:47 +01:00
Luca Deri
47a4507d9e
NDPI_API_VERSION is now computed automatically
2020-03-25 12:51:06 +01:00
havup
779d9a6e51
Add files via upload
2020-03-25 19:09:14 +08:00
havup
ac17e0bea7
Update ndpi_main.c
2020-03-25 19:06:36 +08:00
havup
4d95dae2ae
Update ndpi_main.c
2020-03-25 19:05:49 +08:00
havup
6c3cbe50e2
Update ndpi_protocols.h
2020-03-25 19:04:35 +08:00
havup
a2b163beca
Update ndpi_protocol_ids.h
2020-03-25 19:04:00 +08:00
Luca Deri
c8a1767465
Fixed invalid allocation
2020-03-24 13:36:03 +01:00
Luca Deri
40be74c629
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-03-23 14:45:08 +01:00
Luca Deri
df5cf59787
Format update
2020-03-23 14:44:33 +01:00
Luca Deri
d26349e082
Format update
2020-03-23 14:37:14 +01:00
Luca Deri
7add3acc53
Added fuzz-2020-02-16-11 fuzzy pcap
2020-03-23 10:27:32 +01:00
Luca Deri
1c1a18d12f
Added fuzz-2006-09-29-2858 fuzzy pcap
2020-03-23 10:25:28 +01:00
Luca Deri
92bd223c34
Added fuzz-2006-06-26-2594.pcap fuzzy pcap
2020-03-23 10:24:11 +01:00
Luca Deri
9d53c3c3b8
Added wa_video.pcap
2020-03-23 10:23:05 +01:00
Luca Deri
906d7fe0c1
Added wa_voice.pcap
2020-03-23 10:22:46 +01:00
Luca Deri
cd78740caf
Added netflow-fritz.pcap
2020-03-23 10:11:51 +01:00
Luca Deri
626ee52049
Added smb_deletefile.pcap
2020-03-23 10:09:47 +01:00
Luca Deri
7a93994802
Added iphone.pcap
2020-03-23 10:09:14 +01:00
Luca Deri
1bb10863e4
Added android.pcap
2020-03-23 10:08:57 +01:00
Luca Deri
924bc9698b
Added badpackets.pcap
2020-03-23 10:06:16 +01:00
Luca Deri
9aba94713c
Added dns_exfiltration.pcap
2020-03-23 10:06:00 +01:00
Luca Deri
00beac6b1a
Added netbios.pcap
2020-03-23 10:05:41 +01:00
Luca Deri
8c2ffc5b37
Added dos_win98_smb_netbeui.pcap
2020-03-23 10:05:24 +01:00
Luca Deri
a845e99720
Merge pull request #859 from catenacyber/fuzzudpfix
...
Checks enough data for UDP header
2020-03-20 18:02:27 +01:00
Luca Deri
8cda02bb14
Fixed loop in serialization
2020-03-20 18:01:37 +01:00
Philippe Antoine
3e259aac98
tls_supported_versions only if version_str is initialized
...
With version_len == (extension_len-1)
2020-03-19 17:19:28 +01:00
Philippe Antoine
2aec630202
Fix use of uninitialized value in TLS
2020-03-19 17:16:41 +01:00
Philippe Antoine
c6acf97bfb
Adds different checks against overflows
2020-03-19 16:54:31 +01:00
Philippe Antoine
e9195589d2
Checks enough data for UDP header
2020-03-19 16:44:53 +01:00
Luca Deri
b2cbe76e71
Added QUIC v046 test pcap
2020-03-17 16:51:25 +01:00
Luca Deri
4227be7989
Update for QUIC 046
2020-03-17 16:48:34 +01:00
Simone Mainardi
e282e43279
Fixes netbios overread
...
This commit inherits from https://github.com/ntop/nDPI/commit/7a2bcd9c395f9fe554109e04add33e9e65564d82
but leaves ndpi_netbios_name_interpret as part of the API as it
is used by ntopng
2020-03-12 22:21:07 +01:00
Simone Mainardi
2f15ce706f
Fixed API change which removed ndpi_netbios_name_interpret
...
This reverts commit 7a2bcd9c39 .
2020-03-12 22:08:59 +01:00
Luca Deri
70ee793ff3
Merge pull request #856 from catenacyber/fuzzfix5
...
Fuzzfix5
2020-03-12 18:13:30 +01:00
Philippe Antoine
7806eb5f5b
Fix infinite loop in tls
2020-03-12 14:31:47 +01:00
Philippe Antoine
9d1340a8e7
Fix buffer overread in yahoo
2020-03-12 14:26:08 +01:00
Philippe Antoine
7a2bcd9c39
Fix buffer overread in netbios
2020-03-12 14:22:46 +01:00
Philippe Antoine
fe513014a8
Fix buffer over read in dns
2020-03-12 14:13:04 +01:00
Philippe Antoine
3c05d4551d
Fix snprintf return value check for tls
2020-03-12 14:05:48 +01:00
Philippe Antoine
4976d93d4e
Fix buffer overread in ndpi_search_setup_capwap
2020-03-12 14:03:31 +01:00
Luca Deri
1e933e8b02
Win fixes
2020-03-12 11:26:38 +01:00
Luca Deri
942a71c7eb
NetBIOS dissection improvements
2020-03-01 11:42:21 +01:00
Luca Deri
7fd135a8c9
Added SMBv1 over NetBIOS detection
2020-03-01 11:32:09 +01:00
Luca Deri
34ad06fef5
Compilation fix
2020-02-28 16:03:27 +01:00
Luca Deri
8f45f51e6c
Compilation fix
2020-02-28 15:28:41 +01:00
Luca Deri
9f72b15fff
Merge pull request #850 from catenacyber/fuzz4fix
...
Fuzz4fix
2020-02-28 14:39:17 +01:00
Philippe Antoine
6fe9535881
Adds check before memcpy for bittorrent
2020-02-26 17:12:46 +01:00
Philippe Antoine
5fc9d41eb0
Run ndpi_detection_process_packet only with payload
...
Real problem is decapsulation of all ipv6 headers
2020-02-26 17:05:08 +01:00
Philippe Antoine
933351840d
Fix off by one in imap
2020-02-26 16:59:04 +01:00
Philippe Antoine
83fdfe24d0
Fix read overflow before UDP header
2020-02-26 16:16:29 +01:00
Alfredo Cardigliano
d4c093e828
Check NULL strings in ndpi_serialize_string_string
2020-02-26 09:55:24 +01:00
Luca Deri
c0ec78885d
Merge pull request #849 from annp1987/fix_ndpi_flow2json_segfault
...
ndpi_flow2json should check http.url before serializer
2020-02-26 08:06:11 +01:00
Luca Deri
a55c410202
Merge pull request #848 from aouinizied/dev
...
nDPI 3.2 support in python cffi bindings
2020-02-26 08:05:45 +01:00
Nguyen Phuong An
e675be1a83
ndpi_flow2json should check http.url before serializer
...
This patch will fix issue: https://github.com/ntop/PF_RING/issues/557
2020-02-26 13:32:13 +07:00
Luca Deri
f07a329447
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-02-23 19:10:14 +01:00
Luca Deri
2ceff3e214
Fixed swapped protocol
2020-02-23 19:09:58 +01:00
Zied Aouini
dcb6fde0c9
Update Python cffi bindings.
2020-02-21 17:28:44 +01:00
Zied Aouini
e67604a583
Remove trailing alignment directives.
2020-02-21 16:37:36 +01:00
Zied Aouini
40896d3d44
Fix docstrings.
2020-02-21 15:51:17 +01:00
Zied Aouini
5a0f609086
Add ndpi_flow_tcp_struct and ndpi_flow_udp_struct api calls.
2020-02-21 15:49:46 +01:00
Alfredo Cardigliano
2972e29097
Moved to 3.3
2020-02-20 10:15:11 +01:00
Luca Deri
dd80ec869a
Fixes #837
2020-02-19 23:44:22 +01:00
Luca Deri
1714d7aa52
Fixes #842
2020-02-19 23:40:53 +01:00
Luca Deri
90e08b3568
Fixes #845
2020-02-19 23:38:33 +01:00
Luca Deri
080e23e30e
Merge pull request #846 from catenacyber/fuzzofix
...
Fix various buffer over reads
2020-02-19 22:55:18 +01:00
Luca Deri
edce5a8c1f
Fix for disabling guess when not requested
2020-02-19 12:24:26 +01:00
Alfredo Cardigliano
c8ccf33f07
nDPI 3.2 changelog
2020-02-19 12:10:49 +01:00
Philippe Antoine
ee979ac14a
Fix kerberos leak
2020-02-18 13:32:20 +01:00
Philippe Antoine
3eb9907dd7
Fix various buffer over reads
2020-02-18 11:50:22 +01:00
Luca Deri
fdf8dd724f
Minor fix
2020-02-17 22:15:36 +01:00
Luca Deri
37121a9b58
Added protocol range check
2020-02-17 19:34:47 +01:00
Luca Deri
bbaf9147b6
Fixed TLS client SNI dissection
2020-02-17 18:48:21 +01:00
Luca Deri
9796fdc0e9
Temporarely disabled x390 s390x as we have no way to debug the code on such platforms
2020-02-15 17:31:30 +01:00
Luca Deri
e0a058af67
Merge pull request #844 from catenacyber/fuzz2fix
...
Fuzz2fix
2020-02-15 17:21:52 +01:00
Alfredo Cardigliano
80e9826040
Add ndpi_serialize_string_raw to add raw json values
2020-02-14 16:32:00 +01:00
Philippe Antoine
bf7dcd63c3
Checks length for next ip header
2020-02-14 14:18:31 +01:00
Philippe Antoine
b287dccecf
Checks l4 size against l3 size
2020-02-14 14:02:19 +01:00
emanuele-f
cb34c6b233
Add fpic in the reader
2020-02-14 12:06:55 +01:00
emanuele-f
fd94270507
Remove decimals in test results for IAT, packet lengths and goodput ratio
2020-02-14 11:42:20 +01:00
Emanuele Faranda
03cf975c07
Merge pull request #840 from xnox/more-tests
...
travis: bump to bionic, add arm64 & s390x.
2020-02-14 10:32:31 +00:00
emanuele-f
428661c00b
Add debug symbols when using --with-llvm-sanitizer
2020-02-14 11:09:00 +01:00
emanuele-f
5c52c00ea4
Add the --with-llvm-sanitizer flag
...
To enable the leaks detector, set the ASAN_OPTIONS=detect_leaks=1
environment variable, e.g:
ASAN_OPTIONS=detect_leaks=1 example/ndpiReader -i test.pcap
2020-02-13 18:42:13 +01:00
Luca Deri
f89f25c118
Added ndpi_is_protocol_detected() API call
2020-02-13 15:20:47 +01:00
emanuele-f
d4ae8a5f16
Fix memory invalid access in SMTP and leaks in TLS
2020-02-13 10:46:30 +01:00
emanuele-f
7234f36949
Fix possible leak
2020-02-13 10:14:57 +01:00
emanuele-f
2efc09a20e
Fix invalid memory read
2020-02-12 19:36:47 +01:00
emanuele-f
3fa61a394b
Fix little leak on the proto_defaults strdup
2020-02-12 17:15:01 +01:00
Dimitri John Ledkov
582a01303f
travis: bump to bionic, add arm64 & s390x.
2020-02-10 18:26:47 +00:00
Luca
97fb50e837
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-02-10 15:26:21 +01:00
Luca Deri
a3da5604a3
Allocation fix in kerberos dissector
2020-02-10 15:25:40 +01:00
Luca
af6c86de28
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-02-10 15:04:37 +01:00
Luca Deri
34984f1aec
Removed outdated AppVeyor link
2020-02-08 11:25:39 +01:00
Luca Deri
83bbb4cb69
Compliation warning fixes
2020-02-08 11:24:40 +01:00
Luca Deri
ff4f32ff48
Merge pull request #839 from catenacyber/fuzzbadge
...
Adds oss-fuzz badge to REAMDE
2020-02-08 11:21:23 +01:00
Luca Deri
33d761a55a
Merge pull request #838 from catenacyber/fix2
...
Adds missing checks
2020-02-08 11:20:54 +01:00
Luca Deri
2bd89be3e2
Added new TLS test files
2020-02-08 10:38:22 +01:00
Luca Deri
5cad39f0e8
Added export of TLS supported version in TLS header
2020-02-07 23:26:03 +01:00
Luca Deri
3be263aafc
Added TLS ALPN support
2020-02-07 21:54:04 +01:00
Luca
452ba1f339
Improvements for DNS continuous flow dissection
2020-02-06 19:19:36 +01:00
emanuele-f
ec15089208
Little enhancements
2020-02-06 18:22:00 +01:00
Philippe Antoine
af661bd652
Adds oss-fuzz badge to REAMDE
2020-02-06 10:56:33 +01:00
Luca Deri
4613515635
Category matching fix
2020-02-05 08:37:24 +01:00
Luca Deri
2009361b89
Fix for IPv6 address format across the various platforms/distributions
2020-02-04 22:51:07 +01:00
Luca Deri
f027ab1ae7
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-02-04 22:50:37 +01:00
Luca Deri
fa26c62b0c
Fix for IPv6 address format across the various platforms/distributions
2020-02-04 22:50:08 +01:00
Luca Deri
0faba29351
Result update
2020-02-04 22:38:56 +01:00
Luca Deri
2701cc9491
Warnign fix
2020-02-04 22:34:08 +01:00
Luca Deri
88fc9232ff
Code improvements
2020-02-04 22:31:02 +01:00
Luca Deri
0703ab5ac5
Improved DNS response decoding
...
The first decoded address is now reported by ndpiReader
2020-02-04 22:16:54 +01:00
Philippe Antoine
418ea234ae
Adds missing checks
...
Found by fuzzing
2020-02-03 22:38:31 +01:00
Luca
3e99b73635
Updte WebattackRCE.pcap.out with libpcre disabled
2020-02-02 22:15:55 +01:00
Luca
6dbe81588f
Added --with-pcre to enable libpcre usage
2020-02-02 22:07:21 +01:00
Luca
2b6a639192
Libfuzz fixes
2020-02-02 21:54:36 +01:00
Luca
9e87645022
PCRE fixes
2020-02-02 19:54:31 +01:00
Luca
626fcf1418
Added missing additiona libs
2020-02-02 17:01:07 +01:00
Luca Deri
5b11c2ffc5
Merge pull request #836 from MrTiz9/dev
...
nDPI now detects RCE injections in HTTP requests
2020-02-02 16:19:26 +01:00
Luca Deri
8486eb08ea
Merge pull request #835 from catenacyber/fuzzfix
...
Fuzz fixes
2020-02-02 16:17:03 +01:00
MrTiz9
ce4f4fbe2f
Added missing pcap.out for RCE detections
2020-02-01 17:23:22 +01:00
MrTiz9
3422574c17
FIXED - nDPI now detect RCE injections via PCRE instead Intel Hyperscan
2020-02-01 17:18:35 +01:00
MrTiz9
b3138d5e3e
Merge branch 'dev' of https://github.com/ntop/nDPI into dev-unstable
2020-02-01 13:47:42 +01:00
Philippe Antoine
0bf2ca56a8
Uses ip_size in get_ndpi_flow_info6
2020-01-31 15:37:36 +01:00
Philippe Antoine
b97360d931
Fix infinite loop in ndpi_workflow_process_packet
2020-01-31 15:26:34 +01:00
Philippe Antoine
579dd7dff9
Fix memcached read overflow
2020-01-31 15:21:03 +01:00
Philippe Antoine
ff89a14b49
Modifies fuzz target to fix leaks
2020-01-31 15:13:35 +01:00
Philippe Antoine
b5b2260f2e
Fix undefined shift in dns
2020-01-31 14:50:18 +01:00
lucaderi
39b1ad3087
PCRE fix
2020-01-31 07:09:54 +01:00
Luca Deri
c68ea3067b
Added libpcre lib if present
2020-01-30 22:24:24 +01:00
Alfredo Cardigliano
4e538b1e4d
Disabeld community id debug
2020-01-30 15:20:52 +01:00
MrTiz9
5c8c2d843a
nDPI now detect RCE injections via PCRE instead Intel Hyperscan - BUGGY, DOES NOT COMPILE
2020-01-30 15:08:26 +01:00
MrTiz9
ea957687e1
Merge branch 'dev' of https://github.com/ntop/nDPI into dev-unstable
2020-01-30 14:57:58 +01:00
Luca Deri
c84ed5a712
Added check for libpcre presence
2020-01-29 00:41:35 +01:00
Alfredo Cardigliano
ab2a011cf9
Community ID hash fixes
2020-01-25 16:04:00 +01:00
Luca Deri
d86d632fe6
Added memory boundary check in HTTP dissector
2020-01-24 21:04:27 +01:00
Luca Deri
87d228f78e
Fixed heap-buffer-overflow in citrix decoder
2020-01-24 19:50:38 +01:00
Luca Deri
a7a4bf32d3
Merge pull request #833 from catenacyber/travisfuzz2
...
Fix sanitizers build on Travis
2020-01-24 19:38:18 +01:00
Alfredo Cardigliano
e20c4acbde
Implement ndpi_flowv6_flow_hash ndpi_flowv4_flow_hash. Add ndpi_base64_encode.
2020-01-24 18:36:38 +01:00
MrTiz9
daf15e70bf
Added missing pcap.out for RCE detections
2020-01-24 17:16:18 +01:00
MrTiz9
daa1171593
nDPI now detect RCE in HTTP GET requests
2020-01-24 17:16:18 +01:00
Philippe Antoine
dc5fecfc92
Use MSAN_SYMBOLIZER_PATH now that it works
2020-01-24 10:15:16 +01:00
Philippe Antoine
79e1ec9f50
Complete absolute path for symbolizer
2020-01-24 10:03:23 +01:00
Philippe Antoine
902a1c7b4c
Trying with ASAN_SYMBOLIZER_PATH
2020-01-24 09:53:06 +01:00
Philippe Antoine
5b88867084
Looking for symbolizer
2020-01-24 09:46:53 +01:00
Philippe Antoine
4749e61bdb
Debug symbols in LDFLAGS
2020-01-24 09:23:56 +01:00
Philippe Antoine
4f230943cf
Debug compilation flag for fuzz targets
...
And adding include file to fuzz_ndpi_reader
2020-01-24 09:10:52 +01:00
Philippe Antoine
6186e1ab01
Only one env
2020-01-24 08:40:05 +01:00
Philippe Antoine
9fe8bf018a
Use clang++7 for fuzz targets in Travis
2020-01-24 08:24:18 +01:00
Philippe Antoine
e082134a0d
Fix sanitizers build on Travis
2020-01-24 08:14:44 +01:00
Luca Deri
cedbf3b636
Merge pull request #832 from catenacyber/travisfuzz
...
Adds fuzz targets build and run to travis
2020-01-23 18:36:40 +01:00
Luca Deri
5f6fd8d2a5
Merge pull request #831 from catenacyber/fuzzcorpus
...
Generates automatically corpus for fuzz target
2020-01-23 18:35:48 +01:00
Philippe Antoine
cbb755666e
Typo fix
2020-01-23 09:09:21 +01:00
Philippe Antoine
1d024ece7a
Adds fuzz targets build and run to travis
...
Build comes with the different sanitizers
2020-01-22 16:36:12 +01:00
Philippe Antoine
77db14fd7a
Generates automatically corpus for fuzz target
2020-01-22 16:12:50 +01:00
Luca Deri
5a40f9b7fd
Minor fixes
2020-01-21 20:52:42 +01:00
Luca Deri
931f51bd77
ndpi_load_categories_file() now returns the number of loaded hosts or -1 in case of error
2020-01-20 23:37:09 +01:00
Luca Deri
283588a37b
Crash fix when not using CSV output
2020-01-19 20:50:23 +01:00
Luca
812505b56b
Added sanity check
2020-01-15 20:49:21 -07:00
Luca Deri
98d9f524f9
Merge pull request #830 from catenacyber/fuzzpcap
...
Adds another fuzz target
2020-01-14 16:37:55 -08:00
Luca Deri
0023a96f80
Merge pull request #828 from vitalivanov/pull_764
...
example: fix compilation of ndpireader on latest dpdk.
2020-01-14 16:37:28 -08:00
Luca Deri
9f7b1c84f2
Merge pull request #829 from vitalivanov/pull_warning_vit
...
example: fix build warning.
2020-01-14 16:36:51 -08:00
Alfredo Cardigliano
e1047b324b
Fix misleading error message
2020-01-14 10:57:05 +01:00
Philippe Antoine
10738a0ca3
New fuzz target : fuzz_ndpi_reader
2020-01-14 08:20:15 +01:00
Philippe Antoine
fe312ffbe1
Compile libndpireader
2020-01-14 08:20:15 +01:00
Vitaliy Ivanov
24f2cd6fc1
example: fix build warning.
...
ndpiReader.c:24:0: warning: "_GNU_SOURCE" redefined
#define _GNU_SOURCE
<command-line>:0:0: note: this is the location of the previous definition
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2020-01-13 16:15:58 +02:00
Vitaliy Ivanov
cbabbd5865
example: fix compilation of ndpireader on latest dpdk.
...
reader_util.c:1708:43: error: 'ETHER_MAX_LEN' undeclared here (not in a function)
.rxmode = { .max_rx_pkt_len = ETHER_MAX_LEN }
^~~~~~~~~~~~~
DPDK before 19.08 had a macro ETHER_MAX_LEN, in later versions it was
changed to RTE_ETHER_MAX_LEN.
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2020-01-13 16:10:09 +02:00
Luca Deri
da5208ee68
Updated results with the new output
2020-01-10 23:21:11 +01:00
Luca Deri
bccf1c433a
Added missing flow extra info export in flows
2020-01-10 23:15:54 +01:00
Luca Deri
cc7593fe5a
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-01-10 22:21:42 +01:00
Luca Deri
5571ce114d
Added flow extra info field
...
Updated tests/results
2020-01-10 22:21:16 +01:00
Luca
4dd887e516
Added further TLS checks
2020-01-10 18:18:07 +01:00
Luca Deri
a3e06da2a8
Minor cleanup
2020-01-10 12:46:53 +01:00
Luca Deri
dc21079851
Fix for invalid TLS leght
2020-01-09 18:51:03 +01:00
Luca Deri
5987ec6014
Added check for preventing TLS misbehavior
2020-01-09 17:14:37 +01:00
Luca
757b0c602f
Fix for avoiding misdetection in TLS
2020-01-09 10:30:14 +01:00
Luca Deri
498b346219
Added bootstrap ethereum nodes
2020-01-08 22:44:30 +01:00
Luca Deri
3e66bbc5bc
Tool for listing the current bitcoin IPv4 nodes
2020-01-08 22:14:34 +01:00
Luca Deri
3ba7667887
Various ethereum improvements
2020-01-08 22:01:45 +01:00
Luca Deri
fd943d6000
Code hardening
2020-01-08 17:13:24 +01:00
Luca Deri
691778df33
Cosmetic fixes
2020-01-06 22:25:20 +01:00
Luca Deri
81c3f5813c
Added check to avoid double allocations with retransmitted packets
2020-01-06 21:27:51 +01:00
Luca Deri
fdf402d027
Added missing RPM files
2020-01-06 18:20:52 +01:00
Luca Deri
f0014a5a24
Removed TLS debug code that could have caused crashes
2020-01-05 21:28:35 +01:00
Luca Deri
53a5be3399
Added packet boundary checks
2020-01-05 20:58:16 +01:00
Luca Deri
f389969c0b
Use share instead of sbin for sample files
...
Fixes #826
2020-01-05 18:50:56 +01:00
Luca Deri
dc02afa3ea
Merge pull request #825 from aouinizied/fix_python_bindings
...
Update Python cffi bindings.
2020-01-05 18:47:43 +01:00
Luca Deri
d1fb41a161
Minor cleanup
2020-01-05 18:42:36 +01:00
Luca Deri
ef16591f3f
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2020-01-05 18:25:44 +01:00
Luca Deri
29dd45838d
Updated (C)
2020-01-05 18:24:58 +01:00
emanuele-f
798bb6e2e1
Fix leaks and sha1 certificate detection
2020-01-02 14:39:51 +01:00
emanuele-f
2332cbfefe
Fix invalid free on non-tls flows
2020-01-02 14:10:21 +01:00
emanuele-f
a58a135758
Add fingerprint_set flag
2020-01-02 12:56:25 +01:00
Luca
634457615c
Updated TLS support
2020-01-02 10:47:23 +01:00
Luca
cb825766ea
Minor changes
2020-01-02 10:37:53 +01:00
Luca
8b01056b21
Renamed TLS requested server name
2020-01-02 07:37:03 +01:00
Luca
f6c7a33177
Added TLS test
2020-01-01 21:27:18 +01:00
Luca
daae1cc9b1
Reworked TLS dissection
2020-01-01 12:59:19 +01:00
Luca Deri
499c80535b
Minor fix
2019-12-29 22:27:48 +01:00
Luca
9fb3a57a71
Kerberos fixes
...
Minor TLS cleanup
2019-12-29 10:45:42 +01:00
Luca
257ec7cc5f
Removed disable_metadata_export preference that is no longer useful
...
since ndpi_process_extra_packet() can drive limited or full metadata export
2019-12-29 08:07:35 +01:00
emanuele-f
73c7ccdb65
Fix crash in ndpi_fill_ip_protocol_category when both saddr and daddr are 0
...
In this corner case, the "prefix" variable was not initialized leading to a failed assertion and crash:
ndpi_patricia_search_best2: Assertion `prefix->bitlen <= patricia->maxbits' failed.
2019-12-23 15:20:09 +01:00
Zied Aouini
cffb11fbc9
Update ndpi_flow_struct definition.
2019-12-23 11:22:23 +01:00
Luca Deri
23421b47d9
Added snprintf() return code check
2019-12-18 19:49:46 +01:00
Luca Deri
1cab9fe838
Fix for custom protocol detection
2019-12-18 19:35:40 +01:00
Luca Deri
27ea04c08e
Merge pull request #824 from catenacyber/stunfix
...
Fix read buffer overflow in stun
2019-12-18 19:29:23 +01:00
Luca Deri
5c225b8a2e
Merge pull request #821 from aouinizied/win32-lib-appveyor
...
Win32 lib appveyor
2019-12-18 19:22:12 +01:00
Luca Deri
4961241c62
Merge pull request #823 from haroflow/dev
...
Changed 13.64.0.0/11 range from Skype to Microsoft
2019-12-18 19:18:28 +01:00
Philippe Antoine
843204299c
Fix read buffer overflow in stun
2019-12-18 13:48:33 +01:00
Simone Mainardi
09cd95d54a
Fixes informative subprotocols
...
Wrongly marked subprotocols were causing issues on ntopng.
This fixes https://github.com/ntop/ntopng/issues/3129
2019-12-17 18:12:15 +01:00
Renan de Souza
1d3bef41a4
Added *whatsapp-*.fbcdn.net IPs as WhatsApp
2019-12-16 15:32:46 -03:00
Luca Deri
e21fe5d594
Added intrusion_detection.c in DPDK makefile
2019-12-16 17:56:08 +01:00
Renan de Souza
9133955219
Changed 13.64.0.0/11 range from Skype to Microsoft, blocking this range also blocks some azure-hosted websites
2019-12-16 10:50:19 -03:00
Zied Aouini
acb74905a5
Switch to dev branch.
2019-12-16 01:36:02 +01:00
Zied Aouini
ed3fff554a
Add Appveyor build status.
2019-12-16 01:34:42 +01:00
Zied Aouini
7ebe6a0c82
Add LDFLAGS for Win32.
2019-12-16 01:24:42 +01:00
Zied Aouini
87333aa68c
Add branch.
2019-12-16 01:19:37 +01:00
Zied Aouini
e593319ba0
Fix Win32.
2019-12-16 01:14:10 +01:00
Zied Aouini
812a3e7099
Add mingw host target
2019-12-16 01:11:55 +01:00
Zied Aouini
1097f5488d
Add .appveyor.yml
2019-12-16 01:10:26 +01:00
Zied Aouini
b90410e335
Add .gitattributes
2019-12-16 01:09:09 +01:00
Luca Deri
deed27cbef
Implemented nDPI timeline visualizer
2019-12-15 23:35:43 +01:00
Luca Deri
ea001b439a
TLS decoding improvements
2019-12-14 16:17:34 +01:00
Luca Deri
14e5adc7c2
Win fixes
2019-12-14 15:05:47 +01:00
Luca Deri
81012b3201
CSV output enhancements
2019-12-13 12:50:52 +01:00
Luca Deri
406aa12468
Fixed CSV output
2019-12-13 09:45:34 +01:00
Luca
2c2bb11c9b
Fixed output format
2019-12-11 11:27:00 +01:00
Luca Deri
1bd63d68a5
CSV export improvements
2019-12-11 09:45:14 +01:00
Luca Deri
bf5e9b7b0b
Fixed bug that prevented SMTP email to be dissected
2019-12-09 19:04:13 +01:00
Luca Deri
7fe9dddf65
Fixed invalid password report on telnet
2019-12-09 18:43:05 +01:00
Luca Deri
6d7f3976f3
Code cleanup
2019-12-09 18:02:48 +01:00
Luca Deri
65d526d8f6
Code cleanup
2019-12-09 15:28:44 +01:00
Luca Deri
56eeb965bf
Code cleanup
2019-12-09 13:10:21 +01:00
Luca Deri
c4d476cc58
Code improvements
2019-12-09 00:29:02 +01:00
Luca Deri
23b0b8625d
Minor changes to the IDS score calculation
2019-12-09 00:11:32 +01:00
Luca Deri
558983c99c
Merge pull request #813 from SimoneRicci97/dev
...
Fixed intrusion detection
2019-12-09 00:01:09 +01:00
Luca Deri
c8d6f2845f
Improved memory management in the kerberos dissector
2019-12-08 23:59:53 +01:00
Luca Deri
1a115cac5a
Merge pull request #817 from MrTiz9/dev
...
Integration of the libinjection library
2019-12-08 23:49:23 +01:00
Luca Deri
11401edfe7
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-12-08 23:47:25 +01:00
Luca Deri
239842b821
Major kerberos rework
2019-12-08 23:47:04 +01:00
MrTiz9
606ff10ecf
Integration of the libinjection library to detect SQL injections and XSS type attacks in HTTP requests
2019-12-05 18:09:43 +01:00
emanuele-f
d37b69ce9c
Fix corner case causing access to already freed memory
2019-12-04 18:36:54 +01:00
emanuele-f
226a9abf22
Additional memory bounds checks
2019-12-04 18:34:08 +01:00
emanuele-f
f26096ee4c
Fix reversed offset check
2019-12-04 15:20:49 +01:00
emanuele-f
2b3ef7e762
Fix invalid memory access
2019-12-04 14:21:04 +01:00
emanuele-f
d62526f9ed
Fix invalid reads and add valgrind test
2019-12-04 13:06:05 +01:00
Luca Deri
e66d7216b8
Removed header space with JSON serialization
2019-12-04 10:52:51 +01:00
Luca Deri
fbc59c5f81
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-12-01 22:27:26 +01:00
Luca Deri
32dc9e3225
Refreshed Whatsapp server list
2019-12-01 22:26:57 +01:00
Luca Deri
b4468239b9
Merge pull request #814 from aouinizied/python_cffi_bindings
...
Implement cffi bindings.
2019-12-01 21:56:10 +01:00
Luca Deri
95c1282ef4
Improved categories with streaming
2019-12-01 21:52:28 +01:00
Luca Deri
a7b0457753
Improved category detection with HTTP
2019-12-01 21:40:04 +01:00
Luca Deri
7da7ae622b
Improvements to stop dissection when the first protocol is detected
...
Used IP-based detection to compute the application protocol
Improved application detection
2019-11-28 23:20:40 +01:00
aouinizied
a95cfcc989
Implement cffi bindings.
2019-11-28 03:09:13 +01:00
Simone Ricci
a65c959940
Fixed intrusion detection
2019-11-26 21:20:22 +01:00
Luca Deri
d328c3bccc
Overflow fix
2019-11-26 17:58:49 +01:00
Luca Deri
8368568443
Added buffer overflow check in smpp dissector
2019-11-26 17:45:08 +01:00
Luca Deri
c223bb1f10
Fixed buffer overflow in DNS dissection
2019-11-26 17:42:59 +01:00
Luca Deri
c7efd0892f
Fixed buffer overflow in amazon video dissector
2019-11-26 17:30:36 +01:00
Luca
ae9429408b
Added webattacj results
2019-11-25 18:40:14 +01:00
Luca Deri
0ce56d5714
Updated results
2019-11-23 19:55:06 +01:00
Luca Deri
509cfcb556
Fixed invalid category matching in HTTP
...
Fixed overlapping categories
2019-11-23 19:54:06 +01:00
Luca Deri
3b203d57e9
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-11-23 13:28:15 +01:00
Luca Deri
68d66b780c
Added new test pcaps
...
Renamed protocol 104 to IEC60870 (more meaningful)
2019-11-23 13:27:34 +01:00
Luca Deri
f94d6cca7d
Memory fixes
2019-11-23 12:14:52 +01:00
Luca Deri
382217887b
Nested encapsulation dissection
2019-11-23 11:53:00 +01:00
Luca Deri
537c11a985
Fixes for uninitialized variables
2019-11-23 11:39:23 +01:00
Luca Deri
bdc0719e76
Added auth failed support with FTP
2019-11-21 23:31:52 +01:00
Luca Deri
fc82cdfa4a
Implemented telnet password export
2019-11-21 19:36:01 +01:00
Luca Deri
e98b994a39
Updated results
2019-11-21 13:35:04 +01:00
Luca Deri
a58c838c4c
Added flow duration and goodput in output (-v and -c)
2019-11-21 13:31:56 +01:00
Luca Deri
f91f2c57ef
Fixed skype/soom false positives
2019-11-20 23:28:24 +01:00
emanuele-f
68b7986d9b
Expose API to calculate the MD5 hash
2019-11-20 11:57:21 +01:00
Alfredo Cardigliano
ead0325deb
Rounding up serializer buffer to be divisible by 4 (required by zmq encryption)
2019-11-19 19:03:06 +01:00
emanuele-f
0b819badd2
Possible leak fix
2019-11-19 11:42:04 +01:00
Simone Mainardi
3754e6dd12
Fixes crash when searching kerberos usernames
...
Fixes
(gdb) f 0
101 if(cname_str[cname_len-1] == '$') {
(gdb) p cname_len
$3 = 0
2019-11-19 11:34:34 +01:00
Luca Deri
da029607a0
Removed (unreliable) line protocol detection
2019-11-18 21:21:52 +01:00
Luca Deri
803dc6ff77
Minor fix
2019-11-17 22:42:32 +01:00
Luca Deri
65a629304c
Kerberos dissection improvements
2019-11-17 22:35:10 +01:00
Luca Deri
51cfdfb0d8
Removed unused JSON-C code
2019-11-17 17:51:45 +01:00
Luca Deri
53108c9ff1
Merge pull request #811 from aouinizied/python_bindings_fix
...
Python bindings fix and improve
2019-11-15 19:51:15 +01:00
aouinizied
82a186e096
Polish.
2019-11-15 19:30:50 +01:00
aouinizied
e467fe9aa6
Improve python bindings.
2019-11-15 19:18:30 +01:00
Luca Deri
7a1940e1f7
Modified Diameter category to network
...
Updated test results
2019-11-14 15:13:13 +01:00
Alfredo Cardigliano
6b7c56c909
New ndpi_serialize_string_boolean/ndpi_serialize_uint32_boolean
2019-11-13 18:16:44 +01:00
Luca
470d30ac23
Fixed SQL Injection detection
2019-11-13 17:37:48 +01:00
Luca
7e87bfd039
Added support of default /32 in ndpi_load_ipv4_ptree()
2019-11-12 16:37:18 +01:00
Luca Deri
ab9ccf9eb9
Fixed new nDPi API
2019-11-12 12:28:34 +01:00
Luca Deri
15ec013af8
Added ndpi_load_ipv4_ptree() API call
2019-11-11 23:52:24 +01:00
emanuele-f
748f10c0d6
Fix possible crash due to unsigned int number wrapping
2019-11-11 10:18:55 +01:00
Luca Deri
8181d63a95
Added ndpi_init_detection_module() API preferences
2019-11-10 22:57:21 +01:00
Luca
d0e7e69552
Renamed DNSoverHTTPS to handle bot DoH and DoT
2019-11-08 09:23:52 +00:00
Luca
0558d641f2
Added ndpi_finalize_initalization() initialization function
2019-11-07 19:28:16 +00:00
Alfredo Cardigliano
ac46a4dd58
Added L2TP tunnel type. Warning fix.
2019-11-06 09:55:22 +01:00
Luca
fb56b042c0
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-11-05 12:15:27 +00:00
Luca
6298ecc271
Added tunnelling decapsulation
2019-11-05 08:21:31 +00:00
Luca Deri
a26fe08aa6
Updated results
2019-11-04 22:11:33 +01:00
Luca Deri
5b2c0f68fe
Telnet fix
2019-11-04 22:06:02 +01:00
Luca Deri
e695dd6ead
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-11-03 17:15:48 +01:00
Luca Deri
953571e3d8
Added comment
2019-11-03 17:15:40 +01:00
Luca Deri
01455c3188
Merge pull request #808 from oleg-umnik/dev
...
Change type
2019-11-03 17:15:06 +01:00
Luca Deri
a5210af823
Merge pull request #807 from oleg-umnik/fix_3
...
Align CSV header with actual row data
2019-11-03 17:14:38 +01:00
Luca Deri
9e42b525ec
Merge pull request #806 from oleg-umnik/fix_1
...
Don't leak memory in live capture mode
2019-11-03 17:13:49 +01:00
Luca Deri
02d69b72f5
Merge pull request #803 from haroflow/dev
...
Updated Breed's descriptions in ndpi_get_proto_breed_name
2019-11-03 17:13:18 +01:00
Luca Deri
c998e2e9ef
Merge pull request #802 from AndrewKarelin/dev
...
Added some public DNSoverHTTPS servers
2019-11-03 17:07:17 +01:00
Luca Deri
a3a85106a1
Implemented SQL Injection and XSS attack detection
2019-11-01 23:05:11 +01:00
Luca
75302a10bd
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-31 09:31:42 +01:00
Luca
2ab0433aca
Updated content-type parsing
2019-10-31 09:31:26 +01:00
Luca
e272db0f7f
content type parsing fix
2019-10-31 09:15:57 +01:00
Luca Deri
3580765ba3
Updated result
2019-10-31 09:04:52 +01:00
Luca
cb79d89f83
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-31 08:58:03 +01:00
Luca
2e178d0f05
Improved libary initialization for custom protocols
2019-10-31 08:57:33 +01:00
Luca Deri
edf0b171e2
Merge pull request #810 from catenacyber/fuzztarget
...
Adds fuzz target
2019-10-31 08:54:44 +01:00
Philippe Antoine
148506ede8
Adds fuzz target
...
And configur option enable-fuzztargets
2019-10-31 08:37:42 +01:00
Luca
c0a08d9ca2
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-31 00:14:40 +01:00
Luca
4802987178
Initial work towards HTTP content-type export
2019-10-31 00:14:20 +01:00
Luca Deri
1cd7cf9990
Merge pull request #809 from catenacyber/fuzz1fix
...
Fix buffer over read in ndpi_handle_ipv6_extension_headers
2019-10-30 17:31:28 +01:00
Philippe Antoine
4830755fac
Fix buffer over read in ndpi_handle_ipv6_extension_headers
2019-10-30 17:18:21 +01:00
Renan de Souza
124545e1ed
Added twitch.tv website
2019-10-29 16:26:17 -03:00
Luca
af01e61c89
Fixed invalid guess with the top defined protocol
2019-10-29 19:45:15 +01:00
Renan de Souza
9400a3b9ef
Added ranges 20.180.0.0/14, 20.184.0.0/13 to Skype
2019-10-29 15:28:08 -03:00
Luca
6e314ea6d7
Added zabbix dissector
2019-10-29 19:25:46 +01:00
Oleg A. Arkhangelsky
dfd962a8bc
Change type
...
Use double type instead of float when printing time for CSV file.
Float type is too small for 64 bit int time so cast corrupts value.
2019-10-29 21:23:42 +03:00
Oleg A. Arkhangelsky
cfcbfe1e8f
Align CSV header with actual row data
2019-10-29 21:20:56 +03:00
Luca
0e54f87b18
Added telnet dissector
...
Improved data report
2019-10-29 19:12:42 +01:00
Oleg A. Arkhangelsky
9f5e5b90e5
Don't leak memory in live capture mode
2019-10-29 21:11:31 +03:00
Renan de Souza
d619ba0857
Merge remote-tracking branch 'upstream/dev' into dev
2019-10-29 14:59:18 -03:00
Renan de Souza
fbea243e56
Added brasilbandalarga.com.br and .eaqbr.com.br as EAQ on host_match[]
2019-10-29 11:48:23 -03:00
Renan de Souza
d062386656
Added ^pastebin.com to host_match[]
2019-10-29 09:54:42 -03:00
Luca Deri
d2f04f5bdf
Fixed prototype
2019-10-29 10:32:13 +01:00
Luca Deri
42c8d3ac27
Added ability to defien custom protocols
2019-10-29 10:29:12 +01:00
Luca Deri
d53563ab46
Implemented Microsoft range
2019-10-28 00:15:51 +01:00
Luca Deri
3d5f0ee315
Implemented stacked DPI decoding
2019-10-27 23:20:56 +01:00
Luca Deri
ecdb7cdc55
Various improvements in particular for CapWAP and Bloomberg
2019-10-27 23:05:24 +01:00
Luca Deri
fd38b752c4
Added capwap support
2019-10-27 19:03:23 +01:00
Luca Deri
64804a2a24
Fixed some false positivies with skype and stun-based protocols
2019-10-27 12:23:57 +01:00
Luca Deri
b603cb4530
nDPI TLS improvements using the server certificate
2019-10-26 10:54:32 +02:00
Luca Deri
8f2c7c0638
Code cleanup
2019-10-26 08:28:14 +02:00
Luca Deri
044ba7697a
Improved guess
2019-10-25 16:02:44 +02:00
Luca Deri
e6bd64b3ea
Improved HTTP reporting in ndpiReader
2019-10-25 15:56:47 +02:00
Renan de Souza
56db916833
Merge remote-tracking branch 'upstream/dev' into dev
2019-10-25 08:57:49 -03:00
Luca Deri
12cf0c4763
Further SMB improvements
2019-10-25 07:22:29 +02:00
Luca Deri
0a92e0f532
Ficed invalid SMBv1 detection
2019-10-25 07:00:57 +02:00
Luca Deri
e6f9177fdb
SSH dissection improvements
2019-10-25 00:05:18 +02:00
Luca Deri
c3f6a4a57a
SMTP and SSH dissection fixes
2019-10-24 23:28:32 +02:00
Renan de Souza
653c209253
Added 52.84.0.0/14 range as Amazon
2019-10-24 14:50:54 -03:00
Luca Deri
0974075fa0
Major cleanup
...
Removed ndpi_pref_http_dont_dissect_response and ndpi_pref_dns_dont_dissect_response as the ndpi_extra_dissection_possible() call will now handle everything
2019-10-24 19:48:55 +02:00
Renan de Souza
53e1ee3475
Changed Breeds descriptions in ndpi_get_proto_breed_name: Dangerous to Potentially Dangerous, added Dangerous (SMBv1)
2019-10-24 14:43:10 -03:00
Andrew Karelin
46affea055
Added some public DNSoverHTTPS servers
...
List of servers taken from https://github.com/curl/curl/wiki/DNS-over-HTTPS
2019-10-23 18:47:51 +05:00
Luca Deri
0ffe5cf1ff
Added extra processing for POP and SMTP
2019-10-22 00:57:35 +02:00
Luca Deri
d023f9bf2d
Silenced TLS warning
2019-10-21 15:33:20 +02:00
Alfredo Cardigliano
b2832cee8e
rpm-sign fix for centos8
2019-10-21 09:26:40 +02:00
Luca Deri
960aa77b6d
Reworked email metaata extraction
2019-10-21 01:27:07 +02:00
Luca Deri
58daa5ed7d
Added POP3 metadata extraction
2019-10-20 23:06:05 +02:00
Luca Deri
437e8bd706
Implemented IMAP data extraction
2019-10-20 22:46:08 +02:00
Luca Deri
1a5c7daaf6
Implemented FTP user/pwd extraction
2019-10-20 21:49:45 +02:00
Luca Deri
c1ba4764b5
Merge pull request #799 from ntop/ndpi_memleak_fix
...
Fix memory leak in ndpiReader.
2019-10-20 11:47:13 +02:00
Ravi Kerur
7cb3cb7353
Fix memory leak in ndpiReader.
...
Changes in library for strict function prototype.
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-10-19 08:59:48 -07:00
Alfredo Cardigliano
604abaf81c
Disabled debug_package
2019-10-18 12:30:42 +02:00
Luca Deri
8b157bb13f
Ports are not JSON printed when 0 (e.g. with ICMP)
2019-10-17 00:38:42 +02:00
Luca Deri
a8c71dcd20
Improved ndpi_flow2json
2019-10-17 00:29:30 +02:00
Alfredo Cardigliano
363a8f6282
Checking gmtime_r return value
2019-10-16 07:54:33 +02:00
Luca Deri
5b314cf1c3
Updated ndpi_flow2json
2019-10-16 12:31:41 +02:00
Luca Deri
02783bd7c6
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-15 23:06:41 +02:00
Luca Deri
d5c918d258
Initial implementation of ndpi_flow2json APi call
2019-10-15 23:06:30 +02:00
emanuele-f
6b044335cd
Implement nDPI patricia tree API
2019-10-15 01:22:17 +02:00
Luca Deri
cbe20d3740
Fixes for API changes
2019-10-09 22:25:40 +02:00
Luca Deri
21bc84e837
Modified API signatures for
...
- ndpi_ssl_version2str()
- ndpi_detection_giveup()
2019-10-09 22:09:58 +02:00
Luca Deri
203359ed7f
Fixed ndpi_ssl_version2str()
2019-10-08 23:57:56 +02:00
Luca Deri
24a26a2e94
Added NetBIOS metadata export
2019-10-08 23:40:56 +02:00
Luca Deri
0a7521060a
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-08 13:32:43 +02:00
Luca Deri
6b5a9aa992
Implemented Kerberos metadata extraction
2019-10-08 13:32:21 +02:00
emanuele-f
2dfdaa4d70
Replace strtok with reentrant version
2019-10-08 11:59:20 +02:00
emanuele-f
f2504494fe
New API functions: ndpi_load_categories_file and ndpi_load_category
2019-10-08 11:55:47 +02:00
Luca Deri
256858d2e5
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-08 11:36:11 +02:00
Luca Deri
10873bfe35
Added ndpi_get_l4_proto_name() and ndpi_get_l4_proto_info() API calls to print L4 protocol
2019-10-08 11:35:33 +02:00
emanuele-f
e939f1c1d1
Fix leaks in ndpi_load_hostname_category when ac_automata_add fails
2019-10-08 11:07:59 +02:00
emanuele-f
b2c8cb655c
ndpi_load_hostname_category now performs strdup on the name argument
...
This simplifies the API as an application is not required to keep references to the strings to free
2019-10-08 10:23:00 +02:00
emanuele-f
4bdbf02c2d
Fix invalid memory accesses
2019-10-04 14:35:51 +02:00
Luca Deri
f83b2a0940
Fixed ndpi_extra_dissection_possible()
2019-10-04 14:13:53 +02:00
emanuele-f
76ec74cbf1
Fix out of bounds read in ndpi_match_custom_category
2019-10-04 11:54:05 +02:00
Luca Deri
8ae5da1472
Moved to 3.1 release
2019-10-04 07:45:57 +00:00
Luca Deri
d8067cdc1d
Extended changelog for v3
2019-10-04 09:42:43 +02:00
Luca Deri
67dbcb7375
Fixed invalid network searchthat caused categories to be set randomly
2019-10-04 07:19:20 +00:00
Luca Deri
3180f279c8
Merge pull request #792 from ntop/ndpi_streaming
...
Move Hulu and Disney+ to category match.
2019-10-03 22:35:31 +02:00
Simone Mainardi
1982e6cef9
Adds nDPI 3.0 changelog
2019-10-03 20:04:26 +02:00
emanuele-f
d2f0a8d493
Add missing results
2019-10-03 16:26:14 +02:00
emanuele-f
37cb113c45
Handle TCP DNS replies and add is_reply flag
2019-10-03 16:19:15 +02:00
emanuele-f
04a97fa72b
Fix DNS reply dissection issues
2019-10-03 15:52:55 +02:00
Ravi Kerur
8897aa6acb
Move Hulu and Disney+ to category match.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-10-02 20:03:18 -07:00
Luca Deri
c247a9d191
Code cleanup
2019-10-02 23:25:05 +02:00
Luca Deri
4fd7e5734a
Manual merge of pull #769
2019-10-02 23:01:29 +02:00
Luca Deri
3dbf7bbabb
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-10-02 20:58:02 +02:00
Luca Deri
8f20e482ce
Improved Viber protocol dissection
...
Added Hulu dissection
2019-10-02 20:57:17 +02:00
Luca Deri
329a33ed59
Merge pull request #791 from ntop/ndpi_hs
...
Fix crash due to recent code changes when using hyperscan and mining_…
2019-10-02 20:50:19 +02:00
Ravi Kerur
77edf1f680
Fix crash due to recent code changes when using hyperscan and mining_hosts.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-10-02 09:32:39 -07:00
emanuele-f
7f510c10fe
Fix double free after b19bfa1e20
2019-10-02 16:26:52 +02:00
Luca Deri
a559ba20b1
Merge pull request #790 from emanuele-f/managed_strings
...
Fixes leaks in ndpi_add_host_url_subprotocol
2019-10-02 15:30:33 +02:00
emanuele-f
b19bfa1e20
Fixes leaks in ndpi_add_host_url_subprotocol
...
It is now possible to deallocate strings in ac_automata_release via
an additional parameter
2019-10-02 14:02:19 +02:00
Luca Deri
6a22bee2ca
Added URL in results
2019-10-01 12:26:15 +02:00
Luca Deri
e45237a93f
Removed http:// from HTTP url
...
Reported URL in ndpiReader
2019-10-01 12:25:39 +02:00
Luca Deri
a62cf10233
Added SSH handling in ndpi_extra_dissection_possible()
2019-09-30 23:23:52 +02:00
Luca Deri
1361c8fbdf
Updated the logic of ndpi_is_subprotocol_informative()
2019-09-30 17:28:41 +02:00
Luca Deri
f2a5bbef17
Reworked categories handling
...
Removed GenericProtocol and replaced with categories
Removed ndpi_pref_enable_category_substring_match option: substring matching is now default
2019-09-29 21:46:41 +02:00
Luca Deri
016d568c2b
Merge pull request #787 from bohmax/explanation-file
...
Adding explanation file
2019-09-29 18:32:46 +02:00
bohmax
02609114d3
Add files via upload
2019-09-29 11:10:46 +02:00
Luca Deri
53ea3481ea
Fixed ICMP parsing bug introduced by pull #770
2019-09-29 08:10:12 +02:00
Luca Deri
59b8399923
Merge pull request #778 from choyos/dev
...
Added support for dissection of DNP3 and IEC104 protocols
2019-09-29 08:02:49 +02:00
Luca Deri
3b06d2191c
Merge pull request #770 from ntop/ndpi_icmp
...
Add icmp and icmp6 to calculate splt and bd values.
2019-09-29 07:59:02 +02:00
Luca Deri
e9df2b187c
Merge pull request #786 from ntop/ndpi_ac_vpn
...
Add Cisco anyconnect VPN signature.
2019-09-29 07:58:27 +02:00
Ravi Kerur
bc1b266174
Add Cisco anyconnect VPN signature.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-28 19:52:53 -07:00
Luca Deri
b0c68dc29b
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-09-27 17:35:08 +02:00
Luca Deri
c839dcb74c
Improved category handlign in subprotocols
...
Further DNS dissection fixes
Fixed WeChat invalid category
2019-09-27 17:34:22 +02:00
emanuele-f
05aa27e477
Add test for custom categories match on HTTP and SSL flows
2019-09-27 14:01:12 +02:00
Luca Deri
7c788f0779
Fixed partial string matches
2019-09-27 13:42:41 +02:00
emanuele-f
5099646938
Fix missing strdup on ndpi_load_hostname_category
2019-09-27 12:09:51 +02:00
emanuele-f
277b4a060a
Add categories test PCAP
2019-09-27 10:15:20 +02:00
Luca Deri
17f560a1cd
Added ndpi_extra_dissection_possible() API call
2019-09-26 23:50:02 +02:00
Luca Deri
194cdcf581
Fixed false positive with STUN detection
2019-09-26 22:18:56 +02:00
Luca Deri
7de9fd7170
Updated instagram check
2019-09-26 22:08:21 +02:00
Luca Deri
0e9918464b
Added Zoom protocol support removing invalid STUN/Skype detections
2019-09-26 21:52:42 +02:00
Luca Deri
ce40155377
Merge pull request #783 from ntop/ndpi_ps_vue
...
Ndpi ps vue
2019-09-26 19:37:49 +02:00
emanuele-f
4dc60f151d
Restructure DNS search code
2019-09-26 13:20:13 +02:00
emanuele-f
937dcb38ea
Fix bad protocols returned in ndpi_detection_giveup when detection is already complete
2019-09-26 12:15:49 +02:00
Ravi Kerur
4170eb3a1d
Modified logic and test pcap file included.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-25 16:21:22 -07:00
Ravi Kerur
c3a5650071
Initial PS_VUE support based on public IP.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-25 15:20:19 -07:00
Luca Deri
62fa0908a3
Improved packet datastructure cleanup after packet processing
...
Cleaned up code of steam dissector
Added steam test pcap
2019-09-25 23:59:22 +02:00
Ravi Kerur
d2c0b9872d
Initial Zoom detection based on IP and ports.
...
Following IP and ports are reported by Zoom support
to open up in firewall.
https://support.zoom.us/hc/en-us/articles/201362683-Network-Firewall-or-Proxy-Server-Settings-for-Zoom
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-25 12:59:34 -07:00
Alfredo Cardigliano
3709e673d9
New serializer APIs ndpi_serialize_start_of_block / ndpi_serialize_end_of_block (JSON only)
2019-09-25 17:19:33 +02:00
Luca Deri
0b62c0ad45
Merge pull request #781 from marco-testa/dev
...
Update dissector stun.c
2019-09-24 16:39:46 +02:00
Luca
0ed679e795
Improves IAT calculation
2019-09-24 16:37:42 +02:00
marco-testa
b706730e10
Loaded in the wrong place
2019-09-24 09:45:34 +02:00
marco-testa
bd83847027
Changed the packets handling with STUN msg_type > 0x000C and other fixes.
...
Eliminated double call to the ndpi_int_stun_add_connection function.
2019-09-24 09:43:47 +02:00
marco-testa
d3348ff730
Changed the packets handling with STUN msg_type > 0x000C and other fixes.
...
Eliminated double call to the ndpi_int_stun_add_connection function.
2019-09-24 09:41:58 +02:00
Ravi Kerur
e29032085d
Merge branch 'dev' of https://github.com/ntop/nDPI into ndpi_icmp
2019-09-23 17:06:43 -07:00
Luca Deri
19dbcaa3a9
Fixes #777
2019-09-23 18:04:55 +02:00
Luca Deri
3f56b2476a
Merge pull request #780 from bohmax/fix_wrap
...
Fix wrap
2019-09-23 17:48:02 +02:00
bohmax
8246467022
Add files via upload
2019-09-23 17:40:34 +02:00
bohmax
90c28e9d63
Delete ndpi_typestruct.py
2019-09-23 17:40:16 +02:00
Luca Deri
64513b1c0e
Rewritten qq dissector
2019-09-23 17:39:58 +02:00
Ravi Kerur
e8d501158e
Restore protocol extraction to original method.
...
Add microseconds to time series if milliseconds returns 0.
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-21 10:38:04 -07:00
Ravi Kerur
d92015a092
Merge branch 'dev' of https://github.com/ntop/nDPI into ndpi_icmp
2019-09-21 10:16:10 -07:00
Luca Deri
5c2e495792
ndpiReader now report protocol category and breed
...
Modified TikTok category to Fun
2019-09-21 09:52:44 +02:00
Luca Deri
421f819b8a
Added signal test pcap
2019-09-21 09:40:20 +02:00
Luca Deri
ab9246f51f
Adedd DTLS check in STUN
...
Uodated (C)
2019-09-21 09:16:56 +02:00
Ravi Kerur
e2e05cd499
Merge branch 'dev' of https://github.com/ntop/nDPI into ndpi_icmp
2019-09-20 10:54:58 -07:00
Luca
bdcc6dc173
STUN protocol dissector code cleanup
2019-09-20 18:47:39 +02:00
Luca
f9716c5139
Unified WhatsApp Video and Audio under WhatsAppCall
2019-09-20 17:37:41 +02:00
choyos
bae36d2e25
added dnp3 and iec104 pcaps for tests
2019-09-20 13:35:46 +02:00
choyos
cbda4c2af1
Added support for industrial protocols DNP3, IEC 60780-5-104
2019-09-20 13:29:49 +02:00
Luca
f678486393
Improved STUN-based protocol heuristic both in terms of accuracy and packets necessary for the detection
2019-09-20 07:29:02 +02:00
emanuele-f
518df786ed
Add ndpi_parse_ip_string and ndpi_get_ip_string API
2019-09-19 16:08:47 +02:00
Luca Deri
16da3f58cc
Fixed JA3C compuration wtih SSL (no TLS) traffic
2019-09-19 00:01:44 +02:00
Luca Deri
cf0ca7db51
Improved STUN caching
2019-09-18 23:31:25 +02:00
Luca Deri
0d8a161d15
Further line update
2019-09-18 23:24:41 +02:00
Luca Deri
487110693c
Line protocol update
2019-09-18 23:23:13 +02:00
Luca Deri
3287dfbff4
Added dissection of TLS version in supported_versions of Hello packets
2019-09-18 14:20:01 +02:00
Luca Deri
ac1f7d71dd
New instagram testing set
2019-09-18 12:23:55 +02:00
Luca Deri
a716d5a317
Improved Line protocol heuristic
2019-09-18 12:14:23 +02:00
Ravi Kerur
7e3fd16b0d
Merge branch 'dev' of https://github.com/ntop/nDPI into ndpi_icmp
2019-09-17 17:01:17 -07:00
emanuele-f
e152e687a5
Fix notBefore/notAfter broken in previous commit
2019-09-17 18:43:11 +02:00
emanuele-f
10e560a508
Fix notBefore/notAfter issues
2019-09-17 18:09:17 +02:00
Luca Deri
2fc68a441d
Improved -C output
2019-09-17 12:07:00 +02:00
Luca Deri
64ed0ac6b3
Various STUN improvements
2019-09-17 00:11:17 +02:00
Ravi Kerur
ce79626679
Merge branch 'dev' of https://github.com/ntop/nDPI into ndpi_icmp
2019-09-16 13:56:17 -07:00
Luca Deri
8f4e8d8254
Code cleanup
2019-09-15 22:56:55 +02:00
Luca Deri
62c9766cc1
Warnign fix
2019-09-15 22:43:43 +02:00
Luca Deri
f0013e826e
Added python bindings for nDPI
2019-09-15 22:32:18 +02:00
Luca Deri
5fd79567f0
Merge pull request #767 from LocutusOfBorg/fix-cross-ftbfs
...
Fix cross-build from source, because of direct pkg-config check calls
2019-09-15 20:57:13 +02:00
Luca Deri
11e9fd8cef
As TLS certificate fingerprint is computed, TLS without certificate protocol has been removed
...
Various improvemenets in detection quality
2019-09-15 12:18:24 +02:00
Luca Deri
2b0945b88d
TLS disection improvements
2019-09-15 10:56:08 +02:00
Ravi Kerur
23780a655d
Fix protocol for v4 and v6.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-14 18:38:18 -07:00
Ravi Kerur
9f83bf4624
Add icmp and icmp6 to calculate splt and bd values.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-09-14 10:06:37 -07:00
Luca Deri
00e639d513
TLS certificate hash is not reported
2019-09-14 15:00:52 +02:00
Luca Deri
659f75138c
TLS cerficate hash calculation
2019-09-14 12:38:58 +02:00
Alfredo Cardigliano
d7c2ced475
Fix ndpi_serializer_rollback_snapshot with single records
2019-09-11 20:04:32 +02:00
Helmut Grohne
2e01a1fe53
Fix cross-build from source, because of direct pkg-config check calls
...
ndpi fails to cross build from source, because configure.seed hard codes
the build architecture pkg-config. It is best to use PKG_CHECK_MODULES
instead. Please consider applying the attached patch.
See: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=939286
2019-09-11 19:11:42 +02:00
Luca Deri
e687a73cb2
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-09-11 17:14:52 +02:00
Luca Deri
6966e0d19b
Added STUN check to avoid false positives
...
Added fingerprint comments in SSH/TLS
Added netflow test pcap
2019-09-11 17:13:49 +02:00
Alfredo Cardigliano
7d9ed162c7
Optimized memory utlization resizing serialization buffer buffer
2019-09-11 16:32:40 +02:00
Alfredo Cardigliano
848c9db4fb
Added ndpi_init_serializer_ll() to specify low-level settings for optimizing memory allocations
2019-09-11 16:10:18 +02:00
Alfredo Cardigliano
16fe2574b1
Fix ndpi_serializer_rollback_snapshot with JSON
2019-09-11 11:32:11 +02:00
Luca Deri
c3c975a51a
Renamed snapshot API call
2019-09-11 09:45:29 +02:00
Alfredo Cardigliano
a265b50a66
Support for nDPI serializer snapshot set/reset
2019-09-10 20:24:36 +02:00
Luca Deri
67a1455619
ndpi_serializer_set_buffer_len() fix
2019-09-10 23:55:00 +02:00
Luca Deri
844e2bab3b
warnng fix
2019-09-10 22:46:37 +02:00
Luca Deri
b1583cc29e
Added ndpi_serializer_set_buffer_len() API call
2019-09-10 22:45:52 +02:00
Luca Deri
0f9107bef3
Fixed timezone conversion
2019-09-10 22:15:23 +02:00
Luca Deri
068611e8ba
Changes in validity format
2019-09-10 21:44:42 +02:00
Luca Deri
1f417fe67d
Validity format fix
2019-09-10 21:44:04 +02:00
Alfredo Cardigliano
8186b72c11
Added ndpi_deserialize_clone_all to the public API
2019-09-10 19:30:52 +02:00
Alfredo Cardigliano
4c0cc80771
New API ndpi_deserialize_clone_all to clone an record from TLV to a different format (e.g. JSON)
2019-09-10 18:57:28 +02:00
Alfredo Cardigliano
9c8c165a2c
Added ndpi_deserialize_clone to the public API
2019-09-10 17:32:13 +02:00
Alfredo Cardigliano
84ce1861a2
New API ndpi_deserialize_clone to clone an element from a deserialized TLV to another TLV
2019-09-10 17:30:15 +02:00
Alfredo Cardigliano
990d06d10c
TLC EOR/Unknown items size
2019-09-10 16:40:29 +02:00
Alfredo Cardigliano
3e1c811780
Added ndpi_deserialize_get_format() to read the serialization format
2019-09-10 15:02:02 +02:00
Alfredo Cardigliano
b96b618443
nDPI serialization: uint key compression, new deserialization API
2019-09-10 14:47:47 +02:00
Luca Deri
65bdd0de9a
Uddated results
2019-09-10 00:43:03 +02:00
Luca Deri
086c511a11
Parsed TLS certificate validity
2019-09-10 00:34:48 +02:00
Luca Deri
c5fffce96c
Added IMO dissector
...
Fixed TLS/UDP detection
Reduced UBNT buffer for saving space
2019-09-09 21:17:53 +02:00
Luca Deri
d457b07f9f
Refreshed Tor node list
2019-09-08 21:42:33 +02:00
Luca
a0a8149833
Skype STUN enhancements
2019-09-06 10:41:53 +02:00
Luca
241cfb319b
Enhanced Signal detection
2019-09-05 10:45:08 +02:00
Luca
9b80c6314d
Enhanced STUN cache
2019-09-05 10:23:07 +02:00
Luca Deri
3d21c33409
Compilation fix when JSON-C is not present
2019-09-03 18:45:51 +02:00
Luca
b3c88a7e24
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-09-03 18:39:36 +02:00
Luca
886d575157
Added -C to generate CSV analysis files
...
Improved IAT and byte distribution
2019-09-03 18:38:54 +02:00
Alfredo Cardigliano
2a8f9c3a81
Return value fix in ndpi_deserialize_*
2019-09-03 11:44:32 +02:00
Alfredo Cardigliano
2cbad47d7b
Added vxlan header
2019-09-03 02:26:40 +02:00
Luca Deri
eb154bac69
Added ndpi_alloc_data_analysis APi call
2019-09-02 22:12:46 +02:00
Alfredo Cardigliano
ab178e62f5
Transparently handle int8/16 deserialization
2019-09-02 17:29:08 +02:00
Luca Deri
bc4c48fa0b
Added packetIDs with -P
2019-09-02 14:47:37 +02:00
Luca Deri
5d5d056849
Added payload memory free
2019-09-02 14:14:13 +02:00
Luca Deri
f1ad951bf6
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-09-02 14:00:45 +02:00
Luca Deri
d0436e7b29
Added new parameter to -P
2019-09-02 14:00:18 +02:00
Alfredo Cardigliano
2616dcb424
TLV signed int compression
2019-09-02 12:33:16 +02:00
Luca Deri
eb6afa17c0
Added ndpi_serialize_string_binary() call
2019-09-02 10:18:54 +02:00
Alfredo Cardigliano
77409a3833
TLV: encoding uint 32/64 as 16/8 bit whenever possible
2019-08-30 11:00:04 +02:00
Alfredo Cardigliano
49a02c9b96
TLV deserialization of uint16/uint8/int16/int8 when deserializing uint32/uint64/int32/int64
2019-08-30 10:31:54 +02:00
emanuele-f
1bf23dc2a8
Fix mangled stack by invalid sscanf
2019-08-29 22:40:29 +02:00
emanuele-f
fce2cd9817
Fix memory corruptions in ndpi_node handler
...
Crash occurred with clang version 6.0.0-1ubuntu2 on ubuntu 18
2019-08-29 20:13:19 +02:00
emanuele-f
2c4495e483
Add missing lib
2019-08-29 17:55:51 +02:00
emanuele-f
6781485c42
Warning fix
2019-08-29 16:49:44 +02:00
emanuele-f
d27e7e2786
Add missing pack_on on ajp struct
2019-08-29 16:47:33 +02:00
Luca Deri
68f6310222
AJP crash fix
2019-08-29 16:17:43 +02:00
Luca
c328452687
Average calculation fix
2019-08-29 16:08:18 +02:00
Luca Deri
536b520750
Added stub for ndpi_free_memory_at_termination() (TODO)
2019-08-29 15:47:34 +02:00
Luca Deri
8b8fd25626
Compilation fix on systems without JSON-C
2019-08-29 15:35:29 +02:00
emanuele-f
e98eb294c7
Add missing json cleanup
2019-08-29 15:25:52 +02:00
Luca
b1270fc7bb
Uodated results
2019-08-29 15:23:01 +02:00
Luca
9eb1676b4b
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-08-29 15:22:46 +02:00
emanuele-f
aea91781aa
Fix alignment issue on IPv6 structs
2019-08-29 14:50:17 +02:00
Luca
9a6f6d9fe4
Implemented IAT (Inter Arrival Time) stats
2019-08-29 13:40:44 +02:00
Luca
e4e40e3c70
Added entropy, average, stddev, variance, bytes ratio calculation
2019-08-28 14:02:39 +02:00
Luca Deri
84aeee49bd
Disable debug code
2019-08-27 10:45:33 +02:00
Luca Deri
6011790d79
Entropy calculation example
2019-08-27 10:44:41 +02:00
Luca
2acffb4163
Initial work towards traffic classification
2019-08-27 12:56:15 +02:00
Luca Deri
b837f3753d
SSH hash fix
2019-08-26 19:13:45 +02:00
Alfredo Cardigliano
d043cd2ac7
Serialization/deserialization of int32/int64/float with uint key
2019-08-26 12:55:23 +02:00
Alfredo Cardigliano
dbf8c24ecb
Fix ndpi_serialize_end_of_record in JSON mode
2019-08-24 03:08:07 +02:00
Alfredo Cardigliano
c50709a8d0
Fix ndpi_reset_serializer
2019-08-24 02:56:17 +02:00
emanuele-f
1231b81839
Add more length checks in HASSH
...
This to prevent possible crashes on invalid packets
2019-08-23 11:36:35 +02:00
Luca Deri
d2fe21ddff
Enhanced -P in ndpiReader so that it can now specify additional parameters
2019-08-22 23:42:07 +02:00
Luca Deri
2134f83948
Warning fixes
2019-08-22 20:04:15 +02:00
Luca Deri
3d3cae1f20
SSH test file
2019-08-22 19:36:36 +02:00
Luca Deri
1e8a43d51e
Merge pull request #758 from tansly/wireguard
...
Add support for WireGuard VPN
2019-08-22 19:31:51 +02:00
Luca Deri
e7c0ac37d8
Implemented HASSH ( https://github.com/salesforce/hassh )
2019-08-22 19:25:58 +02:00
Luca Deri
385e848a0f
Disabled weak (port-based) teamspeak detection
2019-08-22 15:37:31 +02:00
Luca Deri
9f42a4482a
Initial work workards payload analysis
2019-08-21 19:01:56 +02:00
Luca
fdeecf5d41
Implemented STUN cache to enhance matching of STUN-based protocols
2019-08-12 14:16:28 +02:00
Luca
51ac583d83
Improved google duo detection
2019-08-12 11:59:57 +02:00
emanuele-f
e226f99e4e
Fix possible intoaV4 1 byte overflow
2019-08-09 17:02:15 +02:00
emanuele-f
f73dc61ff8
Add NDPI_PROTOCOL_DANGEROUS classification
2019-08-09 10:04:56 +02:00
Luca
90547c4fd2
Added SMBv1 test file
2019-08-08 23:33:40 +02:00
Luca
c6e832be18
Various TLS/STUN improvememnts
2019-08-08 18:09:12 +02:00
Luca
cce8a6026f
Reworked SSL/TLS field naming
2019-08-08 15:20:05 +02:00
Luca
419160f351
Implemented DTLS support
...
Renamed ssl to tls
2019-08-08 12:45:27 +02:00
Luca Deri
3c4a959c1e
Updated results when adding client hello
2019-08-07 20:06:31 +02:00
Luca
800deb3f54
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-08-07 20:00:59 +02:00
Luca
49f5beab84
Added client SSL hello
2019-08-07 19:35:33 +02:00
emanuele-f
a6fe581d48
Change SMBv1 breed to potentially dangerous
...
https://techcommunity.microsoft.com/t5/Storage-at-Microsoft/Stop-using-SMB1/ba-p/425858
2019-08-07 12:39:07 +02:00
Luca Deri
ff1234cce3
Changes in QUIC dissector to avoid miing QUIC with STUN
2019-08-06 23:13:47 +02:00
Luca Deri
32665e6417
Removed non-ASCII chars from JSON header
2019-07-31 00:11:40 +02:00
Luca Deri
b2f7a52f98
Serialization fix
2019-07-30 23:46:20 +02:00
Luca Deri
4ebc8d54f4
Compilation fix
2019-07-30 22:51:54 +02:00
Luca Deri
9c3e623bb4
Split serialization code from ndpi_utils
2019-07-30 22:48:55 +02:00
Luca Deri
e1b7005c2b
Minro change
2019-07-30 10:28:30 +02:00
Luca Deri
398e9718ea
JSON serialization fixes
2019-07-30 08:04:39 +02:00
Luca
a0be9ea639
Fixed wrong detection of RTP as WhatsApp voice
2019-07-29 16:28:56 +02:00
Luca Deri
fbe87ed640
Fixed CSV initialization
2019-07-29 00:41:29 +02:00
Luca Deri
23af4d8211
Initial CSV implementation
2019-07-29 00:33:48 +02:00
Luca Deri
bfc3a00e6c
Fix for ndpi_serialize_string_uint32_format with JSON
2019-07-28 23:02:55 +02:00
Luca Deri
40f55e2d06
Added string/float support in (de)serialization
2019-07-27 17:48:23 +02:00
Luca Deri
3e044a759b
Code cleanup
2019-07-27 17:24:32 +02:00
Luca Deri
5c38e7b126
Better messenger traffic guess
2019-07-25 17:23:32 +02:00
Alfredo Cardigliano
32c61d3ea1
RPM spec cleanup
2019-07-25 14:23:11 +02:00
Alfredo Cardigliano
ea80c4dacc
Removed conflict with nprobe-dev
2019-07-25 11:59:01 +02:00
Luca Deri
7f66f1053f
Updated google docs detection in wechat.pcap
2019-07-25 09:13:46 +02:00
Luca Deri
734305e111
Updated Google docs category
2019-07-25 08:58:44 +02:00
Luca Deri
3369716fc3
Added SPLT (sequence of packet length and time) and BD (byte distribution) with -J
2019-07-24 23:55:07 +02:00
Yağmur Oymak
cdf61de129
Add test for WireGuard
2019-07-24 19:18:20 +03:00
Yağmur Oymak
786ea3c0f9
Merge branch 'dev' into wireguard
...
Conflicts:
src/include/ndpi_protocols.h
src/lib/ndpi_main.c
Get upstream developments.
2019-07-24 19:16:44 +03:00
Yağmur Oymak
9a899c54c9
Harden WireGuard detection
...
Exploit the fixed size handshake messages and sender/receiver indices.
2019-07-24 18:51:29 +03:00
Luca Deri
2148568347
Added int32/int64 (with sign) serialization/deserialization
2019-07-24 15:20:31 +02:00
Luca Deri
5c6c64ed1d
Warnign fix
2019-07-24 14:16:38 +02:00
Luca Deri
b99ef159ed
Added missing result for nest
2019-07-24 11:32:15 +02:00
lucaderi
a9ce7ccb83
Packages fixes
2019-07-24 08:47:36 +02:00
Luca Deri
b715467da6
Added -e option to ndpiReader for searchign human readeable strings lenght
...
Default human readeable strings lenght is not 5 chars (used to be 8)
2019-07-24 00:25:00 +02:00
Luca Deri
63173e7360
Updated results with new dissection
2019-07-24 00:13:07 +02:00
Luca Deri
d398b0aba6
Simplified makefile
...
Fixed warning
2019-07-23 22:45:31 +02:00
Luca Deri
8ff68a58f2
Merge pull request #759 from themadprofessor/patch-2
...
Create CONTRIBUTING.md
2019-07-23 22:33:29 +02:00
Luca Deri
f55391f99d
Merge pull request #760 from ntop/nDPI-SPLT-BD
...
Ndpi splt bd
2019-07-23 22:32:59 +02:00
Ravi Kerur
a262f8dd29
Add SPLT and BD classification to the lib.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 10:00:34 -07:00
Ravi Kerur
c6ca6ec712
Add new datastructures.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 09:56:32 -07:00
Ravi Kerur
1ec160d4c9
nDPI ovs changes.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 09:56:24 -07:00
Ravi Kerur
6b8234d938
Xbox and PS4 static port classification.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 09:56:15 -07:00
Ravi Kerur
b6db991710
Amazon video static classification.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 09:56:05 -07:00
Ravi Kerur
6ff9b8b90e
Add default port based iperf classification.
...
Signed-off-by: Ravi Kerur <ravi.kerur@viasat.com >
2019-07-23 09:55:32 -07:00
Stuart Reilly
e781ddfa43
Create CONTRIBUTING.md
...
Add simple contribution guidelines.
2019-07-23 10:47:25 +01:00
Yağmur Oymak
a0d8ce4159
Add support for WireGuard VPN
2019-07-23 12:00:23 +03:00
Luca Deri
974abaa275
Merged Google Hangout and Duo as they are pretty similar from the network standpoint and from the features they implement
2019-07-22 23:24:40 +02:00
Luca Deri
ccea4669de
Improved WhatsApp detection
2019-07-22 23:06:25 +02:00
Luca Deri
db36294dcb
Warnign fix
2019-07-22 21:42:55 +02:00
Alfredo Cardigliano
b13780c6e0
Serialization of arrays in JSON format
2019-07-22 17:24:04 +02:00
Luca Deri
6d00b59bb8
Compilarion fix
...
Updated SIP result
2019-07-22 16:08:44 +02:00
Luca Deri
72b05fed75
STUN, Hangout, Duo dissection improvements
2019-07-21 08:17:28 +02:00
Alfredo Cardigliano
e2d2ca5fe0
Added braces in JSON object serialization
2019-07-19 19:55:21 +02:00
Alfredo Cardigliano
d43cfe1ead
JSON serialization fixes in buffer offset and room computarion, string escape
2019-07-19 17:33:17 +00:00
Luca Deri
11004de056
Restored serializerUnitTest() after fixes
2019-07-19 16:54:48 +02:00
Alfredo Cardigliano
f3faaec9d8
serializer char* parameters are now const
2019-07-19 14:36:41 +00:00
Alfredo Cardigliano
8350b7269f
Fix Makefile.dpdk
2019-07-19 10:00:12 +00:00
Luca Deri
6bce0c4a9c
Added support for Google Duo
2019-07-19 00:48:07 +02:00
Luca Deri
4bda18a079
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-07-18 15:14:06 +02:00
Luca Deri
46499a53aa
Improved Facebook messnger mobile detection
2019-07-18 15:13:48 +02:00
Luca Deri
57ef7c1276
Added QUIC 046 support
2019-07-18 15:00:24 +02:00
Luca Deri
b8867642fc
Refresh after data leak detection
2019-07-18 11:49:53 +02:00
Luca Deri
e902478bd3
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-07-18 11:38:43 +02:00
Luca Deri
b50635cb89
Renamed ndpi_util.c -> reader_util.c
...
Added crash fix with IPv6
2019-07-18 11:38:16 +02:00
Luca Deri
cbb31fa204
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-07-18 11:26:17 +02:00
Luca Deri
20bac32e1f
Improvements for dta dissection
2019-07-18 11:24:44 +02:00
Luca Deri
f394102b80
Merge pull request #752 from marcopiangatello/dev
...
ndpi_has_human_readeable_string Test
2019-07-18 07:32:38 +02:00
Alfredo Cardigliano
dc375aed81
Corruptioon fix
2019-07-18 00:01:52 +02:00
Alfredo Cardigliano
c85f7de2c1
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-07-17 22:06:15 +02:00
Alfredo Cardigliano
ac3a618458
Improved deserialization safety checks
2019-07-17 22:06:00 +02:00
Alfredo Cardigliano
6081e46ad9
Fix memory corruption (reworked space computation and safety checks)
2019-07-17 21:20:51 +02:00
Alfredo Cardigliano
c990d6bbd9
Deserialization boundary check fix, new end_of_record type
2019-07-17 17:58:14 +02:00
marcopiangatello
4ad12dcd19
Update ndpiReader.c
2019-07-17 17:09:33 +02:00
marcopiangatello
dea4f784e2
Update ndpiReader.c
2019-07-17 16:55:49 +02:00
marcopiangatello
20c3d90163
Update ndpiReader.c
2019-07-17 16:53:24 +02:00
marcopiangatello
7053721aae
Add files via upload
2019-07-17 16:50:38 +02:00
marcopiangatello
adcb05d213
Delete ndpiReader.c
2019-07-17 16:50:25 +02:00
marcopiangatello
11639dcc8b
Update ndpiReader.c
2019-07-17 16:34:13 +02:00
marcopiangatello
44dd09b438
Add files via upload
2019-07-17 16:08:22 +02:00
marcopiangatello
7280fc7d31
Delete ndpi_util.h
2019-07-17 16:08:00 +02:00
marcopiangatello
e93ccab279
Delete ndpi_util.c
2019-07-17 16:07:53 +02:00
marcopiangatello
5294945554
Delete ndpiReader.c
2019-07-17 16:07:45 +02:00
Luca Deri
9ca87a620a
Added extar check
...
Warning fix
2019-07-17 15:31:48 +02:00
Luca Deri
b54863edc6
Merge pull request #747 from themadprofessor/travis-gcc
...
Add more compilers to travis
2019-07-17 15:26:47 +02:00
Stuart Reilly
065d0c7e9f
Add ubuntu toolchain to clang builds
2019-07-17 12:14:45 +01:00
Stuart Reilly
e2fcb942e8
Add clang-7
2019-07-17 11:44:44 +01:00
Stuart Reilly
cfdf832d3a
Remove brew update
2019-07-17 11:44:44 +01:00
Stuart Reilly
098c4228fb
Make travis more explicit
2019-07-17 11:44:44 +01:00
Stuart Reilly
79a0cfbcdb
Remove gcc7, add clang 8
2019-07-17 11:44:44 +01:00
Stuart Reilly
e923ca4f17
Add gcc-8 and gcc-9
2019-07-17 11:44:44 +01:00
Stuart Reilly
95ba3fa142
Add gcc-7 to travis.yml
2019-07-17 11:44:38 +01:00
Alfredo Cardigliano
2fcc4f3e73
Added ndpi_serialization_uint32_uint64 and ndpi_serialization_string_uint64
2019-07-17 10:10:41 +00:00
Alfredo Cardigliano
1657686eb4
Moved json2tlv to ntopng
2019-07-17 08:55:46 +00:00
Alfredo Cardigliano
c0835968af
ZMQ export in json2tlv
2019-07-16 16:04:04 +00:00
Alfredo Cardigliano
4b2fbdb277
json2tlv tool to convert from JSON to TLV and run performance tests
2019-07-16 13:31:26 +00:00
Alfredo Cardigliano
2ce4adf09d
Added ndpi_serialization_string_uint32
2019-07-16 12:31:41 +02:00
Luca Deri
1777841ec1
Line dissection improvements
2019-07-16 00:02:34 +02:00
Luca Deri
f570eccf81
Fixes #741
2019-07-15 23:53:28 +02:00
Luca
67dfddd065
Line fix
2019-07-15 16:25:53 +02:00
Luca
9a4d01cb26
Lenght fix
2019-07-15 16:17:23 +02:00
Luca Deri
5c758d4564
Reworked output
...
-v 1 now prints only unknown flows
-v 2 now prints all flows
2019-07-15 14:45:25 +02:00
emanuele-f
fc531334ae
Remove Werror
2019-07-15 09:31:15 +02:00
Luca Deri
5a018e0bc0
Added Line protocol dissection
...
Add fix for discarding STUN over TCP flows
2019-07-15 00:19:45 +02:00
Luca Deri
f8fb1f838c
Fixes #740
2019-07-14 12:25:08 +02:00
Luca Deri
7b16c68e92
JA3 format cleanup
2019-07-13 19:32:51 +02:00
Luca Deri
af2dc0860c
Merge pull request #734 from glpaparelli/dev
...
fixed the printing layout, even with IPv6
2019-07-13 18:44:03 +02:00
Luca Deri
acd3db13f8
Fixes #735
2019-07-13 18:39:18 +02:00
Luca Deri
c8a867bf29
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-07-13 18:38:20 +02:00
Luca Deri
17c49b2e6d
Updated test resultss after export changes
2019-07-13 18:37:57 +02:00
Luca Deri
9bdc021f98
Merge pull request #736 from themadprofessor/patch-1
...
Fix invalid function prototype
2019-07-13 18:36:09 +02:00
Luca Deri
c65025f7b0
Merge pull request #737 from themadprofessor/dev
...
Add compiler warnings and fix them
2019-07-13 18:34:40 +02:00
Luca Deri
ea32d535eb
initial work towards simple serilizer/deserialier
2019-07-13 18:32:22 +02:00
Stuart Reilly
92c769f206
Solve remaining warnings
2019-07-12 16:41:39 +01:00
Stuart Reilly
343ee0c9b6
Merge branch 'dev' of github.com:themadprofessor/nDPI into github
2019-07-12 16:28:38 +01:00
Stuart Reilly
8b1c68aed3
Add compiler warnings and fix them
2019-07-12 16:01:22 +01:00
Stuart Reilly
929cbbb7fc
Add compiler warnings and fix them
2019-07-12 15:59:11 +01:00
Stuart Reilly
22e323528e
Fix invalid function prototype
...
Solves a warning when compiling with strict-prototypes.
2019-07-12 15:02:20 +01:00
Giulio Paparelli
52533c3b66
all fixed
2019-07-12 12:06:10 +02:00
Luca Deri
563215a05e
Compilation fix
2019-07-12 07:24:07 +02:00
Luca Deri
4ac60d88d7
Improved whatsapp dissection
2019-07-11 22:49:24 +02:00
Luca Deri
3e2e616507
Dissection improvents
...
Fixed QUIC dissection
Disabled debug message
2019-07-11 22:35:50 +02:00
Luca Deri
da7e595fcf
Fixed uninitialized variable that caused weird errors
2019-07-10 19:27:27 +02:00
Luca Deri
829a284d48
Fix that caused nDPI to provide false positive results with pattern matching
2019-07-10 16:08:12 +02:00
Luca Deri
c0d9dc9969
Typo
2019-07-03 18:03:44 +02:00
Luca Deri
cc15389729
Improved protocol guess
2019-07-02 23:25:55 +02:00
Luca
edd4f2e37d
Remvoed debug info
2019-07-02 15:28:40 +02:00
Luca Deri
8205f2c6f1
Various TLS improvements
2019-07-02 00:05:17 +02:00
Luca Deri
dd9db5d0b7
SSL ciphers improvements
2019-07-01 23:25:48 +02:00
Luca Deri
9590b18fdd
Fixed invalid changes in ndpi_get_proto_category() and ndpi_get_proto_name() dur to https://github.com/ntop/nDPI/pull/731/commits/4b717276614e20feada22e6fe29ea2099ba9fd37
2019-07-01 23:16:43 +02:00
Luca Deri
7cb7a12f96
Merge pull request #731 from themadprofessor/dev
...
Stability Fixes
2019-07-01 20:02:49 +02:00
Stuart Reilly
5ce5bae99d
Merge remote-tracking branch 'upstream' into dev
2019-07-01 17:49:14 +01:00
Luca Deri
8fdef484f6
Minor change
2019-07-01 12:51:55 +02:00
Luca Deri
65e842effa
Merge pull request #730 from hoermto/hoermto-patch-alpine
...
Alpine linux: "ln -F" not supported in alpine
2019-06-30 15:34:00 +02:00
Luca Deri
2c43b61798
Added DNSoverHTTPS detection
2019-06-30 12:36:58 +02:00
Luca Deri
a1ac31062d
Added ndpi_has_human_readeable_string for detecting human-readeable strings in buffers
2019-06-30 11:59:51 +02:00
Luca Deri
06b05e21c6
Improvemnts in SSL certificate detection
2019-06-30 08:19:51 +02:00
Luca Deri
3f460ad5a9
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-06-29 17:34:45 +02:00
Luca Deri
e9e647f043
ntohl Portability fixes
2019-06-29 17:34:08 +02:00
Luca Deri
e8c84f3c5d
Initial implementation of datasaver protocol support
2019-06-29 13:04:06 +02:00
Stuart Reilly
f3161309ff
Fix missing braces
2019-06-28 16:21:49 +01:00
Stuart Reilly
ef1b8e36a0
Fix potential NULL dref in btlib.c
2019-06-28 16:12:42 +01:00
Stuart Reilly
79634a6789
Fix two resource leaks
2019-06-28 16:11:33 +01:00
Stuart Reilly
d8ec0a9229
Move NULL checks to start of functions
2019-06-28 16:08:36 +01:00
Stuart Reilly
bc1b4885de
Fix potential NULL deref in libcache
2019-06-28 16:00:32 +01:00
Stuart Reilly
4b71727661
Fix two potential OOB reads in ndpi_main.c
2019-06-28 15:55:00 +01:00
Stuart Reilly
cc39ef0946
Remove duplicate defintions and fix function prototypes
2019-06-28 15:53:11 +01:00
hoermto
e47c0c3e49
Makefile: ln -F not supported in alpine
...
removed -F option from makefile for alpine support. Actually not sure the relevance of -F flag for other OS
2019-06-28 15:54:59 +02:00
Luca Deri
81d3fc8a24
Dissection improvements
2019-06-27 16:38:36 +02:00
Luca Deri
cc51253007
Removed debug message
2019-06-25 16:30:51 +02:00
Luca Deri
a4d797f832
WhatsApp improvements for video/audio detection
2019-06-25 15:18:49 +02:00
Luca Deri
6ed8ccfa46
Merge pull request #723 from lance-wyvern/dev
...
OICQ protocol version:0x371b
2019-06-22 15:42:15 +02:00
Luca Deri
c4f513f6e7
Merge pull request #717 from weiyanhua100/dev
...
add null process for malloc.
2019-06-22 15:40:25 +02:00
Luca Deri
4ea8eaf103
Merge pull request #724 from themadprofessor/fix_dhcp_tests
...
Fix tests broken by new DHCP fingerprinting
2019-06-22 15:40:08 +02:00
Luca Deri
00ed2653fe
Further WhatsApp improvements
2019-06-21 19:06:41 +02:00
Luca Deri
179b93d625
Better UDP flow handling
2019-06-21 12:14:57 +02:00
Luca Deri
3e43e77b1c
Cleanup
2019-06-21 12:14:51 +02:00
Luca Deri
b66606bc16
Improved OpenVPN support for UDP-based VPNs
2019-06-21 12:01:07 +02:00
Luca Deri
b6ac750e21
Added WhatsApp Video
2019-06-20 23:16:36 +02:00
Luca Deri
936a95e10e
WhatsApp improvements
2019-06-20 23:11:16 +02:00
Luca Deri
13e8354f37
JSON-C fix
2019-06-20 22:16:53 +02:00
Luca Deri
0fe7f16ecf
Fixed invalid false positive
2019-06-20 21:11:21 +02:00
Stuart Reilly
784f4e4bba
Add dhcp fingerprints to expected results
2019-06-19 13:20:55 +01:00
zhenxian.wang
1e616b227b
new QQ version:0x3823
2019-06-19 15:58:30 +08:00
Luca
4830aa9a14
DHCP fingerprint is now in human readeable format
2019-06-18 17:44:05 +02:00
Luca
5f26149938
Added DHCP fingerpring handling
2019-06-18 17:36:39 +02:00
zhenxian.wang
1891f687b6
new QQ version
2019-06-18 18:04:46 +08:00
Luca Deri
41b75485eb
SSL cipher improvements
2019-06-16 21:42:12 +02:00
Luca Deri
1a3f2b3f0d
Reworked SSL cipher handling
2019-06-16 16:05:13 +02:00
Luca Deri
5b7a08bac3
Added SSL cipher print
2019-06-16 10:08:21 +02:00
weiyanhua
e814cd0b9e
add null process for malloc.
2019-06-13 15:05:22 +08:00
Luca Deri
709a87c8d4
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-06-05 23:15:42 +02:00
Luca Deri
4e8055742e
Added fix for discarding core protocols as subprotocols
2019-06-05 23:15:06 +02:00
lucaderi
3979c28cac
Added missing antimalware category
2019-06-03 19:50:18 +02:00
Luca Deri
e6813846b8
Adds CUSTOM_CATEGORY_ANTIMALWARE category referenced by #710 .
2019-06-03 08:18:24 +02:00
Luca Deri
165decdf6c
Merge pull request #691 from pallas/fix-double-strdup
...
Fix double-strdup memory leak in ndpi_handle_rule
2019-06-03 08:10:01 +02:00
Luca Deri
4441bc7033
Merge pull request #711 from dfranusic/dev
...
Added PUBLISH/SUBSCRIBE/MESSAGE methods to SIP
2019-06-03 08:05:26 +02:00
Damir Franusic
a015cb7f48
Merge remote-tracking branch 'upstream/dev' into dev
2019-05-31 15:21:04 +02:00
Damir Franusic
5c7e0a0319
SIP Message extension
...
* RFC 3248
2019-05-31 15:19:07 +02:00
Luca Deri
c43bec826d
Updated results with the new SSL dissection
...
Added RDP dissector
2019-05-30 11:15:50 +02:00
Luca
a3b564eb92
Warning fix
2019-05-29 18:54:17 +02:00
Damir Franusic
1b9955e9ef
Added PUBLISH/SUBSCRIBE methods to SIP
2019-05-29 17:12:32 +02:00
Luca Deri
5da363cbde
Fixed MySQL dissector
...
SSL dissector now reports the protocol version
Fixed bug in ndpiReader that ivalidates in some cases the protocl dissection and used to slow down the dissection
2019-05-28 23:35:49 +02:00
Luca Deri
53119e71f4
Added ndpi_is_safe_ssl_cipher(0 call
2019-05-23 00:16:05 +02:00
Luca Deri
fcc9c76249
Disabled debug
2019-05-22 21:19:22 +02:00
Luca Deri
f29f9bbb38
Update SSL server ciphers
2019-05-22 12:37:27 +02:00
Luca Deri
04b543caa9
SSL certificate analysis improvement
2019-05-20 22:30:53 +02:00
Luca Deri
3f9383c343
Added missing definitions
2019-05-20 22:13:21 +02:00
Luca Deri
0d2f8f4498
Implements #705
2019-05-20 22:02:21 +02:00
Luca Deri
53e64df8e2
Removed debug code
2019-05-20 15:40:09 +02:00
Luca Deri
f97be61e8b
Fixed JA3 decoding
...
Made ndpi_process_extra_packet() optional
2019-05-20 15:32:50 +02:00
Luca Deri
9604386698
Merge pull request #704 from TelecomsSansFrontieres/dev
...
Adding 2 missing Whatsapp IPs
2019-05-18 11:18:07 +02:00
Luca Deri
7b2d9adbdf
Merge pull request #707 from zyingp/xcode_fix
...
Fix the Xcode project
2019-05-18 11:17:47 +02:00
Luca
d592902553
JA3 hardeding code
2019-05-15 17:55:01 +02:00
Yingpei Zeng
08ca25c9c8
Fix the Xcode project
2019-05-15 09:56:10 +08:00
Luca Deri
e5a95cf92e
Skept GREASE in SSL JA3 fingerprint
2019-05-13 23:22:19 +02:00
Clément BRUGUERA
1a2b8a98a6
Adding 2 missing Whatsapp IPs
2019-05-13 17:26:19 +02:00
Luca Deri
0d0d6893fc
JA3 fixes
2019-05-12 15:25:14 +02:00
Luca Deri
3b185a00fa
Disabled debug traces
2019-05-11 00:53:02 +02:00
Luca Deri
a00ad9fc92
Initial JA3 support ( https://github.com/salesforce/ja3 ) for SSL
2019-05-11 00:50:56 +02:00
Luca Deri
b96e6a9e2d
Merge pull request #696 from pallas/avoid-hyperscan-leak
...
Avoid leaking hyperscan struct
2019-05-08 12:13:23 +02:00
emanuele-f
ea1ea99ce1
Add allowed site category
2019-05-06 12:01:53 +02:00
Luca Deri
e99a0abfba
Hardening fixes for packer parsing
2019-05-03 18:08:12 +02:00
cardigliano
361ab030bc
ndpi_handle_rule accepted formats
2019-04-29 09:44:39 +02:00
Derrick Lyndon Pallas
33d17dbf1f
Avoid leaking hyperscan struct
2019-04-22 17:02:11 +00:00
Alfredo Cardigliano
8a09ca2180
Fixed RPM pkgconfig path
2019-04-19 11:44:10 +02:00
Alfredo Cardigliano
1bbb992ca6
Fixed pkgconfig path (installing libndpi.pc in the default location)
2019-04-19 11:38:34 +02:00
emanuele-f
4dd51a165c
Fix DNS rsp_addr missing in some tiny responses
2019-04-15 19:54:17 +02:00
Luca Deri
8365afee8d
Merge pull request #688 from Dark-Vex/whatsapp
...
Added new Whatsapp addresses ntop/nDPI issue #683
2019-04-12 19:39:20 +02:00
emanuele-f
0961caec1b
Add missing fclose in ndpiReader
2019-04-12 19:39:01 +02:00
Luca Deri
1bf9351a67
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-04-12 19:33:17 +02:00
Luca Deri
3cb0b3fc7b
Fixes #692
2019-04-12 19:32:44 +02:00
Luca Deri
ffb1b9c14f
Merge pull request #690 from pallas/make-path-const
...
Make path const in ndpi_load_protocols_file
2019-04-12 19:25:27 +02:00
Luca Deri
82817c1cac
Merge pull request #687 from Dark-Vex/viber
...
Added Viber IPs issue #684
2019-04-12 19:25:00 +02:00
Luca Deri
173a04007f
Merge pull request #682 from chiehmin/dev
...
Parse HTTP PATCH method
2019-04-12 19:24:14 +02:00
Luca Deri
83d5627c4d
Merge pull request #694 from pallas/avoid-csgo-short-read
...
csgo: fix invalid read on short packet
2019-04-12 19:20:14 +02:00
Luca Deri
6f8a01ca18
Merge pull request #695 from pallas/avoid-memcached-short-read
...
memcached: fix invalid read on short packet
2019-04-12 19:19:46 +02:00
emanuele-f
5b6526cc5a
Add missing newlines
2019-04-12 17:25:38 +02:00
emanuele-f
5e24b32467
Fix category detection
2019-04-12 17:08:32 +02:00
Luca Deri
2f14b8abbf
Added test file for FTP
2019-04-12 12:19:11 +02:00
Derrick Lyndon Pallas
74715b12b0
memcached: fix invalid read on short packet
2019-04-06 01:00:44 +00:00
Derrick Lyndon Pallas
7415af5086
csgo: fix invalid read on short packet
2019-04-06 00:31:41 +00:00
Derrick Lyndon Pallas
85776a532d
Fix double-strdup memory leak in ndpi_handle_rule
...
proto is being strdup'd both in the call to ndpi_set_proto_defaults and
inside of that function as well, leaking the memory.
2019-04-05 19:00:39 +00:00
Derrick Lyndon Pallas
bb2f35fe79
Make path const in ndpi_load_protocols_file
2019-04-05 18:48:42 +00:00
Luca
1290706fad
Tests result fix
...
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-04-05 12:51:59 +02:00
Luca
4e7fa82aff
Fixed false positive with FTP_DATA protocol
...
Added coherency in application protol guess by exploiting the host server name
Various protocol optimizations
2019-04-05 12:47:58 +02:00
emanuele-f
796472cf84
Fix category detection due to missing initialization
2019-04-05 10:11:17 +02:00
Luca Deri
a455e0d8d4
Improved flow category guess
2019-04-02 23:01:03 +02:00
Dark-Vex
55c4108d8b
[FIX] Added new whatsapp addresses ntop/nDPI issue #683
2019-04-02 16:47:49 +02:00
Daniele De Lorenzi
2ef19c7e49
[FIX] Added IPs reported in ntop/nDPI issue #684
2019-04-02 16:04:01 +02:00
Daniele De Lorenzi
e27022b698
Merge pull request #11 from ntop/dev
...
Add all dev branch modifications
2019-04-02 15:49:54 +02:00
Luca Deri
153c77c2cd
Improvements with category detection
2019-04-01 18:40:14 +02:00
Luca Deri
6693151052
Added custom category support to ndpi_get_partial_detection()
2019-04-01 16:12:44 +02:00
Luca Deri
1915a63cf2
Implemented ndpi_process_partial_detection() API call to handle partial matches due to the nDPI specified configuration
2019-04-01 12:30:51 +02:00
emanuele-f
c496c7975f
Add DNS response address
2019-03-29 19:58:10 +01:00
Luca Deri
8dbe7818eb
Improvments for AmazonVideo
2019-03-27 07:00:11 +01:00
chiehminw
1df5b453cb
Parse HTTP PATCH method
...
HTTP PATCH is introduced in RFC 5789 (https://tools.ietf.org/html/rfc5789 )
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-26 11:46:57 +08:00
Luca Deri
0b5e5a5f82
SSL cleanup
2019-03-25 22:08:39 +01:00
Luca Deri
f47be6ef60
Added SSL organization support
2019-03-23 10:32:18 +01:00
Luca Deri
f592b9fc31
Merge pull request #681 from chiehmin/certificate-parsing
...
Parse server certificate organization
2019-03-23 09:58:54 +01:00
Luca Deri
6b1f158322
Merge pull request #675 from chiehmin/dev
...
Respect CXX variable during configure
2019-03-23 09:54:17 +01:00
Luca Deri
99748cddcc
Merge pull request #679 from chiehmin/link-use-relative-path
...
Use relative path for library link
2019-03-23 09:53:35 +01:00
Luca Deri
e2cd89e354
Merge pull request #678 from madpilot78/FreeBSD_endian.h
...
The le32toh() function used in some places on BSD OSes requires sys/en…
2019-03-23 09:53:05 +01:00
Luca Deri
e5f6f68cd6
Merge pull request #677 from chiehmin/add-http-method-prefix
...
Add NDPI prefix for HTTP_METHOD enum to avoid name collisions
2019-03-23 09:52:34 +01:00
Luca Deri
e2ad6bf79f
Merge pull request #673 from vel21ripn/dns_fix_name
...
More accurate hostname verification in a DNS query.
2019-03-23 09:51:53 +01:00
Luca Deri
ef9f395cb6
Merge pull request #665 from vel21ripn/whatsapp
...
Fix whatsapp signature detecting.
2019-03-23 09:49:35 +01:00
Luca Deri
e6f8a66197
Merge pull request #662 from bmwiedemann/date
...
Use ChangeLog date instead of build date
2019-03-23 09:49:06 +01:00
Luca
5656a41f69
Improved snapchat detection
2019-03-22 12:36:42 +01:00
chiehminw
96ed31874d
we only need one dot to confirm it is a valid domain name
...
github.com is valid but can not be retreive by server certificate
parsing
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-20 17:47:51 +08:00
chiehminw
db91837647
retreive ssl certificate origanization
...
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-20 17:47:48 +08:00
emanuele-f
6c9fbc2ddb
Fix invalid categories labels array length and add check
2019-03-18 13:29:59 +01:00
Luca Deri
7237f7081f
Improved FTP dissection
2019-03-14 22:07:21 +01:00
Luca Deri
54f90c7556
Added fix to avoid FTP false positives
2019-03-14 21:50:09 +01:00
chiehminw
43890b31fc
Use relative path for library link
...
relative link path can preserve link relation after packaging and
doplying to new machine
ex:
$ make DESTDIR=/tmp/ndpi install
$ tar czf ndpi.tar.gz /tmp/ndpi
$ tar xf ndpi.tar.gz -C /lib
Orignal install script will caused the /lib/libndpi.so.2 links to
/tmp/ndpi/libndpi.so.2.9.0 which is not intended
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-13 15:04:10 +08:00
Guido Falsi
b1282da542
The le32toh() function used in some places on BSD OSes require sys/endian.h to be included.
2019-03-12 18:12:18 +01:00
Luca
22e431ca67
Sporify fix
2019-03-12 18:01:14 +01:00
chiehminw
b1bd7d6f8c
Add NDPI prefix for HTTP_METHOD enum to avoid name collisions
...
ref: https://stackoverflow.com/questions/35380279/avoid-name-collisions-with-enum-in-c-c99
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-12 16:11:33 +08:00
Luca Deri
6c1d236a03
Category cleanup
2019-03-10 21:44:11 +01:00
Luca Deri
89d548f9d3
Removed categories based on file content
2019-03-10 21:18:19 +01:00
Luca
fde4380422
Proto cleanup
2019-03-08 20:17:11 +01:00
Luca Deri
aaa686b9fe
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-03-08 15:59:26 +00:00
Luca Deri
03b0aa7185
Added new categories
...
- NDPI_PROTOCOL_CATEGORY_MUSIC
- NDPI_PROTOCOL_CATEGORY_VIDEO
- NDPI_PROTOCOL_CATEGORY_SHOPPING
- NDPI_PROTOCOL_CATEGORY_PRODUCTIVITY
- NDPI_PROTOCOL_CATEGORY_FILE_SHARING
Protocol vs category rework
2019-03-08 15:58:21 +00:00
chiehminw
518dbbc96b
Respect CXX variable during configure
...
commit 6ac83ce7eb use CXX to link ndpiReader however CXX is not
properly set in configure step
Fixes: 6ac83ce7eb ("Fixes broken hyperscan compilation")
Signed-off-by: chiehminw <chiehminw@synology.com >
2019-03-06 15:27:50 +08:00
Simone Mainardi
59f683858b
Fixes possibly broken dissection of invalid DNS responses
2019-03-04 18:48:38 +01:00
Luca Deri
c339211ac7
Re-Added TikTok/Musical.ly protocol
2019-03-03 21:07:54 +01:00
Simone Mainardi
93582a4204
Bump to version 2.9
2019-03-01 18:06:28 +01:00
Simone Mainardi
5bb53cf995
Changelog update
2019-03-01 18:02:24 +01:00
Luca
05ef62781f
Fixes for wireshark 3
2019-03-01 15:19:05 +01:00
Luca
d283538146
Fixed false positive mining detection
2019-03-01 12:56:33 +01:00
Vitaly Lavrov
a99754d88b
More accurate hostname verification in a DNS query.
2019-02-27 15:26:11 +03:00
Luca Deri
de16b01bb2
Improved MDNS dissection
2019-02-24 11:03:06 +01:00
Luca Deri
47669abd44
Added extra check to avoid nDPI wrong matches
2019-02-21 23:29:06 +01:00
emanuele-f
ab3833a708
Fix invalid TCP DNS dissection
2019-02-19 17:17:02 +01:00
Luca Deri
dc8d582b18
Fixes #671
2019-02-14 10:31:42 +01:00
emanuele-f
a035763afd
Change ndpi_fill_ip_protocol_category to pass IPs explicitly
2019-02-12 17:28:30 +01:00
Luca Deri
0c4fada265
Fix for avoid wrong substring match to happen
2019-02-10 23:52:24 +01:00
Luca Deri
ddf0066c11
Aligned DNS to HTTP dissection
2019-02-07 22:44:48 +01:00
Vitaly Lavrov
476fbbfe4e
Fix whatsapp signature detecting.
2019-01-31 11:27:40 +03:00
cardigliano
2ec41c1732
Releasing old buffer if realloc fails
2019-01-31 09:12:04 +01:00
Alfredo Cardigliano
6a98aec2ca
Support for protocol file files of arbitrary length
2019-01-30 08:44:32 +00:00
Bernhard M. Wiedemann
e91123e17a
Use ChangeLog date instead of build date
...
in order to make builds reproducible.
See https://reproducible-builds.org/ for why this is good.
This date call works with GNU date and BSD date.
Also use UTC/gmtime to be independent of timezone.
2019-01-24 14:27:10 +01:00
Luca Deri
e2ffcd7229
Improved HTTP response code handling
2019-01-23 00:53:56 +01:00
Luca Deri
efa96da3e0
Fixes #657
2019-01-20 23:47:24 +01:00
Luca Deri
b9ae650146
Merge pull request #659 from cavedon/direction-endianness
...
Compute packet_direction consistently independently from endianness
2019-01-20 23:18:46 +01:00
Luca Deri
72edc508eb
Merge pull request #661 from pcein/propagate-prefix
...
Propagate prefix settings to Makefiles
2019-01-20 23:17:46 +01:00
Pramode
81649d9979
Propagate prefix settings to Makefiles
...
A "make install" was failing because the --prefix flag
setting was not being propagated to the Makefiles.
2019-01-20 19:09:07 +05:30
Luca Deri
7efe1f06ee
Removed debug code
2019-01-17 22:03:39 +01:00
Luca Deri
85155d5899
Removed debug code
2019-01-17 00:42:45 +01:00
Luca Deri
d088a968a9
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2019-01-17 00:41:05 +01:00
Luca Deri
efef99cbad
Removed this party LRU and replaced with home grown
2019-01-17 00:40:28 +01:00
Luca Deri
f3b0878a37
Warnign fixes
...
Updated test results
2019-01-17 00:39:45 +01:00
Luca Deri
c856e0a563
Disabled ookla statistics: needs to be improved
2019-01-16 22:30:55 +01:00
Ludovico Cavedon
2c672a4ea2
Compute packet_direction consistently independently from endianness
...
Ensure packet_direction is computed in the same way on little endian and
big endian architectures.
This change will convert IP addresses and port from little endian to host
endian (instead of converting from network endian to host endian) so
that it does not change the behavior on little endian architecture where
ndpi is usually developed.
A better (but more invasive) change would be to use the ntoh*()
functions and then adjust all affected tests.
2019-01-16 01:15:43 -08:00
Ludovico Cavedon
0cb4bae275
QUIC: convert little endian offsets to host endianness
...
Offset in the QUIC protocol are little endian. Reading them as uint32_t
works on little endian architectures, but breaks on big endian ones.
This change applies the proper conversion and fixes running the
http_ipv6 and quic tests on big endian architectures.
2019-01-15 23:49:26 -08:00
Simone Mainardi
2ade0be365
Fixes ookla lru cache use with IPv6
2019-01-15 09:56:33 +01:00
Luca Deri
f2f2dbe381
Fix for IPv6 HTTP traffic
2019-01-14 20:03:06 +01:00
Luca Deri
60eee5f9e9
Merge pull request #649 from Dark-Vex/dev
...
Bank website detected as TOR from SSL Dissector (bigram check)
2019-01-13 11:12:12 +01:00
Luca Deri
4a6b0d7de5
Merge pull request #654 from u-devel/patch-1
...
Update radius.c to RFC2865
2019-01-13 11:11:10 +01:00
Luca Deri
f41ffe136a
Merge pull request #655 from u-devel/dev
...
FIX H.323 broken detection
2019-01-13 11:10:36 +01:00
u-devel
1d155ab2eb
FIX H.323 broken detection
...
TPKT header length field can have value more then 255, and in fact in all of the cases I've met it is more then 255.
Thus checking real H.323 packet like this:
(packet->payload[2] == 0x00)
stop detecting H.323 conversation at all.
2019-01-13 00:07:45 +06:00
u-devel
396f794bf4
Update radius.c to RFC2865
...
According to RFC2865 code can have value up to 13, also payload length ranges should be applied.
2019-01-12 23:49:24 +06:00
Luca Deri
97bdfe295d
nDPi now finally honours dissection of HTTP responses
2019-01-07 00:28:29 +01:00
Luca Deri
5241c9f3cf
Added Modbus over TCP dissector
2018-12-21 18:25:44 +01:00
Luca Deri
91da00f470
Updated results
2018-12-21 17:31:51 +01:00
Alfredo Cardigliano
c7260b6436
Moved to 2.7
2018-12-21 10:50:23 +01:00
Daniele De Lorenzi
c51405e99b
Bank website detected as TOR from SSL Dissector (bigram check)
...
Commented "vp" for vpbank.com
2018-12-20 11:11:32 +01:00
Daniele De Lorenzi
2aea4da9ad
Merge pull request #10 from ntop/dev
...
Repo sync
2018-12-20 11:04:03 +01:00
Alfredo Cardigliano
d3be349fa0
Changelog update
2018-12-20 09:16:59 +01:00
Luca Deri
92ad057332
Added Ookla cache
2018-12-17 22:33:58 +01:00
emanuele-f
d2b2aba6e8
Expose ndpi_fill_ip_protocol_category api to handle ICMP flows category
2018-12-12 11:31:07 +01:00
Luca Deri
c1d31bb409
Fixed eDonkey false positives
2018-12-12 08:58:34 +01:00
Alfredo Cardigliano
181ec4992b
Deb fix (shared lib links)
2018-12-10 16:54:01 +01:00
Alfredo Cardigliano
60337330bf
Creating shared lib with major version
2018-12-10 16:33:09 +01:00
Alfredo Cardigliano
af0fd3b96d
RPM fix
2018-12-10 16:18:53 +01:00
Luca Deri
e7cf989c7a
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-12-10 12:19:53 +01:00
Luca Deri
2a1313ffd5
Improvements in SpeedTest (Ookla) detection
2018-12-10 12:19:34 +01:00
Luca Deri
140ed9887b
Merge pull request #639 from madpilot78/Create_libndpi.so.MAJOR_link
...
Also create the libndpi.so.2 link.
2018-12-10 02:30:05 -08:00
Alfredo Cardigliano
b2c00b3b24
Added script to get the package version
2018-12-07 15:50:23 +01:00
Luca Deri
70d0566480
Build fix
2018-12-05 06:58:29 +01:00
Luca Deri
067c3dad44
Merge pull request #645 from vitalivanov/pull_example_dpdk_cleanups
...
build: cleanup of dpdk examples.
2018-12-04 15:43:18 -08:00
Luca
be2934f9ad
Added the concept of protocols that can have subprotocols. Example Spotify cannot have subprotocols, DNS can (DNS.Spotify)
...
Merged Skype call in/out in Skype Call
2018-11-30 18:41:16 +01:00
Luca
2993d9d37e
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-11-30 08:40:37 +01:00
Luca
bae75c8f9b
Fix for custom protocol load
2018-11-30 08:39:54 +01:00
lucaderi
b6be0eebf6
Fix for shared library symbolic link
2018-11-30 06:53:41 +01:00
Luca Deri
d63e000a45
Fixed package signing
2018-11-30 00:57:34 +01:00
Vitaliy Ivanov
fd963538f3
build: cleanup of dpdk examples.
...
- clean install dependencies on example binary
- add more rules to clean command
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-29 13:40:37 +02:00
Luca
c09284ba27
Improved heuristics
...
Used the host guessed protocol if upper protocol has not been detected
2018-11-29 08:44:41 +01:00
Luca
622519e90e
Warning fix
2018-11-29 07:53:41 +01:00
Luca Deri
f1e5ed4766
Merge pull request #642 from vitalivanov/pull_buildsys_improvements
...
Pull buildsys improvements
2018-11-28 23:20:34 +01:00
Vitaliy Ivanov
a3abbc3ebb
build: do not fail if example app is not present.
...
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-28 19:23:27 +02:00
Vitaliy Ivanov
8df6b5c1bf
build: install example binaries to dst dir.
...
make install DESTDIR=/build/nDPI/
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-28 17:40:01 +02:00
Vitaliy Ivanov
9cbf25a76f
build: cleanup .so.X.X.X if present.
...
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-28 16:56:22 +02:00
Vitaliy Ivanov
923ba84f65
gitignore: ignore dpdk artifacts.
...
Also similarly to shared libraries do not hide static lib.
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-28 16:43:17 +02:00
Vitaliy Ivanov
ea7e7c753b
build: correct example dpdk linking with pcap.
...
- take libpcap from configure information.
- clean up distclean.
Signed-off-by: Vitaliy Ivanov <vitaliyi@interfacemasters.com >
2018-11-28 16:40:34 +02:00
Luca
5429063546
Improved WhatsApp detection
2018-11-28 00:24:41 +01:00
Luca
54deb1302d
Added Signal.org dissector
2018-11-28 00:09:44 +01:00
Luca Deri
f15aed6c46
Renamed internal function
2018-11-21 23:25:27 +01:00
Luca Deri
e9dd5985b3
Made configure more friendly
...
Added time measurement in ndpiReader (processing and setup time)
2018-11-21 17:22:15 +01:00
Luca Deri
669fdf6b5f
Improved skype, teredo, netbios heuristics
...
Changed ndpi_detection_giveup() API: guess is now part of the call
2018-11-21 00:32:32 +01:00
Alfredo Cardigliano
21504c8492
rpm spec file
2018-11-19 19:01:53 +01:00
Luca Deri
12adb25665
Improved Skype detection
...
Update test results
Added initialization for some free protocols
2018-11-19 18:28:18 +01:00
Luca Deri
5259ba2bcb
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-11-19 18:28:10 +01:00
Alfredo Cardigliano
babb1c864c
removed -r not supported on all systems
2018-11-19 18:25:12 +01:00
Luca Deri
582da8d4bb
Improved WeChat support
...
Removed Musical.ly protocol as the service has been merged with another one and thus it is no longer used
Improved guess for UDP protocols
2018-11-19 18:24:33 +01:00
Alfredo Cardigliano
1537669178
rpm package
2018-11-19 18:02:06 +01:00
Alfredo Cardigliano
b0cfe0b9cc
settins arch for -dev package as it contains static libs
2018-11-19 15:27:24 +01:00
Alfredo Cardigliano
30305cf4fa
deb dependency fix
2018-11-19 15:13:38 +01:00
Alfredo Cardigliano
219951760f
ubuntu ndpi/ndpi-dev package (testing)
2018-11-19 11:16:28 +01:00
emanuele-f
0ee451040d
Warning fix
2018-11-18 12:50:53 +01:00
Alfredo Cardigliano
22c2568c27
commented out debug print
2018-11-16 19:21:57 +01:00
Luca Deri
6e6b825e92
Improved skype heuristic
2018-11-15 16:18:45 +01:00
Guido Falsi
8c63f25478
Also create the libndpi.so.2 link.
...
This is created bydefault by all build tools for libraries and required in certain cases. FreeBSD linker requires it when using SONAME.
2018-11-15 09:09:52 +01:00
Luca Deri
977751efdb
Added ndpi_flowv4_flow_hash and ndpi_flowv6_flow_hash skeletons for
...
implementing https://github.com/corelight/community-id-spec
2018-11-14 15:24:15 +01:00
Luca Deri
771a6e9aab
Merge pull request #636 from 2miksyn/dev
...
Improve SSL detection, prevent false positive SSL detection
2018-11-14 00:36:29 +01:00
Luca
2b4554ad44
Updated test results
2018-11-13 15:35:17 +01:00
emanuele-f
9e72884c7b
Add OpenWrt Makefile
2018-11-13 09:58:31 +01:00
Luca Deri
71b2c19cf2
Added DPDK support to ndpiReader
2018-11-10 16:10:22 +01:00
kyrol
6d929bf4cc
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-11-09 14:53:33 +01:00
kyrol
de9b2b202e
FIX missing Application Data pkt for TLS
2018-11-09 14:52:32 +01:00
Luca Deri
b31337db4a
Improved Skype detection
2018-11-09 11:31:08 +01:00
Mikhail Smirnov
8f8ca40f63
Improve SSL detection, prevent false positive SSL detection
2018-11-09 00:46:25 +03:00
Luca Deri
b98373f390
Improved Messenger/Hangout detection
2018-11-08 22:31:58 +01:00
Luca Deri
8e6640605a
Removed skype false positives
...
better STUP detection
2018-11-08 22:13:05 +01:00
Luca Deri
9c5a4a6d1f
Added UPnP test pcap
...
updated Nintendo test ourcome
2018-11-07 22:45:29 +01:00
Luca Deri
e240bbd4a4
Implemented UPnP dissector
2018-11-07 22:43:33 +01:00
Luca Deri
f7e7ef2f30
Improved SSL decoding
2018-11-03 10:05:13 +01:00
Luca
875b1e0dd5
Better clang check
2018-11-01 09:36:11 +01:00
Luca Deri
6a4324f451
Merge pull request #628 from madpilot78/Respect_DESTDIR_and_PREFIX
...
Make the examples Makefile respect DESTDIR and PREFIX env vars.
2018-11-01 09:20:38 +01:00
Luca Deri
de37d08c24
Merge pull request #632 from madpilot78/Add_SONAME
...
Add SONAME property to shared library
2018-11-01 09:20:05 +01:00
Guido Falsi
00827903ef
The OS variable was not being populated by default.
2018-10-29 23:15:28 +01:00
Guido Falsi
023830f5ab
Try to fix build on Mac.
2018-10-29 21:24:08 +01:00
Guido Falsi
c2169b3dca
Add command line options to correctly populate the shared object SONAME property.
2018-10-29 17:06:58 +01:00
Luca
01444f79e1
Added NDPI_MIN_NUM_STUN_DETECTION constant
2018-10-29 14:47:53 +01:00
Luca
ecdece83fe
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-10-29 14:44:53 +01:00
Michele Campus
d7478c6ed3
Merge pull request #630 from pchaigno/fix-typo
...
Fix typo in README
2018-10-16 11:01:41 +02:00
Paul Chaignon
b467005fac
Fix typo in README
2018-10-16 10:14:09 +02:00
Guido Falsi
b7b12d5b4e
Make the examples Makefile respect DESTDIR and PREFIX env vars.
2018-10-12 17:22:13 +02:00
Luca
952215c0ac
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-10-11 17:47:10 +02:00
Luca
3e5db956a8
Added further ubuntu servers
2018-10-11 17:47:00 +02:00
kyrol
a62f90073a
fix domain name checking for https://github.com/ntop/nDPI/issues/617
2018-10-11 16:16:55 +02:00
emanuele-f
6789d41993
Fix category match not using client certificate
2018-10-11 12:40:11 +02:00
emanuele-f
4b4f4be3a5
Add -g flag
2018-10-11 12:27:13 +02:00
emanuele-f
40294f3aed
Custom categories have now priority over protocol related categories
2018-10-10 15:56:46 +02:00
emanuele-f
67a1a07ac1
Fix custom categories match by IP not working
2018-10-10 13:33:02 +02:00
emanuele-f
cdf197ccfe
Add function to search host in custom categories
2018-10-10 13:29:49 +02:00
emanuele-f
6ff6c2e5af
Fix category field not accounted in ndpi_get_proto_category
...
Fixes #627
2018-10-10 10:43:51 +02:00
Luca Deri
cf0c8be63d
Merge pull request #616 from wang-xuefei/dev
...
remake clean or remake install failed.
2018-10-09 17:45:23 +03:00
root
1d56c9aa1b
fix remake
2018-10-02 23:54:01 +08:00
Luca Deri
ab2f3cefc8
Merge pull request #612 from xcorail/dev
...
Add LGTM code quality badges
2018-10-02 10:07:04 +02:00
Luca Deri
3cbdbc1db5
Merge pull request #610 from eglooca/pr-nest-log-sink
...
New dissector: Nest Log Sink
2018-10-02 10:06:07 +02:00
Luca Deri
90ca91caa8
Renamed files to avoid name clashes during compilation with other libs
2018-09-29 08:38:00 +02:00
Luca Deri
1f24adc9cd
Renamed source files to avoid clashes
2018-09-29 08:28:26 +02:00
Xavier RENE-CORAIL
a1f7ab776e
Add LGTM.com code quality badges
2018-09-27 13:00:00 +02:00
Luca Deri
f639c237a1
Added check for not going beyond the string lenght
2018-09-24 09:57:51 +02:00
Darryl Sokoloski
46ebf541e1
Removed unused varaibles.
...
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-09-19 22:05:39 -04:00
Darryl Sokoloski
53910f0737
Added missing declarations for nest_log_sink dissector.
...
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-09-19 22:05:03 -04:00
Darryl Sokoloski
31f62c5cf5
New dissector: Nest Log Sink
...
This is a dissector for the Nest Log Sink protocol which is used by the Nest Protect (https://nest.com/ca/smoke-co-alarm/overview/ ).
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-09-19 21:25:16 -04:00
Luca
7117f0532c
Mapped the mining category in ndpi_category_get_name()
2018-09-18 18:32:08 +02:00
Luca
c6b427c252
Implementation of Bitcoin, Ethereum, ZCash, Monero dissectors all identified as mining
...
Implements #503
2018-09-18 18:13:04 +02:00
Luca Deri
b0f9f76b79
Addes support for SMBv1 traffic that has been split from SMBv23
2018-09-17 23:15:44 +02:00
Luca
8689d3293a
Added ndpi_protocol2id() API call
2018-09-17 17:57:47 +02:00
Luca Deri
51fdd12d23
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-09-13 00:11:09 +02:00
Luca Deri
24110acafc
Merge pull request #606 from eglooca/pr-fix-parse-packet-line-info
...
Prevent missing text lines and invalid reads past end-of-buffer.
2018-09-13 01:11:01 +03:00
Michele Campus
f6f242b899
Merge pull request #604 from DanieleDeSensi/dev
...
Bug fix and performance improvement for spotify dissector.
2018-09-13 00:09:56 +02:00
Luca Deri
e8c738282d
Improved Facebook Messenger support
2018-09-13 00:04:19 +02:00
Darryl Sokoloski
c0ed50d5b0
Prevent invalid reads past end-of-buffer.
...
The recent revert commit applied to ndpi_parse_packet_line_info resurrects an old bug where the last lines in packets that end with a CR+NL will not be parsed. This revert commit is an attempt to prevent invalid reads past the end of the packet buffer. This PR moves the end-of-bounds test to before the 16-bit read and returns if true. This fixes the case where a text line ends aligned to the buffer-end boundary, and it fixes the invalid read issue.
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-09-11 17:16:12 -04:00
Daniele De Sensi
f48c7ab8e6
Fixed bug in spotify dissector (subnet /24 was matched as /22).
...
Slight performance improvements in spotify dissector (avoid doing ntohl and masking in each and all if conditions).
2018-09-11 12:41:05 +02:00
诟屍
adcb82d2b5
parse protocol's string_to_match into hex which could be match by hyperscan ( #589 )
...
* if one protocol do not have it's regex (pattern_to_match)
then parse it's string (string_to_match) into hex
so we can match every protocol with hyperscan
* fix string2hex()
* fix init_hyperscan():
check return value of string2hex()
2018-09-11 10:46:13 +02:00
Simone Mainardi
6ac83ce7eb
Fixes broken hyperscan compilation
2018-09-11 10:43:04 +02:00
Luca
b9ae0f8888
Fixes #578
2018-09-11 10:07:39 +03:00
Luca Deri
7b4d335944
Merge pull request #603 from pavlosantoniou/dev
...
Avoid possible NULL pointer dereference in ndpi_detection_process_packet
2018-09-11 10:04:15 +03:00
Luca
9bf05c3534
Indentation fix
2018-09-11 09:33:09 +03:00
Luca
1075283d8e
Fixes #601
2018-09-11 09:26:01 +03:00
Pavlos Antoniou
77ea1c25bd
Avoid possible NULL pointer dereference in ndpi_detection_process_packet
2018-09-09 08:20:54 +00:00
Luca Deri
6373c355cf
Added fix for out of boundary memory access
...
Fixes warning
2018-09-05 23:23:54 +02:00
Campus
225826ce83
FIX: dropbox dissector. UPD: updated pcap file with new dropbox pkts
2018-09-05 16:10:07 +02:00
Luca Deri
0c3989b40f
Merge pull request #596 from madpilot78/Add_back_pkgconfig_file
...
Add back pkgconfig file. It is required by ntopng to find the install…
2018-08-30 11:29:12 +02:00
Luca Deri
4a2525241f
Merge pull request #598 from madpilot78/include_hyperscan_fix
...
Move the configure include file inclusion and code depending on it in…
2018-08-30 11:28:41 +02:00
Luca
ed5b04791e
Added missing -lpthread
2018-08-30 11:26:49 +02:00
Luca
71b28e0774
Cleanup
2018-08-30 11:19:09 +02:00
Luca
33d6f2d52f
Added missing file
2018-08-30 11:17:19 +02:00
Luca
e4f01976a6
Added missing categorization when giveup/guess is called
...
Added optimization for TCP flows that do not start with a SYN packet: early giveup is performed
Code cleanup
2018-08-30 11:10:30 +02:00
Luca
0a33e439bd
Better clang handling
2018-08-30 10:05:53 +02:00
Luca
f948f3525f
Cleaned up makefile
...
Used clang instead of gcc on MacOS
2018-08-30 09:59:39 +02:00
Guido Falsi
396e72f4fe
Move the configure include file inclusion and code depending on it in code protected by the NDPI_LIB_COMPILATION define, this should avoid it polluting the environment when including this file from ntopng.
2018-08-27 17:45:38 +02:00
Guido Falsi
d31a29bf6a
Adapt pkgconfig file include path to new Makefile install location.
2018-08-26 00:35:01 +02:00
Guido Falsi
405e2f8dd0
Add back pkgconfig file. It is required by ntopng to find the installed shared library.
2018-08-25 23:42:20 +02:00
Luca
a98c0a81be
Added target for shared liubrary creation
...
Added target for install
Fixes #593
2018-08-25 10:50:16 +02:00
Campus
2f83375eec
Merge branch 'eglooca-pr-remove-autoconf-include' into dev
2018-08-23 12:09:51 +02:00
Campus
2b9b996148
Merge branch 'pr-remove-autoconf-include' of https://github.com/eglooca/ndpi-pr into eglooca-pr-remove-autoconf-include
2018-08-23 12:01:14 +02:00
Michele Campus
48f3104774
Merge pull request #591 from alm-A/patch-2
...
README add protocol : removed Makefile.am step
2018-08-23 12:00:02 +02:00
Michele Campus
b8571475c9
Merge pull request #592 from alm-A/patch-3
...
ndpi_typedefs.h : missing include
2018-08-23 11:59:31 +02:00
Campus
ff83bfbad0
ADD: add prototype of function ht_free in hash.h - DEL: delete include file .c in ndpi_main.c
2018-08-23 11:22:21 +02:00
alm-A
dd307af215
ndpi_typedefs.h : missing include
...
include to ndpi_protocol_ids.h needed for:
- NDPI_PROTOCOL_SIZE
- NDPI_MAX_SUPPORTED_PROTOCOLS
- NDPI_MAX_NUM_CUSTOM_PROTOCOLS
2018-08-22 16:37:59 +02:00
alm-A
58a784e342
README add protocol : removed Makefile.am step
2018-08-22 16:18:44 +02:00
Luca Deri
89b3b085af
Moved to 2.5.0
2018-08-22 08:45:13 +02:00
Simone Mainardi
e6c3c0139a
Updates changelog release date
2018-08-21 18:13:54 +02:00
Simone Mainardi
aad896c2a8
Updates ChangeLog
2018-08-21 18:12:36 +02:00
Luca Deri
1a6a9593fb
Changed type to ease compilation accross platforms
2018-08-20 14:49:59 +02:00
Luca Deri
6cb40ac75e
Compilation fix
2018-08-20 12:39:55 +02:00
Luca Deri
50591238e5
Merge pull request #586 from eglooca/pr-sys-types-include-for-actypes-h
...
Include <sys/types.h> for u_int16_t.
2018-08-17 14:18:27 +02:00
Simone Mainardi
291acb9459
Hyperscan regex for domains such as .com.cn or .co.uk
2018-08-17 13:13:26 +02:00
Simone Mainardi
47c2ad1b5f
Webex category fix
2018-08-17 12:59:19 +02:00
Simone Mainardi
6491568e15
Fixes hyperscan WeChat detection
2018-08-17 12:48:53 +02:00
Simone Mainardi
28ac30d827
Fixes hyperscan skype detection
2018-08-17 12:41:35 +02:00
Simone Mainardi
db74459ca2
Fixes weibo detection
2018-08-17 12:29:08 +02:00
Simone Mainardi
d2bc3ea209
Initial hyperscan support for all protocols
2018-08-17 12:00:28 +02:00
Darryl Sokoloski
cd9d456994
Include sys/types.h for u_int16_t.
...
On various embedded environments (OpenWrt, EdgeOS), <sys/types.h> must be included for u_intX_t types. The Hyperscan changes made recently introducted a u_int16_t member in actypes.h which is undeclared in certainly environments without this include.
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-08-16 22:31:23 -04:00
Darryl Sokoloski
06befec642
Remove autoconf include from typedefs headers.
...
Including this file in any "public" API header breaks all projects that also use autotools because macros such as PACKAGE_VERSION will be redefined.
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-08-16 22:24:15 -04:00
Simone Mainardi
579f1b05db
Adds hyperscan support for Apple and Dropbox
2018-08-16 19:42:04 +02:00
Simone Mainardi
7e41309fa9
Hyperscan compilation fix
2018-08-16 15:43:35 +02:00
Luca Deri
3091dc3c48
Fix for #400
2018-08-16 15:23:30 +02:00
Luca Deri
01bf295a19
Completed custom category implementation
2018-08-16 14:57:44 +02:00
Luca Deri
f88648fbc8
Tests update
2018-08-16 12:05:07 +02:00
Luca Deri
18b9589e50
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-08-16 12:03:23 +02:00
Luca Deri
9847c2ccbb
Generic protocol cleanup (work in progress)
2018-08-16 12:03:09 +02:00
Simone Mainardi
335b336968
Hyperscan compilation fixes
2018-08-16 11:47:10 +02:00
Luca Deri
70eb619b86
Merge pull request #584 from eglooca/pr-memcached
...
Added new dissector for Memcached.
2018-08-16 09:36:35 +02:00
Darryl Sokoloski
b3b8feabf1
Added new dissector for Memcached.
...
Signed-off-by: Darryl Sokoloski <darryl@sokoloski.ca >
2018-08-15 16:47:21 -04:00
Luca Deri
d9cf798753
Updated YouTube support
2018-08-06 10:34:45 +02:00
Luca Deri
cbb2eb8c8f
Merge pull request #576 from eglooca/pr-ssdp-min-length
...
Adjust the SSDP dissector's minimum packet length
2018-07-25 08:18:17 +02:00
Luca Deri
6474125c93
Merge pull request #577 from eglooca/pr-parse-packet-line-info-length
...
Fix end-of-line bounds handling.
2018-07-25 08:17:32 +02:00
Luca Deri
5100cc0eae
Added checks for missing protocol initialization
...
Fixed missing LOG_ERR initialization
Fixed logging warnings
2018-07-23 14:58:16 +02:00
Luca Deri
49ed41142c
Fixed SEGV with undepcified protos
2018-07-22 21:06:10 +02:00
Luca Deri
659649d2e9
Fixed warning
2018-07-21 18:23:48 +02:00
Luca
5246656ae0
Fixed required library prefix
2018-07-21 16:27:05 +02:00
Luca
f828dfc202
Added comment about typedefs
2018-07-21 16:17:12 +02:00
Luca
591158bb92
Defined type ndpi_protocol_id_t for protocol identifiers
2018-07-21 16:09:32 +02:00
Luca
667e77c609
Major code cleanup
...
Converted some not popular protocols to NDPI_PROTOCOL_GENERIC with category detection
2018-07-21 16:02:54 +02:00
Luca
a499f369a5
Updated results based on the new output format
2018-07-21 15:20:11 +02:00
Darryl Sokoloski
fbf6bd2be8
Fix end-of-line bounds handling.
...
The existing implementation misses ending lines and as a result, fails
to match certain protocols (SMTP for example, which needs to see at
least 3 commain/response matches). It appears from the commit history
that an attempt was made (end-1) to prevent reads past payload length.
This can be ensured by simply not reading any payload that is < 3 bytes.
The updated logic for this loop is:
- Payload length is >= 3 bytes, or return.
- Loop over payload, compare for EOL (CR + NL) sequence.
- If found, process string.
- If index 'a' plus two is less than payload length, increment 'a' by
one and continue.
- Loop return always increments index 'a' by one.
2018-07-20 13:51:17 -04:00
Darryl Sokoloski
212598b45e
Added example SSDP M-SEARCH capture file.
2018-07-20 13:28:38 -04:00
Darryl Sokoloski
8b0e735f67
Decreased minimum packet payload length down to 19 from 100 for SSDP.
...
The minimum packet payload length is: "NOTIFY * HTTP/1.1" + 0x0d + 0x0a (19 bytes).
2018-07-20 13:26:44 -04:00
Simone Mainardi
d9c963061b
Fixes invalid NDPI_MAX_SUPPORTED_PROTOCOLS
2018-07-20 18:52:00 +02:00
Luca Deri
30b72eae64
Changed RTP from VoIP to Media category
2018-07-18 21:29:26 +02:00
Luca Deri
475f54e9d1
Fixed name clash
2018-07-18 17:33:28 +02:00
Luca Deri
34dfe7d375
Improved tor detection to limit false positives
2018-07-17 18:21:06 +02:00
Luca Deri
06789406ad
Pattern match improvements
2018-07-17 17:49:59 +02:00
Luca Deri
1ebc510bcb
Fied substring matching
2018-07-17 15:48:24 +02:00
Luca Deri
90ffa1fc2c
Updated twitter invalid address range
...
Using content substring match in category search
2018-07-16 09:21:34 +02:00
Michele Campus
f942cef2f1
Merge pull request #573 from protohuf/dev
...
Added showmax.com detection
2018-07-02 23:04:31 +02:00
Marcus Hufvudsson
7fce8f02d2
Added showmax.com detection
2018-07-02 19:54:37 +02:00
Luca
3986a951d8
Suppressed invalid messages with -q
...
-j now accepts - as stdout
2018-06-21 16:13:18 +02:00
Luca Deri
22356fa69b
Added site unavailable category
2018-06-11 17:01:20 +02:00
Luca Deri
e00b06926e
Fix for handling IP address based custom categories
2018-06-11 16:22:02 +02:00
Luca Deri
dc9409ae12
Added missing include
2018-06-05 23:02:24 +02:00
Daniele De Lorenzi
3b1047b0c8
Merge pull request #9 from ntop/dev
...
updates from dev
2018-05-31 16:29:04 +02:00
Simone Mainardi
2b4321b5c3
Fixes invalid NDPI_MAX_SUPPORTED_PROTOCOLS
...
Fixes https://github.com/ntop/nDPI/commit/c77ec63e
2018-05-31 16:19:48 +02:00
Luca Deri
6b16ad709e
Fix for #560
2018-05-29 22:50:18 +02:00
Campus
3407db11cd
added new viber pcap and updated results
2018-05-29 20:37:02 +02:00
Luca Deri
326a2fb7ed
Fix for https://github.com/ntop/nDPI/issues/572
2018-05-28 18:18:19 +02:00
Luca Deri
eef175e579
Merge pull request #571 from Dark-Vex/rapidvideo
...
Added Rapidvideo
2018-05-28 17:27:53 +02:00
Daniele De Lorenzi
7989b8d969
Merge pull request #8 from Dark-Vex/rapidvideo
...
Added RapidVideo
2018-05-25 22:03:14 +02:00
Daniele De Lorenzi
9af00fdb4c
Merge branch 'dev' into rapidvideo
2018-05-25 21:57:38 +02:00
Daniele De Lorenzi
6c2cfb34f7
Merge pull request #7 from Dark-Vex/vidto
...
Added VidTO streaming service
2018-05-25 21:51:15 +02:00
Daniele
5171309c43
Added RapidVideo
2018-05-25 21:41:14 +02:00
Daniele
c77ec63ed8
Added VidTO streaming service
2018-05-25 20:34:37 +02:00
Daniele De Lorenzi
30afa082e4
Merge pull request #6 from ntop/dev
...
Merge branch 'Dark-Vex-viber' into dev
2018-05-25 18:54:26 +02:00
Daniele De Lorenzi
ea64f8b0da
Merge pull request #5 from Dark-Vex/viber
...
Viber
2018-05-25 18:52:06 +02:00
Daniele De Lorenzi
e2310751f1
Updated Viber ports
...
New ports taken from
https://support.viber.com/customer/portal/articles/1506350-opening-ports-for-viber-desktop
2018-05-24 12:14:09 +02:00
Daniele De Lorenzi
47b5e45f13
Updated Viber subnet and domain
...
Added the new subnet, added viber.it and removed the old subnet 54.169.X since are no more part of viber network
daniele@bart:~$ whois 54.169.63.160
[Querying whois.arin.net]
[whois.arin.net]
#
# ARIN WHOIS data and services are subject to the Terms of Use
# available at: https://www.arin.net/whois_tou.html
#
# If you see inaccuracies in the results, please report at
# https://www.arin.net/resources/whois_reporting/index.html
#
NetRange: 54.160.0.0 - 54.175.255.255
CIDR: 54.160.0.0/12
NetName: AMAZON-2011L
NetHandle: NET-54-160-0-0-1
Parent: NET54 (NET-54-0-0-0-0)
NetType: Direct Allocation
OriginAS:
Organization: Amazon Technologies Inc. (AT-88-Z)
RegDate: 2014-06-20
Updated: 2014-06-20
Ref: https://whois.arin.net/rest/net/NET-54-160-0-0-1
2018-05-24 12:14:09 +02:00
Campus
31275398aa
Merge branch 'Dark-Vex-viber' into dev
2018-05-24 11:40:51 +02:00
Daniele De Lorenzi
c1166c37d1
Updated Viber ports
...
New ports taken from
https://support.viber.com/customer/portal/articles/1506350-opening-ports-for-viber-desktop
2018-05-24 11:16:32 +02:00
Daniele De Lorenzi
5420b6359b
Updated Viber subnet and domain
...
Added the new subnet, added viber.it and removed the old subnet 54.169.X since are no more part of viber network
daniele@bart:~$ whois 54.169.63.160
[Querying whois.arin.net]
[whois.arin.net]
#
# ARIN WHOIS data and services are subject to the Terms of Use
# available at: https://www.arin.net/whois_tou.html
#
# If you see inaccuracies in the results, please report at
# https://www.arin.net/resources/whois_reporting/index.html
#
NetRange: 54.160.0.0 - 54.175.255.255
CIDR: 54.160.0.0/12
NetName: AMAZON-2011L
NetHandle: NET-54-160-0-0-1
Parent: NET54 (NET-54-0-0-0-0)
NetType: Direct Allocation
OriginAS:
Organization: Amazon Technologies Inc. (AT-88-Z)
RegDate: 2014-06-20
Updated: 2014-06-20
Ref: https://whois.arin.net/rest/net/NET-54-160-0-0-1
2018-05-24 11:12:15 +02:00
Daniele De Lorenzi
5e47871256
Merge pull request #1 from ntop/dev
...
fetch new commit
2018-05-24 10:57:28 +02:00
Luca Deri
1585503809
Added Musical.ly support
2018-05-23 22:53:03 +02:00
Campus
60636a9a88
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-05-23 18:32:04 +02:00
Campus
fcf4b25bc3
update google hangout detection from string
2018-05-23 18:31:27 +02:00
Luca
0efc4a706d
Added custom categories
...
CUSTOM_CATEGORY_MINING = 99
CUSTOM_CATEGORY_MALWARE = 100
CUSTOM_CATEGORY_ADVERTISEMENT = 101
CUSTOM_CATEGORY_BANNED_SITE = 102
Updated test results
2018-05-23 17:49:07 +02:00
Luca Deri
fb7416cb9d
Merge pull request #565 from Dark-Vex/dev
...
SMTPS on port 587 is not detected and Updated AmazonVideo
2018-05-23 16:53:26 +02:00
Daniele De Lorenzi
32c62faa78
Updated AmazonVideo
...
Updated CDN list of PrimeVideo
2018-05-22 11:28:17 +02:00
Daniele De Lorenzi
363deeb23d
Added support for SMTPS on port 587
...
Added support for SMTPS on port 587
2018-05-21 17:26:00 +02:00
Daniele De Lorenzi
131f68117b
Update ssl.c
...
Added support for SMTPS on port 587
2018-05-21 17:23:32 +02:00
Michele Campus
05cef1d69a
Merge pull request #564 from Dark-Vex/dev
...
Cloudflare detection
2018-05-21 16:31:11 +02:00
Daniele De Lorenzi
71ef54f561
Update ndpi_content_match.c.inc
...
Removed 64.68.192.0 since is no more part of Cloudflare according to the whois data
NetRange: 64.68.192.0 - 64.68.207.255
CIDR: 64.68.192.0/20
NetName: EDNS
NetHandle: NET-64-68-192-0-1
Parent: NET64 (NET-64-0-0-0-0)
NetType: Direct Assignment
OriginAS: AS16686
Organization: easyDNS Technologies, Inc. (EASYD-2)
RegDate: 2008-06-12
Updated: 2012-03-02
Comment: ARINA51-ARIN
Ref: https://whois.arin.net/rest/net/NET-64-68-192-0-1
2018-05-21 08:14:01 +02:00
Daniele De Lorenzi
f9c217e42a
Update ndpi_content_match.c.inc
...
Updated Cloudflare subnet
2018-05-19 20:21:26 +02:00
Luca Deri
36c1b72118
Updated test resuls
2018-05-18 23:22:14 +02:00
Luca Deri
6dd42d19f7
Implemented Facebook Messenger (mobile) support
...
Code cleanup
2018-05-18 23:10:00 +02:00
Luca Deri
5d3ac78250
Fixed memory leak
...
Optimized memory usage
2018-05-18 10:15:05 +02:00
Luca Deri
f56b083bc3
Implemented FacebookZero protocol support
...
https://code.facebook.com/posts/608854979307125/building-zero-protocol-for-fast-secure-mobile-connections/
Discontinued filetopia protocol
2018-05-18 00:55:21 +02:00
Campus
79be44ddea
fix spotify detection
2018-05-17 22:54:03 +02:00
Luca Deri
dcdd7562f4
Implemented hash-based categories
2018-05-16 00:09:12 +02:00
Luca Deri
66b759ca69
Hidden ndpi_detection_module_struct definition
2018-05-14 22:58:14 +02:00
Luca Deri
529492e81f
Updated test results
2018-05-14 21:42:19 +02:00
Luca Deri
1076455c01
Added ndpi_set_detection_preferences() APi call
2018-05-14 21:40:27 +02:00
Luca Deri
2d486aeed8
Skype CallIn/CallOut are not set as
...
Skype.SkypeCallOut
Skype.SkypeCallIn
2018-05-14 19:23:15 +02:00
Luca Deri
00c35e48a2
Added
...
- ndpi_load_hostname_category()
- ndpi_enable_loaded_categories()
in the list of exported API calls
2018-05-11 16:04:47 +02:00
Luca Deri
8380b505f4
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-05-11 13:49:11 +02:00
Luca Deri
564d622cc9
Added ndpi_fill_protocol_category call
...
Introduced intitial Skype in/out support
2018-05-11 13:48:14 +02:00
Luca Deri
a067350098
Hyperscan fixes
2018-05-11 09:06:07 +02:00
Luca Deri
50216991bd
Improved hyperscan support and category definition
2018-05-10 23:46:35 +02:00
Alfredo Cardigliano
3707553906
host_server_name size fix
2018-05-05 10:01:02 +00:00
Michele Campus
b8fec1e3ce
Merge pull request #557 from dsokoloski/pr-gitignore-updates
...
Clean-up/sort: .gitignore
2018-05-04 18:50:44 +02:00
Michele Campus
979330392e
Merge pull request #558 from gozzy/dev
...
SSH: increase client's maximum payload length from 100 to 500
2018-05-04 18:49:56 +02:00
Alexander Gozman
11898f0268
SSH: increase client's maximum payload length from 100 to 500
...
According to RFC4253, a client may send additional data right after
its identification string (before receiving the server's identification
string). For instance, PuTTY sends supported ciphers. This exceeds
100 bytes and nDPI fails to detect such SSH sessions.
2018-05-04 07:17:17 +00:00
Luca Deri
78176d2b7b
Added timeseries dump (disabled by default)
2018-05-02 00:11:55 +02:00
Luca Deri
64633939e0
Added NetFlix block for Rogers
2018-04-28 10:07:54 +02:00
emanuele-f
f717be19cb
Fix custom categories matching
2018-04-27 15:02:51 +02:00
Darryl Sokoloski
9c6c15cd6b
Clean-up/sort: .gitignore
2018-04-26 16:33:58 -04:00
Luca
3adccc98f7
Implemented custom category loading.
...
Modified ndpiReader with -c <file> (use mining_hosts.txt as example) for loading name-based categories
2018-04-26 21:10:59 +02:00
Michele Campus
79f3199339
Merge pull request #553 from dsokoloski/pr-debug-call-back
...
Added missing file, func, and line parameters to call-back typedef.
2018-04-26 11:45:36 +02:00
Campus
23042b3c9a
Merge branch 'dsokoloski-pr-autoconf-config-include-fix' into dev
2018-04-26 11:43:59 +02:00
Campus
e819899221
Merge branch 'pr-autoconf-config-include-fix' of https://github.com/dsokoloski/nDPI into dsokoloski-pr-autoconf-config-include-fix
2018-04-26 11:43:00 +02:00
Luca Deri
b92541a08e
Added flow and timing support
2018-04-26 00:04:26 +02:00
Darryl Sokoloski
c54a8f8cfa
Moved ndpi_config.h from ndpi_main.h to ndpi_main.c, and example source files.
2018-04-24 10:21:47 -04:00
Darryl Sokoloski
3b5f32f261
Added missing file, func, and line parameters to debug call-back typedef.
2018-04-24 10:20:06 -04:00
Luca Deri
7798b964fe
Replaces outdates socrates protocol with ntop
2018-04-24 15:48:46 +02:00
Campus
44e2e0beea
Merge branch 'leonn-AJP_protocol' into dev
2018-04-23 15:50:06 +02:00
Campus
32a9b8fd14
Merge branch 'AJP_protocol' of https://github.com/leonn/nDPI into leonn-AJP_protocol
2018-04-23 15:48:46 +02:00
Leonn
5a7f58d23f
💡 Add Apache JServ Protocol Dissector
2018-04-22 01:54:28 -03:00
Luca
6aaca82d0e
Added fbsbx.com to the list of FaceBook sites
2018-04-18 18:25:11 +02:00
Luca Deri
07a81f5e15
Updated results
2018-04-16 14:21:59 +02:00
Luca Deri
c9a2eb54c1
Merge pull request #539 from felix-jia/fix-mem-leak
...
Fixed memory leak when flow is zeroed out.
2018-04-16 14:19:00 +02:00
Luca Deri
8a59581668
Merge pull request #547 from zyingp/free-after-detect
...
Fix several bugs found by Address Sanitizer (ASan)
2018-04-16 14:16:09 +02:00
Yingpei Zeng
5950ad7ef8
Add length check before several memcmps in msn.c [ASan detected].
2018-04-16 18:47:49 +08:00
Yingpei Zeng
4b720c4f3c
Add length check before do memcmp to "x-steam-sid" in http.c
2018-04-16 16:07:01 +08:00
Yingpei Zeng
480791a057
Add length check before checking a Tor certificate name
2018-04-16 16:01:31 +08:00
Yingpei Zeng
076bd3d1f4
Add a new file to Xcode project
2018-04-16 10:48:30 +08:00
NETAGO
d8e4111a9d
Improved netflix support
2018-04-13 16:36:33 -04:00
Michele Campus
9c1029ff6c
Merge pull request #543 from vel21ripn/fix_packet_time
...
Repaired wrong timestamp calculation.
2018-04-09 16:44:38 +02:00
Michele Campus
56f14ebee4
Merge pull request #545 from vpiserchia/dev
...
added ndpi_process_extra_packet to exported symbols
2018-04-09 16:40:05 +02:00
Vito Piserchia
aa5d06bb1a
added ndpi_process_extra_packet to exported symbols
2018-04-09 00:37:34 +02:00
Vitaly Lavrov
025ca46981
Repaired wrong timestamp calculation.
...
Fixed incorrect type conversion.
Hardcoded constant replaced by structure field.
2018-04-06 22:56:43 +03:00
Simone Mainardi
521afe7e1f
Adds version 2.2.2 ChangeLog
2018-04-06 17:12:47 +02:00
Luca Deri
c7e53724dc
Added protocol placeholders for undefined protocols
2018-04-06 11:34:26 +02:00
Luca Deri
85f25fad6d
Removed NDPI_PROTOCOL_MOVE protocol no longer used
...
Merged NDPI_PROTOCOL_CITRIX_ONLINE with NDPI_PROTOCOL_CITRIX
2018-04-05 23:08:10 +02:00
Luca Deri
b63279af8d
Updated WhatsApp address range
2018-04-03 18:13:42 +02:00
Felix Jia
5281fcf3cd
Fixed memory leak when flow is zeroed out.
2018-03-26 10:20:03 +13:00
Luca Deri
462da90a21
Added API calls
...
ndpi_network_ptree_match
ndpi_check_flow_func
ndpi_config.h is now installed with "make install"
2018-03-23 19:05:32 +01:00
Luca
a2acd09263
Added ndpi_get_api_version() API call to be used in applications that
...
are dynamically linking with nDPI, to make sure the APIs are in sync
2018-03-21 18:33:08 +01:00
Michele Campus
957b01aa71
Merge pull request #531 from zyingp/dev-autogen
...
Add chmod +x to the generated configure file in autogen.sh
2018-03-13 19:44:43 +01:00
Yingpei Zeng
ac31c1ba98
Add chmod +x to the generated configure file
...
Fix an error when running autogen.sh on Ubuntu (16.04 LTS):
./autogen.sh: 49: ./autogen.sh: ./configure: Permission denied
2018-03-06 15:14:38 +08:00
Michele Campus
3aaae46c66
Merge pull request #529 from sparlane/office365_sni
...
Improve SNI matching when using office365
2018-03-05 15:01:40 +01:00
Scott Parlane
53882ef736
Improve SNI matching when using office365
...
Adds additional SNIs that are used when accessing
office365 applications, these didn't have any existing
match.
2018-03-05 13:16:30 +13:00
Luca Deri
21da70fd75
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-03-01 20:54:17 +01:00
Luca Deri
d4a20ba6a8
Increased number of protocols to 512
...
Implemented WhatsApp file exchage support (added test pcap)
2018-03-01 20:52:06 +01:00
Campus
4204e2f614
Merge branch 'dillinger79-dev' into dev
2018-03-01 16:28:32 +01:00
dillinger79
38199a589f
Update ndpi_main.c
2018-03-01 15:45:26 +02:00
dillinger79
b19cd086b4
Merge pull request #3 from ntop/dev
...
update to latest
2018-03-01 14:13:50 +02:00
Luca Deri
e935ee77bf
Updated results after the latest RTP fixes
2018-02-21 08:37:03 +01:00
Luca Deri
6a9fc935eb
Added fix for invalid RTP/Skype detection
...
Added change in config.h generated by nDPI to avoid name clashes (the GNU autotools are really outdated)
2018-02-21 08:18:37 +01:00
Luca Deri
06bb9a9c57
Remove too strict check for RTP
2018-02-21 07:43:59 +01:00
Luca Deri
6e7a1022b2
Added PACKAGE_XXX rename to avoid name clashes when nDPI is used inside another project that use the autotools
2018-02-19 18:50:23 +01:00
Campus
76d058360e
Merge branch 'bjornfor-for-upstream' into dev
2018-02-18 19:49:27 +01:00
Bjørn Forsman
9fa6119f14
autogen.sh: break overlong sed line
2018-02-18 18:47:42 +01:00
Bjørn Forsman
be38c3d90e
autogen.sh: which -> command -v
...
command -v is a POSIX standard, available in all POSIX sh. which is not.
Prefer command -v for portability.
2018-02-18 18:46:04 +01:00
Bjørn Forsman
6ba79afc23
autogen.sh: /bin/rm -> rm
...
For portability, don't assume that /bin/rm exists, rely on $PATH lookup
instead.
This fixes building in sandboxed Nix(pkgs) builds.
2018-02-18 18:45:09 +01:00
Campus
12a1b0d7a3
Merge branch 'vel21ripn-config_gebug' into dev
2018-02-16 22:20:07 +01:00
Campus
029ca0797a
Merge branch 'config_gebug' of https://github.com/vel21ripn/nDPI into vel21ripn-config_gebug
2018-02-16 22:18:43 +01:00
Michele Campus
a5dd00eedb
Merge pull request #523 from zyingp/dev
...
[For Xcode project] Fix some typos and add Macro definitions for Release build as well
2018-02-16 22:14:52 +01:00
Campus
b98f79eaa6
Merge branch 'vel21ripn-libcache' into dev
2018-02-16 22:10:20 +01:00
Campus
16e57f64cd
Merge branch 'libcache' of https://github.com/vel21ripn/nDPI into vel21ripn-libcache
2018-02-16 22:08:21 +01:00
Campus
9e47e49ade
fix wrong increment for MPLS double header
2018-02-15 21:26:38 +01:00
Luca Deri
df54e8b926
Improved numeric to protocol conversion
2018-02-12 21:44:48 +01:00
Luca
01949c47da
Fixed typo
2018-02-12 11:08:37 +01:00
Luca Deri
52a2c0589e
Updadate last protocol id
...
Updated tests with new protocols
2018-02-11 21:11:36 +01:00
Luca Deri
12368ba2d5
Implemented supporto for GoogleDocs and AmazonVideo
...
Fixed various bugs in detecting Google Drive
Improved Spotify support
2018-02-11 19:36:13 +01:00
Yingpei Zeng
053dbd73a6
[For Xcode project] Change some typos in README.md and add macro definition for release build as well
2018-02-11 13:58:09 +08:00
Yingpei Zeng
8f631fa19d
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2018-02-11 11:09:51 +08:00
Luca Deri
344392868b
Added 179 to the default BGP port list
2018-02-09 18:24:35 +01:00
Vitaly Lavrov
0624afd422
Added option --enable-debug-messages.
...
The configurator option "--enable-debug-messages" is added to enable
debug information output (define NDPI_ENABLE_DEBUG_MESSAGES=1).
Mandatory inclusion of the file ndpi_config.h in all the compiled files.
2018-02-07 16:31:35 +03:00
Vitaly Lavrov
c3f5307a3d
Update libcache
...
Using ndpi_calloc(), ndpi_free() in libcache.
Fixing warnings about mixing declaration and code.
2018-02-06 14:06:38 +03:00
zyingp
e6412949f1
Merge pull request #1 from ntop/dev
...
Merge the latest main branch
2018-02-05 09:32:28 +08:00
Luca Deri
ea74d87fd8
Merge pull request #519 from zyingp/dev
...
Add an Xcode project for easier debugging on MacOS
2018-02-04 10:01:39 -08:00
ZengYingpei
5e0880dac6
Reset optind of getopt_long for synthesizing command line input stably in the Xcode project
2018-02-04 15:34:04 +08:00
ZengYingpei
26e36a19bf
Unify Copyright declaration for all added files of the Xcode project
2018-02-04 14:35:56 +08:00
ZengYingpei
aea81e4a1a
Add an Xcode project for debugging under MacOS (add all missed files)
2018-02-04 14:21:52 +08:00
ZengYingpei
39b9f6752c
Add an Xcode project for debugging under MacOS
2018-02-04 14:19:38 +08:00
Campus
73b4019561
update results for test pcap
2018-02-03 19:56:14 +01:00
Campus
3b5d8177f7
fix wrong conversion dec to hex
2018-02-03 17:06:28 +01:00
Simone Mainardi
f8c6e9d714
Fixes possible out-of-bounds due to malformed DHCP packets
2018-01-31 17:15:55 +01:00
Luca Deri
da588f6a30
Improved hyperscan support
2018-01-26 23:40:23 +01:00
Luca
ee7a30385b
Added minor hardening code in STUN
2018-01-26 19:45:41 +01:00
Michele Campus
809535e0a2
Merge pull request #510 from vel21ripn/dev
...
Fix buffer overflow in function ndpi_debug_printf()
2018-01-26 15:04:38 +01:00
Vitaly Lavrov
57fb117571
Fix buffer overflow in function ndpi_debug_printf()
2018-01-26 13:03:17 +03:00
Luca Deri
78feabfad7
Inital hyperscan work
2018-01-24 22:11:05 +01:00
Luca Deri
54306411a4
Merge pull request #508 from emanuele-f/hyperscan
...
Initial support for Intel hyperscan pattern matching library
2018-01-24 18:09:12 +01:00
Luca Deri
f2280c90a4
Merge pull request #482 from hvanderheide/dev
...
Revert the revert of 2155dd9 after fixing ntopng Travis
2018-01-24 18:08:44 +01:00
emanuele-f
e09ebab0c2
Initial support for Intel hyperscan pattern matching library.
2018-01-24 16:47:23 +01:00
Luca Deri
d18824a73f
Cleaned up Amazon IP range
...
Improved HostShield VPN
2018-01-19 14:33:43 +01:00
Luca Deri
d2d20a8aa4
Warnign fix
2018-01-16 16:39:30 +01:00
Luca Deri
fbf7fe2424
Implemented Google services detection
...
Refreshed google-based services support
2018-01-16 15:57:45 +01:00
Luca Deri
ced9658c63
Added ApplePush support
2018-01-15 20:13:34 +01:00
Hidde van der Heide
d896ce7469
Merge remote-tracking branch 'upstream/dev' into dev
2018-01-10 10:40:54 +01:00
Michele Campus
77cb8ccaea
Merge pull request #506 from cavedon/dev
...
Fix MPLS header parsing in ndpiReader.
2018-01-09 22:13:57 +01:00
Ludovico Cavedon
35dc6e27ae
Fix MPLS header parsing in ndpiReader.
...
Reported at https://bugs.debian.org/886133 .
The current parsing for the MPLS header in examples/ndpi_util.c has
multiple issues:
- the bitfield order is incorrect for little endian architectures
- ntohl() is applied to a 20 bit label, which has unclear purpose
- if multiple labels are detected, the while loop parsing labels will
never exit due to a missing re-read of the mpls label
- the last label is identified by looking inside the label field, while
it should be done by looking at the S bit
This change fixes the above issues.
Notice that bitfield ordering is implementation-dependent, so C
bitfields should not be used in the first place to parse network
packets.
2018-01-09 10:26:10 -08:00
Campus
61e297b851
add missing check for free TCP/UDP root in tree
2018-01-05 00:34:33 +01:00
Campus
1d1082342f
added diameter protocol dissector
2018-01-02 13:47:46 +01:00
Luca Deri
f5e366d8c4
Added third party libs
2017-12-25 19:57:03 +01:00
Luca Deri
8d52491508
Added simplified makefile
...
Fixed small warnings
Compilation fixes
2017-12-25 19:26:17 +01:00
Luca Deri
caf602c4a9
Merged categories network and network_tool (way too similar)
...
Replaced former network_tool category with streaming category
2017-12-23 19:40:39 +01:00
Hidde van der Heide
bf8c9c2625
Merge remote-tracking branch 'upstream/dev' into dev
2017-12-20 13:19:24 +01:00
Campus
f024e72eff
Merge branch 'qianguozheng-dev' into dev
2017-12-19 19:56:06 +01:00
qianguozheng
9561f37998
Fix ndpiReader long run crash due to dupilicate nodes exist, cause
...
double free failed.
2017-12-19 17:37:46 +08:00
Campus
13e592275a
Merge branch 'madpilot78-fix_symbols' into dev
2017-12-15 23:51:33 +01:00
Campus
3f9434b81d
Merge branch 'fix_symbols' of https://github.com/madpilot78/nDPI into madpilot78-fix_symbols
2017-12-15 23:51:15 +01:00
Luca Deri
00e6ee3dc3
Implemented GooglePlus support that replaced ancient Quake protocol now obsolete
2017-12-15 10:33:01 +01:00
Luca Deri
a06c399530
Compilation fixes
2017-12-13 08:04:51 +01:00
Simone Mainardi
cd12a86088
Implements ndpi_get_category_id
2017-12-11 20:15:00 +01:00
Luca Deri
61bc528159
Simplified IPv6 datatypes
2017-12-08 18:13:31 +01:00
Campus
811717e7c1
Merge branch 'vel21ripn-dev' into dev
2017-12-07 22:54:49 +01:00
Michele Campus
cb8f4f87bf
Merge branch 'dev' into dev
2017-12-07 22:45:28 +01:00
Luca
dfd8cbc4e1
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2017-12-07 20:31:15 +01:00
Luca
d88a73397d
Fix for #491 (SpeedTest/Ookla)
2017-12-07 18:29:46 +01:00
Luca Deri
90ec8040e6
Improved Apple update pattern
2017-12-06 21:39:56 +01:00
Guido Falsi
f1f8afdddf
Add ndpi_set_proto_category, which is actually uses by ntopng.
2017-12-05 23:10:32 +01:00
Luca Deri
7fd8406916
Fixed invalid symbolic categories
2017-12-05 11:30:29 +01:00
Simone Mainardi
b5a8c6bae8
Bump to version 2.3
2017-12-03 19:09:11 +01:00
Simone Mainardi
a6c56b5682
2.2 changelog
2017-12-03 16:23:35 +01:00
Campus
e5546eb988
Merge branch 'dsokoloski-pull-request' into dev
2017-11-30 21:59:55 +01:00
Darryl Sokoloski
3577072b12
Return before calling ndpi_match_host_subprotocol when dns_dissect_response enabled.
...
Otherwise responses will never be seen if a host sub-protocol matched.
2017-11-30 14:54:23 -05:00
Luca
5b03443693
Added test pcap for check_mk protocol
2017-11-30 10:15:19 +01:00
Luca Deri
8af18763cc
Compilation fixes
2017-11-28 22:05:34 +01:00
Luca Deri
840dab894f
Merge pull request #496 from cymaniac/check_mk
...
Added dissector for protocol check_mk
2017-11-28 21:53:16 +01:00
cymaniac
df7015f3a5
Added dissector for protocol check_mk
2017-11-28 21:29:38 +01:00
Luca Deri
8547b50be7
Merge pull request #493 from evengx/dev
...
Fixed ndpi_win32.h so that it compiles on MinGW+GCC
2017-11-28 17:51:53 +01:00
Luca Deri
7090ef838c
Minor optimizations
2017-11-28 00:44:08 +01:00
Jacob Masen-Smith
950f5db3dd
Changed MinGW __forceinline strategy to something with less side effects
2017-11-23 20:40:43 -08:00
Luca
8eaf0cefa1
Warning fix
2017-11-23 15:39:20 +01:00
Luca Deri
8b1f8636d1
Further check if a STUN flow will eventually become RTP
2017-11-23 15:25:02 +01:00
Luca Deri
1b5c90cfbe
STUN improvements
2017-11-23 14:16:27 +01:00
Jacob Masen-Smith
33e0be73f7
Fixed ndpi_win32.h so that it compiles on MinGW+GCC
2017-11-22 01:11:49 -08:00
Campus
6e62367b56
add ICQ (instant messaging client) detection - deleted unused skyfile protocol
2017-11-20 17:05:15 +01:00
Luca Deri
d6176ff668
Improved ndpiReader output
...
Updated tests
2017-11-19 18:35:26 +01:00
Luca Deri
2831d64f6a
Added YouTube Upload protocol (used the identified unused by NDPI_PROTOCOL_SKYFILE_PREPAID)
2017-11-19 18:11:37 +01:00
Campus
a4532a4999
update Telegram match
2017-11-11 16:23:14 +01:00
Campus
3caac691d5
removed bigrams for src/lib/ndpi_content_match.c.inc
2017-11-11 15:56:16 +01:00
Hidde van der Heide
ee957e0831
Merge remote-tracking branch 'upstream/dev' into dev
2017-11-09 10:14:02 +01:00
Luca
c9f32ee76d
Fixed begin/end type when capturing live traffic
2017-11-03 17:15:04 +01:00
Luca Deri
a488c9b7dc
Fixes #485
2017-11-03 09:32:43 +01:00
Vitaly Lavrov
50645e11d8
Merge branch 'dev' into dev
2017-11-02 10:59:21 +03:00
Michele Campus
3e53577936
Merge pull request #486 from vel21ripn/dev-sip
...
Bug fix. Protocol SIP: command 'CANCEL sip:' is not recognized.
2017-11-01 11:07:37 +01:00
Vitaly Lavrov
a0980228ef
Bug fix. Protocol SIP: command 'CANCEL sip:' is not recognized.
...
Add sip.pcap for tests ( Source: https://wiki.wireshark.org/SIP ).
2017-10-31 22:04:14 +03:00
Alfredo Cardigliano
6e6b623057
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2017-10-30 11:30:14 +01:00
Alfredo Cardigliano
159e6228fe
--ndpi-proto-filter now accepts also protocol name
2017-10-30 11:30:09 +01:00
Luca Deri
cf07c92538
Dropbox and apple improvements
...
Fixed warning
2017-10-29 18:31:31 +01:00
Campus
23e08c93b6
Merge branch 'dsokoloski-upstream-dhcp-client-ident' into dev
2017-10-27 09:52:47 +02:00
Darryl Sokoloski
169aa11adc
Added DHCP class identifier support.
2017-10-26 21:07:00 -04:00
Alfredo Cardigliano
7e38a4f790
Update README.md
2017-10-26 23:23:29 +02:00
Vitaly Lavrov
2787c2390c
Refactoring the debugging output.
...
levels of debug output:
0 - ERROR: Only for errors.
1 - TRACE: Start of each packets and if found protocol.
2 - DEBUG: Start of searching each protocol and excluding protocols.
3 - DEBUG_EXTRA: For all other messages.
Added field ndpi_struct->debug_logging for enable debug output of each protocols.
Simple macros for debugging output are added:
NDPI_LOG_ERR(), NDPI_LOG_INFO(), NDPI_LOG_DBG(), NDPI_LOG_DBG2(),
NDPI_EXCLUDE_PROTO()
2017-10-26 20:41:22 +03:00
Hidde van der Heide
441e43c167
Revert the revert of 2155dd9 after fixing ntopng Travis
...
This reverts commit 4f72b954da .
2017-10-24 17:05:48 +02:00
Simone Mainardi
4f72b954da
Undoes 2155dd9 that breaks ntopng Travis
2017-10-23 15:20:30 +02:00
Campus
5dbe705dd3
Merge branch 'hvanderheide-dev' into dev
2017-10-23 11:05:18 +02:00
Hidde van der Heide
2155dd9153
Add libcache to installed headers and removed relative import
2017-10-19 16:10:56 +02:00
Luca Deri
f7e95b4ee8
Fixed DHCP layout
2017-10-14 14:23:49 +02:00
Luca Deri
36adc23507
Fixed warning generated by some compilers
2017-10-14 13:15:35 +02:00
Luca Deri
2ee871f5e6
Added Android fingerprint
2017-10-14 12:59:28 +02:00
Luca Deri
39d7738042
Implemented DHCP fingerprinting
2017-10-14 12:29:25 +02:00
Luca Deri
75993242b0
Implemented HTTP User Agent discovery
2017-10-14 11:21:01 +02:00
Luca Deri
83d5a46ec4
Added ndpi_icmphdr datatype
2017-10-13 19:41:34 +02:00
Michele Campus
7f197d12dd
Merge pull request #473 from beratx/dev
...
fixed bug
2017-10-12 11:33:47 +02:00
berat
d273b67fd7
fixed bug
2017-10-12 11:18:05 +02:00
Michele Campus
aefd16647e
Merge pull request #472 from beratx/dev
...
extended (-b flag) statistics with top receiver stats
2017-10-10 09:15:34 +02:00
berat
98d1c762cd
extended (-b flag) statistics with top receiver stats
2017-10-09 22:21:40 +02:00
Luca Deri
2476c3c1b6
Fixed bug in someip dissector (access out of boundary)
...
Fixed memory leak in ndpiReader
2017-10-08 18:55:40 +02:00
Campus
ed830d2474
update README for json install lib
2017-10-06 20:04:26 +02:00
Luca Deri
8bcafff569
Fixes for iQIYI and 1kxun protocols
2017-10-06 19:08:08 +02:00
Luca Deri
9b91623d57
Added ndpi_is_subprotocol_informative() API call
2017-10-06 15:20:36 +02:00
Luca Deri
27d66f6845
Typo
2017-10-06 09:51:42 +02:00
Luca Deri
b10e526364
Leak fix
2017-10-05 16:21:32 +02:00
Michele Campus
cf26e8429e
Merge pull request #469 from vel21ripn/dev
...
Fix undefined behavior (detected by gcc):
2017-10-03 16:08:14 +02:00
Michele Campus
094ddc2048
Merge pull request #468 from danielengbert/dev
...
Fixed issue #459 by adding missing symbols.
2017-10-03 15:58:07 +02:00
Vitaly Lavrov
25a4569e67
Fix undefined behavior (detected by gcc):
...
ndpi_define.h.in:218: Macros NDPI_SET(), NDPI_CLR(), NDPI_ISSET()
runtime error: left shift of 1 by 31 places cannot be represented in type 'int'
http.c:364: strncpy((char*)flow->protos.http.nat_ip,(char*)packet->forwarded_line.ptr,len);
runtime error: null pointer passed as argument 2, which is declared to never be null
ndpi_patricia.c:ndpi_comp_with_mask(): int m = ((-1) << (8 - (mask % 8)));
runtime error: left shift of negative value -1
Original function ndpi_comp_with_mask() is unreadable and slow.
We have only 2 type of address: 32 bit and 128 bit. The optimized version works 6 times faster (IPv4).
2017-10-03 16:43:23 +03:00
dangbert
47f922fa7b
Fixed issue #459 by adding missing symbols.
2017-10-02 15:35:22 -04:00
Michele Campus
82c244b04f
Merge pull request #466 from vel21ripn/dev-fixerr
...
Fix error: Use of uninitialized structures in tcp_udp.c
2017-10-02 00:45:17 +02:00
Vitaly Lavrov
f80f0eedc0
Fix error: Use of uninitialized structures in tcp_udp.c
...
Now the test results do not depend on the compiler optimization level and architecture.
2017-10-01 22:43:20 +03:00
Campus
1b162234f0
Merge branch 'vel21ripn-dev-tests' into dev
2017-09-29 12:18:00 +02:00
Campus
3ac47a5104
Merge branch 'dev-tests' of https://github.com/vel21ripn/nDPI into vel21ripn-dev-tests
2017-09-29 12:15:13 +02:00
Vitaly Lavrov
b2f0558080
A more predictable sorting of the flows list.
...
It is necessary for correct testing.
2017-09-29 12:46:27 +03:00
Michele Campus
50624b390e
Merge pull request #463 from vel21ripn/dev
...
Fixed a typo in lisp.c
2017-09-29 10:15:19 +02:00
Vitaly Lavrov
1dd93590e4
Fixed a typo in lisp.c
2017-09-29 10:04:03 +03:00
Campus
662ef2f65b
update results after many commits
2017-09-27 16:17:28 +02:00
Michele Campus
83104eb8b6
Merge pull request #460 from beratx/dev
...
memory improvement again for (-b flag) statistics
2017-09-26 22:36:35 +02:00
emanuele-f
cd2a328cc5
Add configure.ac and ndpi_define.h to gitignore
2017-09-26 20:25:40 +02:00
berat
f255b10524
memory improvement again for (-b flag) statistics
2017-09-26 17:20:51 +02:00
berat
4ba6ba70c5
memory usage is improved (-b flag)
2017-09-26 17:01:10 +02:00
Michele Campus
0827a6bf8b
Merge pull request #457 from la10736/fix_ndpiReader_dependencies
...
Fix #456 : ndpiReader depend from uthash.h heder
2017-09-25 15:21:51 +02:00
Michele Campus
4348109931
Merge pull request #455 from beratx/dev
...
improved memory usage by (-b flag) statistics
2017-09-25 15:21:23 +02:00
Michele d'Amico
59097a2d30
Fix #456 : ndpiReader depend from uthash.h heder
2017-09-25 15:08:55 +02:00
Luca Deri
b129487636
Custom protocols are not set as application and no longer master protocols
2017-09-25 14:51:46 +02:00
berat
2c014c5693
improved memory usage by (-b flag) statistics
2017-09-25 12:45:30 +02:00
Michele Campus
80fa0b5f98
Merge pull request #454 from beratx/dev
...
improved (-x flag) bpf filter condition
2017-09-25 11:25:52 +02:00
berat
688d7c33e4
improved (-x flag) bpf filter condition
2017-09-25 11:14:57 +02:00
berat
b0f3852fed
improved (-x flag) bpf filter condition
2017-09-25 11:06:47 +02:00
Michele Campus
cd595caf8d
Merge pull request #452 from beratx/dev
...
fixed another memory leak
2017-09-25 08:29:04 +02:00
Luca Deri
c115903fbb
Patch for giving prority in case of match to custom-defined protocols
2017-09-24 22:49:07 +02:00
berat
807db80afc
fixed another memory leak
2017-09-24 18:43:31 +02:00
Michele Campus
8939a72ea8
Merge pull request #450 from beratx/dev
...
fixed memory leak
2017-09-24 15:16:23 +02:00
berat
baae16ec2f
memory leak fixed
2017-09-23 19:55:47 +02:00
berat
41b40ddf18
memory leak fixed
2017-09-23 19:50:52 +02:00
Luca Deri
8cc2b04f3c
Fixed category for email services
2017-09-23 11:34:12 +02:00
Michele Campus
98b3268bfb
Merge pull request #449 from beratx/dev
...
typos and renames
2017-09-22 20:55:02 +02:00
berat
f575959cd2
typos and renames
2017-09-22 19:00:27 +02:00
Luca Deri
c2002cd48f
Removed / from category names that can cause issues in applications
2017-09-21 19:35:03 +02:00
Luca Deri
9fb5981128
Added ndpi_category_set_name() API call
2017-09-19 22:39:00 +02:00
Luca Deri
1a4e57e736
Code rework
2017-09-17 23:34:46 +02:00
Luca Deri
d6f7dd9c08
Implemented DHCP field 55 decode
2017-09-17 21:25:55 +02:00
Luca Deri
4176fd5068
Reworked categories
2017-09-15 11:56:40 +02:00
Luca Deri
1808519b5b
Reorganized protocol families
...
Added new API calls ndpi_set_proto_breed() and ndpi_set_proto_category() for overwriting nDPI protocol specifications
2017-09-15 11:23:34 +02:00
Luca Deri
83b1b34c18
Added custom 5 protocol categories to be used by applications. They are currently empty
...
Added ndpi_is_custom_category() to check if a defined category is custom
2017-09-15 11:13:25 +02:00
Campus
b4d535e184
Merge branch 'huniyaarif1-dev' into dev
2017-09-14 11:45:11 +02:00
huniya arif, xflowResearch
f7e9264c36
LISP PROTOCOL by Huniya Arif (xFlowResearch)
2017-09-14 12:52:18 +05:00
huniya arif, xflowResearch
d4d4f2a17c
Added LISP protocol. By Huniya Arif (xFlowResearch)
2017-09-14 11:38:31 +05:00
huniya arif, xflowResearch
d3d6a95da7
Added protocol LISP. By Huniya Arif xFlow Research
2017-09-14 11:05:20 +05:00
Michele Campus
8a6a8ea07e
Merge pull request #445 from beratx/dev
...
Extended filter produced by -b flag
2017-09-13 11:22:04 +02:00
berat
ecb048a7bc
Extended filter produced by -b flag
2017-09-08 18:00:32 +02:00
Campus
8e8445e02f
fix telegram detection
2017-09-03 16:40:41 +02:00
Campus
0e3248b0f7
Merge branch 'k0ste-newfeature' into dev
2017-08-31 11:32:30 +02:00
Campus
0e8756ab46
Merge branch 'newfeature' of https://github.com/k0ste/nDPI into k0ste-newfeature
2017-08-31 11:28:58 +02:00
Luca
b2bc6039da
Partial fix for #410 : added case insensitive HTTP header checks.
...
If the user will provide a pcap for reproducing further potential issues reported we will consider them
2017-08-29 21:32:52 +02:00
Luca
22beb7714d
Implements #376
2017-08-29 20:56:08 +02:00
Luca
299b9435d0
Fixed memory out-of-bound issue
...
Added extra check for fixing #366
2017-08-29 19:56:32 +02:00
Konstantin Shalygin
31478703c2
Backported CSGO/DOTA2 protocol.
2017-08-26 15:41:04 +07:00
Michele Campus
a1367a9d39
Merge pull request #438 from pauloangelo/dev
...
HTTP respose status code after validation check.
2017-08-21 14:08:45 +02:00
Paulo Angelo
7dc20134c0
Merge remote-tracking branch 'upstream/dev' into dev
2017-08-19 14:21:06 -03:00
Paulo Angelo
63c97753a1
Respose status code after validation check.
2017-08-19 14:19:30 -03:00
Campus
5515c3a109
fix for https://github.com/ntop/nDPI/issues/437
2017-08-18 10:11:41 +02:00
Luca Deri
5547ef06b3
Collapsed email send and receive categories in a new email category
2017-08-17 17:55:52 +02:00
Campus
65b39240aa
Merge branch 'pauloangelo-i434' into dev
2017-08-14 10:44:43 +02:00
Paulo Angelo
449e06df77
Code formating and some improvements on HTTP (issue 434)
2017-08-11 17:52:32 -03:00
Paulo Angelo
c4885fe260
Merge remote-tracking branch 'upstream/dev' into dev
2017-08-11 13:39:12 -03:00
Paulo Angelo
5a8aa3d72d
Windows 10 detection from UA and indentation
2017-08-11 13:38:46 -03:00
Campus
7ad04a2184
Merge branch 'pauloangelo-dev' into dev
2017-08-09 19:41:52 +02:00
Paulo Angelo
d8ed5b1005
final revision.
2017-08-09 14:17:07 -03:00
Paulo Angelo
93ceb14302
few classification adjusts
2017-08-09 14:08:28 -03:00
Campus
0326442faf
add SoundCloud detection for https://github.com/ntop/nDPI/issues/396
2017-08-09 18:14:41 +02:00
Campus
89f1e663fa
update results
2017-08-09 15:57:15 +02:00
Campus
5e2f75f5f0
Merge branch 'pauloangelo-dev' into dev
2017-08-09 15:51:48 +02:00
Paulo Angelo
7cab6efcd5
Issue 118 implementation (risk classification), indentation, and PasteBin&LinkedIn added.
2017-08-08 18:06:33 -03:00
Paulo Angelo
d79c5ffc24
Identation and comments only.
2017-08-08 15:48:27 -03:00
Luca
3ba3a08141
Implemented flow sort based on total bytes so that we can (with -v X) immediately spot elephants and mice
2017-08-02 20:15:21 +02:00
Luca Deri
1d4eeaa328
Removed invalid networks from google list
2017-07-30 13:57:12 +02:00
Campus
b1f6ac1a84
updated results
2017-07-29 23:48:25 +02:00
Campus
a90b97bc10
fix wrong datalink type for Cisco PPP
2017-07-29 23:44:47 +02:00
Michele Campus
f336f1a340
Merge pull request #428 from k0ste/newfeature
...
Added Sony Playstation protocol.
2017-07-29 22:14:52 +02:00
Konstantin Shalygin
fbfe3e004c
Added Sony Playstation protocol.
2017-07-29 16:52:03 +07:00
Luca
9a809bf673
Improved TeamViewer support
2017-07-29 06:55:50 +02:00
Michele Campus
baa761a2e2
Merge pull request #427 from alagoutte/fix_warning
...
Fix warning
2017-07-28 18:59:47 +02:00
Alexis La Goutte
ad401c4192
ndpi_main.c: fix unused variable 'rc' [-Werror,-Wunused-variable]
2017-07-28 13:46:02 +00:00
Alexis La Goutte
5ebc85e705
ndpiReader.c: fix variable ‘fileName’ set but not used [-Werror=unused-but-set-variable]
2017-07-28 13:45:59 +00:00
Alexis La Goutte
b021f5bce1
ndpiReader.c fix ‘getTopStats/deleteTopStats/top_stats_sort/scanners_port_sort/scanners_sort/deleteScanners’ defined but not used [-Werror=unused-function]
2017-07-28 13:45:56 +00:00
Alexis La Goutte
5f1131cae2
ndpiReader: fix file_first_time/_statsFilePath defined but not used [-Werror=unused-variable]
2017-07-28 13:45:49 +00:00
Campus
f664aee00b
results updated 2
2017-07-27 13:37:09 +02:00
Campus
01649f097c
results updated
2017-07-27 13:15:37 +02:00
Campus
abf5bea425
Merge branch 'MicahLyle-ssl-certificate-fix' into dev
2017-07-27 13:12:12 +02:00
Michele Campus
6ca6d96821
Merge branch 'dev' into ssl-certificate-fix
2017-07-27 13:10:08 +02:00
Luca Deri
e6b594a626
Fixed TINC bug (cache usage)
...
Merged MS Lync with Skype (Microsoft renamed MS Lync in Skype for Business)
Renumbered Nintendo protocols in former MS Lync that was no longer used
Fix for #425
2017-07-27 00:18:15 +02:00
Luca Deri
c15f2bda97
Implemented support for Nintendo (switch) gaming protocol
2017-07-26 19:59:46 +02:00
Luca Deri
41c720d951
Added test file for skype conf call
2017-07-26 11:57:51 +02:00
Luca Deri
be52d4e9ad
Removed unused variable
2017-07-25 16:56:15 +02:00
Luca
7ec3af2156
Removed reference to ndpi_init_placeholder_proto() that is no longer necessary
2017-07-25 16:45:22 +02:00
emanuele-f
bab373f992
Add nintendo protocol
2017-07-24 12:06:13 +02:00
Micah Lyle
55d1362924
Updated tests to match new SSL server certificate fix/addition
2017-07-18 12:53:02 -07:00
Micah Lyle
6e85b93442
Implementation for extra packet processing if desired
2017-07-17 18:06:07 -07:00
Micah Lyle
2e13e44b9c
Added testing scripts and commited files that only had the server diff on the right
2017-07-14 18:19:49 -07:00
Micah Lyle
0b72c2fce3
Fixed tcp ssl case where client cert got set but server did not
2017-07-14 14:55:03 -07:00
Campus
6d7f5552de
changed name from _bpf_filter to bpfFilter to avoid compilation error in OpenBSD caused by redefinition by https://github.com/openbsd/src/blob/master/sys/net/bpf.h#L296
2017-07-13 16:22:34 +02:00
Campus
c5bc91145f
removed warning compilation for - warning: passing argument 3 of 'pcap_compile' from incompatible pointer type
2017-07-09 18:10:10 +02:00
Campus
cfa9a79f67
fix for OpenBSD compile error https://github.com/ntop/nDPI/issues/417
2017-07-07 12:50:06 +02:00
Luca Deri
d66e473a2c
Code cleanup
...
Updated test results
Renamed SOMEIP -> someip
2017-07-06 09:28:15 +02:00
Luca Deri
9bfab472e4
Win fix
2017-07-06 08:29:21 +02:00
Campus
1a605e2b77
Merge branch 'beratx-dev' into dev
2017-07-01 11:45:19 +02:00
Campus
5c39d65f8f
Merge branch 'dev' of https://github.com/beratx/nDPI into beratx-dev
2017-07-01 11:41:22 +02:00
Luca Deri
5bf6be7eb8
Improved checks on libnuma
2017-06-30 11:32:23 -04:00
berat
e857c5fb41
extended bpf filter produced by -x flag to include hosts
2017-06-30 09:52:26 +02:00
Simone Mainardi
4a1ced3709
Removes invalid char in SOME/IP proto name
2017-06-27 12:10:50 +02:00
Campus
dbb9724c4e
added fix protocol https://github.com/ntop/nDPI/issues/372
2017-06-27 11:38:44 +02:00
Campus
100062a156
Merge branch 'YumingMa-dev' into dev
2017-06-26 12:14:50 +02:00
MaYuming
a40507b8b2
fix compiler error about json
2017-06-25 16:58:50 +08:00
MaYuming
592b769f67
fix lync over ICE detection
2017-06-25 11:15:59 +08:00
Campus
5b8d566a79
Merge branch 'beratx-dev' into dev
2017-06-23 12:41:04 +02:00
berat
7235c9a73a
Added -x flag. Produces a bpf filter based on diagnose information generated by -b flag
2017-06-23 12:14:31 +02:00
Luca
8395bdac97
Implemented RPC latency
2017-06-20 23:16:59 -04:00
Luca
e2119896db
Added protocl info in wireshark info columm
2017-06-20 14:19:55 -04:00
Campus
68f1653dec
fix lync detection
2017-06-19 20:39:36 +02:00
Campus
30d29f7ac3
Merge branch 'YumingMa-dev' into dev
2017-06-19 20:37:52 +02:00
Campus
117e61c34b
Merge branch 'dev' of https://github.com/YumingMa/nDPI into YumingMa-dev
2017-06-19 15:53:36 +02:00
Luca
412cb2e6e8
Label fix
2017-06-17 07:15:50 -04:00
Luca Deri
b11390429c
Merge pull request #409 from beratx/dev
...
Added scanner host stats to (-b) diagnose statistics
2017-06-17 07:08:55 -04:00
berat
5a08303c43
Added scanner host stats to (-b) diagnose statistics
2017-06-16 14:10:54 +02:00
Michele Campus
5fef520d0e
Merge pull request #408 from beratx/dev
...
Fixed bug causing wrong results in (-b) diagnose statistics
2017-06-16 11:34:45 +02:00
berat
6edece628e
Fixed bug causing wrong results in (-b) diagnose statistics
2017-06-16 11:24:16 +02:00
Luca
be749e75a5
Removed tracing
2017-06-15 07:13:29 -04:00
Luca
ac5cb53066
mDNS improvemennts to recognize reponses senst to non multicast addresses
2017-06-15 05:25:27 -04:00
Luca
684c924587
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2017-06-14 21:37:08 -04:00
Luca
090dc752bd
Added OOO, restransmission, segment losts
2017-06-14 21:35:46 -04:00
Campus
348159dc3a
Merge branch 'alexei-argus-SOMEIP' into dev
2017-06-14 16:04:15 +02:00
alexei-argus
d4ca57884b
CR fixes #2
2017-06-14 16:50:01 +03:00
alexei-argus
8ec2867433
CR fixes
2017-06-14 16:49:58 +03:00
Yoni.Linder
0aa5ebde5d
CR comments and fixes
2017-06-14 16:49:56 +03:00
alexei-argus
6029510ee7
Add CR comments
2017-06-14 16:49:53 +03:00
Yoni.Linder
7d39ba2124
removed debug prints, changed line of documentation
2017-06-14 16:49:50 +03:00
Yoni.Linder
ae959f2d78
SOMEIP debug + bug fixes
2017-06-14 16:49:47 +03:00
Yoni.Linder
968085c965
last updated protocol updated to SOMEIP(228)
2017-06-14 16:49:45 +03:00
alexei-argus
62a65aa4cc
Fix case-sensitivity issue
2017-06-14 16:47:43 +03:00
Yoni.Linder
bc7f0b3686
endianity for ports
2017-06-14 16:46:44 +03:00
alexei-argus
87b49c5249
Fix build errors
2017-06-14 16:46:42 +03:00
Yoni.Linder
ef1a84fb39
ndpi someip initial version with hardcoded port enforcing
2017-06-14 16:43:47 +03:00
Luca Deri
c46af1291a
Improved AppleStore detection
...
Modified string search matching to match the longest match (and not the first one)
2017-06-13 15:06:27 +02:00
Luca Deri
f3f83f2eee
Adding AppleStore and PlayStore (work in progress)
2017-06-13 14:48:59 +02:00
MaYuming
d9bef8fa46
fix ms-lync detection missing, More detail at https://github.com/ntop/nDPI/issues/401
2017-06-13 17:17:19 +08:00
Campus
af3086fb82
add check for whatsapp in ssl
2017-06-09 13:22:58 +02:00
Campus
e0366a9965
improved whatsapp and wechat detection by new ip-ranges
2017-06-09 13:15:09 +02:00
Campus
88d47399b5
updated results
2017-06-09 01:18:41 +02:00
Campus
05912a49ae
fixed 1kxun application protocol to avoid false positive in udp detection
2017-06-09 01:15:11 +02:00
Michele Campus
b462a0845f
Merge pull request #398 from kYroL01/dev
...
added GoogleDrive detection
2017-06-07 18:20:46 +02:00
Campus
39dc99443c
added GoogleDrive detection
2017-06-07 18:18:12 +02:00
Michele Campus
c2f51cf7ab
Merge pull request #395 from pavlosantoniou/dev
...
Use flag %d to print signed integers in ndpiReader.
2017-06-07 15:03:14 +02:00
Pavlos Antoniou
9c4a446c76
Use flag %d to print signed integers in ndpiReader.
2017-06-07 13:14:37 +02:00
Campus
e49c9f36e8
Merge branch 'pavlosantoniou-dev' into dev
2017-06-07 11:27:37 +02:00
Pavlos Antoniou
1467ad68d4
Remove unused variables for ndpiReader.c and tinc.c
2017-06-07 11:18:38 +02:00
Luca Deri
9a4634adbb
Fixes for latency calculation
2017-06-06 21:22:46 +02:00
Luca Deri
984eedc5ea
Code cleanup
2017-06-06 11:40:30 +02:00
Luca Deri
7bf508df0a
Improved ARP/VLAN stats
2017-06-05 18:05:02 +02:00
Luca Deri
5570e6cbee
Fixed bug that was preventiv packets to be analyzed properly
...
Fixed ARP stats calculation
2017-06-03 18:39:43 +02:00
Luca Deri
3e529dd042
Cleanup
2017-06-03 12:38:00 +02:00
Luca Deri
2049e3d655
Added SSL dissection
2017-06-03 11:35:51 +02:00
Luca Deri
2d72e2a2ae
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2017-06-02 21:48:37 +02:00
Luca Deri
67aa9f2350
Implemented Application/Network latency
...
Implemented DNS stats
Moved all menu entries unser Tools -> ntop menu
2017-06-02 21:47:55 +02:00
Campus
a5268b1137
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2017-06-02 20:10:58 +02:00
Campus
6b5f640849
improved spotify detection
2017-06-02 20:10:05 +02:00
Michele Campus
1b5b38a3ba
Merge pull request #391 from deselmo/dev
...
Updated libcache's license
2017-06-02 12:13:55 +02:00
William Guglielmo
e1b5b54c4c
Update license libcache
2017-06-02 00:29:04 +02:00
cardigliano
22b7b407c3
compilation fix
2017-06-01 18:13:31 +02:00
Campus
284bb21d61
Merge branch 'deselmo-dev' into dev
2017-06-01 16:45:24 +02:00
Campus
f6eebb9c81
Merge branch 'dev' of https://github.com/deselmo/nDPI into deselmo-dev
2017-05-31 09:57:00 +02:00
William Guglielmo
b08fbe46c0
Delete test.c
2017-05-30 21:04:57 +02:00
William Guglielmo
4a751f9d05
Updated libcache
2017-05-30 19:17:41 +02:00
Luca
c5c417e526
Snapchat is now detected as sociaal network
2017-05-30 07:03:55 +02:00
William Guglielmo
46284e1537
Update ndpi_typedefs.h
2017-05-29 21:30:30 +02:00
William Guglielmo
694bc039e8
Added tinc protocol detection
2017-05-29 19:09:32 +02:00
Luca
d21dbee102
TYpo
2017-05-29 18:58:02 +02:00
Luca
2b9f8f6a89
Fixed nDPI report formatting
2017-05-29 16:46:28 +02:00
Luca Deri
61f8f56719
Implemented network latency dissector
2017-05-26 12:46:19 +02:00
Luca Deri
d67d3eed3c
Compilation fix for systems that do not have JSON-C installed
2017-05-26 12:11:37 +02:00
Campus
4829222e73
update results after modifications
2017-05-26 11:26:22 +02:00
Campus
554278e678
Merge branch 'beratx-dev' into dev
2017-05-26 11:24:01 +02:00
berat
b1ecc45e4f
Added timestamp, flow count and app. level protocol to (-b) diagnose statistics
2017-05-26 02:47:46 +02:00
Campus
d17ea73273
update
2017-05-25 17:13:43 +02:00
Luca Deri
07b1a93026
Latency calculation (work in progress)
2017-05-25 16:44:48 +02:00
Luca Deri
98dcfd8393
Reworked MAC stats
2017-05-25 10:55:41 +02:00
Luca Deri
e1efee8594
Added check for searching JSON-C in home directory if not installed
...
Fixed type
2017-05-24 10:11:04 -07:00
Luca
993605d4f3
Fixed bug that was forcing the reader to pass several times the same flow
...
renamed some variables
2017-05-24 18:53:51 +02:00
Luca Deri
904210e87c
Split src2dst / dst2src traffic
2017-05-24 16:06:23 +02:00
Luca Deri
50e26ca400
Implemented MAC stats
2017-05-24 00:51:21 +02:00
Luca Deri
c723f7e668
Added VLAN / ARP stats
2017-05-23 23:31:43 +02:00
Alfredo Cardigliano
1a20029c82
compilation fixes
2017-05-23 18:56:43 +02:00
Alfredo Cardigliano
26bd42a71c
crc32 fix
2017-05-23 18:02:53 +02:00
cardigliano
601f7f59ff
forcing quiet mode in extcap mode
2017-05-22 16:55:48 +02:00
Luca Deri
b39eb67836
Moved to 2.1.0
...
Updated test results
2017-05-22 14:44:31 +02:00
Luca Deri
cb6aabbf19
Fixed JSON format when -v 3 and -b is used
2017-05-22 14:14:45 +02:00
Luca Deri
b89a2dce6f
Removed warning
2017-05-22 01:16:38 +02:00
Campus
97a57ac68d
Merge branch 'beratx-dev' into dev
2017-05-20 10:20:16 +02:00
Campus
a487a58884
Merge branch 'dev' of https://github.com/beratx/nDPI into beratx-dev
2017-05-20 10:19:44 +02:00
Michele Campus
ccfe37870c
Merge pull request #386 from Manouchehri/brew
...
Added HEAD for homebrew.
2017-05-20 10:08:34 +02:00
David Manouchehri
867acf717a
Added HEAD for homebrew.
2017-05-19 19:34:52 -04:00
berat
6f27a48721
Added -b for saving port based diagnose statistics in json
2017-05-19 23:26:02 +02:00
Michele Campus
185cd4fb30
Merge pull request #383 from pavlosantoniou/dev
...
Remove unused variable and clarify operator precedence in ndpi_util.c
2017-05-18 16:52:57 +02:00
Pavlos Antoniou
73b3ee51d1
Remove unused variable and clarify operator precedence in ndpi_util.c
2017-05-18 14:08:01 +03:00
Michele Campus
b579408711
Merge pull request #382 from pavlosantoniou/dev
...
Remove redundant check from btlib.c
2017-05-18 12:16:30 +02:00
Pavlos Antoniou
ec0e6f98d4
Remove redundant check from btlib.c
2017-05-18 13:08:45 +03:00
Campus
b4b682a4bf
Merge branch 'pavlosantoniou-dev' into dev
2017-05-18 10:47:17 +02:00
Pavlos Antoniou
167732cae4
Check pointer for NULL before dereferencing
2017-05-18 11:09:56 +03:00
Michele Campus
2b128a2f1b
Merge pull request #380 from pavlosantoniou/dev
...
Use correct subscripts when checking IP array in ndpi_main.c
2017-05-18 10:06:12 +02:00
Pavlos Antoniou
f4bba23ba7
use correct subscripts when checking IP array in ndpi_main.c
2017-05-18 10:42:23 +03:00
Luca Deri
724d182939
Restored file selection as the wireshark bug seems to be fixed in 2.3.x wireshark series
2017-05-17 22:33:44 +02:00
Campus
ebb6d4499a
update Snapchat detection
2017-05-17 17:33:16 +02:00
Campus
b2282a49b5
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2017-05-17 17:20:47 +02:00
Campus
a044178b47
Merge branch 'pavlosantoniou-dev' into dev
2017-05-17 17:17:38 +02:00
Luca
a874e7869c
Typo
2017-05-17 17:12:22 +02:00
Luca
cef42b4050
Updated tests instruction
2017-05-17 17:11:54 +02:00
Pavlos Antoniou
0a2cbe4926
Fix buffer overflows in http.c
2017-05-17 18:11:25 +03:00
Luca Deri
99c9f1d36b
Updated results are ndpiReader output has been modified
2017-05-17 15:53:52 +02:00
Luca Deri
0091f35e02
Reworked flow structure handler
2017-05-17 15:50:59 +02:00
Simone Mainardi
f2730f06a0
Changlogs for the forthcoming release
2017-05-12 14:43:28 +02:00
Campus
5271233774
Merge branch 'alexei-argus-example_caplen_fix' into dev
2017-05-11 15:59:17 +02:00
Campus
5da83360aa
Merge branch 'example_caplen_fix' of https://github.com/alexei-argus/nDPI into alexei-argus-example_caplen_fix
2017-05-11 15:50:09 +02:00
Campus
cd26942edf
delete check for old protocol
2017-05-11 15:48:12 +02:00
alexei-argus
8a7dc10f51
Fix out-of-bounds heap read caused by using header->len instead of header->caplen (as provided in pcap_loop)
2017-05-10 14:16:46 +03:00
Campus
c2bbe79a3e
Results update
2017-05-09 19:57:47 +02:00
Campus
e6dc092b73
Merge branch 'beratx-dev' into dev
2017-05-09 19:52:46 +02:00
berat
5c1954012b
Added IPv6 support to Port Stats
2017-05-09 19:32:40 +02:00
Luca
21567e8686
Added missing direction update with non TCP-UDP protocols
2017-05-08 08:29:18 +02:00
Campus
1af3d571d9
fix for https://github.com/ntop/nDPI/issues/371
2017-05-02 16:50:25 +02:00
Luca Deri
442adce51d
Fixed invalid ndpi_match_string_id() return code
2017-05-01 23:05:42 +02:00
Luca Deri
3f5e4cb7ee
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2017-05-01 21:40:02 +02:00
Luca Deri
4c6f9d5c25
Result update
2017-05-01 21:39:46 +02:00
Luca Deri
a43244e493
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2017-05-01 21:36:59 +02:00
Luca Deri
5c2fa2d2e7
Updated results
2017-05-01 21:36:45 +02:00
Luca Deri
aa6167bb42
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2017-05-01 21:21:03 +02:00
Luca Deri
205b82f6ba
Added new API calls
...
- ndpi_add_string_value_to_automa
- ndpi_match_string_id
2017-05-01 21:20:43 +02:00
Luca Deri
a03a343723
Minor code cleanup
2017-05-01 19:44:46 +02:00
Luca Deri
92d19ae2ed
Merge pull request #370 from beratx/dev
...
Added IP Statistics to Port Stats
2017-05-01 19:36:49 +02:00
berat
32d02836f0
fixed syntax for gcc compiler
2017-05-01 14:37:12 +02:00
berat
4030b52ecb
Added IP Statistics to Port Stats
2017-05-01 14:07:41 +02:00
Luca Deri
064b50df81
Added -m for splitting analysis in sub-analysis steps
2017-04-30 10:12:28 +02:00
Luca Deri
af5021d571
Fixed warning
2017-04-29 08:32:28 +00:00
Luca
e1b905124f
Improved SSL dissection
2017-04-27 14:57:04 +02:00
Luca Deri
6cae3a7dce
Removed Napatech dependency
2017-04-27 12:17:32 +02:00
Luca Deri
d4a16d9e55
Improced extcap configuration window with sorted protocol list
...
Reported flow stats in Statistics -> nDPI menu
2017-04-25 11:21:40 +02:00
Luca Deri
6c2c885176
Extcap crash fix
2017-04-25 10:42:03 +02:00
Luca Deri
43f18ddb0f
Updated Wireshark lua dissector
...
Added -v to ndpiReader to print port stats
Recomputed protocol test results
2017-04-24 00:45:43 +02:00
Luca Deri
b9a2511ea8
Initial Wireshark nDPI integration
2017-04-23 19:58:41 +02:00
Campus
c96507b7a4
updated tests pcap
2017-04-21 02:01:09 +02:00
Campus
e2f2111637
update bittorrent detection - fix https://github.com/ntop/nDPI/issues/362
2017-04-21 01:42:54 +02:00
Campus
9a94c34b91
fix for https://github.com/ntop/nDPI/issues/364
2017-04-20 23:00:11 +02:00
Campus
6581579d37
update flow thanks to commit a9c01ded17
2017-04-20 17:57:40 +02:00
Luca Deri
4cc54cceb5
Added port stats when verbose mode (-v) is used
2017-04-19 23:31:45 +02:00
Luca Deri
a9c01ded17
ndpiReader now prints (-v) the flows with the correct direction
2017-04-19 21:55:49 +02:00
Luca
cbc08f7e50
Added DNScrypt test files
2017-04-19 09:58:35 +02:00
Luca
45582194cf
Added DNScrypt detection
2017-04-19 09:56:51 +02:00
Luca
56b6c7ed93
Fixed thread crash caused by commit 29cd6ef994
2017-04-19 09:50:54 +02:00
Luca
c1db9a830d
Compilation fix for old compilers
2017-04-18 17:20:43 +02:00
Luca
4c5de9ef8e
Added ethernet checksum reforging and nDPI protocol export in nDPI-extcap reader
2017-04-17 09:38:30 +02:00
Campus
3a21152f4c
improved wechat detection
2017-04-15 21:18:50 +02:00
Campus
b97e3ee51a
add initial detection for WeChat
2017-04-15 11:23:03 +02:00
Campus
2b0809f3dc
name correction for llc_snap header and minor fix
2017-04-15 00:40:01 +02:00
Campus
29cd6ef994
fix segmentation fault caused by missing spanning tree check - add control for threads return values
2017-04-15 00:29:53 +02:00
Luca Deri
d8b2189cc3
Initial wireshark integration via extcap interface
2017-04-14 00:07:46 +02:00
Michele Campus
3a8c2d0b6f
Merge pull request #360 from jaspervandenberg/dev
...
unified HTTPDownload name with other HTTP protocols (as HTTP_Download)
2017-04-07 17:01:39 +02:00
Jasper van den Berg
eed3ba5d1e
unified HTTPDownload name with other HTTP protocols (as HTTP_Download) for consistency
2017-04-07 11:47:44 +02:00
Luca
bc68949c76
Added AMQP (Advanced Message Queueing Protocol)
2017-04-07 08:05:39 +02:00
Luca
e4ef2d8140
Improved Ookla protocol
2017-04-04 14:42:45 +02:00
emanuele-f
0659f9b592
Replace BSD dependent strnstr with ndpi portable one
2017-04-02 11:17:57 +02:00
Luca Deri
0390c8ccfb
Added Ookla test pcap
...
Updated results
2017-04-01 21:39:47 +02:00
Luca Deri
281ba768ec
Added Ookla (SpeedTest) protocol detection
2017-04-01 21:33:15 +02:00
Campus
806fae6596
Merge branch 'vpiserchia-set_memory_functions' into dev
2017-03-29 10:59:41 +02:00
Campus
65359e53d8
Merge branch 'set_memory_functions' of https://github.com/vpiserchia/nDPI into vpiserchia-set_memory_functions
2017-03-29 10:46:38 +02:00
Luca Deri
92b1b46fa6
SSL server certificate is now detected
2017-03-21 00:48:16 +01:00
Luca Deri
760d468aca
Improved netbios name decoding
2017-03-19 23:42:36 +01:00
Luca Deri
6a5b380bc7
Exported ndpi_netbios_name_interpret() to all nDPI apps
2017-03-19 22:51:13 +01:00
Luca Deri
689d3e7602
Improved netbios dissection
2017-03-19 22:38:13 +01:00
Vito Piserchia
4300208642
Added ndpi_flow_ free/malloc and set_ functions:
...
Ideally these two new functions will provide more flexibility
in regards of application that want to use specific allocation
approaches, for example storage queues for this structures
from where the application can pop and release the data it
needs.
Semantically they can be set up as the other ndpi_malloc and ndpi_free
functions, that is via the set_ndpi_flow_malloc and set_ndpi_flow_free.
In case a NULL parameter is passed to the above functions the old
approach will be used, that means that the ndpi_malloc will be used as
the ndpi_flow_malloc function and ndpi_free_flow as the ndpi_flow_free one.
Application that use the old functions will be not affected by this change,
and the ndpi_free_flow can be deprecated in the future and made private.
2017-03-16 17:35:10 +01:00
Campus
149818671d
minor fix for http
2017-03-16 10:31:36 +01:00
Luca Deri
dc1f005823
Tests update
2017-03-15 20:25:08 +01:00
Luca Deri
eeb6f9334a
Warning fix
2017-03-15 20:21:18 +01:00
Campus
3add72c686
deleted useless function - change macro name
2017-03-15 18:42:44 +01:00
Campus
5de6a96af5
change behaviour for https://github.com/ntop/nDPI/issues/344 - fix skype detection deleting parts that detect host name and ip addr (duplicate behaviour) - improved any detection after fix - added skype host name
2017-03-15 17:28:31 +01:00
Michele Campus
1e014aa95b
Merge pull request #348 from jsoref/spelling
...
Spelling fixes
2017-03-13 14:46:22 +01:00
Luca Deri
9962eb1f08
Fixed invalid QUIC header parsing
2017-03-13 14:33:03 +01:00
Luca Deri
6bc35b92d3
Result file for youtube_quic.pcap
2017-03-13 01:19:35 +01:00
Luca Deri
40aaa05456
Minor changes for tracking Youtube content
...
Added test pcap for working on quic/youtube dissector
2017-03-13 01:16:58 +01:00
Josh Soref
e17f62d261
spelling: values
2017-03-12 22:21:51 +00:00
Josh Soref
65cde78f6d
spelling: unknown
2017-03-12 22:11:52 +00:00
Josh Soref
9a5402518c
spelling: unencrypted
2017-03-12 22:13:00 +00:00
Josh Soref
11fc826e52
spelling: switch
2017-03-12 22:10:54 +00:00
Josh Soref
249b5d6783
spelling: structure
2017-03-12 22:10:38 +00:00
Josh Soref
7a2dcf0f9f
spelling: soulseek
2017-03-12 22:10:05 +00:00
Josh Soref
710d528215
spelling: second
2017-03-12 22:07:00 +00:00
Josh Soref
ce0a3e858a
spelling: scrupulous
2017-03-12 22:06:44 +00:00
Josh Soref
d178bec60e
spelling: reset
2017-03-12 22:02:56 +00:00
Josh Soref
fba88e225f
spelling: remove
2017-03-12 22:06:05 +00:00
Josh Soref
7bac815938
spelling: protocol
2017-03-12 22:00:38 +00:00
Josh Soref
18916e682f
spelling: prerequisites
2017-03-12 22:01:58 +00:00
Josh Soref
fbe1fb285d
spelling: platform
2017-03-12 22:00:21 +00:00
Josh Soref
04014d73d9
spelling: pedantic
2017-03-12 22:00:07 +00:00
Josh Soref
1aa10f5211
spelling: optimization
2017-03-12 21:58:56 +00:00
Josh Soref
35fe91116a
spelling: ninety
2017-03-12 21:48:05 +00:00
Josh Soref
fa34be1a00
spelling: modified
2017-03-12 21:52:59 +00:00
Josh Soref
7bb615a262
spelling: length
2017-03-12 21:45:36 +00:00
Josh Soref
c51f88e62a
spelling: interface
2017-03-12 21:44:26 +00:00
Josh Soref
120e3473f8
spelling: initialize
2017-03-12 21:43:57 +00:00
Josh Soref
4a5407feb7
spelling: incomplete
2017-03-12 21:43:45 +00:00
Josh Soref
d332370298
spelling: googlesyndication
2017-03-12 21:37:41 +00:00
Josh Soref
d5b15c498b
spelling: five
2017-03-12 21:34:28 +00:00
Josh Soref
66e93da6f5
spelling: excluding
2017-03-12 21:33:20 +00:00
Josh Soref
f8fed9be7e
spelling: exclude
2017-03-12 21:33:32 +00:00
Josh Soref
3dbb97413c
spelling: encryption
2017-03-12 21:32:57 +00:00
Josh Soref
47f9f54b89
spelling: discarded
2017-03-12 21:32:19 +00:00
Josh Soref
e89ce717ba
spelling: delivered
2017-03-12 21:31:56 +00:00
Josh Soref
0645625585
spelling: datastructure
2017-03-12 21:31:28 +00:00
Josh Soref
e115e0b89e
spelling: creating
2017-03-12 21:26:33 +00:00
Josh Soref
6a7ad10ae0
spelling: conservative
2017-03-12 21:22:34 +00:00
Josh Soref
5a2f556ff7
spelling: compatibility
2017-03-12 21:20:18 +00:00
Josh Soref
b0e0b29201
spelling: associated
2017-03-09 04:56:31 +00:00
Josh Soref
616b6ce4d5
spelling: address
2017-03-09 04:54:42 +00:00
Luca Deri
6a27b6262d
Added disclaimer
2017-03-07 19:25:34 +01:00
Luca Deri
940c185c5d
Improved BJNP protocol
2017-03-07 10:40:42 +01:00
Luca Deri
f831f30556
Fixed invalid SNMP detection
2017-03-07 10:19:29 +01:00
Campus
fd93036b79
better improvement of netflix traffic detection - added netflix pcap and output - change little bit http detection behaviour
2017-03-05 12:38:15 +01:00
Luca Deri
889cdbff3c
Fixed bug that can lkead to a crash in iqiyi dissector
2017-02-25 06:31:07 +01:00
Campus
a787287bfa
fix and improved netflix detection by user-agent
2017-02-22 17:14:52 +01:00
Campus
c2c92b2e9b
added double tagging 802.1Q in dissection of vlan pkt
2017-02-21 13:04:17 +01:00
Campus
e68aeb69eb
Merge branch 'k0ste-newfeature' into dev
2017-02-20 17:26:09 +01:00
Campus
846f457db4
update detection and tests
2017-02-20 17:25:19 +01:00
Campus
35ab1b5d1c
Merge branch 'newfeature' of https://github.com/k0ste/nDPI into k0ste-newfeature
2017-02-20 16:47:46 +01:00
Campus
76e1bed466
update test dir to fix wrong pcap
2017-02-20 16:45:26 +01:00
Campus
100acbbe7b
added missing .out
2017-02-20 16:42:54 +01:00
Konstantin Shalygin
66044578c2
ndpi_content_match: Add origin routes for many services.
2017-02-20 18:26:22 +07:00
Campus
eb92c6b676
improved skype detection
2017-02-16 20:11:21 +01:00
Campus
af04f78bd7
update Netflix ip-range list
2017-02-16 12:43:52 +01:00
Campus
b35c1ab696
minor fix mgcp dissector
2017-02-14 01:23:47 +01:00
Campus
5c1c8b80e2
Merge branch 'numeronove-dev-numeronove-openbsd' into dev
2017-02-13 13:16:14 +01:00
Campus
787ca096e6
Merge branch 'dev-numeronove-openbsd' of https://github.com/numeronove/nDPI into numeronove-dev-numeronove-openbsd
2017-02-13 13:11:54 +01:00
Campus
363b38ceb0
fix dhcp buffer overflow
2017-02-13 13:03:27 +01:00
Luca Deri
e2cfc96577
Improvements for exporting info in MDNS and UBNTAC2 protocols
...
Added test pcap file for UBNTAC2
2017-02-13 01:29:25 +01:00
Luca Deri
b16769ddbe
Refined guess that does not happen for protocols that have been excluded
2017-02-12 20:14:11 +01:00
Numeronove
ffbe5d1e22
Easing OpenBSD build
...
Addedd macro AM_PROG_CC_C_O in configure.ac, needed to have autogen.sh
manage the error:
C objects in subdir but `AM_PROG_CC_C_O' not in `configure.ac'
Modified case instance in example/ndpi_util.c, since DLT_LINUX_SLL
isn't defined in OpenBSD pcap.h.
2017-02-11 11:04:59 +01:00
Luca Deri
1d2e67d38c
Dissected SSH client/server versions and reported in data structures
2017-02-11 10:48:08 +01:00
Alfredo Cardigliano
b6eecd7d0c
Update .travis.yml
2017-02-09 22:57:49 +01:00
Campus
b229b89c78
fix for https://github.com/ntop/nDPI/issues/339
2017-02-09 17:01:12 +01:00
Simone Mainardi
b161a6d7f7
Fix for FreeBSD build
2017-02-04 17:01:40 +01:00
Michele Campus
799e39227c
Merge pull request #334 from alagoutte/fix
...
fix hardcoded value of version in Makefile
2017-02-04 12:22:54 +01:00
Michele Campus
38820ec916
Merge pull request #335 from alagoutte/warning
...
ndpi_main(.c): fix unused function 'tor_ptree_match' [-Werror,-Wunuse…
2017-02-04 12:22:22 +01:00
Alexis La Goutte
be1ee30fa8
ndpi_main(.c): fix unused function 'tor_ptree_match' [-Werror,-Wunused-function]
2017-02-04 10:11:28 +01:00
Alexis La Goutte
beb069df64
fix hardcoded value of version in Makefile
...
Issue report by @clauderobi (issue #333 )
2017-02-04 09:01:46 +01:00
Luca Deri
9941045468
Renumbered ids that were changed by mistake
...
MQTT (NOW 208, latest stable version 222)
RX ( NOW 209, latest stable version 223)
OPENDNS ( NOW 197, latest stable version 225 ).
2017-02-01 18:10:02 +01:00
Luca Deri
8fa2d8f0d6
Improved whatsapp detection
2017-01-31 16:38:31 +01:00
Luca Deri
a3d32d9d80
Improved HTTP subprotocol matching
2017-01-31 16:01:58 +01:00
Luca Deri
bf35300817
Updated readme
2017-01-31 15:43:14 +01:00
Luca Deri
ff9af3166f
Updated results for HTTP-subprotocols
2017-01-31 15:06:21 +01:00
Luca Deri
8805d8523b
Optimized code to avoid multiple calls to ndpi_network_ptree_match()
...
HTTP-based subprotocols have not HTTP set as master_protocols
2017-01-31 15:04:24 +01:00
Luca Deri
0610ae2d21
Fixed issues caused by (invalid) protocol renumbering. The problem has been solved and now protocols are in sync with its previous values in the stable version
2017-01-31 13:16:36 +01:00
Campus
5972fca190
Merge branch 'dillinger79-dev' into dev
2017-01-20 16:20:44 +01:00
dillinger79
9f8fedb3b1
Merge pull request #1 from dillinger79/dillinger79-patch-1
...
Update smpp.c
2017-01-20 11:31:36 +02:00
dillinger79
048ab4b5d3
Merge pull request #2 from dillinger79/dillinger79-patch-2
...
Add files via upload
2017-01-20 11:31:12 +02:00
dillinger79
8aa1d770f0
Add files via upload
...
this pcap file causes a busy loop
2017-01-18 18:27:56 +01:00
dillinger79
4e6dda6361
Update smpp.c
2017-01-18 18:21:47 +01:00
Luca
e44834e0c5
Fixed warning
2017-01-02 22:05:40 +01:00
Luca Deri
1a3ee31865
Renamed enum constant
2017-01-02 21:52:53 +01:00
Michele Campus
721af38aed
Merge pull request #322 from emanuele-f/dev
...
Add enum items number
2016-12-30 09:51:20 +01:00
emanuele-f
2ac04dba4d
Add enum items number
2016-12-29 23:41:09 +01:00
Michele Campus
e7fbcc690b
Merge pull request #321 from alagoutte/fix_warning
...
SMPP: fix comparison of unsigned expression >= 0 is always true [-Wer…
2016-12-29 11:26:11 +01:00
Alexis La Goutte
f4ce6a8023
SMPP: fix comparison of unsigned expression >= 0 is always true [-Werror,-Wtautological-compare]
2016-12-29 10:14:17 +00:00
Luca Deri
773dbf4ef2
Added BJNP default ports
2016-12-19 17:33:28 +01:00
Luca Deri
5486dcd1f9
Added default AFP port
2016-12-19 14:29:51 +01:00
Campus
61f0eb062e
fix indent code and int type to keep conformity of the rest of the code (u_intxx instead uintxx)
2016-12-15 12:15:48 +01:00
Campus
b68f197fea
Merge branch 'dfranusic-dev' into dev
2016-12-15 12:12:15 +01:00
Campus
39e475b4ea
Merge branch 'dev' of https://github.com/dfranusic/nDPI into dfranusic-dev
2016-12-15 12:00:08 +01:00
Damir Franusic
f5b8855fed
Implemented Short Message Peer-to-Peer (SMPP) dissector
2016-12-14 21:57:33 +01:00
Campus
03e8111e1b
Merge branch 'k0ste-newfeature' into dev
2016-12-14 18:21:13 +01:00
Konstantin Shalygin
e26b64a0fc
Add Valve AS routes and domain names for better Steam detection.
2016-12-14 23:20:42 +07:00
Campus
8b1aa4a7bd
improved steam detection
2016-12-13 19:00:34 +01:00
valentina
b2b36be6cf
Removed "yp" element from "ndpi_en_impossible_bigrams" structure because tor was detected instead of ssl (paypal).
2016-12-11 22:12:26 +01:00
Luca Deri
7d82948bd1
Improvement on ndpi_int_change_protocol() accuracy
2016-12-10 19:30:42 +01:00
Michele Campus
f7515514bd
Merge pull request #314 from sologub/dev
...
Fix 'IPVERSION undeclared' error on WIN32
2016-12-07 10:45:43 +01:00
Ruslan Sologub
12a3d80f71
Fix 'IPVERSION undeclared' error on WIN32
2016-12-07 11:36:39 +02:00
Campus
ef69a1610a
Merge branch 'denisvm-magicnumbers' into dev
2016-12-06 22:23:36 +01:00
Denis Volpato Martins
483eb63408
Removed some magic numbers
2016-12-06 18:48:26 -02:00
Luca Deri
b019dcd11a
Added missing -ldl library
2016-12-05 19:15:45 +01:00
Luca Deri
163945f4b4
Added check to avoid loops with invalid DHCP packets
2016-12-05 18:25:39 +01:00
Luca Deri
22ee439215
Added memory check in patricia tree
...
Improved AFP dissection
Updated DHCP test results
2016-12-05 13:58:43 +01:00
Luca Deri
582f5e0f72
Implemented DHCP host name extraction
2016-12-04 21:44:48 +01:00
Campus
5f672dfb42
added comment to function process_packet
2016-12-02 02:32:46 +01:00
Campus
6f31ae722e
added prototype of function packet_processing
2016-12-02 02:25:43 +01:00
Campus
cc5167c09a
Merge branch 'alagoutte-osx' into dev
2016-11-28 21:45:44 +01:00
Alexis La Goutte
c6eb41b7bf
Remove gcc when build with osx
...
osx buildbot use always clang for the build
2016-11-28 19:16:09 +01:00
Alexis La Goutte
eeef26ae59
Add macOS build on Travis
2016-11-28 10:55:29 +01:00
Alexis La Goutte
d53b655c32
Update ax_pthread
...
for fix issue when build with clang on macos
clang: error: argument unused during compilation: '-pthread'
No need -pthread when linking
2016-11-28 10:45:54 +01:00
Luca Deri
be81d33495
Disabled coverage (work in progress)
2016-11-27 12:21:02 +01:00
Luca Deri
035a290ab5
Coverage (work in progress)
2016-11-27 11:52:50 +01:00
Luca Deri
c041a723c1
Added coverage
2016-11-27 11:34:52 +01:00
Luca Deri
45ca2ace0b
Code cleanup. Added coveralls badge
2016-11-27 10:57:42 +01:00
Luca
424fbb710c
Added fixes to properly honour subprotocols
2016-11-26 18:36:08 +02:00
Luca
169a8fb97f
Test update
2016-11-25 17:52:19 +02:00
Campus
098812d3cc
Merge branch 'mgigante-dev_libdl' into dev
2016-11-24 10:07:10 +01:00
Campus
4eb5297a79
Merge branch 'dev_libdl' of https://github.com/mgigante/nDPI into mgigante-dev_libdl
2016-11-24 10:05:56 +01:00
Marco Gigante
c52c738408
Checking for libdl vs. libc during configure
2016-11-23 08:44:07 +01:00
Campus
797eb2c3ca
fix initialization of struct ndpi_flow_info *flow
2016-11-22 23:11:24 +01:00
Campus
d9a2d9a6bd
updated facebook detection (continue) by ip server ranges
2016-11-22 22:57:31 +01:00
Michele Campus
4da4db1e73
Merge pull request #303 from alagoutte/fix_warning
...
Fix warning
2016-11-22 22:18:11 +01:00
Alexis La Goutte
4c23c3fec9
ndiReader: fix ‘jObj_main/jArray_detProto’ may be used uninitialized in this function [-Werror=maybe-uninitialized]
2016-11-22 20:56:14 +01:00
Alexis La Goutte
2ab1faf05a
http: unused variable 'no_pps' [-Werror=unused-variable]
2016-11-22 20:56:12 +01:00
Campus
f670eefd84
update facebook detection (2) for https://github.com/ntop/nDPI/issues/300#issuecomment-261977387
2016-11-21 17:28:53 +01:00
Campus
4e1c301b2a
update facebook detection
2016-11-21 16:14:28 +01:00
Luca Deri
b25e3e0917
Compilation fix
2016-11-20 20:24:39 +01:00
Campus
f571d7ed3a
fix ssl for https://github.com/ntop/nDPI/issues/301
2016-11-20 13:19:20 +01:00
Campus
9abbef7e05
added iqiyi media service and updated ppsetream protocol - added 1kxun media service
2016-11-20 13:07:00 +01:00
Campus
1fbe25f91e
fix facebook detection in http dissector
2016-11-18 20:21:08 +01:00
Michele Campus
19ad081bb1
Merge pull request #298 from denisvm/twitter-nets
...
Update and merge Twitter networks
2016-11-18 10:23:12 +01:00
Denis Volpato Martins
911be714e5
Update and merge Twitter networks
2016-11-17 16:42:16 -02:00
Michele Campus
f51fef6027
Merge pull request #296 from sologub/dev
...
Fix byte packing on Windows
2016-11-15 15:14:29 +01:00
Ruslan Sologub
8761e3a869
Fix byte packing on Windows
2016-11-15 15:47:08 +02:00
Campus
b9a1eba152
updated host matching services
2016-11-15 12:44:39 +01:00
Campus
1e19b689c4
minor fix for https://github.com/ntop/nDPI/commit/0f94a46f868e6818790b0c278121c081a63c9eeb
2016-11-15 12:02:02 +01:00
Campus
0f94a46f86
Merge branch 'mkfsn-bjnp-protocol' into dev
2016-11-15 11:50:45 +01:00
mkfsn
d9659617e9
Add BJNP Protocol
2016-11-15 17:59:02 +08:00
Luca Deri
edf0b2fbfe
Updated Twitter networks
2016-11-15 10:19:27 +01:00
Campus
61c8dca469
fixed wrong function call
2016-11-14 13:35:16 +01:00
Campus
d86e504779
Merge branch 'alagoutte-warning' into dev
2016-11-13 18:45:50 +01:00
Alexis La Goutte
3d6b4d4dff
ndpi_util: fix ‘type/ip_offset’ may be used uninitialized in this function [-Werror=maybe-uninitialized]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
45bcb9927d
bittorrent: fix variable ‘peer_id’ set but not used [-Werror=unused-but-set-variable]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
612a07f420
ndpi_main: fix variable 'daddr/saddr' set but not used [-Wunused-but-set-variable]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
d129abcde0
ndpi_util: unused variable 'nDPI_traceLevel' [-Wunused-const-variable]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
6fad364daa
ndpi_util: fix unused variable 'ip6_offset/ethernet_2/llc_off/cdp/slarp' [-Wunused-variable]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
dc7a85ee76
ndpiReader: fix unused function 'debug_printf' [-Wunused-function]
...
Comment the function
2016-11-13 18:22:03 +01:00
Alexis La Goutte
26aec8714e
ndpi_main: fix enumeration value 'NDPI_PROTOCOL_CATEGORY_UNSPECIFIED' not handled in switch [-Wswitch]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
65f61fd5b1
rx: fix unused variable 'found' [-Wunused-variable]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
57ad066e66
QUIC: fix unused variable 'begin' [-Wunused-variable]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
2a2a0d4aeb
git: fix unused variable 'git_len' [-Wunused-variable]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
1082a234fe
bittorrent: fix unused variable 'no_bittorrent' [-Wunused-variable]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
141bb48d76
BGP: fix unused function 'ndpi_int_bgp_add_connection' [-Wunused-function]
2016-11-13 18:22:03 +01:00
Alexis La Goutte
85bb227b45
ndpi_main: fix unused variable 'node/ret' [-Wunused-variable]
2016-11-13 18:22:03 +01:00
Campus
2005979f46
update test results after new services added
2016-11-12 16:38:37 +01:00
Campus
48a206a434
Merge branch 'alagoutte-scan-build' into dev
2016-11-12 16:35:25 +01:00
Alexis La Goutte
3a6d2c7c5f
ndpi_main: fix Dereference of null pointer
2016-11-12 16:30:15 +01:00
Alexis La Goutte
800ad1737c
COAP: fix typo about checking twice source port
...
Found via Clang Analyzer (Used d_port variable)
2016-11-12 16:02:32 +01:00
Alexis La Goutte
c7eb8d1082
HTTP: Fix Dead Store (Dead assignement/Dead increment) Warning found by Clang Analyzer
2016-11-12 16:00:10 +01:00
Michele Campus
4564b973df
Merge pull request #289 from mkfsn/service-github
...
Add Github service
2016-11-11 18:46:22 +01:00
mkfsn
2586618c1b
Add Github service
2016-11-12 00:15:31 +08:00
Campus
7758bc821e
Merge branch 'vpiserchia-dev' into dev
2016-11-03 23:10:23 +01:00
Campus
78f7f19359
Merge branch 'dev' of https://github.com/vpiserchia/nDPI into vpiserchia-dev
2016-11-03 23:08:44 +01:00
Vito Piserchia
04e45f503b
setup the debug function
2016-11-03 17:41:31 +01:00
Campus
58e97c966c
Merge branch 'vpiserchia-dev' into dev
2016-11-03 15:39:28 +01:00
Vito Piserchia
e3d15ef4e7
Prevent Segfault when building with -DNDPI_ENABLE_DEBUG_MESSAGES
2016-11-03 15:23:06 +01:00
Vito Piserchia
61f1ace43f
Fix NDPI_PROTOCOL_MSSQL_TDS macro name
2016-11-03 15:22:04 +01:00
Vito Piserchia
087ca9d0d5
Merge remote-tracking branch 'upstream/dev' into dev
2016-11-03 15:08:56 +01:00
Luca Deri
002b8b04e9
Win fixes
2016-11-03 00:22:51 +01:00
Luca Deri
6f0232763c
Added -ldl needed by PF_RING
2016-11-02 20:48:22 +01:00
Vito Piserchia
8169b35fa6
Merge remote-tracking branch 'upstream/dev' into dev
2016-11-02 10:16:16 +01:00
Campus
097ba22a59
minor fix to keep same coherence of type used
2016-10-30 01:14:49 +02:00
Vito Piserchia
78ebb3445a
Merge remote-tracking branch 'upstream/dev' into dev
2016-10-25 14:37:31 +02:00
Campus
b8fb5fb403
added iflix service
2016-10-24 23:25:29 +02:00
Luca Deri
93f01e614f
Added new functions defined in #279 for exporiting them in shared libs
...
Disabked some search dissectors from Office365
Fixed warning
2016-10-23 13:00:41 +02:00
Luca Deri
e9f00a4e8a
Merge pull request #279 from emanuele-f/category
...
Add protocol category ids
2016-10-23 12:54:30 +02:00
emanuele-f
7d0397a8fb
Add protocol category ids
2016-10-22 22:22:15 +02:00
Campus
2682ab6791
added skype ip-address server name range
2016-10-20 23:54:15 +02:00
Michele Campus
b60e82c702
Merge pull request #278 from mgigante/dev_funcproto
...
Avoid c99 complains about function prototypes
2016-10-20 17:08:04 +02:00
Marco Gigante
bac82eeb8e
Avoid c99 complains about function prototypes
2016-10-20 16:01:53 +02:00
Campus
94c134318b
fix msn dissector - add pcap for test
2016-10-17 18:43:47 +02:00
Luca Deri
6fd334dcd7
Updated quickstart guide
...
The new master file for the guide is keynote (deleted docx)
2016-10-15 11:41:40 +02:00
Campus
df6b71c5ea
fix debug function
2016-10-15 00:47:13 +02:00
Vito Piserchia
4c467d7cad
Merge remote-tracking branch 'upstream/dev' into dev
2016-10-13 13:50:29 +02:00
Campus
db794beb84
added vnc pcap to test folder
2016-10-12 00:14:46 +02:00
Campus
3b95cd9a11
fix vnc dissector
2016-10-12 00:10:06 +02:00
Campus
bbe4717075
removed imesh protocol (iMesh is no longer availlable)
2016-10-09 19:12:15 +02:00
Campus
2c47dca086
fixed some dissector for logic or syntax
2016-10-07 11:37:42 +02:00
Vito Piserchia
a17553cbf1
more ignores
2016-10-04 15:42:20 +02:00
Campus
7e8e243e68
fix check for issue https://github.com/ntop/nDPI/issues/272
2016-10-03 14:36:51 +02:00
Luca
cf470ec038
Fix for #218
2016-09-28 18:15:51 +02:00
Luca
016623decb
Added protos.txt to the list of tests
2016-09-28 17:50:17 +02:00
Luca Deri
a0a8c0294d
Fix for #249
2016-09-27 19:24:57 +02:00
Campus
9fe92f6145
fixed drda_db2 dissector
2016-09-27 11:17:45 +02:00
Campus
9f3804444e
fixed drda_db2 dissector
2016-09-27 11:17:06 +02:00
lucaderi
67ac0b431c
Fix for #249 (not sure is enough)
2016-09-27 08:01:15 +02:00
Campus
1f807a1348
fix snaplen for pcap_open_live function - optimal value is described here http://pcap.man.potaroo.net/
2016-09-26 10:43:44 +02:00
Campus
bf778d6df1
fix typo
2016-09-24 16:13:41 +02:00
Campus
f8a9faf2fa
added adobe flash host name - fix twitter and netflix detection - removed twitter dissector (useless have a dissector that looking for ip range; moved matching in ndpi_content_match.c.inc)
2016-09-24 13:45:28 +02:00
Campus
054f8376e4
deleted meebo dissector (service not availlable anymore) - change Weibo subservice name to Sina service (more correct)
2016-09-24 11:32:47 +02:00
Campus
d601b0ce20
fix ftp on tcp
2016-09-22 18:59:56 +02:00
Campus
730c8d6879
fix wrong comment rsync - deleted old tds dissector
2016-09-16 02:19:20 +02:00
Campus
dbb3d8280e
fix and merge mssql and tds in unique dissector mssql_tds due to latest release + minor fixes
2016-09-16 02:05:14 +02:00
Michele Campus
36956ebf68
Merge pull request #267 from tianzhishuizhu/dev
...
check udp
2016-09-15 09:50:38 +02:00
tianzhishuizhu
3c8d5bb788
check udp
2016-09-15 10:49:03 +08:00
Michele Campus
9e9b64a7e7
Merge pull request #266 from tianzhishuizhu/dev
...
check udp
2016-09-14 10:35:07 +02:00
tianzhishuizhu
0a73a9bd9c
Merge branch 'dev' of github.com:tianzhishuizhu/nDPI into dev
2016-09-14 16:16:37 +08:00
tianzhishuizhu
d9addc9245
check packet udp != NULL
2016-09-14 16:16:24 +08:00
Michele Campus
6b4b7a9083
Merge pull request #265 from tianzhishuizhu/dev
...
improve readability
2016-09-13 10:51:35 +02:00
tianzhishuizhu
afcf567538
Update syslog.c
2016-09-13 15:55:05 +08:00
tianzhishuizhu
2b67b3bc81
improve readability
2016-09-13 15:51:17 +08:00
Michele Campus
3cd6456349
Merge pull request #263 from tianzhishuizhu/dev
...
payload min length
2016-09-08 15:01:28 +02:00
tianzhishuizhu
c10052764b
payload min length
2016-09-08 20:55:26 +08:00
Michele Campus
2ae4db34b0
Merge pull request #261 from tianzhishuizhu/dev
...
optimization for code duplication
2016-09-08 14:48:54 +02:00
tianzhishuizhu
9ddaccbae0
text error
2016-09-08 19:53:03 +08:00
tianzhishuizhu
f7ca670ce0
delete variables unused
2016-09-08 19:49:13 +08:00
tianzhishuizhu
ce3493952b
logical error
2016-09-08 17:02:50 +08:00
tianzhishuizhu
ac8aaf0e08
optimization for code duplicationdup
2016-09-08 16:29:39 +08:00
Campus
3ceb19a9c6
fixed dhcp dissector
2016-09-07 10:31:11 +02:00
Luca Deri
95974b0d24
Merge pull request #258 from emanuele-f/facebook
...
Fix facebook certificate recognition
2016-09-06 08:10:35 +03:00
emanuele-f
ba3bf6c3d9
Fix facebook certificate recognition
2016-09-06 00:44:17 +02:00
Campus
7300e88cdb
fixed h323 dissector
2016-09-05 00:49:48 +02:00
Michele Campus
7364fcc7df
Merge pull request #255 from emanuele-f/openvpn
...
Fix openvpn with multiple hard_reset_client not being recognized
2016-08-28 01:05:08 +02:00
emanuele-f
562b90d93c
Fix openvpn with multiple hard_reset_client not being recognized
2016-08-28 00:41:39 +02:00
Campus
210602476f
update Skype ip address range
2016-08-27 22:56:01 +02:00
Campus
58e37f8130
update Skype and MS_OneDrive range IP address
2016-08-27 22:25:28 +02:00
Michele Campus
b6802767aa
Merge pull request #253 from theirix/fix-drda2
...
Fix drda in addition to #242
2016-08-22 14:54:56 +02:00
theirix
76f7454049
Fixed drda loop logic
2016-08-22 15:09:06 +03:00
theirix
fb687b7217
Fix another overflow in DRDA
2016-08-22 15:09:06 +03:00
Campus
b34d418b57
fix indentation ssl.c
2016-08-22 12:03:56 +02:00
Michele Campus
45f8f72bae
Merge pull request #252 from emanuele-f/gmail
...
Add hotmail service and enable full master protocol detection for sub-protocols
2016-08-22 11:56:06 +02:00
emanuele-f
11ca0a01d3
Enable full master protocol detection for sub-protocols
2016-08-22 11:32:57 +02:00
emanuele-f
5f4bbe311e
Add Hotmail service
2016-08-22 11:08:22 +02:00
Luca Deri
305e310f0a
Merge pull request #251 from Lzz/dev
...
Fix README.md
2016-08-20 08:28:47 +02:00
yimao
ed35c466ae
Fix README.md
2016-08-20 11:05:10 +08:00
Michele Campus
48341094a3
Merge pull request #248 from theirix/build-check2
...
Added instructions how to run tests
2016-08-13 16:22:40 +02:00
theirix
fb73ab95ea
Added instructions on running tests
2016-08-13 17:17:35 +03:00
theirix
9c4f80449b
Fixed dist build
2016-08-13 17:14:01 +03:00
Luca Deri
dc88cc4e64
Merge pull request #247 from theirix/build-check
...
Allowed to run tests by 'make check' in addition to plain do.sh
2016-08-13 13:32:20 +02:00
theirix
bee9090a92
Allowed to run tests by 'make check'
2016-08-13 13:35:14 +03:00
Michele Campus
d1bf5d2bb6
Merge pull request #245 from denisvm/service-slack
...
added Slack service
2016-08-13 10:54:27 +02:00
Denis Volpato Martins
9c2eba2009
fix Slack service domains without A DNS RRs and fix slack-imgs.com access
2016-08-12 15:18:11 -03:00
Denis Volpato Martins
44271e7bb8
added Slack service
2016-08-12 15:08:32 -03:00
Campus
5e399498c3
minor fixes
2016-08-12 15:51:41 +02:00
Campus
3bfa021760
fix quic result detection for YouTube
2016-08-12 15:33:34 +02:00
Michele Campus
7853c4a90b
Merge pull request #244 from emanuele-f/starttls
...
Add STARTTLS detection
2016-08-12 15:27:11 +02:00
emanuele-f
e7613a3851
Add IMAPS protocol on stack for use on detection giveup
2016-08-12 14:28:16 +02:00
emanuele-f
b34e9bf42a
Keep previous code
2016-08-12 13:28:40 +02:00
emanuele-f
6e1341c148
Add STARTTLS detection
2016-08-12 13:19:42 +02:00
Campus
92cac451c8
added new Youtube server name to improve detection
2016-08-11 20:06:08 +02:00
Michele Campus
0e04068952
Merge pull request #242 from theirix/fix-drda
...
Fixed DRDA detection
2016-08-11 09:16:42 +02:00
theirix
0a06b3b208
Fixed DRDA detection
2016-08-11 01:55:24 +03:00
Campus
8bccfa5b10
fixed invalid termination with ipv6 address
2016-08-09 23:00:33 +02:00
Michele Campus
5e1e6a48a4
Merge pull request #241 from theirix/fix-quic
...
Fixed buffer overflow in QUIC
2016-08-08 09:52:38 +02:00
theirix
4981005572
Fixed QUIC crash
2016-08-07 22:37:36 +03:00
Luca Deri
9e207f7f24
Fix for systems without beXXtoh
2016-08-05 17:29:33 +02:00
Michele Campus
5ec1b685d8
Merge pull request #240 from emanuele-f/openvpn
...
Add openvpn test pcap
2016-08-05 09:16:49 +02:00
emanuele-f
c41571879b
Add openvpn test pcap
2016-08-05 01:20:05 +02:00
Michele Campus
62a5f2350b
Merge pull request #239 from emanuele-f/openvpn
...
OpenVPN detection by opcode, packet ID and session ID
2016-08-05 00:21:31 +02:00
emanuele-f
82f10ddc6a
OpenVPN detection by opcode, packet ID and session ID
2016-08-04 23:08:09 +02:00
Michele Campus
4fa76bee78
Merge pull request #235 from theirix/fix-overflow-oscar
...
Fixed overflow in Oscar
2016-07-26 10:37:36 +02:00
theirix
384dee1f95
Fail when Oscar family or type is 0
2016-07-25 18:24:45 +03:00
theirix
3e5033ff13
Fail when Oscar family is 0
2016-07-25 17:44:45 +03:00
theirix
01ac65eee4
Fail fast when Oscar family cannot be detected
2016-07-25 17:02:39 +03:00
Luca Deri
da80bd8bb4
Added ndpi_get_proto_by_name() for mapping protocolIDs to protocol names
...
Added a new parameter to ndpi_guess_protocol_id() to indicate if the guessed protocol has been set by the user through a custom protocols file
2016-07-25 14:52:44 +02:00
theirix
470901dc58
Fixed overflow in Oscar
2016-07-25 15:23:44 +03:00
Michele Campus
32e6a79e9c
Merge pull request #234 from theirix/fix-overflows
...
Fixed payload overflow in MQTT, DNS
2016-07-25 12:12:47 +02:00
theirix
d1f0b56adc
Fixed payload overflow in MQTT, DNS
2016-07-25 12:58:27 +03:00
Michele Campus
77fc4be458
Merge pull request #233 from theirix/fix-bgp
...
Fixed BGP payload overflow
2016-07-25 10:22:47 +02:00
theirix
3dec8d1880
Fixed BGP payload overflow
2016-07-25 11:19:00 +03:00
Michele Campus
b102caf482
Merge pull request #232 from theirix/dns-int-overflow
...
Fixed integer overflow in DNS extensions
2016-07-25 10:05:47 +02:00
theirix
7ec9e78e4d
Fixed integer overflow in DNS extensions
2016-07-25 10:04:39 +03:00
Campus
b6237bc39d
minor fixes hangout
2016-07-20 13:31:29 +02:00
Luca Deri
54935e4aa3
Removed un-necessary files
2016-07-20 01:41:26 +02:00
Luca Deri
18b9addc85
Implemented #228
2016-07-20 01:40:16 +02:00
Luca Deri
abdccaa8eb
Harvested some unused protocols
2016-07-20 00:28:32 +02:00
Luca Deri
a93c83fe6b
Added check on payload len ( #227 )
2016-07-12 16:05:49 +02:00
Luca
4fe8d350a2
Added fix to avoid IPv6 formatting differences across platforms
2016-07-12 00:38:07 +02:00
Simone Mainardi
72e3930e08
Fixes nDPI protocol initialization for Git
...
[NDPI] ndpi_init_protocol_defaults(missing protoId=226) INTERNAL ERROR: not all protocols have been initialized
This is actually a merge of branch 'dev' into 1.8-stable.
2016-07-08 15:23:45 +02:00
Simone Mainardi
31140c8da7
Fixes test cases for QUIC.Google
2016-07-08 15:03:40 +02:00
Luca Deri
47bb46176b
Fix for #225
2016-07-05 19:07:16 +02:00
Campus
0e49eb1d17
added drda protocol - fix quic output after commit 87717dd77f
2016-07-02 18:29:02 +02:00
Luca Deri
87717dd77f
Added QUICK subprotocol support
2016-06-30 17:03:36 +02:00
Luca Deri
6fb81f146e
Refreshed DNS implementation
2016-06-27 11:19:47 +02:00
Campus
ff6b193821
minor fixes - deleted useless part on git and quic protos
2016-06-24 13:45:43 +02:00
Campus
96623c0e4f
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2016-06-24 13:19:56 +02:00
Campus
0f089bd49a
added git protocol dissector and pcap for test
2016-06-24 13:19:14 +02:00
Luca Deri
b318d191a5
Removed variables not used
2016-06-23 23:53:03 +02:00
Luca Deri
d0665bb301
Recomputed results due to the previous commit
2016-06-19 21:29:19 +02:00
Luca Deri
adbba69988
Removed false positives from CoAP protocol
...
Improved DNS detection
Added misisng default DropBox port
Fix for #154
Added sample pcap of Tor traffic for regression testing
2016-06-19 21:25:58 +02:00
Luca Deri
539ab241cd
Reverted https://github.com/ntop/nDPI/commit/392a14241fa68512099ea6096a640275461af7d0 that prevented Tor dissector to work
2016-06-19 20:48:05 +02:00
Luca Deri
f18b7c5e14
Compilation fix
2016-06-15 06:04:07 +02:00
Luca Deri
19324f2904
Enhanced string boundary check to avoid crashes with malformed packets
2016-06-15 06:12:41 +02:00
Luca Deri
6c83cd627f
Enhanced string boundary check to avoid crashes with malformed packets
2016-06-14 20:25:23 +02:00
Luca Deri
ed09d78ed9
Added 1e100.net to Google
2016-06-12 21:01:59 +02:00
Luca Deri
0b7a392b30
Restored code harvested in
...
https://github.com/ntop/nDPI/commit/60e7e19dab72a37d57bc7854e702264e7d25886d#diff-0856ce19e6ed4e80946656d41f7edd65L135
DNS reply dissection can now be controlled by a preference as demonstrated in ndpiReader.c
2016-06-07 17:14:16 +02:00
Luca Deri
2379443ef5
Fix on multicast address check on teredo
2016-05-31 12:58:44 +02:00
Luca Deri
8c50b9692e
Improved bigram detection (used by Tor)
2016-05-31 12:47:51 +02:00
Luca Deri
787be6ec08
Improved teredo detection by discarding packets sent towards multicast addresses
2016-05-31 12:32:47 +02:00
Luca Deri
72efa329db
Enhanced fragments support in ndpiReader
...
Improved RX protocol dissection and removed port guess as it caused false positives.
2016-05-31 12:20:25 +02:00
Luca Deri
a79b338208
Compilation fix due t pack/unpack
2016-05-30 09:09:00 +02:00
Luca Deri
08b2899676
Merge pull request #210 from mscherer/patch-1
...
Fix typo
2016-05-29 10:10:22 +02:00
Michael Scherer
074e489fe3
Fix typo
2016-05-29 10:09:07 +02:00
Luca Deri
f8badefa90
Update homebrew 1.8 formula
2016-05-28 11:00:32 +02:00
Luca Deri
d113f8db5a
Moved to 1.8 release
2016-05-28 09:24:57 +02:00
Luca Deri
db36040fe1
Merge pull request #207 from alagoutte/scan-build
...
ndpi_main: fix Value stored to 'saddr'/'daddr' is never read
2016-05-28 09:06:34 +02:00
Alexis La Goutte
f0c1688b1b
ndpi_main: fix Value stored to 'saddr'/'daddr' is never read
...
ndpi_main.c:3286:7: warning: Value stored to 'saddr' is never read
ndpi_main.c:3290:7: warning: Value stored to 'saddr' is never read
ndpi_main.c:3291:7: warning: Value stored to 'daddr' is never read
2016-05-26 19:52:25 +02:00
Campus
67d3c9e9c8
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2016-05-24 23:33:13 +02:00
Luca Deri
ac664940da
Merge pull request #206 from theirix/l4-api
...
Updated ndpi_l4_detection_process_packet
2016-05-24 23:32:53 +02:00
Luca Deri
8eb0829267
Merge pull request #205 from theirix/dns-overflow
...
Fixed dns buffer overflow
2016-05-24 23:31:54 +02:00
Campus
f8ecdc004f
added new fb detection - remove old bittorrent functions - fix rx warning
2016-05-24 23:28:43 +02:00
theirix
c088672632
Synchronized ndpi_l4_detection_process_packet impl
2016-05-24 23:39:10 +03:00
theirix
552076a36c
Fixed dns buffer overflow
2016-05-24 23:34:15 +03:00
Michele Campus
a0fe6665b2
Merge pull request #203 from alagoutte/scan-build
...
fix warning found by Clang Analyzer (scan-build)
2016-05-24 22:04:33 +02:00
Michele Campus
b05907f592
Merge pull request #204 from alagoutte/fix_warning
...
fix warning when use -Wdocumentation CFLAG (clang)
2016-05-24 16:54:13 +02:00
Alexis La Goutte
bae6a09a7c
ndpi_main(.c): fix Null pointer passed as an argument to a 'nonnull' parameter
2016-05-24 13:46:17 +02:00
Alexis La Goutte
8bc1ed7d86
ndpi_api(.h): fix '@return' command used in a comment that is attached to a function returning void [-Wdocumentation]
2016-05-24 13:19:53 +02:00
Alexis La Goutte
9935cb0e3b
ndpi_util.c: fix The right operand of '+' is a garbage value
2016-05-24 08:12:36 +02:00
Alexis La Goutte
594f7074f7
ndpi_util: Value stored to 'fcs' is never read
2016-05-23 23:04:50 +02:00
Alexis La Goutte
a6c9d33c09
ndpi_util: replace if / else by switch/case
...
Fix also
The left operand of '==' is a garbage value
Value stored to 'slarp' is never read
Value stored to 'cdp' is never read
2016-05-23 23:03:26 +02:00
Alexis La Goutte
e0e1ed6936
rtcp: fix Value stored to 'sport'/'dport' is never read
2016-05-23 22:32:39 +02:00
Alexis La Goutte
7fb4b42092
bittorrent: fix Value stored to 'a' is never read
2016-05-23 22:30:47 +02:00
Alexis La Goutte
1b3055faef
ndpi_main: fix Value stored to 'saddr'/'daddr' is never read
2016-05-23 22:21:50 +02:00
Alexis La Goutte
cf905d0c7f
FTP: fix Value stored to 'packet' during its initialization is never read
2016-05-23 22:19:05 +02:00
Luca Deri
f084bbb6d0
Merge pull request #201 from alagoutte/scan-build
...
Fix missing break
2016-05-23 21:39:42 +02:00
Luca Deri
a2843084d6
Merge pull request #200 from alagoutte/typo
...
Fix some typo
2016-05-23 21:38:36 +02:00
Alexis La Goutte
3d23ee0e23
RX: fix indent
2016-05-23 19:56:45 +02:00
Alexis La Goutte
92718c4def
QUIC: fix typo
2016-05-23 19:56:45 +02:00
Alexis La Goutte
e1d3a8ea7d
QUIC: remove trailing whitespace
2016-05-23 19:56:45 +02:00
Alexis La Goutte
2f7a9bb789
Fix missing break
2016-05-23 08:01:51 +02:00
Luca Deri
ef2cb860a3
Recodede QUIC from scratch to make it more robust and export SNI (server name) as with SSL/HTTP
2016-05-21 15:34:10 +02:00
Campus
1e37916156
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2016-05-17 23:44:05 +02:00
Campus
f3fb445166
upgrade quic test pcap with version 33
2016-05-17 23:43:05 +02:00
Michele Campus
ac55d8dd8b
Merge pull request #193 from backer-and/dev
...
Fix QUIC
2016-05-17 23:40:01 +02:00
Andrea Buscarinu
f517a6a373
Fix QUIC
2016-05-17 23:15:38 +02:00
Campus
ccdcf9d82b
added OpenDNS service
2016-05-17 18:28:54 +02:00
Campus
b7863e2dc2
added Weibo service and pcap test
2016-05-13 01:05:13 +02:00
Campus
6edb280cc7
update test pcap due to modification of quic protocol - improved readability of code
2016-05-12 23:17:41 +02:00
Michele Campus
32847fcfd0
Merge pull request #190 from backer-and/dev
...
enhance/refactor quic.c
2016-05-12 22:53:41 +02:00
Luca
69bdc44441
Fix for invalid DNS reponse detection
2016-05-12 13:10:23 +02:00
Andrea Buscarinu
4d58e55781
enhance/refactor quic.c
2016-05-11 12:42:30 +02:00
Luca Deri
90843a4228
Merge pull request #188 from alagoutte/QUIC
...
Enhance QUIC support
2016-05-10 23:50:02 +02:00
Alexis La Goutte
d233459195
QUIC: Remove a wrong heuritics
...
There is always the QUIC version on first frame
2016-05-10 22:21:50 +02:00
Alexis La Goutte
6dab2b8c62
QUIC: Fix trailing whitespace
2016-05-09 19:12:09 +02:00
Michele Campus
86893a2984
Merge pull request #187 from madpilot78/add_needed_symbols
...
Add symbols needed by ntopng to the shared library export list.
2016-05-09 13:22:23 +02:00
Guido Falsi
3618f066bb
Add symbols needed by ntopng to the shared library export list.
2016-05-09 12:36:30 +02:00
Luca Deri
5c149e0363
Simplified ndpi_exit_detection_module()
2016-05-08 11:04:20 +02:00
Luca Deri
22e03ee98a
Simplified nDPI initialization function
2016-05-08 10:55:46 +02:00
Luca Deri
18901ca4d6
Added wrappers for substring-search
...
ndpi_init_automa()
ndpi_free_automa()
ndpi_add_string_to_automa()
ndpi_finalize_automa()
ndpi_match_string()
set_ndpi_malloc()
set_ndpi_free()
2016-05-07 18:45:18 +02:00
Luca Deri
d5f77e92f7
Fixed the travis link from master -> dev
2016-05-03 08:59:52 +02:00
Luca Deri
d139c31972
Merge pull request #185 from alagoutte/QUIC
...
Fix test suite
2016-05-03 08:55:47 +02:00
Alexis La Goutte
53550d8bb4
Fix test suite
...
there is some change with IPv6 Address...
2016-05-03 08:00:57 +02:00
Alexis La Goutte
356f9914cc
QUIC: fix test suite after typo change
2016-05-03 07:52:39 +02:00
Luca Deri
6e57c4618e
Merge pull request #184 from alagoutte/QUIC
...
Enhance QUIC support
2016-04-29 11:34:32 +02:00
Alexis La Goutte
9b0bef50de
QUIC: fix typo the protocol name is QUIC (and not Quic)
2016-04-29 09:25:28 +02:00
Alexis La Goutte
c957a12742
QUIC: last version of QUIC is Q033
...
Look Recent Changes by Version from QUIC Wire Layout Specification
2016-04-29 09:21:42 +02:00
Campus
1b9aa2ab71
fixed rx protocol for better logic conditions
2016-04-26 18:49:52 +02:00
Campus
1d17ece9ce
fix missing conditional and
2016-04-26 15:02:32 +02:00
Campus
34ce35dcfa
minor fix makefile
2016-04-26 14:20:23 +02:00
Campus
f66cfca2a9
fixed and improved rx protocol detection - there was error on detection when -d option was enabled
2016-04-26 13:48:43 +02:00
Campus
7c1e8ba2bf
rework some stuffs - added missing comments on functions
2016-04-24 23:43:22 +02:00
Luca Deri
e23446389c
Reworked https://github.com/ntop/nDPI/commit/8a4c15ecf5c5c1430e8047324a5e336db2f503f1 to avoid adding (un-needed) pcap dependency in nDPI core
2016-04-24 23:17:18 +02:00
Luca Deri
8cb6172e4b
Added #include <sys/types.h>
...
https://github.com/voidlinux/void-packages/blob/master/srcpkgs/ndpi/patches/types.patch
2016-04-24 22:59:05 +02:00
Luca Deri
d427647ce7
Firxed warnings
2016-04-24 10:35:54 +02:00
Luca Deri
8a4c15ecf5
Merge pull request #180 from emanuele-f/dev
...
High level API and ndpiReader simplification
2016-04-24 10:29:26 +02:00
Luca Deri
1be9194734
Code hardening for #181
2016-04-21 12:04:33 +02:00
emanuele-f
792d2fc79a
Remove floating stack pointer causing segmentation fault
2016-04-20 16:20:50 +02:00
emanuele-f
5386aede36
Integrate root flows free and little changes
2016-04-20 15:36:44 +02:00
emanuele-f
4e1317cd0f
Fix inline travis complaining
2016-04-20 02:23:37 +02:00
emanuele-f
9ee6442004
Other util API stuff
2016-04-20 01:32:01 +02:00
emanuele-f
6f84b85358
Use calloc to force 0 initialization
2016-04-20 00:03:21 +02:00
emanuele-f
d7548e72b2
Fix some issues
2016-04-19 23:35:35 +02:00
emanuele-f
7964e11c7f
Add header stuff
2016-04-19 22:39:19 +02:00
emanuele-f
a4d0af1f96
Move relevant functions to ndpi_util API module
2016-04-19 22:35:18 +02:00
emanuele-f
282bc16243
add malloc wrapper TODO
2016-04-19 22:19:06 +02:00
emanuele-f
4ba106a525
Change confusing "ndpi_flow" structure name to "ndpi_flow_info"
2016-04-19 19:25:42 +02:00
Michele Campus
1d54092c7d
Merge pull request #177 from giomasce/dev
...
Support RX protocol (used by AFS).
2016-04-16 18:03:26 +02:00
Giovanni Mascellani
4b50045ecd
Add file license.
2016-04-15 16:41:23 +02:00
Giovanni Mascellani
a6e715f574
Add RX testcase.
2016-04-15 15:47:39 +02:00
Giovanni Mascellani
18f5362a34
Support RX protocol (used by AFS).
2016-04-15 15:21:02 +02:00
Michele Campus
a71f525a2b
Merge pull request #175 from theirix/reader-asan-2
...
Combined ASAN overflow detection and buffer modify
2016-04-13 11:06:32 +02:00
theirix
efae85de84
Combined ASAN overflow detection and buffer modify
...
Combined approach from pull request #172 and commit 6a63ea4 .
2016-04-13 11:42:59 +03:00
Michele Campus
da811fbdd0
Merge pull request #173 from theirix/buffer-overflows
...
Fixed multiple buffer overflows
2016-04-12 23:41:02 +02:00
theirix
d7a2515093
Fixed oscar buffer overflow
2016-04-12 22:26:10 +03:00
Luca Deri
885cc3864e
Merge pull request #172 from theirix/reader-asan
...
Allocate exact-size buffer with address sanitizer
2016-04-12 21:22:38 +02:00
theirix
c22d3d3cae
Fixed more buffer overflows with small packets
2016-04-12 22:14:13 +03:00
theirix
fb3fc0c6de
Fixed buffer overflows with safe str search
...
1. Detected a lot of memory errors using address sanitizer
and ndpi-scapy tool.
2. Added ndpi_match_prefix function that compares strings
with taking care of payload packet len. Almost drop-in
replacement for match_first_bytes function.
3. Replaced unsafe match_first_bytes usage with a ndpi_match_prefix
and additional length checks.
2016-04-12 22:08:30 +03:00
theirix
624f61193c
Allocate exact-size buffer with address sanitizer
...
Allows address sanitizer to detect buffer overflow by
using special packet buffer when compiled with address sanitizer
support (autodetected clang and gcc).
2016-04-12 22:04:47 +03:00
Luca Deri
5a37ee9976
Removed some Tor false positives (more work necessary)
2016-04-06 09:45:38 +02:00
Luca Deri
6a63ea46a4
Added check for alerting when nDPI modified packet payload (should not happen)
2016-04-04 21:40:23 +02:00
Campus
f437fac412
fix for test pcap and output
2016-04-04 00:15:57 +02:00
Michele Campus
afea67e303
Merge pull request #170 from srzamfir/dev
...
Mqtt dissector fix
2016-04-04 00:12:13 +02:00
Campus
3d46f3df61
fixed wrong dropbox detection
2016-04-04 00:10:43 +02:00
Michele Campus
697617622c
Merge pull request #169 from theirix/build-json-c
...
Improved autogen.sh, json-c search
2016-04-03 23:58:51 +02:00
Sorin Zamfir
7e9e3903d8
Included test result for CoAP and Mqtt.
2016-04-03 15:05:38 +03:00
Sorin Zamfir
7b66fcff37
Merge remote-tracking branch 'upstream/dev' into dev
2016-04-03 14:45:39 +03:00
Sorin Zamfir
40b219c397
Fixed false positives on skype and KakaoTalk. Tests run smooth now.
2016-04-03 14:16:18 +03:00
Sorin Zamfir
b5e74ee3f1
Solved invalid detection on tests. Needs further work to detect one of the flows.
...
Please enter the commit message for your changes. Lines starting
2016-04-03 02:00:36 +03:00
theirix
6f95182751
Improved detection of json-c package.
...
- Improved detection code for json-c package to use pkg-config
with custom search path that includes /usr/local
- Added optional option --disable-json-c to disable json-c package for
reducing runtime dependencies.
2016-04-01 17:18:33 +03:00
theirix
41d7430442
Call configure with args from autogen
2016-04-01 17:18:23 +03:00
Campus
aa86387ba9
improved Microsoft detection (minor fix)
2016-04-01 02:17:58 +02:00
Campus
2a1f44610f
improved Microsoft detection
2016-04-01 02:11:51 +02:00
Campus
4704f48daa
minox fix dns
2016-03-29 15:07:16 +02:00
Campus
8dacc91d51
fixed dns check host name server
2016-03-29 15:04:15 +02:00
Campus
a594273989
fixed coap.c and dropbox.c after detecting wrong detection - added test for dropbox
2016-03-29 00:05:56 +02:00
Campus
d9264e415c
fixed and improved bittorrent detection for issue https://github.com/ntop/nDPI/issues/164
2016-03-27 01:39:38 +01:00
Luca Deri
b3df389bd6
Removed WinMX reference from Makefile
2016-03-23 08:46:24 +01:00
Campus
2998b78797
deleted winmx protocol due to abandoned development since July 2, 2004
2016-03-23 01:27:36 +01:00
Campus
46a526ce26
deleted mqtt.c
2016-03-23 00:35:22 +01:00
Campus
95fffec172
fix for pull request https://github.com/ntop/nDPI/pull/161
2016-03-20 16:10:26 +01:00
Michele Campus
323912371e
Merge pull request #161 from srzamfir/dev
...
Add CoAP and Mqtt (IoT specific protocols) dissectors
2016-03-20 15:51:11 +01:00
Sorin Zamfir
3213d2205a
Removed unused type definitions.
...
Disabled tracing in the example application.
2016-03-20 13:38:29 +02:00
Sorin Zamfir
3dde80ed0f
Included test file for coap and mqtt dissectors.
2016-03-20 12:12:42 +02:00
Sorin Zamfir
6f428c03e2
Merge remote-tracking branch 'remotes/iot/dev' into dev
...
Conflicts:
src/include/ndpi_protocol_ids.h
src/lib/ndpi_main.c
2016-03-20 11:53:27 +02:00
Sorin Zamfir
2d5d39db7b
Updated with mqtt callbacks.
2016-03-20 11:22:04 +02:00
Sorin Zamfir
28806f3187
Minor changes to a comment
2016-03-19 20:50:38 +02:00
Luca Deri
5349d33abf
Fixed unitialized variable
2016-03-19 14:10:26 +01:00
Campus
a499da00ba
added tcp port 51413 for TCP BT detection
2016-03-19 01:18:48 +01:00
Luca Deri
a4d9c8cc3b
Fix for https://github.com/ntop/nDPI/issues/159
2016-03-18 11:00:11 +01:00
Luca Deri
27d09c33ce
Fix for invalid DNS dissection that caused packet corruption
2016-03-17 08:28:24 +01:00
Campus
5b86186e85
deleted old and not yet good skype ip addr - added new Netflix and CloudFlare IP addr
2016-03-16 10:47:35 +01:00
Campus
3b399f62f4
improved Skype detection - redized Viber pcap for test
2016-03-15 15:03:06 +01:00
Campus
7c511fb2f2
add new detection of Viber (service)
2016-03-15 00:56:09 +01:00
Campus
4370781b49
rework API (part 1) - minor fixes functions
2016-03-14 01:04:50 +01:00
Luca Deri
1cf4926b4e
Enhanced Google detection
2016-03-13 21:30:21 +01:00
Campus
7ae06a114d
added check_punycode_string for issue https://github.com/ntop/nDPI/issues/157
2016-03-10 11:44:24 +01:00
Campus
8321b2fa66
added support for MS_OneDrive service
2016-03-08 01:49:48 +01:00
Luca Deri
ba966634f5
Source code rename to avoid conflicts on Windows
2016-03-06 18:52:43 +01:00
Luca Deri
dd12757493
Added check to harden code
2016-03-05 08:22:04 +01:00
Luca Deri
7ea37edfbf
Improved protocol detection
2016-03-04 22:13:37 +01:00
Luca Deri
462368f959
Added new ndpi_detection_giveup() API call to call before giving up for a given flow
...
Code cleanup
2016-03-04 19:15:13 +01:00
Michele Campus
73833e0ef0
Merge pull request #153 from Timothyyy/dev
...
protocols: sip CANCEL packet detection fix
2016-03-02 11:54:05 +01:00
Timothy
7d699ade0c
protocols: sip CANCEL packet detection fix
2016-03-02 11:04:36 +03:00
Luca
bc52b8f310
Changed label case
2016-02-29 23:22:34 +01:00
Luca
ecb8d117ac
Reworked sockets support
...
Fixed TFTP support
2016-02-29 17:23:05 +01:00
Luca Deri
ead8c4933e
Removed VEOHTV protocol and replaced with HTTPDownload
...
Fixed bug that prevented content type to be properly detected
2016-02-28 23:19:13 +01:00
Luca Deri
20374b542d
Fixed warning
...
Reworked protocol initialization
2016-02-27 09:00:02 +01:00
Campus
6df31099c2
typo fixed
2016-02-26 20:48:14 +01:00
Luca Deri
b7e2d8f019
Minor BT optimization
2016-02-25 10:25:03 +01:00
Luca Deri
80a35226c5
Improve BT-uTP protocol dissection
2016-02-25 09:58:23 +01:00
Luca Deri
e025d696f6
Added trace for BitTorrrent u-TP
2016-02-25 08:31:59 +01:00
Sorin Zamfir
245ca20eea
Fixed the bug. Damn comparison.
2016-02-20 00:15:09 +02:00
Sorin Zamfir
8f60ad8874
We have a bug :(.
2016-02-19 21:18:28 +02:00
Sorin Zamfir
d18a1edb67
Functional mqtt
2016-02-19 20:22:54 +02:00
Sorin Zamfir
a8050635fa
Improved Mqtt detection. 3 messages remain for identification
2016-02-19 19:55:03 +02:00
Campus
33fa1989bc
improved netflix and amazon cloud detection
2016-02-19 02:00:23 +01:00
Sorin Zamfir
7d3ab6d0b4
Some filtering applied. Not yet functional.
2016-02-18 21:36:06 +02:00
Sorin Zamfir
237102b5f2
First draft of the Mqtt dissector.
2016-02-18 20:29:41 +02:00
Campus
407b4fd1d5
improved facebook detection adding host name match
2016-02-18 00:43:43 +01:00
Campus
882cbd8b4e
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2016-02-18 00:30:02 +01:00
Campus
4c3d9788dd
added missing free for idle flow in ndpiReader.c
2016-02-18 00:29:06 +01:00
Luca Deri
59c65118e1
Updated readme
2016-02-17 10:58:52 +01:00
Campus
84976ed5dc
fix for https://github.com/ntop/nDPI/issues/148
2016-02-16 12:23:56 +01:00
Luca Deri
15ccb70ae6
Improved WhatsAppVoice detection
2016-02-15 22:16:39 +01:00
Luca Deri
e1481f3a90
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2016-02-15 12:00:56 +01:00
Luca Deri
01413c8d9f
Disabled list of skype hosts: it looks outdated
2016-02-15 11:55:21 +01:00
Campus
392a14241f
fixed ssl/tor bug for https://github.com/ntop/nDPI/issues/147
2016-02-15 11:02:40 +01:00
Luca Deri
16a5c6995c
Added ability to extract BitTorrent hash (and eventually peerId)
2016-02-15 09:57:26 +01:00
Campus
c7334e7c56
added cloudflare service - minor fixes for test pcap
2016-02-14 19:38:30 +01:00
Luca Deri
cc4ceb88a0
Fix for #143
2016-02-12 22:07:37 +01:00
Sorin Zamfir
7ee464709b
Functional dissector. Guestimative.
2016-02-11 23:55:21 +02:00
Sorin Zamfir
ee5e7449ac
First running example. No actual low-level detection.
...
* logging is now running
* included example capture
* included example log
* skeleton for coap detection
2016-02-08 23:01:22 +02:00
Sorin Zamfir
278a067d43
First skeleton for Coap dissector.
2016-02-07 19:29:30 +02:00
Luca
e9f7df081f
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2016-01-21 16:33:20 +01:00
Luca
d0b83a7196
Minor change to ndpi_protocol2name()
2016-01-21 13:52:52 +01:00
Luca
bc48b770de
Added ndpi_automa_match_string_subprotocol call
...
Fixed DNS dissector decoding bug
2016-01-21 13:25:55 +01:00
Campus
e7cb3d324a
fixed wrong dns detection for host name server that invalidated test pcaps
2016-01-12 17:21:04 +01:00
Luca Deri
0f3222e489
Fixed compilation errors due to previous commit
2016-01-06 18:11:57 +01:00
Luca Deri
a08a0077e6
Hardened DNS dissector
2016-01-06 17:38:41 +01:00
Campus
5336aecde7
added ip range feature for file loaded with -p option to support custom protocols specified
2015-12-31 17:07:22 +01:00
Michele Campus
a2c51a586e
Merge pull request #132 from pavel-odintsov/dev
...
Made ndpi memory allocator type compatible with C++ on x686 platforms
2015-12-31 10:27:54 +01:00
Campus
3aa506eb1b
added Office 365 URLs and IP address ranges (part 1)
2015-12-29 19:41:15 +01:00
Campus
60e7e19dab
wrote new dns dissector - deleted useless part of dns to slim data structures used in nDPI and ntopng
2015-12-29 18:17:52 +01:00
Pavel Odintsov
1b2702df24
Made ndpi memory allocator type compatible with C++ on x686 platforms. Switch from unsigned long to size_t as allocation functions parameter.
2015-12-28 14:08:57 +03:00
Campus
6d37ee2970
added Google server address range
2015-12-24 00:26:31 +01:00
Campus
2aa007fbad
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2015-12-24 00:17:26 +01:00
Campus
bfded90875
added OCS service and related pcap for testing
2015-12-24 00:16:33 +01:00
Luca
e0c6d80c09
Fix for #131
2015-12-18 11:53:01 +01:00
Campus
237de95285
fixed makefile include header ndpi_includes.h
2015-12-13 17:21:47 +01:00
Luca Deri
357d8c98a3
Merge pull request #128 from lmangani/dev
...
minor fix for tests after d2c355bdb0
2015-12-10 10:24:25 +01:00
Lorenzo Mangani
5f40394501
minor fix for tests
2015-12-10 00:07:37 +01:00
Luca
41c6d2d031
Improvement for Dropbox detection
...
Fix for #124
2015-12-08 00:32:30 +08:00
Luca
d2c355bdb0
Enhanced QQ support
2015-12-08 00:19:13 +08:00
Luca Deri
6f3d5a7b33
Win fixes
2015-11-30 14:38:16 +01:00
Luca Deri
34491f4be1
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2015-11-30 14:22:01 +01:00
Luca Deri
34e0a74c07
Win fixes
2015-11-30 14:21:50 +01:00
Campus
587f156557
reorganized header files - added ndpi_includes.h
2015-11-30 12:37:15 +01:00
Luca Deri
f04c3c6acb
Minor fix
2015-11-27 00:29:19 +01:00
Luca Deri
80171b7c54
Removed warning
2015-11-26 23:53:21 +01:00
Luca Deri
cb68d4d00a
Win32 compilation fixes
2015-11-26 23:47:55 +01:00
Luca Deri
98ef945d2e
fixes for packing datastructures
2015-11-26 19:46:51 +01:00
Campus
12b47fece0
fixed missed library netinet/in.h under FreeBSD
2015-11-26 12:32:15 +01:00
Luca Deri
bfb44934b7
Fixed IPv6 HTTPs support
2015-11-23 10:08:44 +01:00
Luca Deri
08ca34f5d0
Fix for #119
2015-11-23 10:07:19 +01:00
Luca Deri
a46c12c014
Fixed string offset
2015-11-22 23:28:50 +01:00
Luca Deri
d24093c4a6
Improvements on netbios name detection
2015-11-22 23:13:50 +01:00
Campus
ec034da5c9
fixed potential buff overflow with sizeof control
2015-11-19 20:18:37 +01:00
Campus
d5b9e4ccd5
fixed wrong output 6in4tunnel after updates in nDPI
2015-11-19 20:10:46 +01:00
Luca Deri
169c837613
Fix for https://github.com/ntop/nProbe/issues/7 for wrong RTP identification
2015-11-18 10:46:58 +01:00
Luca
33f38dd437
Added ndpi_l4_detection_process_packet function
2015-11-17 14:16:09 +01:00
Simone Mainardi
bd7004ecd7
Fixes #116 , adds extra #ifndef to prevent redefinitions
...
Extra #ifndef directives are added to prevent possible redefinitions
of __LITTLE_ENDIAN__ and __BIG_ENDIAN__
2015-11-15 22:44:06 +01:00
lucaderi
8babee0efb
Fix for CentOS6
2015-11-12 16:25:12 +01:00
Luca
a407da79a9
Update ndpi_ethernet definition
2015-11-12 15:32:44 +01:00
Luca
8399afa607
Removed legacy linux_compat.h file
...
Updated IPv6 address dump format
2015-11-12 15:23:00 +01:00
Luca
68091c7cdb
Added missing prototype
2015-11-12 15:11:28 +01:00
Luca
e62be406ce
Added missing ndpi_detection_get_sizeof_ndpi_flow_struct(), ndpi_detection_get_sizeof_ndpi_id_struct() functions
2015-11-12 15:09:49 +01:00
Michele Campus
dd3a79dac2
Merge pull request #114 from kYroL01/dev
...
Refactoring nDPI
2015-11-12 14:57:02 +01:00
Campus
a4f170604c
removed kernel support and #if 0s
2015-11-12 12:08:41 +01:00
Campus
349e0b6fd2
other changes related to refactoring, including Makefile.am modifications
2015-11-12 10:43:32 +01:00
Campus
78eceb43a1
deleted useless or not used functions and #ifdef
2015-11-10 01:12:00 +01:00
Campus
0cd8d939f1
deleted useless header
2015-11-09 14:36:49 +01:00
Campus
9fa2c7404f
fixed mdns and tcp/udp protocols after changes
2015-11-09 13:44:23 +01:00
Campus
8cd0a8838a
fixing ndpiReader.c after previous changes
2015-11-09 13:39:33 +01:00
Campus
d92ffa6771
initial refactoring nDPI - typedef defined only in ndpi_typedef.h
2015-11-09 13:36:35 +01:00
Michele Campus
63cab68a96
Merge pull request #111 from xumjbn/dev
...
fix dissector QQ unkown bug
2015-10-27 10:33:05 +01:00
xumjbn
f6eb2724e2
fix dissector QQ unkown bug
2015-10-28 15:07:26 +08:00
Luca Deri
fc6980e0c9
Fix for #86
2015-10-26 13:43:38 +01:00
Luca Deri
7a95a21e09
Fix for #110
2015-10-26 13:21:39 +01:00
Luca Deri
8edd628973
Minor core reorganization
2015-10-26 01:34:39 +01:00
Luca Deri
50e7e959fe
Updated test result
2015-10-25 23:26:03 +01:00
Luca Deri
b5f70d02b2
Fixed IPv6-in-IPv4 implementation
2015-10-25 23:23:51 +01:00
Luca Deri
76c2fb3de7
Removed linux kernel support
2015-10-24 12:47:23 +02:00
Campus
27ea5c0026
added 6in4 tunneling pcap for test
2015-10-23 17:15:28 +02:00
Campus
59d0af33b8
added support for 6in4 tunneling in ndpiReader.c
2015-10-23 17:14:03 +02:00
Luca Deri
25631a25f7
Implemented MS Lync support
2015-10-22 00:32:48 +02:00
Luca
ac9b4f8135
Removed non IP traffic to shrink pcaps
2015-10-20 16:20:59 +02:00
Campus
46694ece47
added new BGP pcap for detection of Cisco datalink layer
2015-10-19 01:58:03 +02:00
Campus
74b016c8b6
fixed BGP detection - added BGP pcap with Cisco hDLC and Cisco SLARP
2015-10-19 01:54:41 +02:00
Campus
7242b08609
deleted useless header
2015-10-16 19:28:53 +02:00
Campus
ee0954c8cb
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2015-10-16 17:49:29 +02:00
Campus
fd9f4753bb
added cisco hdlc datalink type - fix MPLS header - added BGP pcap with cisco hdlc & MPLS header
2015-10-16 17:48:38 +02:00
Luca Deri
dc9ad66fe2
Windows changes
2015-10-15 12:44:51 +02:00
Luca Deri
247acce949
Simplified IPv6 typedefs
2015-10-12 09:15:02 +02:00
Luca Deri
91b2e0bff2
Merge branch 'dev' of https://github.com/ntop/nDPI into dev
2015-10-12 01:17:19 +02:00
Luca Deri
17ad351386
Changed to make sure IPv6 defines are properly defined
2015-10-12 01:16:28 +02:00
Luca Deri
72eafff843
Improvements for NetFlix detection
2015-10-11 22:27:03 +02:00
Luca Deri
4ec03b7e87
Added TZSP encapsulation support
2015-10-11 18:35:51 +02:00
Luca Deri
88d466e58e
Added fix for Webex protol detection
2015-10-11 17:55:56 +02:00
Luca Deri
cf2c59b1d7
Fixed travis link
2015-10-11 17:44:41 +02:00
Luca
93f02c08dc
Fixed invalid indexes used in SMTP dissector.
...
See https://github.com/ntop/nDPI/commit/8c4fada42f8e6dcba42281fdc129e0a32b6050dc#commitcomment-13685139
2015-10-09 15:03:10 +02:00
Michele Campus
efac255821
Merge pull request #101 from Tomasu/dev
...
NDPI_PROTOCOL_KAKAOTALK_VOICE was used instead of NDPI_SERVICE_KAKAOT…
2015-10-08 13:27:57 +02:00
Thomas Fjellstrom
06515b43d8
NDPI_PROTOCOL_KAKAOTALK_VOICE was used instead of NDPI_SERVICE_KAKAOTALK_VOICE
2015-10-08 05:04:16 -06:00
Luca
0e436e66de
Reworked copyright to give credit to the developer
2015-10-06 16:24:03 +02:00
Luca Deri
3f2eec75c7
Merge pull request #98 from Tomasu/dev
...
Add Ubiquity AirControl 2 protocol detector
2015-10-06 16:09:59 +02:00
Thomas Fjellstrom
6519a1e326
add ndpi_malloc, ndpi_calloc and ndpi_set_detected_protocol to list of exported symbols
2015-10-04 20:04:39 -06:00
Thomas Fjellstrom
a2ff20990c
remove traces of DHCP detector from ubntac2.c
2015-10-04 19:53:25 -06:00
Thomas Fjellstrom
0a6d43c5f6
Add Ubiquity AirControl 2 protocol detection
2015-10-04 19:50:47 -06:00
Thomas Fjellstrom
64a368dd8e
add Ubiquity AirControl 2 protocol detection
2015-10-04 19:48:26 -06:00
Campus
1dc03d5741
added radio tap header identification for ieee802.11 packets
2015-10-04 14:00:47 +02:00
Luca Deri
e5c2fee022
Travis logo changes
2015-10-03 08:34:18 +02:00
Lorenzo Mangani
00bfba1d77
Update README.md
2015-09-29 01:04:46 +02:00
Luca Deri
76c963a70c
Added support for pfring_config
2015-09-23 15:53:01 +02:00
valentina
f78f6b59cc
Added some tags in order to recognize ebay
2015-09-23 00:53:25 +02:00
Luca Deri
faf3c81be3
Merge pull request #96 from mgigante/dbg_mgigante_freebsd81
...
Remove duplicated function declarations
2015-09-22 16:11:14 +02:00
Marco Gigante
a994722bb1
Remove duplicated function declarations
2015-09-22 15:25:09 +02:00
valentina
b383475282
Fixed DCE_RPC protocol when the port is different to default port (135)
2015-09-20 23:22:48 +02:00
Luca Deri
ce7866a6a6
Added missing symbols
...
ndpi_get_lower_proto
ndpi_is_proto
2015-09-04 09:00:00 +02:00
Lorenzo Mangani
0dfd6d3986
Merge pull request #92 from lmangani/dev
...
Added HEP protocol detection support (sipcapture)
2015-09-01 18:11:52 +02:00
Lorenzo Mangani
50757e7afe
Remove HEP2 match
2015-09-01 10:02:27 +02:00
Lorenzo Mangani
df64a1069e
Added HEP protocol detection support (sipcapture)
2015-08-30 23:07:31 +02:00
Luca Deri
9450226675
Merge pull request #91 from rs-dev/steam_NDPI_PARSE_PACKET_LINE_INFO
...
Make sure packet->user_agent_line.ptr is up to date before using it.
2015-08-30 22:42:33 +02:00
Martin Natano
8f8052735c
Make sure packet->user_agent_line.ptr is up to date before using it.
...
Otherwise we might dereference a stale pointer.
2015-08-28 14:49:51 +02:00
Luca Deri
aa6640e1c0
Merge pull request #84 from bcronje/dev
...
Ensure usage of struct in_addr is in network byte order.
2015-08-27 08:45:05 +02:00
Beyers Cronje
5f1b82d696
Ensure usage of struct in_addr is in network byte order.
...
Closes issue #81
2015-08-27 01:18:32 +02:00
Luca Deri
19e96f7dd2
Fixes #83 . Critical fix: due to an invalid endianess conversion some protocol were not properly indetified
2015-08-26 16:09:24 +02:00
Luca Deri
591d6df489
Merge pull request #80 from bcronje/dev
...
Do not write to packet.iph, which should be readonly.
2015-08-26 01:18:45 +02:00
Beyers Cronje
8fe318495f
Do not write to packet.iph, which should be readonly.
...
Resolves issue #77
2015-08-26 00:49:01 +02:00
Luca Deri
569c055389
Fir for #79
2015-08-26 00:29:18 +02:00
Luca Deri
26ce076f61
Merge pull request #76 from alagoutte/wdoc
...
Fix warning when use -Wdocumentation (Clang CFLAG)
2015-08-18 15:20:24 +02:00
Alexis La Goutte
07c7d63d44
Fix warning when use -Wdocumentation
...
src/include/ndpi_api.h:73:13: error: parameter 'ndpi_malloc' not found in the function declaration [-Werror,-Wdocumentation]
src/include/ndpi_api.h:91:13: error: parameter 'cache' not found in the function declaration [-Werror,-Wdocumentation]
src/include/ndpi_api.h:92:13: error: parameter 'cache' not found in the function declaration [-Werror,-Wdocumentation]
ndpiReader.c:152:22: error: not a Doxygen trailing comment [-Werror,-Wdocumentation]
ndpiReader.c:153:36: error: not a Doxygen trailing comment [-Werror,-Wdocumentation]
ndpiReader.c:156:39: error: not a Doxygen trailing comment [-Werror,-Wdocumentation]
2015-08-18 14:44:05 +02:00