Ivan Nardi
c50a8d4808
Add support for Snapchat voip calls ( #1147 )
...
* Add support for Snapchat voip calls
Snapchat multiplexes some of its audio/video real time traffic with QUIC
sessions. The peculiarity of these sessions is that they are Q046 and
don't have any SNI.
* Fix tests with libgcrypt disabled
2021-03-06 05:48:36 +01:00
Luca Deri
0f8a994841
Improved DGA detection
...
Before
Accuracy 66%, Precision 86%, Recall 38%
After
Accuracy 71%, Precision 89%, Recall 49%
2021-03-03 19:30:01 +01:00
Luca
49843509e5
Added verbose option
2021-03-03 08:12:16 +01:00
Luca Deri
1a37595de0
Removed check for knowns protocols (major and app protocols)
2021-03-03 00:57:56 +01:00
Luca Deri
56bfb439f8
Improved DGA detection with trigrams. Disadvantage: slower startup time
...
Reworked Tor dissector embedded in TLS (fixes #1141 )
Removed false positive on HTTP User-Agent
2021-03-03 00:41:07 +01:00
Ivan Nardi
4c00ff89df
DTLS: improve support ( #1146 )
...
* DTLS: add some pcap tests
* DTLS: fix parsing of Client/Server Helllo message
* DTLS: add parsing of server certificates
2021-03-02 21:15:40 +01:00
Ivan Nardi
2b71a329c1
QUIC: fix mvfst-27 test ( #1145 )
...
Regardless of its name, quic-mvfst-27 trace doesn't contain mvfst-27
traffic
2021-03-02 21:15:02 +01:00
Toni
16890a6632
Added NDPI_MALICIOUS_SHA1 flow risk. ( #1142 )
...
* An external file which contains known malicious SSL certificate SHA-1 hashes
can be loaded via ndpi_load_malicious_sha1_file(...)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-02-26 17:00:05 +01:00
Luca Deri
fba61adf5e
Improved DNS dissector
2021-02-26 00:42:15 +01:00
Luca Deri
4bd175b07e
Modified JA3 fingerprint message
2021-02-24 10:42:26 +01:00
Luca Deri
f1b22b199f
Added NDPI_MALICIOUS_JA3 flow risk
...
Added ndpi_load_malicious_ja3_file() API call
2021-02-22 23:19:23 +01:00
Luca Deri
fc3db8f169
Implemented TLS Certificate Sibject matching
...
Improved AnyDesk detection
2021-02-22 22:37:33 +01:00
Luca Deri
a21ad2fbe4
Added new data for risky domains test
2021-02-21 22:08:01 +01:00
Luca Deri
fc16c9368e
Added risky domain flow-risk support
2021-02-21 21:45:46 +01:00
Luca Deri
a2c5adc374
Improved nDPI string matching algorithm
2021-02-18 21:47:09 +01:00
Luca Deri
c408df1b0e
STUN improvements
2021-02-10 15:22:20 +01:00
Luca Deri
e2f6569adb
Fixed CPHA missing protocol initialization
...
Improved IEC104 and IRC detection
2021-02-10 15:22:20 +01:00
Luca Deri
1a557d0918
IRC test files
2021-02-09 21:25:48 +01:00
Luca Deri
be58d78417
(Temporarely) Disabled fragment manager ( #1129 )
2021-02-05 23:03:08 +01:00
Luca Deri
45e9c3c438
Partial fix for #1129
2021-02-05 22:22:33 +01:00
Luca Deri
54636a3213
Improved (partial) TLS dissection
2021-02-04 22:06:18 +01:00
Ivan Nardi
679c317c57
Fix utests when "--disable-gcrypt" flag is used ( #1128 )
...
Fix: d6684f4b
2021-02-04 19:29:48 +01:00
Toni and Luca Deri
7255dbe4b7
Added fuzzy targets conditional in tests/do.sh.in which prevents the fuzzer from running if nDPI was configured previously --enable-fuzztargets but not for the current config (may produce invalid results). ( #1126 )
...
* fixed possible NULL pointer dereference for memcpy(), src pointer should never be NULL
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2021-02-04 19:28:52 +01:00
Luca Deri
6289413fea
Updated results
2021-02-03 11:58:17 +01:00
Luca Deri
d6684f4b4c
Added test pcap
2021-02-03 11:56:14 +01:00
Luca Deri
155b1aaa68
Updated results due to the new fragment manager handler
2021-02-03 11:52:46 +01:00
Luca Deri
d19bad1581
Added pcap for testing fragments reassembly
2021-02-03 11:48:53 +01:00
Toni
399755607d
Disable tests that require libgcrypt if --disable-gcrypt set. ( #1121 )
...
Signed-off-by: Toni Uhlig <matzeton@googlemail.com >
2021-01-21 08:59:06 +01:00
Luca
0809956e5f
Rewored UPnP protocol that in essence was WSD hence it has been renamed
...
Cleaned up TLS code for DTLS detection by defining a new DTLS protocol
2021-01-20 09:53:30 +01:00
Luca Deri
e9f43516ec
Improves STUN dissection removing an invalid termination condition that prevented Skype calls to be properly identified
2021-01-13 16:46:51 +01:00
Ivan Nardi
2080cc7365
QUIC: add suppport for DNS-over-QUIC ( #1107 )
...
Even if it is only an early internet draft, DoQ has already (at least)
one deployed implementation.
See: https://www.zdnet.com/article/ad-blocker-adguard-deploys-worlds-first-dns-over-quic-resolver/
Draft: https://tools.ietf.org/html/draft-huitema-dprive-dnsoquic-00
In the future, if this protocol will be really used, it might be worth to
rename NDPI_PROTOCOL_DOH_DOT in NDPI_PROTOCOL_DOH_DOT_DOQ
2021-01-07 10:56:39 +01:00
Ivan Nardi
b8a5358e80
QUIC: improve handling of SNI ( #1105 )
...
* QUIC: SNI should be always saved in flow->protos.stun_ssl.ssl.client_requested_server_name
Close #1077
* QUIC: fix matching of custom categories
* QUIC: add NDPI_TLS_MISSING_SNI support for older GQUIC versions
* QUIC: fix serialization
* QUIC: add DGA check for older GQUIC versions
2021-01-07 10:55:23 +01:00
Luca Deri
eb37f8f1fb
Split HTTP request from response Content-Type. Request Content-Type should be present with POSTs and not with other methods such as GET
2021-01-06 18:28:24 +01:00
Ivan Nardi
1b524f5538
QUIC: update to draft-33 ( #1104 )
...
QUIC (final!?) constants for v1 are defined in draft-33
2021-01-04 15:50:14 +01:00
Ivan Nardi
23b84cd3ee
Remove FB_ZERO protocol ( #1102 )
...
FB_ZERO was an experimental protocol run by Facebook.
They switched to QUIC/TLS1.3 more than 2 years ago; no one ever used it but
them so it is definitely dead.
See: https://engineering.fb.com/2018/08/06/security/fizz/
2021-01-04 15:49:19 +01:00
Luca Deri
4ddb5f4245
Added TLS test with long certificate
2021-01-04 11:31:25 +01:00
Luca Deri
05d76525b0
Added HTTP suspicious content securirty risk (useful for tracking trickbot)
2021-01-02 21:11:42 +01:00
Luca Deri
b7376cc690
Restored QUIC stats
2020-12-30 12:12:33 +01:00
Luca Deri
9c1827a77b
Fixed output when tLS (nad not QUIC) is used
2020-12-28 09:19:39 +01:00
Luca Deri
34fc9d5d50
Introduced fix on TLS for discarding traffic out of sequence that might invalidate dissection
2020-12-22 09:47:39 +01:00
Luca Deri
2768da0637
Improved HTTP dissection
2020-12-16 14:45:29 +01:00
rafaliusz and rafal
1ecc6d323e
Add a connectionless DCE/RPC detection ( #1078 )
...
* Add connectionless DCE/RPC detection
* Add DCE/RPC pcap file as well as its test result
Co-authored-by: rafal <rafal.burzynski@cryptomage.com >
2020-12-08 15:48:53 +01:00
Luca Deri
23a15bae5f
Fixes #1029
2020-11-27 18:51:56 +01:00
Ivan Nardi
53a5c354d8
Quic fixes ( #1067 )
...
* QUIC: fix return value on error path on quic_cipher_init()
* QUIC: allow dissection of sessions forcing version negotiation
Enhance heuristic to avoid false positives.
2020-11-22 11:04:10 +01:00
Luca Deri
d670850f55
Updated results
2020-11-16 21:25:59 +01:00
Zied Aouini and Luca Deri
bfabb0ddf4
Add Virtual Asssitant (Alexa, Siri) support. ( #1057 )
...
* Add AmazonAlexa protocol.
* Add AmazonAlexa test file and result.
* Include pcapng as file format.
* Rename Category to VirtualAssistant.
* Add AppleSiri virtual assistant.
* Fix pcapng test files format support.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:19:38 +01:00
Zied Aouini
3d8fd42307
Implement DGA detection performances tracking workflow. ( #1064 )
...
* Implement dga evaluation helper.
* Add test set for DGA classification.
* Add DGA classification performances tracking as part of Travis.
* Add DGA evaluation doc.
* Fix CI on OSX.
* Add missing backquote.
2020-11-16 21:17:16 +01:00
Zied Aouini
76bb83085b
Improve subprotocols detection. ( #1062 )
...
* Improve Spotify detection.
* Improve Skype detection.
* Improve Microsoft detection.
* Fix Microsoft detection categories.
* Improve Waze detection.
* Improve Apple detection.
* Improve WindowsUpdate detection.
* Improve TikTok detection.
* Improve Teams detection.
* Improve Youtube detection.
* Improve Messenger detection.
* Improve Twitch detection.
* Improve Hulu detection.
* Improve Facebook detection.
* Improve AmazonVideo detection.
2020-11-16 21:16:38 +01:00
Zied Aouini and Luca Deri
3529268df8
Add Tumblr support. ( #1061 )
...
* Add Tumblr protocol.
* Add Tumblr test file and result.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:14:06 +01:00
Zied Aouini and Luca Deri
22780da8d5
Add Reddit support. ( #1060 )
...
* Add Reddit protocol.
* Add Reddit test file and result.
Co-authored-by: Luca Deri <lucaderi@users.noreply.github.com >
2020-11-16 21:13:01 +01:00