Toni
10161448bc
Improved TLS application data detection. ( #1532 )
...
Signed-off-by: lns <matzeton@googlemail.com >
2022-04-27 17:22:53 +02:00
Ivan Nardi
f455421870
Improve protocol stacks ( #1425 )
...
We should have two protocols in classification results only when the
"master" protocol allows some sub-protocols.
Classifications like `AmazonAWS`, `TLS/AmazonAWS`, `DNS/AmazonAWS` are
fine. However classifications like `NTP/Apple`, `BitTorrent/Azure`,
`DNScrypt.AmazonAWS` or `NestLogSink.Google` are misleading.
For example, `ndpiReader`shows `BitTorrent/Azure` flows under `Azure`
statistics; that seems to be wrong or, at least, very misleading.
This is quite important since we have lots of addresses from CDN
operators.
The only drawback of this solution is that right now ICMP traffic is
classified simply as `ICMP`; if we are really interested in ICMP stuff
we can restore the old behaviour later.
2022-01-30 19:15:42 +01:00
Ivan Nardi
86b97ffb73
Sync unit tests results ( #1423 )
...
Fix: 7a3aa41a
2022-01-28 17:17:39 +01:00
Ivan Nardi
3a087e951d
Add a "confidence" field about the reliability of the classification. ( #1395 )
...
As a general rule, the higher the confidence value, the higher the
"reliability/precision" of the classification.
In other words, this new field provides an hint about "how" the flow
classification has been obtained.
For example, the application may want to ignore classification "by-port"
(they are not real DPI classifications, after all) or give a second
glance at flows classified via LRU caches (because of false positives).
Setting only one value for the confidence field is a bit tricky: more
work is probably needed in the next future to tweak/fix/improve the logic.
2022-01-11 15:23:39 +01:00
Ivan Nardi
b1e9245d94
ndpiReader: slight simplificaton of the output ( #1378 )
2021-11-27 17:32:23 +01:00
Ivan Nardi
5464bad6db
Differentiate between standard Amazon stuff (i.e market) and AWS ( #1369 )
2021-11-04 00:20:45 +01:00
Ivan Nardi
b6d9536533
Fixed cleartext protocol assignment ( #1357 )
2021-10-25 15:04:04 +02:00
Luca Deri
9e97d20c25
Refreshed results list
2021-10-16 12:03:16 +02:00
Luca Deri
408d78e628
Improved DGA detection for skipping potential DGAs of known/popular domain names
2021-10-05 16:51:24 +02:00
Luca Deri
e8455236bd
Updated output
2021-08-07 17:38:33 +02:00
Ivan Nardi
cccf794265
ndpiReader: add statistics about nDPI performance ( #1240 )
...
The goal is to have a (roughly) idea about how many packets nDPI needs
to properly classify a flow.
Log this information (and guessed flows number too) during unit tests,
to keep track of improvements/regressions across commits.
2021-07-13 12:28:39 +02:00
Luca Deri
732bcecd17
Added flow risk score
2021-05-18 21:05:47 +02:00
Luca Deri
43a8576efb
Reworked human readeable string search in flows
...
Removed fragment manager code
2021-05-17 20:55:06 +02:00
Luca Deri
ac1eaca8a6
Added browser TLS heuristic
2021-05-13 20:00:27 +02:00
Luca Deri
1a37595de0
Removed check for knowns protocols (major and app protocols)
2021-03-03 00:57:56 +01:00
Luca Deri
56bfb439f8
Improved DGA detection with trigrams. Disadvantage: slower startup time
...
Reworked Tor dissector embedded in TLS (fixes #1141 )
Removed false positive on HTTP User-Agent
2021-03-03 00:41:07 +01:00
Luca Deri
23a15bae5f
Fixes #1029
2020-11-27 18:51:56 +01:00
Luca Deri
f597086386
Stddev calculation changes
2020-08-30 12:48:32 +02:00
Luca Deri
dd75060932
Fixed false positive in suspicous user agent
...
Optimized stddev calculation
2020-08-30 12:25:15 +02:00
Luca Deri
fef199ad45
Added new check for detecting suspicious (too long) names
2020-08-21 19:35:27 +02:00
Luca Deri
2ae4c6675d
Fixed partial TLS dissection
2020-07-30 18:30:07 +02:00
Luca Deri
e71df49b3e
Changed due to bin size extension
2020-07-30 00:06:46 +02:00
Luca Deri
12abcd516b
Updated test results due to bin changes
2020-07-09 17:28:02 +02:00
Luca Deri
d9af1562f0
Fixes #906
...
Packet bins are not printed wehn empty
2020-06-22 14:30:26 +02:00
Luca Deri
1a62f4c799
Added ndpi_bin_XXX API
...
Added packet lenght distribution bins
2020-06-22 01:02:54 +02:00
Luca Deri
3506a07864
Added check in TLS 1.2+ for reporting a risk when TLS is not used to carry HTTPS
2020-06-08 14:20:10 +02:00
Luca Deri
4a09b4efa0
Added TLS issuerDN and subjectDN
2020-05-07 18:44:51 +02:00
emanuele-f
fd94270507
Remove decimals in test results for IAT, packet lengths and goodput ratio
2020-02-14 11:42:20 +01:00
Luca Deri
0703ab5ac5
Improved DNS response decoding
...
The first decoded address is now reported by ndpiReader
2020-02-04 22:16:54 +01:00
Luca
daae1cc9b1
Reworked TLS dissection
2020-01-01 12:59:19 +01:00
Luca Deri
7da7ae622b
Improvements to stop dissection when the first protocol is detected
...
Used IP-based detection to compute the application protocol
Improved application detection
2019-11-28 23:20:40 +01:00
Luca Deri
e98b994a39
Updated results
2019-11-21 13:35:04 +01:00
Luca Deri
4fd7e5734a
Manual merge of pull #769
2019-10-02 23:01:29 +02:00
Luca
0ed679e795
Improves IAT calculation
2019-09-24 16:37:42 +02:00
Luca Deri
11e9fd8cef
As TLS certificate fingerprint is computed, TLS without certificate protocol has been removed
...
Various improvemenets in detection quality
2019-09-15 12:18:24 +02:00
Luca Deri
0f9107bef3
Fixed timezone conversion
2019-09-10 22:15:23 +02:00
Luca Deri
068611e8ba
Changes in validity format
2019-09-10 21:44:42 +02:00
Luca Deri
65bdd0de9a
Uddated results
2019-09-10 00:43:03 +02:00
Luca Deri
086c511a11
Parsed TLS certificate validity
2019-09-10 00:34:48 +02:00
Luca Deri
d457b07f9f
Refreshed Tor node list
2019-09-08 21:42:33 +02:00
Luca
886d575157
Added -C to generate CSV analysis files
...
Improved IAT and byte distribution
2019-09-03 18:38:54 +02:00
Luca
c328452687
Average calculation fix
2019-08-29 16:08:18 +02:00
Luca Deri
8b8fd25626
Compilation fix on systems without JSON-C
2019-08-29 15:35:29 +02:00
Luca
b1270fc7bb
Uodated results
2019-08-29 15:23:01 +02:00
Luca
e4e40e3c70
Added entropy, average, stddev, variance, bytes ratio calculation
2019-08-28 14:02:39 +02:00
Luca
c6e832be18
Various TLS/STUN improvememnts
2019-08-08 18:09:12 +02:00
Luca
419160f351
Implemented DTLS support
...
Renamed ssl to tls
2019-08-08 12:45:27 +02:00
Luca Deri
3c4a959c1e
Updated results when adding client hello
2019-08-07 20:06:31 +02:00
Luca Deri
b715467da6
Added -e option to ndpiReader for searchign human readeable strings lenght
...
Default human readeable strings lenght is not 5 chars (used to be 8)
2019-07-24 00:25:00 +02:00
Luca Deri
b8867642fc
Refresh after data leak detection
2019-07-18 11:49:53 +02:00