Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Detection accuracy of network anomalies using sampled flow statistics
Kawahara R., Ishibashi K., Mori T., Kamiyama N., Harada S., Hasegawa H., Asano S. International Journal of Network Management21 (6):513-535,2011.Type:Article
Date Reviewed: Jul 23 2012

The identification of anomalies in network traffic is still a challenging task. The authors investigate this issue by measuring traffic at the flow level and collecting flow statistics through packet sampling. They use an analytical model they developed for quantitatively evaluating traffic conditions, such as the ratio of anomalous traffic volume to normal traffic volume, to investigate, in detail, “the effect of packet sampling on the detection accuracy of network anomalies.” Furthermore, the authors propose “a method of spatially partitioning monitored traffic into groups to increase the detection accuracy,” even for low sampling rates. For this case, they “further propose a method of determining an appropriate number of partitioned groups.” This paper is an extension of the authors’ previous work, which was presented at the 2007 IEEE Global Communications Conference (GLOBECOM) and at a 2007 IEEE International Symposium on Applications and the Internet (SAINT) workshop. Unfortunately, the authors did not update the references--the most recent one is from 2008.

After an introduction to the problem in the first section, a brief survey of related work is given in section 2. In the next section, the authors use “a link connecting the Science Information Network and one of the large commercial Internet exchanges in Japan” to show that anomaly detection becomes difficult when packet sampling is performed.

Section 4 presents the “analytical model and the effects of packet sampling rate and ... traffic [conditions] on detection accuracy.” First, the model itself is outlined, showing that the false positive rate (FPR)--the rate of misidentifying anomalies--is independent of the sampling rate, but the false negative rate (FNR)--the rate of missing anomalies--is not. The authors use a threshold-based anomaly detection method in their approach. This part of the paper lacks detailed explanations, and the justification for the model assumptions is rather scarce. Experimentally, the approach is supported by data from scientific traffic at the National Laboratory for Applied Network Research. The authors present a method for analyzing FNR as a function of the sampling rate; it is evaluated using data from the scientific traffic. It can be seen that FNR depends not only on the sampling rate, but also on the anomalous traffic volume. Next, the impact of commercial network traffic on the proposed evaluation model is presented (using measurement data from 2009), showing that the proposed approach can also cope with network traffic with different characteristics. Finally, the factors degrading detection accuracy are discussed, showing that detection accuracy can be improved if the ratio of anomalous to normal flows is increased.

In section 5, the authors propose a spatial partitioning method for improving detection accuracy. The approach, as well as a method for determining the number of partitioned groups, is experimentally validated. The paper ends with a concluding section (6).

From both the theoretical and experimental sides, this is a well-done paper; it is well organized and very readable.

Reviewer:  G. Haring Review #: CR140480 (1212-1239)
Bookmark and Share
 
Network Monitoring (C.2.3 ... )
 
 
Performance of Systems (C.4 )
 
Would you recommend this review?
yes
no
Other reviews under "Network Monitoring": Date
Network monitoring explained: design and application
Chiu D., Sudama R., Ellis Horwood, Upper Saddle River, NJ, 1992. Type: Book (9780136147107)
Jun 1 1993
The art of testing network systems
Robert W. J., John Wiley & Sons, Inc., New York, NY, 1996. Type: Book (9780471132233)
Aug 1 1997
RMON
Perkins D., Prentice Hall PTR, Upper Saddle River, NJ, 1999. Type: Book (9780130961631)
Oct 1 1999
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy