Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
A multi-state Q-learning based CSMA MAC protocol for wireless networks
Bayat-Yeganeh H., Shah-Mansouri V., Kebriaei H. Wireless Networks24 (4):1251-1264,2018.Type:Article
Date Reviewed: Jul 27 2018

Carrier sense multiple access (CSMA) is a very common media access control scheme across various networking topologies and architectures. Whenever multiple agents require the use of a shared transmission medium to send data, some form of orchestration of access is required. Broadly generalized, the medium can either be partitioned or the attached agents can take turns transmitting. CSMA falls under the latter grouping of schemes. Agents first check if another agent is transmitting; if no other device is, then transmission can begin.

P-persistent CSMA is one of three variants that deal with the problem of multiple agents all starting transmission as soon as the medium is clear. Under this scheme, each agent will transmit with a probability p and defer to the next time the channel is available with probability 1-p. It should come as no surprise that the optimal value of p depends on the number of agents and how frequently they need to transmit data. In any network where either of these two parameters changes over time, it makes sense that each agent is able to adapt its value of p to the changing circumstances.

The authors use reinforcement learning to train the agents: each agent is rewarded for a successful transmission and punished for transmission collisions. All of the aforementioned topics are already extensively researched and documented. What the authors add to the state of the art is the combination of two conditions. First, no a priori knowledge of the network is assumed. Second, agents with various learning algorithms are combined to compete against each other. Performance results are realized through the use of MATLAB simulations.

Reviewer:  Bernard Kuc Review #: CR146175 (1811-0570)
Bookmark and Share
  Featured Reviewer  
 
Wireless Communication (C.2.1 ... )
 
Would you recommend this review?
yes
no
Other reviews under "Wireless Communication": Date
Mobile power management for wireless communication networks
Rulnick J., Bambos N. Wireless Networks 3(1): 3-14, 1997. Type: Article
Aug 1 1998
New call blocking versus handoff blocking in cellular networks
Sidi M., Starobinski D. Wireless Networks 3(1): 15-27, 1997. Type: Article
Sep 1 1998
The wireless Net
Fowler D. netWorker: The Craft of Network Computing 1(2): 24-34, 1997. Type: Article
Sep 1 1998
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy