A Machine Learning Based Forwarding Algorithm Over Cognitive Radios in Wireless Mesh Networks
Abstract
Wireless Mesh Networks improve their capacities by equipping mesh nodes with multi-radios tuned to non-overlapping channels. Hence the data forwarding between two nodes has multiple selections of links and the bandwidth between the pair of nodes varies dynamically. Under this condition, a mesh node adopts machine learning mechanisms to choose the possible best next hop which has maximum bandwidth when it intends to forward data. In this paper, we present a machine learning based forwarding algorithm to let a forwarding node dynamically select the next hop with highest potential bandwidth capacity to resume communication based on learning algorithm. Key to this strategy is that a node only maintains three past status, and then it is able to learn and predict the potential bandwidth capacities of its links. Then, the node selects the next hop with potential maximal link bandwidth. Moreover, a geometrical based algorithm is developed to let the source node figure out the forwarding region in order to avoid flooding. Simulations demonstrate that our approach significantly speeds up the transmission and outperforms other peer algorithms.
Keywords:
mesh networks, machine learning, forwarding, highest bandwidth capacityJianjun Yang, Ju Shen, Ping Guo
0.1 Introduction
Mesh routers and client devices are self-organized and self-configured to form wireless mesh networks(WMNs) meshsurvey (). A device is called a node in WMNs. Each node is equipped with multiple radios to improve the whole capacities in WMNs yang0 (). The radios in WMNs are cognitive radios, by which the radio devices are capable of learning from their environment and adapting to the environmentCognitive (). Cognitive radio is also called programmable radio because such radio has the ability of self-programmingself (), learning and reasoning Cognitive ().
Machine learning has been studied for about 60 years. It evolved from simple artificial intelligence to a wide variety of applications in image processing, vision, networking, and pattern recognition. In this paper, we propose a learning algorithm for a forwarding node to find one of its links with possibly maximal bandwidth, and then choose next forwarding node and then forward the message to that node. Each node only saves the last three changed bandwidth status of its links . Then the forwarding node learns the three status and predict the potential bandwidth of its links. So the forwarding node is able to find the neighbor with highest link bandwidth as its next hop. We further devise an algorithm to let the source node figure out the forwarding region in order to avoid flooding.
The rest of the paper is organized as follows. Section II discusses the related research on this topic. Section III proposes our novel forwarding method that selects the best next hop. We evaluate the proposed schemes via simulations and describe the performance results in Section IV. Section V concludes the paper.
0.2 Related Work
Some approaches on machine learning, wireless forwarding and related work have been studied yang1 ()MTA ()yang2 ()yang3 ()shen1 ()shen2 ()shen3 (). Wang Y. et al. wang1 ()proposed a machine learning mechanism to improve data transmission in sensor network. The predication of link quality was used to implement the approach. Additionally, they developed a protocol called MetricMap to maintain efficient routing in case the regular routing is not working.
Sawhney A. et al. Sawhney1 () presented a machine learning algorithm to handle congestion controlling in wireless networks. Their approach learns many factors that have impact to congestion controlling, and then uses the parameters in a fuzzy logic to generate better result when congestion takes place. The efficiency is assessed with machine learning tools.
0.3 The Learning Based Forwarding Mechanism
0.3.1 The Forwarding Problem
In wireless mesh networks(WMNs), the communications are over links. Link bandwidth is critical for transmission speed. Since each node may be equipped with multiple network interfaces with different radios and the radios are switchable, the bandwidth over two neighbor nodes may vary from time to time. The radios in WMNs are cognitive radios and then the nodes are able to learn the changes of past bandwidths and can further predict and select the desired link with potential highest bandwidth.

Assuming a source node intends to send data to a destination node , many traditional routing algorithms set up the forwarding path by simply selecting the shortest route. For example, is the forwarding path in figure 1. However, it may not be the best path in WMNs. In WMNs, the bandwidth over two nodes changes frequently. The bandwidth of the link is possibly much lower than that of . Or the past bandwidth of is higher than but two much traffic is over now so the available bandwidth of is going down while that of is going up.
Our goal is to let each forwarding node select the link for next hop with the highest potential bandwidth. In our approach, each node learns its links’ past bandwidths and then predict their potential bandwidths. Then the forwarding node figures out its next hop with highest potential bandwidth.
0.3.2 Prediction for Future Bandwidth
Suppose node saves the bandwidth changes of its links of the last three times , , and . Then for any of its neighbor , predicts the potential bandwidth of link . By computational methodcomp (), we define
at time , where is the bandwidth between node and node at time . Then the bandwidth of link at future time can be calculated and predicated as:
Algorithm 1 describes node learns the bandwidth of link in the last three changes and then it predicts the bandwidth of next time .
0.3.3 Forwarding Region
When a node intends to send data to node , it selects the neighbor node with highest potential link bandwidth as its next hop and then same metric continues to select the best next forwarding node . Apparently, will not select any nodes in the opposite direction from to . How is node aware of the region where the next hop falls? In current WMNs, each device is equipped with GPS and hence it knows its location. We assume that the sender knows its own location and the location of the receiver. The assumption is very common in geographic routingyang1 (). Figure 2 shows the scenario. Suppose node intends to send data to node , it figures out the forwarding region as algorithm 2.

0.3.4 Forwarding algorithm
Suppose each node in a Wireless Mesh Network regularly mains the last three changes of bandwidths of all its links that connect its neighbors. When node intends to send data to node , first uses algorithm 2 to figure out the region where the forwarding will be performed. Then calls algorithm 1 to find the node with potential highest bandwidth among all its neighbors as next hope. When the selected node relays the forwarding, it only considers its neighbors in the forwarding region as forwarding candidates, and it calls algorithm 1 to forward the data to next hop with potential highest bandwidth. The forwarding resumes until the packets arrive destination node .
0.4 Evaluation
We evaluated our mechanism in a simulated noiseless radio network environment by MATLAB. We create a topology that consists of a number of randomly distributed nodes. We compare our approach(ML Forwarding) with two other algorithms. One is congestion control and fuzzy logic with machine learning for wireless communications, say Fuzzy Logic. The other one is supervised learning approach for routing optimization in wireless networks, say Supervised Learning. The compared metrics are transmission delay(Milliseconds) and transmission speed(MBs/Millisecond). We performed a sequence of experiments in which the number of nodes varies from 100 to 300 in increments of 25 over an area of 100x100 meters in the reference network. For each number of mobile users, we conduct our experiments 10 times and present the average value.

Figure 3 shows that our approach results in the least delay. It is because our approach selects the link with potential maximum bandwidth of each hop. Figure 4 shows that with the same reason, our approach generates the maximal transmission speed among the three approaches.

0.5 Conclusion
A machine learning based forwarding algorithm in wireless mesh networks with cognitive radios is presented in this paper.
In this algorithm, each mobile device keeps the last three times of bandwidth changes of its links that connect its neighbors. Then when a node
intends to forward data, the node learns the historical changes of bandwidth and then predicts the possible future bandwidths
of the links with neighbor nodes. Hence the forwarding node is able to select the next hop with highest bandwidth.
We also designed a geometrical algorithm to let the source node figure out the forwarding region in order to avoid unnecessary flooding.
Simulation results demonstrate that our approach
outperforms peer approaches.
ACKNOWLEDGMENT
This work is supported in part by the Spanish government, Dirección General de Investigación Científica y Técnica, a unit of the Ministerio de Economía y Competitividad, TIN2015-69542-C2-1-R (MINECO/FEDER), in collaboration with Universidad Rey Juan Carlos, Spain, under the project “Inteligencia Artificial y Métodos Matemáticos Avanzados para el Reconocimiento Automático de Actividades.”
Bibliography
- (1) Akyildiz I.F. and Wang X.: A Survey on Wireless Mesh Networks, IEEE Communications Magazine (2005).
- (2) Mitola, J.: Cognitive radio: An integrated agent architecture for software defined radio, Ph.D. dissertation, Royal Institute of Technology (KTH), Stockholm, Sweden, (2000).
- (3) Costlow, T.: Cognitive radios will adapt to users, IEEE Intelligent Systems, vol. 18, no. 3, p. 7, May-June (2003).
- (4) Ayodele, T. O.: Introduction to machine learning, New Advances in Machine Learning. InTech, (2010).
- (5) J. Shen, C. Ti, A. Raghunathan, S.C. Cheung, R. Patel: Automatic video self modeling for voice disorder. Multimedia Tools and Applications, vol. 74, no. 14, 5329-5351, 2015.
- (6) Yang, J., Payne, B., Hitz, M., Zhang, Y., Guo, P., and Li, L.: Fair Gain Based Dynamic Channel Allocation for Cognitive Radios in Wireless Mesh Networks, Journal of Computers, (2014).
- (7) Yang, J., Fei, Z.: HDAR: Hole detection and adaptive geographic routing for ad hoc networks, Computer Communications and Networks (ICCCN), 2010 Proceedings of 19th International Conference, pp. 1-6. IEEE, (2010).
- (8) Yang, J., Fei, Z.: Broadcasting with prediction and selective forwarding in vehicular networks. International journal of distributed sensor networks, 2013 (2013).
- (9) Yang, J., Fei, Z.: Bipartite graph based dynamic spectrum allocation for wireless mesh networks. In Distributed Computing Systems Workshops, 2008. ICDCS08. 28th International Conference, pp. 96-101. IEEE, (2008).
- (10) J. Shen, S.C. Cheung: Layer depth denoising and completion for structured-light rgb-d cameras. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1187-1194, 2013.
- (11) J. Shen, P. Su, S.C. Samson Cheung, J. Zhao: Virtual mirror rendering with stationary rgb-d cameras and stored 3-d background. IEEE Transactions on Image Processing, vol. 22, no. 9, pp. 3433-3448, 2013.
- (12) J. Shen, W. Tan: Image-based indoor place-finder using image to plane matching. IEEE International Conference on Multimedia and Expo, pp. 1-6, 2013.
- (13) Wang, Y., Martonosi, M., Peh, L. S.: A supervised learning approach for routing optimizations in wireless sensor networks. In: Proceedings of the 2nd international workshop on Multi-hop ad hoc networks: from theory to reality, pp. 79–86 (2006)
- (14) Sawhney, A., Bhatia, R., Mahajan, P.: Congestion Control in Wireless Communication Network Using Fuzzy Logic and Machine Learning Techniques, International Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering Vol. 3, Issue 11, October (2014)
- (15) Kincaid, D., Cheney, W.: Numerical Analysis: Mathematics of Scientific Computing 3rd Edition, (2005)