The Infona portal uses cookies, i.e. strings of text saved by a browser on the user's device. The portal can access those files and use them to remember the user's data, such as their chosen settings (screen view, interface language, etc.), or their login data. By using the Infona portal the user accepts automatic saving and using this information for portal operation purposes. More information on the subject can be found in the Privacy Policy and Terms of Service. By closing this window the user confirms that they have read the information on cookie usage, and they accept the privacy policy and the way cookies are used by the portal. You can change the cookie settings in your browser.
Computing constrained shortest paths is fundamental to some important network functions such as QoS routing and traffic engineering. This paper introduces a polynomial time approximation Quality of Service (QoS) routing algorithm and constructs dynamic state-dependent routing policies. The proposed algorithm uses a bio-inspired approach based on the trial/error paradigm combined with swarm adaptive...
As the scarce spectrum resource is becoming overcrowded, cognitive wireless mesh networks express great flexibility to improve the spectrum utilization by opportunistically accessing the authorized frequency bands. One of the critical challenges for realizing such networks is how to adaptively match transmit powers and allocate frequency resources among secondary users (SUs) of the licensed frequency...
Dynamic channel selection is an important component of multi-channel wireless systems. It allows a transmitter to identify the channel offering the best radio conditions and to avoid interference created by other transmitters. In absence of interference, the channel selection problem can be simply interpreted as a Multi-Armed Bandit problem for which low-regret learning algorithms such as Exp3 have...
Using reinforcement learning (RL), this paper deals with the problem of call admission control (CAC) and routing in differentiating the services of Wavelength Division Multiplexing (WDM) networks to obtain maximized system revenue. The problem is formulated as a finite-state discrete-time dynamic programming problem. Here we adopt the RL method together with a decomposition approach, to solve this...
Cognitive radio has been proposed as a novel approach for improving the utilization of the limited radio resources by dynamically changing its operating parameters. This paper deals with the problem of channel and power allocation for cognitive radio networks. In particular, we consider the scenario where the transmission of secondary users is controlled by cognitive base station. We propose an autonomic...
Cooperative spectrum sensing has greatly improved the performance of the cognitive radio. If the cognitive users belong to different groups, they seem to be less insensitive to achieve a higher throughput. In this paper , an evolutionary game framework is proposed to study the interactions between selfish users in the cooperative sensing .We compare the dynamics and the stationary strategy of the...
The coexistence of different heterogeneous Radio Access Technologies (RATs) is a significant feature of current wireless networks. Thus, it is important for network elements, such as the Base Stations (BSs) of cellular networks or access points (APs) of wireless local area networks (WLANs) to be reconfigurable according to the real-time network environment. This will enable interconnection between...
Contention losses which usually do not indicate congestion is a major issue that hinders the deployment of optical burst switching (OBS) networks. Development of efficient path and wavelength selection algorithms is crucial to minimize the burst loss probability (BLP) in OBS networks. In this paper, we handle path selection and wavelength selection in a joint fashion. We formulate the problem of selecting...
This paper proposes a self-organized spectrum assignment strategy in the context of next generation multicell orthogonal frequency division multiple access networks. The proposed strategy is able to dynamically find spectrum assignments per cell depending on the spatial distribution of the users over the scenario, opening new spectrum access opportunities for secondary spectrum usage. Reinforcement...
In this paper, we consider a target-tracking sensor network and improve its energy awareness through predicting a target trajectory and decreasing sampling rate of sensors while maintaining an acceptable tracking accuracy. The tracking problem is formulated as a hierarchical Markov decision process (MDP) and is solved through neurodynamic programming. Though this is not new, improvements in performance...
In this work the feasibility of Reinforcement Learning (RL) for Dynamic Spectrum Management (DSM) in the context of next generation multicell Orthogonal Frequency Division Multiple Access (OFDMA) networks is studied. An RL-based algorithm is proposed and it is shown that the proposed scheme is able to dynamically find spectrum assignments per cell depending on the spatial distribution of the users...
Actually, various kinds of sources (such as voice, video or data) with diverse traffic characteristics and quality of service requirements (QoS), which are multiplexed at very high rates, leads to significant traffic problems such as packet losses, transmission delays, delay variations, etc, caused mainly by congestion in the networks. The prediction of these problems in real time is quite difficult,...
Cooperative spectrum sensing has been shown to greatly improve the sensing performance in cognitive radio networks. However, if the cognitive users belong to different service providers, they tend to contribute less in sensing in order to achieve a higher throughput. In this paper, we propose an evolutionary game framework to study the interactions between selfish users in cooperative sensing. We...
This paper presents an online tuning approach for the ad-hoc reinforcement learning algorithms which are used for solving the exploitation-exploration dilemma of the opportunistic spectrum access, in dynamic environments. These algorithms originate from a well-known problem in computer science: the multi-armed bandit (MAB) problem and they have provided evidence to be viable solutions for the detection...
Opportunistic spectrum access (OSA) is a hot topic in cognitive radio context. The main challenge of the OSA is to define improved spectral usage schemes, through the utilization of frequency holes in licensed bands. The multi armed bandit (MAB) is a reinforcement learning technique that can provide the secondary user with the adequate rules, in order to perform simultaneously 1) the exploitation...
High speed modern communication networks are required to integrate and support multimedia application which requires differentiated quality-of-service (QoS) guarantees. Routing mechanism is a key to success of future communication networking. However, it is often complicated by the notion of guaranteed QoS, which can either be related to time, cost, packet loss or bandwidth requirements. Communication...
Set the date range to filter the displayed results. You can set a starting date, ending date or both. You can enter the dates manually or choose them from the calendar.