Filetype
This paper presents a reinforcement learning algorithm and provides conditions for global convergence to Nash equilibria. For several reinforcement learning schemes, including the ones proposed here, excluding convergence to action profiles which are not Nash equilibria may not be trivial, unless the step-size sequence is appropriately tailored to the specifics of the game. In this paper, we sides
Managing the resources of a virtualized data-center is a key issue in cloud computing. Existing research mostly assumes that applications are either allocated the required resources or fail. Combined with the fact that most cloud applications have dynamic resource requirements, this imposes a fundamental limitation to cloud computing: To guarantee on-demand resource allocations, the data-center ne
Traditionally, control loops are closed using periodic sensing and actuation. When communication resources are scarce, however, much may be gained from transmitting only when something important has happened in the loop. This paper presents a simple model of the interference between event-based control loops caused by sharing a common medium, based on the coupled dynamics of a Markov chain represe
A number of techniques have been proposed to provide run- time performance guarantees while minimizing power consumption. One drawback of existing approaches is that they work only on a fixed set of components (or actuators) that must be specified at design time. If new components become available, these management systems must be redesigned and reimplemented. In this paper, we propose PTRADE, a n
As farms are getting bigger with more animals, less manual supervision and attention can be given the animals on both group and individual level. In order not to jeopardize animal welfare, automated supervision is in some way already in use. Function and control of ventilation is already in use in modern pig stables, e.g. by the use of sensors for temperature, relative humidity and malfunction con
In this paper a distributed version of the Kalman filter is proposed. In particular, the estimation problem is reduced to the optimization of a cost function that depends on the system dynamics and the latest output measurements and state estimates which is distributed among the agents by means of dual decomposition. The techniques presented in the paper are applied to estimate the position of mob
An adaptive resource management system combined with a thermal controller is presented. The aim of the system is to dynamically allocate computing resources to applications competing for the same computing resources in such a way that the system is not overheated. The approach has been implemented on a mobile robot. Experimental results are presented showing the feasibility of the approach.
Cloud computing is an application hosting model providing the illusion of infinite computing power. However, even the largest datacenters have finite computing capacity, thus cloud infrastructures have experienced overload due to overbooking or transient failures. The topic of this paper is the comparison of different control strategies to mitigate overload for datacenters, that assume that the r
The Modelica language, targeted at modeling of complex physical systems, has gained increased attention during the last decade. Modelica is about to establish itself as a de facto standard in the modeling community with strong support both within academia and industry. While there are several tools, both commercial and free, supporting simulation of Modelica models few efforts have been made in th
Turbines operating in wind farms are coupled by the wind flow. This coupling results in limited power production and increased fatigue loads on turbines operating in the wake of other turbines. To operate wind farms cost effectively, it is important to understand and address these effects. In this paper, we derive a stationary model for turbine interaction. The model has a simple intuitive structu
The software engineering community has proposed numerous approaches for making software self-adaptive. These approaches take inspiration from machine learning and control theory, constructing software that monitors and modifies its own behavior to meet goals. Control theory, in particular, has received considerable attention as it represents a general methodology for creating adaptive systems. Con
This article analyzes how the American philosopher and educator John Dewey was received, adapted, and transformed in four different time periods in China: during the Republican era (1912–1949), after the Communist take-over in 1949, after Deng Xiaoping's launch of the 'Four Modernizations' (in the 1980s), and in present-day China. Dewey is generally seen to have exerted an immense influence on Ch
The purpose of this paper is to formulate an optimization model for the production scheduling problem at continuous production sites. The production scheduling activity should produce a monthly schedule that accounts for orders and forecasts of all products. The plan should be updated every day, with feedback on the actual production the previous day. The actual daily production may be lower than
