Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem

Shi, Peng; Landa-Silva, Dario

Abstract

An approximate dynamic programming that incorporates a combined policy, value function approximation and lookahead policy, is proposed. The algorithm is validated by applying it to solve a set of instances of the nurse rostering problem tackled as a multi-stage problem. In each stage of the problem, a weekly roster is constructed taking into consideration historical information about the nurse rosters in the previous week and assuming the future demand for the following weeks as unknown. The proposed method consists of three phases. First, a pre-process phase generates a set of valid shift patterns. Next, a local phase solves the weekly optimization problem using value function approximation policy. Finally, the global phase uses lookahead policy to evaluate the weekly rosters within a lookahead period. Experiments are conducted using instances from the Second International Nurse Rostering Competition and results indicate that the method is able to solve large instances of the problem which was not possible with a previous version of approximate dynamic programming.

Citation

Shi, P., & Landa-Silva, D. (2017). Approximate dynamic programming with combined policy functions for solving multi-stage nurse rostering problem.

• Conference Name: 3rd International Workshop on Machine Learning, Optimization and Big Data (MOD 2017)
• End Date: Sep 17, 2017
• Acceptance Date: Sep 1, 2017
• Publication Date: Sep 14, 2017
• Deposit Date: Dec 8, 2017
• Publicly Available Date: Dec 8, 2017
• Peer Reviewed: Peer Reviewed
• Public URL: https://nottingham-repository.worktribe.com/output/883011
• Additional Information: Published in: Lecture Notes in Computer Science, v. 10710, ISSN: 0302-9743.; Published in: Machine learning, optimization, and big data : third International Conference, MOD 2017, Volterra, Italy, September 14-17, 2017 : revised selected papers / Giuseppe Nicosia, Panos Pardalos, Giovanni Giuffrida, Renato Umeton (eds.).Cham : Springer,c 2018, ISBN: 9783319729268.; https://www.springerprofessional.de/approximate-dynamic-programming-with-combined-policy-functions-f/15325492
• Contract Date: Dec 8, 2017