Next Article in Journal
Rainbow Stars—Multi-Color Laser Emission for Science and Art
Next Article in Special Issue
Modeling, Simulation, and Performance Analysis of Decoy State Enabled Quantum Key Distribution Systems
Previous Article in Journal
Optimization Design of Coupling Beam Metal Damper in Shear Wall Structures
Previous Article in Special Issue
A Genetic Regulatory Network-Based Method for Dynamic Hybrid Flow Shop Scheduling with Uncertain Processing Times
Article Menu
Issue 2 (February) cover image

Export Article

Open AccessArticle
Appl. Sci. 2017, 7(2), 136;

Manufacturing Scheduling Using Colored Petri Nets and Reinforcement Learning

Alexander Technological Educational Institute of Thessaloniki, Department of Automation Engineering, P.O. Box 141, GR-57400 Thessaloniki, Greece
Author to whom correspondence should be addressed.
Academic Editor: Zhiwu Li
Received: 23 December 2016 / Revised: 18 January 2017 / Accepted: 20 January 2017 / Published: 3 February 2017
(This article belongs to the Special Issue Modeling, Simulation, Operation and Control of Discrete Event Systems)
Full-Text   |   PDF [5680 KB, uploaded 3 February 2017]   |  


Agent-based intelligent manufacturing control systems are capable to efficiently respond and adapt to environmental changes. Manufacturing system adaptation and evolution can be addressed with learning mechanisms that increase the intelligence of agents. In this paper a manufacturing scheduling method is presented based on Timed Colored Petri Nets (CTPNs) and reinforcement learning (RL). CTPNs model the manufacturing system and implement the scheduling. In the search for an optimal solution a scheduling agent uses RL and in particular the Q-learning algorithm. A warehouse order-picking scheduling is presented as a case study to illustrate the method. The proposed scheduling method is compared to existing methods. Simulation and state space results are used to evaluate performance and identify system properties. View Full-Text
Keywords: agent-based manufacturing scheduling; colored petri nets; reinforcement learning; Q-learning agent-based manufacturing scheduling; colored petri nets; reinforcement learning; Q-learning

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Drakaki, M.; Tzionas, P. Manufacturing Scheduling Using Colored Petri Nets and Reinforcement Learning. Appl. Sci. 2017, 7, 136.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Appl. Sci. EISSN 2076-3417 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top