Title :
A reinforcement learning approach to production planning in the fabrication/fulfillment manufacturing process
Author :
Cao, Heng ; Xi, Haifeng ; Smith, Stephen F.
Author_Institution :
IBM T.J. Watson Res. Center, Yorktown Heights, NY, USA
Abstract :
We have used reinforcement learning together with Monte Carlo simulation to solve a multiperiod production planning problem in a two-stage hybrid manufacturing process (a combination of build-to-plan with build-to-order) with a capacity constraint. Our model minimizes inventory and penalty costs while considering real-world complexities such as different component types sharing the same manufacturing capacity, multiend-products sharing common components, multiechelon bill-of-material (BOM), random lead times, etc. To efficiently search in the huge solution space, we designed a two-phase learning scheme where "good" capacity usage ratios are first found for different decision epochs, based on which a detailed production schedule is further unproved through learning to minimize costs. We illustrate our approach through an example and conclude discussion of future research directions.
Keywords :
Monte Carlo methods; bills of materials; discrete event simulation; learning (artificial intelligence); manufacturing processes; production planning; push-pull production; supply chain management; Monte Carlo simulation; cost minimization; fabrication; hybrid manufacturing process; inventory minimization; manufacturing process; multiperiod production planning; production scheduling; reinforcement learning; Bills of materials; Capacity planning; Costs; Fabrication; Learning; Manufacturing processes; Monte Carlo methods; Partitioning algorithms; Production planning; Robotic assembly;
Conference_Titel :
Simulation Conference, 2003. Proceedings of the 2003 Winter
Print_ISBN :
0-7803-8131-9
DOI :
10.1109/WSC.2003.1261584