Author(s)

Weiyuan Wang ¹, Fuqing Zhao ¹

Affiliation(s)

¹ School of Computer and Communication, Lanzhou University of Technology, Lanzhou, China

Corresponding Author

Weiyuan Wang

ABSTRACT

This study delves into the multi-objective flexible job-shop scheduling problem with fuzzy time (MOFFJSP), addressing complex and dynamic production environments, with the goal of minimizing the maximum completion time and total machine workload (TMW). A graph embedding algorithm based on reinforcement learning (GEARL) is proposed in this article, consisting of four modules: population initialization, fuzzy disjunctive graph, policy model, and solution set optimization processing. Diverse initial populations are constructed using different rules tailored to the problem. A fuzzy disjunctive graph is designed to transform individual data information into graph information. Graph embedding technology is utilized to extract individual feature information and generate corresponding optimization strategies through the policy model. Solution set optimization processing involves performing non-dominated sorting on the entire population to filter out advantageous individuals to guide subsequent optimization directions. Experimental results demonstrate that the GEARL algorithm exhibits significant advantages in solving the MOFFJSP.

KEYWORDS

Multi-objective flexible job-shop scheduling problem, Graph embedding, Fuzzy disjunctive graph, Reinforcement learning

CITE THIS PAPER

Weiyuan Wang, Fuqing Zhao, A Graph Embedding Algorithm Based on Reinforcement Learning for Solving Fuzzy Multi-Objective Flexible Job Shop Scheduling Problem. Industrial Engineering and Innovation Management (2025) Vol. 8: 118-130. DOI: http://dx.doi.org/10.23977/ieim.2025.080114.

REFERENCES

[1] SHEN L, DAUZèRE-PéRèS S, MAECKER S. Energy cost efficient scheduling in flexible job-shop manufacturing systems [J]. European Journal of Operational Research, 2023, 310(3): 992-1016. 
[2] SONG W, CHEN X, LI Q, et al. Flexible Job-Shop Scheduling via Graph Neural Network and Deep Reinforcement Learning [J]. IEEE Transactions on Industrial Informatics, 2023, 19(2): 1600-1610.
[3] GAO K, CAO Z, ZHANG L, et al. A review on swarm intelligence and evolutionary algorithms for solving flexible job shop scheduling problems [J]. IEEE/CAA Journal of Automatica Sinica, 2019, 6(4): 904-916.
[4] FAN J, SHEN W, GAO L, et al. A hybrid Jaya algorithm for solving flexible job shop scheduling problem considering multiple critical paths [J]. Journal of Manufacturing Systems, 2021, 60: 298-311.
[5] CHEN R, YANG B, LI S, et al. A self-learning genetic algorithm based on reinforcement learning for flexible job-shop scheduling problem [J]. Computers & Industrial Engineering, 2020, 149.
[6] SUN L, LIN L, GEN M, et al. A Hybrid Cooperative Coevolution Algorithm for Fuzzy Flexible Job Shop Scheduling [J]. IEEE Transactions on Fuzzy Systems, 2019, 27(5): 1008-1022.
[7] ZHANG Z-Q, WU F-C, QIAN B, et al. A Q-learning-based hyper-heuristic evolutionary algorithm for the distributed flexible job-shop scheduling problem with crane transportation [J]. Expert Systems with Applications, 2023, 234.
[8] LUO C, GONG W, LU C. Knowledge-driven two-stage memetic algorithm for energy-efficient flexible job shop scheduling with machine breakdowns [J]. Expert Systems with Applications, 2024, 235.
[9] ZHU N, GONG G, LU D, et al. An effective reformative memetic algorithm for distributed flexible job-shop scheduling problem with order cancellation [J]. Expert Systems with Applications, 2024, 237.
[10] LI W, HE L, CAO Y. Many-Objective Evolutionary Algorithm With Reference Point-Based Fuzzy Correlation Entropy for Energy-Efficient Job Shop Scheduling With Limited Workers [J]. IEEE Transactions on Cybernetics, 2022, 52(10): 10721-10734.
[11] GAO D, WANG G-G, PEDRYCZ W. Solving Fuzzy Job-Shop Scheduling Problem Using DE Algorithm Improved by a Selection Mechanism [J]. IEEE Transactions on Fuzzy Systems, 2020, 28(12): 3265-3275.
[12] CHEN X-L, LI J-Q, DU Y. A hybrid evolutionary immune algorithm for fuzzy flexible job shop scheduling problem with variable processing speeds [J]. Expert Systems with Applications, 2023, 233.
[13] ABDEL-BASSET M, MOHAMED R, EL-SHAHAT D, et al. An efficient hybrid optimization method for Fuzzy Flexible Job-Shop Scheduling Problem: Steady-state performance and analysis [J]. Engineering Applications of Artificial Intelligence, 2023, 123.
[14] SHAO W, SHAO Z, PI D. An Ant Colony Optimization Behavior-Based MOEA/D for Distributed Heterogeneous Hybrid Flow Shop Scheduling Problem Under Nonidentical Time-of-Use Electricity Tariffs [J]. IEEE Transactions on Automation Science and Engineering, 2022, 19(4): 3379-3394.
[15] ZHAO F, WANG Z, WANG L. A Reinforcement Learning Driven Artificial Bee Colony Algorithm for Distributed Heterogeneous No-Wait Flowshop Scheduling Problem With Sequence-Dependent Setup Times [J]. IEEE Transactions on Automation Science and Engineering, 2023, 20(4): 2305-2320.
[16] ZHU K, GONG G, PENG N, et al. Dynamic distributed flexible job-shop scheduling problem considering operation inspection [J]. Expert Systems with Applications, 2023, 224.
[17] HU Y, ZHANG L, ZHANG Z, et al. Matheuristic and learning-oriented multi-objective artificial bee colony algorithm for energy-aware flexible assembly job shop scheduling problem [J]. Engineering Applications of Artificial Intelligence, 2024, 133.
[18] AKRAM K, BHUTTA M U, BUTT S I, et al. A Pareto-optimality based black widow spider algorithm for energy efficient flexible job shop scheduling problem considering new job insertion [J]. Applied Soft Computing, 2024, 164.
[19] SI J, LI X, GAO L, et al. An efficient and adaptive design of reinforcement learning environment to solve job shop scheduling problem with soft actor-critic algorithm [J]. International Journal of Production Research, 2024, 62(23): 8260-8275.
[20] ZHANG W, ZHAO F, LI Y, et al. A novel collaborative agent reinforcement learning framework based on an attention mechanism and disjunctive graph embedding for flexible job shop scheduling problem [J]. Journal of Manufacturing Systems, 2024, 74: 329-345.
[21] PARK J, CHUN J, KIM S H, et al. Learning to schedule job-shop problems: representation and policy learning using graph neural network and reinforcement learning [J]. International Journal of Production Research, 2021, 59(11): 3360-3377.
[22] ZHAO F, XU Z, BAO H, et al. A cooperative whale optimization algorithm for energy-efficient scheduling of the distributed blocking flow-shop with sequence-dependent setup time [J]. Computers & Industrial Engineering, 2023, 178.
[23] BŁAŻEWICZ J, PESCH E, STERNA M. The disjunctive graph machine representation of the job shop scheduling problem [J]. European Journal of Operational Research, 2000, 127(2): 3173-3185.
[24] WU Z, PAN S, CHEN F, et al. A Comprehensive Survey on Graph Neural Networks [J]. IEEE Transactions on Neural Networks and Learning Systems, 2021, 32(1): 4-24.
[25] GAO K Z, SUGANTHAN P N, PAN Q K, et al. An effective discrete harmony search algorithm for flexible job shop scheduling problem with fuzzy processing time [J]. International Journal of Production Research, 2015, 53(19): 5896-5911.
[26] TIAN Y, CHENG R, ZHANG X, et al. A Strengthened Dominance Relation Considering Convergence and Diversity for Evolutionary Many-Objective Optimization [J]. IEEE Transactions on Evolutionary Computation, 2019, 23(2): 331-345.
[27] FARIAS L R C, ARAúJO A F R. Many-Objective Evolutionary Algorithm Based On Decomposition With Random And Adaptive Weights [J]. IEEE International Conference on Systems, Man and Cybernetics (SMC), 2019.
[28] LIU G, PEI Z, LIU N, et al. Subspace segmentation based co-evolutionary algorithm for balancing convergence and diversity in many-objective optimization [J]. Swarm and Evolutionary Computation, 2023, 83.

Sponsors, Associates, and Links

---

• Information Systems and Economics
  
  
• Accounting, Auditing and Finance
  
  
• Tourism Management and Technology Economy
  
  
• Journal of Computational and Financial Econometrics
  
  
• Financial Engineering and Risk Management
  
  
• Accounting and Corporate Management
  
  
• Social Security and Administration Management
  
  
• Population, Resources & Environmental Economics
  
  
• Statistics & Quantitative Economics
  
  
• Agricultural & Forestry Economics and Management
  
  
• Social Medicine and Health Management
  
  
• Land Resource Management
  
  
• Information, Library and Archival Science
  
  
• Journal of Human Resource Development
  
  
• Manufacturing and Service Operations Management
  
  
• Operational Research and Cybernetics