Solving the Online 3D Bin Packing Problem with Graph-Based Reinforcement Learning

Solving the Online 3D Bin Packing Problem with Graph-Based Reinforcement Learning

Corvi, Giovanni (TU Delft Mechanical Engineering; TU Delft Cognitive Robotics)

Della Santina, C. (mentor)
Poelman, Ronald (graduation committee)
Wisse, M. (graduation committee)

Delft University of Technology

Mechanical Engineering | Vehicle Engineering | Cognitive Robotics

2024-04-25

The rapidly growing volume of parcel shipments is straining transportation and logistics sectors, highlighting the need for innovative solutions to optimize packing and loading processes. The online bin packing problem (BPP), an NP-hard computational problem, finds practical applications in numerous sectors, including modern packaging and intelligent logistics. This study proposes a novel reinforcement learning (RL) approach to tackle the online 3D-BPP emphasizing applicability and versatility. The key innovation is the representation of the packing scene as a graph, enabling effective encoding of task-specific high-level features. This graph-based structure serves as the foundation for an RL agent designed to learn an optimal packing strategy through dynamic interaction with the environment. The proposed approach uniquely operates within the continuous domain, enhancing generalization across diverse packing tasks. Experimental evaluations in both simulated environments and a real-world setting demonstrate that the solution achieves state-of-the-art performance across multiple complex three-dimensional packing scenarios.

Bin Packing
Warehouse automation
Reinforcement Learning
Graph Neural Networks

http://resolver.tudelft.nl/uuid:81c7d858-88f6-4c39-9a99-c09ec6128e08

Student theses

master thesis

© 2024 Giovanni Corvi