Chamzas, ConstantinosQuintero-Peña, CarlosKingston, ZacharyOrthey, AndreasRakita, DanielGleicher, MichaelToussaint, MarcKavraki, Lydia E.2022-08-152022-08-152022Chamzas, Constantinos, Quintero-Peña, Carlos, Kingston, Zachary, et al.. "MotionBenchMaker: A Tool to Generate and Benchmark Motion Planning Datasets." <i>IEEE Robotics and Automation Letters,</i> 7, no. 2 (2022) IEEE: 882-889. https://doi.org/10.1109/LRA.2021.3133603.https://hdl.handle.net/1911/113097Recently, there has been a wealth of development in motion planning for robotic manipulation—new motion planners are continuously proposed, each with their own unique strengths and weaknesses. However, evaluating new planners is challenging and researchers often create their own ad-hoc problems for benchmarking, which is time-consuming, prone to bias, and does not directly compare against other state-of-the-art planners. We present MotionBenchMaker , an open-source tool to generate benchmarking datasets for realistic robot manipulation problems. MotionBenchMaker is designed to be an extensible, easy-to-use tool that allows users to both generate datasets and benchmark them by comparing motion planning algorithms. Empirically, we show the benefit of using MotionBenchMaker as a tool to procedurally generate datasets which helps in the fair evaluation of planners. We also present a suite of 40 prefabricated datasets, with 5 different commonly used robots in 8 environments, to serve as a common ground to accelerate motion planning research.engThis is an author's peer-reviewed final manuscript, as accepted by the publisher. The published article is copyrighted by IEEE.Journal articlehttps://doi.org/10.1109/LRA.2021.3133603