How Much Do Unstated Problem Constraints Limit Deep Robotic Reinforcement Learning?

Simple item page
dc.contributor.authorLewis, W. Cannon IIen_US
dc.contributor.authorMoll, Marken_US
dc.contributor.authorKavraki, Lydia E.en_US
dc.date.accessioned2019-09-16T16:15:11Zen_US
dc.date.available2019-09-16T16:15:11Zen_US
dc.date.issued2019en_US
dc.description.abstractDeep Reinforcement Learning is a promising paradigm for robotic control which has been shown to be capable of learning policies for high-dimensional, continuous control of unmodeled systems. However, Robotic Reinforcement Learning currently lacks clearly defined benchmark tasks, which makes it difficult for researchers to reproduce and compare against prior work. “Reacher” tasks, which are fundamental to robotic manipulation, are commonly used as benchmarks, but the lack of a formal specification elides details that are crucial to replication. In this paper we present a novel empirical analysis which shows that the unstated spatial constraints in commonly used implementations of Reacher tasks make it dramatically easier to learn a successful control policy with Deep Deterministic Policy Gradients (DDPG), a state-of-the-art Deep RL algorithm. Our analysis suggests that less constrained Reacher tasks are significantly more difficult to learn, and hence that existing de facto benchmarks are not representative of the difficulty of general robotic manipulation.en_US
dc.format.extent8 ppen_US
dc.identifier.citationLewis, W. Cannon II, Moll, Mark and Kavraki, Lydia E.. "How Much Do Unstated Problem Constraints Limit Deep Robotic Reinforcement Learning?." (2019) https://doi.org/10.25611/az5z-xt37.en_US
dc.identifier.digitalTR19-01en_US
dc.identifier.doihttps://doi.org/10.25611/az5z-xt37en_US
dc.identifier.urihttps://hdl.handle.net/1911/107403en_US
dc.language.isoengen_US
dc.rightsYou are granted permission for the noncommercial reproduction, distribution, display, and performance of this technical report in any format, but this permission is only for a period of forty-five (45) days from the most recent time that you verified that this technical report is still available from the Computer Science Department of Rice University under terms that include this permission. All other rights are reserved by the author(s).en_US
dc.titleHow Much Do Unstated Problem Constraints Limit Deep Robotic Reinforcement Learning?en_US
dc.typeTechnical reporten_US
dc.type.dcmiTexten_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
TR19-01.pdf
Size:
905.53 KB
Format:
Adobe Portable Document Format
Description:
Download
Collections
Computer Science Technical Reports