From the state of the art of assessment metrics toward novel concepts for humanoid robot locomotion benchmarking

In order to prepare humanoid robots for real-world applications, it is necessary to assess the robots’ locomotion performance and to determine their readiness level. We have carried out an extensive statistical literature review of 204 publications evaluating what kind of benchmarking scenarios and...

Full description

Saved in:
Bibliographic Details
Main Authors: Aller, Felix (Author) , Mombaur, Katja (Author)
Format: Article (Journal)
Language:English
Published: 2020
In: IEEE Robotics and automation letters
Year: 2019, Volume: 5, Issue: 2, Pages: 914-920
ISSN:2377-3766
DOI:10.1109/LRA.2019.2952291
Online Access:Resolving-System: https://doi.org/10.1109/LRA.2019.2952291
Verlag: https://ieeexplore.ieee.org/document/8894403/authors
Get full text
Author Notes:Felix Aller, David Pinto-Fernandez, Diego Torricelli, Jose Luis Pons, Katja Mombaur

MARC

LEADER 00000caa a22000002c 4500
001 1691056499
003 DE-627
005 20220818001359.0
007 cr uuu---uuuuu
008 200226r20202019xx |||||o 00| ||eng c
024 7 |a 10.1109/LRA.2019.2952291  |2 doi 
035 |a (DE-627)1691056499 
035 |a (DE-599)KXP1691056499 
035 |a (OCoLC)1341308145 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 27  |2 sdnb 
100 1 |a Aller, Felix  |d 1987-  |e VerfasserIn  |0 (DE-588)1205414185  |0 (DE-627)1691055891  |4 aut 
245 1 0 |a From the state of the art of assessment metrics toward novel concepts for humanoid robot locomotion benchmarking  |c Felix Aller, David Pinto-Fernandez, Diego Torricelli, Jose Luis Pons, Katja Mombaur 
264 1 |c 2020 
300 |a 7 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date of publication: 08 November 2019 
500 |a Gesehen am 26.02.2020 
520 |a In order to prepare humanoid robots for real-world applications, it is necessary to assess the robots’ locomotion performance and to determine their readiness level. We have carried out an extensive statistical literature review of 204 publications evaluating what kind of benchmarking scenarios and performance indicators are used and if they are sufficient to take a robot from prototype to production. We report the results of our analysis and discuss the most relevant findings such as the overall increase in the number of publications and motion tasks considered. Previous benchmarking efforts have been devoted to the functional assessment of the robotic system itself. A trend towards goal level oriented performance indicators such as robustness to external disturbance and dependability can be observed. We also identify a deficiency in benchmarking of non-functional aspects like safety or human-robot interaction. Based on our results, we outline the creation of a benchmarking framework with respect to current benchmarking approaches also introducing testbeds considering currently neglected motion tasks with a focus on a high degree of standardization. 
534 |c 2019 
650 4 |a Benchmark testing 
650 4 |a humanoid and bipedal locomotion 
650 4 |a Humanoid robots 
650 4 |a Legged locomotion 
650 4 |a Measurement 
650 4 |a performance evaluation and benchmarking 
650 4 |a Stability criteria 
650 4 |a Task analysis 
700 1 |a Mombaur, Katja  |e VerfasserIn  |0 (DE-588)1031167269  |0 (DE-627)735773769  |0 (DE-576)182041840  |4 aut 
773 0 8 |i Enthalten in  |t IEEE Robotics and automation letters  |d New York, N.Y. : Institute of Electrical and Electronics Engineers, 2016  |g 5(2020), 2, Seite 914-920  |h Online-Ressource  |w (DE-627)846122235  |w (DE-600)2844561-2  |w (DE-576)45442244X  |x 2377-3766  |7 nnas  |a From the state of the art of assessment metrics toward novel concepts for humanoid robot locomotion benchmarking 
773 1 8 |g volume:5  |g year:2020  |g number:2  |g pages:914-920  |g extent:7  |a From the state of the art of assessment metrics toward novel concepts for humanoid robot locomotion benchmarking 
856 4 0 |u https://doi.org/10.1109/LRA.2019.2952291  |x Resolving-System 
856 4 0 |u https://ieeexplore.ieee.org/document/8894403/authors  |x Verlag 
951 |a AR 
992 |a 20200226 
993 |a Article 
994 |a 2020 
998 |g 1031167269  |a Mombaur, Katja  |m 1031167269:Mombaur, Katja  |d 700000  |d 720000  |e 700000PM1031167269  |e 720000PM1031167269  |k 0/700000/  |k 1/700000/720000/  |p 5  |y j 
998 |g 1205414185  |a Aller, Felix  |m 1205414185:Aller, Felix  |d 700000  |d 720000  |e 700000PA1205414185  |e 720000PA1205414185  |k 0/700000/  |k 1/700000/720000/  |p 1  |x j 
999 |a KXP-PPN1691056499  |e 3598584857 
BIB |a Y 
SER |a journal 
JSO |a {"type":{"bibl":"article-journal","media":"Online-Ressource"},"origin":[{"dateIssuedDisp":"2020","dateIssuedKey":"2020"}],"person":[{"role":"aut","roleDisplay":"VerfasserIn","given":"Felix","family":"Aller","display":"Aller, Felix"},{"given":"Katja","roleDisplay":"VerfasserIn","role":"aut","family":"Mombaur","display":"Mombaur, Katja"}],"physDesc":[{"extent":"7 S."}],"title":[{"title":"From the state of the art of assessment metrics toward novel concepts for humanoid robot locomotion benchmarking","title_sort":"From the state of the art of assessment metrics toward novel concepts for humanoid robot locomotion benchmarking"}],"id":{"eki":["1691056499"],"doi":["10.1109/LRA.2019.2952291"]},"note":["Date of publication: 08 November 2019","Gesehen am 26.02.2020"],"name":{"displayForm":["Felix Aller, David Pinto-Fernandez, Diego Torricelli, Jose Luis Pons, Katja Mombaur"]},"language":["eng"],"recId":"1691056499","relHost":[{"origin":[{"publisherPlace":"New York, N.Y.","dateIssuedDisp":"Jan 2016-","publisher":"Institute of Electrical and Electronics Engineers"}],"titleUni":[{"title":"Robotics and automation letters"}],"corporate":[{"display":"Institute of Electrical and Electronics Engineers","role":"isb","roleDisplay":"Herausgebendes Organ"},{"roleDisplay":"Herausgebendes Organ","role":"isb","display":"IEEE Robotics and Automation Society"}],"pubHistory":["Vol. 1, Issue 1 (Jan 2016)-"],"title":[{"title":"IEEE Robotics and automation letters","title_sort":"IEEE Robotics and automation letters"}],"part":{"text":"5(2020), 2, Seite 914-920","pages":"914-920","issue":"2","extent":"7","volume":"5","year":"2020"},"language":["eng"],"name":{"displayForm":["IEEE Robotics and Automation Society"]},"type":{"bibl":"periodical","media":"Online-Ressource"},"disp":"From the state of the art of assessment metrics toward novel concepts for humanoid robot locomotion benchmarkingIEEE Robotics and automation letters","physDesc":[{"extent":"Online-Ressource"}],"id":{"zdb":["2844561-2"],"eki":["846122235"],"issn":["2377-3766"]},"note":["Trotz der Ankündigung, eine OA-only-Zeitschrift zu sein, sind derzeit nicht alle Artikel frei zugänglich","Gesehen am 21. März 2016"],"recId":"846122235"}]} 
SRT |a ALLERFELIXFROMTHESTA2020