Vision-based excavator pose estimation using synthetically generated datasets with domain randomization
dc.contributor.author | Assadzadeh, Amin | |
dc.contributor.author | Arashpour, Mehrdad | |
dc.contributor.author | Brilakis, Ioannis | |
dc.contributor.author | Ngo, Tuan | |
dc.contributor.author | Konstantinou, Erini | |
dc.date.accessioned | 2021-12-11T00:31:26Z | |
dc.date.available | 2021-12-11T00:31:26Z | |
dc.date.issued | 2022-02 | |
dc.identifier.issn | 0926-5805 | |
dc.identifier.uri | https://www.repository.cam.ac.uk/handle/1810/331345 | |
dc.description.abstract | The ability to monitor and track the interactions between construction equipment and workers can lead to creating a safer and more productive work environment. Most recent studies employ computer vision and deep learning techniques, which rely on the size and quality of the training datasets for optimal performance. However, preparation of large datasets with high quality annotations remains a manual and time-consuming process. To overcome this challenge, this study presents a framework for synthetically generating large and accurately annotated images. The contribution of this paper is manifold: First, a method is developed using a game engine, which employs domain randomization (DR) to produce large labelled datasets for excavator pose estimation. Second, a state-of-the-art deep learning architecture based on high representation network is adapted and modified for excavator pose estimation. This model is trained on synthetically generated datasets and its performance is evaluated. The results reveal that the model trained on synthetic data can yield comparable results to the model trained on real images of excavators. This demonstrates the effectiveness of utilizing synthetic datasets for complex vision tasks such as equipment pose estimation. The study concludes by highlighting directions for further work in synthetic data studies in construction. | |
dc.publisher | Elsevier BV | |
dc.rights | Attribution-NonCommercial-NoDerivatives 4.0 International | |
dc.rights.uri | https://creativecommons.org/licenses/by-nc-nd/4.0/ | |
dc.title | Vision-based excavator pose estimation using synthetically generated datasets with domain randomization | |
dc.type | Article | |
dc.publisher.department | Department of Engineering | |
dc.date.updated | 2021-12-10T10:49:11Z | |
prism.endingPage | 104089 | |
prism.number | 104089 | |
prism.publicationDate | 2022 | |
prism.publicationName | Automation in Construction | |
prism.startingPage | 104089 | |
prism.volume | 134 | |
dc.identifier.doi | 10.17863/CAM.78793 | |
dcterms.dateAccepted | 2021-12-01 | |
rioxxterms.versionofrecord | 10.1016/j.autcon.2021.104089 | |
rioxxterms.version | AM | |
dc.contributor.orcid | Brilakis, Ioannis [0000-0003-1829-2083] | |
rioxxterms.type | Journal Article/Review | |
pubs.funder-project-id | European Commission (334241) | |
pubs.funder-project-id | Leverhulme Trust (IAF-2018-011) | |
pubs.funder-project-id | Australian Research Council (DP170104613) | |
pubs.funder-project-id | European Commission Horizon 2020 (H2020) Industrial Leadership (IL) (958398) | |
cam.issuedOnline | 2021-12-09 | |
cam.orpheus.success | 2021-12-10 - Embargo set during processing via Fast-track | |
cam.depositDate | 2021-12-10 | |
pubs.licence-identifier | apollo-deposit-licence-2-1 | |
pubs.licence-display-name | Apollo Repository Deposit Licence Agreement | |
rioxxterms.freetoread.startdate | 2022-12-09 |
Files in this item
This item appears in the following Collection(s)
-
Cambridge University Research Outputs
Research outputs of the University of Cambridge