[go: up one dir, main page]

Puljiz et al., 2019 - Google Patents

Concepts for end-to-end augmented reality based human-robot interaction systems

Puljiz et al., 2019

View PDF
Document ID
15706594053094161613
Author
Puljiz D
Hein B
Publication year
Publication venue
arXiv preprint arXiv:1910.04494

External Links

Snippet

The field of Augmented Reality (AR) based Human Robot Interaction (HRI) has progressed significantly since its inception more than two decades ago. With more advanced devices, particularly head-mounted displays (HMD), freely available programming environments and …
Continue reading at arxiv.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with three-dimensional environments, e.g. control of viewpoint to navigate in the environment
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1674—Programme controls characterised by safety, monitoring, diagnostic

Similar Documents

Publication Publication Date Title
Delmerico et al. Spatial computing and intuitive interaction: Bringing mixed reality and robotics together
US20210205986A1 (en) Teleoperating Of Robots With Tasks By Mapping To Human Operator Pose
Krupke et al. Comparison of multimodal heading and pointing gestures for co-located mixed reality human-robot interaction
Pan et al. Augmented reality-based robot teleoperation system using RGB-D imaging and attitude teaching device
Frank et al. Realizing mixed-reality environments with tablets for intuitive human-robot collaboration for object manipulation tasks
US11422530B2 (en) Systems and methods for prototyping a virtual model
Khatib et al. Human-robot contactless collaboration with mixed reality interface
Wang et al. A robotic teleoperation system enhanced by augmented reality for natural human–robot interaction
Zolkiewski et al. Robot control and online programming by human gestures using a kinect motion sensor
Puljiz et al. General hand guidance framework using microsoft hololens
Zhang et al. Robot programming by demonstration: A novel system for robot trajectory programming based on robot operating system
Puljiz et al. Concepts for end-to-end augmented reality based human-robot interaction systems
Jorgensen et al. cockpit interface for locomotion and manipulation control of the NASA valkyrie humanoid in virtual reality (VR)
Sreenath et al. Monocular tracking of human hand on a smart phone camera using mediapipe and its application in robotics
Messaci et al. 3d interaction techniques using gestures recognition in virtual environment
Nandikolla et al. Teleoperation Robot Control of a Hybrid EEG‐Based BCI Arm Manipulator Using ROS
Dhat et al. Using 3d mice to control robot manipulators
Lin et al. The implementation of augmented reality in a robotic teleoperation system
Teke et al. Real-time and robust collaborative robot motion control with Microsoft Kinect® v2
Kanellakis et al. Guidance for autonomous aerial manipulator using stereo vision
Chiaravalli et al. A Vision-based Shared Autonomy Framework for Deformable Linear Objects Manipulation
Huang et al. Human-to-Robot Handover Control of an Autonomous Mobile Robot Based on Hand-Masked Object Pose Estimation
Cho et al. Development of VR visualization system including deep learning architecture for improving teleoperability
Bai et al. Kinect-based hand tracking for first-person-perspective robotic arm teleoperation
Deegan et al. Toward a holistic framework for human-robot coordination