skip to main content
10.1145/1128923.1128964acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
Article

Virtual assembly operations with grasp and verbal interaction

Published: 14 June 2006 Publication History

Abstract

This paper presents an immersive virtual reality environment (IVE) for performing assembly and maintenance simulations using the Jack® software package. The Flock of Birds™ motion tracking system is used to capture body postures of an immersed human and reproduce it in real-time in the virtual environment. The Cyberglove™ is used to capture finger movements in real-time for realistic grasp interaction. A comprehensive set of voice commands has been developed to provide significant functionality to allow one person to control the virtual environment while immersed in the environment, thereby improving productivity. One of the most important applications is a method by which the immersed human can walk and fly through the virtual environment, thereby greatly expanding the envelope of the virtual environment navigable under the constraints imposed by the limited tracking volume. These capabilities have been used to investigate assembly simulation of the windshield deicer of a Cessna aircraft.

References

[1]
Abshire, K. J. and Baron, M. K. 1998. Virtual Maintenance: Real-world Applications within Virtual Environments, IEEE Proceedings Annual Reliability and Maintainability Symposium, 132--137.
[2]
Boud, A. C., Haniff, D. J., Baber, C. and Steiner, S. J. 1999. Virtual Reality and Augmented Reality as a Training Tool for Assembly Tasks, Proceedings of International Conference on Information Visualisation, 32--36.
[3]
Chen, W., Wang, S., Li, Z., and Feng, C. 2002. Study of Key Techniques Concerning Virtual Assembly System for Equipment Maintenance Training. Third International Conference on Virtual Reality and its Application in Industry, 4756, 254--258.
[4]
Chryssolouris, G., Mavrikios, D., Fragos, D. and Karabatsou, V. 2000. A Virtual Reality-based Experimentation Environment for the Verification of Human-related Factors in Assembly Processes, Robotics and Computer Integrated Manufacturing, 16, 267--276.
[5]
Jayaram, S., Wang, Y., Jayaram, U., Lyons, K. and Hart, P. 1999. VADE: A Virtual Assembly Design Environment, IEEE Computer Graphics and Applications, 19, 6, 44--50.
[6]
Kibira, D. and Mclean, C. 2002. Virtual Reality Simulation of a Mechanical Assembly Production Line. Proceedings of the 2002 Winter Simulation Conference, 2, 1130--1137.
[7]
Kranzlmuller, D., Reitinger, B., Hackl, I., and Volkert, J. 2001. Voice Controlled Virtual Reality and Its Perspectives for Everyday life. ITG-Fachbericht, 168, 101--107.
[8]
Loftin, B. R. 1995. Virtual Environments for Aerospace Training, Proceedings of the 1995 IEEE Technical Applications Conference and Workshops, NORTHCON'95, 31--34.
[9]
Ozaki, T., Tanaka, K., and Abe, N. 1999. Interaction with Virtual Environment Using Verbal/non-verbal Communication. International Conference on Systems, Man, and Cybernetics, 4, 170--175.
[10]
Savall, J., Borro, D., Gil, J. J. and Matey, L. 2002. Description of a Haptic System for Virtual Maintainability in Aeronautics, Proceedings of the 2002 IEEE/RSJ International Conference on Intelligent Robots and Systems, EPFL, Lausanne, Switzerland, 2887--2892.
[11]
Taylor, K. Configuring Resin as a Development Java Servlet Engine. Retrieved September 20, 2005, from Focus on Java. {on-line}, Available at: http://java.about.com/library/weekly/aa_resin_intro2.htm.
[12]
Thornton, J. 2001. Maintainability Drives Fort Worth's Joint Strike Fighter Design: Blending Simulation and Iingenuity, Lockheed Martin Up-ends Design Methods in $320 Billion Program, Assembly Automation, 21, 3, 204--209.
[13]
VoiceXml Programmer's Guide, 2000, IBM. Available at: http://www.elink.ibmlink.ibm.com/public/applications/publications/cgibin/pbi.cgi.
[14]
Vora, J., Nair, S., Gramopadhye, A. K., Duchowski, A. T., Melloy, B. J., and Kanki, B. 2002. Using Virtual Reality Technology for Aircraft Visual Inspection Training: Presence and Comparison Studies. Applied Ergonomics, 33, 6, 559--570.
[15]
Wampler, J. L., Bruno, J. M., Blue, R. R. and Hoebel, L. J. 2003. Integrating Maintainability and Data Development, Reliability and Maintainability Symposium, 255--262.
[16]
Wan, H., Gao, S., Peng, Q., Dai, G., Zhang, F. 2004. MIVAS: A Multi-modal Immersive Virtual Assembly System. ASME 2004 Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 4, 113--122.
[17]
Zachmann, G., and Rettig, A. 2001. Natural and Robust Interaction in Virtual Assembly Simulation. Eighth ISPE International Conference on Concurrent Engineering: Research and Applications.
[18]
Zhang, Y., and Sotudeh, R. 2004. Evaluation of Auditory Feedback on Task Performance in Virtual Assembly Environment. International Conference on Computer and Information Technology, 206--214.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRCIA '06: Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications
June 2006
410 pages
ISBN:1595933247
DOI:10.1145/1128923
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. assembly
  2. grasp
  3. verbal interaction
  4. virtual reality

Qualifiers

  • Article

Conference

VRCIA06
Sponsor:

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2019)Virtual Reality in ManufacturingCIRP Encyclopedia of Production Engineering10.1007/978-3-662-53120-4_16827(1798-1801)Online publication date: 5-Jun-2019
  • (2019)Babel VR: Multimodal Virtual Reality Environment for Shelf Browsing and Book DiscoveryHCI International 2019 – Late Breaking Posters10.1007/978-3-030-30712-7_5(30-38)Online publication date: 20-Sep-2019
  • (2018)Virtual Reality in ManufacturingCIRP Encyclopedia of Production Engineering10.1007/978-3-642-35950-7_16827-1(1-4)Online publication date: 19-Mar-2018
  • (2017)Digitale MenschmodelleHomo Sapiens Digitalis - Virtuelle Ergonomie und digitale Menschmodelle10.1007/978-3-662-50459-8_4(73-182)Online publication date: 28-Mar-2017
  • (2009)A dual-representation strategy for the virtual assembly of thin deformable objectsVirtual Reality10.1007/s10055-009-0143-016:1(3-14)Online publication date: 19-Nov-2009
  • (2008)Optimal assembly plan generation: a simplifying approachJournal of Intelligent Manufacturing10.1007/s10845-008-0100-x20:1(15-27)Online publication date: 8-Apr-2008
  • (2008)Intelligent Virtual Humans with Autonomy and Personality: State-of-the-ArtNew Advances in Virtual Humans10.1007/978-3-540-79868-2_2(43-84)Online publication date: 2008

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media