A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 1

1. An introduction to Augmented Reality Aided Manufacturing :

In many industries, implementing modern technologies brings success in the

tough global market. It propels a company’s innovativeness forward and can even
lower production expenses and maximize profits. Automotive manufacturers have
always remained at the forefront in taking advantage of the latest technological
advancements. Thus, the automotive industry has experienced a significant
development, mainly due to the adoption of new advanced technological .
In recent years, many automotive manufacturers have developed a keen
interest in augmented reality (AR), mainly due to its accessibility and potential for
generating innovative solutions. AR is a form of human machine interaction (HMI)
in which virtual components are inserted and superimposed on the real world,
creating the illusion of an ‘enriched’ reality. It allows users to obtain certain
information they need about some aspects or procedures directly in the working
environment and it has the potential to enrich a person’s sensory perception .

Fig 1.1 Augmented reality aided manufacturing

Augmented reality aided manufacturing (ARAM) represents the new idea in
application of augmented reality technologies in area of manufacturing processes
representation. ARAM is a special subsystem of the system Computer Integrated
Manufacturing including the augmented reality aided systems of all activities
connected with realization of product manufacturing (programming of manipulation,
machine tools, transport and store devices, measuring, testing and diagnose of parts
and assembled product). This stage of augmented reality aided systems in complex
CIM fluently establish on application of augmented reality aided systems in technical
(construction and technological) preparing of production and is inevitable for Secure
Of Concurrent Engineering Conditions.

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 2

2.History of Augmented Reality :

 Augmented reality in 60s and 70s
1968 : Although augmented reality may seem like the stuff of science fiction
researcher have been building prototype system for more than three decade. The
first was developed by computer graphics pioneer Ivan surtherland . he created the
first head-mounted display called ‘The Sword of Damocles’.

Fig 2.1 the sword of Damocles

1974 Myron Kruger, a computer researcher and artist, built a laboratory at the
University of Connecticut called ‘Videoplace’ that was entirely dedicated to artificial
reality. Within these walls, projection and camera technology was used to emit
onscreen silhouettes which surrounded users for an interactive experience. :

 Augmented reality in 80s and 90s

1992 : Louis Rosenburg, a researcher in the USAF Armstrong's Research Lab,
created ‘Virtual Fixtures’, which was one of the first fully functional augmented
reality systems The system allowed military personnel to virtually control and guide
machinery to perform tasks like training their US Air Force pilots on safer flying
practices.
1998: Sports vision broadcasts the first live NFL game with the virtual 1st & Ten
graphic system the yellow yard marker. The technology displays a yellow line
overlay on top of the feed to that views can quickly see where the team just advance
to to get a first down. This system is still used today, although admittedly more
advanced than it was in the late ‘90s. Viewers have become accustomed to the
yellow line marker and other additional graphics – most don’t even know that this is
a form of AR technology.

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 3

Fig2.2 history 1992 fig 2.3 history of 1999 fig 2.4 history of 1998
1999: NASA created a hybrid synthetic vision system of their X-38 spacecraft. The
system leveraged AR technology to assist in providing better navigation during their
test flights .The augmented reality component displayed map data right on the pilot’s
screen.

 Augmented reality after 2000

2013: Volkswagen debuted the MARTA app (Mobile Augmented Reality Technical
Assistance) which primarily gave technicians step-by-step repair instructions within
the service book. This adaptation of AR technology was groundbreaking, as it could
and would be applied to many different industries to align and streamline processes.
2014: Google unveiled its Google Glass devices, a pair of augmented reality glasses
that users could wear for immersive experiences .
2016: Microsoft starts shipping its version of wearable AR technology called the
HoloLens, which is more advanced than the Google Glass, but came with a hefty
price tag. It’s definitely not an everyday type of accessory. The headset runs on
Windows 10 and is essentially a wearable computer. It also allows users to scan their
surroundings and create their own AR experiences.

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 4

3 . An overview on Augmented reality :

Encyclopedia Britannica gives the following definition for augmented
reality:
“Augmented reality, in computer programming, a process of combining or
‘augmenting’ video or photographic displays by overlaying the images with useful
computer-generated data ”
Augmented reality (AR) is a field of computer research which deals with the
combination of real world and computer generated data. Augmented reality (AR)
refers to computer displays that add virtual information to a user's sensory
perceptions or The process of superimposing digitally rendered images onto our real-
world surroundings, giving a sense of an illusion or virtual reality. It is a method for
visual improvement or enrichment of the surrounding environment by overlaying
spatially aligned computer-generated information onto a human's view (eyes).

Fig3.1 example of AR technology

AR system to have the following properties:
1. Combines real and virtual objects in a real environment;
2. Runs interactively, and in real time; and
3. Registers (aligns) real and virtual objects with each other.
The ultimate goal is to create a system such that the user cannot tell the
difference between the real world and the virtual augmentation of it. The
technological requirements of augmented reality are much greater than those for
virtual reality, which is why the development of augmented reality took longer than
that of virtual reality.

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 5

4 . Comparison between AR and virtual environments:

The overall requirements of AR can be summarized by comparing them
against the requirements for Virtual Environments, for the three basic subsystems
that they require.
1. Scene generator : Rendering is not currently one of the major problems in AR.
VE systems have much higher requirements for realistic images because they
completely replace the real world with the virtual environment . In AR, the virtual
images only supplement the real world. Therefore, fewer virtual objects need to be
drawn, and they do not necessarily have to be realistically rendered in order to serve
the purposes of the application.
2. Display devices: The display devices used in AR may have less stringent
requirements than VE systems demand, again because AR does not replace the real
world. For example, monochrome displays may be adequate for some AR
applications, while virtually all VE systems today use full color. Optical see-through
HMD's with a small field-of-view may be satisfactory because the user can still see
the real world with his peripheral vision; the see-through HMD does not shut off the
user's normal field-of-view. Furthermore, the resolution of the monitor in an optical
sec-through
HMD might be lower than what a user would tolerate in a VE application, since the
optical see-through HMD does not reduce the resolution of the real environment.
3. Tracking and sending: While in the previous two cases AR had lower
requirements than VE that is not the case for tracking and sensing. In this area, the
requirements for AR are much stricter than those for VE systems. A major reason for
this is the registration problem.

Basic subsystem VR AR

1.Scene generator More advanced Less advanced

2.Display device High quality Low quality
3.Tracking and sensing Less advanced More advanced
Table 4.1 comparison between AR and VR

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 6

5. Type of Augmented Reality :

There are the various type of the augmented reality are given as follow :
 Projection- based AR
 Marker-base AR
 Outlining base AR
 Marker-less AR
 Superimposition based AR
In industry only marker base and marker-less AR are prominently used for
the various purpose design of cad model , repairing , training.

5.1.Projection based AR :

Fig5.1 projection based AR

Just like anything else which is beyond our reach, projection based AR feels
more attractive (at least as of now) compared to an AR app you can install on your
phone. As is obvious by its name, projection based AR functions using projection
onto objects. What makes it interesting is the wide array of possibilities. One of the
simplest is projection of light on a surface. Speaking of lights, surfaces and AR, did
you ever think those lines on your fingers (which divide each finger into three parts)
can create 12 buttons? Have a look at the image and you would quickly grasp what
we’re talking about. The picture depicts one of the simplest uses of projection based
AR where light is fired onto a surface and the interaction is done by touching the
projected surface with hand. The detection of where the user has touched the surface
is done by differentiating between an expected (or known) projection image and the
projection altered by interference of user’s hand.

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 7

5.2.Recognition AR (Marker-base Augmented Reality)

Recognition based AR focuses on recognition of objects and then provides us
more information about the object. e.g. when using your mobile phone to scan a
barcode or QR code, you actually use object recognition technology. Fact is, except
location based AR systems, all other types do use some type of recognition system
to detect the type of object over which augmentation has to be done. Recognition
based AR technology has varied uses as well.

Fig 5.2 marker-base AR

One of them is to detect the object in front of the camera and provide
information about the object on screen. This is something similar to the AR apps for
travelers (location browsers). However, the difference lies in the fact that the AR
location browsers usually do not know about the objects that they see while
recognition based AR apps do. A second type of recognition-based AR application is

to recognize the object and replace it with something else.

5.3.Outlining AR :
Though the human eye is known to be the best camera in the world, there
are limitations. We cannot look at things for too long. We cannot see well in low
light conditions and sure as anything, your eye cannot see in infrared. For such cases,
special cameras were built. Augmented reality apps which perform outlining use
such cameras. Once again, object recognition sits behind all that outlining AR can
do. Let us begin with a life-saving implementation example. When driving a car on a
road in foggy weather, the boundaries of the road may not be very visible to the
human eye, leading to mishaps. Advanced cameras tuned specially to see the
surroundings in low light conditions can be used to outline the road boundaries
within which the car should stay on road .

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 8

Fig 5.3 marker-less AR fig5.4 example of outlining AR

5.4.Marker-less Augmented Reality :

Marker-less augmented reality is one of the the most widely used
implemented application in the industry. It is also called location based AR , to make
it easier to use the feature of the smartphone that provides location detection. This
type of app is mainly used to help travelers by AR development company. In
addition user can find interesting places from their current location. This method
works by reading data from your mobile’s GPS, digital compass and accelerometer
and predicating where your are focusing . this augmented reality is to add location
information to the screen about an object that can be seen by your camera.

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 9

6. components of Augmented reality :

Augmented reality is generally implemented through some form of anchor in

the real world that is used for navigation. The most common form of anchor is a
specific pattern image, and by connecting virtual objects to pattern images it
becomes possible to orientate and correlate virtual objects to objects in the real
world. For the user to interact with the augmented reality systems a display of some
kind is used.
The different types of displays , hardware and software used to realize
augmented reality have different strengths and weaknesses depending on the
application purpose.AR involves a set of the technologies that make use of an
electronic device to view , directly or indirectly, a real world physical environment
that is combined with physical world. There are some important component that
plays very important roll in such type of the technology . list of those component are
given as follow :

 Camera
 Display
 Tracking system
 Mobile computing power (software or application/ processor

One by one all component of the augmented reality are explained below
explain in shortly below :

6.1.Camera :
The input from the real world is taken by medium of camera present in our
tablet and smartphones . for the better working of the augmented reality the depth
sensing should be present. In short , depth sensing means camera that measure the
distance that very important to perform work .we can also called camera as the input
medium of augmented reality.

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 10

6.2.Display :
Displays for viewing the merged virtual and real environments can be
classified into the following categories :

Fig 6.1 types of display

A)Head worn display :
Users mount this type of display on their heads, providing imagery in front
of their eyes. Two types of HWDs exist: optical see-through and video see-through.
The latter uses video capture from head-worn video cameras as a background for the
AR overlay, shown on an opaque display, where as the optical see-through method
provides the AR overlay through a transparent display.

Fig6.2 head worn display fig 6.3 Google glass

A different approach is the virtual retinal display which forms images
directly on the retina. These displays, which Micro Vision is developing
commercially, literally draw on the retina with low-power lasers whose modulated
beams are scanned by micro electromechanical mirror assemblies that sweep the
beam horizontally and vertically. Potential advantages include high brightness and
contrast, low power consumption, and large depth of the field. Ideally, head-worn
AR displays would be no larger than a pair of sunglasses. Several companies are
developing displays that embed display optics within conventional eyeglasses.
Mechanical Engineering Department Government Polytechnic, Aurangabad
 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 11

B) Hand held display :

Some AR systems use handheld, flat-panel LCD displays that use an
attached camera to provide video see-through-based augmentations. The handheld
display acts as a window or a magnifying glass that shows the real objects with an
AR overlay. There are various type of hand held display tablet, smartphones.

Fig 6.4 smartphone with GPS AR technology

C) Projection based Display :
In this approach, the desired virtual information is projected directly on the
physical objects to be augmented. In the simplest case, the intention is for the
augmentations to be coplanar with the surface onto which they project and to project
them from a single room-mounted projector, with no need for special eyewear.
Projectors can cover large irregular surfaces using an automated calibration
procedure that takes into account surface geometry and image overlap.

Fig 6.5 projection based AR in industry use (piston)

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 12

6.3. Tracking system :

The biggest challenge facing developers of augmented reality is the need to
know where the user is located in reference to his or her surroundings. There’s also
the additional problem of tracking the movement of user’s eyes and heads .A
tracking system has to recognize these movements and project the graphics related to
the real world environment the user is seeing at any given moment .Currently.
The best tracking technology available for large open areas is the Global
Positioning System. There are ways to increase tracking accuracy .For instance ,the
military uses multiple GPS signals. There is also differential GPS, which involves
using an area that has already been surveyed .
Tracking provides information about the user viewpoint or the camera
position and orientation in 6 degree of freedom . there are different approaches to be
tracking which can divided into separate field the most common field are sensor-
based, optical- based ,and hybrid technique.

Fig 6.6 basic principle of GPS tracking system

I)Sensor-Based Tracking :
sensor-based tracking includes sensor such as magnetic(compass) ,acoustic
inertial (accelerometer ,mechanical gyroscope), optical and time frequency
measurement (GPS , ultrasonic) the sensor- based trackers are good at motion
predication when fast changes occur, though it is not as accurate during slow
movement .in these system some sensor take part their fuction are explain below :
 Accelerometer – measure the acceleration applied to the device
 Gyroscope –angular speed around all axes in 3D space.
 Magnetometer – measure ambient magnetic field in all axes

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 13

Ii) Vision- Based Tracking :

The vision based approached uses image processing method , often related
to computer vision, to calculate the camera pose. Vision- based tracking is often
divided into two field , model based and feature based . model based visual tracking
uses a model of the object or the scene as reference for the tracking system this
method may be good if the system depend on a certain place since it require
knowledge of the scene before hand. Feature based visual tracking can either use
markers placed in the scene in the image to calculate camera pose . feature are
extracted from the frames and their correspondence are used to estimate the position.

Iii) Hybrid Tracking Technique :

To compensate for the for the lack in sensor- based technique respectively the
vision- based technique a hybrid approach can be carried out. hybrid technique
combine different method to make the tracking more robust .this can combining
several sensor-based techniques or combine a vision- based approach with one or
several sensor based.

6.4. Mobile Computing Power :

In augmented reality ,what we need is a way of overlaying computer-
generated information on what we can see already .When people first started talking
about augmented reality, there was a feeling we’d all end up walking around in
heads-up displays ,like fighter pilots. Now Net connected cell phones with cameras
are common ,they’ve become the focus for AR-although they may change in
future .Already, researchers are working on prototype contact lenses with built in
computer displays, which would superimpose things like web pages onto our field of
vision.
For a wearable augmented realty system, there is still not enough computing
power to create stereo 3-D graphics. So researchers are using whatever they can get
out of laptops and persona! Computers, for now. Laptops are just now starting to be
equipped with graphics processing unit (CPU's),

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 14

7 .working of Augmented reality :

Using a mobile application, a mobile phone's camera identifies and interprets

a marker, often a black and white barcode image. The software analyses the marker
and creates a virtual image overlay on the mobile phone's screen, tied to the position
of the camera. This means the app works with the camera to interpret the angles and
distance the mobile phone is away from the marker. Due to the number of
calculations a phone must do to render the image or model over the marker, often
only smart phones are capable of supporting augmented reality with any success.
Phones need a camera, and if the data for the AR is not stored within the app, a good
3G Internet connection.

BASIC PRINCIPLE :

Fig 7.1 Basic principle of AR technology

The basic principle of AR are given as follow :
 Pick A Real World Scene : Real world. User's view through the display of
the real world, showing a table and a marker (tracker) without any overlaid
graphics.
 Add your Virtual Objects in it: User's view of the virtual world intended to
overlay the view of the real world.
 Not Engineering
Mechanical Virtual Reality since Environment Real.
Department Government Polytechnic, Aurangabad
 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 15

The proposed system is a marker based system and its architecture as shown
in Fig. contains following modules.:
 Camera
 Image capturing module
 Image processing module
 Marker tracking module
 Rendering module
 Display screen

Fig 7.2 simple working of the Augmented reality system

A )Camera :
A real-world live video is feed as an input from the laptop camera to the
Camera module. Displaying this live feed from the laptop camera is the reality in
augmented reality. This live video stream is given as an input to the Image Capturing
Module..
B) Image Capturing Module :
The input to Image Capturing Module is the live video feed from the camera
of a mobile device. This module analyses the camera feed, by analyzing each frame
in the video. This module generates binary images i.e. a digital image that has only
two possible values for each pixel. Typically the two color used for a binary image
are black and white. These binary images are provided as an input to Image
Processing Module.
C) Image Processing Module :
Inputs to Image Processing Module are the binary images from Image
Capturing Module. These binary images are processed using an image processing
technique to detect the AR Marker. Detection of AR Marker is essential to determine
Mechanical Engineering Department Government Polytechnic, Aurangabad
 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 16

the position, where to place the virtual object. Once the AR Marker is detected, its
location is provided as an input to the Tracking Module.

D) Marker Tracking Module :

The tracking module is “the heart” of the augmented reality system. It
calculate the relative pose of the camera in real time. The term pose means the six
degree of freedom position i.e the 3D location and orientation of an object . the
calculate pose is provided as an input to rendering module .

Fig 7.3 Mobile Augmented Reality System

E) Rendering Module :
There are 2 input to rendering module. First is the calculated pose from the
tracing module and other is the virtual object to be augmented. The rendering module
combines the original image and the virtual component using the calculated pose and
renders the augmented image on the display screen.
7.1. Importance Of The Software Application :
Nowadays , there are many libraries for the development of IAR application .
each implementing certain functionalities in a specific ways .in general , for the
development of an IAR application it is necessary :
 2d and 3d graphics , which should enable real time visualization and
overlapping of virtual element in the field of view
 Recognition mechanism to be able to follow object or to superimpose
information on them
 Reconstruction of 3D model to get an understanding of the surrounding.
There are various application in the market .They are compared according to
Mechanical Engineering Department Government Polytechnic, Aurangabad
several requirements. First, their license type: open-source (i.e., ARToolkit, ArUco,
 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 17

BazAr, UART, OpenSpace3D), free (i.e., ALVAR, Armedia, Vuforia, Wikitude), or

commercial versions (i.e., Armedia, Vuforia, Wikitude, ZappCode Creator.

Fig 7.4 flow chart of AR system

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 18

8. Role of Augmented Reality In Manufacturing:

Augmented reality(AR) is considered by some managers and business leaders
to be critical for creating the smart factories promised by industry 4.0, however
manufacturer are often worry about of buying into new technology trends, worried
that the investment will not generate a tangible return , but AR is one of trend that
can truly benefit manufacturer.
Among the enabling technologies, IAR has proven to be the suitable tool for
the manufacture strategies proposed by different countries. Smart factories allowing
workers to collaborate among them, to interact with real time information and to
monitor and control system. The growth of AR market is as follow:

8.1 Graph show the growth of AR

Augmented reality used in various sector of the industry, and show the
power of the technologies those developing the conventional industrial process
.figure show summarizes the most relevant industrial tasks and sector where
Augmented reality can bring value .

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 19

8.2 graph shows the adoption of AR technology

One of the IAR most common application is the assistance to worker in

maintenance/ repair task through instruction with textual, visual such as information
is rendered on screen , so that the worker perceive the instruction with less effort
According the graph above the field service management have large
demand in adopting augmented reality technologies. Various type of task is perform
by field service management in industry is given as follow:
 Training of new people
 Service delivery
 Maintenance

8.3 graph show percentage of different AR device use

o According to the (2019) survey of industry those who staring

implementing AR technologies by PTC cooperation. In that survey we
observe that maximum percentage of smartphone augmented reality
is used in industry as compared to tablet and eye glass (head worn
display)

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 20

9.Challenges in front of the Field Service in industry:

A. High Technician Turnover:

Given the current issue the field service industry is facing due to aging and
retiring workforce. Due to these industry need to hire new people, those who have
less knowledge of about the actual industry process because of that industry appoint
higher educated trainer those who train the all fresher people who are new in industry
,thus lot of industries pay the high technician turnover.

B. Inadequate Skill Training :

With constant updates in technology and an increase in global trading, the
level of competition between industrial businesses is ever increasing. In current
situation, the proper or sufficient training about process of new product is not given it
will going to affect productivity, hence the productivity level of industry is decrease.

C. Complex Procedure Providing Manual:

To understanding working of complex machine we have to read manual first,
then we have follow steps given in it .but due to these process need lot of time and
also it will affect productivity of worker.

D .Inconsistent Service Delivery:

For the process of the service delivery of their product (i.e. freeze home
boiler)Industry has to hire third party technicians. Those who goes to customers
home to solve problem regarding their product ,in that case consistent service
delivery is not provided all time and also customers not stratifies about the product
it then it also affect market of the product .

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 21

10. Augmented Reality For Field Service:

Many edgy technologies are making their way into the mainstream
environment. This is mainly true in the _Field service management industry. Today,
Field service organizations seek to increase their operational efficiency through
technologies such as augmented reality (AR) field service.

Fig 10.1 advantage of AR in field service

There are several more ways in which AR is changing the field service
industry, let’s take a look:
 Increased Efficiency: Everything from training and repairing modules to
sensor information can be uploaded to the technician’s AR glasses. This will
guide the technician through the process and also allow him to look inside the
device and gain temperature, sensor, and pressure data. This will allow the
technician to visually inspect the device without physically interacting with it.
Moreover, this will also help in the elimination of distractions and the need to
look through manuals for hours. The result is gained efficiently, which
translates into cost savings and satisfied customers.
 Follow Complex Procedures Easily: Integrating AR with field service
management software will help technicians to instantly access the service
manuals containing interactive 3D animations to deal with any unfamiliar
equipment.
Mechanical Though
Engineering the technology is notGovernment
Department here yet, AR will allowAurangabad
Polytechnic, field service
technicians to follow difficult instructions without having to constantly refer
 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 22

to tablets or smartphones. AR allows the graphical information to be

displayed over a physical environment.

 Improved Service Delivery: Artificial Intelligence will affect field service

by providing a digital experience that will offer both assisted and self-service
interactions. AR will help in giving customers a reason to buy and use the
services by offering them an immersive experience that can help build a
connection and brand recognition by conveying your services in an AR
environment.
 Assist Customers: Field service technicians and customer service
representatives will be able to virtually guide customers through maintenance
or repair procedures. For minor repairs and service calls, a field technician
may take a virtual tour to help the customers fix simple problems. This can
also be clubbed with AI when a user error is involved and a virtual assistant
can pinpoint at what the customer needs to do to get things back in working
condition. This way the service is instant and easy.
 Train New Technicians: Given the current issue the field service industry is
facing due to aging and retiring workforce, this will be one of the most
important uses of AR in the field service management industry. Hiring novice
technicians and training them on-the-job will become much easier with AR
implementation. Moreover, in today’s gig economy, mobile workforce
management software integrated with AR can help in hiring labor remotely
and the technicians can be assisted with a repair sequence featuring a series of
3D technical illustrations, guiding them on how to solve the problem. Though
there can be situations where senior technicians need to assist, if the
experienced personnel can deliver assistance remotely, the service
organization can free up labor more efficiently.

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 23

11. Applications

The technology made our mechanical industry efficient include automobile ,

processing and also manufacturing . there are various application in the industry are
given below :

 Lockheed martin – as far as augmented reality application in manufacturing

go, employees training is where the technology excels with even greater
force . the assembly process of Lockheed martin’s F-35 aircraft the use of
AR technology reduced the time by 30%..

Fig 11.2 bosch cap software

 Mitsubishi electric-
Mitsubishi electric has been working on AR technology to support the
servicing of their manufacturer equipment. The employees will view 3D
model that allow to confirm the order of an inspection on an AR display.
 Jaguar land rover (JRL) training –
In collaboration with bosch using BOSCH CAP software platform for
augmented reality that visualizes JRL data inside the car for the mechanic.
Simply point at the ipad at the dashboard screen .

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 24

11.1. Case study -1 (boeing industry) :

Background :

The Boeing Company is an American multinational corporation that designs,

manufactures, and sells airplanes, rotorcraft, rockets, satellites, telecommunications
equipment, and missiles worldwide. The company also provides leasing and product
support services. Boeing is among the largest global aerospace manufacturers;

Fig 11.1 main office of Boeing industry

Boeing is organized into two business units: Boeing Commercial Airplanes
and Boeing Defense, Space & Security. Supporting these units are Boeing Capital
Corporation, a global provider of financing solutions; Shared Services Group, which
provides a broad range of services to Boeing worldwide; and Boeing Engineering,
Operations & Technology, which helps develop, acquire, apply and protect
innovative technologies and processes.

Challenge :
Wiring of the aircraft is extremely complex and time consuming both in
production and inspection. Wire harness in a plane or aircraft contains hugely messy
and complex webs of wire connect to electrical system, hence technicians have to
manually
Mechanicalbuild them out
Engineering , a pain stacking process
Department based Polytechnic,
Government on PDF assembly guide
Aurangabad
 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 25

viewed on the laptop screen . to complete some task about aircraft it take lot of time
the technicians .

Solution :
Boeing R&D efforts in Augmented Reality are focused on assembly
operations and field support. Assembly processes for Boeing products can be highly
complex and require comprehensive understanding of the task at hand to efficiently
execute without introducing errors. In addition, maintenance and field operations
frequently happen in remote locations, and expert assistance may be needed.
Application of Augmented Reality technology to these applications will yield
significant benefits.
The Skylight app works by allowing a Glass wearer to scan a QR code, which
pulls the wireless harness software, and then scan another code to load the assembly
instructions. The app supports Glass voice commands, and also lets users stream
what they're seeing to another technician in the event of something unexpected.

Fig 11.2 use of Google glass in Boeing industry

Outcome :
 With Glass to replace that computer display, Boeing says it reduced
production time for the harnesses by 25 percent and cut error rates in half,
according to CIO.
 research shows that there are large efficiency gains to be realized, when
information related tasks are aided by Augmented Reality techniques.
Augmented Reality is a fundamentally-enabling technology that can be used
in aEngineering
Mechanical large number of applications throughout
Department the Polytechnic,
Government product lifecycle. As the
Aurangabad
 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 26

technology develops and matures, it will be possible to realize these benefits

across the industry.

12 .Limitations

Furthermore, some additional constrained regarding the implementation of

application for an industrial environment should be remarked:

 Most AR system are based on detecting physical object , such detection is

complex and compute intensive and therefore powerful hardware required
 Moreover, the detection of physical object is also influenced by ambient light,
being often more sensitive to changes in the environment than other marker
based detection technique.
 Electrical interface produced by the industrial machinery inside the industry
may affect reading and their accuracy .
 Technological limitations : Although there is much progress in the basic
enabling technologies they still primarily prevent the deployment of many
AR applications. Displays, trackers, and AR systems in general need to
become more accurate, lighter, cheaper, and less power consuming. Since the
user must wear the PC, sensors, display, batteries, and everything else
required, the end result is a heavy backpack. Laptops today have only one
CPU, limiting the amount of visual and hybrid tracking that we can do.
 User interface limitation : We need a better understanding of how to display
data to a user and how the user should interact with the data. AR introduces
many high-level tasks, such as the need to identify what information should
be provided, what’s the appropriate representation for that data, and how the
user should make queries and reports. Recent work suggests that the creation
and presentation of narrative performances and structures may lead to more
realistic and richer AR experience.
Mechanical Engineering Department Government Polytechnic, Aurangabad
 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 27

 Social acceptance : The final challenge is social acceptance. Given a system

with ideal hardware and an intuitive interface, how AR can become an
accepted part of a user’s.

13. Future Scope of AR in Industry:

The trend of deploying and using AR techniques in manufacturing is rapidly

expanding as part of the fourth Industrial revolution (Industry4.0), which propels the
extensive use of digital data in order to manage and drive manufacturing processes,
such as product design, production scheduling, predictive maintenance and more.

 Product design and development will be revolutionary .

Ford has adopted augmented reality to develop car model, to work on
clay model of upcoming new cars which can be developed through
AR in less expensive manner.
 The working environment will become safer .
FMCG industry is one of the industry which leads to start for better
industrial nature, where offering a safer environment using augmented
reality will be added advantage to worker .the energy of AR will offer
the chance to make industrial unit mines, plants more secure .
 Service and repairing will be so easier and less expensive .
 In future Augmented reality, will replace the automobile showroom
and
Will be become effective evolution in the market industry.

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 28

14. Conclusion:
Every as for mentioned augmented reality in manufacturing use case proves
that the technology provides reliable solution to crucible problems in the process and
improve its key steps in industry.
The implementation of element of augmented reality in the areas of technical
poxes connected to the field of manufacturing technologies can be improved to the
satisfactory level with every single development and improvement of any factor of
these process .

Mechanical Engineering Department Government Polytechnic, Aurangabad

 A Seminar on “Augmented Reality Aided Manufacturing” 2020-21 29

15. References:

1. www.sciencedirect.com/science/book/9781597497336
2. www.augmentedreality.com
3. www.en.wikipedia.org/wiki/Augmented_reality
4. www.howstuffworks.com/augmented-reality.htm

5. Fraga lamas- review on IAR system for industry 4.0

6. Azuma, R , Baillot, Y, Behringer, R, Feiner, S, Julier, S and MacIntyre,
B., 2001, “Recent Advances in Augmented Reality.” IEEE Computer
Graphics and Applications (6), pp. 34-47.
7. Azuma, R. 1997, “A Survey of Augmented Reality.” Presence: Tele
operators and Virtual Environments 6, no.4, pp. 355-385.

Mechanical Engineering Department Government Polytechnic, Aurangabad