IoT

Performance
Testing
Slide #4
4 April 2022
 Why Testing is Important to IoT?
traditional software testing does not work for IoT

Helps determine if IoT Efficiently performs all To identify underlying

software meets the its functionalities, bugs and rectify them
accepted standard of ensuring that the entire immediately
quality & the IoT network can work
expectation of users. collaboratively and
deliver as expected

2
IoT Testing Challenges
1. Test Coverage
The diversity of the
smartphone market
based on brand,
model, OS, versions
of the OS, screen
size, and other
elements, it is a
challenge to build
an IoT that can
work perfectly
across countless
devices.

3
Cont.
2. Test Diversity 3. IoT Stability
• Testing an IoT involves more than • The key to any IoT is its ability
testing the actual device. It also to connect to other devices
includes testing its mobile via a Bluetooth connection
application on a variety of devices and/or a wifi network.
to uncover bugs that can lead to Connecting and staying
recalls, hurt brand image, or erode connected to another device
consumer confidence. or network is complex.
• While some test methods can Connection issues can render
focus on evaluating key functions, an IoT useless if it prevented
others can be better utilized to from communicating and
assess other important aspects sharing data.
like UX or accessibility. Without the
right testing expertise, it can
extremely difficult to plan, design,
and execute a proper test.

4
 Types of IoT Testing (Performance Lab, 2022)

IoT Performance Testing IoT Functional Testing

IoT Security Testing IoT Compatibility Testing

IoT Database Testing IoT Usability Testing

 Types of IoT Testing (cont.)
IoT Scalability Testing
IoT Pilot Testing

IoT Reliability Testing IoT Regulatory Testing

IoT Network Testing IoT Upgrade Testing

 IoT Performance Testing IoT Database Testing
• essential to evaluate the IoT device app’s • the data should be safe from any kind of
performance with different performance metrics.
modification, and regular query
• performance metrics include database
execution should not affect data integrity.
performance, load tolerance, IoT device
• IoT testers need to see whether the
app loading speed, throughput,
response time of all the queries is
efficiency, uptime, and data transfer rate
optimal and check whether the data
• To see how well an IoT device app performs
over a long period & additional load during displayed by the application is shown
peak time. accurately by the IoT application.

IoT Security Testing IoT Functional Testing

• IoT device apps for various reasons, which
range from making monitory transactions, • IoT device app needs to perform a
sharing personal information, buying and variety of different functions. -
selling etc.
essential to test the core functions of
• have specialized access controls for
these IoT device apps individually to
users that restrict access for external
prevent any glitches after deployment
people.
• to identify underlying vulnerabilities in
an IoT device app and make sure that it
doesn’t leak sensitive information to
attackers
 IoT Compatibility Testing
IoT Scalability Testing
• to check an IoT device app’s compatibility • ensures whether an IoT app has the
against different devices, apps, and power to support multiple concurrent
operating systems. users while continuing the same level of
• responsible for evaluating whether the
performance
IoT device app is responsive and if it
operates smoothly on different platforms
and browsers. IoT Reliability Testing
• related to compatibility testing.
• users need to validate IoT
IoT Usability Testing components, especially sensors, in
• tests whether an IoT device app offers many different operational and
an optimal user experience to a typical environmental conditions
user.
• usability testing addresses a variety of IoT Network Testing
questions that relate to a user’s
experience, including IoT device app • ensures that IoT applications can
design, how easy to use its features support various network connections
are, and whether or not the content on and connection protocols across the
the IoT device app is clear IoT platform
 IoT Pilot Testing
• testers introduce the application to a live IoT Regulatory Testing
environment with a limited number of
users (real test & not a lab test) • IoT apps applications require teams to
• participants use the application and give pass through several
suggestions on where it can be improved regulatory/compliance checkpoints
(healthcare services).
IoT Upgrade Testing • Even if an IoT app is perfect in terms of
functional, performance, security,
• IoT devices function on a combination compatibility, and usability metrics, it
of several protocols, operating systems, can still fail if it does not fulfill
devices, hardware, firmware, and compliance requirements
networking layers.
• whenever these components are
upgraded, they need to be tested again
using regression testing.
 IoT Real-Time Monitoring
What is it? (IBM,2022)
• Real-time monitoring
is a technique that
allows you to
determine the
current state of • React instantly
queues and channels to events from
within a queue remote sensors.
manager.
• The information
returned is accurate
at the moment the
command was
issued.

20XX Contoso business plan 10

 Thank you

Dr. Norharyanti Mohsin

yantimohsin@um.edu.my

11