Review - 1
For
EXPENSE TRACKER SYSTEM TESTING TOOLS - A REVIEW
In
Software Testing (ITE2004)
Slot: B1
B.Tech - Information Technology and Engineering
by
DIVANSHU AGGARWAL (19BIT0289)
ISHITA DUBEY (19BIT0328)
Under the guidance of
Dr. Charanya R
1
EXPENSE TRACKER SYSTEM TESTING TOOLS - A REVIEW
ABSTRACT
The Expense Tracker System is designed to assist anyone who wants to keep track of their
costs and save money. It is a website that users can use on their mobile phones to update
their daily expenses and keep track of their spending. In order to achieve appreciable
performance, we’ll be using multiple software testing tools to test the performance of our
system. The performance of the system can be determined through web testing, database
testing and load testing. Therefore, in this project we will be reviewing various automation
testing tools used to test ERP systems and then carry out testing for our expense tracking
system along with developing the system.
Keywords - Automation Testing, Selenium, SoapUI, LoadRunner, Jmeter, Funkload,
SolarWinds, Acunetix, Netsparker, Locust, Gatling, Protractor and Bugzilla.
INTRODUCTION
Expense Tracker System is a website that users can use on their mobile phones to update their
daily expenses and keep track of their spending. The user can create their own spending
categories, such as food, clothing, rent, and bills, and then input the money that has been spent,
as well as provide extra details to further characterize the expense. Expense categories can also
be defined by the user. This software is geared toward new employees, interns, and teens, it may
be used by anybody who wants to keep track of their expenses.
Software Testing - Software testing is the process of evaluating and validating that a software
product or application performs as expected. It is used for lowering capital costs, preventing
defects and boosting performance of the product.
There are numerous sorts of software tests, each with its own set of goals and strategies:
● Acceptance testing: Entails determining if the entire system functions as intended.
2
● Integration testing: It is the process of ensuring that software components or functions
work in tandem.
● Unit testing: It is the process of ensuring that each software unit works as planned. An
application's smallest testable component is called a unit.
● Testing functions: It is done by simulating business situations based on functional
requirements is known as functional testing.
● Black-box testing: It is a typical method of ensuring that functions are working properly.
● Performance testing: It is the process of determining how well software performs under
various workloads.
● Regression testing: Testing to see if new features fail or degrade functioning is known as
regression testing.
● Sanity testing: When there isn't enough time for a comprehensive regression test, sanity
testing can be performed to validate menus, functions, and instructions at the surface
level.
● Stress testing: It is the process of determining how much strain a system can withstand
before failing. It is a sort of non-functional testing.
● Usability testing: It is the process of determining how successfully a consumer can
execute a job using a system or web application.
Automation Testing - Automation testing is a software testing technique that executes a test case
suite using particular automated testing software tools. Manual testing, on the other hand, is done
by a person sitting in front of a computer, going over the test procedures step by step. In addition
to entering test data into the System Under Test, the automation testing software may compare
expected and actual outcomes and provide complete test reports. Software Test Automation
involves a large investment of both money and time. Test automation is the most effective method
for increasing the efficacy, coverage, and speed of software testing.
The importance of automated software testing can be summed up as follows:
3
● In manual, it takes time and money to test all workflows, fields, and bad cases.
● It's difficult to test multilingual sites manually.
● Test automation eliminates the need for human intervention in software testing. It is
feasible to conduct automated testing without being present (overnight)
● Automation testing shortens the amount of time required for testing.
● Test coverage can be increased using automation testing.
● Manual Testing can become tedious and, as a result, error-prone.
Below is some literature that we have reviewed in-order to receive more insights about
automation testing tools in ERP systems.
LITERATURE REVIEW
[1]. Mateus, E., & Serrão, C. (2021). Vulnerability Assessment of Angolan University
Web Applications.
They did research to determine how vulnerable their online apps are, as well as the most
typical flaws. The major goal was to raise security awareness among organizations about
the risks to which their data is exposed, as well as to alert them to the critical mitigations
that must be implemented to prevent such risks. This paper describes a study that was
conducted to assess the security status of Angolan universities' web applications,
identifying the most common security vulnerabilities and their severity, using OWASP
Top 10 and CWE Top 25 references to identify and validate the findings discovered
during the automated vulnerability assessment process.
[2]. ERP System.
The basic goal of ERP (Enterprise resource planning) is to create a central system, as
opposed to the old way of doing manual work on paper. As a result, managing all of the
records and analyzing all of the records in each department is quite tough. Manual labor
is inefficient and time-consuming for the entire department. As a result, the necessity for
a central system that provides effective and efficient results in a short period of time has
arisen. All departments have access to the system's data and can conduct whatever task
4
they choose. That way, anyone may simply manipulate and obtain data whenever they
want. They used a variety of software testing methodologies to identify programme
faults, which were then used to determine if the application was usable in practice. They
employed white box testing, black box testing, unit testing, integration testing, and
validation testing during the testing process. They choose inputs to workout paths through
the code and find the right outputs in white box testing. They used black box testing to
look at an application's functionality (what the software performs) without looking at its
internal structures or workings. Unit testing was used to assess if individual units of
source code, sets of one or more computer programme modules with associated control
data, use procedures, and operating procedures were fit for use. Integration testing was
introduced in the article in the phase of testing to test the Individual software modules are
merged or used collectively. Validation testing was established as separate procedures
used in tandem to ensure that a product, service, or system satisfies requirements and
specifications and serves its intended purpose.
[3]. Software and Performance Testing Tools
This paper aims to list out the software testing techniques and tools in order to compare
manual testing and automation testing. They concluded that automation testing is
undoubtedly more suitable than manual testing. They have evaluated checkComplete,
SELENIUM, Quick Test Professional, Katalon Studio, RANOREX and LambdaTest
tools for automation testing. For performance testing they have examined HP Loadruner
and Jmeter and concluded that the selection of one of these tools depends on the budget,
type of system, testers, no of users etc. If we have a budget crisis then you can stick to
JMeter otherwise LoadRunner provides faster resolution of scripting issues. It also
provides excellent monitoring and analysis features which are leading in the market. It's
only disadvantage is high procurement and maintenance cost.
[4]. A Methodology for Enterprise Resource Planning Automation Testing
Application to the Open Source ERP-ODOO
5
This article aims to propose a method for automation of ERP systems which is a complex
task due to the interrelation between modules of the system. They focus on the concepts
of system modeling to reduce the risks of errors. Their method combines the tools
required to manage ERP-tests automation and the system modeling. For this, several test
cases are defined using a test generation tool which is used on the ERP ODOOsystem.
Their approach reduces time and cost of testing, it can be used at every stage of SDLC
and it reduces the risk of errors compared to other tools. But it is unable to test the
architecture and measure its complexity and it cannot analyze the behavior of the system
without disrupting the system.
[5]. Ashraf, H., Alenezi, M., Nadeem, M., & Javid, Y. (2019). Security assessment
framework for educational ERP systems. International Journal of Electrical and
Computer Engineering (IJECE), 9(6), 5570-5585.
This study used automated tools, penetration testing, and public vulnerability repositories
(CVE, CCE) to identify security flaws in an educational ERP system. The Common
Vulnerability Scoring System is then used to prioritize security issues (CVSS). The
discovered vulnerabilities are checked for false positives before being grouped with
mitigation approaches that are publicly available in security vulnerability solution
repositories such as CCE and CWE. Using mapping methods, these mitigation techniques
are mapped over reported vulnerabilities. Through a series of tests and the provision of
recommendations and tools for the issue and security evaluation of enterprise apps, the
goal of this study is to warn users about the importance of protecting the security of
entrepreneurial applications.
[6]. Saha, Trina, and Rajesh Palit. "Practices of Software Testing Techniques and
Tools in Bangladesh Software Industry." 2019 IEEE Asia-Pacific Conference on
Computer Science and Data Engineering (CSDE). IEEE, 2019.
They conducted a survey of ten prominent software organizations to analyze current
software testing procedures and technologies in the industry for this study. They also
brought attention to the current roadblocks and obstacles that are preventing the business
6
from generating better products. The responses from each firm are presented at the
beginning of this study, followed by a general comparative examination of the use of
testing instruments. They surveyed the use of software testing tools by various
organizations and assessed the use of each tool using percentages in this study. According
to the findings of the survey, software testing tools are only used in a restricted fashion
for load testing, functional testing of online and mobile applications, and bug or defect
monitoring.
[7]. Research on Automatic Test of WEB System Based on Loadrunner
In this paper, the team determines whether a small ERP system and Fujian normal
university educational administration management system meets the requirements of the
market and its present users based on throughput, response time, etc. The team uses
LoadRunner to perform load testing on these systems. They have enhanced the script to
improve the accuracy and its capability. Through this, the system performance is
increased by 1-2% which results in better user satisfaction and system stability.
[8]. ERP System Integration with Mobile Applications Using Service Oriented
Architecture
Through the integration of Enterprise Resource Planning (ERP) with mobile applications
utilizing Service Oriented Architecture, this study creates many web services that may be
used to replace the export and import processes (SOA). RESTful web services have gone
through numerous phases of testing using the QOS standard. Based on the results of
testing using Jmeter with a simulation of 20 users, the web service has a latency of 3
seconds and a load time of 4 seconds with an average data size of 2599 bytes, indicating
that the quality is fairly high in terms of performance and accessibility. The results of the
vooky tests show no bugs, but there are still security flaws due to the lack of security in
the header. Based on the results of these testing, the webservice can be used to replace the
salesperson's export and import processes, making data connection between ERP and
mobile applications real-time.
7
[9]. Evaluation of the maintenance required by web application test suites
The purpose of this thesis is to examine the development of online applications as well as
four web application testing approaches, compare their differences, and assess their
benefits and drawbacks. Experiment with an existing open-source web application and
establish some metrics for measuring the program's evolution maintenance effort.
Selenium WebDriver is a powerful tool for testing online applications. It indicates the
need for upkeep and the vulnerability of web applications as they evolve. Furthermore,
there are other issues with these development and testing technologies. In terms of test
code evolution, on average, close to 10% of the total number of rows changed between
releases. If the percentage is low, there will be inevitable code confusion during the
development of the application, and Testing will have to adjust to changing requirements
or any type of AUT change.
[10]. Cloud based ERP system for SME industry
In this article, a cloud-based ERP system is created employing modern technologies and
processes to provide SMEs with a simple and user-friendly platform.The graphical and
tabular reports created by the ERP system will help the company's owner keep track of
his or her business's activity and make smarter decisions. The suggested cloud-based ERP
is targeted at SMEs and has four primary elements that work together to give a complete
solution. The built ERP system provides a real-time solution to SMEs, covering voucher
forms of transactions, order placement, and shipping, among other things. The system
includes graphical and tabular data that allow the business owner to track the company's
progress remotely over the internet. Visual coverage helps managers understand sales and
orders better, allowing them to make better decisions. The results of performance testing
also show that reaction time and throughput are sufficient.
[11]. Performance analysis and performance modeling of Web-applications
They looked into the performance of web servers and database servers that were linked
together in particular online applications. They concentrated on one of the most critical
8
applications' performance bottleneck and average response time. As a result, they
provided the software architecture of the University of Mannheim's "Study-Portal" web
application, as well as typical workload scenarios. They talked about the performance
tests and documented the software and hardware infrastructure that was employed. The
purpose of this essay was to identify the most important parameters that influence the
integrated web-timing application's behavior. They employed normal stochastic
approaches to model the data. Their findings then provide a straightforward
approximation for the web application in question: doubling the number of application
servers reduces response time by half when there are enough clients.
[12]. IT Infrastructure-Monitoring Tools
This article describes current network monitoring techniques for detecting problems,
ensuring component availability, and measuring the resources consumed by those
components. In the article they concluded by stating the future trends in this field. In this
they have listed out eight popular IT-monitoring tools - Nagios, Zabbix, Hyperic,
SolarWinds, ManageEngine OpManager, HP Operations Manager, IBM Tivoli and
Whats up Gold. They have stated the advantages and disadvantages of these tools along
with the ease of use of their functionalities with respect to IT-monitoring. In the end, they
have concluded that traditional infrastructure monitoring tools will be replaced by
application performance management as a business’s profit is highly affected by the
performance of external and internal applications.
[13]. Ateşoğulları, Dilara, and Alok Mishra. "Automation testing tools: a
comparative view." International Journal on Information Technologies & Security
12.4 (2020).
The goal of this article is to comprehensively evaluate and compare twenty-one
accessible automation-testing solutions on twenty criteria. This research will aid software
testing professionals and researchers in gaining more knowledge in this field. The goal of
this research is to look at several automation test tools and categorize the differences
between them. The objective of these tools and their existence is to entirely address
9
market gaps and provide the user with a wide range of capabilities. These instruments
were categorized and studied in this study in terms of their assets and solutions.
[14]. Shrivastava, Siddhant, and S. B. Prapulla. "Comprehensive Review of Load
Testing Tools." (2020).
The purpose of this paper is to provide a general overview of open-source load testing
tools. Based on comparisons of Locust, Gatling, and JMeter, it can be determined that
each tool does an excellent job. Locust has an advantage in terms of efficiency, Gatling
has an advantage in terms of visualizations, and JMeter has an advantage in terms of the
diversity of protocols it supports and its ease of use. According to the parameters, make
an educated judgment between three resources.
[15]. Kelaniyage, T. C. Centralized Change Management Platform for Melstacorp
PLC. Diss. 2021.
This application was created specifically for Melstacorp PLC to centralize and operate as
an all-in-one solution for the company's various applications. The major goal of this
application is to incorporate security, quality of service, transparency, efficiency, and
accuracy into the process of change management and user management. Bugzilla was
utilized for testing since it is a strong, feature-rich, and mature defect-tracking system.
S. Paper Features Testing Tools
No.
1 Vulnerability Assessment of This paper describes a study that Locust
Angolan University Web
was carried out to examine the
Applications
security condition of the online
applications of Angolan institutions
using OWASP Top 10 and CWE Top
10
25 references to identify and validate
the findings discovered during the
automated vulnerability assessment
procedure.
2 ERP System (2020) The project's major goal is to bring -
the organization's many divisions
together in a consistent manner so
that complex functions may be
handled efficiently by both technical
and non-technical people. Validation
and verification were accomplished
through white box, black box, unit,
and integration testing.
3 Software and Performance This study demonstrates that -
Testing Tools (2021)
automation testing is far more
appropriate than manual testing. In
this article, they looked at
SELENIUM, Quick Test
Professional, Katalon Studio,
RANOREX, and LambdaTest.
4 A Methodology for Enterprise This paper explains how to use Selenium
Resource Planning
system modeling and automation
Automation Testing
Application to the Open testing tools to automate the testing
Source ERP-ODOO (2019) of Enterprise Resource Planning
(ERP) systems.
5 Security assessment In this research, SOAP-based web netsparker
framework for educational
services are used to integrate data
ERP systems.
11
from a web portal and an ERP
system. Performance testing is also
used to investigate how online
services behave under different
loads.
6 Practices of Software Testing In order to examine the current Locust
Techniques and Tools in
practices of software testing
Bangladesh Software Industry
techniques and technologies in the
industry, we conducted a survey of
ten top software organizations.
7 Research on Automatic Test of The study performs a load test for LoadRunner
WEB System Based on
these systems using LoadRunner, a
Loadrunner (2018)
performance testing tool.
8 ERP System Integration with Using Service Oriented Jmeter
Mobile Applications Using
Architecture, this study connects
Service Oriented Architecture
(2019) Enterprise Resource Planning (ERP)
with mobile applications (SOA).
Latency on the web service was
determined based on the results of
testing using Jmeter with a
simulation of 20 users. The results
of the vooky tests demonstrate that
there is no bug.
9 Evaluation of the It presents an empirical experiment Selenium
maintenance required by web
on open-source web application
application test suites
projects (dolibarr) to examine web
application testing suits and create
12
analysis metrics.
10 Cloud based ERP system for A cloud-based enterprise resource Jmeter
SME industry (2019)
planning (ERP) solution for small
and medium-sized businesses is
described in this study (SMEs).
Apache Jmeter was used to test the
performance of the created
cloud-based ERP.
11 Performance analysis and They detail our performance FunkLoad
performance modeling of
measurements and document the
Web-applications (2011)
software and hardware architecture
utilized during the measurements for
the University of Mannheim's
web-application, called
"Study-Portal."
12 IT Infrastructure-Monitoring Nagios, Zabbix, Hyperic, SolarWinds
Tools (2015)
SolarWinds, ManageEngine
OpManager, HP Operations
Manager, IBM Tivoli, and Whats up
Gold are among the eight major
IT-monitoring software features.
13 Automation testing tools: a The goal of this paper is to evaluate Protractor
comparative view
and compare twenty-one available
automation-testing tools on twenty
attributes in a thorough manner,
including Selenium,Protractor
Unified Functional Testing, Appium
13
,Test Complete,The Cucumber tool,
Ranorex Studio, Watir, IBM
Rational Functional Tester, Tricentis
Tosca, Telerik Test Studio, Katalon
Studio Framework, Linux Desktop
Testing Project, Serenity, LeanFT,
PhantomJS, Coded UI, Sikuli,
Applitools, TestArchitect
and Testim.io .
14 Comprehensive Review of This study examines the diversity of Locust, Gatling,
Load Testing Tools.
protocols supported by open-source JMeter
load testing tools such as Locust,
Gatling, and JMeter, as well as their
ease of use.
15 Convolutional Neural This study compares Bugzilla Bugzilla
Network Based Approval
alongwith various testing tools for
Prediction of Enhancement
Reports. an application whose main focus is
to incorporate security, quality of
service, transparency, efficiency, and
accuracy into the process of change
management and user management.
CONCLUSION
We have successfully reviewed over fifteen literature on automation testing tools in the field of
expense tracking systems. The literature review contains evaluation of ten automation testing
tools for web testing and load testing. We intend to select a few testing tools from the above
mentioned ones and carry out testing on our expense tracker system to evaluate their
performance.
14
REFERENCES
1. Mateus, Emanuel, and Carlos Serrão. "Vulnerability Assessment of Angolan University
Web Applications." (2021).
2. Nayak, Nikhil Ranjan, et al. "ERP System." (2020)
3. N. Srivastava, U. Kumar and P. Singh (2021) Software and Performance Testing Tools.
Journal of Informatics Electrical and Electronics Engineering, Vol. 02, Iss. 01, S. No.
001, pp. 1-12, 2021
4. Sambe, Thierno Birahime, Stephane Maag, and Ana R. Cavalli. "A Methodology for
Enterprise Resource Planning Automation Testing Application to the Open Source
ERP-ODOO." ICSOFT. 2019
5. Solanki, Manishkumar, Seema Shah, and Deepali Vora. "INTEGRATION OF A WEB
PORTAL AND AN ERP THROUGH WEB SERVICE BASED IMPLEMENTATION AND
TESTING APPROACH."
6. Saha, Trina, and Rajesh Palit. "Practices of Software Testing Techniques and Tools in
Bangladesh Software Industry." 2019 IEEE Asia-Pacific Conference on Computer
Science and Data Engineering (CSDE). IEEE, 2019.
7. Q. Linling and W. Qingfeng, "Research on Automatic Test of WEB System Based on
Loadrunner," 2018 13th International Conference on Computer Science & Education
(ICCSE), 2018, pp. 1-4, doi: 10.1109/ICCSE.2018.8468852
8. H. F. Erdiyana and Suharjito, "ERP System Integration with Mobile Applications Using
Service Oriented Architecture," 2019 International Conference on Information
Management and Technology (ICIMTech), 2019, pp. 1-5, doi:
10.1109/ICIMTech.2019.8843745
9. SHUANG, QI. "Evaluation of the maintenance required by web application test suites."
(2020)
10. Mughal, A., Bhatti, S., Noman, H., & Ahmed, D. (2019). Cloud based ERP system for
SME industry. International Journal of Computer Science and Information Security
(IJCSIS), 17(12), 22-32.
11. H. Kredel, H. Kruse and I. Ott, "Performance Analysis and Performance Modeling of
Web-Applications," 2011 International Conference on P2P, Parallel, Grid, Cloud and
Internet Computing, 2011, pp. 115-122, doi: 10.1109/3PGCIC.2011.27.
12. J. Hernantes, G. Gallardo and N. Serrano, "IT Infrastructure-Monitoring Tools," in IEEE
Software, vol. 32, no. 4, pp. 88-93, July-Aug. 2015, doi: 10.1109/MS.2015.96.
13. Ateşoğulları, Dilara, and Alok Mishra. "Automation testing tools: a comparative view."
International Journal on Information Technologies & Security 12.4 (2020).
15
14. Shrivastava, Siddhant, and S. B. Prapulla. "Comprehensive Review of Load Testing
Tools." (2020).
15. Kelaniyage, T. C. Centralized Change Management Platform for Melstacorp PLC. Diss.
2021.
16
