Research Instrument
Research Instrument
The research objective chalked out for this study is explicitly defined and classified in terms
of the required data and its methodology. A research matrix was developed to allow the
readers a fluent understanding of the analysis of the research objectives. It is presented in the
table mentioned below:
The questionnaire developed covers six dimensions based on the research objectives:
(i), (ii), and (iii). The questionnaire is composed of 23 items using a Likert scale of 1 to 5;
these items were extracted from 100 dimensions of the rural built environment (references).
According to Churchill & Iacobucci (2002), there are nine steps involved in the
process of questionnaire development as illustrated below:
Step 7: Determine
Step 1: Specify what
Step 6: Determine layout and physical
Information will be
sequence of questions charateristics of the
sought
questionnaire
a) Three questions in the personal/ biography section, b) Four items that are further
subdivided into 16 questions in the satisfaction level in producing visual arts sections, whose
detail is mentioned in the table below:
Q1 Organization
Q2 Job
Q3 Years of Experience
Q4 Realization of Institutional
Framework
Effectiveness of Institutional
Q5
Framework
Adequacy of existing
Q6 Institutional Setup
Effectiveness of Previous
master plan(s)
Q9
Supportiveness of Rural Dev.
Plans
Q10
The success of Rural Dev. Plans
Q11 Environment
Effectiveness of Policy
mechanisms
Q12
Federal and Provincial
Coordination
Q19 Pakistan
Rural infrastructure
Q27
development
Place Consideration
Q28
Site Viability for master
Q29 planning
Place Consideration
Elements of Infrastructure
Planning
Q33
Construction Method
Q34
Determination of
Piloting of the Finalisation of the
Instrument
instrument instrument
Objectives
Determination of
Wording of the each
Methods for Data
Construct
Collection
In this study, a five-point Likert scale rating psychometric tool was adopted for the
responses to the questions for the collection of the opinion and views of the subjects.
According to Price (2016), these tools are evolved to quantify the trials like outlook,
qualities, abilities, and perceptions. The Likert scale helps in measuring attitude in an amply
validated and acceptable manner (Edmondson, 2005).
6Piloting
Pre-testing or piloting is critical to the success of the study undertaken. It is recommended
that the content validation is taken from experts in the field of study (Hoxley, 2008). Low-
Choy et al. (2021) suggest adopting a dual-stage process for the pilot study, i.e., the
individual questions and then the complete questionnaire. However, single-stage piloting is
acceptable if the study is on a small or medium scale. It is vital to get feedback on the
samples used in the pilot study, which can be conducted face-to-face or through a short
questionnaire to acquire this feedback. According to some experts, audio or video recording
can also be carried out (Weisberg et al.,1996). The piloting was performed prior to the actual
survey due to the reasons mentioned below:
- According to Rahim (2009), testing the reliability and internal consistency of the instrument
presented in the Likert Scale, where a value of 0.7 or higher in Cronbach’s Alpha reliability
test determines the level of reliability (Pallant, 2005).
- Identification of problems that may occur during the deployment of the actual study, such as
the ability of the subjects to understand the questions, terminologies, and time required for
completing the response.
- According to Viechtbauer et al. (2015), there are four steps in piloting, as illustrated in the
figure below:
The pilot survey was deployed using an online web application called Google forms
which is a free platform for the purpose of carrying out surveys. The pilot study was launched
in February 2021 with a sample size of 105 to obtain feedback regarding the adequacy of the
questionnaire, to ascertain the minimum duration required to answer the questions, and to
obtain an opinion from respondents about the information that can be derived from the
questions, the syntax, and the grammar. The feedback of the respondents was also collected
for their comments and opinion to improve the instrument. The questionnaire used in piloting
is attached as Appendix-
7Analysis of Piloting
The analysis was carried out in SPSS package version 24. After the analysis, Cronbach's
alpha gave a value of 0.898 for all items on the Likert Scale of 5, indicating the good
reliability of the questions asked. The alpha value for all of the questions individually also
indicates a good level of reliability. According to experts like ----, the alpha value of 0.90 and
above is considered excellent, 0.80-0.89 good, 0.70-0.79 adequate, and below 0.70 indicates
limited applicability.
Q4 15.000 0.920
Q5 16.000 0.891
Q6 9.000 0.912
Q7 18.000 0.973
Q8 3.000 0.909
Q9 5.000 0.902
0.898
The sample size represents the number of respondents selected from the overall
population that is used in the research (Newman, 1998). In quantitative research, the size of
the sample is essential in determining the reliability of the results of a study. Sample sizes of
much less than 30 will tend to produce results where individual respondents may skew the
results. In such cases, the larger the sample size, the more reliable the results will be (Flick,
2011). In qualitative research, the size of the sample is less important, and the concept of
representativeness is not as strong as a guideline for the validity of the research.
As the population selected for this study comprises local government and rural
development departments of all provinces, Planners, Architects, and executing agencies, e.g.,
C&W departments, Public Works department, etc., the population is not homogenous. In this
case, the appropriate technique is stratification or dividing the population into several
homogenous groups (Cowels, 2019). The only variable parameter for stratification is their
profession within the built environment schema in Pakistan which ensures that the strata are
homogeneous with respect to our parameter (Levy & Lemeshow, 2008). Moreover,
stratification is also considered to reduce sampling errors (Patten, 2014). A stratified random
sampling technique will be used, and the total population is 9,423, whose sample size is
estimated as 272 (Yamane, 1969; Levy & Lemeshow, 2008), as exhibited in the equation
below:
N
n=
1+ N (e)²
Where, n = Number of samples, N = 9,423 (population size) and e = 0.05 (error limit)
9423
n=
1+ 9423(0.05)²
Thus, n = 272
Consequently, the strata shall not be less than two in number, and it is also suggested
that it shall not exceed six due to diminishing returns. It is also noted by various scholars that
strata can be composed of different sizes. There are four methods to allocate the sample size
in stratified random sampling, namely equal allocation, proportional allocation, Neyman
allocation, and optimal allocation. Through the application of simple random sampling, an
unbiased estimator for a mean population or total shall be assured. However, the variance of
the estimator of mean or total can only be controlled by increasing the sample size
(Mukhopadhyay, 2009). In such a case where the probability proportional to size (PSS) with
the replacement for a sample is chosen, the number of draws shall be kept large enough so
that the variance is controlled in estimation (Chaudhuri, 2019).
According to the literature review, there are 580 tehsil administrations in Pakistan,
723 registered town planners (PCATP, 2021), 4620 registered architects (PCATP, 2021),
1280 LG&RDD employees on the technical portfolio, and 2800 technical employees of
implementing agencies. In such a scenario, simplified random sampling (Probability
sampling group) is recommended (Mishra & Alok, 2020). However, there may occur two
problems, i.e., sample frame error and less representation from the first two groups on the
basis of proportional allocation of samples to the strata. The proportional allocation (Levy &
Lemeshow, 2008; Yamane, 1969) usually does not provide the best representation.
There were two methods for the allocation of samples used for comparison, i.e.,
Proportional and Equal. Proportional allocation lays the size of the sample for each stratum
equal in proportion to the total number of sampling units in that specific stratum which is
expressed as nh/n = Wh.
10Distribution of the Questionnaire
The questionnaire was developed using google forms for distribution convenience through
email, social media, specific websites, real-time data synchronization, storing the feedback/
response, integration with a spreadsheet, and visualization of general statistics that are built-
in in google forms. The questionnaire was distributed to the respondents through e-mail and
cellular messages.
According to Denscombe (2007), the questionnaire instrument will have much better
results if the questions asked are straightforward and easily answered. A total period of 3
weeks was dedicated to the completion of the survey. The questionnaire was sent with a
cover letter, a page containing an introduction to explain the study objectives and a
confidentiality note. The instrument was sent to 500 respondents (mentioned details of LG,
Planners, Architects, and Executing agencies). Several reminders were sent to the
respondents after two weeks. After the cut-off period of 3 weeks, 278 responses were
received.
- achieve a wide range of opinions about the research concern in a single occasion with
multiple respondents.
Prepare a list of topics that are structured in a logical sequence. The guide is, in fact, like a
checklist because the discussion happens in a fluid, haphazard and spontaneous manner
instead of in the desired sequence. That is why the moderator shall remain flexible yet keep
track of the objectives. The guide for FGD shall consist of an introduction, an opening
question, transitory questions, prime questions, and concluding question(s). It is better to
adopt the funnel approach by starting with the broad question(s), shifting to a specific
question(s), and closing with the broader concluding question(s).
“The ability of a system to sustain or absorb external shocks while maintaining the same
functions and form of the system” (Salvia et al., 2015).
Let me share the course of our discussion today, as you are already aware that your
participation is voluntary. All of the discussions here will be confidential and used for the
research project. I would add that there are no right or wrong answers. Rather, we are asking
for your opinion and experiences, so please feel comfortable expressing yourself. It is helpful
to hear a different point of view, allowing disagreements and keeping the respect of views of
others. We request that you join the discussion whenever you have something to say or want
to respond to someone else’s point. In order to hear everyone, it is important that only one
person talks at a time so we do not miss anything.
During the discussion, Mr. Imran will be taking notes and would remind me whenever
I forgot to ask something. We would also like to record the session so he does not have to
worry about writing everything. Please do not be concerned about the recording; we will keep
the discussion confidential. Moreover, the recording will be secured and will not be
accessible to anyone except the research team. Are you fine with the recording? (Everyone’s
consent is required). Kindly help yourselves with the refreshments as this discussion will
probably span over an hour. Let us know if you have any queries prior to the discussion.
14Opening Question
Let us introduce ourselves and share our type of work and the current study. This study
adopted a questionnaire survey based on the literature review on the rural built environment
framework. The key findings of the study are:
Planning Short term Short-sighted planning for the current political cycle instead
of a long-term vision
Building & Standards & A deficit in the adoption of standards and regulations by the
Infrastructure Regulations municipalities, lack of technical cadres on a local level, weak
Design monitoring, and evaluation
At what level shall the goals and policies for the built environment be developed?
Shall it be a linear or cyclic process based on informed decisions and past performance?
15Introductory Question
What is a suitable cycle for the policy on the rural built environment?
16Transitionary Questions
Can inclusiveness and collaboration be the core principles of BE framework?
Are resilience and climate change the suitable governing factors for the rural built
environment?
What level of institutions is suitable for the formulation of policies?
How to synergize the execution of RBE works amongst LG&RDD, C&W, and PWD?
How can policies be reviewed on the basis of feedback from the stakeholders?
17Prime Questions
What can be a better way to develop plans at Tehsil (local) level?
18Closing Questions
Is there any other suggestion or critique of the whole framework?
19Conclusion
We are now about to reach the end of this discussion. Does anyone have any additional
remarks before we conclude this group discussion? I am thankful to all of you for your
presence and support. Your opinions and observations are precious for refining the built
environment framework for resilient rural communities of Pakistan.
22Introduction
The introduction part includes a welcome note, team introduction, introduce the research
broadly, use of information, discussion guidelines, length of the discussion, and response to
the queries, if any.
23Ethical Considerations
This part consists of taking consent from the participants, inform about confidentiality and
data usage, and taking permission to record the session.
26Post-Discussion data
Erstwhile the session is finished, it is recommended to provide a chance for the respondent to
ask any question(s) related to the study. This period is suitable to be utilized for collecting
demographic information from the individuals prior to their departure through single or two
paged questionnaires. The same questionnaire has the possibility to ask questions pertaining
to the study, which can also be helpful for the analysis and interpretation of the data.
28Data Analysis
This section addresses the detailed description of the various statistical analysis exercised in
this study. The process of analysis started after gathering all the required data. The data
collected were calculated and analyzed using statistical procedures of SPSS version 24 and
AMOS version 20 software packages. According to Pallant (2007), multiple arrays of
parametric and non-parametric tests can be performed depending on the nature of the
research question and suitability of the analysis technique as mentioned below:
In this section, please tick only one box for each of the questions
Q1. Which category best describes your planning organization?
PC [ ] P&D [ ] LG&RDD / TEHSIL COUNCIL [ ] DISTRICT COUNCIL [ ] PARD [ ] Others
…………………
Q3. How long have you been working with your planning authority?
1-5years [ ] 6-10years [ ] 11-15 years [ ] 16-20years [ ] more than 20 years
Q4. Please specify the extent to which the following characteristics of the institutional framework
are effectively operational / implemented in the rural built environment planning system in
Pakistan.
1- Not at all implemented 2- slightly implemented, 3-somewhat Implemented 4-moderately implemented, 5-highly
Implemented
1 2 3 4 5
1 National Level
2 Provincial
8 District Council
12 Housing Strategies
14 District Council
15 Tehsil Council
16 Village Council
Q5. In your view, is the existing formal institutional setup adequate for effective rural built
environment Planning?
1- Not adequate, 2- slightly adequate, 3- somewhat adequate, 4- moderately adequate, 5- highly Adequate
FIS 1 2 3 4 5
1 Adequacy of institutional setup for effective rural Built Environment planning
2 Adequacy of the legal framework
3 Evidence-informed policies
4 Consistency of policies and programmes
5 Appropriation of strategies
6 Roles and responsibilities of the various levels of government and of the
7 Human resources (Capacities and Capabilities)
8 Quality of public services
9 Allocation of sufficient financial resources
Q6. In your opinion, how effective are the policy-oriented mechanisms for the enforcement
of Rural Built Environment Programmes in Pakistan?
1- Not effective, 2- sometimes effective, 3- frequently effective, 4- mostly effective, 5- always effective
POM 1 2 3 4 5
1 Strategy Formulation at the municipal level
2 Strategic posture and guidelines at District and Tehsil level
3 The mission at the community level
4 Strategy components at the community level
5 Action Programmes for Strategic Development
6 Action Programmes for Specific Development
7 Assessment and Ranking of Action Programmes
6a Planning Elements (PE)
8 Strategic Framework (guidelines) for Development
9 General Goals of development
10 Specific Goals of development
11 Planning Solutions (measures, rules, etc.)
6b Post-Planning Elements (PPE)
12 Dynamic framework for implementation
13 Measures and instruments of implementation
14 Planning/ Programming
15 Organizational
16 Normative and legal
17 Adequate Financial Allocation
6c Elements of Monitoring (EM)
18 Monitoring system
19 Evaluation (indicators)
20 Institutional and Organisational aspects
Q7. In your view, please rate the effectiveness of the rural planning system in terms of
development control.
1- Not effective, 2- sometimes effective, 3- frequently effective, 4- mostly effective, 5- always effective
1 2 3 4 5
7a Rural Governance (Institutions) (RG)
1 Adequacy of funding provided by the government
2 Creating awareness about development control
3 Consistency in Governance to continue with development control
4 Participation of major stakeholders (broad-based)
5 Effective Communication from the planning authorities to the public
7b Rural Built Environment Planning (BEP)
6 Rural Built Environment Planning Mechanism
7 The control effect of the Spatial Scale
8 The control effect of Spatial Structure
9 The control effect of spatial pattern
7c Rural Management (Development control goals & measures) (Technical) (RM)
10 Control (Height, Space, density Development)
11 Effective use of Zoning regulations (Building line regulation)
12 Adopting and implementing Development control standards
13 Adequate Skilled Manpower to ensure strict compliance with development
14 Planning System in use (Master planning) to support development control
7d Administrative (Operational)
15 Commission System
16 Council-Manager System
17 Coordinated administrative machinery
18 The framework operates using the plans and policies provided to ensure
19 No strategic planning framework for tackling the physical planning
20 A clearly defined administrative procedure
7e Legal (Laws and ordinances)
21 Control Measures like density control and regulations
22 Regional Planning Law
23 Development control standards
24 Does the Development strictly adhere to the Laws
7f Built Environment Plans
25 Spatial Plan
26 Regional Plan
27 Structure Plan
28 Master plan
29 Comprehensive Plan
30 Subject Plan, e.g., Rural Development Plan
Q8. In your opinion, is there any singular mechanism for implementation & enforcement of
Rural built environment Programmes for:
1-Not adequate, 2-Slighly adequate, 3-somewhat adequate, 4- very adequate, 5- highly adequate.
1 2 3 4 5
1 Federal Works
2 Provincial Works
3 District Council Works
4 Tehsil Council Works
5 Village Council Works
Q9. In your opinion, to what extent the RD programs in Pakistan has achieved the objectives
laid down in SDG Agenda 2030 in the following areas:
1 2 3 4 5
1 Technical Assistance
2 Participatory rural development
3 Inclusive growth
4 Sustainable Development
5 Rural Transformation
6 Reduction of rural-urban gaps and migration
7 Community Driven Development CDD
8 Hygienic Public Health System (Water Supply, Drainage, Waste Water)
9 Resilient infrastructure (Roads, Railways, Electricity, e-governance)
10 Innovation in Building Construction
11 Sustainable and Resilient communities
12 Disaster Risk prevention and land management in rural areas of Pakistan
13 Restoration, preservation, and enhancement of biodiversity in rural areas
14 Reduction of GHG, ammonia emissions
15 Supply and use of renewable energy and other means of bio-economy
16 Prevention of soil erosion and improvement of soil management
17 Enhancing energy efficiency in water use by agriculture and food
Q10. In your opinion, to what extent the Rural Built Environment Programmes are
successful:
1-Not successful, 2- slightly successful, 3-somewhat successful, 4- mostly successful, 5- always successful.
Q11. In your opinion, please rate the effectiveness of building construction standards in rural
areas.
1- Not effective, 2- sometimes effective, 3- frequently effective, 4- mostly effective, 5- always effective
1 2 3 4 5
1 Planning, infrastructure, and building standards
2 Building standards and codes
3 Local Building Byelaws and Regulations
4 Technical requirements for buildings
5 National Reference Manual on Planning & Infrastructure Standards 1986
6 Building Code of Pakistan (Seismic Provisions 2007)
7 Building Code of Pakistan (Energy Provisions 2011)
8 National Climate Change Policy 2012
9 Disaster Risk Reduction Policy 2013
10 Pakistan Electric and Telecommunication Code 2014
11 Building Code of Pakistan (Fire Safety Provisions 2016)
Q12. Please rate the major challenges in building standards and regulations that the building
sector faces in rural areas.
1-None, 2-Very Mild,3- Mild,4- Moderate, 5-Severe
1 2 3 4 5
1 Lack of national/ Provincial/ Local building standards
8 Lack of experts/expertise
9 Lack of Knowledge
10 Lack of awareness
11 Lack of finance
Q13. In your opinion, please indicate the measures to be taken to improve building standards
and their effectiveness.
1-None, 2-Very Mild,3- Mild,4- Moderate, 5-Severe
1 2 3 4 5
1 2 3 4 5
1 Village Infrastructure
3 Individual Houses
Q15. In your view, to what extent have RDP interventions successfully contributed to
improving:
1- Not Successful, 2- rarely successful, 3- somewhat successful, 4- mostly successful, 5- always successful
1 2 3 4 5
Q16. In your view, how important are these factors for the planning of rural communities in:
1- Not at all important, 2- Low importance, 3- Neutral, 4- mostly important, 5- always important
1 2 3 4 5
1 Geographical Features
2 Proximity
3 Accessibility
4 Small Settlement
5 Dispersed community
6 Dense Community
7 Proximity
8 Accessibility
9 Dense Community
10 Topography
11 Proximity
12 Accessibility
13 Orientation
14 Form
15 Height
16 Roof
19 External Finishes
20 Natural Ventilation
Q17. In your view, how important are these elements for the planning of Infrastructure and
Public Service Systems in rural communities?
1- Not at all important, 2- Low importance, 3- Neutral, 4- mostly important, 5- always important
1 2 3 4 5
1 Transportation
2 Water Supply
4 Information Systems
Q18. In your opinion, which construction method is suitable for buildings in rural areas?
1. Not at all suitable, 2-Less suitable, 3- Neutral, 4- mostly suitable, 5-always suitable
1 2 3 4 5
1 Site Built
2 Prefabricated
3 Modular
4 Manufactured
5 Traditional