Report
Report
7. Reliability...............................................................................................................................17
This report is consisted of all the information and processes used for calculating all
the characteristic in a good test. The process is also specified from the test
development to data analyzing. Test was consisted of subject BIOLOGY of class
9 .The objective behind this project was to pass over all the phases that provide
evidence about the item as well as test analysis.
The test was consisted of 60 items’ MCQs each MCQ has four distractors. Before the
test development table of specification was also constituted to make sure that the test
has “content validity”.
The next step was to clear the objectives of the administration of the test as well as the
completion of that project.
The test and its items were passed through every phase of the examination according
to the given directions to analyze the test item, student perception and also student’s
response towards each item and distracter.
It was also analyzed that whether the stem has ability to provide the students all that
information which the students want. Furthermore, the distracters has the capability to
distract student’s mind.
This project also helped us to know which item is supposed to be best having good
reliability and has choice to be selected for standardized test as well as to include in
Item bank.
                 2. Objectives:
2. Which of the following is a division of biology that deal with the study of
plants?
04. Which of the following biological careers uses to enhance livestock and
agricultural crops?
5. Groups of similar cells that perform the same duties are referred to as?
1. Which of the following lists the proper order for the biological method?
Comprehension level
5.
A. Data organization is the process of collecting and storing data, while data analysis
is the process of interpreting and drawing conclusions from data.
B. Data organization is the process of structuring and formatting data, while data
analysis is the process of extracting meaningful information from data.
C. Data organization is the process of preparing data for analysis, while data analysis
is the process of using data to make decisions.
D. Data organization is the process of cleaning and validating data, while data
analysis is the process of identifying patterns and trends in data.
A) A single species of grass B) A forest with various plant and animal species C) A
field with only one type of crop D) A desert with minimal plant life
A) It has no impact on human life B) It may lead to the extinction of certain species
C) It improves human health D) It reduces the need for conservation efforts
A. The deforestation of the Chitral region. B. The overfishing of the Indus River. C.
The pollution of Lake Saifullah. D. All of the above
4.What role did Rudolf Virchow play in the advancement of the cell theory?
10. Which type of tissues provides support and connects different tissues in the body?
8. If a cell has 16 chromosomes before mitosis, how many chromosomes will each
daughter cell have after mitosis?
a. 8 b. 16 c. 32 d. 64
9. What happens during cytokinesis in animal cells?
a. Division of the cytoplasm b. Formation of a cell plate c. Duplication of DNA d.
Formation of a cleavage furrow
1 a 18 b 35 d 52 b
2 b 19 b 36 a 53 c
3 b 20 d 37 a 54 d
4 c 21 b 38 c 55 b
5 b 22 a 39 d 56 c
6 c 23 b 40 b 57 a
7 c 24 a 41 b 58 d
8 a 25 d 42 a 59 d
9 a 26 b 43 c 60 b
10 b 27 c 44 d
11 a 28 b 45 c
12 c 29 d 46 b
13 a 30 d 47 b
14 b 31 a 48 d
15 b 32 c 49 a
16 b 33 b 50 c
17       a           34         d           51          d
                             Traditional item analysis:
BIOLOGY 9
1 150 15 10 25 0 0 a 150 2
2 19 141 15 25 0 0 b 141 2
3 15 159 15 11 0 0 b 159 2
4 11 8 142 39 0 0 c 142 2
5 13 126 21 40 0 0 b 126 2
6 18 16 142 25 0 0 c 141 2
7 33 28 121 18 0 0 c 121 2
8 73 28 75 24 0 0 a 73 2
9 116 45 23 16 0 0 a 116 2
10 36 48 55 60 0 0 b 48 2
11 75 37 48 40 0 0 a 74 2
12 78 56 49 17 0 0 c 44 2
 13       58    48      60   34       0              0      a                               56      2
14    59   107   24    10   0   0   b   106   2
15 18 142 21 19 0 0 b 140 2
16 65 102 17 16 0 0 b 101 2
17 80 56 15 49 0 0 a 77 2
18 63 81 33 23 0 0 b 80 2
19 48 95 23 34 0 0 b 94 2
20 27 42 23 105 0 0 d 104 2
21 31 86 32 51 0 0 b 85 2
22 120 27 40 13 0 0 a 119 2
23 59 47 40 54 0 0 b 46 2
24 103 56 23 18 0 0 a 102 2
25 43 39 41 75 0 0 d 74 2
26 41 100 19 39 0 0 b 99 2
27 29 34 98 39 0 0 c 97 2
28 34 59 62 45 0 0 b 59 2
29 33 33 30 104 0 0 d 103 2
30 55 45 35 65 0 0 d 64 2
31 115 40 17 28 0 0 a 114 2
32 48 64 59 30 0 0 c 59 2
33 39 49 76 35 0 0 b 49 2
34 58 37 43 62 0 0 d 61 2
35    62    37   23    78   0   0   d    77   2
36    79    27    28    63   0   0   a    79   2
37 91 68 15 26 0 0 a 90 2
38 35 51 65 49 0 0 c 65 2
39 68 70 20 42 0 0 d 41 2
40 64 69 40 26 0 0 b 68 2
41 70 73 30 26 0 0 b 72 2
42 127 30 27 15 0 0 a 127 2
43 43 38 82 36 0 0 c 89 2
44 28 36 31 103 0 0 d 103 2
45 30 42 80 48 0 0 c 80 2
46 42 101 29 28 0 0 b 101 2
47 49 77 31 43 0 0 b 77 2
48 41 50 34 75 0 0 d 75 2
49 75 69 32 24 0 0 a 75 2
50 41 31 110 18 0 0 c 110 2
51 32 77 51 40 0 0 b 106 2
52 110 27 41 22 0 0 a 78 2
53 38 27 106 29 0 0 c 105 2
54 44 33 45 78 0 0 d 70 2
55 37 107 30 26 0 0 b 98 2
56 54 47 71 28 0 0 c 70 2
57    99    35    41    23   0   0   a    98   2
58   45   39   51   63   0   0   d   63   2
59 14 44 53 89 0 0 d 88 2
60   31   82   34   50   0   0   b   81   2
Traditional item analysis is supposed to be that item analysis which is generally made
for the analysis of the item. This type of item analysis is made at the level of teacher
made test. Every formal teacher must have the concept to check/analyze the item of
the test developed and then administered by the student. This item analysis provides a
claim towards the good item. And a test having a set of good items is considered as a
good test. To test traditionally an item following measures have been taken:
Discrimination index shows the difference between the high achievers and low
achievers towards the perception of an item. The power of getting an item right or
wrong may be depend upon the discrimination power.
For this calculation, we divide the test takers into three groups according to their
scores on the test as a whole: an upper group consisting of the 27% who make the
highest scores, a lower group consisting of the 27% who make the lowest scores, and
a middle group consisting of the remaining 46%. (Note that some text books use 25%,
not 27 %.)
The formulas for finding Discrimination Index is:
                                              NH −NL
                                       D1 =
                                                 n
                                            ad −bc
                            D2 =
                                   √(a+ b)(a+ c)(c +d )(d +b)
Where,
         a= Number of high achievers responded correctly.
         b= number of high achievers responded incorrectly
         c= number of low achievers responded correctly.
         d= number of low achievers responded incorrectly.
All the items were examined under the criteria which is given below.
(moderate)
6. Reliability
it is said to be measure.
Reliability of a test can be measured through reliability coefficient which ranges from
-1.00 to +1.00. The test having the reliability in the same range is supposed to be a
reliable test.
 To find out the reliability the following phases has been passed:
7. PEC Type Report
Distractors A* B C D Missing
     Comment       The item was knowledge based and most of the student          Item Difficulty
        s          attempted it, but only 75% got it right.
  Stem        Which of the following is a division of biology that deal with the study of
    2         plants?
Distractors A* B C D Missing
Comment       The item was Application based and almost every student       Item Difficulty
   s          attempted it, but only 70% got it right.
Item is easy 70
0.70
  Stem        Which of the following sciences studies the biological processes using
    3         mathematical techniques and tools?
Distractors A* B C D Missing
Percentage 7% 79% 7% 5% 0
Comment       The item was comprehension based and almost every             Item Difficulty
   s          student attempted it, but only 79% got it right.
0.79
  Stem        which of the following branch deals with the study of insects?
    4
Distractors A* B C D Missing
Percentage 5 4 71 19 0
Comment       The item was Application based and almost every student         Item Difficulty
   s          attempted it, but only 71% got it right.
0.71
  Stem        Which of the following biological careers uses to enhance livestock and
    5         agricultural crops?
Distractors A* B C D Missing
Percentage 6 63 10 20 0
Comment       The item was Application based and almost every student         Item Difficulty
     s        attempted it, but only 63% got it right.                             63%
  Stem        Groups of similar cells that perform the same duties are referred to as?
    6
Distractors A* B C D Missing
Percentage 9 8 71 12 0
Comment       The item was knowledge based and almost every student           Item Difficulty
   s          attempted it, but only 71% got it right.
0.71
Distractors A* B C D Missing
Percentage 16 14 60 9
Comment       The item was Application based and almost every student         Item Difficulty
   s          attempted it, but only 60% got it right.
                                                                                   60%
             Item difficulty is moderate and should be in the list of
             accepted questions.
0.6
  Stem      Which of the following lists the proper order for the biological method?
   8
            A. Observation, Hypothesis, Law, Theory B. Hypothesis, Observations,
            Deduction, Experimentation C. Observation, Hypothesis, Deduction,
            Experimentation D. Hypothesis, Observation, Deduction, Experimentation
Distracto       A*                 B                   C                D              Missing
   rs
             Observati         Hypothesis,       Observation,      Hypothesis,
                on,
                          observation,Deducti    Hypothesis ,     Observation,
            hypothesis,
               law,                on,            Deduction,
              theory                                               Deduction,
                            Experimentation      Experimentati
                                                                 Experimentati
                                                      on
                                                                        on
Percentag       36        14                          37                12                  0
    e
Commen      The item was knowledge based and almost every student                       Item
  ts        attempted it, but only 36% got it right.                                  Difficulty
-0.36
Distractors A* B C D Missing
Percentage 58 22 11 8 0
Comment       The item was comprehenion based and almost every student       Item Difficulty
   s          attempted it, but only 58% got it right.
0.31
Distractors A* B C D Missing
               A statement    . A well-                 A     .A
              that         substantiated        fundamental hypothesis
              describes a                                     that has
                            explanation          principle of
              natural                                         been
              phenomenon      of some              nature     tested and
                               aspect of the                  confirmed
natural world
Percentage 18 24 27 30 0
Comment       The item was knowledge based based and almost every            Item Difficulty
     s        student attempted it, but only 24% got it right.                     24%
Distractors A* B C D 37Missing
Percentage 37 18 24 20 0
Comment       The item was Application based and almost every student        Item Difficulty
   s          attempted it, but only37% got it right.
-0.37
  Stem        What is the difference between data organization and data analysis?
    12
Distractors A* B C D Missing
Percentage 39 28 24 8 0
              The item was knowledge based and almost every student             Item Difficulty
              attempted it, but only 24% got it right.
-0.24
Distractors A* B C D Missing
Comment       The item was knowledge based and almost every student       Item Difficulty
   s          attempted it, but only 29% got it right.
-0.295
Distractors A* B C D Missing
Percentage 29 53 12 5 0
Comments The item was Application based and almost every                  Item Difficulty
         student attempted it, but only 53% got it right.
                                                                              -0.53
 Stem15       Which of the following is an example of biodiversity?
Distractors A B C D Missing
Percentage 9 71 10 9 0
Comment       The item was Application based and almost every student    Item Difficulty
   s          attempted it, but only 71% got it right.
0.71
Distractors A* B C D Missing
Percentage 32 51 8 8 0
Comment       The item was Application based and almost every student    Item Difficulty
   s          attempted it, but only 51% got it right.
-0.51
Distractors A* B C D Missing
Percentage 40 28 7 24 0
Comment       The item was knowledge almost every student attempted        Item Difficulty
   s          it, but only 40% got it right.
0.4
Distractors A* B C D Missing
                  It         It enhances     It decreases         It
              increases
                             resilience to   competition    decreases
              pollution
                            environmental      amongs            the
                               changes         species      complexity
                                                                  of
Percentage       31               40              16              11                0
Comment       The item was comprehension based and almost every            Item Difficulty
   s          student attempted it, but only 40% got it right.
0.4
Distractors A* B C D Missing
Percentage 24 47 11 17 0
Comment       The item was Analysis based and almost every student         Item Difficulty
   s          attempted it, but only 47% got it right.
0.71
Distractors A* B C D Missing
Percentage 13 21 11 52 0
Comment       The item was Application based and almost every student           Item Difficulty
   s          attempted it, but only 52% got it right.
0.51
Distractors A* B C D Missing
Percentage 15 43 16 25 0
Comment       The item was Application based and almost every student           Item Difficulty
   s          attempted it, but only 43% got it right.
0.4
Distractors A* B C D Missing
Percentage 60 13 20 6 0
Comment       The item was Application based and almost every student         Item Difficulty
   s          attempted it, but only 60% got it right.
-0.60
  Stem         What role did Rudolf Virchow play in the advancement of the cell theory?
    23
Distractors A* B C D Missing
                   He     He provided            . He        He proposed
               discovered
                          evidence to        developed a     that cells are
                 the cell
              membrane, support the              new         not the only
                a barrier
                           concept of         technique      fundamenta
              surrounding
                the cell. bio genesis.          for cell       l units of
                                                division,      life.
                                                known as
                                                mitosis.
Percentage 29 23 20 27 0
Comment       The item was knowledge based and almost every student        Item Difficulty
   s          attempted it, but only 23% got it right.
-0.23
  Stem        . Which of the following cell organelles is responsible for energy production
    24        in eukaryotic cells?
Distractors A* B C D Missing
Percentage 51 28 11 9 0
Comment       The item was Analysis based and almost every student          Item Difficulty
   s          attempted it, but only 51% got it right.
0.51
Percentage 21 19 20 37 0
Comment       The item was knowlege based and almost every student             Item Difficulty
   s          attempted it, but only 20% got it right.
-0.2
  Stem        If a cell lacks ribosomes, what cellular function would be most affeed?
    26
Distractors A* B C D Missing
Percentage 20 50 9 19
Comment       The item was comprehension based and almost every                Item Difficulty
   s          student attempted it, but only 50% got it right.
                                                                                      0.21
  Stem        . Which type of tissues provides support and connects different tissues in
    27        the body?
Distractors A* B C D Missing
Percentage 14 17 49 19
Comment       The item was Application based and almost every student       Item Difficulty
   s          attempted it, but only 49% got it right.
0.09
Distractors A* B C D Missing
Percentage 17 29 31 22
Comment       The item was Application based and almost every student        Item Difficulty
   s          attempted it, but only 29% got it right.
                                                                                  -0.295
  Stem        In which phase of mitosis is nuclear division completed?
    29
Distractors A* B C D Missing
Percentage 16 16 15 52
Comment       The item was knowledge level and 52% students got it        Item Difficulty
   s          right.
0.57
  Stem        Which type of cells are continue dividing throughout an organism’s life?
    30
Distractors A* B C D Missing
Percentage 27 22 17 32
Comment       The item was comprehension based and almost every           Item Difficulty
   s          student attempted it, but only 32% got it right.
Distractors A* B C D Missing
Percentage 57 20 8 14
Comment       The item was knowledge based and almost every student            Item Difficulty
   s          attempted it, but on57% got it right.
              Discrimination index is 0.57 that shows that this item has       Discrimination
                                                                                   Index
              capability to discriminate. This item is acceptable.
0.57
  Stem        During which phase does the cell prepare for division by duplicating its
              organelles?
    32
Distractors A* B C D Missingg
Percentage 24 32 29 15
Comment       The item was comprehension based and almost every                Item Difficulty
     s        student attempted it, but only29% got it right.                  29%
  Stem        If a cell has 16 chromosomes before mitosis, how many chromosomes will
              each daughter cell have after mitosis?
    33
Distractors A* B C D Missing
8 16 32 64
Percentage 19 24 38 15
Comment       The item was Application based and almost every student     Item Difficulty
   s          attempted it, but only 24% got it right.
0.2
Distractors A* B C D Missing
Comment       The item was Application based and almost every student     Item Difficulty
   s          attempted it, but only 31% got it right.
-0.38
Distractors A* B C D Missing
Percentage 31 18 11 39
Comment       The item was knowledgebased and almost every student        Item Difficulty
   s          attempted it, but only 39% got it right.
-0.39
Distractors A* B C D Missing
Percentage 39 13 14 31
Comment       The item was comprehension based and almost every          Item Difficulty
   s          student attempted it, but only 31% got it right.
-0.3
Distractors A* B C D Missing
Percentage 45 35 7 13
Comment       The item was Application based and almost every student    Item Difficulty
   s          attempted it, but only 45% got it right.
                                                                             -0.45
 Stem 38      . What distinguishes enzymes from other biological catalysts?
Distractors A* B C D Missing
Percentage 17 25 32 24
Comment       The item was Application based and almost every student         Item Difficulty
   s          attempted it, but only 25% got it right.
0.71
Distractors A* B C D Missing
                   By            Only by          Through             By
                changing
                                changing          allosteric     modifying
                 genetic
              information       substrate        regulation          cell
                             concentration                        structure
34 35 10 21
                                                                                    DI
                                                                                    0.32
Distractors A* B C D Missing
Percentage 32 34 20 26
DI
-0.445
Distractors A* B C D Missing
Percentage 35 36 15 13 0
                                                                               Discrimination
                                                                                   Index
                                                                                    0.71
 Stem 42      What is the primary pigment involved in capturing light energy during
              photosynthesis?
Distractors A* B C D Missing
Percentage 63 15 13 7
DI
0.24
Distractors A* B C D Missing
Percentage 21 19 41 18
                                                                                      DI
                                                                                    0.4
Distractors A* B C D Missing
Percentage 14 18 15 51
DI
0.21
Distractors A* B C D Missing
reticulum
                                                                                    DI
                                                                                     0.71
Distractors A* B C D Missing
Percentage 21 50 14 14
DI
-0.385
Distractors A* B C D Missing
Percentage 24 38 15 21
-0.375
Distractors A* B C D Missing
Percentage 20 25 17 37
DI
-0.37
Stem 49       . Which type of respiration is more efficient in terms of ATP production per
              glucose molecule
Distractors A* B C D Missing
Percentage 37 34 16 12
DI
0.31
Distractors A* B C D Missing
Percentage 20 15 55 9
              Discrimination index is 0.39 that shows that this item has        55%
              capability to discriminate. This item is acceptable.
                                                                                  DI
0.39
Distractors A* B C D Missing
Percentage        16             38                25                20
              The question was knowledge based.
Comment       Every student attempted it but 38% students got it right.       Item difficulty
   s          The item difficulty is39 i.e. Item is difficult
DI
-0.39
Distractors A* B C D Missing
Percentage 55 13 20 11
Comment       Item is too easy .almost 55% students answer it correctly       Item difficulty
   s
              Discrination index is quit good
                                                                                   55%
DI
0.71
Distractors A* B C D Missing
Percentage 19 13 53 14
Stem 54 . What are the consequences of a poorly functioning gut on overall health
Distractors      A*               B                 C                 D            Missing
              Improved
               immune         Stronger         Enhanced          Nutrient
                system                                           deficiencies
                                bone         energy levels
Percentage 22 16 22 39
DI
-0.35
Distractors A* B C D Missing
Percentage 18 53 15 13
-0.49
Distractor       A*                 B            C                D             Missing
    s
                Right              Right   Left Ventricle     Left Atrium
               Atrium
                              Ventricle
27 23 35 14
              The item was comprehension based and almost not every          Item difficulty
              student attempted it, but only 35% got it right.
              Item is difficult.
                                                                                   DI
              Item as no capability to discriminate
                                                                                 -0.35
Distractors       A*                 B                C                D         Missing
                                             Transportation
                Water   Photosynthesis                           Nutrients
              transport
                                                                absorption
Percentage 49 17 20 11
Comment       Item difficulty is 49% this means that item is moderate and     Item difficulty
   s          can be acceptable
                                                                                    49
DI
                                                                                   -0.49
 Stem 58      Main function of White blood cells in bloodstream.
Distractors A* B C D Missing
Comment       The item was Application based and almost every student           25
   s          attempted it, but only 25% got it right.
Distractors A* B C D Missing
Percentage 7 22 26 44
Comment       The item was Application based and almost every student     Item difficulty
   s          attempted it, but only 44% got it right.
                                                                              -0.44
    Stem 60      Which part of the plant is directly responsible for water absorption.
Distractors A* B C D Missing
Percentage 15 41 17 25
   Comment       The item was Application based and almost every student            Item difficulty
      s          attempted it, but only 41% got it right.
-0.405
    The Rasch model, named after Georg Rasch, is a psychometric model for analyzing
 categorical data, such as answers to questions on a reading assessment or questionnaire
responses, as a function of the trade-off between (a) the respondent's abilities, attitudes or
                          personality traits and (b) the item difficulty.
ICC and PCC
Then I made ICC (Item characteristic curve) and PCC (Person Characteristic curve).
These curves give clear position of item difficulties and position of persons among
these difficulties. Using the formula:
                                               BV − D i
                               P = EXP [                    ¿
                                           1+ exp(Bv − Di )
                                Chart Title
   2
 1.8
 1.6
 1.4
 1.2
   1
 0.8
 0.6
 0.4
 0.2
   0
       0     0.1       0.2       0.3        0.4       0.5       0.6   0.7
                                Series2   Series4
               4. Interpretation ICC Curve
Above graph show that the curve of three groups start from x-axis having initial and
final value. According to series 1,2,3 the lines of three groups having different
response rate low to high or high to low or intermediate depending on your data. As
the curve increases the difficulty index increases or vice versa.
                                      Chart Title
       0.9
       0.8
       0.7
       0.6
       0.5
       0.4
       0.3
       0.2
       0.1
        0
        1.23    1.24   1.25   1.26   1.27   1.28       1.29   1.3   1.31   1.32   1.33
Series2 Series4
The curve of PCC shows them characteristics of person ability to response. The items
of three groups from minimum, maximum and average level of difficulties. The
shows that level from high to low or high to low. As the item increases the person
characteristics decreases or vice versa. So according to the curve response rate of
students are not homogenous or heterogeneous.