{"id":20120,"date":"2020-11-05T12:00:06","date_gmt":"2020-11-05T12:00:06","guid":{"rendered":"https:\/\/ncwit.org?post_type=product&#038;p=20120"},"modified":"2026-09-16T15:18:52","modified_gmt":"2026-09-16T21:18:52","slug":"evaluation","status":"publish","type":"product","link":"https:\/\/ncwit.org\/resource\/evaluation\/","title":{"rendered":"Evaluation Tools"},"content":{"rendered":"<p>NCWIT provides these tools in the hopes that you will find them useful as a starting point for your own evaluations. Along with survey questions, there are interview and observation protocols. Some of the survey instruments have been validated in particular settings, and others just field-tested. Ideally, you will hire a professional evaluator to work with you, but when that is not possible, you can move forward with these tools yourself.<\/p>\n<div id=\"accordion\">\n<h3 data-toggle=\"collapse\"><strong>Why Evaluate?<\/strong><\/h3>\n<div>\n<ul>\n<li><span style=\"font-size: 16px;\"><span style=\"color: #2c3e50;\">To help you <\/span><\/span>assess<span style=\"font-size: 16px;\"><span style=\"color: #2c3e50;\">\u00a0where to put scarce resources<\/span><\/span><\/li>\n<li><span style=\"color: #2c3e50;\"><span style=\"font-size: 16px;\">Answer questions about your particular program or intervention<\/span><\/span><\/li>\n<li><span style=\"color: #2c3e50;\"><span style=\"font-size: 16px;\">To keep track of your inputs and outputs<\/span><\/span><\/li>\n<li><span style=\"color: #2c3e50;\"><span style=\"font-size: 16px;\">To improve what you are doing<\/span><\/span><\/li>\n<li><span style=\"color: #2c3e50;\"><span style=\"font-size: 16px;\">To find out if you are achieving your goals<\/span><\/span><\/li>\n<li><span style=\"color: #2c3e50;\"><span style=\"font-size: 16px;\">To justify your activities to others<\/span><\/span><\/li>\n<li><span style=\"color: #2c3e50;\"><span style=\"font-size: 16px;\">To secure funding<\/span><\/span><\/li>\n<\/ul>\n<\/div>\n<h3><strong>Evaluation Tools You Can Use<\/strong><\/h3>\n<div>\n<ul>\n<li><span style=\"font-size: 16px;\"><span style=\"color: #2c3e50;\">NCWIT\u2019s <\/span><a href=\"https:\/\/ncwit.org\/evaluation-tools\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\"><strong>evaluation tools<\/strong><\/span><\/a><span style=\"color: #2c3e50;\"> contain customizable tools for many different audiences and contexts.<\/span><\/span><\/li>\n<li><span style=\"color: #2c3e50;\"><span style=\"font-size: 16px;\">Surveys, Interview Guides, Observation Protocols, Worksheets, Self-Reports<\/span><\/span><\/li>\n<\/ul>\n<\/div>\n<h3><strong>How Should I Collect Demographic Data?<\/strong><\/h3>\n<div>\n<ul>\n<li><span style=\"font-size: 16px;\"><span style=\"color: #2c3e50;\">Use this <\/span><a href=\"https:\/\/docs.google.com\/document\/d\/1E_CSANwOqbKjEG27woNbGZ09JIXUfAf4Cp9j8g5DFak\/edit?usp=sharing\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\"><strong>Guide to demographic data<\/strong><\/span><\/a><span style=\"color: #2c3e50;\"> for important considerations and sample questions.<\/span><\/span><\/li>\n<\/ul>\n<\/div>\n<h3><strong>How Do I Analyze the Data?<\/strong><\/h3>\n<div>\n<ul>\n<li><span style=\"font-size: 16px;\"><span style=\"color: #2c3e50;\">For help analyzing survey data, see <\/span><span style=\"color: #2c3e50;\">the Student Experience of the Major\u00a0<\/span><a href=\"https:\/\/ncwit.org\/resource\/sem\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\"><strong>Program-in-a-Box<\/strong><\/span><\/a><\/span><\/li>\n<li><span style=\"font-size: 16px;\"><span style=\"color: #2c3e50;\">For analyzing qualitative data, we recommend using Excel if you only have open-ended questions on a survey. If you have interview or observation data, then use a qualitative data analysis software program such as <\/span><a href=\"https:\/\/www.dedoose.com\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\"><strong>Dedoose<\/strong><\/span><\/a><span style=\"color: #2c3e50;\">\u00a0or <\/span><a href=\"https:\/\/www.qsrinternational.com\/nvivo-qualitative-data-analysis-software\/home\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\"><strong>NVivo<\/strong><\/span><\/a><span style=\"color: #2c3e50;\">. If you are at a college or university, they may have a site license program you can take advantage of for free or at reduced cost.<\/span><\/span><\/li>\n<\/ul>\n<\/div>\n<h3><strong>General Tips<\/strong><\/h3>\n<div>\n<ul>\n<li><strong><span style=\"font-size: 16px;\"><a href=\"https:\/\/docs.google.com\/document\/d\/1urMSlNvOwgy07ALbB0znnSOQ_htRg6HYrBJovwx9rVs\/edit#heading=h.tos16dx07yp2\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\">Tips for Survey Construction and Administration<\/span><\/a><\/span><\/strong><\/li>\n<li><span style=\"font-size: 16px;\"><span style=\"color: #2c3e50;\">You can upload questions from a <\/span><strong><a href=\"https:\/\/help.surveymonkey.com\/articles\/en_US\/kb\/Copy-Paste-Questions\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\">.docx<\/span><\/a><\/strong><span style=\"color: #2c3e50;\">\u00a0or <\/span><a href=\"https:\/\/help.surveymonkey.com\/articles\/en_US\/kb\/Can-I-upload-a-survey-created-in-another-file-or-import-responses\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\"><strong>Google Form<\/strong><\/span><\/a><span style=\"color: #2c3e50;\"> to Survey Monkey, or a .doc or .txt on <\/span><strong><a href=\"https:\/\/www.qualtrics.com\/support\/survey-platform\/survey-module\/survey-tools\/import-and-export-surveys\/#ImportTXTDoc\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\">Qualtrics<\/span><\/a><\/strong><\/span><\/li>\n<li><span style=\"font-size: 16px;\"><span style=\"color: #2c3e50;\">If you do not have access to Survey Monkey or Qualtrics, you could use <\/span><a href=\"https:\/\/www.google.com\/forms\/about\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\"><strong>Google Forms<\/strong><\/span><\/a><span style=\"color: #2c3e50;\">. Doing so means your data will be available to you through Google Sheets, which you can export into Excel as needed.<\/span><\/span><\/li>\n<li><span style=\"font-size: 16px;\"><span style=\"color: #2c3e50;\">While every institution (and funder) differs, you should determine if you need Institutional Review Board (IRB) approval before conducting your study. Typically, evaluations do not need IRB approval because they are not intended to produce findings that would generalize to a population. NCWIT\u2019s home institution, the University of Colorado at Boulder, provides this <\/span><a href=\"https:\/\/www.colorado.edu\/researchinnovation\/irb\/getting-started\/does-my-research-require-irb-review\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\"><strong>decision tool<\/strong><\/span><\/a><span style=\"color: #2c3e50;\"> for CU-Boulder researchers. Your institution may have different considerations.\u00a0<\/span><\/span><\/li>\n<li><span style=\"font-size: 16px;\"><span style=\"color: #2c3e50;\">Explore <\/span><a href=\"https:\/\/docs.google.com\/document\/d\/1SfboOcjtwiKdDQbxL3U0C0_06drZ-vyMM3SW6daDrD0\/edit\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #1696ad;\"><strong>non-NCWIT Survey &amp; Evaluation Resources<\/strong><\/span><\/a><span style=\"color: #2c3e50;\">.\u00a0<\/span><\/span><\/li>\n<\/ul>\n<\/div>\n<\/div>\n<p>&nbsp;<\/p>\n<p><em>This project was supported by the National Science Foundation (NSF) under CNS 0813956. Any recommendations expressed in this toolset are those of the authors and do not necessarily reflect the views of the NSF.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>NCWIT provides these tools in the hopes that you will find them useful as a starting point for your own evaluations. Along with survey questions, there are interview and observation [&hellip;]<\/p>\n","protected":false},"featured_media":20129,"template":"","meta":{"_acf_changed":false,"rs_blank_template":"","rs_page_bg_color":"","slide_template_v7":"","_uag_custom_page_level_css":"","site-sidebar-layout":"default","site-content-layout":"default","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"default","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"resource-formats":[],"resource-topics":[511,508],"system-model":[],"media-tags":[],"product_brand":[],"class_list":["post-20120","product","type-product","status-publish","has-post-thumbnail","language-english","family-toolkit","collection-thankyou-aa","collection-thankyou-k12","collection-thankyou-wa","collection-tij-evaluation","resource-topics-evaluation","resource-topics-getting-started","audience-higher-education","audience-k-12","audience-school-counselors-advisors","audience-stem-educators","audience-workforce","desktop-align-left","tablet-align-left","mobile-align-left","ast-product-gallery-layout-horizontal","ast-product-gallery-with-no-image","ast-magnify-disabled","ast-product-tabs-layout-horizontal","first","instock","virtual","product-type-simple","add-to-wishlist-after_add_to_cart"],"acf":[],"uagb_featured_image_src":{"full":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"thumbnail":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1-150x150.png",150,150,true],"medium":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"medium_large":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"large":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"1536x1536":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"2048x2048":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"ultp_layout_landscape_large":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"ultp_layout_landscape":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"ultp_layout_portrait":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"ultp_layout_square":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"woocommerce_thumbnail":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"woocommerce_single":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1.png",240,240,false],"woocommerce_gallery_thumbnail":["https:\/\/wpassets.ncwit.org\/wp-content\/uploads\/2021\/05\/25211741\/evaluationtool_module_draft1-100x100.png",100,100,true]},"uagb_author_info":{"display_name":"tim.faiella@ncwit.org","author_link":"https:\/\/ncwit.org\/author\/"},"uagb_comment_info":0,"uagb_excerpt":"NCWIT provides these tools in the hopes that you will find them useful as a starting point for your own evaluations. Along with survey questions, there are interview and observation [&hellip;]","meta_box":[],"_links":{"self":[{"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/product\/20120","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/product"}],"about":[{"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/types\/product"}],"version-history":[{"count":2,"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/product\/20120\/revisions"}],"predecessor-version":[{"id":30981,"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/product\/20120\/revisions\/30981"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/media\/20129"}],"wp:attachment":[{"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/media?parent=20120"}],"wp:term":[{"taxonomy":"resource-formats","embeddable":true,"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/resource-formats?post=20120"},{"taxonomy":"resource-topics","embeddable":true,"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/resource-topics?post=20120"},{"taxonomy":"system-model","embeddable":true,"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/system-model?post=20120"},{"taxonomy":"media-tags","embeddable":true,"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/media-tags?post=20120"},{"taxonomy":"product_brand","embeddable":true,"href":"https:\/\/ncwit.org\/wp-json\/wp\/v2\/product_brand?post=20120"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}