Common Methods for Collecting Data

Developing a Questionnaire

• Questionnaire Design (43 slides, 1192 KB) - This PowerPoint covers all aspects of questionnaire design including types of questions, response options and scales, layout and design and pilot testing.  There are many examples of common errors we make in wording questions with suggestions for improvements. 
• Asking Questions with a Purpose (20 pages, 185 KB) - This guide covers key aspects of developing a questionnaire including types of questions, question wording, formatting and pre-testing your questionnaire.
• End-of-Session Questionnaires (71 pages, 175 KB) - This guide explains the purpose and use of end-of-session feedback forms with many sample questions to ask about (1) participation reactions; (2) teaching and facilitation; (3) outcomes; (4) future programming; and (5) participant background.
• Checklist: Avoiding Common Problems in Question Wording (1 page, 69 KB) - Use this checklist to remember the various common errors in wording of questions.
• Pilot Test Your Questionnaire (1 page, 91 KB) - Use this Quick Tip of key points and tips as you pilot test your questionnaire. 
• Ways to word answer choices in questionnaires (2 pages,  44 KB) - This two-page Quick Tip describes the three types of response choices for your questions with examples of each and things to consider. 
• Wording for rating scales (2 page, 29 KB) - A two-page Quick Tip that covers common issues when creating your response scale:  length of the scale; odd or even scale; labeling points; balanced scales; whether to use a midpoint, and matching response to the question and consistency.
• What is sampling bias? (1 page, 33 KB) - A quick explanation of sampling bias and why we should care.
• Data Guru - Survey Response Options - Link to this external site for more examples of  3-point, 4-point, 5-point and 7-point scales.

Focus Groups

• Focus Groups (25 slides, 953 KB) - What makes a focus group a focus group and how do you conduct one?  This PowerPoint answers these questions and others such as who participates, how many groups  you need and reviews common tips and traps. 
• Focus Group Interviews (2 pages, 18 KB) - This two-page Quick Tip summarizes the core aspects of conducting a focus group, from UW-Extension Program Development and Evaluation.
• Focus Group Interviewing - Link to this external web site by Richard Krueger, Program Evaluation Leader, University of Minnesota Extension, that includes steps in focus group interviewing and helpful handouts.
• Sample Protocols and Tools
  • Focus Group Protocol (4 pages, 156 KB) - Sample protocol with questions used in the Arts and Communication evaluation.
  • Samples from Ellen Andrew’s Service Project evaluation, Outagamie County.
    • Adult Questions (2 pages, 22 KB)
    • Youth Questions (2 pages, 22 KB)
    • Letter to Participants (1 page, 17 KB)
  • Sample protocol from a neighborhood center needs identification process. (2 pages, 14 KB)
• Using Focus Groups to Evaluate Youth Development Program Direction http://www.joe.org/joe/2008december/rb3.php - Link to this article in the Journal of Extension for an example from Oregon 4-H youth development.  

Surveys

• Surveys (30 slides, 1162KB) - Surveys are a popular way to collect evaluation information.  This PowerPoint covers the pros and cons of surveys, types of surveys and which to choose, steps in planning a survey, response rate, writing a good cover letter and pilot testing.
• Response Rate in Surveys (20 slides, 972 KB) - A high response rate means we can have greater confidence in our results.  Review this PowerPoint to better understand why a high response rate is important, how we can increase our response rates and what to do when the response rate is low. 
• Online Surveys ( 24 slides, 2162 KB) - Internet surveys have become so popular.  But, is it the right method to choose?  The PowerPoint covers all the main points to consider when thinking about and implementing an online survey.
• Collecting Evaluation Data: Surveys (27 pages, 153 KB) - Guide from the UW-Extension Program Development and Evaluation web site covering different types of surveys, planning and conducting a survey with example notice letter, cover letter and follow-up post card and sample telephone survey introduction and call log.
• Quick Tips of Interest from UW-Extension Program Development and Evaluation
  • Survey Procedures (2 pages, 20 KB)
  • How to Get a Respectable Response Rate (1 page, 46 KB)
  • What You Should Do if You Haven't Gotten a Respectable Response Rate (1 page, 14 KB)
• Visit the Sample Evaluation Instruments page for examples of different types of surveys.
• Sample Cover Letters and Follow-up Requests
  • Follow-up Postcard (1 page, 189 KB) - Example postcard as follow-up request to complete an online survey.
  • Web Survey Invitation (2 pages, 17 KB) - Prepared by Ellen Andrews, 4-H Youth Development Educator.
  • Follow Up Survey Invitation (1 page, 27 KB) - Prepared by Penny Tank, 4-H Youth Development Educator.
  • Survey Invitation (1 page, 78 KB) - Prepared by Jessica Jens, 4-H Youth Development Educator.
• On-line Surveys – help available from CE Tech Services for UW-Extension staff in developing a Zoomerang survey.
• Retrospective Post-then-Pre Design Quick Tips by UW-Extension Program Development and Evaluation
• Using the Retrospective Post-then-Pre Design (2 pages, 173 KB)
• Designing a Retrospective Post-then-Pre Question (2 pages, 179 KB)
• When to Use the Retrospective Post-then-Pre Design (1 page, 174 KB)
• Analysis of Retrospective Post-then-Pre Data (2 pages, 163 KB)

Interviews

• Interviews (29 slides, 657 KB  ) - This PowerPoint covers types of interviews, group and individual interviewing, steps to take when planning to interview; probing questions,  analyzing interview data, and a few tips for best practice. 
• Evaluation Examples - Provides samples for review.
• Conducting In-depth Interviews (16 pages, 152 KB) - Practical guide from Pathfinder International with tips and examples.
• Probing Questions in Interviews (1 page, 33 KB) - An UW-Extension Program Development and Evaluation Quick Tip.

Observation

• Observation (21 slides, 2133KB) - This PowerPoint includes ideas and steps for using observation to collect evaluation data:  when you might use observation, ways to observe,  how to record your observations, sample recording forms and some practice activities. 
• Collecting Evaluation Data: Direct Observation (8 pages, 174 KB) - Guide from the UW-Extension Program Development and Evaluation web site on how to use observation with tips and example observation forms.
  • Observation Data Collection Sheet (2 pages, 85 KB) - Observation sheet for Table Hosts, prepared by Paula Huff and Dawn Kuelz, 4-H Youth Development Educators.
  • Observation Sheet for Boomerang Team Teachers (1 page, 15KB) - Prepared by Kevin Palmer, 4-H Youth Development Educator and Faye Malek, Family Living Educator.

Creative Methods

• Creative Methods (35 slides, 3108 KB) - If the common methods of data collection seem boring or not appropriate, try something different.  This Power Point includes a range of alternative ways to collect data from creatively using existing records and forms, games, photography,  drawing, storyboards, journaling, group techniques, action cards, etc.  Let your mind soar but think about how you will analyze the data you collect.
• Other Ways to Collect Evaluation Data (3 pages, 175 KB) - Additional explanation and ideas for using creative expression, personal stories and testimonials, videos and photography, expert review, diaries and journals, logs and case studies.
Top