The survey process can be broken down into three major steps: design, collection, and analysis.
The design phase involves the actual writing of the survey. First and foremost, a survey needs to be clear: use plain language and simple sentences to reduce the chance for confusion. Experience also has taught that multiple-choice questions with preset answers (e.g., yes or no and multipoint scales, such as big problem, problem, and not a problem ) are more useful than questions that invite open-ended responses (such as in your own words and describe what you think about ). Preset answers are easier to use to code responses and analyze data, and people seem to prefer multiple-choice questions to help organize their thoughts.
The nature of a survey also depends on available resources. Staff size, time, money, and survey expertise determine whether a survey:
Regardless of the method used, a survey should be simple and short. Remember that you are asking citizens to volunteer time; do not keep them any longer than absolutely necessary or you may cause resentment. Some surveyors conduct a survey test run with a few community members and then ask for their feedback. Sample feedback questions include the following:
Types of Questions
In general, community justice planners rely on three types of questions:
Planners can get ideas for questions by looking at other surveys, including the National Crime Victimization Surveya telephone survey conducted by the Bureau of Justice Statistics (for more information, visit www.ojp.usdoj.gov/bjs/cvict.htm)and the Red Hook survey (see appendix A). In addition, the U.S. Department of Justices Weed and Seed national evaluation includes a survey that measures community perceptions of neighborhoods, public safety, and the criminal justice system.
There are many different ways to administer a survey. The Denver district attorneys community prosecution program sponsored a survey in which teenagers who were members of a special youth empowerment team asked 225 of their peers about things they liked and disliked in their neighborhood. In West Palm Beach, Florida, community court planners adapted the Red Hook survey to meet their communitys needssending staff to conduct 60 interviews among targeted residences and businesses in the catchment area and repeating the survey every year to track changes over time. Others partner with local universities: Memphis Community Court contacted the University of Memphis Department of Criminology and Criminal Justice, which used graduate assistants to conduct both phone and in-person surveys during the course of a semester. Some hire outside consultants: Vermonts Department of Corrections hired a private market research firm to conduct a statewide telephone survey about the department and its proposed reparative probation program. Similarly, the community court project in Minneapolis hired a local survey research firm to do a targeted telephone survey within the courts catchment area. The survey asked residents about their knowledge and opinion of the project and its various components (e.g., community service, job training, and drug treatment).
Whether the survey relies on volunteers or paid professionals, everyone conducting the survey should receive basic training that covers how to ask the questions, fill out the survey form, and make the experience pleasant and productive. The goal of training is to make surveyors comfortable with the forms and the target area. For example, some volunteers may be nervous about asking questions and bothering people. More experienced surveyors may be anxious about going into a new neighborhood, especially if certain areas seem dangerous. Training can include role plays of different situations, discussions about safety precautions, and practice runs of the survey to allay these concerns.
Community members make the best survey volunteers. In Red Hook, citizens were more willing to stop and take time to answer questions if the surveyor was also from the neighborhood. In this way, Red Hook volunteers were able to break down a traditional barrier that stands between surveyors and participants and foster the trust needed to engage participants. The majority of the times, people come to the door and know me. They say, Oh its you, Natasha, Ill do your survey, said Natasha Richie, a Red Hook surveyor. They feel better and more secure in talking to me.
A successful survey also needs a clear target area. This can be a geographic boundary or a demographic group, such as teenagers, the elderly, single parents, or other groups. In Red Hook, the target area is clearly defined by an elevated highway that physically divides the neighborhood from the rest of Brooklyn. This target area is subdivided into different geographic zones, and surveyors are assigned to each zone and work together to ensure adequate coverage of their area. Similarly, West Palm Beach divided its catchment area into six subareas and completed 10 surveys from each area to ensure a representative sample.
The extent to which planners can use survey results depends in large part on their ability to analyze the data. Some projects have turned to expertsa graduate student familiar with statistical research or a local college professor. This document does not detail how to analyze data. Instead, here are a few pointers.