Applied Research & Evaluation
We help develop campus and community programs and foster connections between Duke and the broader community through responsive and actionable research and evaluation.
SSRI provides evaluation services and learning opportunities to meet an increasing demand for evaluation at the university and in the broader community. We partner both with Duke and community entities to better understand program outcomes and improve program processes.
We foster these partnerships through various means, including serving directly as an evaluation partner for external entities, integrating evaluation into research projects, and prompting Duke/community connection through evaluation – for instance, by performing community needs assessments that lead to university-based research. We also engage Duke learners through direct community project involvement, workshops, and educational modules on evaluation.
Our efforts advance Duke programming, inform community-based programming, and further Duke’s mission of knowledge in the service of society.
From informing program development to communicating program outcomes to stakeholders, our staff have expertise in evaluation and related areas of program development that can help your program from day one.
We provide an array of evaluation services and other assistance around program development and capacity-building.
Our work includes:
- Overall strategic planning
- Logic modeling, theory of change development, and other aspects of outcome mapping
- Evaluation design and planning
- Data collection and analysis, both qualitative and quantitative
- Accessible reporting that focuses on program successes and avenues for continued program improvement, and
- Developing evaluation language for finding requests.
We provide discrete services and reporting needs, but we are especially invested in building long-term collaborative partnerships that help develop program models and establish evaluation data that promotes program advancement.
We provide evaluation and program development to two types of partners:
- Community-based programs related to education and human development, including nonprofit and public entities, and
- Duke-based programs, including student programming, faculty development, and more.
Bass Connections provides both graduate and undergraduate students with greater exposure to inquiry across disciplines, partnership with unlikely fellow thinkers, sustained mentorship in teams, and the chance to experience the intersections of the academy and the broader world. Since the program’s inception, SSRI has worked with Bass Connections not only as a hub for the EHD theme, but also as an evaluator for the program. The first two years of the program were focused on developmental evaluation, helping to guide the growth and direction of the program. In year three and beyond, SSRI has turned the evaluation to incorporate an increased focus on program outcomes.
The Duke University School of Medicine and North Carolina Central University (NCCU) are recipients of a National Institute of Child Health and Human Development (NICHD) Building Interdisciplinary Research Careers in Women’s Health (BIRCWH) grant. The program provides research development support to pursue research careers related to women's health and builds upon existing interdisciplinary faculty relationships to foster productive and innovative collaborations. SSRI has partnered with BIRCWH to evaluate program processes and outcomes for participating early-career faculty. This project has included an array of evaluation activities, ranging from logic model development, evaluation design, and quantitative and qualitative instrument design, data collection, and analysis. Findings are now informing program development and continued funding requests, and they are being communicated to BIRCWH programs at other institutions.
Duke TeachHouse is a living and learning community for early-career teachers. The program focuses on equipping early career educators with the confidence, competence, knowledge, and networks necessary to develop leadership, creative problem solving, and innovation skills. SSRI is working with the program to develop an evaluation model and inform early program development. Over the program's inaugural year, SSRI has worked with TeachHouse leadership in developing a comprehensive and concise mission statement, developing a program logic model, and administering pilot data collection with program participants and a comparison group to better understand the ways in which TeachHouse can provide needed support.
Building Lakewood’s Academic Success Together (BLAST) emerged in 2014 as a partnership between Lakewood Elementary School (LES) and three Duke entities: SSRI, the Office of Durham and Regional Affairs, and the Program in Education. Researchers in the BLAST partnership conducted the needs assessment in the spring of 2015, gathering data on LES strengths, challenges, and opportunities in interviews and focus groups with LES stakeholders. Participants included 24 instructional personnel (teachers and teacher assistants), 11 parents, 3 LES administrators, and 4 community partners. Data were transcribed, coded and analyzed, and the Duke research team shared findings with the LES principal and School Improvement Team in the fall of 2015. The report identified areas that can be addressed through a faculty-run Bass Connections research project and SSRI is supporting the development of this research team.
The Partnership for Appalachian Girls’ Education (PAGE) seeks to inspire and empower underserved rural girls through education. PAGE offers innovative learning opportunities for girls in grades 6-9, a mentoring program for 9th-grade girls, and high school internships for rural girls with college aspirations. PAGE serves girls in Madison County, North Carolina, in the heart of the Blue Ridge Mountains. SSRI has partnered with PAGE to help clarify and visually convey the program model, delineate key proximal and distal outcomes, develop original data collection tools, and analyze school administrative data to help assess the impact of PAGE programming.
We have expertise in data issues throughout the research life-cycle and can provide assistance on an array of topics, including project planning, data collection and measurement, data management, documentation, and analysis.
WE SUPPORT RESEARCH IN A VARIETY OF WAYS:
DATA MANAGEMENT AND DOCUMENTATION
We provide expertise in data management and analysis by partnering with research projects, either on an ongoing basis or to support a specific, short-term task. We can help you create data plans, assess your data management needs, and identify data management solutions. We are also available to recommend best practices for keeping your data usable, now and into the future.
We provide consultation and assistance with data management including, but not limited to, merging data sets, performing de-identification and deductive disclosure risk assessment, creating data documentation, and creating scales and subscales.
We also consult and develop codebooks, data dictionaries, metadata, and other documentation necessary to understand data variables and constructed variables as well as the research study process.
Need help conducting data analysis or want to discuss writing data analysis plans?
Our staff can help operationalize research questions into testable models. We have knowledge in model development, statistical procedures such as frequencies, crosstabs, and regressions as well as social network analysis (SNA), structural equation modeling (SEM), and multilevel modeling (MLM). We can also help with problems using statistical software, including SPSS, SAS, and R.
PROJECT START UP AND DATA COLLECTION
If you have received funding for a new project, but are not sure where to start, our staff can help get you up and running.
We can help with thinking about what data is to be collected and issues to consider when preparing to collect, manage, and analyze data, including determining roles and responsibilities within the project. This includes components of data management plans, but also broader concerns of data sharing and reuse.
We also support data collection through measurement development and refinement. We have expertise in survey design and statistical analysis of data to determine measurement effectiveness.
DATA TRAINING & EDUCATION
Join us for our workshops on different aspects of the data management process. We present ongoing workshops at SSRI offering overviews of different aspects of the data management process. Slides from our data workshops are available in the workshop descriptions.
SAS FOR DATA MANAGEMENT
This three-session workshop offers an overview of the SAS programming language, focusing on data management activities.
Session 1 is a general overview of SAS with a focus on major SAS components (Program Editor, Log and Output), core concepts of SAS programming (DATA and PROC), and issues of importing/exporting, reading, and writing SAS data sets.
Session 2 focuses on data modification, including variable creation and variable recoding, as well as adding to and subsettting from particular data sets. Key SAS statements described include ATTRIB, SET, WHERE, IF-THEN, MERGE.
Session 3 focuses on data analysis, specifically descriptive analyses typically used in data management. Key SAS statements described include PROC CONTENTS, PROC MEANS, and PROC FREQ.
We have worked with the American Association of Gifted Children (AAGC) and the North Carolina Department of Instruction on archiving the data collected for the Bright Idea II project (2004–2009). Funded by the U.S. Department of Education, its goals were to help nurture and develop the interest and abilities of young children in underrepresented groups and to help these groups to become eligible for gifted programs in the school. This project includes data at several different levels — student, teacher, school, and district. The student data includes approximately 8,000 students from 28 schools in 11 districts. The completed project includes two data sets that can be linked or used independently, one on teacher data and one on student data.
A long-standing partnership between the Vice Provost for Academic Affairs, the Center for Instructional Technology, and SSRI focuses on data management and analysis of the Coursera data at Duke. Since 2012, Duke has conducted 74 session-based courses, representing 29 unique course areas. Across these 74 classes, over 3 million people have enrolled in courses and 76,913 have completed these classes. In 2015, Coursera shifted from a session-based fixed term course schedule to an on-demand platform, with 25 courses offered. Across this set of courses, over 500,000 have registered and 17,000 have completed. SSRI has played an integral role in the Coursera leadership at Duke, sitting on the Faculty Online Assessment Committee and presenting Coursera results to key constituents throughout the University.
During the summer of 2015, we partnered with Data+ to have an undergraduate student team focusing on Coursera data and the feasibility of making the data widely available for a DataFest. We supported the project through defining the project domains, handling the day-to-day mentoring and coaching of the undergraduate students, and assisting with products for the program including a final poster presentation and several other formal presentations. \
Avshalom Caspi & Terrie Moffitt’s research team deposited the Environmental-Risk (E-Risk) Longitudinal Twin Study research data with SSRI in 2015 in order to allow Duke researchers to use the data securely. These two Duke researchers, along with a researcher in the United Kingdom, Louise Arseneault, developed the E-Risk study in the 1990s to build knowledge about children’s behavioral development and mental health. Our staff supported the sharing of this data and spearheaded the creation of a request for projects that will conduct secondary analyses using the E-Risk Longitudinal Study data.
We have worked with Duke’s Global Education Office for Undergraduates (GEO) on analyzing their current student survey, with an eye toward improving future assessments. GEO collected student exit surveys from Duke undergraduates who attended any global education program between Fall 2011 and Spring 2014 and from undergraduates at other colleges and universities who had attended a Duke study-abroad program during the same time frame. Almost 2,000 students completed the survey. SSRI provided assistance in managing and analyzing the data that GEO had collected in a Qualtrics survey. This included importing the data into SAS, performing data cleaning tasks, coding program elements, and creating de-identified data sets for future use. We also created codebooks for each survey. Data analysis included basic descriptive analyses, focusing on elements that could be changed or improved in the current assessment. We provided GEO staff with a report of our findings and gave a presentation to the staff on our work with action points for future assessments.
Voices Together completed a two-year music therapy program with young adults living with autism in 2015, funded by the Ireland Family Foundation. An evaluation was conducted to determine if and how the program was effective in this population and included demographic information, behavioral coding of program sessions, behavioral assessments using standardized instruments, and behavior ratings by job supervisors. We supported this project by constructing an analysis plan, implementing the analysis, interpreting the results, and writing the evaluation analysis with the input and support of program leaders.
The Resilience Project is a collaboration between four colleges and universities in North and South Carolina that seeks to understand the sources of stress and anxiety for incoming college students as well as factors that help students to thrive despite adversity. Students at Duke University, Davidson College, Furman University, and Johnson C. Smith University are asked to share information on a variety of topics relevant to college life, including social interactions, physical and mental health, well-being and academics. The information gained through this process will be used to design interventions at each campus aimed at enhancing students’ resiliency. SSRI provides assistance in managing sensitive data that is collected by the Resilience Project, including tasks like importing data, performing initial data cleaning tasks, and creating de-identified data sets. We provide expertise on creating data documentation and setting up file structures and permissions, and we facilitate communication between the project team and SSRI IT regarding technical aspects of the Protected Research Data Network (PRDN).
Science and Society initiated a faculty fellowship in 2014 focused on science communication. During the semester-long program, faculty learn how to communicate about their research and influence decision-making on key issues. In support of this project, we constructed a coding framework for the pre- and post- video interviews of faculty participants with consultation from program leaders. The coding framework included micro codes which were assessed for every question and macro codes that were assessed across all of the questions overall. Once the framework was agreed upon, we implemented video coding of the taped interviews, analysis, and interpretation of the codes. Upon completion of the analysis, we created a report and presented it to our partners.