Loading...
HomeMy WebLinkAbout20043396.tiff RESOLUTION RE: APPROVE PROPOSAL FOR EVALUATION PLAN FOR YEAR TWO OF STEPS PROGRAM AND AUTHORIZE CHAIR TO SIGN - JSI RESEARCH AND TRAINING INSTITUTE WHEREAS, the Board of County Commissioners of Weld County, Colorado, pursuant to Colorado statute and the Weld County Home Rule Charter, is vested with the authority of administering the affairs of Weld County, Colorado, and WHEREAS,the Board has been presented with a Proposal for Evaluation Plan for Year Two of STEPS Program between the County of Weld, State of Colorado, by and through the Board of County Commissioners of Weld County,on behalf of the Weld County Department of Public Health and Environment, and JSI Research and Training Institute, commencing upon full execution, and ending September 21,2005,with further terms and conditions being as stated in said proposal,and WHEREAS,after review,the Board deems it advisable to approve said proposal,a copy of which is attached hereto and incorporated herein by reference. NOW,THEREFORE, BE IT RESOLVED by the Board of County Commissioners of Weld County,Colorado,that the Proposal for Evaluation Plan for Year Two of STEPS Program between the County of Weld,State of Colorado, by and through the Board of County Commissioners of Weld County, on behalf of the Weld County Department of Public Health and Environment, and JSI Research and Training Institute be, and hereby is, approved. BE IT FURTHER RESOLVED by the Board that the Chair be, and hereby is, authorized to sign said proposal. The above and foregoing Resolution was,on motion duly made and seconded,adopted by the following vote on the 24th day of November, A.D., 2004. BOARD OF COUNTY COMMISSIONERS W D COLMTY, COLORADO flh " `/ L4 Robert D. Masden, Chair 1861 , 'CV my Clerk to the Board / O, r ''' : William H. e, Pro-Tem ��� i_'--- eputy Clerk to the Board — ,e�� M. J. eile AP O D AS TO EXCUSED David E. Long ounty Attor ey EXCUSED Glenn Vaad Date of signature: A -- •-",/ 2004-3396 HL0031 CSC" : Ht_( a8H) 1Q_ o4 -oz{ Memorandum TO: Robert D. Masden, Chair Board of County Commissioners ' FROM: Mark E. Wallace, MD, MPH, Director O Department of Public Health and Environment /IN, , ,Ati\COLORADO DATE: November 18,2004 SUBJECT: Proposal from JSI Research and Training Institute for Program Evaluation Services Enclosed for Board review and approval is a proposal by JSI Research and Training Institute, a program evaluation company, to provide assistance in evaluating the Steps to a Healthier US Program which is working to prevent and reduce the burden of Diabetes, Asthma and Overweight/Obesity in Weld County. As part of the Steps to a Healthier US Grant awarded to the Weld County Department of Public Health and Environment (WCDPHE), the program is required to incorporate evaluation services each year to determine the effectiveness of the program. We believe JSI will make an ideal partner for this effort. The agency has a past working history with WCDPHE along with other local community partners in evaluating health related projects and programs to determine program effectiveness. The term of services provided under this proposal, assuming it is approved, will be effective upon approval and continue through the second year of the Steps funding which ends on September 21, 2005 after which a new proposal to evaluate the Steps Program for year three will again be required. The submitted budget of$24,995.50 is the projected amount required by JSI to effectively evaluate the Steps Program. I recommend your approval. Enclosure 2004-3396 JSI Research &Training Institute 1860 Blake Street 303-262-4300 Voice Suite 320 303-262-4395 Fax Denver,Colorado 80202 denver©jsi.com Email Elltqatt November 3, 2004 Mark E. Wallace, MD, MPH, Director Weld County Department of Public Health and Environment 1555 N. 17th Avenue Greeley, CO 80631 Please find enclosed our proposal to Weld County Department of Public Health and Environment to conduct an evaluation of the Steps to a Healthier US Program. The anticipated cost of the evaluation as outlined in the enclosed proposal is $24,995.50 This includes consulting expenses as well as any travel expenses incurred. JSI will invoice the Weld County Department of Public Health and Environment Steps to a Healthier US Program for services completed both at mid point in the contract period and at the completion or end of the contract period following the completion of agreed upon services. If this proposal is acceptable please sign and return this letter. Thank you. Sincerely, v e Hamby Mark E. Wallace, MD, MPH, Director Proje Director Weld County Department of Public JSI Research & Training Institute Health & Environment Cb:Wiza, NOV 242004 Chairman, Board oof�C/ouunnttyy Commissioners p ATTEST: J�� tede ��%/l/ / q WELD UNTY CLER T HE D � BY: ' A F DEPUTY E K TO THE BOA 1 c2Oc -.339 JSI Evaluation Plan for Year Two: Weld County STEPS to a Healthier US Program JSI Research & Training Institute, Inc. (JSI) will conduct a comprehensive evaluation of the Weld County STEPS to a Healthier US Program by bringing together well qualified staff from its Denver office. JSI will provide an evaluation including a process, implementation and an outcome evaluation focus. Our belief is that an evaluation effort should contribute to the probability of success of each of the program components. This support for program components can best take place when the evaluator is seen as an expert technical advisor who is bringing information and ideas that chart progress and show the way to increased effectiveness. The evaluation will include an emphasis on both documenting the quantity and quality of program efforts. The evaluation activities will take maximum advantage of the extensive array of on-going data collection efforts already in place. The comprehensive evaluation activities will provide information on each of the STEPS Project's primary goals: (1) Prevent Weld County residents from developing obesity; (2) Prevent Weld County residents from developing diabetes; (3) Prevent Weld County residents from being hospitalized for asthma; and (4) Reduce exposure to secondhand smoke. These goals apply both to the community and school work plan activities. The purpose of this evaluation is two-fold: 1) describe how they were implemented and 2) ascertain the end results of the main core activities and interventions. As such, our evaluation strategy will include quantitative approach. Quantitative approach will include data collection on program activities and performance indicators (such as Healthy People 2010 objectives) collected at each contact with the particular community entity (senior groups, elementary school groups) and aggregated and reported on a quarterly basis. To describe how the interventions were implemented we will include a process evaluation. The process evaluation will utilize the monthly MIS data provided by clinics and schools to describe the quantity of programmatic efforts. As part of our quality assessment,however, we will ensure that programs are indeed reporting all of their activities. We will work closely with programs to uncover aspects of the MIS system that makes it difficult for programs to report the full extent of their efforts. We will also document changes in policies and regulations that support the goals of the STEPS program. We plan to use the information gathered through existing mechanisms and supplement it with our own tracking efforts to accomplish this task. Analyses of process data will help to quantify the impact of the various program components on each of the overall goals of the STEPS program. Therefore, information that JSI reports will be organized by the goals. We will present information organized around preventing obesity, diabetes, and exposure to secondhand smoke. Outcome evaluation efforts will draw extensively upon on-going data collection efforts. The goal of the outcome evaluation will be to identify changes in knowledge, attitudes and behaviors. It is expected that some of these variables will show more initial progress while others will take more time to change. Therefore, it is essential that information be gathered at multiple points in time in order to fully gauge the impact of the STEPS program. The evaluation sample will be comprised of all the STEPS staff, Community Consortium members, Weld County residents with a sampling plan to ensure full representation of Weld County residents for the community activities, such as low-income, Latino, and elderly populations) and for the school activities such as oversampling from the elementary age students. Analyses of process data will also be organized by the four overall goals for the STEPS program. Yearly analyses will use as much change data as is available from a variety of sources. Analyses that are conducted at the end of the third year will capture cumulative changes since the inception of the program. Lastly, JSI believes that to ensure an effective comprehensive evaluation, a close partnership with the STEPS staff must be fostered. JSI will meet monthly, via conference calls with the STEPS staff to exchange information and ensure that the evaluation activities provide useful information for Weld County. Partnership and mentoring: this is the JSI approach to evaluation. Following are the key overall evaluation activities: • Participate in monthly meeting of the STEPS program Evaluation Team ❖ Coordinate the collection specified program implementation measures utilizing instruments provided by CDPHE. ❖ Design and implement program evaluation that emphasize health outcomes accruing to program participants for Community and School work plans. • Aggregate and report on a monthly basis the quantity of activity and/or exposure to Community or School work plans. ❖ Participate in preparation of mid-year and year-end reports. Community work plan evaluation activities: ❖ Development of KAB pre-and post tools to measure participants' degree of change as a result of the interventions related to the four goals. • Development of databases • Input of data ❖ Analysis of data ❖ Develop a report of findings School work plan evaluation activities: •:• Development of KAB pre-and post tools to measure participants' degree of change as a result of the interventions related to the four goals. ❖ Development of databases • Input of data ❖ Analysis of data ❖ Develop a report of findings 6 STAFFING: JSI has assembled a project team that will meet these requirements and in particular include .05 FTE senior evaluator (doctoral level) staff to provide technical assistance to the evaluation plan and .15 FTE evaluation specialist who has a masters-level degree in public health. Chris Duclos, Evaluation Technical Advisor, Ph.D., (5%) Dr. Duclos will have overall scientific and technical responsibility for all aspects of the project. She will be integrally involved in the formulation, design and development of all research methods, instruments, data analysis and interpretation of findings. Yvonne Hamby, Project Manager and Evaluation Specialist, MPH, (10%) Ms. Hamby will lead the project team, ensuring that project tasks are completed in a timely manner, keeping track of the budget, and monitoring performance. Carl Olson, Research Associate, BA, (10%) Under the supervision of the Project Manager, Mr. Olson will work with the team as a Database Programmer. He will be responsible for database management utilizing Access, SAS, SPSS and TeleForm programs and will conduct analyses on project data sets. BUDGET JUSTIFICATION: Personnel Staff Role on Project Daily Rate No. of Days on Project Total Cost Chris Duclos Evaluation Technical $494 11 5,434 Advisor Yvonne Hamby Project Manager and $448 24 10,752 Evaluation Specialist Carl Olson Research Associate $251 23 5,773 Personnel Subtotal 58 21,959 Travel- $1,861.50 In-State - Includes travel to Weld County for local meetings, focus groups, and technical training, budgeted at 425 miles per month for 12 months at $.365 per mile. Other Direct Costs - $1,175 Telephone - $575 Includes in-state long distance calls, fax and conference calls. Postage and shipping - $300 This includes shipping materials, before and after meeting information, and printed data collection forms. Postage for correspondence, information and materials distribution. Photocopying (in-house) and professional printing- $300 Includes general correspondence, information and materials copying. Total- $24,995.50 Hello