E-22010 DSM Evaluation Reports - Final Report - February 28, 2011 2/28/2011
40 passages
and Appliance Retirement & Replacement), NMR evaluated a total of 11 programs. Five of these eleven programs showed relatively low levels of free ridership— Efficient Products –Retail: CFLs, LIH, C&I 7 Free ridership and spillover were not...
AI summary NMR evaluated 11 DSM programs in 2010, finding five with low free ridership. The LIH program lacked free ridership/spillover data, while the SLC program had over 5,000 completed projects. Verification calls were made to refine savings estimates.
f 2010. However, even the new minimum requirement of EnerGuide 83 did not set significant stretch goals for participants, who could exceed this rating simply by installing a heat pump. The Business Energy Rebates program was a new program...
AI summary The Business Energy Rebates program's prescriptive measures led to higher free-ridership due to high transaction volumes. Table 2-1 shows net-to-gross ratios for various programs, with the LIH program exempt from free-ridership calculations as it offers free participation. The Efficient Products –Retail: CFLs program used a difference-of-differences approach to estimate its net-to-gross ratio.
Program Finding Recommendation Business BER-F1. BER-R1. Energy Unlike the C&I Custom program, the BER program did not While higher levels of free-ridership may be acceptable for a new Rebate incorporate any checks to ensure that participan...
AI summary The BER program lacks checks to ensure participants have funding from the DSM Administrator before proceeding with implementation. Free-ridership was high at 46% in 2010, compared to low levels for the C&I Custom program. As the BER program matures, it is recommended to introduce a free-ridership screening process, particularly for larger projects over $2,000. Awareness and outreach efforts should also be intensified in 2011.
consumers on continued energy efficient information from the energy audit, there was a change in their behavior practices offers a payback in energy savings long after a customer with regard to their use of energy at home: 51% now turn off...
AI summary The program has achieved high overall satisfaction (90%) with participants reporting increased energy efficiency interest and knowledge. However, satisfaction with specific aspects like energy conservation measures, presentations, and work quality declined between 2009 and 2010. The top recommendation for improvement is enhancing the quality of work.
-dec08.cfm?attr=4 NMR Evaluation of 2010 Power Down Program Page III
AI summary This document evaluates the 2010 Power Down Program, focusing on its effectiveness in reducing energy consumption and achieving program goals. It discusses program design, implementation, and outcomes, providing insights into its impact on energy efficiency and customer participation.
30% 4 35% 88% 18% 8 2% 75% 20% 5% 95% na lower 50% 5 6% 8% 2% 9 60% 70% 70% na 100% na lower 10% 5 60% 86% 18% 10 80% 90% 80% na 100% na lower 10% 4 80% 89% 6% Overall Program 58% 77% 72% NMR Evaluation of 2010 Power Down Program Page 39
AI summary The document presents a table with percentages and numbers related to the evaluation of the 2010 Power Down Program, likely assessing program performance or participation metrics. The NMR is mentioned in the context of the evaluation.
ot important 22% 5% 9% Not at all important 17% 9% 6.5 Retailer Satisfaction Overall satisfaction with the program was high among the retailers interviewed with more than three out of five saying they were very satisfied and an additional...
AI summary Retailer satisfaction with the program was high, with over 60% of chain retailers reporting they were very satisfied and an additional one-third satisfied. Dissatisfaction was low, with only two retailers citing reasons such as customer unawareness and insufficient program items.
please tell me if you are very satisfied, satisfied, neither satisfied nor dissatisfied, dissatisfied, or very dissatisfied with your experience with that specific aspect of the program. VS S Neither Dissat V.Dissat DK/Ref a. Program marke...
AI summary The text presents a survey format asking participants to rate their satisfaction with various aspects of the Power Down program, followed by questions about barriers to participation and recommendations for improvement. It includes rating scales and open-ended questions for feedback.
Transfer of understanding. Multi-residential unit owners will remember the energy and bill savings they realized from participating in the program and consider energy efficient options when making decisions to purchase other energy using...
AI summary The text discusses a program aimed at replacing inefficient refrigerators in multi-residential units, highlighting barriers such as program timing and inadequate staff, as well as outcomes like energy savings, bill reductions, and environmental benefits from appliance recycling.
program effectiveness and success in short-, intermediate-, and long-term? Marketing, Participating Retailers, and Verification: 17. Please explain the various marketing activities utilized by each program. What do you think is particularl...
AI summary The text includes a series of questions about program marketing, delivery, effectiveness, and gaps in coverage related to the 2010 Appliance Retirement & Replacement Program. It also asks about program strengths, weaknesses, and potential improvements, as well as about individuals or groups to interview for further evaluation.
s it provided? How frequently is it provided? Approximately how much of your organization‘s effort for the Appliance Retirement Program is spent on fulfilling data tracking requirements? 17. In general, how well do you think the program tr...
AI summary The text includes questions about data tracking requirements for the Appliance Retirement Program, the efficiency of the program tracking and reporting process, and the program delivery process. It asks about data capture, communication, and improvements. NMR is mentioned as the entity involved.
20. Are there any factors inhibit your ability to effectively perform any part of the program delivery process? IF YES: What are they? How can these be addressed? What impact do you think addressing them will have on your effectiveness and...
AI summary The text outlines a series of questions aimed at assessing the effectiveness of a program delivery process, including challenges, successful aspects, and opportunities for improvement. It also explores customer awareness, participation rates, and satisfaction with the Appliance Retirement program.
Skills and equipment. Delivery Agents have the equipment, tools and skills required to complete evaluations of participating homes or they can contract for such services. Understanding of savings. Homeowners will understand the energy...
AI summary The document outlines the requirements and barriers related to the Energy Efficiency for Homes (EEH) program. It emphasizes the importance of skills, equipment, and awareness in achieving energy savings, while also identifying challenges such as lack of awareness, cost concerns, and the need for proper training.
9. What are the major components and activities of the program, and what are they intended to accomplish? a. In the short term? b. Intermediate term? c. Long term? 10. What are the key outputs from each activity? 11. Is there any sequence...
AI summary The text outlines a set of questions regarding the major components, activities, and goals of a program, including its short-term, intermediate, and long-term objectives, key outputs, sequencing of activities, measurement of success, and assumptions underpinning the program's effectiveness.
Marketing and Verification: 16. Please explain the various marketing activities utilized by each program. What do you think is particularly good about program marketing? How could program marketing be improved? 17. Overall, how successful...
AI summary The document outlines a series of questions related to program marketing, delivery, success, free-ridership safeguards, coverage gaps, and the adoption of 2009 recommendations. It also asks about program strengths, weaknesses, and potential improvements.
that can be done to encourage these customers to implement recommended measures? 22. For customers who go on to do the final audit, typically, how soon after the first audit do they implement the measures and how much time after the first...
AI summary The text outlines a series of questions aimed at evaluating the 2010 EnerGuide for Existing Houses Program, focusing on customer behavior, program effectiveness, vendor practices, and areas for improvement.
e-participation and post-participation period to be accurately analyzed. At the end of the editing of the participant billing data a total of 210 participants were available for the billing analysis. 2.4 Develop Representative Control Grou...
AI summary The analysis involved 210 participants in the LIH program and the creation of a control group of 1,860 customers to assess the program's impact on electricity consumption. The control group was selected based on similar temperature, rate class, and heating source. Matching criteria included annualized usage and rate code, with four control group customers selected for each participant. The distribution of annualized usage showed similar consumption patterns between the groups.
or rural inhabitance, was difficult for some participants and could potentially represent a barrier to participation. However, outreach agents focus on explaining the chart to potential participants. 4.3 Verification of Measures Installed...
AI summary The document discusses verification rates of energy efficiency measures installed in homes under the REAP program. Verification rates varied across different measures, with some showing improvement from 2009 to 2010, while others, like building envelope measures, saw a decline. Lower verification rates may be attributed to respondents' difficulty recalling installations due to the time elapsed since installation.
Yes 4 NMR Evaluation of 2010 Low Income Households program Page B2 Table B-5: Impact of Measures 2009 2010 Rating: 5= ‘considerable Rating: 5= ‘considerable improvement’ improvement’ and 1 = ‘no improvement’ and 1 = ‘no improvement’ n 5 4...
AI summary The document evaluates the impact of the 2010 Low Income Households program by analyzing survey responses on comfort, value of the house, energy bill reduction, and energy efficiency knowledge. It includes a questionnaire used during interviews with participants.
a. Again at the broadest level, what were the areas that were not so successful? b. To what do you trace the difficulties you encountered? How might they be addressed in future programs? Marketing and Verification: 8. Please explain the va...
AI summary The text outlines a series of questions posed to evaluate the success, challenges, and improvements needed for energy efficiency and conservation programs. It covers marketing, delivery, free rider safeguards, program gaps, and a review of past recommendations.
16. In general, how well do you think the program tracking and reporting process is working? Do you believe all the necessary data is being captured and passed on to Conserve Nova Scotia? To Nova Scotia Power? If not, what data should be c...
AI summary The text asks about the effectiveness of the program tracking and reporting process, data capture, program delivery timing, vendor selection, and factors affecting program delivery. It seeks improvements and insights into the delivery process and vendor relationships.
c. Again at the broadest level, what were the areas that were not so successful? d. To what do you trace the difficulties you encountered? How might they be addressed in future programs? PROGRAM OUTREACH 11. Do you have any goals for the p...
AI summary The text focuses on evaluating the success and challenges of the Low-Income Residential Energy Assistance Program (LI REAP), including outreach efforts, awareness levels, participation barriers, and opportunities for improvement, particularly in reaching low-income consumers and renters.
ularly good about program outreach? How could program outreach be improved? STRENGTHS AND WEAKNESSES / WRAP-UP 18. What would you say are the greatest strengths of the LI REAP program? And what would you say are the greatest weaknesses? Wh...
AI summary The document includes questions about the Low-Income Residential Energy Assistance Program (LIREAP), focusing on its outreach strengths and weaknesses, and potential improvements. It also references an evaluation report on the 2010 New Houses Program conducted by NMR Group, Inc. for Efficiency Nova Scotia Corporation.
Marketing and Verification: 17. Please explain the various marketing activities utilized by each program. What do you think is particularly good about program marketing? How could program marketing be improved? 18. Overall, how successful...
AI summary The text outlines a series of questions related to program marketing, delivery, success, free-ridership safeguards, coverage gaps, and evaluation of past recommendations. It also asks about program strengths, weaknesses, and needed improvements.
Demand Energy Sample size 6 6 Free-ridership rate 46% 46% 3.6 Net-to-Gross Ratio For the BER program, the net-to-gross ratio was calculated based on spillover and free-ridership. For the 2010 program year, the net-to-gross ratio for the BE...
AI summary The document evaluates the 2010 BER program, calculating the net-to-gross ratio at 54% for both energy and demand savings. It also estimates net annual energy savings at 503.3 MWh and demand savings at 0.72 MW, based on participant surveys and on-site observations.
cipate in the NSPI rebate programs? [Probe: Save energy, rebates offered, reduce maintenance costs, protect environment, recommended by utility, concerns with carbon, etc.] 12. Were there any challenges or barriers that you faced in making...
AI summary The document includes questions about participation in NSPI rebate programs, challenges faced, barriers to participation, and satisfaction with program implementation and communication. It also asks about gaps in energy efficiency programs and overall satisfaction with various NSPI programs.
there any key indicators or metrics to gauge program effectiveness and success in short-, intermediate-, and long-term? 18. What are the assumptions behind the expectations that the program activities will yield the outputs and outcomes, w...
AI summary The text outlines key questions related to program effectiveness, assumptions behind program outcomes, and barriers to participation. It emphasizes the importance of resource availability, customer motivation, and program design in achieving program goals.
primary motivations for participating in the program? What are the major barriers to their participation in the program? 20. What has changed about the program since the beginning, and why? Marketing and Verification: 21. Please explain th...
AI summary The text outlines a set of questions related to energy efficiency programs, focusing on participant motivations, barriers, program changes, marketing strategies, program success, delivery improvements, free-ridership safeguards, and coverage gaps. It also mentions an evaluation of a specific program, the Commercial and Industrial Custom Program 2010, from February 25, 2011.
es FR3. Power, could your budget have accommodated the full cost of the No N/A project including the incentive? Don‘t know Based on their responses to these questions NMR divided respondents into three distinct groups: Full free-riders –...
AI summary The document evaluates the 2010 C&I Custom Program by classifying respondents into free-riders based on their pre-existing plans, budget capacity, and installation intentions. None of the 13 respondents were classified as full free-riders.
t-to-gross ratio 90% 90% Net savings 19,413 2,405.5 7 Note that these include the savings goals for the C&I Custom and New Construction programs combined. NMR Evaluation of 2010 C&I Custom Program Page 15 3 Process Evaluation 3.1 Methodolo...
AI summary The process evaluation of the 2010 C&I Custom Program involved in-depth interviews with program staff and a participant, as well as telephone surveys of 13 participants. Topics included program awareness, communication, and free-ridership. The evaluation aimed to assess the program's effectiveness and identify barriers and motivations.
Table 3-5: Participant Barriers 2008 Participants (n=11) 2009 Participants (n=13) 2010 Participants (n=13) Most Second Most Most Second Most Most Second Most Barriers Faced During Program Important Important Important Important Important I...
AI summary The table presents participant barriers to program participation across three years (2008, 2009, 2010). It highlights that the majority of participants did not face barriers, but issues such as communication, remote location, and voltage change were noted as challenges.
Table 3-8: Participant Satisfaction with Program 2008 2009 2010 Program Aspect n % Satisfied n % Satisfied n % Satisfied Program overall 11 91% 13 100% 13 77% Interaction and communication with 11 82% 12 100% 13 47% program staff Availabil...
AI summary The table presents participant satisfaction levels with various aspects of a program from 2008 to 2010. Satisfaction rates vary across different program aspects, with some areas showing high satisfaction and others showing a decline over time.
90% 12 66% Project rebate amount 10 90% 10 100% 13 77% Verification 7 86% 9 78% 12 75% Those giving a rating of 5 or 4 on a scale where Rating: 5= ‗very satisfied‘ and 1 = ‗not at all satisfied‘ 11 The detailed responses are provided in Ap...
AI summary The 2010 C&I Custom Program evaluation found that 85% of respondents indicated that someone outside their organizations, primarily design professionals (46%) and contractors (23%), was most responsible for specifying the measures installed through the program, similar to findings in 2008 and 2009.
120-volt MR16 19 20 PAR20 3 50 LED Retro Kit 1 1 Incandescent Exit 1 30 The fixture quantities listing in Table 2 reflect changes to the counts made during the evaluation. Note that line items do not match along rows in Table 2. Fixtures i...
AI summary The document discusses fixture quantities and their organization in Table 2, noting changes in counts during the evaluation. It also mentions the installation of additional lighting measures after program participation, which may be considered spillover but are not credited to the program under gross savings work.
contractor) 11. (Past participation in utility programs) 12. (Other (Please explain )) 99. (Don‘t know/Don‘t recall) 10. What was the second most important reason your company / organization chose to participate in the program? (Do not rea...
AI summary The text outlines survey questions related to participation in utility programs, including reasons for participation and verification of actions taken through the program. It also includes questions about feasibility studies and implementation of energy efficiency measures.
Theory and Logic Model Review: 9. Is the program theory and logic model included in the C&I program manual still valid? 10. Has the program been expanded to include participants other than larger commercial, industrial and municipal custom...
AI summary The document contains a series of questions about the Commercial & Industrial (C&I) program, focusing on its theory, logic model, outreach activities, program goals, and market impact. It explores whether the program is primarily a Resource Acquisition or Market Transformation initiative, and seeks clarification on short-term and intermediate goals.
21. For the C&I program, how has the involvement of contractors changed since last year? [Probe: Have contractors taken a more active role in program marketing?] [Probe: in the program logic model NSPI has identified that trade allies and...
AI summary The text outlines a series of questions posed to NSPI regarding the Commercial and Industrial (C&I) program, including contractor involvement, barriers to participation, program impacts, customer targeting, program interactions, coverage gaps, and program strengths and weaknesses.
what would you say are the programs greatest weaknesses? What could be done to address these weaknesses? 29. Based on your experience with the program so far, what are the most important improvements that still need to be made to the progr...
AI summary The text includes a set of questions for an interview with a participant in Nova Scotia Power's Commercial and Industrial Custom and Business Energy Rebate programs, focusing on program weaknesses, improvements, and other issues. It also includes an interview guide and a request for permission to record the interview.
ith NSPI staff [Does this vary by program at all?] e. Project implementation f. Rebate amounts [Does this vary by program at all?] g. Measurement and verification h. Application, rebate/incentive and associated paperwork [Does this vary by...
AI summary The text includes questions about energy efficiency programs administered by NSPI, focusing on rebate implementation, free-ridership, and the impact of rebate programs on company behavior. It asks whether companies would have taken energy efficiency actions without the programs and how rebate amounts, paperwork, and implementation vary by program.
Table 3-7: Influence of Program on Additional Energy Efficiency Actions Program Influenced Additional Actions 2008 2009 2010 Sample size 50 50 65 No 62% 76% 66% Yes 34 22 29 Don‘t Know 2 2 5 Type of Action Taken 2008 2009 2010 Sample size...
AI summary The table shows the influence of energy efficiency programs on additional energy efficiency actions taken by participants from 2008 to 2010. The data indicates that a majority of participants did not take additional actions, while a smaller percentage did, with various types of actions being taken.