E-22023 DSM Programs Evaluation Reports
28 passages
DEFINITIONS Accuracy Reflects the proximity of measurements to the true value. Table 2: 2023 Participant Surveys 7 Table 3: 2023 Interviews Completed 8 Table 4: 2023 Project Reviews with Follow-up Site Visits or Interviews 9 5: Comparison...
AI summary The document provides definitions and outlines tables related to participant surveys, interviews, project reviews, energy savings evaluations, and free-ridership measurements from 2023. It includes various tables comparing energy and peak demand savings, GHG emission reductions, and satisfaction results from the evaluation process.
Project Reviews with Follow-up Site Visits or Interviews The Evaluator performed a total of 74 project reviews during the summer and fall of 2023, 51 of which were complemented through site visits and 23 were complemented through phone int...
AI summary The Evaluator conducted 74 project reviews in 2023, including site visits and interviews, to assess programs like Small Business Energy Solutions and Strategic Energy Management. Reviews aimed to validate savings calculations and gather data on free-ridership and spillover effects.
4.1 Participant and Partner Satisfaction The 2023 evaluation revealed high participant satisfaction with EOne and its programs. Home Energy Assessment, Green Heat, Custom (regular Retrofit and Solar PV), SEM, and Small Business Energy Solu...
AI summary The 2023 evaluation showed high participant satisfaction with EOne and its programs, including Home Energy Assessment, Green Heat, and Small Business Energy Solutions. Program partners were generally satisfied, though Green Heat contractors expressed lower satisfaction with the program component.
Table 31: 2023 Instant Savings Net-to-Gross Ratios Product Category Free-Ridership Level Margin of Error Spillover Net-to-Gross Ratio LED Lamps 59% 5.9% 9% 0.50 LED Fixtures 49% 6.0% 2% 0.53 All Other Products 0 0 0 1.00 8.3.4 Evaluated Ne...
AI summary Table 31 presents the 2023 Instant Savings Net-to-Gross Ratios for different product categories, including LED lamps, LED fixtures, and all other products. The table highlights free-ridership levels, margins of error, spillover effects, and net-to-gross ratios for these categories.
For HEA, participant spillover occurs when participants implement additional measures recommended in their initial energy assessments after their participation in the program component, i.e. after having completed the final energy assessme...
AI summary The document discusses spillover in the Home Energy Assessment (HEA) program, where participants implement additional energy efficiency upgrades after completing the program. A spillover level of 1% was measured in 2023, consistent with the 2020 measurement, based on participant surveys.
8.3.1 Participant Familiarity Nearly nine in ten (87%) Green Heat participants 15 report knowing that Home Energy Assessment ( HEA) enables access to the CGH Grant . Over one quarter of those who have heard of HEA/CGH Grant mention that th...
AI summary The text discusses participant familiarity with the Green Heat program and the CGH Grant, noting that 87% of Green Heat participants are aware of the HEA and CGH Grant. Contractors report that fewer than 20% of customers who know about both programs choose Green Heat, and that confusion between the two programs is high among customers.
Table 1: Overview of Data Collection Activity Descriptor This Instrument Instrument Type Telephone participant survey Estimated Time to Complete 20 min Target Audience Participant who purchased home heating equipment Expected Number of Com...
AI summary This document outlines a telephone survey targeting participants who purchased home heating equipment, focusing on data collection related to free-ridership, program awareness, and satisfaction. The survey includes sections on verification, motivations, and recommendations for program improvements, with a focus on technologies like mini-split heat pumps and biomass systems.
[0-10 SCALE WITH END POINT LABELS– RECORD NUMBER] - 98. Don't Know - 99. Refused - G3. [I[F H2<](#page 1-1)8] What was the main reason you were not more satisfied with the program overall? [PROBE FOR SPECIFIC REASON. RECORD FIRST MENTION A...
AI summary The text outlines survey questions related to customer satisfaction with the Heating System Rebates program, focusing on aspects such as program clarity, application process, rebate amounts, and communication with Efficiency Nova Scotia. Respondents are asked to rate their satisfaction on a scale from 0 to 10.
Aspects of the Program Score 0 = Not at all satisfied 10 = Completely Satisfied Reason If 7 or less, please share the reason(s) for your score. a. The overall program /10 What could be improved? b. The list of equipment that qualifies for...
AI summary The document outlines aspects of a program that require evaluation, including the overall program, eligibility criteria, incentive levels, and application form. Each aspect is rated on a scale from 0 to 10, with reasons for scores below 7.
1 BER Overview This section describes Business Energy Rebates (BER), follows up on past evaluation recommendations, and presents participation history.
AI summary This section outlines the Business Energy Rebates (BER) program, discusses past evaluation recommendations, and provides participation history data.
Program Performance Table 2 below presents the participation levels, average net-to-gross ratios (NTGRs), evaluated gross and net savings at the generator, annual GHG emission reductions, as well as average EUL values for each program comp...
AI summary Table 2 provides data on program participation levels, net-to-gross ratios, gross and net savings, GHG emission reductions, and average effective useful life values for each program component and Custom Incentives as a whole.
Table 6: 2022 Custom Evaluation Approach Evaluation Objectives Research Questions Methodology Collect information on participant and partner perspectives on Retrofit › What is the level of satisfaction with the different elements of Custom...
AI summary This section discusses the 2022 Custom Evaluation Approach, focusing on collecting information on participant and partner perspectives on Retrofit. It outlines research questions related to satisfaction, impact of decarbonization and electrification objectives, challenges, and ways to improve Custom. The methodology includes interviews with Business Development Managers, participants, and consultants.
Consultant Perspectives Consistent with participant feedback, consultants indicated that project costs and insufficient returns on investment are the primary barriers to businesses carrying out energy efficiency projects (n=6). Two consult...
AI summary Consultants identified project costs, insufficient returns on investment, and lengthy timelines as key barriers to energy efficiency projects for businesses. They suggested standardizing forms and providing additional training for EOne staff to reduce administrative burdens and improve processing times.
Participant Perspectives Since solar PV projects are now distinguished from regular Retrofit projects within the Retrofit offer, participant satisfaction results are presented separately for each project category. Participants are satisfie...
AI summary Participants expressed high satisfaction with Custom Retrofit projects, with solar PV participants scoring higher than regular Retrofit participants. EOne received positive feedback for its responsiveness and technical expertise but faced criticism regarding rebate amounts and clarity in energy savings calculations.
Table 8: Reasons for Dissatisfaction Factor Assessed Reasons for Dissatisfaction/What Could Be Improved (#) n=4 Value of the service relative to the time and cost involved › Incentives too low/should be more value for the customer (1) › Cu...
AI summary The table outlines reasons for dissatisfaction with retrofit programs, citing issues such as low incentives, complex processes, expensive equipment, and poor customer support. Consultants report that the programs are too time-consuming, not financially rewarding, and lack adequate support and transparency.
CONCLUSION Table 39 presents the participation levels, net-to-gross ratios (NTGRs), evaluated gross and net savings at the generator, annual GHG emission reductions, as well effective useful life (EUL) values for each Custom Incentives pro...
AI summary The conclusion section references Table 39, which provides data on participation levels, net-to-gross ratios, evaluated savings, GHG emission reductions, and effective useful life values for the Custom Incentives program and its components.
- 98. Don't know - 99. Refused - F4. In your opinion, how well do customers and consultants understand what is required for program participation? They … [ASK FOR EACH (customers / consultants] - a) Customers - b) Consultants - 1. Understa...
AI summary The text includes survey questions about customer and consultant understanding of program participation requirements, barriers to implementing measurement and verification plans for Custom Retrofit projects, and suggestions for supporting these efforts. It focuses on improving program effectiveness and stakeholder engagement.
APPENDIX V Retrofit Algorithm for Free-Ridership Calculation Question Response Score
AI summary This appendix outlines a retrofit algorithm used for calculating free-ridership, which is relevant to regulatory proceedings involving energy efficiency programs and customer participation metrics.
Table 1: Participant Interview Questionnaire and Free-ridership Algorithm Question (From the Custom New Construction Participant Interview Guide) Response Score INTRODUCTION I am with and we are performing an evaluation of the Custom New C...
AI summary The text outlines an interview questionnaire used to evaluate the Custom New Construction program by Efficiency Nova Scotia, aiming to understand participants' decision-making processes in designing energy-efficient buildings beyond code requirements.
3.2.1 Participants Participants were asked to rate the extent to which certain factors posed barriers to installing energy efficiency upgrades in their businesses. As outlined in [Table](#page-182-1) 9 below, financial challenges and lack...
AI summary Participants identified financial challenges and lack of funds as the most significant barriers to installing energy efficiency upgrades in their businesses, followed by time constraints and long application processing times. Information and technical support, as well as qualified contractors, were also noted as important factors. Concerns about rebate availability and upgrade effectiveness were minor barriers.
Table 10: Satisfaction with SBES Overall Overall Satisfaction with SBES 2017 2019 2021 2023 Sample Size 70 50 50 46 Mean 8.8 9.2 9.1 8.8 Don't know/refused excluded from calculations Table 11: Satisfaction with Aspects of SBES 20 17 20 19...
AI summary Table 10 and Table 11 provide data on customer satisfaction with the Small Business Energy Solutions (SBES) program across different years, highlighting sample sizes, mean satisfaction scores, and feedback on various aspects of the program such as audit reports, financing, contractor quality, and rebate processes.
Table 12: Participant Suggestions to Improve SBES Participant Recommendations to Improve SBES 2017 2019 2021 2023 Sample Size 70 50 50 46 Offer financing/help with cost 1% - 4% 63% Offer more measures eligible for rebates 4% 10% 2% 15% Inc...
AI summary Table 12 outlines participant recommendations for improving the Small Business Energy Solutions (SBES) program from 2017 to 2023. The data shows a significant increase in the percentage of participants suggesting the need for financing options, with 63% in 2023 compared to 1% in 2017. Other recommendations include increasing rebates, improving marketing, simplifying the program, and enhancing communication.
F2. Using a scale from 0 to 10 where 0 is "not at all satisfied" and 10 is "completely satisfied" how would you rate your satisfaction with the program overall?\ 2023 Sample Size 46 MEAN 8.8 Mean excludes responses of 'Don't know' and 'Ref...
AI summary The survey results indicate a high level of satisfaction with the program, with a mean score of 8.8 out of 10 in 2023, based on a sample size of 46 respondents. The mean excludes responses of 'Don't know' and 'Refused'.
Table 1: FR – Audit Path C3. If your business had not received the free audit of your facility by a certified energy auditor, would you have identified the opportunity for the energy efficient upgrades that you installed? IF 1. Yes: EMPTY...
AI summary The table explores the influence of Efficiency Nova Scotia (ENS) programs and promotions on businesses' decisions to install energy-efficient upgrades. It assesses whether previous participation in ENS programs or ENS promotions influenced the decision-making process regarding energy efficiency measures.
Table 12: 2023 BNI DR Evaluation Approach Evaluation Objectives Research Questions Methodology Establish available DR capacity results for the DR Aggregator pathway › Are the data in the tracking sheet complete, accurate, and consistent? ›...
AI summary Table 12 outlines the 2023 BNI DR Evaluation Approach, focusing on evaluating the accuracy and completeness of data related to demand response (DR) capacity results for the DR Aggregator pathway. The methodology includes a tracking sheet audit, meter data analysis, project reviews, and follow-up interviews.
KEY DEFINITIONS Accuracy Reflects the proximity of measurements to the true value. First-year savings The first full year of energy or peak demand savings generated by an energy efficiency measure. Free-ridership Percentage of gross saving...
AI summary The document defines key terms related to energy efficiency programs, including accuracy, first-year savings, free-ridership, gross savings, induced consumption, and interactive effects, providing clarity on how these metrics are measured and interpreted.
Installation Rates Installation rates for electric thermal storage systems are estimated at 100% due to their relatively high cost.
AI summary Installation rates for electric thermal storage systems are estimated at 100% due to their relatively high cost.
Installation Rates [Table](#page-116-0) 173 shows the installation rate for SBES hot water tank wraps.
AI summary The document refers to Table 173, which displays the installation rate for SBES hot water tank wraps. The table is located on page 116-0 and is labeled with an anchor for reference.