E-22023 DSM Programs Evaluation Reports
41 passages
2.1.2 Data-collection Tool Development and Sampling Strategy Data-collection tool development and sampling were carried out for Instant Savings, Home Energy Assessment, Green Heat, Small Business Energy Solutions, Custom, and Strategic Ene...
AI summary The document outlines the development of data-collection tools and sampling strategies for various energy efficiency programs, including Instant Savings, Home Energy Assessment, Green Heat, and others. The Evaluator created instruments like surveys and interview guides, informed by documentation reviews and staff interviews.
Survey Margins of Error The 2023 HEA survey margins of error were established by using the following formula, which corresponds to the margin of error calculation for a proportion (i.e. a value between 0% and 100%): Margin of Error (e) = $...
AI summary The 2023 HEA survey margins of error are calculated using a statistical formula that considers the confidence level, proportion, population size, and sample size. A sample size of 100 and a 90% confidence level are used in this example.
Narrative Research staff conducted a participant online survey with 81 consumers who purchased qualifying non-A-type LED lamps, and 41 consumers who purchased qualifying LED fixtures during the fall 2023 campaign, for a total sample size o...
AI summary A survey was conducted with 122 participants who purchased qualifying LED lamps and fixtures during the fall 2023 campaign. The survey was distributed at retail locations and took nine minutes to complete. Results are detailed in Appendices V and VI, with a maximum margin of error of ±7.4% at a 90% confidence level.
Table 1: Overview of Data Collection Activity Descriptor This Instrument Instrument Type Participant Intercept Survey with Online Option Estimated Time to Complete 5 min Target Audience Instant Savings participants who have purchased LED n...
AI summary The document outlines data collection activities for a survey targeting participants of the Instant Savings program who purchased LED bulbs or fixtures during the fall 2023 campaign. The survey aims to collect data on usage, free-ridership, cross-influence, and participant awareness. It is to be adapted by Econoler.
Green Heat Findings and Recommendations This subsection presents the key findings from the Green Heat evaluation. 2023 Green Heat-Finding: Green Heat fell short of its net savings targets in 2023, achieving 80% of its net energy savings ta...
AI summary The 2023 Green Heat evaluation found that the program underperformed its energy and peak demand savings targets, with participation declining by 11% compared to 2022. Mini-split heat pumps saw a 22% drop in participation, while the Canada Greener Homes Grant and HEA programs gained traction due to higher incentives. Customer and contractor satisfaction with Green Heat is low, citing issues with rebates, marketing, and program communication.
INTRODUCTION Could I please speak with ? - 1. Yes [GO TO INTRODUCTION] - 2. No [SAY "PERHAPS YOU CAN HELP ME ANYWAY." GO TO INTRODUCTION] Hello, my name is ___________ calling on behalf of Narrative Research, a Halifax-based survey researc...
AI summary A surveyor from Narrative Research is contacting participants of Efficiency Nova Scotia's Home Energy Assessment program to gather feedback for program improvement. The survey involves questions about the program's energy efficiency services and may take about fifteen minutes to complete.
[VOLUNTEERED] - 98. Don't know [GO TO F SECTION] - 99. Refused [GO TO F SECTION] D9. I would like you to rate the influence of the following three factors in your decision to install a highefficiency heat pump. Use a scale from 0 to 10 whe...
AI summary This section of the proceeding includes instructions for respondents to rate the influence of factors on their decision to install a high-efficiency heat pump, using a scale from 0 to 10. Respondents are directed to skip or refuse participation by following specific instructions.
[READ AND ROTATE [(F1](#page-169-0) + [F2-](#page-170-0)[F4)](#page-170-1) AND [(F5](#page-170-2) + [F6-](#page-171-0)[F8)](#page-171-1) SEQUENCES] - F1. Before participating in the Home Energy Assessment program in 2023, had you at any ti...
AI summary The text presents a series of survey questions aimed at assessing the impact of Efficiency Nova Scotia programs and promotions on participants' decisions to install energy-efficient upgrades and seek home energy assessments. Questions focus on past participation and the influence of prior engagement with Efficiency Nova Scotia.
[ASK SECTION IF [B2](#page-160-0) = 1 OR 3, OR IF [B3](#page-160-1) = 2, OR IF ANY OF [B4](#page-161-0) = 2.] You mentioned in a previous answer that there were some recommended upgrades that you decided not to install through the Home Ene...
AI summary This section asks participants in the Home Energy Assessment program whether they installed any recommended upgrades on their own after participating in the program, and if so, which ones. It also inquires about receiving rebates from other Efficiency Nova Scotia programs and the influence of the Home Energy Assessment program on their decisions to install upgrades.
2023 Sample Size Mean The solar PV Rebate 29 6.9 Information or recommendations provided in the Renovation Upgrade Report 29 5.2 Expert information or advice from the energy advisor who came to your home to conduct the energy assessment 29...
AI summary The document presents data on the solar PV rebate program in 2023, including a sample size of 29 respondents and a mean value of 6.9. It also highlights feedback on information provided through the Renovation Upgrade Report and expert advice from energy advisors, with mean values of 5.2 and 4.8 respectively.
Just to confirm: before you had your home evaluated by an energy advisor, you had already made the decision to install a heat pump to heat your home? 2023 Sample Size 14 Yes 71% No 29% Base: Respondents who installed a heat pump but no oth...
AI summary The text confirms that 71% of respondents who installed a heat pump had already decided to do so before their home was evaluated by an energy advisor, while 29% had not. This data is based on a sample size of 14 in 2023.
2023 Sample Size 9 MEAN 8.0 Base: Respondents who decided to install and purchase a heat pump before home evaluation
AI summary The document presents a statistical summary from 2023, showing a sample size of 9 and a mean value of 8.0, focusing on respondents who decided to install and purchase a heat pump prior to a home evaluation.
2023 Sample Size Mean The program rebate 9 9.0. Information provided by the retailers or contractors on the benefits of high efficiency heat pumps 9 7.3 Information provided by Efficiency Nova Scotia on the benefits of high efficiency heat...
AI summary The data table shows the sample size and mean responses regarding heat pump installation and information provided by retailers, contractors, and Efficiency Nova Scotia. The base refers to respondents who decided to install and purchase a heat pump before home evaluation.
F2. Your previous participation in an Efficiency Nova Scotia program was a major factor in your decision to install energy efficient upgrades in your home. 2023 Sample Size 35 Agree 66% Disagree 31% Don't know 3% Base : Respondents who pre...
AI summary The text discusses how participation in an Efficiency Nova Scotia (ENS) program significantly influenced a respondent's decision to install energy-efficient upgrades in their home. A survey of 35 participants showed that 66% agreed with this statement, while 31% disagreed and 3% were unsure.
The initial home energy assessment overall 2023 Sample Size 100 10 - Completely satisfied 42% 9 17% 8 21% 7 12% 6 2% 5 3% 4 1% 3 1% 2 0% 1 0% 0 - Not at all satisfied 1% Not applicable 0% Don't know/Don't recall 0% Refused 0% SATISFIED % (...
AI summary The document presents survey results on customer satisfaction with the Home Energy Assessment program in 2023, with high satisfaction levels across multiple aspects of the program, including the initial and final assessments, as well as the expertise of energy advisors.
This appendix summarizes all the recommendations made by the Evaluator as part of the 2023 HEA evaluation. Section Recommendations Executive Summary Recommendation #1: Continue exploring the factors potentially responsible for the inconclu...
AI summary This appendix summarizes recommendations from the 2023 HEA evaluation, including the need to explore factors affecting billing analysis results and reconsider evaluation approaches for 2024 due to changes in program participant characteristics.
[READ AND ROTATE (F1 + F2 TO F4) AND (F5 + F6 TO F8) SEQUENCES] - F1. Before participating in the Heating System Rebates program in 2023, had you at any time in the past participated in any Efficiency Nova Scotia program or service? - 1. Y...
AI summary The text includes a survey question about prior participation in Efficiency Nova Scotia programs and a follow-up question about the influence of that participation on the decision to install heating equipment, indicating a focus on customer engagement and program impact evaluation.
Responses of 'Don't know' and 'Refused' are excluded from the table C10A. I would like you to rate the influence of the following three factors in your decision to install a high-efficiency heat pump. Use a scale from 0 to 10 where 0 is "N...
AI summary The text prompts respondents to rate the influence of three factors in their decision to install a high-efficiency heat pump, using a scale from 0 to 10.
Responses of 'Don't know' and 'Refused' are excluded from the mean calculation C10B. I would like you to rate the influence of the following three factors in your decision to install a high-efficiency heat pump. Use a scale from 0 to 10 wh...
AI summary The text asks respondents to rate the influence of three factors on their decision to install a high-efficiency heat pump, using a scale from 0 to 10, with 0 being 'No influence' and 10 being 'Great influence'.
Responses of 'Don't know' and 'Refused' are excluded from the mean calculation C10C. I would like you to rate the influence of the following three factors in your decision to install a high-efficiency heat pump. Use a scale from 0 to 10 wh...
AI summary The text asks respondents to rate the influence of three factors in their decision to install a high-efficiency heat pump on a scale from 0 to 10, with 0 indicating no influence and 10 indicating great influence.
[DO NOT ASK SECTION D IF CONTRACTOR TYPE = ETS ALONE] - D1. If a homeowner is interested in installing a mini-split heat pump (MSHP) and is contacting you to find out about available incentives for their purchase, which programs would you...
AI summary The text presents a series of questions aimed at understanding customer awareness and preferences regarding incentive programs for installing mini-split heat pumps, specifically Heating System Rebates and Greener Homes. It explores customer understanding, program selection criteria, and common practices among advisors.
Participant Interviews Participant interviews were conducted for process related questions (such as satisfaction, barriers, interest in EMIS, etc.) between December and January. These interviews were sometimes conducted at the same time as...
AI summary Participant interviews were conducted between December and January to gather insights on satisfaction, barriers, and interest in EMIS. The Evaluator conducted nine interviews, with varying participant outcomes, and the interview guide is provided in Appendix XV.
Table 39: Overall 2023 Custom Incentives Participation and Evaluated Savings Participation Level Gross Gross Savings Net Savings Value Unit Value Unit Value Unit Value
AI summary Table 39 presents data on the participation levels and evaluated savings from custom incentives in 2023, including gross and net savings across different categories. The table provides a structured overview of the impact of these incentives.
VOLUNTEERED - 98. Don't know - 99. Refused - I6. Do you have any suggestions to improve the Custom Retrofit program? - 96. Specify: - I7. How likely would you be to participate in other programs offered by Efficiency Nova Scotia if your or...
AI summary The text includes survey questions related to the Custom Retrofit program and potential participation in other programs offered by Efficiency Nova Scotia. It asks for suggestions to improve the program and gauges the likelihood of participation in other initiatives.
F. Consultant Satisfaction and Support from ENS F1. I am interested in your assessment of the Custom Retrofit program. On a scale of 0 to 10, where 0 is "not at all satisfied" and 10 is "completely satisfied", how satisfied are you with ea...
AI summary The text asks respondents to evaluate the Custom Retrofit Program based on six aspects, including overall satisfaction, eligibility criteria, value relative to time and cost, program requirements, support from Efficiency Nova Scotia, and overall performance. Respondents are also asked how likely they are to recommend the program.
SBES Findings and Recommendations This subsection presents the key findings from the SBES evaluation. 2023 SBES-Finding: Net electrical energy and peak demand savings did not meet targets for 2023. 2023 SBES-Finding: Participation in SBES...
AI summary The 2023 SBES evaluation found that net electrical energy and peak demand savings did not meet targets, participation decreased, and free-ridership for DIY increased. Recommendations include improving the CIS and implementing communication strategies for participants nearing project expiration. Satisfaction levels remain high, but stakeholders are dissatisfied with processing times.
3.1 Awareness and Motivation to Participate
AI summary This section discusses awareness and motivation to participate in energy efficiency programs, focusing on factors that influence customer engagement and participation rates.
s score indicates that most SBES participants are Promotors (93%), with very few Detractors (2%). Figure 7: Likelihood to Recommend SBES When asked for ideas to improve the program component, nearly two thirds of participants suggested EOn...
AI summary The SBES program has a high NPS score, with 93% of participants being Promotors. Participants suggested that EOne could improve the program by offering project financing and increasing awareness of on-bill financing options. Some also suggested expanding the range of eligible measures for rebates.
[ IF NEEDED: You may have recently been contacted by MQO or by Efficiency Nova Scotia about your experience with the program. This survey is different as it focuses on other aspects of your participation in the program.] [IF NEEDED: The su...
AI summary The text outlines a survey process for participants in an Efficiency Nova Scotia program, focusing on small businesses. It includes options for respondents to confirm their participation, prompts for clarification, and procedures for handling responses.
0-10 SCALE WITH END POINT LABELS– RECORD NUMBER - 98. Don't Know - 99. Refused - D7. [ASK IF TOTAL LIGHTING QTY>1] If there was no program rebate or financing, what is the likelihood that you would have installed exactly the same number of...
AI summary The text presents a scale question regarding the likelihood of installing the same number of lighting products without a program rebate or financing, indicating a focus on customer behavior and program effectiveness.
READ AND ROTATE [(E1](#page-24-1) + [E2](#page-24-2) TO [E4)](#page-24-3) AND [(E5](#page-25-0) + [E6](#page-25-1) TO [E8)](#page-25-2) SEQUENCES - E1. Before participating in the Small Business Energy Solutions program in 2023 , had your...
AI summary The text includes survey questions related to participation in the Small Business Energy Solutions program and previous engagement with Efficiency Nova Scotia programs and promotional materials. It explores the influence of past participation and promotional efforts on business decisions regarding energy efficiency upgrades.
Base: Respondents who had an audit and who installed more than one measure C8. If there was no program rebate, no program financing, and no program audit, what is the likelihood that you would have postponed making energy efficient upgrade...
AI summary The text asks respondents who had an audit and installed multiple energy efficiency measures about the likelihood of postponing upgrades by at least one year if there were no program rebates, financing, or audits.
D5. Were you aware that the lighting products rebated through the Small Business Energy Solution Program are premium products certified by Design Light Consortium or ENERGY STAR®? 2023 2021 Sample Size 19 41 Yes 84% 61% No 11% 37% Don't kn...
AI summary The text presents survey results regarding awareness of certified lighting products in the Small Business Energy Solution Program and the likelihood of installation without rebates. In 2023, 84% of respondents were aware of the certified products, compared to 61% in 2021. The mean likelihood of installation without rebates was 4.9 in 2023 and 3.5 in 2021.
D16C. Information or advice received by Efficiency Nova Scotia staff 2023 2021 Sample Size 20 8 MEAN 7.5 6.8 Mean excludes responses of 'Don't know' and 'Refused'
AI summary This table presents the mean scores from surveys conducted in 2023 and 2021, with sample sizes of 20 and 8 respectively. The mean scores are 7.5 and 6.8, excluding responses of 'Don't know' and 'Refused'.
E1. Before participating in the Small Business Energy Solutions program in 2023, had your business at any time in the past participated in any Efficiency Nova Scotia programs? 2023 2021 Sample Size 46 50 Yes 41% 38% No 46% 60% Don't know 1...
AI summary The document presents survey data on participation in Efficiency Nova Scotia (ENS) programs prior to joining the Small Business Energy Solutions (SBES) program in 2023. It compares responses from 2023 and 2021, showing a slight increase in participation and a decrease in uncertainty. Additionally, it examines how previous ENS program participation influenced decisions to install energy-efficient upgrades.
2023 2021 Sample Size 19 (#) 19 (#) Agree 17 16 Disagree 2 3 E5. Before participating in the Small Business Energy Solutions program in 2023, had you at any time in the past seen Efficiency Nova Scotia promotional materials advertising the...
AI summary The data shows a high level of agreement among participants in the Small Business Energy Solutions program regarding the influence of Efficiency Nova Scotia's promotional materials on their decision to install energy-efficient upgrades, with 85% in 2023 and 80% in 2021 reporting they had seen the materials.
G1A. To what extent do you consider the following as barriers preventing your business from installing other energy efficiency upgrades? Use a scale of 0 to 10, where 0 means 'not at all a barrier' and 10 means 'a major barrier'.\
AI summary The text asks respondents to rate, on a scale from 0 to 10, the extent to which various factors prevent their business from installing other energy efficiency upgrades, focusing on identifying barriers.
Confidentiality Your responses are for research purposes only. We will not share your information in a way that could identify you or your company. Efficiency Nova Scotia is looking for feedback on why a participant may start a project, bu...
AI summary Efficiency Nova Scotia is seeking feedback on why participants may start but not complete projects through their programs, aiming to identify barriers and improve program effectiveness.
[ASK FOR EACH RESPONSE IN E3A-I= 5-10 (RESPONDENT INDICATES SPILLOVER - THEY WERE INFLUENCED BY PROGRAM TO INSTALL EE EQUIPMENT WITHOUT REBATES)] - E4. Would it be ok if someone from the program evaluator, Econoler, called within the next...
AI summary The respondent indicates that they were influenced by a program to install energy efficiency equipment without receiving rebates. They are being asked if a program evaluator from Econoler can contact them for more specific questions about the equipment installed.
Introduction Hello, may I speak with [Contact name]? My name is and I am calling from Narrative Research, a market research firm. Efficiency Nova Scotia has mandated the evaluation of its Small Business Energy Solutions Program and they in...
AI summary Efficiency Nova Scotia has mandated an evaluation of its Small Business Energy Solutions Program. The evaluation involves contacting contractors who have worked with businesses participating in the program to gather their perspectives.
Table 1: FR – Audit Path C3. If your business had not received the free audit of your facility by a certified energy auditor, would you have identified the opportunity for the energy efficient upgrades that you installed? IF 1. Yes: EMPTY...
AI summary The table explores whether businesses that did not receive a free energy audit would have identified opportunities for energy-efficient upgrades. The response options include 'Yes' with no input required or 'No/DK/REF' with 0% as the value.