E-12023 DSM Annual Progress Repot
7 passages
5. 2023 PROGRAM RESULTS - This section provides an overview of 2023 results and activities for E1's Residential and BNI sector - programs including: - evaluation activities; - program results and highlights; - discussion of program varianc...
AI summary This section outlines E1's 2023 program results for Residential and BNI sectors, including evaluation activities, savings outcomes for underserved communities, variance explanations for programs deviating by 25% from mid-course targets, and Enabling Strategies. Program rate class results are detailed in Attachment 1.
5.2 Residential Sector Results - The Residential sector consists of the following programs: - Efficient Product Rebates; - Existing Residential; and Date Filed: April 1, 2024 Page 17 of 44 1 • New Residential. 2 - 3 In 2023, the Residentia...
AI summary The Residential sector achieved 60.2 GWh energy savings and 16.7 MW peak demand savings in 2023, exceeding mid-course adjusted targets. E1 provided variance explanations for programs deviating by 25% from targets, including Efficient Product Rebates, Existing Residential, and New Residential programs.
1 5.3 Business, Non-Profit and Institutional (BNI) Sector Results - 2 The BNI sector is comprised of the following programs: - 3 Efficient Product Rebates; - 4 Custom Incentives; and - 5 Direct Installation. 6 10 7 In 2023, the BNI sector...
AI summary In 2023, the BNI sector achieved 71.4 GWh energy savings and 10.9 MW demand savings, exceeding mid-course adjusted targets. E1's Energy Manager initiative supported organizations in identifying efficiency projects, with six placements partially funded by DSM. Variance explanations were provided for programs deviating by 25% from targets.
5.5.2 Performance Indicator The NSUARB also established a Performance Indicator of incidental cumulative annual energy savings of 23.6 GWh applicable to low-income and underserved communities from non-targeted programs. [26](#page-39-1) E1...
AI summary The NSUARB set a 23.6 GWh annual energy savings target for low-income/underserved communities via non-targeted programs. E1 met its 2023 mid-course adjusted target (10.3 GWh achieved) using Residential and BNI rebates, custom incentives, and direct installation. E1 updated its methodology for estimating program impacts in Q3 2023, with 2023 results reflecting these changes.
1 2023 Rate Class Results by Program - 2 Tables 2 7 provide a breakdown of 2023 net incremental energy and net peak demand savings, - 3 expenditures, and participation achieved by rate class within the energy efficiency programs.
AI summary The document presents 2023 results from energy efficiency programs, detailing net incremental energy savings, peak demand reductions, expenditures, and participation rates by rate class. Tables 2 and 7 are referenced as primary sources for quantitative breakdowns of program performance metrics.
ATTACHMENT 2: EVALUATOR AND VERIFIER RECOMMENDATION UPDATES Table 1: Update on Implementation of 2018-2021 Evaluation Recommendations Table 2: Update on Implementation of 2018-2021 Verification Recommendations Table 3: Update on Implementa...
AI summary This attachment provides updates on the implementation of evaluation and verification recommendations from 2018-2021 and 2022. It includes tables summarizing progress on these recommendations, though specific details are not provided in the text snippet.
changes through processes and engagement. The Evaluator performed a process evaluation for SEM in 2023 and interviewed nine participants regarding their motivations and barriers related to participation and satisfaction, as well as their s...
AI summary A process evaluation for the Strategic Energy Management (SEM) program was conducted in 2023, involving interviews with nine participants to assess their motivations, barriers, and satisfaction levels. The evaluation results were submitted to the Nova Scotia Utility and Review Board (NSUARB) on April 1, 2024.
E-22023 DSM Programs Evaluation Reports
34 passages
DEFINITIONS Accuracy Reflects the proximity of measurements to the true value. Peak demand savings The demand savings that coincide in time with the expected annual peak demand period of the entire electricity system. For industrial partic...
AI summary The document defines key terms related to energy efficiency and measurement accuracy, including concepts such as peak demand savings, precision, random sampling error, realization rate, sample size, secondary market impacts, and spillover. These terms are relevant for assessing program effectiveness and energy savings.
Project Reviews with Follow-up Site Visits or Interviews The Evaluator performed a total of 74 project reviews during the summer and fall of 2023, 51 of which were complemented through site visits and 23 were complemented through phone int...
AI summary The Evaluator conducted 74 project reviews in 2023, including site visits and interviews, to assess programs like Small Business Energy Solutions and Strategic Energy Management. Reviews aimed to validate savings calculations and gather data on free-ridership and spillover effects.
2.2 Process and Market Evaluation The process and market evaluations were conducted using a range of activities such as program component documentation as well as secondary data reviews, logic model reviews, and in-depth interviews with pr...
AI summary The process and market evaluations for Green Heat and related programs involved activities like program documentation, secondary data reviews, logic model reviews, and in-depth interviews with stakeholders and participants. The Evaluator conducted these tasks to assess the effectiveness of the programs.
Analysis The results of the process and market evaluation activities were analyzed in relation to the research objectives identified in Subsection [1.2](#page-13-0) above. Results from all evaluation activities were consolidated and triang...
AI summary The analysis consolidated and triangulated results from process and market evaluation activities to ensure findings are based on a preponderance of results, aligning with the research objectives outlined in Subsection 1.2.
This section presents a comparison of evaluated savings with EOne planned savings at the program and component levels. It also addresses satisfaction results, annual savings performance, as well as the historical performance and contributi...
AI summary This section compares evaluated savings with EOne planned savings at the program and component levels. It discusses satisfaction results, annual savings performance, and the historical performance and contribution of individual program components to portfolio savings.
9 Instant Savings Key Findings and Recommendations As mentioned previously, the main objectives of the 2023 Instant Savings evaluation were as follows: - › Collect information on participant and partner perspectives. - › Calculate gross an...
AI summary The 2023 Instant Savings program exceeded its energy and peak demand savings targets, with 11.476 GWh and 1.459 MW achieved, respectively. Participation increased by 9%, with notable growth in controls and appliance sales. LED lighting remained the primary source of savings, but non-LED replacements are becoming less available. Free-ridership levels for LED lamps and fixtures also increased.
5 HEA Key Findings and Recommendations As mentioned previously, the main objectives of the 2023 HEA evaluation were as follows: - › Collect information on participant perspectives - › Calculate gross and net results, namely electrical firs...
AI summary The 2023 HEA evaluation found that the program exceeded energy and demand savings targets, with increased participation and average savings per home. Participant satisfaction was high, though delays in rebate processing were noted. Free-ridership levels were lower than previously tracked, and billing analysis results were inconclusive, prompting recommendations for further exploration and a revised evaluation approach for 2024.
4 Impact Evaluation for Instant Rebates The objectives of the 2023 Instant Rebates impact evaluation were to determine gross and net electrical energy and peak demand savings.
AI summary The 2023 Instant Rebates impact evaluation aimed to assess gross and net electrical energy and peak demand savings, providing insights into the effectiveness of the program.
Custom General Key Findings and Recommendations 2023 Custom Finding: Custom achieved 21.746 GWh in net electrical energy savings and 3.053 MW in net peak demand savings at the generator in 2023, thus falling short of the planned electrical...
AI summary In 2023, Custom fell short of its energy and peak demand savings targets, partly due to decreased participation and adjustments made during project reviews. Free-ridership levels increased for Retrofit and solar PV projects, while spillover effects were minimal. Evaluated savings were lower than those tracked by EOne.
SEM Findings and Recommendations This section provides the key findings and recommendations from the SEM evaluation. The recommendations are also outlined in Appendix XIX. 2023 SEM-Finding: SEM achieved 3.381 GWh in net electrical energy s...
AI summary The 2023 SEM evaluation found that the program achieved energy savings above targets, with high participant satisfaction. However, it lacks metrics for capital project realization and faces barriers like time commitment and staffing. Recommendations include tracking capital projects and improving communication on energy management's value.
Pay-for-Performance (P4P) - Financial support for reductions in electricity consumption achieved through a variety of capital and behavioural energy efficiency upgrades - •Incentives are based on verified facility energy performance - Orga...
AI summary The Pay-for-Performance (P4P) program provides financial support for electricity consumption reductions through energy efficiency upgrades. Eligibility is based on annual consumption and project-generated savings. Savings claims are categorized into partial, single-year, and multiyear projects, with adjustments applied in 2023. Combined programs aim for 22.730 GWh of net energy savings and 5.280 MW of peak demand savings in 2023.
2 Custom Evaluation Approach The 2023 Custom evaluation comprised a comprehensive impact evaluation for Retrofit, Building Optimization, and New Construction. For Building Optimization, given its smaller contribution to Custom savings, NTG...
AI summary The 2023 Custom evaluation focused on assessing the impact of Retrofit, Building Optimization, and New Construction programs. It aimed to calculate energy savings, develop a method for solar PV projects, and gather participant perspectives and motivations. The evaluation used NTGR results for Building Optimization and outlined research questions, methods, and sample sizes.
Participant Phone Interviews To collect information on participant free-ridership and perspectives, the Evaluator conducted participant phone interviews with 13 regular Retrofit participants, six solar PV participants, 7 and eight New Cons...
AI summary The Evaluator conducted phone interviews with participants in Retrofit, solar PV, and New Construction programs to gather information on free-ridership and perspectives. Interview guides are provided in appendices for each participant group.
Note on Margins of Error For evaluation activities that yield quantitative results based on a sample, the Evaluator aimed to achieve a maximum margin of error of 10% at a confidence level of 90%. This means that if measurements were conduc...
AI summary The note explains the margin of error used in the evaluation of DSM programs, aiming for a 10% margin at a 90% confidence level. This applies to savings adjustment ratios for Retrofit and New Construction, but not for Building Optimization, as all 2023 projects were fully reviewed. The note clarifies that precision relates to reproducibility, not accuracy.
3.1.6 Measurement and Verification
AI summary This section addresses the importance of measurement and verification in energy efficiency programs. It outlines the need for accurate tracking of energy savings and the methodologies used to ensure program effectiveness.
Participant Perspectives Participants place a high degree of importance on the M&V of energy efficiency projects, rating its importance an average of 8.8 out of 10 where 1 means measurement and verification is not important to their organi...
AI summary Participants emphasize the importance of measurement and verification (M&V) in energy efficiency projects, rating it 8.8 out of 10. Most found M&V intuitive and supported by EOne, but some faced challenges with data access and system capabilities. Suggestions for improvement include better support from EOne and financial incentives for M&V.
Consultant Perspectives Overall for Retrofit projects, consultants were more likely to point out challenges with M&V than participants. Two consultants said that cost is a challenge; in some cases, the M&V cost exceeded the Retrofit incent...
AI summary Consultants highlight challenges with M&V in Retrofit projects, including cost issues and difficulties in fluctuating energy usage. They suggest improvements like independent M&V, aligning M&V with feasibility studies, and covering M&V costs through Retrofit incentives.
4.2.4 Project Review Findings – Regular Retrofit Projects The Evaluator reviewed the project sample to ensure the best measurement and verification practices were applied for commercial and industrial energy efficiency projects and adjuste...
AI summary The Evaluator reviewed 20 sampled retrofit projects and adjusted savings calculations for nine of them. Adjustments included both energy and peak demand savings, as well as corrections to M&V methodologies. Improvements in M&V quality were noted in 2023 following the implementation of EOne's updated guidelines.
General Custom Key Findings and Recommendations 2023 Custom Finding: Custom net electrical energy and peak demand savings fell short of targets in 2023. Custom achieved 21.746 GWh in net electrical energy savings and 3.053 MW in net peak d...
AI summary In 2023, Custom's net electrical energy and peak demand savings fell short of targets by 4% and 42% respectively. Participation in Custom programs decreased due to the lack of Pay-for-Performance (P4P) service and the removal of the Retrofit Operational Demand Reduction offer. Project reviews led to adjustments in energy and peak demand savings for Retrofit, New Construction, and Building Optimization.
9.1 SEM Description In 2023, SEM and Energy Management Information Systems (EMIS) were merged into one program component. Previously, SEM and EMIS were offered as separate program components. SEM provides industrial and institutional parti...
AI summary The Strategic Energy Management (SEM) program, merged with Energy Management Information Systems (EMIS) in 2023, supports industrial and institutional participants in implementing energy management practices. Eligible participants receive funding and support for energy-saving actions, audits, and training, with the goal of achieving continuous energy savings and improving long-term energy performance.
Figure 15: 2023 SEM Participation Process Summary Eligibility Check, Memorandum of Understanding (MOU), and Kick-off Meeting - Once approved, eligible participants must first sign a MOU that outlines the project scope, participant requirem...
AI summary The 2023 SEM Participation Process involves eligibility checks, signing MOUs, kick-off meetings, energy team formation, and development of energy management policies. Participants host energy improvement events, develop energy management plans, and undergo savings verification. Performance-based incentives are offered at different rates depending on participation in the Large Industrial initiative. The program aimed for 3.002 GWh of energy savings and 0.343 MW of peak demand savings.
12.2 Gross Savings This subsection describes the methodology used to review the six SEM projects that generated savings in 2023 and summarizes the review findings. Interactive effects, EUL values, and revised gross savings were also assess...
AI summary This subsection outlines the methodology for reviewing six SEM projects that generated savings in 2023 and summarizes the findings, including assessments of interactive effects, EUL values, and revised gross savings.
13 SEM Key Findings and Recommendations As mentioned previously, the main objectives of the 2023 SEM evaluation were as follows: - › Calculate SEM gross and net results, namely electrical first-year and lifetime energy savings, peak demand...
AI summary The 2023 SEM evaluation found that the program exceeded its energy and peak demand savings targets, maintained stable participation levels, and received high participant satisfaction. The bottom-up M&V approach did not hinder the program's energy management objectives.
Custom Appendix I Retrofit and SEM Interview Guide with BDMS Appendix II Retrofit and Solar Participant Interview Guide Appendix III Retrofit Consultant Interview Guide Appendix IV Custom Tracking Sheet Audit Appendix V Retrofit Algorithm...
AI summary The document outlines various appendices related to energy efficiency programs, including interview guides, tracking sheets, algorithms for free-ridership and spillover calculations, project review protocols, and recommendations for a custom 2023 initiative.
4. On-site or Virtual Review (continued) Section to be filled out with questions prior to virtual visits, and answers to be included during the call. Create new worksheet and 8. If a regression is used (based on HDD, tons/day) to build a p...
AI summary The text outlines a worksheet for conducting on-site or virtual reviews, focusing on the use of regression in measurement and verification (M&V) processes, validation of statistical indicators, and the impact of the COVID-19 pandemic on energy savings calculations.
Reminder of Evaluation Goals and Key Principles While developing the checklist, the Evaluator kept in mind the key evaluation goals and the five guiding principles presented in the 2020-2022 Overall Strategic Evaluation Plan. Notably for N...
AI summary The Evaluator focused on reviewing key measures contributing the most savings in complex programs like Custom New Construction, without a comprehensive review of entire models or M&V procedures, as outlined in Principle 4 of the 2020-2022 Overall Strategic Evaluation Plan.
Table 1: Overview of Data Collection Activity Descriptor This Instrument Instrument Type Semi-directed in-depth interview Estimated Time to Complete 60 minutes Target Audience EPS, service provider for SEM Expected Number of Completions 1...
AI summary The document outlines two tables related to data collection for a research project. Table 1 details a semi-directed in-depth interview targeting EPS and SEM service providers, while Table 2 lists research objectives and associated questions focusing on SEM adoption, challenges, and improvements. The research involves Efficiency One and Econoler and explores topics such as decarbonization, electrification, and program coherence.
Table 1: 2023 SEM Energy Savings Adjustments Project Tracked Savings (kWh) Evaluated Savings (kWh) Adjustment Ratio Explanation for Adjustment 1 36,798 36,798 1.000 None. 2 633,512 633,512 1.000 None. 3 287,808 287,808 1.000 None. 4 1,745,...
AI summary The document presents two tables detailing energy savings adjustments for the 2023 SEM (Smart Energy Manager) program. Adjustments were made due to calculation errors and assumptions in the M&V (Measurement and Verification) process, impacting both tracked and evaluated savings. Specific projects had their savings adjusted based on factors like pump affinity laws and peak demand calculations.
SBES Findings and Recommendations This subsection presents the key findings from the SBES evaluation. 2023 SBES-Finding: Net electrical energy and peak demand savings did not meet targets for 2023. 2023 SBES-Finding: Participation in SBES...
AI summary The 2023 SBES evaluation found that net electrical energy and peak demand savings did not meet targets, participation decreased, and free-ridership for DIY increased. Recommendations include improving the CIS and implementing communication strategies for participants nearing project expiration. Satisfaction levels remain high, but stakeholders are dissatisfied with processing times.
3.3 Participant and Contractor Satisfaction
AI summary This section discusses participant and contractor satisfaction in the context of energy efficiency programs. It likely includes metrics and feedback mechanisms used to evaluate the effectiveness of these initiatives.
5 SBES Key Findings and Recommendations The main objectives of the 2023 SBES evaluation were as follows: - › Collect information on participant and partner perspectives - › Calculate gross and net SBES results, namely electrical first-year...
AI summary The 2023 SBES evaluation found that net energy and peak demand savings fell short of targets by 37% and 28%, respectively. Participation decreased by 27%, and free-ridership for DIY projects increased to 20%. The Evaluator made minor adjustments to savings calculations and recommended improving the CIS data entry process. Participant satisfaction remained high.
0-10 SCALE WITH END POINT LABELS– RECORD NUMBER - 98. (Don't Know) - 99. (Refused) - F3. [IF [F2<](#page-26-0)8] What is the most important reason you are not more satisfied with the program overall? [PROBE FOR SPECIFIC REASON. ACCEPT MULT...
AI summary This section of the regulatory proceeding document includes survey questions and response options related to customer satisfaction with the Small Business Energy Solutions (SBES) program. Respondents are asked to rate their satisfaction with various aspects of the program and provide recommendations for improvement.
[VOLUNTEERED] - 98. Don't Know - 99. Refused - a. The number of steps required to complete the program - b. The time it took to get your application approved - c. The range of equipment that qualifies for incentives - d. The helpfulness of...
AI summary The text presents a series of survey questions aimed at assessing the experience of participants in the Small Business Energy Solutions program, focusing on program efficiency, support received, challenges faced, and areas for improvement.
7.2.1 Meter Data Analysis and Project Reviews
AI summary The section discusses meter data analysis and project reviews, focusing on evaluating energy usage patterns and the effectiveness of various programs and initiatives. It highlights the importance of accurate data in assessing program performance and making informed decisions.