E-2Savings Verification Review - Gil Peach
8 passages
Table 3: Planned Evaluations for 2024 Programs. 2024 Portfolio Evaluation Plan D Impact Ev Impact Evaluation Market Program Component Comprehensive Condensed Evaluation Evaluation Residential Appliance Retirement Х Instant Savings Х Afford...
AI summary Table 3 outlines the planned evaluations for 2024 programs, including various residential and business energy efficiency initiatives. It includes evaluations such as the Appliance Retirement Program, Instant Savings, and Strategic Energy Management. The table also references supporting reports from Econoler and Efficiency One.
IX. General Recommendations SVR24-G-1. The Savings Verification study recommends acceptance of the 2024 evaluation estimates for energy savings and demand reduction except for four programs . These are the Residential Behavior program (6.2...
AI summary The Savings Verification study recommends accepting 2024 energy savings estimates for most programs but excludes four due to evaluation issues. Key concerns include lack of independent evaluation for compressed air projects, insufficient practical significance of savings for residential and demand response programs, and protocol limitations. Recommendations include flagging low-impact programs, improving evaluation transparency, and emphasizing practical significance over statistical significance.
N. Demand Response (DR) There are two demand response programs, Residential Demand Response and Business-Nonprofit-Institutional (BNI) Demand Response. Demand response concerns capacity (Watts, kW, MW, GW) rather than energy (kWh, GWh). Th...
AI summary Nova Scotia's Demand Response (DR) programs include Residential and BNI (Business-Nonprofit-Institutional) DR, focusing on capacity reduction rather than energy savings. Participants totaled 353 (residential) and 76 (BNI) in 2024. Events are triggered by Nova Scotia Power to reduce load during peak periods, with savings measured in watts/kW.
2. BNI DR For BNI, the Evaluator first reviewed Efficiency Nova Scotia BNI tracking sheets to ensure consistency, resulting in a small correction (magnitude 2%-3%) to Efficiency Nova Scotia tracking values. By agreement between Efficiency...
AI summary BNI DR capacity calculation involves corrections to Efficiency Nova Scotia tracking sheets, event-based capacity determination (Dec-Feb, excluding weekends/holidays), participant classification for morning/evening events, and whole-house AMI data analysis. Evaluated results show 8.034 MW for BNI DR and 0.057 MW for Residential DR, with methodologies deemed logical and complete.
Recommendations SVR2024-Demand Response – 13 . In the next evaluation, include an analysis of the relative importance or lack of importance to the possible capacity shortfall problem to Nova Scotia Power, the roles of the load research sho...
AI summary The document recommends evaluating Demand Response (DR) programs' impact on Nova Scotia Power's capacity shortfall, clarifying their practical benefits beyond learning experiences, and justifying their business case. It critiques DR programs for minimal kW demand reduction and calls for analysis of whole-home vs. device-level approaches in residential DR. A citation to Econoler's report is included.
A. General Recommendations There are four general recommendations . SVR24-G-1. The Savings Verification study recommends acceptance of the 2024 evaluation estimates for energy savings and demand reduction except for four programs . These a...
AI summary Four recommendations address energy savings program evaluations. Four programs (Residential Behavior, Residential Demand Response, BNI Demand Response, and BNI Custom Incentive Program’s compressed air component) are rejected due to insufficient practical savings despite statistical significance. Evaluations must flag programs with trivial savings, ensure protocol compliance, and disclose statistical test details for transparency.
B. Program Specific Recommendations There are recommendations for only five of the program evaluations, Residential Behavior, BNI Efficient Product Rebates, the compressed air leak detection part of BNI Custom Incentives, and the two Deman...
AI summary Recommendations are provided for five programs: Residential Behavior, BNI Efficient Product Rebates, BNI Custom Incentives (compressed air leak detection), and two Demand Programs (Residential and BNI). Other programs lack evaluation issues. Key focus areas include program-specific evaluations and demand-side initiatives.
4. BNI Demand Reduction Programs SVR2024-Demand Response – 13 . In the next evaluation, include an analysis of the relative importance or lack of importance to the possible capacity shortfall problem to Nova Scotia Power, the roles of the...
AI summary The text requests an evaluation of BNI Demand Response programs, emphasizing the need to analyze their impact on Nova Scotia Power's capacity shortfall, clarify their practical benefits, and justify their business case. It criticizes the programs' weak demand reduction effects and calls for a comparison of whole-home vs. device-level approaches in residential analysis.
E-17Reply Evidence- E1 including Appendix A -Econoler Reply Evidence
4 passages
1. Verifier's Recommendations The Peach Report states the following general recommendation regarding the acceptance of 2024 evaluation results for four program components, including the DR program:[29](#page-36-0) SVR24-G-1. The Savings Ve...
AI summary The Peach Report recommends accepting 2024 evaluation results for four programs except the Demand Response (DR) programs due to their lack of practical significance despite statistical significance. The Evaluator followed protocols but failed to address the issue of large sample sizes, which rendered statistical significance irrelevant for practical value assessment.
Econoler Response: Econoler disagrees that the 2024 evaluated available capacity for the Residential and BNI DR program components should not be accepted and should have been flagged for not producing practical demand reduction as discusse...
AI summary Econoler contests the rejection of the 2024 Residential and BNI DR program capacity evaluations, arguing that demand reductions are practically valuable at both household and utility levels. They dispute claims about insufficient savings and question the reliability of statistical significance in DR program evaluations.
BNI DR - › Practical value at the utility system level: The BNI DR program is not required to generate savings or demand reduction of practical value at the utility system level at this stage in the program component's development, since i...
AI summary The BNI DR program's early-stage practical value is acknowledged, with 8.034 MW of available DR capacity in 2024. Econoler argues savings claims are justified despite household-level demand reduction, as the program targets system-level capacity for NS Power. The Verifier disputes the 'very large sample size' claim, noting only 93 projects analyzed.
Conclusion Econoler disagrees that the 2024 evaluated available DR capacity for Residential and BNI DR should not be accepted and disagrees with the recommendation that these program components should have been flagged for not producing pr...
AI summary Econoler disputes the recommendation to flag DR programs, arguing statistical significance, not practical effect size, should validate impact evaluations. The 2024 evaluation used valid sample sizes and followed industry best practices. The Peach Report recommends analyzing DR program importance, roles of NSP and Efficiency Nova Scotia, and clarifying program benefits for utility operations.