Topic:"Program Evaluation" in M09096

Table 1: 2020-2022 Preferred Plan Performance Metrics Year Investment ($ million) Lifetime Benefits ($ million) a First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Weighted- Average Measure Life (years) Peak Demand Savings (MW)...

AI summary Table 1 presents performance metrics for the 2020-2022 Preferred Plan, including investment, energy savings, and cost tests. The data shows increasing investment and energy savings over the years, with metrics such as lifetime benefits, peak demand savings, and TRC/PAC tests.

1 5.1.2 How does the Preferred Plan respond to the decline in savings from lighting? 2 3 The Preferred Plan responds to this projected decline in savings by diversifying its 4 program delivery to energy saving measures beyond lighting. In...

AI summary The Preferred Plan addresses declining lighting savings by diversifying programs to include non-lighting energy efficiency measures. It increases funding for home energy assessments, insulation, and heating systems, while shifting the BNI Efficiency Rebates Program focus from lighting to technologies like heating and compressed air. This aligns with industry trends toward comprehensive energy savings strategies.

11 5.2.1.1 Residential 12 13 For residential customers, the Preferred Plan focuses on the barriers of affordability and 14 up-front costs, lack of information and awareness of energy efficient technologies and 15 benefits, lack of time and...

AI summary The residential section discusses barriers to participation in energy efficiency programs, including affordability, upfront costs, lack of information, and split incentives between landlords and tenants. The Preferred Plan aims to address these barriers through targeted program components, as detailed in Table 6.

per year, an increase of 27 approximately $3 million from an average of approximately $40 million over the last 9 28 years of approved investment levels. This proposed investment level is materially 29 consistent with the average of approv...

AI summary The text discusses the need to increase DSM investment due to market evolution, moving away from lighting rebates to more complex upgrades. It references the 2020-2022 Preferred DSM Plan and a Consensus Agreement dated June 30, 2016, highlighting the shift from low-cost energy savings to deeper, more expensive measures.

5 EfficiencyOne's progress in implementing the approved DSM Plan is measured and 6 monitored continuously, through quarterly and annual reports. EfficiencyOne's 7 progress and reported results are subject to an independent review by a thir...

AI summary EfficiencyOne's implementation of the approved DSM Plan is continuously monitored through quarterly and annual reports, which are reviewed by an independent Evaluation Consultant and a Board-appointed Verification Consultant to ensure performance targets are met and adjustments can be made as needed.

1 7.2.2 Threshold 2 3 EfficiencyOne proposes the Lifetime Energy Savings performance target be established 4 with a threshold of 75 percent, as opposed to the 90 percent threshold established for 5 shorter term cumulative annual energy and...

AI summary EfficiencyOne proposes a 75% threshold for Lifetime Energy Savings, citing volatility in the metric compared to established targets. The 2017 third-party evaluation found a 25% decrease in savings due to methodological changes, particularly for LED lighting. Lower thresholds reflect the need for refined methodologies as the process matures.

23 Table 12: Alternate Scenario performance metrics Year Investment ($ million) Lifetime Benefits ($ million) a First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Weighted-Average Measure Life (years) Peak Demand Savings (MW) To...

AI summary Table 12 presents performance metrics for alternate scenarios, showing investment, energy savings, and cost tests from 2020 to 2022. It highlights increasing investments and benefits over time, with consistent energy savings and improvements in cost tests.

1 1. INTRODUCTION 2 3 EfficiencyOne developed the 2020-2022 Preferred Demand Side Management (DSM) 4 Resource Plan (Preferred Plan) to acquire cost-effective energy efficiency and system 5 coincidence peak demand reduction resources that p...

AI summary EfficiencyOne's 2020-2022 DSM Resource Plan proposes a $129.1 million investment to reduce energy costs and emissions while building on Nova Scotia's successful energy efficiency programs. The plan emphasizes cost-effective resources, stakeholder collaboration, and historical achievements, including annual savings of $188 million and 800,000 tonnes of greenhouse gas reductions.

2. DEVELOPMENT APPROACH AND DETAILS 2 4 5 6 7 1 The Preferred Plan was developed for the purpose of delivering cost-effective energy and system-peak demand savings to Nova Scotia electricity ratepayers for the three-year plan period. Effic...

AI summary The Preferred Plan aims to deliver cost-effective energy and system-peak demand savings for Nova Scotia ratepayers over three years. EfficiencyOne employed a multi-stage process to define performance targets, portfolio structure, and program design, as illustrated in Figure 1.

4 Cost-Effectiveness 5 6 To assess the cost-effectiveness of the 2020-2022 Preferred Plan, EfficiencyOne used 7 two industry standard screening tests: the TRC test and the Program Administrator Cost 8 (PAC) test. The TRC was used as the pr...

AI summary EfficiencyOne assessed the 2020-2022 Preferred Plan using the TRC and PAC tests. TRC was mandated by NSUARB to ensure a TRC of 1 or greater, while PAC provided supplementary cost-effectiveness analysis excluding voluntary contributions. Results are detailed in Table 1.

12 Vetting Process 13 14 The final stage of model design is the vetting process. This step is crucial, as it allows 1 for the alignment of EfficiencyOne's qualitative and quantitative design efforts. The 2 vetting process involves analysis...

AI summary The vetting process is the final stage of model design, involving internal and external teams to analyze model outputs for validity. An example highlighted concerns over a program component's energy savings dropping to 0 GWh in 2020, prompting model refinements. This iterative process ensured alignment of qualitative and quantitative efforts, addressing impacts on delivery costs, industry capacity, and market presence.

Table 3: 2020 Preferred DSM Resource Plan Investment and Savings 2020 Investment ($ million) Lifetime Benefits ($ million) a First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Peak Demand Savings (MW) Total Resource Cost Test (T...

AI summary Table 3 outlines the 2020 Preferred DSM Resource Plan investment and savings, detailing program investments, energy savings, and cost tests for residential and business programs in Nova Scotia. It highlights investments in efficient product rebates, custom incentives, and enabling strategies, along with their associated lifetime benefits and energy savings.

1 4. RESIDENTIAL PROGRAMS AND SERVICES 2 3 The Preferred Plan will allow EfficiencyOne to continue delivering cost-effective 4 energy savings benefits for Nova Scotia's residential customers. The Preferred Plan 5 pursues enhanced approache...

AI summary The Preferred Plan emphasizes EfficiencyOne's continued delivery of cost-effective residential energy savings in Nova Scotia, leveraging customer insights and evolving technologies. It highlights high household prioritization of energy reduction (87% in 2018) and shifts toward non-lighting measures, system-peak demand reduction, and expanded program accessibility. The plan includes three residential programs with eight components.

Appliance Replacements Appliance Retirement will place an increased focus on appliance replacements by offering a new turn-key service. Currently, Appliance Retirement replaces fridges, freezers and dehumidifiers for low-income qualified N...

AI summary Appliance Retirement expands focus to appliance replacements, including new services for low-income Nova Scotians via HomeWarming and First Nations programs. ENS introduces a cost-based appliance replacement package under the Preferred Plan, offering full-service removal, recycling, and installation of efficient appliances.

Efficient Clothes Dryers Instant Savings will offer a point-of-sale rebate on energy efficient clothes dryers. This proposed enhancement aligns with other jurisdictions that have recently introduced incentives for efficient dryers includin...

AI summary The proposal introduces a point-of-sale rebate for energy-efficient clothes dryers through Instant Savings, aligning with similar initiatives by BC Hydro, Fortis BC, Efficiency Vermont, and MassSave. This aims to promote energy efficiency and reduce consumption.

Quality Assurance The Residential Efficient Product Rebates program has a quality assurance framework which includes retailer site visits (during both campaign and non-campaign periods), random customer record review, appliance metering, a...

AI summary The Residential Efficient Product Rebates program employs a quality assurance framework involving retailer site visits, random customer record reviews, appliance metering, internal temperature testing, and customer satisfaction surveys to ensure program effectiveness during campaign and non-campaign periods.

11 Table 7: 2020-2022 Residential Efficient Product Rebates Performance Indicators Year Investment ($ million) First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Peak Demand Savings (MW) Total Resource Cost Test (TRC) a Program...

AI summary This table presents performance indicators for the Residential Efficient Product Rebates program from 2020 to 2022, including investment, energy savings, peak demand savings, and cost metrics like the Total Resource Cost Test (TRC) and Program Administrator Cost Test (PAC).

4.1.8 Low-Income Performance Indicators 2627 28 Low-Income performance indicators for the Residential Efficient Product Rebates program are provided in Table 8 below.

AI summary The text references Low-Income Performance Indicators for the Residential Efficient Product Rebates program, noting that details are provided in Table 8. No specific data or arguments are presented in the excerpt.

5 4.1.9 Program Alternatives 6 EfficiencyOne considered the same key principles in both the development of the 2020- 2022 Preferred DSM Resource Plan and alternate scenario. The significant difference between the Alternate scenario and Eff...

AI summary EfficiencyOne compared its 2020-2022 Preferred DSM Resource Plan with an alternate scenario, noting reduced participation levels and energy savings in the alternate scenario. Table 9 highlights differences in the Residential Efficient Product Rebates program between the two scenarios.

4.2 Existing Residential: Program Description 15 16 17 18 19 20 21 22 23 14

AI summary The section outlines the Program Description for Existing Residential initiatives under Nova Scotia's regulatory framework, though no detailed content is provided in the excerpt. Key terms and acronyms related to energy efficiency, utility regulation, and program administration are referenced.

4.2.2 Enhancements in 2020-2022 Several new initiatives are introduced in 2020-2022 to enhance the Existing Residential Program. These are detailed in the following section.

AI summary New initiatives from 2020-2022 aim to enhance the Existing Residential Program, with details provided in subsequent sections. These efforts focus on improving residential energy efficiency and program administration.

Additional Support Increased financial support will be provided for heat pump water heaters and DWHR in both the Green Heat and Home Energy Assessment program components. Additional engagement with plumbers and plumbing contractors will be...

AI summary Increased financial support for heat pump water heaters and domestic water heating recovery (DWHR) in the Green Heat and Home Energy Assessment programs. Collaboration with plumbers and contractors aims to enhance residential sector implementation of these upgrades.

Mid-stream[12](#page-115-0) Delivery Approach for Cold Climate Ductless Heat Pumps Currently, incentives for ductless heat pumps are delivered through a downstream mail- in rebate via Green Heat or as part of whole home upgrades in Home En...

AI summary The document proposes transitioning from downstream mail-in rebates to mid-stream instant rebates for cold climate ductless heat pumps, aiming to reduce administrative barriers, improve customer understanding, and lower upfront costs. EfficiencyOne will collaborate with distributors to promote the program.

Deeper Energy Savings Support for Home Energy Assessment Participants Home upgrades such as increasing insulation and, energy efficient space and water heating systems are an important part of the residential sector portfolio. Achieving de...

AI summary The document highlights the importance of home energy upgrades and the Home Energy Assessment (HEA) program in achieving long-term energy savings. With 17% market penetration in 2018, the program aims for growth through two enhancements to increase participation in residential energy efficiency initiatives.

Demand Reduction Measures Demand reduction initiatives are being introduced as part of the broader DSM portfolio in the Preferred Plan. These initiatives are meant to build on the demand reduction pilot beginning in 2019. Demand reduction...

AI summary Nova Scotia Power Inc. (NSP) is introducing demand reduction measures as part of the Demand Side Management (DSM) portfolio in the Preferred Plan, building on a 2019 pilot. Measures include ETS units and electric storage hot water heater timers under the Green Heat and Home Energy Assessment programs.

4.2.6 Implementation Strategy

AI summary The section titled '4.2.6 Implementation Strategy' outlines the approach for executing demand-side management and efficiency initiatives, though specific details are not provided in the text. Key entities and acronyms related to Nova Scotia's energy regulatory framework are referenced.

4.2.8 Low-Income Performance Indicators 1920 Low-income performance indicators for the Existing Residential program are provided in Table 11 below. 2122 23

AI summary The section outlines low-income performance indicators for the Existing Residential program, referencing Table 11 for detailed metrics. No specific claims or arguments are presented in the provided text.

4.2.9 Program Alternatives 2 4 5 6 7 1 EfficiencyOne considered the same key principles in both the development of the 2020-2022 Preferred DSM Resource Plan and alternate scenario. The significant difference between the Alternate scenario...

AI summary EfficiencyOne developed both a 2020-2022 Preferred DSM Resource Plan and an alternate scenario with reduced participation levels, leading to lower energy savings and investment. Table 12 illustrates these differences for the Existing Residential program.

4.3.8 Program Alternatives 2324 25 26 27 28 EfficiencyOne considered the same key principles in both the development of the 2020-2022 Preferred DSM Resource Plan and alternate scenario. The significant difference between the Alternate scen...

AI summary EfficiencyOne compared its 2020-2022 Preferred DSM Resource Plan with an alternate scenario showing reduced participation due to lower energy savings and investment. Table 14 highlights differences for the New Residential program, with footnotes explaining metrics like TRC, PAC, and WACC. Key differences include reduced household upgrades and cost calculations.

5. BUSINESS, NON-PROFIT AND INSTITUTIONAL PROGRAMS AND The Preferred Plan maintains a focus on delivering energy savings benefits to Nova Scotia business customers through a variety of effective programs. Over the 2016-2018 period, market...

AI summary The Preferred Plan focuses on expanding energy savings for Nova Scotia businesses by reducing reliance on lighting upgrades, increasing program accessibility, and promoting system-peak demand reduction. It addresses barriers like cost and complexity through enhanced support and expertise, building on 2019 changes that phased out lighting incentives.

5.1.2 Enhancements in 2020-2022

AI summary This section outlines enhancements implemented between 2020-2022, focusing on regulatory and programmatic developments in Nova Scotia's energy sector, including updates to demand-side management, efficiency programs, and regulatory frameworks.

1 5.1.8 Low-Income Performance Indicators 2 3 Low-income performance indicators for the BNI Efficient Product Rebate program are 4 provided in Table 17 below. 5

AI summary The section discusses low-income performance indicators for the BNI Efficient Product Rebate program, referencing Table 17 for detailed metrics. It is part of a regulatory proceeding evaluating energy efficiency initiatives in Nova Scotia.

10 5.1.9 Program Alternatives 11 EfficiencyOne considered the same key principles in both the development of the 2020- 2022 Preferred DSM Resource Plan and alternate scenario. The significant difference between the Alternative scenario and...

AI summary EfficiencyOne developed both a preferred DSM resource plan and an alternate scenario for 2020-2022, with the latter showing reduced participation due to lower energy savings and investment. Table 18 highlights differences in the BNI Efficient Product Rebates program between scenarios.

Demand Reduction Demand reduction initiatives are being introduced as part of the broader DSM portfolio in the Preferred Plan. These initiatives are meant to build on the demand reduction pilot beginning in 2019. Support for demand reducti...

AI summary Demand reduction initiatives are part of the DSM portfolio in the Preferred Plan, building on a 2019 pilot. The Custom Program supports maintaining the implementation structure while offering incentives for system-peak demand savings through studies, financial incentives, and financing.

Program History The Custom Incentives program began with a single component, Custom Retrofit, in May 2008. When Efficiency Nova Scotia began administering the program in 2010, it added a New Construction program component to help streamlin...

AI summary The Custom Incentives program, initiated in 2008, expanded under Efficiency Nova Scotia from 2010, adding New Construction and Building Optimization components. Pilots like compressed air optimization (2013) and Building Optimization (2014) broadened offerings. EMIS (2013) and SEM (2014) evolved to support energy efficiency. The program provides tailored financial and technical assistance for retrofits, new construction, and energy management.

Program Delivery The Custom Incentives program structure is designed to overcome customer barriers associated with large upfront costs, lack of in-house capacity and business case requirements. The program is delivered through a combinatio...

AI summary The Custom Incentives program aims to address customer barriers like upfront costs and lack of in-house capacity through a collaborative delivery model involving EfficiencyOne staff, contracted partners, and third-party resources such as engineering firms and HVAC automation companies.

1 5.2.8 Low-Income Performance Indicators 2 3 Low-Income performance indicators for the Custom Incentives program are provided 4 in Table 19 below. 5

AI summary The document references Table 19, which contains low-income performance indicators for the Custom Incentives program. No further details or analysis are provided in the excerpt.

9 5.2.9 Program Alternatives 10 EfficiencyOne considered the same key principles in both the development of the 2020- 2022 Preferred DSM Resource Plan and alternate scenario. The significant difference between the Alternate scenario and Ef...

AI summary EfficiencyOne compared its 2020-2022 Preferred DSM Resource Plan with an alternate scenario, noting reduced participation levels in the latter due to lower energy savings and investment. Table 21 illustrates this difference for the Custom Incentives program.

Table 21: Custom Incentives Performance Indicators - Comparison of Preferred and Alternate Plans Scenario Year Investment ($ million) First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Peak Demand Savings (MW) Total Resource Cos...

AI summary Table 21 compares the performance indicators of custom incentives under preferred and alternate plans from 2020 to 2022. It includes metrics like investment, energy savings, peak demand savings, and costs. The preferred plan shows higher investment and savings compared to the alternate plan, though the levelized and nominal costs of saved energy remain consistent across both scenarios.

5.3.6 Implementation Strategy

AI summary The document outlines an implementation strategy for demand-side management (DSM) and electricity efficiency programs in Nova Scotia. It references regulatory entities like NSUARB and NSP, along with acronyms related to energy policies, cost tests, and utility regulations. The strategy likely involves coordination between program administrators, utilities, and regulatory bodies.

4 5.3.9 Program Alternatives 5 EfficiencyOne considered the same key principles in both the development of the 2020- 2022 Preferred DSM Resource Plan and Alternate scenario. The significant difference between the Alternate scenario and Eff...

AI summary EfficiencyOne developed both a Preferred DSM Resource Plan and an Alternate scenario for 2020-2022. The Alternate scenario features reduced participation due to lower energy savings and investment levels. Table 24 illustrates these differences in the Direct Installation program.

Impact Evaluations Annual impact evaluations will provide EfficiencyOne, stakeholders, and the NSUARB with up-to-date impacts on net electrical energy and net system-peak demand savings as progress indicators towards the overall approved 2...

AI summary Annual impact evaluations will track progress towards the 2020-2022 DSM Resource Plan targets, providing updates on energy and system-peak demand savings. EfficiencyOne will determine whether a full or condensed evaluation is needed, with condensed reports referencing prior evaluations and including program changes.

1 those with recent changes or more variable savings parameters. The Evaluator will 2 design and conduct a full scope of evaluation activities for program components that 3 require a full impact evaluation. Process and Market Evaluations

AI summary The Evaluator is tasked with designing and conducting a full scope of evaluation activities for program components that require a full impact evaluation, particularly those with recent changes or more variable savings parameters.

Annual Progress Reports In the first quarter of each calendar year, EfficiencyOne will file an APR with the NSUARB, which will include the following information: - a summary of the context, activities and milestones achieved in the prior y...

AI summary EfficiencyOne must submit Annual Progress Reports (APR) to NSUARB annually, detailing prior-year activities, discrepancies, expenditures, and energy savings. If results fall below 75% of targets, a Corrective Action Plan is required. The Standardized Filing Framework for DSM Supply Agreements was approved by NSUARB (M07543).

1 terminating an existing Program; • 2 increasing the 3-year plan budget for the total Residential sector by more than 25 • 3 percent; 4 decreasing the 3-year plan budget for the total Residential sector by more than • 5 25 percent; 6 incr...

AI summary The text outlines proposed changes to the 3-year plan budget and savings targets for the Residential and BNI sectors, including potential increases or decreases by more than 25 percent. It also details the requirement for EfficiencyOne to file quarterly reports with the NSUARB and outlines the process for making mid-course adjustments to the DSM Resource Plan.

Performance Targets consist of: - i. Cumulative annual energy savings; - ii. Cumulative annual system-peak demand savings; and NSUARB would use its discretion to determine appropriate action. iii. Cumulative lifetime energy savings.

AI summary The document outlines three performance targets: cumulative annual energy savings, cumulative annual system-peak demand savings, and cumulative lifetime energy savings. The NSUARB reserves discretion to determine appropriate actions related to these targets.

8 4.3 OVERALL PARTICIPATION IMPACTS 9 Figures 4 through 7 present actual participation for 2011-2017 and estimates for 2018 10 through 2022. The 2011-2019 figures are presented here to provide context for the 11 2020-2022 estimates. The es...

AI summary The document analyzes participation data from 2011-2022, distinguishing between tracked and untracked participants. It notes that certain customer classes have 100% participation in BER-IR, while others show increasing rates. Figures 7-10 illustrate these trends.

Figure 9: Annual Participation Rates by Rate Class (tracked only) (Preferred Plan) Figure 10: Annual Participation Rates by Rate Class (tracked + untracked) (Preferred Plan)

AI summary The document presents two figures (Figure 9 and Figure 10) showing annual participation rates by rate class for the Preferred Plan, tracking both tracked and untracked participants. These figures are part of a regulatory proceeding involving Nova Scotia Power Inc. (NSP) and the Nova Scotia Utility and Regulatory Board (NSUARB), likely related to demand-side management (DSM) program performance metrics.

a customer with average energy use and no DSM savings. 'Total Customers' is a hypothetical scenario that does not differentiate between Participants and Non-Participants. This graph shows monthly bill impacts relative to the no-DSM scenari...

AI summary The text discusses graphical analyses of demand-side management (DSM) program impacts on customer bills, participation rates, and customer classifications. It highlights hypothetical scenarios like 'Total Customers' and differentiates between tracked and untracked participants in DSM programs, emphasizing metrics for evaluating program effectiveness.

Energy Savings Actions (Home Energy Report) participation Customers receiving the Home Energy Report were modeled as new participants in 2013. The same cross-participation rates used for Residential Instant Savings are used for the Home En...

AI summary The Home Energy Report program modeled participants as new in 2013, using cross-participation rates from Residential Instant Savings, assuming no impact on other ENS programs. The program ended in 2015, but the web portal remained accessible until 2016.

23 Q: Please summarize your perspective, testimony, and primary finding. 24 A: First, as for my overall perspective, I am interested in encouraging initiatives and technology 25 that create economic value, enhance energy justice, protect c...

AI summary The testifier supports energy efficiency initiatives that create economic value and reduce emissions, emphasizing the need for program administrators to quantify savings. They highlight declining lighting savings due to technology changes and advocate for portfolio diversification to maintain cost-effectiveness. EfficiencyOne's approach to addressing these challenges is endorsed as strategic for Nova Scotia's ratepayers.

26 Q: Does your testimony include any specific recommendations? And if so, can you please 27 summarize them? 1 A: Yes. I recommend that the Board not be misled into thinking that because the unit cost of saved 2 energy increases, due to th...

AI summary The witness recommends against reducing efficiency investments despite higher unit costs, emphasizes ongoing engagement with EfficiencyOne, acknowledges past successes in lighting markets, and suggests maintaining distinctions between residential and commercial markets. They stress the importance of diversifying portfolios and stakeholder collaboration to meet policy goals.

V . Diversifying Energy Efficiency Portfolios - What can you say about the response of program design and implementation to the trends and shifts you have described above? - 6 A: Over time, programs will ramp down spending for lighting, wh...

AI summary The response outlines a strategic shift in energy efficiency programs from lighting to diverse technologies like appliances, HVAC, and industrial processes. Efficiency Vermont's forecasts (Figures 24-25) show declining lighting savings but growing potential in non-lighting areas, emphasizing portfolio diversification to maintain overall savings despite budget constraints.

1 VII. Recommendations - 2 Q: Please list any recommendations you have for the Board. - 3 A: In this proceeding, I am recommending that the Board commend EfficiencyOne for the proactive - 4 approach they are taking to recognizing the light...

AI summary The testifier recommends the Board commend EfficiencyOne for their proactive approach to lighting transitions and direct them to focus on cost-effective opportunities in C&I markets. They suggest applying successful lighting strategies to other markets and maintaining cost-effectiveness despite rising unit costs, emphasizing the value of efficiency for Nova Scotia's power system and economy.

Selected Publications - 2018 Pennsylvania's Solar Future Plan: Strategies to Increase Electricity Generation from In-state Solar Energy. Pennsylvania Department of Environmental Protection, November. Led the VEIC team that conducted the sc...

AI summary Selected publications focus on energy efficiency, solar energy, and policy initiatives from 2000 to 2018. Key contributors include the American Council for an Energy-Efficient Economy (ACEEE), U.S. Department of Energy (DOE), and Vermont Energy Investment Corporation (VEIC). Topics include solar market development, renewable energy assessments, and climate policy recommendations.

- Emily Levin, Managing Consultant, Energy Services: Experience from other jurisdictions in energy efficiency lighting program trends and analysis, and diversification of portfolios. - o Areas of expertise and projects. Emily provides ener...

AI summary Emily Levin and Pierre van der Merwe, both from VEIC, provide expertise in energy efficiency program design, data analytics, and evaluation. Levin's work includes leading initiatives with NYSERDA and EmPOWER Maryland, while van der Merwe oversees technical operations and program analytics for VEIC's evaluation and measurement activities.

- From Nova Scotia Power's perspective, yield 4.8 dollars for every dollar invested in DSM 2 over the lifetime of the installed measures. - From a total resource cost perspective, which includes participating customer costs, 4 yield 2.0 do...

AI summary Nova Scotia Power (NSP) highlights that DSM 2 investments yield $4.8 per dollar over the lifetime of measures, with total resource cost analysis showing $2.0 per dollar. Rate impacts vary by class (0.8%-1.7%), while participant bills reduce 1-11%, offsetting nonparticipant increases via high EfficiencyOne program participation. Benchmarking against North American peers assesses EfficiencyOne's savings and spending合理性.

this benchmarking? - 3 A: We believe that is important to use comparable data that overlaps with EfficiencyOne's - 4 2020-2022 Plan timeframe in comparing metrics across PAs. As Dr. David Hill of Vermont Energy - 5 Investment Corporation d...

AI summary The text discusses benchmarking EfficiencyOne's 2020-2022 Plan against other Program Administrators (PAs), noting challenges due to evolving lighting efficiency trends and limited data availability. It emphasizes using comparable 2020-2022 timeframe data, acknowledges the need for portfolio diversification, and explains the use of 2017 sales/revenue data as a denominator due to limited projections.

rences in parameters like hours of use, net-to-gross ratios, or heating and cooling degree days, but some may reflect different evaluation cycles and the use of potentially dated planning assumptions. - 1 Program Administrator Size . Econo...

AI summary The text discusses factors influencing the cost-effectiveness of Demand-Side Management (DSM) programs, including economies of scale from statewide implementation, administrative cost variations with program maturity, and the role of account management for Commercial and Industrial (C&I) customers in reducing incentive costs.

13 Q: What are the results from your benchmarking? 14 A: First, it is important to put EfficiencyOne's proposed savings levels into context relative to its benchmarked peers. As can be seen from Figures 1 and 2 below, EfficiencyOne's 2020...

AI summary EfficiencyOne's 2020 and 2021 energy savings as a percent of sales (1.4%) are lower than most of its peers, with non-EfficiencyOne benchmarked PAs planning to achieve savings above 1.5% and some exceeding 2.0%. EfficiencyOne's proposed spending as a percent of revenue is lower than other PAs, and its cost of saved energy is lower than New England PAs but slightly higher than non-New England PAs. EfficiencyOne's lifetime cost rate is significantly lower than other PAs.

PROFESSIONALSUMMARY Glenn Reed has more than 30 years of experience in demand-side management (DSM) program planning and evaluation; energy-efficiency policy development and implementation; building codes and appliance standards developmen...

AI summary Glenn Reed, with over 30 years of experience in demand-side management and energy efficiency, has led residential energy programs for Connecticut, Massachusetts, and Rhode Island. He previously worked at NEEP, DNV GL, and MA EEOER, contributing to initiatives like upstream lighting. His expertise spans policy development, building codes, and program implementation.

5. NOTIFICATION OF SIGNIFICANT CHANGES 5.1 EfficiencyOne shall provide notice of Significant Changes to NSPI at the same time as EfficiencyOne makes application to the UARB for the approval of the Significant Changes. Subject to the terms...

AI summary EfficiencyOne must notify NSPI when applying to the UARB for approval of significant changes to the EECA Plan. NSPI may submit written comments to the UARB regarding these changes, subject to the Public Utilities Act and UARB's discretion.

12. PERFORMANCE REQUIREMENTS AND EVALUATIONS 12.1 EfficiencyOne's performance under the terms of this Agreement shall be measured in accordance with the performance requirements established by the UARB pursuant to Section 79M of the Act as...

AI summary EfficiencyOne's performance under the agreement is evaluated based on the UARB's performance requirements outlined in Schedule 'C' and Section 79M of the Public Utilities Act (PUA).

25. COORDINATION MEETINGS AND REPORTS - 25.1 During the Term of this Agreement, EfficiencyOne shall prepare and deliver to the UARB and NSPI a quarterly report (the " Quarterly Report ") in a form acceptable to the UARB. - 25.2 EfficiencyO...

AI summary EfficiencyOne must submit quarterly and annual reports to UARB and NSPI, with the annual report detailing EECA progress, financials, and evaluations. Quarterly coordination meetings between NSPI and EfficiencyOne are required to ensure effective EECA planning and implementation.

Presentation Summary EfficiencyOne has developed an electronic technical reference manual (eTRM) which relies on three core components: - 1. Energy Savings Platforms (ESP) - 2. Dynamic DSM (DDSM) - 3. Evaluation reports These three compone...

AI summary EfficiencyOne's eTRM integrates Energy Savings Platforms, Dynamic DSM, and Evaluation reports to enhance operationalization, reduce errors, and improve transparency in energy savings algorithms. This approach contrasts with traditional TRMs by enabling real-time modifications and historical tracking, offering greater flexibility and integration with program administration.

DDSM

AI summary The document discusses Demand-Side Management (DDSM) in Nova Scotia, involving regulatory considerations, program evaluations, and stakeholder input. Key entities include Nova Scotia Power, the Nova Scotia Utility and Regulatory Board (NSUARB), and various efficiency programs. Topics focus on energy conservation, cost-benefit analysis, and compliance with regulatory frameworks.

Project Energy savings Demand savings

AI summary The document outlines a project focused on energy and demand savings, though specific details, arguments, or entities involved are not provided in the text. Key regulatory and technical terms related to energy efficiency and utility management are referenced contextually.

DDSM

AI summary The document discusses Demand-Side Management (DDSM) in Nova Scotia, involving regulatory considerations, program evaluations, and stakeholder input. Key entities include Nova Scotia Power, the Nova Scotia Utility and Regulatory Board (NSUARB), and various efficiency programs. Topics focus on energy conservation, cost-benefit analysis, and compliance with regulatory frameworks.

Project Energy savings (calculated) Demand savings (calculated)

AI summary The Project section outlines calculated energy and demand savings metrics, which are key factors in assessing the efficiency and impact of energy-related initiatives under regulatory review.

Lighting Calculator $$\Delta kWh = (W_b - W_e) HRS QTY$$ $$\Delta kW = (W_b - W_e) x QTY$$

AI summary The Lighting Calculator provides formulas to estimate energy savings (ΔkWh) and demand reduction (ΔkW) from lighting upgrades, using variables for baseline wattage (W_b), efficient wattage (W_e), hours of operation (HRS), and quantity (QTY). No explicit claims, entities, or regulatory references are mentioned in the text.

Heat Pump Calculator $$\Delta kWh$$ $$= \left(HC \left[\frac{1}{HSPF_{base}} - \frac{1}{HSPF_{ee}}\right] FLH_h + CC\right)$$ $$ \left[\frac{1}{SEER_{base}} AC - \frac{1}{SEER_{ee}}\right] FLH_c QTY$$ $$\Delta kW = \frac{HC_{min}}{3.412} \...

AI summary The document presents mathematical formulas for calculating energy savings from heat pumps, incorporating variables like HSPF (Heating Seasonal Performance Factor), SEER (Seasonal Energy Efficiency Ratio), COP (Coefficient of Performance), and factors such as heating/cooling load hours (FLH) and quantity (QTY). The equations quantify kilowatt-hour (kWh) and kilowatt (kW) reductions based on efficiency improvements.

pply Agreement for Electricity Efficiency and Conservation Activities between E1 and Nova Scotia Power Inc. (DSM 2020- 2022) M09096 (E-ENS-R-19) E1 Responses to Nova Scotia Power Inc. (NS Power) NON-CONFIDENTIAL Stakeholder Comment How com...

AI summary The document outlines responses to stakeholder comments on the DSM 2020-2022 agreement between E1 and NS Power. It includes comparisons of the Preferred Plan and Alternate Scenario, data on end-use shifts (e.g., lighting, heat pumps), and explanations of E1's focus on demand savings. References to appendices and expert testimony are provided.

ement for Electricity Efficiency and Conservation Activities between E1 and Nova Scotia Power Inc. (DSM 2020- 2022) M09096 (E-ENS-R-19) E1 Responses to Nova Scotia Power Inc. (NS Power) NON-CONFIDENTIAL 1 Request IR-06: 2 3 (a) Please conf...

AI summary EfficiencyOne (E1) reported achieving 151.4 GWh of first-year energy savings and 25.5 MW of peak demand savings in 2018, with cumulative totals of 419.0 GWh and 75.2 MW over 2016–2018. The response references evaluation reports and annual progress reports for these figures.

N/A N/A Total 34.4 188.0 123.2 1817.1 33.3 2.1 5.5 Incremental Incremental Lifetime Energy Annual Net Program Investment ($ Lifetime Benefits Annual Net Total Resource Year Savings at Demand Savings Administrator million) ($ million)a Ener...

AI summary The text presents a table with columns related to energy program metrics, including incremental investment, lifetime energy savings, annual net benefits, and cost tests (TRC and PAC). It appears to evaluate program administrator performance and resource costs within a regulatory context.

Generator (GWh) (MW) 2020 33.4 171.0 123.2 1774.5 32.8 2.0 5.1 2021 34.2 181.4 124.1 1819.6 33.5 2.1 5.3 2022 34.4 188.0 123.2 1817.1 33.3 2.1 5.5 Total 102.0 540.3 370.5 5411.2 99.5 2.1 5.3 aLifetime benefits are expressed as the net pres...

AI summary The text defines TRC (Total Resource Cost Test) and PAC (Program Cost Test) as benefit/cost ratios comparing lifetime benefits to combined or individual costs. It references avoided costs (energy, capacity, transmission/distribution) and utility WACC for net present value calculations, emphasizing cost-benefit analysis frameworks for program evaluation.

N/A N/A Total 27.1 128.2 99.8 1433.0 22.3 2.0 4.7 Incremental Incremental Lifetime Energy Annual Net Program Investment Lifetime Benefits Annual Net Total Resource 2021 a Savings at Demand Savings b Administrator ($ million) ($ million) En...

AI summary The text provides a summary of investment, benefits, and costs related to energy programs, including incremental investments, lifetime benefits, energy savings, and cost tests such as the Total Resource Cost Test (TRC) and Program Cost Test (PAC).

Generator (GWh) (MW) 2020 27.1 128.2 99.8 1433.0 22.3 2.0 4.7 2021 27.1 132.4 97.8 1421.9 22.2 2.1 4.9 2022 26.8 136.2 94.5 1408.5 21.7 2.1 5.1 Total 81.0 396.8 292.0 4263.4 66.2 2.1 4.9 aLifetime benefits are expressed as the net present...

AI summary The text provides data on generator output in gigawatt-hours (GWh) and megawatts (MW) for the years 2020 to 2022, including totals. It also defines terms such as 'Lifetime benefits,' 'TRC,' and 'PAC,' which are used to evaluate the net present value of avoided costs and benefit/cost ratios in energy efficiency programs.

bTRC is a benefit/cost ratio of comparing lifetime benefits to the sum of EfficiencyOne's and participants' costs. cPAC is a benefit/cost ratio comparing lifetime benefits to EfficiencyOne's costs. Note: These results have not subject to t...

AI summary The document discusses the Total Resource Cost Test (TRC) and Program Cost Test (PAC), which are benefit/cost ratios used to evaluate the EfficiencyOne 2020-2022 DSM Resource Plan. The plan involves a $34M investment level and outlines incremental benefits and costs associated with energy savings and demand reductions.

NON-CONFIDENTIAL 1 • Independent Reviews – The evaluation of energy savings and the audit of financial 2 statements have been conducted since 2010. The internal audit function was 3 introduced in 2013. 4 • Process Improvement – The introdu...

AI summary EfficiencyOne has implemented several cost management strategies, including independent reviews and process improvement initiatives like LEAN. It also uses benchmarking and market research to ensure its costs align with industry standards, referencing CLEAResult and other market research reports.

29, 2019 NS Power IR-15 Attachment 1 Page 14 of 206 EFFICIENCYONE INCENTIVE SETTING METHODOLOGY FILING (E-ENS-R-16) 1 4. ONGOING REPORTING ON IMPLEMENTATION PROGRESS 2 EfficiencyOne is committed to keeping the Board and stakeholders inform...

AI summary EfficiencyOne is committed to reporting on the implementation of CLEAResult’s recommendations through quarterly reports, an annual progress report, and an external evaluation and verification process.

1. Instant Savings 2. Custom 8 We change the way people use energy™ Date Filed: March 29, 2019 NS Power IR-15 Attachment 1 Page 25 of 206 The purpose of this simulation was to evaluate EfficiencyOne’s current incentive levels. To support t...

AI summary This text discusses a simulation conducted to evaluate EfficiencyOne's current incentive levels, comparing them to three thresholds: cost to customer, program budget, and cost effectiveness.

ducted to evaluate the current incentive levels versus the three incentive level thresholds: 1. Cost to Customer 2. Program Budget 3. Cost Effectiveness For Instant Savings, most of the incentive levels were within an appropriate range, bu...

AI summary The document evaluates the incentive levels in EfficiencyOne's programs against three thresholds: cost to customer, program budget, and cost effectiveness. It recommends further investigation and financial simulation for certain incentives, particularly for heavy-duty timers and outdoor clotheslines, and emphasizes the need for consistent, consolidated analysis and documentation.

405.9 62.5 Final Order $102.15 million 405.9 62.5 Table 1: EfficiencyOne Targets and Budgets Between the Quantum Agreement and the Decision, there was a regulatory hearing to address a number of issues that the UARB had identified in its F...

AI summary EfficiencyOne is required to conduct research on incentive setting practices following guidance from the UARB, which emphasized the need for a more rigorous approach to determine minimum incentive levels that encourage participation with quantitative analysis.

. Lastly, Nova Scotia’s energy efficiency policies and the associated regulatory structure were also studied to fully understand how they currently drive incentive setting for ENS’s programs. Review of Efficiency Nova Scotia’s Historical P...

AI summary The document discusses a review of Efficiency Nova Scotia's (ENS) historical program performance and incentive setting methodologies. It outlines an analysis of ENS's programs, including Instant Savings, Custom, Business Energy Rebates, and Home Energy Assessment, and compares them to recommended methodologies informed by jurisdictional best practices.

are captured under program administration costs. It should be noted that there is a cost associated with providing the convenience incentive, regardless of whether they are accounted for as financial incentives or fall under other program...

AI summary The text discusses the categorization of convenience incentives in energy efficiency programs, including examples like appliance retirement and direct install. It notes that while some convenience-related costs are accounted for as financial incentives, others are considered part of good customer service or program delivery, not incentives.

participation may indicate a change in market conditions to their market which can support a reduced incentive rate  Program evaluation suggests poor  Program evaluation suggests Program Evaluation program and market performance due to c...

AI summary The text discusses program evaluation and historical experience, highlighting that poor program performance may be due to insufficient financial incentives. It also suggests that market conditions and customer motivations beyond financial incentives can influence incentive rates.

tomer Participation Forecasts Findings reporting Incentive Customer and Supply Chain Technology Financial Impact & Risks Thresholds Engagement Other Supply Chain Cost-Effectiveness Testing Monitor and Manage Considerations Periodic Updatin...

AI summary The text outlines a methodology for identifying best practices in incentive setting, focusing on customer participation forecasts, financial impact, cost-effectiveness testing, and periodic updating. It highlights the importance of research and engagement in the process.

ratepayers, or a bundling incentive option being considered, they should be noted and the participation forecast adjusted accordingly. Using preliminary incentive rates The Energy Trust of Oregon is mindful of the impact of Program adminis...

AI summary The text discusses the financial impacts and risks associated with incentive rates used in energy programs. It emphasizes the importance of balancing market barriers with incentive rates and adjusting participation forecasts accordingly. The Energy Trust of Oregon is mentioned as an example of an organization involved in this process.

General Principle Definition Examples Identified Best Practice can set the stage for incentive administration and incentive funding in its programs  Determine the impact of adjustments in order to properly balance required to overcome the...

AI summary The text discusses the importance of balancing incentive rates with market barriers and program requirements to achieve savings goals. It highlights the need to assess the impact of incentives on program budgets and identify potential budget constraints that may hinder program effectiveness.

constraints may hinder the desired rates on total program budgets. program delivery strategies to overcome customer barriers

AI summary The text discusses how constraints may affect the rates on total program budgets and the need for program delivery strategies to overcome customer barriers.

The cost effectiveness of measures, The following cost effectiveness programs and portfolios should be PG&E performs streamlined cost effectiveness testing at testing best practices should be tested to determine whether a every stage of th...

AI summary The text discusses the importance of cost effectiveness testing for energy programs and portfolios, emphasizing that jurisdictions like PG&E and the Energy Trust of Oregon perform such testing at multiple levels to ensure proper market transformation and compliance with regulatory standards.

cognize local avoided costs, and to consider discount and premium zones for electricity conservation. This position will be considered in any incentive methodology recommendations. OTHER CONSIDERATIONS Through the most recent program evalu...

AI summary The document discusses the need to consider local avoided costs and discount/premium zones for electricity conservation. It highlights issues with savings attribution in educational initiatives, particularly the Home Energy Reports (HER) program, and notes the use of an average wattage approach for energy savings estimates, which may present challenges in determining lifetime energy savings.

We change the way people use energy™ Date Filed: March 29, 2019 NS Power IR-15 Attachment 1 Page 59 of 206  Current Incremental Equipment Cost;  Forecast Incremental Equipment Cost (in 1 year);  Energy Savings;  Expected Energy Savings...

AI summary The text outlines parameters for setting incentive levels in energy efficiency programs, including incremental equipment costs, energy savings, and incentive thresholds. It emphasizes the importance of reviewing these parameters through processes like TRM updates and program evaluations, especially when market penetration exceeds 50 percent.

aluations, this information for prescriptive measures can be reviewed and updated annually or bi-annually as required. During these review, all parameters listed can be updated accordingly. SUPPLY CHAIN AND SERVICE PROVIDER RESEARCH The su...

AI summary The document discusses the importance of regularly reviewing prescriptive measures and engaging with the supply chain and service providers to gain insights for incentive setting and program design. It also highlights the need to analyze the financial impacts of incentive changes, including current incentives, participation forecasts, and market penetration.

individual cost effectiveness incentive level thresholds for each measure. The data points and functionality needed to build an appropriate consolidated calculator are listed in Appendix B. 6. What is the proposed incentive, forecasted par...

AI summary The text discusses the process of determining incentive levels for energy efficiency measures, including the use of cost effectiveness thresholds and the development of a consolidated calculator. It also mentions the importance of historical performance in forecasting participation and incentive expenditures.

General Principle Current Activities Recommended Activities EfficiencyOne currently understands  EfficiencyOne’s ability to collect cost/price information through program delivery technology savings, price and market and account managemen...

AI summary EfficiencyOne is recognized for its current methods of collecting cost/price information through program delivery and account management. It is recommended that EfficiencyOne continue these activities and introduce a formal measures assumption validation process and summary manual, supported by primary or secondary research and periodic reviews.

Understand Technology covered by the program evaluations. Please refer to the Technology Savings, Price and Research section for a list of parameters that CLEAResult recommends Market Penetration including in the research. o For LEDs in th...

AI summary The text discusses the need for annual updates to technology parameters related to LEDs in residential and commercial sectors, to be reviewed by a committee of technical experts. The updates should be aligned with program evaluations for collaboration and efficiency.

General Principle Current Activities Recommended Activities EfficiencyOne conducts cost effectiveness  EfficiencyOne should continue understanding the macro-level budget impacts testing using the TRC test. The TRC is from incentive level...

AI summary EfficiencyOne conducts cost-effectiveness testing using the TRC test at both measure and program levels. The TRC is used to qualify measures and screen programs for implementation, while considering strategic considerations. The document recommends improving the granularity of data tracking to better manage program risks and adjust spending accordingly.

program. This provides a recent example of savings are affected by the technology consumption, should also be Technology Savings, proactivity regarding the incentive setting process. updated annually for savings assumptions. Price and Mark...

AI summary The document discusses the annual review and updating of energy savings assumptions for LED technology in residential and commercial sectors, highlighting the need for proactivity in the incentive setting process and the impact of market penetration and price on savings. The Achievable Potential Study from 2014 is referenced as a basis for understanding technology stock.

understanding of the stock of different technologies in the residential sector, some of which are associated with the Instant Savings program. For Instant Savings, EfficiencyOne gains an understanding of customer motivations and  Conduct...

AI summary The document discusses the Instant Savings program and how EfficiencyOne understands customer motivations and barriers through market research and program evaluation. Annual surveys and price sensitivity research are conducted to assess participation and identify free ridership and spillover savings.

may be difficult to gather this insight as it is understood that retailers Additionally, the delivery agent provides EfficiencyOne with an open channel of reserve the right to make “game time” decisions regarding product communication to r...

AI summary The text discusses challenges in gathering insights from retailers and the delivery agent regarding program performance, particularly in real-time reporting. It highlights the importance of complementary incentives to increase participation and the need for these factors to be considered in incentive analysis.

difficult to achieve for this improvement. program, which prevents instant correction. For Instant Savings, EfficiencyOne gains an understanding of financial impacts through  The current activities should be continued. the following activ...

AI summary The document discusses the Instant Savings program and the need for ongoing program evaluation, planning, and financial analysis. It highlights the importance of reviewing energy savings assumptions and net-to-gross ratios to ensure cost-effectiveness, with a regulatory requirement of a TRC of ≥1.0 at the program level.

For the Custom Program, EfficiencyOne gains an  Market research should continue to be conducted, especially for understanding of customer motivations and barriers through: areas that are underperforming in terms of participation.  From t...

AI summary The document discusses the need for continued market research, program management, benchmarking, and evaluation for EfficiencyOne's Custom Program, particularly focusing on understanding customer motivations and barriers in underperforming areas and the large commercial and industrial sector.

s a ceiling for individually negotiated incentives with each prospective program participant. Program Evaluation Through the annual program evaluation process, participant surveys are conducted to determine free ridership and spillover sav...

AI summary The text discusses the use of a ceiling for individually negotiated incentives with program participants and mentions the annual program evaluation process, which includes participant surveys to determine free ridership and spillover savings.

For the Custom Program, EfficiencyOne gains an  The current activities should be continued. understanding of the supply chain and service provider  EfficiencyOne’s should use its active program management and considerations through: prog...

AI summary The document outlines the need for EfficiencyOne to continue its engagement with the supply chain through ongoing program management and evaluation. This includes understanding market penetration of technologies and validating customer motivations and barriers.

EfficiencyOne’s Business Development Managers regularly interact with the supply chain. Program Evaluation

AI summary EfficiencyOne’s Business Development Managers frequently engage with the supply chain. The text also mentions Program Evaluation, indicating a focus on assessing the effectiveness of programs.

Through the annual program evaluation process, there are interviews conducted with select supply chain partners to understand their perspectives and suggestions for improvement. CLEAResult recommends that: For the Custom Program, Efficienc...

AI summary The document discusses the annual program evaluation process, emphasizing interviews with supply chain partners and recommendations for improving the Custom Program. CLEAResult suggests continuing current activities, implementing general principles, and expanding cost-effectiveness analysis to include Program Administrator Costs.

For the Business Energy Rebates Program, EfficiencyOne gains an understanding of  Continue to conduct the market research, especially customer motivations and barriers through: for areas where participation is underperforming.  From the...

AI summary The text discusses the Business Energy Rebates Program managed by EfficiencyOne, emphasizing the importance of continuing market research, program management, benchmarking, and evaluation to understand customer motivations and barriers, particularly in areas with underperforming participation.

program. They work with both the distributors in the midstream program and customers who access the downstream application process. Through these efforts, as well as the need for project invoices to be submitted, reference points are provi...

AI summary The text discusses program benchmarking and evaluation, including the use of incentives based on a similar program from Efficiency Vermont and the annual evaluation process to determine free ridership and spillover savings through participant surveys.

 Continue the current activities of engaging the supply chain and reviewing the project invoices to understand technology savings and pricing. For the Business Energy Rebates program, EfficiencyOne gains an understanding of  Investigate...

AI summary The text discusses ongoing activities related to the Business Energy Rebates program, including program management, evaluation, and investigations into methods to understand program participant operating hours. It also mentions the implementation of recommendations from a General report.

ed recently. Savings, Price and Market  Implement the recommendations in the General Penetration EfficiencyOne currently captures technology savings and cost information through Principles section to support this program. Those discussion...

AI summary EfficiencyOne captures technology savings and cost information through discussions with manufacturers and distributors, as well as project invoices. Program evaluations review and update energy savings assumptions annually. The program should analyze technology penetration using semi-annual surveys for commercial lighting and VFD technologies.

acts with the supply chain regularly through the Program Manager, Business Development Manager and Application Coordinators. Program Evaluation Through the annual program evaluation process, interviews are conducted with select supply chai...

AI summary The document outlines the process of evaluating the Business Energy Rebates Program through ongoing program management, interviews with supply chain partners, and implementing recommendations from the General Principles section to improve the program and introduce new measures.

2. Program Evaluation. introduction of new measures. 64 Date Filed: March 29, 2019 NS Power IR-15 Attachment 1 Page 81 of 206 Ongoing Program Management Due to ongoing program management, the costs of the products are always monitored. Thi...

AI summary The document discusses ongoing program management and evaluation, highlighting the monitoring of product costs and incentives, as well as the review and potential update of energy savings assumptions and net-to-gross ratios during program evaluation.

n the Home Energy Assessment program. It was found that General Principles, the semi-annual some customers were implementing a subset of recommended measures after receiving an audit report, although they surveys for residential HVAC did n...

AI summary The Home Energy Assessment program found that initial audits provided benefits to homeowners and helped reduce unit costs through spillover savings. Research indicated a 25% incentive was more effective than interest-free financing in encouraging major efficiency upgrades. This informed decisions to further subsidize audit incentives and continue ongoing program management and benchmarking.

for new measures) and program Barriers for EfficiencyOne conducted demographic research to understand the characteristics of the general population, program evaluation. Participation participants and non-participants. Ongoing Program Manag...

AI summary EfficiencyOne conducts demographic research and program evaluation to understand participation barriers and motivations. The program benchmarks incentives against a federal program that was discontinued in 2012, leading to reduced participation. Annual evaluations assess free ridership and spillover savings.

For the Home Energy Assessment program, EfficiencyOne gains an understanding of technology savings, price and  The current activities of engaging the penetration through the following activities: Service Organizations and Natural Resource...

AI summary The Home Energy Assessment program by EfficiencyOne involves ongoing management and evaluation to capture technology savings. Discussions with service organizations and Natural Resources Canada are ongoing, and recommendations from the General Principles section are to be implemented.

pport this analysis. changes and introduction of new measures. Understand Program Evaluation  Additionally, EfficiencyOne should Technology start to understand the technology Annually, through the program evaluation process, the energy sa...

AI summary The document discusses the importance of program evaluation, specifically reviewing energy savings assumptions annually and understanding technology penetration in residential HVAC and building envelope technologies in Nova Scotia.

am Management Considerations Through the delivery of the program, EfficiencyOne interacts with the supply chain regularly through the discussions with the service organizations. Program Evaluation Through the annual program evaluation proc...

AI summary The document discusses EfficiencyOne's program management and evaluation processes, including interactions with supply chain partners and annual evaluations to gather feedback and identify areas for improvement.

Page 84 of 206 General Principle Current Activities Recommended Activities For the Home Energy Assessment program, EfficiencyOne gains an understanding of financial impacts through the  The current activities should be following activitie...

AI summary The Home Energy Assessment program's financial impacts are understood through program evaluation, which involves reviewing and updating energy savings assumptions and net-to-gross ratios to ensure cost-effectiveness. Current activities are recommended to continue, and general principles should be implemented to support the program, including changes to incentive levels and introduction of new measures.

Other Considerations for the Home Energy Assessment Program The Home Energy Assessment program recently introduced an updated incentive structure, which featured an increased incentive for the initial audit, and premiums associated with bu...

AI summary The Home Energy Assessment Program introduced updated incentives, including increased initial audit incentives and bundled incentives to encourage larger projects. Early data from CLEAResult shows increased savings and lower unit costs, though it is difficult to isolate the effects of bundling. Bundling is seen as a useful strategy for programs with high customer acquisition costs, and personal energy planning services have enhanced customer understanding and project savings.

based on the analysis for the dimmer switch. It should also be noted that the difference between the customer cost and the PME for both of these measures is ≤two percent of the customer cost. From reviewing the current incentive compared t...

AI summary The text discusses incentive levels for various energy efficiency measures, noting that most fall within acceptable ranges, except for ENERGY STAR® A Lamps, Heavy-Duty Timers, and Programmable Thermostats. It also outlines the program budget incentive level threshold and administrative costs.

roject incentives, EfficiencyOne should take into consideration the energy savings persistence of the project. Comparison of Current Incentive Level to Incentive Level Thresholds Cost to Customer Program Budget Cost Effectiveness Measure I...

AI summary The document discusses the need for EfficiencyOne to track incremental costs to better understand the cost to the customer, noting that these costs differ from project costs and influence equipment replacement decisions. It also states that the Custom Program's incentive levels are appropriate and do not exceed the program budget threshold.

 Financial Impact  Cost Effectiveness Impact  Program Operations Impact including changes to processes, documents and implementation considerations The business case, once developed, is reviewed by the relevant LDC-IESO working groups,...

AI summary The document discusses the process of developing and reviewing incentive levels for energy efficiency programs, including input from market research, program evaluations, and best practices. The IESO and LDCs are involved in this process, with annual evaluations and specific review cycles for certain programs.

chment 1 Page 107 of 206 participants; and analyzing what future impacts would be on uptake, the budget and cost effectiveness based on current and future participation trends. ONTARIO CORE PROGRAM OFFERINGS (RESIDENTIAL AND BUSINESS) Curr...

AI summary The text discusses Ontario's conservation programs, which cover various sectors and include financial incentives, coaching, assessments, and training initiatives. Ontario has conducted rigorous evaluations of its programs, leading to higher energy efficiency baselines. A new pay-for-performance framework for LDC funding of Conservation Program delivery was recently released.

and for assessing the appropriateness DSM plans for 2015-2020. The framework can also be used in gas utilities’ proposal reviews/approvals for their DSM plans by the OEB. Guiding principles include: 1. Invest in DSM where the cost is equal...

AI summary The document outlines guiding principles for assessing DSM plans, emphasizing cost-effectiveness, customer participation, and integration with other energy efficiency efforts. It also mentions the submission of annual budgets, eligibility criteria, and studies for OEB approval, including a mid-term review in 2018 to assess performance and impact on customer rates and shareholder incentives.

 Infrastructure Resource Planning study  Natural Gas Conservation Potential study  Report on free rider reduction efforts and results across all programs  On-bill presentment status report  Joint studies and initiatives with electric...

AI summary The text outlines the various studies and reports related to gas utilities in Ontario, including infrastructure resource planning, natural gas conservation potential, and program evaluation. The OEB is leading program evaluation starting in 2016, with the Evaluation Contractor and Evaluation Advisory Committee. The historical performance of DSM programs for natural gas utilities is also detailed, including savings and costs from 2012 to 2014.

luding financial, marketing and communications, administration and staffing requirements and program evaluation. The OEB has approved annual DSM budgets for the 2015-2020 with modifications: Figure 19: Gas Program Budgets 4 Figure 20: Gas...

AI summary The document discusses the approval of annual DSM budgets by the OEB for 2015-2020, including financial and program evaluation aspects. Gas utilities have set targets and performance metrics, using a weighted scorecard approach that emphasizes lifetime natural gas savings. Union Gas also proposed specific metrics targeting various programs and participant categories.

NS Power IR-15 Attachment 1 Page 136 of 206 2013-2015 Total Portfolio $/kWh 2013 2014 2015 Gross Savings (kWh) 828,999,924 845,181,086 769,529,791 Spending $ 317,221,372 $ 365,056,021 $ 385,199,846 $/kWh $ 0.38 $ 0.43 $ 0.50 Excludes C&S,E...

AI summary The text provides data on PG&E's energy efficiency programs from 2013 to 2015, including gross savings, spending, and cost-effectiveness ratios. It outlines the incentive-to-administrative spending ratios and highlights the requirement for California PAs to maintain a TRC and PAC greater than 1.

sting incentive rate (change in incentive greater than 50 percent). Please note that PG&E uses a streamlined version of the E3 Cost Effectiveness model at each stage in order to calculate preliminary measure level incentives and cost effec...

AI summary PG&E uses a streamlined version of the E3 Cost Effectiveness model to set incentives for energy efficiency measures, ensuring market transformation goals are met while maintaining portfolio-level cost effectiveness. Market research and work papers are used to determine measure performance metrics, costs, and savings calculations, with work papers approved by the Commission before measures are offered with a Public Agency.

We change the way people use energy Date Filed: March 29, 2019 NS Power IR-15 Attachment 1 Page 140 of 206 APPENDIX A-5: OREGON & WASHINGTON (ENERGY TRUST OF OREGON) BACKGROUND Efficiency Nova Scotia has contracted CLEAResult to conduct en...

AI summary Efficiency Nova Scotia has contracted CLEAResult to conduct research on best practices for incentive rate setting in energy conservation and efficiency programs. The research includes interviews with key contacts in other jurisdictions and will be used to optimize program design and delivery for conservation and environmental protection goals. The findings will be submitted to the Utility and Review Board (UARB) and made publicly available.

Idea Generation & Preliminary Measure Detailed Measure Measure Approval Vetting Development Development • Identify new measure • Collection and • Identify technical • Finalize MAD from multiple souces analysis of preliminary guidelines and...

AI summary The text outlines a process for generating and developing new measures, including identifying sources, analyzing preliminary information, addressing data gaps, engaging stakeholders, and conducting cost-effectiveness testing. It also mentions the creation of a Measure Approval Document (MAD) and the role of the Manager of Planning and Engineering.

• If measure is sufficient available identified as a good fit and reliable data, for current program, it strong stakeholder is promoted to the interest, cost effective detailed development and proper timing and stage fit it is promoted to...

AI summary The text outlines a process for evaluating energy efficiency measures, promoting those with sufficient data and stakeholder support to the approval stage, while piloting those with insufficient data. This relates to energy efficiency program development and evaluation.

he following are the retail prices for Con Edison customers in 2014:  Residential: $0.2885/kWh  Commercial: $0.2216/kWh  Industrial: $0.2018/kWh NYSERDA ENERGY EFFICIENCY PROGRAM INCENTIVE AND COST EFFECTIVENESS POLICY Cost Effectivenes...

AI summary The text provides retail electricity prices for Con Edison customers in 2014 and discusses NYSERDA's energy efficiency programs under the Energy Efficiency Portfolio Standard (EEPS). It outlines cost-effectiveness testing using the Total Resource Cost (TRC) and the calculation of avoided supply costs provided by the NY-ISO. Energy efficiency programs are funded over three-year cycles and cover residential and commercial sectors.

f a measure is being “jump-started”, there may be consideration to increase the incentive. For example, for agricultural customers, the incentive can go up to 70 percent of the cost. For larger projects in the commercial program, there has...

AI summary The text discusses incentive structures for energy efficiency programs, including adjustments based on historical experience, performance-based incentives, and annual reviews. It highlights communication with stakeholders and the impact of cost-effectiveness on incentive changes.

d stakeholder communication. For incentive changes, cost effectiveness is checked. Typically, incentive changes feature reductions, so cost effectiveness impact is usually positive. During the incentive setting process, a formal document i...

AI summary The text discusses the process of changing incentives in energy efficiency programs, emphasizing cost effectiveness checks, the involvement of the Public Service Commission, and the use of a measures list to document savings and costs. The process does not require formal submissions but follows regular program change procedures.

Every three year cycle is determined through a Demand Resource Plan (DRP) process that has a 20 year horizon. This process sets the three year energy conservation savings and budget targets. According to the latest update to the 2015-2017...

AI summary The Demand Resource Plan (DRP) sets three-year energy conservation savings and budget targets over a 20-year horizon. Efficiency Vermont's resource acquisition budgets for 2015–2017 are outlined, with annual figures of $42.35M, $39.46M, and $45.56M. The Public Services Board (PSB) verifies annual savings to ensure alignment with the initial plan.

The Technical Advisory Group (TAG) contains members from Efficiency Vermont, PSB, Burlington Electric Department and other stakeholders to resolve any issues with the annual savings verification process and to track implementation of any r...

AI summary The Technical Advisory Group (TAG) includes stakeholders like Efficiency Vermont and PSB to oversee savings verification and implementation of recommendations. The TRM outlines methods for calculating energy savings, using deemed and calculation-based approaches. An audit from 2015 showed cost-effectiveness metrics, with Efficiency Vermont using the SCT instead of TRC for measure and portfolio-level evaluations.

INCENTIVE LEVEL-SETTING Note the Trust is in the middle of a transition on the process for setting incentives. At the time of writing this report, the MPUC had not yet decided on the process. For the first two Triennial plan periods, one o...

AI summary Efficiency Maine is in the process of setting incentive levels for energy efficiency programs, with the MPUC expressing concerns about overall cost effectiveness. The Trust has proposed a third plan, but the process for adjusting incentives has not yet been finalized. Market research and stakeholder engagement are part of the process.

..................... A-1 Date Filed: March 29, 2019 NS Power IR-15 Attachment 2 Page 5 of 32 Executive Summary In late 2015 and continuing into 2016, Efficiency Nova Scotia (ENS) launched a major refresh of its brand and restructuring of...

AI summary Efficiency Nova Scotia (ENS) undertook a brand refresh and restructuring of its marketing and communications function in late 2015 and 2016. The initiative aimed to increase program participation, enhance customer experience through digital assets, and improve marketing effectiveness via internal processes and tools. Research Into Action developed a marketing evaluation plan to assess progress toward these goals.

ying and addressing overlaps and gaps in marketing activities?  Do the marketing campaigns follow best practice guidelines to help ensure their success? This plan describes how ENS can gauge the effectiveness of its internal infrastructur...

AI summary The document outlines a plan for evaluating the effectiveness of ENS's marketing infrastructure and campaigns. It recommends revisiting internal plans, leveraging market research, and documenting efforts to ensure alignment with goals. The plan builds on a 2016/17 evaluation that found ENS's marketing efforts to be highly effective.

view and analysis of: a. ENS marketing plans and brand guidelines b. Marketing tracking system c. A sample of campaign materials 2. Primary data collection through: a. In-depth interviews or less formal check-ins with ENS marketing and pro...

AI summary The text outlines an evaluation plan for ENS marketing efforts, including reviewing marketing materials, conducting interviews, surveys, and focus groups. It emphasizes the need for ongoing evaluation activities integrated with current marketing processes, based on the positive results of the 2016/17 evaluation.

vities should integrate easily with current or planned marketing processes at ENS. Whether formally or informally conducted, it will be important to document these efforts.  Revisit and review internal plans, guidelines, and tracking syst...

AI summary The text outlines steps for integrating marketing activities with ENS's processes, revisiting internal plans and tracking systems, leveraging market research, and conducting primary research on marketing infrastructure and efforts.

processes), and its external-facing efforts. Conduct interviews and/or check-ins with marketing and program staff. These discussions may be relatively informal.  Conduct periodic best practices review of a sample of campaign materials. Ap...

AI summary This section outlines the methodology for evaluating the marketing function at ENS. It includes conducting interviews with staff, reviewing campaign materials, and applying best practices from previous evaluations, such as the 2016/17 marketing evaluation.

campaign plans • Coordination with programs and stakeholders • Clear identification of target markets • Updated documents • Staff roles, responsibilities, capabilities Organizational chart, • Filled and unfilled positions staffing plans •...

AI summary The text outlines key components of campaign planning, including coordination with programs and stakeholders, identification of target markets, staffing plans with roles and responsibilities, budget allocations, and cross-functional communications plans with updated documents and rationale.

• Targets identified, and met or exceeded Date Filed: March 29, 2019 NS Power IR-15 Attachment 2 Page 12 of 32 Data Source Representative Indicators / Evaluation Questions 1 to 3 Subsequent Years Years • Reporting capabilities include curr...

AI summary The document outlines key indicators and evaluation questions related to marketing tracking systems and program databases, focusing on reporting capabilities, customer participation, and targeted segments. It emphasizes the importance of regular reporting, feedback mechanisms, and tracking the effectiveness of marketing campaigns over time.

• Identification of targeted segments reached and not reached • Average number of projects per trade ally; changes over time 3.2. Primary Data Collection Table 2 through Table 5 show the target groups, population sizes, sample sizes, poten...

AI summary The text discusses primary data collection methods for evaluating ENS's marketing efforts, including interviews, check-ins, surveys, and focus groups. It emphasizes the need to assess targeted segments, track changes over time, and use findings to refine marketing infrastructure and campaigns. The evaluation also considers ENS's recent restructuring and campaign updates.

ts. We also recommend ENS conduct brief interviews with its BDMs and ESAs in future years to take maximum advantage of their knowledge from working directly with customers. Because ENS’s Efficiency Trade Network (ETN) is still in its early...

AI summary The text recommends that ENS conduct interviews with BDMs and ESAs to leverage their customer insights, while delaying interviews with ETN partners until the network is more established. It also suggests coordinating marketing evaluations with ongoing research to reduce respondent burden and improve survey efficiency.

Estimated Target Sample Population Representative Indicators / Evaluation Questions Suggested Timeframe Group Size Size • Understand, enthusiastic, motivated by branding; report it is effective • Understand marketing plan, find implementat...

AI summary The text discusses the evaluation of the ENS program, focusing on understanding participant feedback, marketing effectiveness, and communication processes. It highlights the need for aligned marketing strategies, effective feedback mechanisms, and the importance of targeting specific market segments over a timeframe of 1 to 3 years.

feedback mechanism works well; requested changes and updates are promptly addressed; high overall user satisfaction system facilitates cross-marketing efforts Table 3. Brief Interviews Estimated Suggested Timeframe Target Sample Population...

AI summary The feedback mechanism is effective, with changes and updates being promptly addressed and high user satisfaction. The system also supports cross-marketing efforts. Table 3 outlines brief interviews with ENS BDMs and ESAs, focusing on customer awareness, program inquiries, and marketing campaign effectiveness.

subsequent evaluations team lead) • Customers perceive ENS as trusted advisor Participant ≈ 130 Res 10 Res • Awareness of and attendance at trainings Coordinated with regular trade market research and/or ≈ 170 BNI 10 BNI • ENS viewed as co...

AI summary The text highlights customer perception of ENS as a trusted advisor, with approximately 130 residential and 170 BNI participants involved. It also mentions awareness of trainings and coordination with market research and program evaluations.

Table 4. Surveys Estimated Sample Target Group Population Stratification Representative Indicators / Evaluation Questions Suggested Timeframe Size Size Nonparticipant trade allies (contractors, • Changes in awareness and knowledge of ENS a...

AI summary The table outlines surveys targeting nonparticipant trade allies and BNI participants, focusing on awareness, knowledge, and participation in ENS programs, with suggested timeframes aligned with market research and program evaluations.

program evaluations • Perception of ENS as trusted advisor Coordinated with regular BNI • Changes in awareness of ENS and its programs over time > 31,000 TBD TBD market research and/or nonparticipants • Perception of ENS as trusted advisor...

AI summary The text discusses program evaluations focusing on perceptions of ENS as a trusted advisor, changes in awareness of ENS and its programs over time, and sources of information about ENS programs. It also mentions participation in multiple programs and the coordination with market research and program surveys.

on of ENS as trusted advisor program evaluations • Sources of information about ENS and its programs Residential: general Coordinated with regular > 400,000 68 per • Changes in awareness of ENS and its programs over time population TBD mar...

AI summary The text discusses the evaluation of ENS programs, including awareness of ENS and its programs over time, perception of ENS as a trusted advisor, and sources of information about ENS and its programs.

vity’s outputs, short-term outcomes, and medium-term outcomes. ENS may opt to conduct informal check-ins in lieu of the formal in-depth interviews shown in Table 6, Table 7, and Table 8. Since ENS enhanced or refreshed many of its marketin...

AI summary The text discusses ENS's approach to evaluating the effectiveness of its marketing tools, processes, and campaign delivery methods, particularly following enhancements made in 2017. It suggests using consistent indicators across evaluations to track improvements and identify areas needing refinement.

underserved populations/markets Date Filed: March 29, 2019 NS Power IR-15 Attachment 2 Page 22 of 32 Objective Indicators / Evaluation Questions Data Sources & Collection Approaches (Desired Output/ Outcome) Staff find marketing plan is •...

AI summary The document outlines an objective related to the implementation of a marketing plan by staff, emphasizing clarity, effectiveness, and the resolution of concerns. It includes evaluation indicators such as staff reports, interviews with managers, and digital metrics from Google Analytics.

Indicators / Evaluation Questions Data Sources & Collection Approaches (Desired Output/ Outcome) Tracking systems and • Tracking systems continue to completely and accurately capture • IDIs with marketing managers and processes meet overal...

AI summary The text outlines indicators and evaluation questions related to tracking systems and data collection approaches for programmatic needs, emphasizing the importance of accurate information capture and storage for marketing efforts and reporting.

IDIs with program staff reporting needs (e.g., identifying previous participants for Short-term Outcomes potential reconnections) • Gaps identified in system capabilities • Users’ "wish list" of system capabilities to enhance decision- mak...

AI summary The text outlines short-term and medium-term outcomes related to feedback mechanisms and system capabilities, focusing on identifying gaps, enhancing decision-making, and ensuring system updates are promptly addressed by marketing and program staff.

Tracking systems updated • Users continue to report system is always "current" • IDIs with marketing staff Medium-term Outcomes regularly in response to • IDIs with program staff feedback and strategic organization/program shifts Cross-pro...

AI summary The document discusses updates to tracking systems and medium-term outcomes, focusing on user feedback, stakeholder engagement, and cross-program collaboration. It outlines marketing campaign objectives and evaluation methods, including the use of program databases and informal check-ins with staff.

Stakeholders (e.g., trade • Percentages of participant and nonparticipant trade allies (and • Baseline surveys of trade ally (and other allies) aware of and other stakeholders) aware of programs; changes over time stakeholders) understand...

AI summary The text outlines methods for evaluating stakeholder awareness and engagement with ENS programs, including surveys, interviews, and training attendance metrics. It focuses on tracking changes over time and identifying common errors in program submissions.

program staff) Date Filed: March 29, 2019 NS Power IR-15 Attachment 2 Page 28 of 32 Objective Indicators / Evaluation Questions Data Sources & Collection Approaches (Desired Output/ Outcome) Customers participate in ENS • Number and percen...

AI summary The text outlines the objective of evaluating customer participation in ENS programs, with indicators such as the number and percentage of target population participating and identification of segments not being reached. Data sources include program databases, interviews with marketing managers, program staff, and BDMs.

• Surveys of participants • Surveys of nonparticipants Customers share experiences • Number and percent of participants reporting they learned of • Surveys of participants and refer friends and family program through family/friends; change...

AI summary The text outlines data collection methods for evaluating program participation and stakeholder engagement, including surveys of participants and nonparticipants, program databases, and interviews with program staff. It focuses on tracking changes in participant awareness and engagement over time.

fective at 5. Marketing connects customers to ENS provide feedback/input identifying needed system programs; customers interested in pursuing 5. Staff have adequate resources and enhancements/changes programs know where to go for help 6. S...

AI summary The document discusses marketing efforts by ENS to connect customers with programs, the adequacy of staff resources, internal communication at ENS, and the monitoring of key performance indicators across marketing initiatives.

d an Incentive Setting Workbook (the Workbook) to detail an internal process and to guide ENS through compiling the information on which incentive decisions would be based. ENS plans to review the incentive level for each measure on an ann...

AI summary ENS has implemented an incentive setting process to review and adjust incentive levels annually, using a workbook to guide decision-making. The process began in 2017 and will expand to cover all incentives by 2018. Program managers and an internal reviewer will oversee the review process for each measure.

manager to lead the incentive review across the program components. The lead reviewer will consult, as needed, with managers of the other affected program components during this process. In addition to developing this process for incentive...

AI summary ENS is conducting an evaluation of the incentive setting process for its programs, including financial simulations and market research. The evaluation focuses on the ease of obtaining information, decisions made, and compliance with the Implementation Plan. The goal is to improve and scale the process for 2018.

Incentive setting process • How easy/difficult is it for program team members to obtain the information the Workbook asks them to provide? 1 Measures for which incentive spending exceeds $400,000 per year for at least two years will receiv...

AI summary The text discusses the incentive setting process, focusing on the ease of information gathering, time consumption, and compatibility with different measures and incentive structures. It also asks whether the process provides sufficient oversight and if the review cycles are justified.

allow for sufficient oversight by, all the relevant actors within ENS? • Do program team members feel the annual or biannual incentive review cycles are justified?  Incentive setting decisions • How do program team members use the informa...

AI summary The text outlines questions related to oversight, incentive review cycles, and the use of information in incentive-setting decisions, as well as compliance with the Implementation Plan. It also describes the evaluation approach, which includes a review of documents such as the CLEAResult Report and the Workbook.

uments provided background for other data collection activities and analysis, and were central to the review of compliance with the Implementation Plan.  Workbook feedback. The evaluation team worked with ENS to develop questions about pr...

AI summary The evaluation team collaborated with ENS to gather feedback on the Workbook used in the incentive setting process. This included written feedback from program staff, in-depth interviews with program managers, and demonstrations of the Workbook and eTRM by ENS staff.

Technical Reference Manual (eTRM). Date Filed: March 29, 2019 NS Power IR-15 Attachment 3 Page 10 of 94 2. Experience with the Incentive Setting Workbook This section describes the experience of program staff in completing the Workbook, ba...

AI summary The document discusses the time and challenges involved in completing the Incentive Setting Workbook, noting that it can take up to three to four days per measure due to the complexity and need for multiple reviews. The 'Existing Measures' and 'Inputs & Calcs' tabs were particularly time-consuming.

be beneficial. According to one staff member, “We don’t have this data; we don’t know how to find it. Are there assumptions that are acceptable to use to get the most accurate result?” Respondents also expressed concern that values for a c...

AI summary Respondents raised concerns about data availability and consistency in measuring program impacts, noting a lack of data and varying assumptions used. There was also a call for coordination in outreach to market actors to avoid duplication and reduce burden during evaluation processes.

ket actors, staff noted that coordination could help to avoid placing too great a burden on market actors involved in evaluation, measurement, and verification activities. 2.3.2. Prioritization of Workbook Inputs The program staff suggeste...

AI summary The text discusses the need for coordination to reduce burdens on market actors involved in evaluation, measurement, and verification. It also highlights the importance of prioritizing Workbook inputs based on the technological and market stability of different measures and the need for increased regulatory staff support in completing the Workbook.

n the process, with one noting in particular that it would be beneficial to have one-on-one discussions with regulatory staff about the best way to interpret Workbook data. Two others expressed a desire for regulatory staff to take respons...

AI summary Staff members discussed challenges in completing the Workbook, noting the need for one-on-one discussions with regulatory staff and the need for regulatory staff to take responsibility for certain sections. They highlighted the lack of necessary skills among program staff and the time-consuming nature of the process.

es of baseline products and estimates of market potential. As previously noted, these types of inputs were among the data points program staff most often found challenging. While program staff noted they did not consistently approach incen...

AI summary The document discusses challenges faced by program staff in setting incentives, including inconsistent approaches prior to the current process. However, all staff with experience in incentive setting reported that their decisions were documented and justified. The new process was seen as beneficial for consistency in information and documentation. Program staff also collaborated with others during the incentive review process and consulted the regulatory team for assistance.

ss/fail on each measure, why don’t we just have a spreadsheet that has that information on it? You can dive deeper into those certain measures that potentially don’t pass.” Consistent with program staff reports about the importance of the...

AI summary The document discusses the use of a spreadsheet tool ('Workbook') in evaluating incentive levels for energy programs. Program staff rely on the 'Inputs & Calcs' tab for decisions, but rarely reference other tabs in their rationale. Most staff found their chosen incentive levels similar to those without the Workbook, though some were skeptical due to input uncertainty and lack of incentive cap considerations.

ted. Two stated they were skeptical of the Workbook’s calculations due to uncertainty in their input estimates and because the Workbook did not account for incentive caps. 3.3. Frequency Program staff suggested that the frequency with whic...

AI summary Program staff and managers discussed concerns about the Workbook's calculations and the frequency of incentive reviews. Skepticism was raised due to uncertainty in input estimates and lack of consideration for incentive caps. The frequency of reviews should align with market changes, with some measures requiring less frequent reviews due to slower market changes. Frequent reviews may reduce program stability and increase participant burden.

ill provide many of the inputs to the Workbook. Date Filed: March 29, 2019 NS Power IR-15 Attachment 3 Page 16 of 94 4. Compliance with Incentive Implementation Plan This section describes the results of the evaluation team’s review and as...

AI summary This section discusses the evaluation of ENS's Incentive Setting Manual against the Implementation Plan's requirements. The Manual was found to effectively document the steps taken but could benefit from more detailed instructions on tool usage.

Expectation Verified Notes Definition of roles and The manual lists separate roles for the “Lead for Incentive responsibilities with respect to Review” and the “Program Manager.” Since, in many cases, the incentive design and revision prog...

AI summary The document discusses the roles and responsibilities related to incentive design and revision, including approval processes, documentation requirements, and storage procedures. It also highlights the need for clarity on overlapping roles and the lack of detail on internal controls and monitoring.

The interviewed program staff reported that the Consolidated Calculator was helpful in making incentive decisions, although they reported difficulty finding some of the required inputs. 4.5. Conduct Financial Simulations of Existing Incent...

AI summary The interviewed program staff found the Consolidated Calculator useful for making incentive decisions but faced challenges in locating required inputs. CLEAResult conducted financial simulations for two program components, Instant Savings and Custom, and recommended that ENS perform simulations for all program components to evaluate current incentive levels against cost to participants, program budget, and cost effectiveness thresholds.

tive structures. Our recommendations focus on providing greater support for gathering data that had not been previously tracked for program components. Recommendation 1-1: Determining the highest priorities for inputs to the incentive-sett...

AI summary The text outlines two recommendations aimed at improving data collection and training for program staff. The first focuses on prioritizing and clarifying inputs for incentive-setting workbooks, while the second emphasizes training to enhance the reliability of research and analysis for workbook inputs.

measures than others? 1. Which measures took/would take longer? 2. Why do you think those measures took/would take longer? Q7. Assuming the workbook doesn’t change, how do you think the amount of time it takes you to complete the incentive...

AI summary The text outlines a series of questions focused on the time required to complete an incentive setting workbook, challenges faced with specific tabs like 'Existing Measures' and 'Inputs and Calcs,' and potential improvements to the process. The discussion centers on efficiency, data collection, and user experience in incentive setting procedures.

attempt 8 Total 12 To minimize the burden on Retrofit service participants, the BD evaluation team coordinated with the Research Into Action team conducting the Retrofit service process evaluation, and developed a single instrument coverin...

AI summary The BD evaluation team coordinated with the Research Into Action team to develop a single instrument for evaluating the Retrofit service process, which included questions similar to those in the BER participant guide. Both guides focused on the role of BDMs in promoting ENS programs and supporting energy-efficiency efforts.

NS Power IR-15 Attachment 3 Page 58 of 94 Appendix D. Retrofit Service Participant Interview Guide D.1. Introduction Thanks for taking the time to talk today. I work for Research Into Action, part of the Econoler evaluation team, and we ha...

AI summary This document is an interview guide for participants in Efficiency Nova Scotia's Custom Retrofit program. It outlines the introduction and initial questions related to roles and responsibilities of participants in the program.

NON-CONFIDENTIAL • 36 workshops and • 37 workshops and energy management energy management plans delivered to plans delivered to non-profit non-profit organizations organizations 1 2 Efficiency Trade Network 3 EfficiencyOne supports growth...

AI summary EfficiencyOne supports Nova Scotia’s energy efficiency industry through the Efficiency Trade Network (ETN), which helps increase participation in programs by connecting residents with skilled professionals. Membership in the ETN grew significantly from 2016 to 2018, and training and networking events increased substantially during this period. A 2018 survey highlighted benefits such as gaining new customers and industry networking.

NON-CONFIDENTIAL 1 Regulatory Affairs 2 Regulatory Affairs activities enable EfficiencyOne to meet its regulatory requirements and 3 provide a fair and transparent process for stakeholders and Nova Scotians to offer input 4 into DSM Resour...

AI summary EfficiencyOne's Regulatory Affairs activities during 2016-2018 included stakeholder engagement, NSUARB approvals, development of standardized filings, and participation in regulatory processes. Activities also involved incentive methodology studies, locational DSM reports, and the filing of evaluation and financial reports.

and 2018 Evaluation Reports; 24 • developing and filing Quarterly and Annual NSUARB reports; 25 • filing EfficiencyOne’s 2016, 2017, and 2018 Audited Financial Statements and Internal 26 Audits reports and response to the NSUARB’s Informat...

AI summary The document outlines various reporting and compliance activities undertaken by EfficiencyOne in relation to the NSUARB, including the submission of financial statements, audit reports, and responses to information requests. It also mentions coordination with evaluation and verification consultants.

similar to the 2016, 2017 and 2018 evaluation scopes with the exception of adding the 28 following criteria to be used to determine when a process evaluation should occur: Date Filed: March 29, 2019 E1 (NS Power) IR-29 Page 1 of 2 Efficien...

AI summary EfficiencyOne outlines its approach to process evaluations for its energy efficiency programs, stating that evaluations should occur every three years and that it relies on the NSUARB verification consultant for annual reviews of evaluation activities.

NON-CONFIDENTIAL 1 • In the New Residential program, the program manager identified two updates. First, in 2 their next service delivery contract, delivery agent costs will increase for the high- 3 performance home measures (shown as measu...

AI summary The document outlines updates to the New Residential program, including increased delivery agent costs for high-performance home measures and changes to the measure mix. It also discusses updated savings estimates for the Green Heat Program and revised incentive unit costs in EMIS. EfficiencyOne identified gaps and developed program enhancements, excluding certain initiatives.

or example, the three-year 18 average unit-cost of $0.31/kWh reflects net savings at the generator, i.e. after adjustments for NTG 19 (free-ridership and spillover) and line losses are applied. 1 M08604, EfficiencyOne – 2019 Demand Side Ma...

AI summary The document discusses data requests related to EfficiencyOne's DSM programs from 2016 to 2018, including customer identifiers, energy consumption, installed measures, savings, and incentive amounts. It references a specific proceeding and includes a request for information from the DSM Data Tracking System.

NON-CONFIDENTIAL 1 b) The Preferred Plan continues to rely on an evidence-based approach to monitor and respond 2 to program efficacy and performance, and changes in technology. Sections 5.1 and 5.2 in 3 the Evidence Section describes how...

AI summary The Preferred Plan uses an evidence-based approach to monitor and adjust programs based on technology trends and customer behavior. It expands access to energy efficiency programs for rental housing and First Nations communities and includes demand-reduction incentives. Barriers to energy efficiency and mitigation strategies are outlined in tables within the Evidence section.

fficiencyOne has confirmed that application of such sensitivity analysis as 27 suggested in this IR is not an industry standard practice performed for short-term DSM 28 planning. 29 Date Filed: March 29, 2019 E1 (NS Power) IR-36 Page 1 of...

AI summary EfficiencyOne states that sensitivity analysis for short-term DSM planning is not standard industry practice. They highlight their consistent achievement of NSUARB-approved energy savings targets and the use of expert modeling and planning in their DSM Resource Plan, supported by over a decade of experience and verified results.

1 Date Filed: March 29, 2019 NS Power IR-44 Attachment 1 Page 6 of 46 In the same vein, the National Efficiency Screening Project2 (NESP) recently developed best practice guidelines that similarly call for either wholesale changes to the T...

AI summary The document discusses the need for changes to Nova Scotia's cost-effectiveness framework for demand-side management (DSM), citing best practices from the National Efficiency Screening Project (NESP) and the Northeast Energy Efficiency Partnership (NEEP). It suggests shifting from the Total Resource Cost (TRC) method to the Program Administrator Cost (PAC) test due to its simplicity and lower cost.

and far less expensive – exercise than “fixing” the current TRC by, among other things, assessing non-energy benefits. It may also be less contentious (see below). • Accuracy: Even if the TRC were to be corrected, in part by efforts to acc...

AI summary The text discusses the challenges with the Total Resource Cost (TRC) approach, highlighting concerns about accuracy, relevance, and alignment with existing legislation. It suggests that the Program Administrator Cost (PAC) test may be a more effective and less contentious alternative for evaluating demand-side management (DSM) programs.

ency and Conservation Restructuring (2014) Act in that it requires the utility to procure DSM services. As a result of our review, we make the following recommendations: 2 The National Efficiency Screening Project (NESP) is comprised of or...

AI summary The document outlines recommendations for adopting the Program Administrator Cost (PAC) as a primary test for evaluating the cost-effectiveness of Demand-Side Management (DSM) programs in Nova Scotia. It also suggests re-examining key inputs like the discount rate and developing a transparent reporting template based on the National Efficiency Screening Project (NESP) framework.

10 Date Filed: March 29, 2019 NS Power IR-44 Attachment 1 Page 15 of 46 cost of the measures adopted by free riders (irrespective of who paid them), but none of the savings. ii. Avoided Costs: Avoided costs should encompass generation, tra...

AI summary The text discusses the concept of avoided costs and net savings in the context of energy efficiency programs. It highlights that avoided costs should include generation, transmission, distribution, and ancillary costs, and that net savings can be calculated using different approaches, including accounting for free ridership, spillover effects, and long-term market transformation.

a) Program Marketers: While theoreticians may argue amongst themselves as to the importance of “non-energy benefits” and the theoretical basis for valuing them, they need look no further than DSM Program Administrators themselves. Indeed,...

AI summary The text discusses the importance of non-energy benefits (NEBs) in demand-side management (DSM) programs, emphasizing that they are often more persuasive in marketing than energy-related economics. It argues that ignoring NEBs can lead to underinvestment in energy efficiency programs and higher costs for utility customers, citing a statement from Tim Woolf et al.

contributions to the program administrator budget). This approach – direct installation of all TRC-positive measures – could well achieve the most possible savings that are deemed cost effective from the TRC perspective, at the least total...

AI summary The text discusses the Total Resource Cost (TRC) approach in energy efficiency programs, noting that while it aims to minimize total costs, it may not effectively reflect program efficiency or how efficiently program funds are used to achieve energy savings. It also highlights concerns that focusing too much on TRC may lead to suboptimal decisions for ratepayers.

osts and not just program costs, it may arguably be an unfair measure by which to compare options. This is noted in the California Standard Practice Manual’s own discussion of the TRC: “In addition, the costs of the DSM ‘resource’ in the T...

AI summary The text discusses the limitations of the Total Resource Cost (TRC) in evaluating Demand-Side Management (DSM) programs, noting that it may unfairly compare options by including participant costs, unlike supply-side resources. It also highlights that TRC may distort savings opportunities due to varying consumer value. Nova Scotia uses TRC for DSM screening, but the Program Administrator Cost (PAC) test is the only one reflecting utility least-cost procurement.

tition with procurement of supply. Only the Program Administrator Cost (PAC) test reflects the costs and benefits of DSM from a utility least-cost procurement perspective. 25 For example, if consumers value solar hot water (SHW) systems mo...

AI summary The text discusses the Program Administrator Cost (PAC) test as a method to evaluate Demand-Side Management (DSM) programs from a utility's least-cost procurement perspective. It also raises concerns about the Total Resource Cost (TRC) test potentially conflicting with public policy by not reflecting consumer preferences, which could lead to less effective energy savings.

ts can lead to radically different valuations of the same or similar participant NEBs. Because of this, the regions that have begun to account for NEBs have done so in different ways. • Specific NEB valuations: conduct market research to q...

AI summary The text discusses different methods for valuing non-energy benefits (NEBs) in program cost-effectiveness assessments, including specific, inferred, and approximate approaches, highlighting variations in how regions account for these benefits.

31 Date Filed: March 29, 2019 NS Power IR-44 Attachment 1 Page 36 of 46 OPTION B. MOVE FOCUS TO PAC TEST The other primary option for Nova Scotia is to focus instead on the narrower but more straightforward PAC test. Using the PAC test pro...

AI summary This section discusses Option B, which involves shifting focus to the Program Assessment Criteria (PAC) test for evaluating demand-side management (DSM) programs. It argues that the PAC test provides a clear measure of program performance, facilitates comparison with supply-side options, and is more symmetrical in treating benefits and costs. Connecticut is cited as an example of a state that focuses on PAC-level results for determining DSM cost-effectiveness.

benefits (NEBs), the accuracy of such assessments may raise concerns, leading to lengthy discussions, ongoing debate, and more contentious hearings than otherwise necessary. • Relevance: While the TRC (once corrected) arguably would provid...

AI summary The text discusses concerns about the accuracy of Non-Energy Benefits (NEBs) assessments, which can lead to contentious hearings. It argues that the Program Administrator Cost (PAC) test is more aligned with Nova Scotia's regulatory framework and Integrated Resource Plan (IRP), and recommends using the PAC test for screening Demand Side Management (DSM) programs.

ed for each dollar provided to ENS. In addition, stakeholders and the UARB are already familiar with the workings of the PAC, which has been reported on in DSM Plans for several years. Finally, the PAC perspective is strongly aligned with...

AI summary The text discusses the adoption of the Program Administrator Cost (PAC) as a primary test for evaluating the cost-effectiveness of Demand Side Management (DSM) programs in Nova Scotia. It aligns with the objectives of Nova Scotia’s Electricity Efficiency and Conservation plan, emphasizing least-cost procurement and market transformation. Recommendations include applying the PAC test at different levels and developing a transparent reporting template.

ement for Electricity Efficiency and Conservation Activities between E1 and Nova Scotia Power Inc. (DSM 2020- 2022) M09096 (E-ENS-R-19) E1 Responses to Nova Scotia Power Inc. (NS Power) NON-CONFIDENTIAL 1 Request IR-51: 2 3 Describe the se...

AI summary The response to Request IR-51 explains that the initial test runs of the ProCESS model were administrative tests to verify model functionality and outputs. These tests used controlled mock data and checked formatting, metrics, and naming conventions. The response also notes that ProCESS and ELRAM models produce similar outputs but highlights ProCESS as more feature-rich and efficient.

NON-CONFIDENTIAL 1 Request IR-55: 2 3 (a) Explain whether the example of a constraint “to ensure that no program has TRC 4 less than 1.0” (Appendix A, 2020-2022 DSM Plan, page 9, lines 1-2) was included in 5 the portfolio optimization mode...

AI summary The response to Request IR-55 explains that a TRC constraint of at least 1.0 was included in the portfolio optimization model for the 2020-2022 DSM Plan. EfficiencyOne argues that optimizing at the measure level would not be more cost-effective for customers due to considerations like equitability and income-eligible populations, and that the Preferred Plan was guided by internal expertise and program delivery experience.

NON-CONFIDENTIAL 1 2 (g) Does Mr. Reed believe that his benchmarking analysis accomplished its goal of 3 assessing “where EfficiencyOne falls compared to [all of] its North American peers”? 4 5 Response IR-61: 6 7 The following response ha...

AI summary Glenn Reed confirms that his benchmarking analysis compared EfficiencyOne to leading North American Program Administrators (PAs), focusing on those with significant investment in demand-side management (DSM). He excluded PAs with minimal commitment to DSM to ensure a more representative comparison.

NON-CONFIDENTIAL 1 Request IR-62: 2 3 Reference: Appendix E, Direct Testimony of Glenn Reed, page 8, lines 1-4 state that, “these 4 caveats do not significantly diminish the value of undertaking such a benchmarking exercise, 5 particularly...

AI summary The response to Request IR-62 addresses concerns about the value of benchmarking exercises in comparing DSM plans across program administrators. It acknowledges the caveats but argues that such comparisons are still useful for initial evaluations of program performance, citing examples from Energy Futures Group.

EfficiencyOne IN THE MATTER OF The Public Utilities Act, RSNS 1989, c 380, as amended, - and – IN THE MATTER OF EfficiencyOne's 2018 Annual Progress Report.

AI summary The document outlines a regulatory proceeding under the Public Utilities Act, RSNS 1989, c 380, as amended, focusing on EfficiencyOne's 2018 Annual Progress Report. The proceeding evaluates EfficiencyOne's compliance and performance under the Act.

1 2018 DSM RESULTS In its Order dated October 7, 2015, the Nova Scotia Utility and Review Board (NSUARB) approved the 2016-2018 DSM Resource Plan and the corresponding 2016-2018 DSM Plan Consensus Agreement. 1 The NSUARB Order approved a 2...

AI summary The Nova Scotia Utility and Review Board (NSUARB) approved a 2016-2018 DSM Resource Plan in 2015, setting 2018 investment and savings targets. Mid-course adjustments in 2018 revised energy and demand savings goals based on cumulative 2016-2017 results, aiming to meet three-year performance targets of 405.9 GWh energy and 62.5 MW peak demand savings. Tables detail expenditures, program participation, and unit costs.

Table 11: 2016-2018 DSM Plan Results - Portfolio Level Year Investment ($ million) Lifetime Benefits ($ million) First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Weighted- Average Measure Life (years) Peak Demand Savings (MW)...

AI summary Table 11 presents the results of the 2016-2018 DSM Plan, showing investment amounts, energy savings, and cost metrics for both approved and reported outcomes. The data includes metrics such as lifetime benefits, energy savings, and program cost tests, with notes on rounding, unaudited figures, and pending verification for 2018 results.

8 10 11 12 13 14 6 Table 14 provides a breakdown of the cumulative 2016-2018 expenditures and the evaluated net incremental energy and net peak demand savings results by program, for comparison with the 2016-2018 DSM Plan Compliance Filing...

AI summary The text references tables that provide information on cumulative expenditures, energy savings, peak demand savings, and program participation data for the 2016-2018 DSM Plan period. It also mentions the evaluation of net incremental energy and peak demand savings results.

Figure 2: 2016-2018 DSM Results as Compared to 2016-2018 Targets Energy and demand savings are calculated at the generator and net of free-ridership and spillover. 2016-2017 results are evaluated and verified. 2018 results are evaluated an...

AI summary Figure 2 compares 2016-2018 Demand Side Management (DSM) results against targets, noting energy and demand savings calculations account for free-ridership and spillover. 2016-2017 results are verified, while 2018 results are evaluated but pending verification.

3.2 Cost-Effectiveness Testing In the 2016-2018 Quantum Agreement, the DSM Advisory Group agreed to work to achieve consensus as to the methodology and assumptions of the cost- effectiveness screening test to be applied to future DSM Resou...

AI summary The 2016-2018 Quantum Agreement and EfficiencyOne's 2016 Settlement Agreement established collaboration with the DSM Advisory Group to refine cost-effectiveness testing methods for DSM Resource Plans, including quantifying non-energy benefits. EfficiencyOne engaged Vermont Energy Investment Corporation (VEIC) for analysis, filed an application with NSUARB in 2018, and faced regulatory delays due to stakeholder consultation requests.

3.3 Update on Evaluation and Verification Recommendations 11 12 13 10 An update on the status of evaluation and verification recommendations is set out in Attachment 1. - & lt;sup>40 Ibid [NSUARB Hearing Order], [1 October 2018] & lt;sup>4...

AI summary The section provides an update on the status of evaluation and verification recommendations, referencing specific NSUARB orders from 2018. The update is detailed in Attachment 1, with footnotes citing prior NSUARB Hearing and Board Orders.

7 CONCLUSION 2 5 7 9 1 EfficiencyOne is pleased to submit this Annual Progress Report on its 2018 DSM performance, as well as its 2016-2018 DSM Plan performance. As of this writing, EfficiencyOne expects to meet its 2019 planned savings, w...

AI summary EfficiencyOne submits its Annual Progress Report on DSM performance for 2018 and the 2016-2018 DSM Plan. They expect to meet 2019 savings targets and continue DSM programs, updating NSUARB and stakeholders.

EVALUATOR AND VERIFIER RECOMMENDATION UPDATES - Table 1: Update on Implementation of 2013-2016 Evaluation Recommendations - Table 2: Update on Implementation of 2013-2016 Verification Recommendations - Table 3: Update on Implementation of...

AI summary The document outlines updates on the implementation of evaluation and verification recommendations from 2013-2016 and 2017, presented in four tables. It focuses on progress tracking for regulatory proceedings related to energy management and rebate programs in Nova Scotia.

Table 1 Update on Implementation of 2013-2016 Evaluation Recommendations Year Evaluation/ Verification Recommendation Text Source Status Comments Expected Period of Completion Year Evaluation/ Verification Recommendation Text Source Status...

AI summary The document presents an update on the implementation of evaluation recommendations from 2013 to 2016. It includes details on the status of each recommendation, along with comments and expected completion periods.

Attachment 1, Page 15 of 30 Recommendation Text Source Status Comments Expected Period of Completion Conduct a process evaluation for NHC in 2018. During the 2017 evaluation, participants and builders made certain criticisms about NHC, esp...

AI summary A 2017 evaluation of the New Home Construction (NHC) program identified concerns regarding incentive levels and participation processes, leading to a recommendation for a 2018 process evaluation. The evaluation aimed to benchmark NHC against other programs and consult with builders to improve participation and address declining interest.

2018 DSM EVALUATION REPORTS

AI summary The 2018 DSM Evaluation Reports assess the effectiveness of demand-side management programs, focusing on energy efficiency, cost recovery, and regulatory compliance, providing insights for future program improvements.

2018 DSM PROGRAMS EVALUATION EXECUTIVE SUMMARY EFFICIENCY NOVA SCOTIA Final Report March 18, 2019

AI summary The 2018 Demand Side Management (DSM) Programs Evaluation Executive Summary by Efficiency Nova Scotia provides an overview of program performance and outcomes. The report assesses the effectiveness of energy efficiency initiatives in Nova Scotia, focusing on key metrics and stakeholder feedback.

Evaluated savings Gross and net energy or peak demand savings calculated by the Evaluator using the parameters (unitary savings values, installation rates, interactive effects, net-to-gross ratio, etc.) validated or measured during the eva...

AI summary The text defines key terms related to energy efficiency program evaluation, including evaluated savings, gross and net savings, free-ridership, installation rates, and market effects. These definitions are essential for assessing the effectiveness and impact of energy efficiency initiatives.

Executive Summary Net savings Energy or peak demand savings that can be reliably attributed to a program. This includes effects, such as free-ridership and spillover, that negatively or positively affect the savings attributable to a progr...

AI summary The document defines key terms related to energy program evaluation, including net savings, net-to-gross ratio, peak demand savings, and tracked savings. It also outlines statistical and measurement concepts such as precision, sampling error, and secondary market impacts.

INTRODUCTION Efficiency Nova Scotia (ENS) is operated by EfficiencyOne, an independent, non-profit organization. ENS is responsible for helping Nova Scotians improve the energy efficiency of their homes and workplaces by designing, marketi...

AI summary Efficiency Nova Scotia (ENS), operated by EfficiencyOne, delivers energy efficiency programs funded by Nova Scotia Power (NSP) and the Province. An evaluation by Econoler and partners found ENS's 2018 DSM programs achieved 151.393 GWh in net energy savings and 25.542 MW in peak demand savings, reducing GHG emissions by 92,659 tonnes annually. Codes and Standards also contributed savings, though not attributed to ENS.

1 EVALUATION OBJECTIVES AND SCOPE The objectives of the 2018 evaluation of ENS DSM program components were to: - › Assess the effectiveness of program component design and delivery - › Determine the extent to which program component implem...

AI summary The 2018 evaluation of ENS DSM program components aimed to assess the effectiveness of program design and delivery, determine implementation progress, calculate energy and peak demand savings, and analyze market evolution of LED lamps and mini-split heat pumps. Table 1 outlines evaluated programs, their components, and evaluation types.

The types of conducted evaluations were chosen based on an analysis of 2018 evaluation objectives, key results of the previous evaluations, and recent changes made to each program component. Based on this analysis and as outlined in Table...

AI summary The evaluation scope for three program components—Home Energy Assessment, Efficient Product Installation, and Small Business Energy Solutions—was partially reduced based on an analysis of 2018 evaluation objectives, previous results, and recent changes. The rationale for this decision is discussed.

Process Evaluations The Evaluator recommended that the New Construction service of Custom, New Home Construction, and Business Energy Rebates would benefit the most from a process evaluation in 2018. & lt;sup>b The process evaluation speci...

AI summary The Evaluator recommended process evaluations for New Construction, Business Energy Rebates, and Retrofit services in 2017-2018. Participants reported moderate satisfaction with New Home Construction but criticized incentive levels and low participation. Business Energy Rebates, generating 86% of ENS savings, faces challenges in diversifying measures beyond lighting. Strategic Energy Management had no 2017 savings due to cohort timing.

Market and Impact Evaluations When choosing the market and impact evaluation activities to be conducted for 2018, Econoler considered the research themes that required deeper analysis and those that were fully addressed by previous evaluat...

AI summary Econoler reduced market and impact evaluations for Home Energy Assessment, Small Business Energy Solutions, and Efficient Products Installation in 2018 due to minimal changes since 2017, using prior data instead of conducting new assessments. Other program components had full evaluations.

2 EVALUATION METHODOLOGY This section presents the methodology used and the activities carried out to evaluate ENS DSM program components and services. The Evaluator first reviewed all relevant documentation, particularly focusing on the m...

AI summary This section outlines the methodology for evaluating ENS DSM program components, including documentation review, data collection activities, and statistical analysis with a 10% margin of error at 90% confidence. Appendices provide examples of error calculation methods, and some results exceeded the 10% threshold with justifications in individual reports.

2.1 Interviews The 2018 evaluation methodology included interviews with ENS program managers, partners, participants, and industry associations. Between August 2018 and January 2019, the Evaluator conducted 92 interviews with various stake...

AI summary The 2018 evaluation methodology involved 92 interviews with stakeholders, including ENS program managers, partners, participants, and industry associations, conducted between August 2018 and January 2019 as part of a broader assessment of programs.

Phone Surveys Between September and December 2018, CRA conducted phone surveys with participants of four program components. The contents of the surveys varied from one program component to another. The surveys were used to collect informa...

AI summary CRA conducted phone surveys between September and December 2018 with participants of four program components to gather data on participation motivations, barriers, satisfaction, recommendations, free-ridership, demographics, and program effectiveness, focusing on energy efficiency initiatives managed by ENS.

2.3 On-site Visits For the 2018 evaluation, the Evaluator visited a total of 211 participant sites in the summer and fall of 2018. For all BNI program components, the objective of the on-site visits was to collect data to establish or vali...

AI summary In 2018, an evaluator conducted on-site visits to 211 participant sites to collect data for validating parameters in savings calculations for BNI program components. These visits were used to review project files, assess the completeness of simulation files, validate equipment functionality, and ensure proper metering processes at recycling facilities.

2.5 Unitary Savings Review For those program components whose savings were established on a unitary basis, the Evaluator reviewed the savings presented in the tracking sheet. First, consistency with the savings results of the previous eval...

AI summary The Evaluator reviewed unitary savings for programs like Efficient Product Installation and Business Energy Rebates, ensuring consistency with prior evaluations. Methods included using technical reference manuals, product specifications, and sampling popular products to calculate average characteristics. Savings from the 2017 evaluation were reapplied in 2018 for certain measures.

2.7 Simulation Model Review Simulation model reviews were performed for four New Construction projects completed in 2018 to thoroughly verify the accuracy of energy models. This activity involved reviewing simulation models against as-buil...

AI summary Simulation model reviews were conducted for four New Construction projects in 2018 to verify energy model accuracy against as-built drawings, documentation, and on-site verification results. Adjusted models were used to calculate evaluated savings.

2.9 Effective Useful Life Review To establish the persistence of energy savings over time, the Evaluator determined the effective useful life (EUL) values to be used in all program components. For most program components, the Evaluator sim...

AI summary The Evaluator applied existing EUL values from 2017 to 2018 energy savings for most programs but recalculated equivalent EULs for programs affected by upcoming regulations. A new EUL was established for Strategic Energy Management based on literature and project analysis, as it had no participants in 2017.

3 IMPACT EVALUATION RESULTS This section presents an analysis of the impact evaluation results for all program components by comparing the 2018 tracked energy and peak demand savings with those evaluated. The evaluated netto-gross ratios,...

AI summary This section compares 2018 tracked energy and peak demand savings with evaluated results, presenting netto-gross ratios, lifetime energy savings, and GHG emission reductions. The analysis focuses on program performance metrics and their environmental impacts.

Green Heat The 2018 Green Heat participation level was much higher than in previous years with 3,055 measures installed. MSHPs were still the most popular measure, accounting for 92 percent of measures installed. The Evaluator found that t...

AI summary In 2018, the Green Heat program saw high participation with 3,055 measures installed, primarily mini-split heat pumps. The program achieved significant energy and peak demand savings. However, evaluated net energy and peak demand savings were lower than tracked values due to a decrease in the net-to-gross ratio (NTGR) and differences in participant selection processes.

Custom In 2018, the suite of services offered through Custom was broken down as follows: Retrofit; New Construction; and Building Optimization. Overall, 79 projects generated savings, 69 of which were completed. The Evaluator determined th...

AI summary In 2018, Custom's services generated 11.603 GWh in net electrical energy savings and 1.200 MW in net peak demand savings. However, evaluated gross energy savings were 13% below the tracked value due to significant reductions in New Construction and Building Optimization. The NTGR was revised downward, with peak demand savings decreasing by 31% below the tracked value.

Strategic Energy Management Four participants generated savings in 2018, all of whom were new participants. The Evaluator determined that Strategic Energy Management achieved 1.455 GWh in net electrical energy savings and 0.190 MW in net p...

AI summary Strategic Energy Management achieved 1.455 GWh in net electrical energy savings and 0.190 MW in net peak demand savings in 2018. However, savings were 8% below tracked values due to untracked capital project savings and an adjustment from revised savings on a lighting project. Net savings were 13% below tracked values due to these adjustments.

3.2 Net-to-gross Ratio The NTGRs, outlined in Table 5 and Table 6 above, were applied to the gross savings to estimate net savings. NTGRs were established based on the levels of free-ridership and, in some cases, spillover. NTGR estimation...

AI summary This section discusses the calculation of the net-to-gross ratio (NTGR) used to estimate net savings from energy efficiency programs. The NTGR accounts for free-ridership and spillover effects, with free-ridership levels determined through surveys and interviews. Spillover was assessed by evaluating additional energy efficiency measures taken by participants and market effects for specific programs like Instant Savings and New Home Construction.

4.1 Participant and Partner Satisfaction Once again in 2018, the evaluation revealed very high participant satisfaction with ENS and its programs. Most participants were pleased with their interactions with program partners, specifically i...

AI summary The 2018 evaluation showed very high participant satisfaction with ENS and its programs, with most participants and partners expressing satisfaction with interactions and the value of program involvement.

Table 10: 2018 Satisfaction Results DSM Program Program Component Participant Satisfaction Partner Satisfaction Residential Residential Efficient Appliance Retirement 9.6 - Products Rebates Instant Savings - 8.6 Green Heat 9.0 - Existing R...

AI summary Table 10 presents 2018 satisfaction results for various DSM program components, with average ratings above 8.0 on a 10-point scale. Most components saw improved ratings, except Strategic Energy Management and Energy Management Information Systems, which had low participant numbers.

6 RECOMMENDATIONS Once again, the Evaluator commends ENS on its ability to quickly and effectively implement the recommendations formulated and submitted as part of past evaluations. The 2018 evaluation revealed that two-thirds of former r...

AI summary The Evaluator commends ENS for implementing past recommendations but notes that strategies to engage participants in non-lighting energy efficiency measures are not fully effective. Lighting measures still account for most savings, and ENS is discontinuing support for certain high-saving measures starting in 2019.

Table 15: Crosscutting Recommendation on ENS Programs No. Recommendation CR-R1. Monitor the market evolution for lighting products that were recently removed from ENS offerings. The recent changes to lighting product eligibility in Instant...

AI summary The recommendation suggests monitoring the market evolution for lighting products recently removed from ENS offerings. Changes to lighting product eligibility in Instant Savings and Business Energy Rebates may significantly impact savings. The Evaluator advises ENS to collect timely data on market evolution to enable quick adjustments if necessary.

Table 16: Recommendations on Residential Program Components No. Recommendation HEA-R2. Share evaluation findings with the EAs to ensure sustained quality simulations. As part of the 10 HEA on-site visits and HOT2000 simulation reviews, the...

AI summary The text discusses improvements in data collection and simulation accuracy by EAs since 2016, noting some recurrent mistakes in HOT2000 simulations. It recommends sharing feedback with EAs to improve the quality of simulations and project reviews.

No. Recommendation EMIS/SEM-R1. Review program delivery to improve participant understanding and mastery of energy performance tracking. Despite being satisfied with EMIS and SEM, many participants in both program components mentioned feel...

AI summary The document highlights that participants in the EMIS and SEM programs rely heavily on service providers for energy performance tracking. Many participants lack the resources to continue tracking energy consumption independently, leading to a lack of ongoing engagement. The Evaluator recommends reviewing program delivery to better equip participants with the tools and knowledge needed to manage energy performance independently.

APPENDIX II CALCULATION OF MARGINS OF ERROR This appendix presents some examples of how the Evaluator has established the margins of error of participant surveys, installation rates, adjustment ratios, free-ridership levels and measured en...

AI summary This appendix provides examples of how margins of error were calculated for various program components, including participant surveys, installation rates, adjustment ratios, free-ridership levels, and measured energy consumption levels, using data from the 2017 evaluation.

APPENDIX III NTGR CALCULATIONS This appendix provides some examples to illustrate the Evaluator's calculations of free-ridership, participant spillover and net-to-gross ratio values in the 2018 evaluation. To demonstrate how to apply the a...

AI summary This appendix provides examples of free-ridership, participant spillover, and net-to-gross ratio calculations from the 2018 evaluation, using the EPI program component and Custom Retrofit service as examples. Similar methods were applied to other program components, with more details available in individual program evaluation reports.

Executive Summary – Appendix Report Efficient Product R ebates - LED Bulbs, Owners FR3c [ASK IF LED bulbs/low flow showerheads and/or showerwands QUANTITY >1] If the service had not been offered, what is the likelihood that you would have...

AI summary The text presents a table analyzing customer responses to energy efficiency programs, focusing on rebate programs for LED bulbs and low-flow showerheads. It includes metrics such as likelihood of purchase without the program, inconsistency tests, free-ridership calculations, and the influence of promotional materials on customer decisions.

Custom Retrofit Free-ridership algorithm Low Free-ridership Participant High Free-ridership Participant Average Free-ridership Participant Questions Calculation Algorithm Answer Calc. Result Answer Calc. Result Answer Calc. Result likeliho...

AI summary The text presents a table related to the Custom Retrofit program, focusing on free-ridership algorithm calculations. It includes questions and corresponding calculation algorithms to assess the likelihood of participants implementing energy efficiency measures without financial incentives, along with scores derived from their responses.

2018 DSM Evaluation Report Evaluated savings Gross and net energy or peak demand savings calculated by the Evaluator using the parameters (unitary savings values, installation rates, interactive effects, net-to-gross ratio, etc.) validated...

AI summary The 2018 DSM Evaluation Report defines key terms related to demand-side management (DSM) programs, including evaluated savings, free-ridership, gross savings, and installation rates. It outlines how energy efficiency measures impact energy consumption, participant behavior, and market dynamics.

6.2 Fo llow-up on 2017 Evaluation Report Recommendations 33 Table 3: Comparison of ARet Tracked and Evaluated Savings at the Generator xiv Table 4: Instant Savings Net-to-gross Ratio xvii Table 5: Comparison of Instant Savings Tracked and...

AI summary The text presents a table of contents with various tables related to the evaluation of energy efficiency programs, including appliance retirement (ARET), instant savings, and the implementation status of recommendations from a 2017 evaluation report. The tables cover tracked and evaluated savings, survey sample sizes, energy consumption values, and rebate listings.

Table 40: Evaluated Net Energy and Peak Demand Savings by Product Category for Instant Savings 59 Table 41: Comparison of Instant Savings Tracked and Evaluated Savings at the Generator 61 Table 42: ENS Rebated LED Lamp Replacement Intentio...

AI summary The document provides a list of tables and figures that evaluate energy and peak demand savings by product category, compare tracked and evaluated savings, and analyze participation and pricing in residential efficient product rebate programs. It includes data on LED lamp replacements, free-ridership levels, and program planning factors.

ARet Energy Savings For the 2018 evaluation, the Evaluator revised the unitary savings values of appliances retired through ARet and HomeWarming using a methodology similar to that used in previous evaluations, except that induced consumpt...

AI summary The 2018 evaluation of ARet Energy Savings revised unitary savings values for retired appliances, using 2017 metering data due to inconsistencies in 2018 data. Net unitary savings for refrigerators and freezers decreased, while those for air conditioners and small appliances increased. The equivalent net-to-gross ratio (NTGR) was calculated using updated free-ridership and spillover values.

ARet Recommendations Despite operating in the market for several years, ARet continues to achieve considerable levels of participation and savings by encouraging the retirement of inefficient appliances. In addition to the general recommen...

AI summary The ARet program continues to achieve high participation and savings by retiring inefficient appliances. Two key recommendations are made: continuing metering activities with proper protocol and developing a heat gun usage protocol to ensure accurate data collection and proper identification of non-working appliances.

Instant Savings Energy Savings Using a combination of program data, engineering algorithms, and values from the technical literature, the Evaluator validated the unitary savings values used by ENS for each product category rebated through...

AI summary The Evaluator updated unitary savings values for Instant Savings program products, particularly ENERGY STAR certified LED lamps, and measured the Net Total Gross Savings (NTGR) for these products. The evaluation found higher free-ridership and spillover rates than in 2017, indicating that more participants would have purchased LED lamps without the program discount. Future evaluations will need to assess free-ridership for other product categories.

Table 6: Types of Evaluations Conducted for Each Program Component 2017 2018 Program Program Component Process Market Impact Process Market Impact Residential Efficient Appliance Retirement R C C Product Rebates Program Instant Savings R R...

AI summary Table 6 outlines the types of evaluations conducted for each program component in the residential and business energy efficiency programs. It includes process and impact evaluations for various initiatives such as appliance retirement, home energy assessments, and strategic energy management.

1 ARET OVERVIEW This evaluation report first discusses the ARet evaluation results and then the results from the Instant Savings evaluation. This section describes ARet, follows up on the 2017 evaluation recommendations and gives an overvi...

AI summary This section provides an overview of the ARet evaluation, discusses its results, and follows up on 2017 evaluation recommendations. It also outlines the program's participation history.

1.2 Follow-up on 2017 Evaluation Report Recommendations ARet was evaluated in 2017 and recommendations were made by the Evaluator for its improvement. Table 7 below provides a brief summary of the implementation status of each recommendati...

AI summary The 2017 evaluation report on the Appliance Retirement (ARet) program outlined recommendations for improvement, and Table 7 summarizes the implementation status of these recommendations.

Participant Survey In October 2018, CRA conducted a telephone survey with a total of 200 participants. The average length of the survey was nine minutes. All five types of appliances covered by ARet (refrigerators, freezers, air conditione...

AI summary In October 2018, CRA conducted a telephone survey with 200 participants to gather feedback on the Appliance Retirement (ARet) program. The survey covered appliance usage, replacement, satisfaction, and demographics. The margin of error was 5.7% at a 90% confidence level. The report also notes that the 2018 metering results were not used for this evaluation.

Appliance Type Metered Energy Consumption (kWh) Occupant Adjustment Factor Part-Use Factor Gross Unitary Savings (kWh) Net Unitary Savings (kWh) Ratio of Net to Gross Participant Spillover Equivalent NTGR Refrigerators 828 1.12 0.81 751 41...

AI summary The document presents a table summarizing energy consumption and savings data for various appliance types, including refrigerators, freezers, air conditioners, and small fridges. The Evaluator updated tracked savings values using a methodology similar to that used in the previous five evaluations, relying on 2017 metering results and 2018 survey data to calculate energy consumption and savings.

Residential Efficient Product Rebates Program Efficiency Nova Scotia 2018 DSM Evaluation Report For evaluation activities that yield quantitative results based on a sample, the Evaluator aimed to achieve a maximum margin of error of 10 per...

AI summary The 2018 DSM Evaluation Report discusses the methodology used to calculate margins of error for survey samples and free-ridership rates in the Residential Efficient Product Rebates Program. The Evaluator aimed for a maximum margin of error of 10 percent at a 90 percent confidence level, with examples provided in Appendix II.

9.2.1 Free-ridership In the case of Instant Savings, the Evaluator assessed the free-ridership level by determining which LED lamps would still have been bought by participants in the absence of the program component. The free-ridership le...

AI summary The free-ridership level for LED lamps sold through Instant Savings in 2018 was 39%, higher than 32% in 2017. The assessment used a self-reporting approach and an algorithm that considers variables like awareness of discounts and purchase intent. Free-ridership for other products rebated through Instant Savings was considered nil, though future assessments may need to include these products.

Residential Efficient Product Rebates Program Efficiency Nova Scotia 2018 DSM Evaluation Report The retailer interviews were used to estimate the level of spillover by measuring the market effects attributable to the program component for...

AI summary The 2018 DSM Evaluation Report discusses the spillover effect of the Residential Efficient Product Rebates Program, particularly the Instant Savings campaign. It found that 81% of LED lamp sales occurred without receiving a rebate, leading to a 25% spillover level, an increase from 16% in 2017. This is attributed to reduced market barriers and broader availability of LED lamps.

Table 41 compares the energy and peak demand savings established by this evaluation with the savings calculated in the 2018 tracking sheet.

AI summary Table 41 compares energy and peak demand savings from the current evaluation with those from the 2018 tracking sheet, highlighting changes and differences in the savings calculations.

DEFINITIONS Accuracy Reflects the proximity of measurements to the true value. Evaluated savings Gross and net energy or peak demand savings calculated by the Evaluator using the parameters (unitary savings values, installation rates, inte...

AI summary The document defines key terms related to energy efficiency program evaluation, including accuracy, evaluated savings, evaluation plans, first-year savings, free-ridership, and gross savings. These definitions help quantify the impact of energy efficiency initiatives.

Net savings Energy or peak demand savings that can be reliably attributed to a program. This includes effects, such as free-ridership and spillover, that negatively or positively affect the savings attributable to a program. Net-to-gross r...

AI summary The document defines key terms related to energy program evaluation, including net savings, net-to-gross ratio, non-sampling error, peak demand savings, and tracked savings. These metrics are used to assess the effectiveness of energy efficiency initiatives.

Home Energy Assessment HEA encourages homeowners to improve the energy efficiency and comfort of their homes by improving building envelopes, space heating systems, water heating systems, and mechanical ventilation systems. Eligible measur...

AI summary The Home Energy Assessment (HEA) program encourages homeowners to improve energy efficiency and comfort through various home improvements. The program underwent several changes, including the removal of tiered rebates and the inclusion of non-electrically heated households after receiving funding from the Low Carbon Economy Fund in 2018. An evaluation in 2018 included documentation reviews, interviews, billing analysis, and project reviews.

HEA Energy Savings The objective of the 2018 HEA impact evaluation was to determine net energy and peak demand savings. To calculate gross savings, the Evaluator reviewed the contents of the 2018 tracking sheet. The Evaluator employed the...

AI summary The 2018 HEA impact evaluation calculated net energy and peak demand savings using updated ORs and unitary savings values. The evaluation did not update free-ridership or spillover levels due to recent HEA changes, so 2017 levels were used. A NTGR of 0.76 was applied based on 2017 data.

HEA Recommendations The 2018 evaluation revealed that HEA succeeded in achieving significant net and peak demand energy savings, although at lower levels than in previous years. Significant changes to HEA occurred in the second half of 201...

AI summary The 2018 evaluation of the Home Energy Assessment (HEA) program showed significant energy savings, though lower than in previous years. Changes in 2018, such as reinstating funding for non-electrically heated households and revising incentives, were too recent to impact the evaluation. Recommendations include conducting a billing analysis to assess overestimation ratios and sharing evaluation findings with energy advisors to improve simulation accuracy.

Green Heat Green Heat provides financial incentives to homeowners and encourages them to reduce heating electricity consumption by either installing high-efficiency electrical systems or replacing existing electrical heating systems with s...

AI summary Green Heat offers financial incentives for installing high-efficiency heating systems, including heat pumps, biomass, and solar thermal. As of August 2017, it shifted to an after-purchase mail-in rebate model and introduced new eligibility criteria. In 2018, it expanded to non-electrically heated homes with funding from the LCEF. The program evaluation involved documentation reviews, interviews, and on-site visits.

Green Heat Energy Savings To calculate Green Heat gross energy savings, the Evaluator reviewed the unitary savings values used for each type of equipment category based on the information in the tracking sheet, site visit results, literatu...

AI summary The Evaluator calculated Green Heat energy savings by reviewing unitary savings values, site visits, and billing analysis. Discrepancies were found in tracked data, particularly for MSHPs and ASHPs, leading to adjustments in savings estimates. Free-ridership levels increased significantly in 2018 due to a new delivery mechanism, with 54% of MSHP participants already deciding to install equipment before the program.

Green Heat Recommendations The Evaluator noted that Green Heat participation increased significantly in 2018 (by 67%), likely due to changes to the application process and ENS promotional efforts. Changes in free-ridership levels and the M...

AI summary The Evaluator noted a 67% increase in Green Heat participation in 2018, likely due to process changes and promotional efforts. Issues with tracking sheet data accuracy and the need to monitor barriers to high-efficiency MSHP adoption were identified. Recommendations include improving data quality and adapting program strategies based on market trends.

1.2 Follow-up on the 2017 Evaluation Report Recommendations HEA was evaluated in 2017 and improvement recommendations were made by the Evaluator. Table 9 below provides a summary of the implementation status of each recommendation presente...

AI summary The 2017 Evaluation Report on HEA (Home Energy Assessment) identified areas for improvement, and Table 9 summarizes the implementation status of the recommendations made by the Evaluator.

2 HEA EVALUATION OBJECTIVE AND METHODOLOGY The main objective of the HEA evaluation is as follows: › Calculating program results, namely electrical first-year and lifetime energy savings, peak demand savings, and avoided GHG emissions This...

AI summary The HEA evaluation aims to calculate program results, including energy savings and GHG emissions. The methodology involves reviewing program documentation, meeting with the program manager, and collecting data through structured instruments. The evaluation also calculates margins of error for free-ridership and spillover levels to ensure the precision of quantitative results.

Comparison with 2017 Evaluation Scope No market evaluation was carried out for HEA in 2018; hence, no participant survey was conducted. The impact evaluation scope was considered reduced since net-to-gross ratios (NTGRs) were not measured...

AI summary In 2018, no market evaluation was conducted for HEA due to the absence of participant surveys. The evaluation scope was reduced as NTGRs were not measured. These decisions were informed by the 2018 evaluation objectives, prior results, and recent program changes within the ENS portfolio, with further details in Section 1 of the DSM Programs Evaluation Executive Summary.

In 2017, a participant survey was used to assess participant spillover, which occurs when participants implement additional energy efficiency measures recommended in their initial energy assessments after their participation in the program...

AI summary In 2017, a participant survey was conducted to assess participant spillover, which refers to the implementation of additional energy efficiency measures following initial energy assessments. No data collection was done in 2018 to update this level, so the 2017 level was used in the evaluation. Table 18 outlines the 2017 participant spillover level.

3.4 Unconverted D Assessment Spillover Since the 2014 evaluation, another spillover effect associated with unconverted D assessment savings has been considered. This effect corresponds to the savings associated with those measures implemen...

AI summary This section discusses the unconverted D assessment spillover effect, which includes energy savings from participants who did not complete an E assessment within the 12-month period. Data from 2016 and 2018 evaluations show that 54% of expired participants installed upgrades, with an average electrical savings of 2,283 kWh per participant. In 2018, total spillover savings were estimated at 0.836 GWh and 0.236 MW.

4 HEA RECOMMENDATIONS The 2018 evaluation revealed that HEA succeeded in achieving significant net and peak demand energy savings, although at lower levels than in previous years. Significant changes to HEA occurred in the second half of 2...

AI summary The 2018 evaluation of the Home Energy Assistance (HEA) program showed significant but lower-than-previous energy savings. Changes in 2018, such as reinstating funding for non-electrically heated households and revising incentive structures, were too recent to show impacts in the 2018 evaluation. The Evaluator recommends conducting a billing analysis to evaluate overestimation ratios and the impact of different HOT2000 versions on energy savings.

2018 HEA-R2. Share evaluation findings with the EAs to ensure sustained quality simulations. As part of the 10 HEA on-site visits and HOT2000 simulation reviews, the Evaluator noted that significant improvements have been achieved in both...

AI summary The Evaluator noted significant improvements in data collection accuracy and quantity since 2016, with EAs performing well in recording household energy data and complying with EnerGuide requirements. However, recurrent mistakes in HOT2000 simulations were identified, and feedback is recommended to improve the project review process.

2017 Recommendations Status 2017 GH-R1. Perform the ASHP billing analysis again in 2018. Implemented 2017 GH-R2. Conduct a survey with a larger sample of participants who installed MSHPs in non-electrically heated households. Implemented 2...

AI summary The 2017 Green Heat recommendations were largely implemented by ENS, with the exception of GH-R5, which is still in progress. The implemented recommendations focused on evaluation activities, including billing analysis and market evolution studies. The results of these evaluations are detailed in specific sections of the report.

6 GREEN HEAT EVALUATION OBJECTIVES AND METHODOLOGY The main objectives of the Green Heat evaluation are as follows: - > Reporting on participant perspectives - Calculating program results, namely electrical first-year and lifetime energy s...

AI summary The Green Heat evaluation aims to report on participant perspectives, calculate program results such as energy savings and GHG emissions, and analyze the market evolution of MSHPs. The methodology includes data collection, review of program documentation, and meetings with program managers to ensure alignment with evaluation goals and previous recommendations.

Participant Survey In October and November 2018, CRA conducted a telephone survey with 90 participants. The average length of the survey was 16 minutes. The questionnaire and complete survey results are presented in Appendices IV and V. Th...

AI summary In 2018, CRA conducted a telephone survey with 90 participants to gather feedback on the Green Heat Program, covering aspects such as program awareness, participation motivations, equipment usage, free-ridership, satisfaction, barriers to installation, and demographic information. The survey results are detailed in Appendices IV and V.

8.1 Gross Savings Gross savings correspond to the change in energy consumption that results from actions taken by participants regardless of their reasons for participating.18 For Green Heat, the Evaluator reviewed the unitary savings valu...

AI summary Gross savings refer to the change in energy consumption due to participant actions. For the Green Heat program, the Evaluator used 2017-established EUL values to calculate lifetime energy savings in 2018, considering unitary savings, peak demand-to-energy ratios, and interactive effects.

Table 32 compares the energy and peak demand savings established through this evaluation to those calculated in the tracking sheet.

AI summary Table 32 compares the energy and peak demand savings from the evaluation to those in the tracking sheet, highlighting discrepancies or confirmations between the two sets of data.

9.4 Green Heat Recommendations The Evaluator noted that Green Heat participation increased significantly in 2018 (by 67%), likely due to changes to the application process and ENS promotional efforts. Changes in free-ridership levels and t...

AI summary The Evaluator highlights that Green Heat participation increased in 2018 due to process changes and promotional efforts. However, data reliability issues were found in the tracking sheet, and the program's influence on MSHP adoption is diminishing. Recommendations include improving data accuracy and continuing to monitor market barriers for high-efficiency MSHPs.

11 EPI EVALUATION OBJECTIVES AND METHODOLOGY The main objectives of the EPI evaluation are as follows: - › Reporting on participant perspectives - › Calculating program results, namely electrical first-year and lifetime energy savings, pea...

AI summary The EPI evaluation objectives include reporting on participant perspectives and calculating program results such as energy savings and GHG emissions. The methodology involved reviewing EPI documentation, meeting with the program manager, and using a sampling approach with a 10% margin of error at a 90% confidence level to ensure precision in measurements.

Participant Survey In October 2018, CRA conducted a telephone survey with a total of 100 non-low-income participants39 comprising 70 owners and 30 tenants. The average length of the survey was 18 minutes. The questionnaire and complete sur...

AI summary A telephone survey conducted by CRA in October 2018 with 100 non-low-income participants assessed feedback on the Efficient Product Installation (EPI) program, including installation satisfaction, barriers to energy efficiency upgrades, and recommendations for improvement. The survey aimed to evaluate free-ridership and spillover effects.

Comparison with 2017 Evaluation Scope The impact evaluation scope is defined as reduced in 2018 since the Evaluator did not conduct any on-site visits. This is justified because the products offered were very similar to previous years and...

AI summary The impact evaluation scope was reduced in 2018 due to the Evaluator not conducting on-site visits, as products, delivery methods, and service providers remained consistent with 2017. The EPI program has reached high maturity, leading to consistent results from on-site visits over recent years.

For EPI, participant spillover occurs when participants purchase and install additional energy efficient products, due to the influence of having previously participated in the program component, without receiving any additional support fr...

AI summary The document discusses participant spillover in the Efficient Product Installation (EPI) program, where participants install additional energy-efficient products after initial participation without additional program support. Survey results from 2017 and 2018 are used to determine spillover levels, with 3% for non-low-income owners and 4% for non-low-income tenants in 2018, down from 6% in 2017.

Green Heat Green Heat achieved 4.227 GWh in net electrical energy savings and 4.042 MW in net peak demand savings in 2018, thus surpassing both the planned 3.7 GWh in electrical energy savings and the planned 3.8 MW in peak demand savings....

AI summary Green Heat achieved significant energy savings in 2018, surpassing planned targets. Factors like the removal of pre-approval and increased marketing contributed to higher participation. The program's evaluation highlighted the importance of contractor awareness and participant satisfaction, while also noting challenges with data accuracy in billing analyses.

Green Heat Appendix IV GH: Participant Survey Questionnaire Appendix V GH: Participant Survey Results Appendix VI GH: On-site Visit Sampling Methodology and Protocol Appendix VII GH: Distributors Interview Guide Appendix VIII GH: Savings R...

AI summary The 'Green Heat' section includes appendices related to a participant survey questionnaire, survey results, on-site visit sampling methodology, distributor interviews, savings reviews, free-ridership calculation algorithms, and 2018 recommendations.

Efficient Product Installation Appendix XI EPI: Participant Survey Questionnaire Appendix XII EPI: Participant Survey Results Appendix XIII EPI: Detailed Calculations of Unitary Savings Values Appendix XIV EPI: Detailed Calculations of Equ...

AI summary The document contains appendices related to the Efficient Product Installation (EPI) program, including survey questionnaires, results, calculations of savings values, free-ridership algorithms, spillover methodology, and 2018 recommendations. These appendices support the evaluation and implementation of energy efficiency initiatives.

[READ IF ONE EQUIPMENT IN THE DATABSE] - V1. Our records indicate that your household installed a [EQUIPMENT 1] through the Green Heat program. Is this correct? - 1. Yes [CONTINUE] - 2. No, does not recall participating [PROBE: Are you sur...

AI summary The text is a questionnaire asking a household if they installed a specific equipment through the Green Heat program, with options to confirm, deny, or indicate lack of knowledge, and subsequent steps based on responses.

Section Recommendations 1. Improve the accuracy of the information in the tracking sheet. While reviewing the data for the ducted air-source heat pump (ASHP) billing analysis, the Evaluator noticed that the information on primary and secon...

AI summary The evaluation highlights issues with the accuracy of the Green Heat tracking sheet data, particularly regarding heating system information. It also recommends continuing to monitor barriers to high-efficiency MSHP adoption and improving clarity on eligible ASHP equipment for participants.

APPENDIX XV EPI: ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity,...

AI summary This appendix outlines an algorithm for calculating free-ridership in the context of ENS' energy efficiency programs, specifically the EPI Service. It includes survey questions designed to assess participant behavior and the influence of previous program participation on current energy efficiency decisions.

APPENDIX XVI EPI: PARTICIPANT SPILLOVER METHODOLOGY Participant spillover was measured using a participant survey. Participants were asked whether, following their participation in the program component, they bought and implemented any add...

AI summary This appendix describes the methodology used to measure participant spillover in the EPI program. It involved surveying participants to determine if they implemented additional energy-efficient products outside of the program's rebate offerings and quantifying the savings and influence of the program on these actions.

APPENDIX XVII EPI: 2018 RECOMMENDATIONS This appendix summarizes all the recommendations made by the Evaluator as part of the 2018 evaluation of the Efficient Product Installation (EPI) program component, as well as all 2017 evaluation rec...

AI summary This appendix outlines the 2018 recommendations from the Evaluator for the Efficient Product Installation (EPI) program component, including any 2017 recommendations that were not fully implemented.

DEFINITIONS Accuracy Reflects the proximity of measurements to the true value. Evaluated savings Gross and net energy or peak demand savings calculated by the Evaluator using the parameters (unitary savings values, installation rates, inte...

AI summary The text defines key terms related to energy efficiency program evaluation, including accuracy, evaluated savings, evaluation plans, first-year savings, and free-ridership. These definitions are essential for assessing the effectiveness of energy efficiency initiatives.

NHC Overview Administered by Efficiency Nova Scotia (ENS), NHC encourages homeowners and builders to exceed energy efficiency building code requirements for new homes. Participation in NHC involves completing the following steps: (1) revie...

AI summary The New Home Construction (NHC) program, administered by Efficiency Nova Scotia (ENS), encourages energy efficiency in new homes by offering incentives based on performance levels. The program was updated in 2017 with a new EnerGuide rating system and again in 2018. A 2018 evaluation included documentation reviews, interviews, and on-site assessments to evaluate program effectiveness.

NHC Energy Savings The objective of the 2018 NHC impact evaluation was to establish net energy and peak demand savings. Prior to reviewing the gross savings calculations, the Evaluator reviewed the contents of the 2018 tracking sheet to en...

AI summary The 2018 NHC impact evaluation calculated net energy and peak demand savings by adjusting gross energy savings with overestimation ratios and applying net-to-gross ratios (NTGRs). Free-ridership and market effects levels from 2017 were used, resulting in NTGRs of 0.95 for NHC and 0.39 for the Passive House pilot. Net savings were determined as 4.481 GWh and 1.268 MW for NHC, and 0.035 GWh and 0.010 MW for the Passive House pilot.

Table 3: Overall Comparison of Tracked and Evaluated Savings at the Generator Initial Gross Savings Adjusted Gross Savings NTGR Net Savings Energy Savings ENS Tracked Savings 5.901 GWh 4.946 GWh 0.90 4.451 GWh Evaluation Results 5.901 GWh...

AI summary Table 3 compares tracked and evaluated energy and peak demand savings. The evaluated savings are slightly lower than tracked values for adjusted gross savings but higher for net savings due to changes in the NTGR value for NHC and Passive House. This reflects updated ORs and revised NTGR values used in the evaluation.

3.1 The Builder Journeys Builder participation through a new home construction program can be categorized into five distinct phases: (1) program outreach and recruitment; (2) DA selection (or having one assigned); (3) project registration;...

AI summary The document outlines five phases of builder participation in a new home construction program: outreach and recruitment, DA selection, project registration, application review, and construction with inspections. It references a qualitative study on the ENS New Home Construction Program conducted by Corporate Research Associates in 2018.

CONCLUSION The New Residential program, including NHC and the Passive House pilot, achieved 4.515 GWh in net energy savings and 1.278 MW in net peak demand savings at the generator, which resulted in 2,766 tonnes of CO2 eq in avoided annua...

AI summary The New Residential program achieved significant energy and demand savings, with results close to 2018 targets. The evaluation found improvements in data accuracy but noted documentation gaps. Process evaluations identified opportunities to enhance builder satisfaction and program efficiency by improving registration and construction processes.

Successes, Challenges, and Opportunities To wrap-up I have a few general questions about the program's successes, challenges, and opportunities. [ASK ALL] Q34. What do you think builders and homeowners like best about your program? [ASK AL...

AI summary The text outlines a set of questions posed to stakeholders regarding the program's successes, challenges, and opportunities, focusing on perspectives from builders and homeowners, as well as potential changes to the program in the near future.

This appendix summarizes all the recommendations made by the Evaluator throughout the report as well as the section from which the recommendations originated. Sections Recommendations 3. Share evaluation findings with the EAs to ensure sus...

AI summary This section highlights the Evaluator's recommendations to improve the accuracy of energy simulations and ensure all required documentation is included in participant files, noting that while improvements have been made since 2016, many files still lack essential building plans or as-built reports.

Sections Recommendations 5. Ensure the tracked savings are accurate. Prior to reviewing the gross savings calculations, the Evaluator identified several issues in the 2018 tracking sheet, including with values that had been entered manuall...

AI summary The Evaluator identified issues with manual data entry in the 2018 tracking sheet and recommended that ENS apply consistent formulas for tracking NHC savings in future years to ensure accuracy.

Table 18: Free-ridership for BER Instant Rebates 46 Table 19: NTGR for BER Instant Rebates 47 Table 20: Evaluated Net Energy and Peak Demand Savings for BER Instant Rebates 49 Table 21: Comparison of Tracked and Evaluated Savings at the Ge...

AI summary The document presents tables and figures related to the Business Energy Rebates (BER) program, including free-ridership analysis, net-to-gross ratios, energy and peak demand savings, rebate values, and participant satisfaction metrics. It evaluates the effectiveness and participation rates of the BER program from 2012 to 2018.

Table 5: Types of Evaluations Conducted for Each Program Component 2017 2018 Program Program Component Process Market Impact Process Market Impact Residential Efficient Product Appliance Retirement R C C Rebates Program Instant Savings R R...

AI summary The document presents Table 5, which outlines the types of evaluations conducted for each program component in 2017 and 2018, including process and impact evaluations. It indicates the evaluation status for various programs such as the Residential Efficient Product Rebates Program, the Existing Residential Program, and the Direct Installation Program.

2 BER EVALUATION OBJECTIVES AND METHODOLOGY The main objectives of the BER evaluation are as follows: - › Assessing the effectiveness of BER design and delivery - › Reporting on participant and partner perspectives - › Calculating program...

AI summary The BER evaluation objectives include assessing the program's effectiveness, reporting on stakeholder perspectives, calculating energy and GHG savings, and analyzing LED lamp market evolution. The methodology involved document reviews, meetings with program managers, and statistical sampling with a 10% margin of error at a 90% confidence level.

Participant Survey In October and November 2018, CRA conducted a telephone survey with a total of 70 BER Mail-in participants. The average length of the survey was 17 minutes. The questionnaire and complete survey results are presented in...

AI summary In October and November 2018, CRA conducted a telephone survey with 70 BER Mail-in participants to gather feedback on various aspects of the program, including awareness, participation reasons, experience, free-ridership, and satisfaction. The survey had an 8.5% margin of error at a 90% confidence level.

Participant Survey In October and November 2018, CRA conducted a telephone survey with a total of 50 Instant Rebates participants. Of the 50 participants, 30 were end users who had purchased LED lighting measures for their own business and...

AI summary In October and November 2018, CRA conducted a telephone survey with 50 Instant Rebates participants to gather feedback on their reasons for participation, awareness of ENS rebates, and the influence of promotional materials. The survey aimed to understand decision-making processes and project types for eligible measures, with a margin of error of 11.8% at a 90% confidence level.

Savings Review Similarly to the 2017 evaluation, the savings review for the 2018 evaluation was limited to validating whether tracked savings were consistent with the recommended values from the 2016 evaluation.

AI summary The 2018 savings review was limited to validating whether tracked savings aligned with the 2016 evaluation's recommended values, similar to the approach taken in the 2017 evaluation.

Table 14: Comparison of Tracked and Evaluated Savings at the Generator – BER Mail-in Initial Gross Savings Adjusted Gross Savings NTGR Net Savings Energy Savings ENS Tracked Savings 25.235 GWh 25.235 GWh 0.86 21.702 GWh Evaluation Results...

AI summary Table 14 compares tracked and evaluated savings from the BER Mail-in program. Energy savings were 3% lower in evaluation results than tracked values, primarily due to adjustments in lighting, motor, and VFD measure categories. The NTGR decrease also contributed to a 6% difference in net energy savings between tracked and evaluated results.

BER Appendix I - BER: Mail-in Participant Survey Questionnaire Appendix II - BER: Mail-in Participant Survey Results Appendix III - BER: Mail-in Interview Guide with Contractors Appendix IV - BER: Mail-in On-site Visit Sampling Methodology...

AI summary The document outlines various appendices related to the Bill-Entry Rebate (BER) program, including survey questionnaires, results, interview guides, sampling methodologies, savings calculations, and recommendations. These appendices support the evaluation and administration of the BER program.

Previous ENS Program Component Participation Led to Assess Product Cost-effectiveness 2016 2017 2018 Sample Size 36 33 34 Agree 89% 91% 79% Disagree 11% 9% 15% Don't know/refused - - 6% Base: Respondents who previously participated in anot...

AI summary This chunk presents survey data on customer participation in Efficiency Nova Scotia (ENS) programs and the effectiveness of promotional materials. It shows varying levels of agreement across years regarding the impact of ENS materials on decision-making and product cost-effectiveness.

FR3b. [ASK IF TOTAL MEASURE CATEGORY QTY>1] If the rebate had not been offered, what is the likelihood that you would have purchased exactly the same quantity of lighting products that you bought? Response 98 Don't Know 99 Refused FR3c. [A...

AI summary This section of the document includes survey questions related to the influence of rebate programs and information received on purchasing decisions for lighting products. The questions focus on the impact of rebate programs and information from program representatives and distributors on customer behavior.

Previously Seen Energy Efficiency Promotional Materials Distributed by ENS Sample Size 50 Yes 96% No 2% Don't know 2% CI4a. The energy efficiency promotional materials distributed by Efficiency Nova Scotia were a major factor in the compan...

AI summary The document presents survey results showing that a majority of respondents found Efficiency Nova Scotia's energy efficiency promotional materials influential in their purchasing decisions, prompting inquiries about efficient products and considerations of cost-effectiveness.

This appendix summarizes all the recommendations made by the Evaluator as part of the 2018 evaluation, as well as all 2017 evaluation recommendations that were not fully implemented. Sections Recommendations 1. Review BER logic model and e...

AI summary This appendix summarizes recommendations from the 2018 evaluation and unimplemented recommendations from the 2017 evaluation, focusing on the need to review the BER logic model and eligibility criteria for intended projects.

6.2 Net -to-gross Ratio2 29 6. 2.1 Free-ridership 29 6.3 Net Savings 30 7 В UILD ING OPTIMIZATION MARKET EVALUATION 31 8 В UILD ING OPTIMIZATION IMPACT EVALUATION 32 8.1 Gro ss Savings 32 8. 1.1 Project Review Findings 32 8. 1.2 Interactiv...

AI summary The document outlines various evaluations related to energy efficiency programs, including market evaluations, impact assessments, and the calculation of net-to-gross ratios and net savings. It references follow-up actions on previous evaluation reports and describes the objectives and methodologies used in these assessments.

Retrofit Retrofit accounted for both 77 percent of Custom savings and 84 percent of Custom projects completed in 2018 (58 of the 69 projects with final savings being claimed in 2018). The number of completed projects increased with respect...

AI summary In 2018, Retrofit accounted for a large portion of Custom savings and projects. The evaluation noted improved documentation and participant satisfaction, but also identified issues with quality assurance, non-routine adjustments in M&V calculations, and peak demand savings adjustments. The free-ridership level was measured at 14 percent.

New Construction In 2018, five projects were completed through New Construction. A detailed technical review, including a site visit and a simulation review, was performed for four of the completed projects. Additionally, a process and mar...

AI summary In 2018, five New Construction projects were completed, with four undergoing a detailed technical review. A process and market evaluation was conducted through interviews with service providers and participant feedback during site visits.

Custom Recommendations Although the number of completed Retrofit projects increased and Retrofit remains the main contributor to overall Custom savings, Retrofit savings decreased significantly in 2018 compared to 2017. New Construction an...

AI summary The 2018 Custom program evaluation highlights a decline in Retrofit savings and challenges in New Construction participation. Key issues include unclear communication about service steps and requirements, low engagement with SPs, and a lack of modellers and architects in the ETN. Recommendations focus on improving communication and engagement strategies to boost participation and service quality.

Energy Management Information System The main goal of EMIS is to assist industrial businesses and institutions in making real-time decisions about their processes using energy consumption data from metered systems. To achieve this goal, EM...

AI summary The Energy Management Information System (EMIS) assists industrial businesses and institutions in making real-time energy decisions through audits, implementation plans, and metering equipment. The 2018 evaluation of EMIS included documentation reviews, interviews, and project assessments.

Table 4: Comparison of EMIS Tracked and Evaluated Savings at the Generator Initial Gross Savings Adjusted Gross Savings NTGR Net Savings Energy Savings ENS Tracked Savings 1.637 GWh 1.637 GWh 1.00 1.637 GWh Evaluation Results 1.637 GWh 1.6...

AI summary Table 4 compares energy and peak demand savings tracked by ENS with evaluated savings. Evaluated energy savings were 1% lower than tracked savings due to minor changes in the evaluator's calculation and incorrect tracking of the 2017 project by ENS.

SEM Energy Savings To evaluate energy savings, the Evaluator reviewed the preliminary project documentation provided by ENS to prepare on-site visits and understand the key operating variables that had been chosen to create the regression...

AI summary The Evaluator assessed the energy savings from the Strategic Energy Management (SEM) program in 2018, finding that the tracked savings required minimal adjustments, primarily due to errors in ENS tracking. Peak demand savings were calculated by the Evaluator, and an average effective useful life of three years was applied to the savings. Free-ridership and spillover effects were assumed to be nil, but the Evaluator recommended continued monitoring. A special adjustment was made for a participant who installed high-efficiency lighting through Business Energy Rebates (BER) before starting SEM.

EMIS and SEM Recommendations Both EMIS and SEM achieved their savings targets in 2018 and participation satisfaction remained high. EMIS saw additional incremental savings being achieved in the continuing participant's fourth year of parti...

AI summary EMIS and SEM achieved their savings targets in 2018 with high participant satisfaction. However, participants rely heavily on service providers for energy performance tracking, and many lack the resources to continue independently. The Evaluator recommends reviewing program delivery to improve participant understanding and mastery of energy performance tracking.

2 CUSTOM EVALUATION OBJECTIVES AND METHODOLOGY The main objectives of the Custom evaluation are as follows: - › Assessing the effectiveness of New Construction design and delivery - › Reporting on participant and partner perspectives - › C...

AI summary The Custom evaluation objectives focus on assessing the effectiveness of New Construction design and delivery, reporting participant and partner perspectives, and calculating program results such as energy savings and avoided GHG emissions. The methodology includes reviewing program documentation, meetings with program managers, and data collection with a target margin of error of 10% at a 90% confidence level.

Project File Review and On-site Visits In the fall of 2018, Equilibrium and Technosim, a subcontractor of Econoler, carried out a full technical review of project documentation and on-site visits on a sample of 2018 Retrofit, New Construct...

AI summary In 2018, Equilibrium and Technosim reviewed 25 Retrofit, 4 New Construction, and 3 Building Optimization projects to assess free-ridership, participant satisfaction, and implementation barriers. On-site visits and interviews were conducted to validate technical specifications and collect data on project characteristics and operations.

4.1.1 Sampling Methodology The Evaluator selected a sample of 25 projects from a total of 58 completed projects as of January 2019. The nine projects with partially claimed savings were excluded from the project reviews because they will b...

AI summary The Evaluator selected 25 projects from 58 completed projects as of January 2019, excluding nine with partially claimed savings. Due to the limited number of completed projects in November 2018, a stratified sampling method was not used, and projects were selected to represent a variety of types and include a higher proportion of larger projects.

4.1.5 Revised Gross Savings For projects that claimed partial savings over previous years and were completed in 2018, the Evaluator calculated a true-up adjustment. This true-up adjustment is added to the total adjusted gross savings claim...

AI summary The document discusses the calculation of revised gross savings for energy efficiency projects, particularly those completed in 2018. A true-up adjustment is applied to projects that claimed partial savings over previous years, ensuring the total adjusted gross savings align with the total tracked project savings multiplied by an adjustment ratio.

6 NEW CONSTRUCTION IMPACT EVALUATION The objective of the 2018 New Construction impact evaluation was to determine the gross and net electrical energy and peak demand savings. Like Retrofit, New Construction claims three types of savings:...

AI summary The 2018 New Construction impact evaluation aimed to assess gross and net electrical energy and peak demand savings. The evaluation categorized savings into partial, final for current year projects, and final for multi-year projects. In 2018, one project had partial savings, five projects had final savings, and no multi-year projects had final savings that year.

10 CUSTOM RECOMMENDATIONS Although the number of completed Retrofit projects increased and Retrofit remains the main contributor to overall Custom savings, Retrofit savings decreased significantly in 2018 compared to 2017. New Construction...

AI summary The 2018 DSM Programs Evaluation highlights a decline in Retrofit savings and challenges with New Construction participation. Key issues include unclear communication about service requirements and a lack of engagement with professionals involved in early construction stages. Recommendations focus on improving communication and expanding stakeholder engagement to boost participation.

11 EMIS OVERVIEW The following sections present the EMIS evaluation results. This section describes the EMIS program component, follows up on the 2017 evaluation recommendations and provides an overview of the participation history.

AI summary This section provides an overview of the EMIS program component, follows up on 2017 evaluation recommendations, and outlines participation history.

Table 17: Implementation Status of the 2017 Recommendations for EMIS 2017 Recommendations Status 2017 EMIS-R1. Ensure that the tracking sheet is complete and accurate. Being Implemented 2017 EMIS-R2. Design baseline regressions and plan M&...

AI summary Table 17 outlines the implementation status of 2017 recommendations for the Energy Management Information System (EMIS). While some recommendations were implemented, discrepancies in 2018, such as incorrect savings and missing demand savings, led to the conclusion that one recommendation was only partly implemented.

14.2.1 Project Review Findings ENS tracked savings for two EMIS projects in 2018; one was a continuing participant in the fourth year of participation and the other was a participant that had not yet reported any annual savings. Since thos...

AI summary ENS tracked savings for two EMIS projects in 2018. One project was in its fourth year of participation, while the other had not yet reported any annual savings. The differing scopes of the projects led to separate reporting of findings.

15 SEM OVERVIEW This section describes the SEM program component, follows up on 2016 evaluation recommendations, since SEM was not evaluated in 2017, and provides an overview of participation history.

AI summary This section outlines the SEM program component, addresses 2016 evaluation recommendations, notes that SEM was not evaluated in 2017, and provides an overview of participation history.

15.3 Participation History Although two projects were launched in fall 2017, these projects started generating savings only in January 2018 and were therefore included in the 2018 evaluation. Two other projects generated savings in 2018 af...

AI summary The document discusses the participation history in the Sustainable Energy Management (SEM) program from 2015 to 2018, noting the number of active participants and savings generated. In 2018, four projects started generating savings, with participation levels higher than 2017 but lower than 2015 and 2016. Savings per participant in 2018 were similar to 2015 due to new participants in both years.

16 SEM EVALUATION OBJECTIVES AND METHODOLOGY The main objectives of the SEM evaluation are as follows: - › Reporting on participant perspectives - › Calculating program results, namely electrical first-year and lifetime energy savings, pea...

AI summary The SEM evaluation aims to report on participant perspectives and calculate program results, including energy savings and GHG emissions. The methodology includes reviewing SEM documentation, meeting with the program manager, and collecting data to assess program effectiveness.

On-site Visits and Savings Review In the fall of 2018, the Evaluator carried out a review of project documentation for all SEM projects in preparation for site visits. The on-site visits, also performed in the fall of 2018, allowed the Eva...

AI summary In the fall of 2018, an Evaluator reviewed project documentation and conducted on-site visits for SEM projects to understand energy consumption drivers, validate energy models, and assess savings calculations. The visits also aimed to evaluate free-ridership and program satisfaction.

Recommendations Three participants made suggestions on how to improve SEM. One participant suggested reducing the number of in-person visits since they were somewhat dissatisfied by the number of visits conducted by ENS and the Evaluator....

AI summary Three participants provided feedback on improving the Sustainable Energy Management (SEM) program. One suggested reducing in-person visits due to dissatisfaction with the frequency, while others requested more visits and assistance in identifying priority energy measures.

18.1 Gross Savings This subsection describes the methodology used to review the four SEM projects that generated savings in 2018 and summarizes the review findings. Interactive effects and revised gross savings are also assessed. As recomm...

AI summary This section outlines the methodology for reviewing four SEM projects that generated savings in 2018 and summarizes the findings. It notes that ENS now tracks both incremental and cumulative savings, and since all 2018 participants are new, incremental savings equal cumulative savings. The evaluation focuses on the incremental savings reported to regulators.

Table 24: Comparison of SEM Total Tracked and Evaluated Savings at the Generator Initial Gross Savings Adjusted Gross Savings NTGR Net Savings Energy Savings ENS Tracked Savings 1.681 GWh 1.681 GWh 1.00 1.681 GWh Evaluation Results 1.681 G...

AI summary The table compares energy and peak demand savings tracked by ENS and evaluated results. Evaluated gross energy savings were 8% lower than tracked due to incorrect tracking of savings from capital projects and adjustments made by the Evaluator after the tracking sheet was submitted. Net savings were 13% below tracked savings.

19 EMIS AND SEM RECOMMENDATIONS Both EMIS and SEM achieved their savings targets in 2018 and participation satisfaction remained high. EMIS saw additional incremental savings being achieved in the continuing participant's fourth year of pa...

AI summary EMIS and SEM achieved their savings targets in 2018 with high participant satisfaction. However, participants rely heavily on service providers for energy performance tracking, which limits their ability to sustain efforts independently. Recommendations focus on improving participant understanding and mastery of energy performance tracking to increase savings persistence and satisfaction.

Custom Custom is comprised of the Retrofit, New Construction and Building Optimization services. Altogether, these services generated 11.603 GWh in net electrical energy savings and 1.200 MW in net peak demand savings at the generator in 2...

AI summary The Custom program, including Retrofit, New Construction, and Building Optimization services, achieved significant energy and peak demand savings in 2018. However, the Evaluator noted issues with documentation accuracy and free-ridership, particularly in New Construction, and recommended improvements in communication and process clarity.

Strategic Energy Management Four participants generated savings in 2018, and all were new participants. The Evaluator determined that SEM achieved 1.455 GWh in net electrical energy savings and 0.190 MW in net peak demand savings at the ge...

AI summary In 2018, four new participants in the Strategic Energy Management (SEM) program achieved significant energy and peak demand savings. The Evaluator found that while the service provider's reporting was of high quality, ENS made errors in tracking savings, particularly omitting deductions from capital projects. Peak demand savings were also not tracked by ENS or the service provider, leading to an upward adjustment in reported savings. Participant confidence in continuing SEM without support from a SP was low to medium.

Custom Appendix I Custom: Retrofit On-site Visit Protocol Appendix II Custom: New Construction Project Review Protocol Appendix III Custom: Building Optimization On-site Visit Protocol Appendix IV Custom: New Construction Service Provider...

AI summary The document outlines various custom protocols and algorithms related to energy efficiency programs, including on-site visit procedures, project review processes, and calculation methods for free-ridership and participant spillover effects.

NC Satisfaction Questions - S1. Using a scale from 1 to 10 where 1 is "not at all satisfied" and 10 is "completely satisfied" how would you rate your satisfaction with the program overall? - S2. [IF S1<8] What is the most important reason...

AI summary The text outlines a set of satisfaction questions related to a New Construction program, focusing on participant satisfaction, challenges faced, and suggestions for improvement. The questions are structured to assess overall satisfaction, reasons for dissatisfaction or satisfaction, challenges encountered, and potential improvements.

Custom Incentives Program Efficiency Nova Scotia 2018 DSM Evaluation – Appendix Report

AI summary This document is an appendix report from the 2018 DSM Evaluation, focusing on the Custom Incentives Program by Efficiency Nova Scotia. It provides details related to demand-side management and program evaluation.

5. On-Site Observations and Findings Report the on-site visit and indicate the key observations and findings made on site. 6. Questionnaires Market Information Questionnaire Completed? (Y/N) Free Ridership Questionnaire Completed? (Y/N) 7...

AI summary The document contains tables related to on-site observations, questionnaires, and measurement and verification (M&V) results. It includes sections for reporting findings, completing questionnaires, and summarizing energy savings and load profiles. The content appears to be part of a regulatory process involving energy efficiency and demand-side management.

Satisfaction Questions - S1. Using a scale from 1 to 10 where 1 is "not at all satisfied" and 10 is "completely satisfied" how would you rate your satisfaction with the Building Optimization program overall? - S2. [IF S1<8] What is the mos...

AI summary The document presents a set of satisfaction questions related to the Building Optimization program. Questions focus on participant satisfaction, challenges faced, and suggestions for improvement. Topics include program participation, marketing, and interactions with Energy Efficiency Nova Scotia (ENS) staff.

Table 1: Overview of Data Collection Activity Descriptor This Instrument Instrument Type In-depth interview Estimated Time to Complete 30 minutes Count Up to 10 Population Description New Commercial Construction Service Providers (Architec...

AI summary The document outlines two tables related to data collection activities. Table 1 describes an in-depth interview instrument targeting new commercial construction service providers, while Table 2 lists research objectives and associated questions aimed at understanding barriers, successes, and engagement with the Energy Efficiency Nova Scotia (ENS) program.

Program Satisfaction [ASK ALL] Q24. The next few questions are about your satisfaction with various program elements? How satisfied were you with the information you received about the program? [ If needed: Was the information consistent w...

AI summary The text outlines a series of questions aimed at assessing participant satisfaction with various aspects of a program, including information received, interactions with staff, enrollment processes, timeliness of incentives, and overall satisfaction.

PA4 Score: FR2c Inconsistency Test PA1 IF ABS(FR2a – FR3) ≥ 50%: PA1 = MIN OF (FR2a ; FR3) Inconsistency Test PA2 IF FR1c=100% AND FR2a OR FR3 < 70%: PA2 = EMPTY Free-Ridership IF PA4 < MEAN (PA1; PA2; PA3) FR = MEAN (PA1; PA2; PA3; PA4) O...

AI summary The text outlines a scoring system used to evaluate participation in energy efficiency programs, including factors like previous participation in ENS programs and the influence of promotional materials on decision-making. It includes formulas for calculating scores and determining free-ridership.

APPENDIX IX CUSTOM: 2018 RECOMMENDATIONS This appendix summarizes all the recommendations made by the Evaluator as part of the 2018 evaluation of the Custom program component, as well as all 2017 evaluation recommendations that were not fu...

AI summary This appendix summarizes the 2018 recommendations made by the Evaluator for the Custom program component and any 2017 recommendations that were not fully implemented.

2017 Recommendations (Not fully implemented at the time of evaluation) 4 Continue conducting an in-depth review of energy models as part of the evaluation and improve ENS staff's capacity to identify discrepancies in energy models. The mor...

AI summary The 2017 recommendations highlight the need for continued in-depth review of energy models and improving ENS staff's capacity to identify discrepancies, which were found in all five projects during the 2017 evaluation.

APPENDIX X EMIS: ON-SITE VISIT AND PROJECT REVIEW PROTOCOL WITH EMIS NEW PARTICIPANT The 2018 EMIS impact evaluation involved conducting one project review and one on-site visit for a new participant to collect additional information on me...

AI summary This appendix outlines the protocol for conducting an on-site visit and project review with a new EMIS participant in 2018. The process involved collecting information on implemented measures and assessing participant satisfaction and project useful life.

10. Explain Project Adjustments between PDA and project completion If any modification were made between PDA and project completion, describe and provide calculations 11. Summarize Project Adjustments and Final Savings Values IF any adjust...

AI summary The text outlines two sections of a regulatory proceeding document: one asking for explanations of project adjustments between the Preliminary Design Assessment (PDA) and project completion, and another requesting a summary of project adjustments and final savings values. It also includes a section about satisfaction questionnaires.

APPENDIX XI EMIS: PROJECT REVIEW PROTOCOL AND INTERVIEW GUIDE WITH CONTINUING PARTICIPANT The 2018 EMIS impact evaluation involved conducting one project review and one phone interview with a continuing participant from 2017 in order to co...

AI summary This appendix describes the project review protocol and interview guide used in the 2018 EMIS impact evaluation. It involved a project review and a phone interview with a continuing participant from 2017 to gather information on program changes and participant satisfaction.

Project Review Protocol and Participant Interview Guide The Evaluator relied on the 2017 evaluation protocol and only made minor adjustments. The information that was collected during the 2017 site visit was included in this protocol prior...

AI summary The Evaluator used the 2017 evaluation protocol with minor adjustments, incorporating data from site visits, annual reports, savings calculation workbooks, and phone interviews to complete sections on interactive effects, energy and demand savings adjustments, and final savings values. The protocol also includes questions on savings persistency and participant satisfaction.

2018 DSM Evaluation – Appendix Report EWIS Sausiaction and Barriers S1. Using a scale from 1 to 10 where 1 is "not at all satisfied" and 10 is "completely satisfied" how would you rate your satisfaction with the EMIS program overall? Rate:...

AI summary The 2018 DSM Evaluation – Appendix Report includes a survey assessing participant satisfaction with the EMIS program, challenges faced during implementation, and suggestions for improvement. It focuses on the effectiveness of the Energy Management Information System and interactions with Efficiency Nova Scotia.

APPENDIX XII SEM: ON-SITE VISIT PROTOCOL The 2018 SEM impact evaluation involved conducting on-site visits, including assessing free-ridership, satisfaction and barrier levels, as well as gathering insight on the persistency of savings for...

AI summary This appendix outlines the on-site visit protocol used during the 2018 SEM impact evaluation, which included assessing free-ridership, satisfaction, barriers, and the persistency of savings for SEM projects.

On-site Visit Protocol For the 2018 SEM impact evaluation, the Evaluator reviewed the interview protocol used in 2016 and improved the statistical analysis questions of the protocol used to validate the accuracy of the regression model. Qu...

AI summary The 2018 SEM impact evaluation involved refining the interview protocol from 2016, adding questions on satisfaction, barriers, and savings persistency. Four on-site visits were conducted based on ENS digital project files, including M&V reports and SEM planning tools. The Evaluator reviewed baseline energy regression and other components of the protocol.

This appendix summarizes all the recommendations made by the Evaluator as part of the 2018 EMIS and SEM evaluations, as well as all 2017 evaluation recommendations that were not fully implemented. Sections Recommendations Executive Summary...

AI summary The appendix highlights the Evaluator's recommendations to improve EMIS and SEM program delivery by enhancing participant understanding and mastery of energy performance tracking. Participants rely heavily on service providers, and without continued support, they may discontinue efforts. The recommendations aim to increase persistence of savings and improve participant satisfaction.

SBES Energy Savings The Evaluator reviewed ENS gross savings estimates using the information contained in the tracking sheet, the CIRx Screening Tool, and findings from the on-site visits. Overall, this review found continued improvement i...

AI summary The Evaluator reviewed ENS gross savings estimates for SBES Energy Savings, noting improvements in DIY project accuracy but significant adjustments due to inaccuracies in tracked HOUs and peak coincidence factors. Audit path savings were also adjusted due to various issues, leading to an overall adjustment ratio of 0.811. Free-ridership values from 2017 were reapplied in 2018, and spillover was found to be nil. Net energy and peak demand savings in 2018 were 9.589 GWh and 1.441 MW respectively.

Table 2: Comparison of Tracked and Evaluated Savings at the Generator for SBES Initial Gross Savings Adjusted Gross Savings NTGR Net Savings Energy Savings Tracked Savings from ENS 11.852 GWh 11.852 GWh 0.82 9.673 GWh Evaluation Results 11...

AI summary Table 2 compares tracked and evaluated savings for the Small Business Energy Solutions (SBES) program. Evaluated net energy savings are about 1% lower than tracked values, with tracked gross savings adjusted downward by 8%. The tracked net-to-gross ratio (NTGR) is significantly lower than the 2017 NTGR, leading to an underestimate of tracked net energy savings.

2 SBES EVALUATION OBJECTIVE AND METHODOLOGY The main objectives of the SBES evaluation are as follows: - › Collecting information during site visits on non-lighting measures that participants are most interested in upgrading - › Calculatin...

AI summary The SBES evaluation aims to collect information on non-lighting measures participants are interested in upgrading and to calculate program results such as energy savings and GHG emissions. The methodology includes reviewing program documentation, meeting with the program manager, and using a sample-based approach with a 10% margin of error at a 90% confidence level.

Comparison with 2017 Evaluation Scope No participant survey was carried out for SBES in 2018; hence, the market evaluation scope was considered reduced for 2018. The impact evaluation scope was also considered reduced since the freeridersh...

AI summary The evaluation scope for the 2018 SBES program was reduced due to the absence of a participant survey and the lack of freeridership measurement. These changes were influenced by the evaluation objectives, previous results, and program updates. Further details are outlined in Section 1 of the DSM Programs Evaluation Executive Summary.

4.1 Gross Savings Gross savings correspond to the change in energy consumption resulting from actions taken by participants, regardless of their reasons for participating.4 For each SBES project, ENS tracks gross savings using the standard...

AI summary The section discusses gross savings in the SBES program, focusing on the evaluation of energy consumption changes from implemented measures. Lighting measures account for most savings, and the evaluation methodology involved on-site visits to assess accuracy. Issues with data tracking and performance variables were identified, particularly in HVAC projects.

4.2.2 Participant Spillover For SBES, participant spillover occurs when participants implement eligible energy efficiency measures due to the influence of previously participating in the program component without having received any kind o...

AI summary The document discusses participant spillover in the SBES program, where participants implement energy efficiency measures influenced by previous participation without additional support. In 2018, negligible spillover was observed, with only two measures identified among 50 surveyed participants, resulting in less than 0.1% spillover and a nil spillover level applied to net savings calculations.

Sampling Methodology for Participant Visits In 2018, a total of 50 on-site visits were conducted to verify the performance of the measures installed as part of SBES. The sampling plan was developed using the tracking sheet received in Octo...

AI summary In 2018, 50 on-site visits were conducted to verify the performance of measures installed under the Smart Building Energy Savings (SBES) program. A stratified sampling method was used, based on total tracked savings, to ensure a representative sample of both small and large projects, with 40 visits allocated to DIY projects and 10 to audit path projects.

ALGORITHM FOR PARTICIPANT SPILLOVER CALCULATION Participant spillover of SBES was measured using a participant survey conducted during the on-site visits. Participants were asked whether following their participation in SBES, they implemen...

AI summary The algorithm for calculating participant spillover in the SBES program involves surveying participants to determine if they implemented additional energy efficiency measures outside of program incentives. Savings from these non-incentivized measures are then compared to those from incentivized measures to assess the program's influence.

2018 RECOMMENDATIONS This appendix summarizes all the recommendations made by the Evaluator as part of the 2018 evaluation of the Small Business Energy Solutions (SBES) program component, as well as all 2017 evaluation recommendations that...

AI summary This section outlines the 2018 recommendations from the Evaluator regarding the Small Business Energy Solutions (SBES) program, including unresolved recommendations from the 2017 evaluation.

Efficiency Nova Scotia (ENS) engaged Research Into Action ("the evaluation team") to assess the effectiveness of its Efficiency Trade Network (ETN), a network of market actors who help drive customers to ENS programs and services. Working...

AI summary Efficiency Nova Scotia (ENS) commissioned Research Into Action to evaluate the effectiveness of its Efficiency Trade Network (ETN), which connects market actors to ENS programs. The study explored understanding and use of the ETN by ENS staff, effectiveness in managing partners, and impact on program participation. Interviews with ENS staff and ETN members were conducted.

The ETN's Effect on Program Participation ENS staff described the network as vitally important to their organization. They reported that programs with engaged ETN members are correlated with programs that exceed their savings targets. At t...

AI summary ENS staff emphasized the ETN's critical role in program success, noting that engaged ETN members correlate with exceeding savings targets. They proposed enhancing the network through expanded contractor support, vetting, marketing, and recruiting diverse professionals to increase its value.

Conclusions and Recommendations The following conclusions and recommendations describe how ENS can build upon the ETN's strong accomplishments over the past two years so that the network continues to drive uptake in ENS services. Conclusio...

AI summary The document highlights the ETN's effectiveness in driving ENS service uptake through best practices, online tools, and member engagement. It recommends expanding ETN support, increasing trade allies, and assigning dedicated staff to improve member recruitment and marketing collaboration. Current members underutilize marketing benefits due to limited awareness.

1.1. Efficiency Trade Network Overview Efficiency Nova Scotia (ENS) established its Efficiency Trade Network (ETN) in 2016 to provide, "a structured framework for recruiting, developing, and managing a [member] network…to drive uptake in E...

AI summary Efficiency Nova Scotia (ENS) established the Efficiency Trade Network (ETN) in 2016 to manage a network of professionals supporting energy efficiency services. ETN includes trade network members (affiliated but non-contracting) and partner members (contracting with ENS). As of 2018, ETN had 330 members, 180 active, with benefits like website listing, marketing support, training discounts, and newsletters. ENS does not endorse specific members.

2.1. Literature Review The evaluation team worked closely with ENS staff to identify recent documents with information about innovative approaches and best practices for trade ally networks. The team explored sources such as American Counc...

AI summary The evaluation team collaborated with Efficiency Nova Scotia (ENS) to gather best practices for trade ally networks, consulting sources like ACEEE, AESP, and Research Into Action's evaluations. Appendix B lists the referenced documents.

2.2.1. ENS Staff Interviews Research Into Action interviewed ENS staff to gain insight into how staff use, interact with, benefit from, and value the ETN. The ENS staff interview guide is presented in Appendix C. At the recommendation of E...

AI summary Research Into Action interviewed 11 ENS staff, including ETN Manager, Program Managers, and Service Delivery Managers, to evaluate how ENS interacts with the ETN. The interview guide is detailed in Appendix C, focusing on staff experiences with the Efficiency Trade Network.

〉 2 Business Development Managers The ENS staff interviews, conducted in August and September 2018, averaged approximately 60 minutes in length. The evaluation team used Microsoft Excel to analyze the staff interviews.

AI summary ENS conducted staff interviews in August and September 2018, averaging 60 minutes each. The evaluation team used Microsoft Excel to analyze the interview data as part of the proceeding.

2.2.2. ETN Member Interviews Research Into Action interviewed ETN members to gather in-depth feedback about their interactions with the program. The discussion topics included components of the program design, training offered through the...

AI summary Research Into Action conducted 25 interviews with ETN members to assess program design, training, benefits, challenges, and engagement opportunities. Interviews covered diverse member categories, with some respondents overlapping in roles. The interview guide is detailed in Appendix D, and results are summarized in Table 2-1.

3. Findings This chapter summarizes Research Into Action's findings from the literature review, staff interviews, and member interviews. The chapter is organized by the overarching issue: - 1. Internal understanding and use of the ETN - 2....

AI summary This chapter summarizes Research Into Action's findings on the Efficiency Trade Network (ETN), focusing on internal usage, member recruitment and retention challenges, and the ETN's impact on program participation. The analysis is based on literature reviews, staff interviews, and member interviews.

3.2.4. Marketing Support for Members' Businesses The literature review showed that a trade ally network best practice is to provide contractors with marketing materials and support they can use to sell efficiency programs to customers. One...

AI summary The literature highlights best practices for energy efficiency programs, emphasizing the importance of providing accessible marketing materials to contractors. ENS has implemented this approach but found that fewer than half of ETN members use the ENS logo. While some members use the logo for credibility, its impact on sales is minimal.

3.2.6. Member Communication with ENS Staff The ETN design fosters direct communication with ENS staff with good results. Of the 23 ETN members who said they were in touch with ENS staff typically with Program Managers and Business Developm...

AI summary The ETN design facilitates direct communication between members and ENS staff, leading to positive outcomes. Members contacted ENS for ETN-related queries, and ENS provided personalized support, such as notifying members about program changes. Nearly all members reported satisfaction with ENS staff's responsiveness, though one respondent expressed dissatisfaction. The ETN newsletter was found helpful by two-thirds of members for program updates and event listings.

3.3. The ETN's Effect on Program Participation The ETN touches all programs, and is vital to many, because ETN members act as an extended sales force for ENS. ENS staff described the network as vitally important to their organization. They...

AI summary The ETN is critical to ENS programs, acting as an extended sales force and driving program participation through member engagement. ENS staff and members suggest expanding contractor support, marketing, and recruitment to enhance ETN's value. Improvements include training, contractor vetting, and co-op marketing. ETN's growth is linked to exceeding savings targets and better customer experiences.

4. Conclusions and Recommendations The following conclusions and recommendations describe how ENS can build upon the ETN's strong accomplishments over the past two years so that the network continues to drive uptake in ENS services. Conclu...

AI summary The document highlights the ETN's success in energy efficiency initiatives, including its online tool and member engagement, but notes the need for expanded support and recruitment. It recommends assigning dedicated ENS staff to enhance member services and improve awareness of ETN's marketing benefits to increase participation.

Appendix A. Program Documents Reviewed for this Study - 〉 ETN Strategy Presentation, January 11, 2018 - 〉 Efficiency Trade Network Brand Guidelines - 〉 ETN General Participation Agreement - 〉 ETN Program Charter - 〉 ETN Survey Results, Jan...

AI summary Appendix A lists program documents reviewed for the study, including ETN Strategy Presentations, Brand Guidelines, Participation Agreements, Program Charters, and survey results from 2016-2018, along with member tracking data. These materials detail ETN's operations, member engagement, and program effectiveness.

Appendix B. External References - Clemens, William. (2015). DTE Energy's Designated Trade Ally Program. Presented at AESP Conference. - Clemens, William. (2017, 2018). Show Me the Money!!! Contractor Bonuses The Pros, Cons, Successes, and...

AI summary Appendix B lists external references to presentations and papers on trade ally programs and energy efficiency, featuring contributions from individuals like William Clemens, Jen Denherder, and Alyssa Speil. These materials discuss program design, contractor incentives, and outreach strategies, with references to organizations such as AESP, ACEEE, and WECC.

[ETN MANAGER AND ETN SPONSOR] 7. How does the ETN interact with ENS's programs? Response

AI summary The document asks how the Efficiency Trade Network (ETN) interacts with Efficiency Nova Scotia (ENS) programs. No response is provided in the text, but the question highlights the need to clarify the relationship between ETN and ENS initiatives.

[PMS] 33. What suggestions do you have, if any, for how the ETN could better coordinate with the program that you manage? Response

AI summary The document poses a question seeking suggestions for improving coordination between the Efficiency Trade Network (ETN) and another program managed by the respondent. No response or specific recommendations are provided in the excerpt.

[ALL] 34. Since the ETN's inception in 2016, what affect, if any, has the ETN had on ENS's programs overall? [ Probes: Has it helped boost participation numbers, increased the scale of projects, or made any other noticeable changes to prog...

AI summary The document asks about the impact of the Efficiency Trade Network (ETN) on Efficiency Nova Scotia (ENS) programs since 2016, probing whether it boosted participation, scaled projects, or caused other changes. No response is provided, focusing solely on the question and its specific probes.

Successes, Challenges, and Opportunities To wrap-up I'd like to get your feedback about the ETN's successes and challenges to date, as well as about opportunities for the future. [BDMS, SDMS, PMS, AND OEM] 38. What would you say are the gr...

AI summary The document seeks feedback on the Efficiency Trade Network (ETN) since its 2016 inception, focusing on its benefits, successes, challenges, and opportunities for improvement. It asks stakeholders to evaluate the ETN's impact on Efficiency Nova Scotia (ENS) and suggest changes to enhance outreach and program support.

Phone Script Hello [CONTACT NAME], My name is [NAME] and I'm with Research Into Action. As you may know, we are working with Efficiency Nova Scotia (ENS) to learn about how well their Efficiency Trade Network (ETN) is working within the en...

AI summary A phone script from Research Into Action seeking feedback from Efficiency Trade Network (ETN) members regarding the effectiveness, services, benefits, challenges, and potential improvements of the ETN, as part of a collaboration with Efficiency Nova Scotia (ENS). The script outlines steps for scheduling interviews with key industry participants.

Introduction to Interview Thanks for taking the time to talk today. I work for Research Into Action and we are conducting research on behalf of ENS about their Efficiency Trade Network (ETN). We are interviewing contractors like you to lea...

AI summary Research Into Action conducts an interview with contractors about Efficiency Nova Scotia's Efficiency Trade Network (ETN), seeking feedback on its effectiveness, services, benefits, challenges, and potential improvements. The interview emphasizes confidentiality and anonymous quote usage.

Staff First, I'd like to ask you about your interactions with ENS staff. [ALL] 19. Have you ever contacted ENS with questions or concerns about the ETN? [ If so ] Who at ENS did /would you reach out to? Were they able to answer your questi...

AI summary The document includes questions from a regulatory proceeding in Nova Scotia, focusing on stakeholder interactions with ENS staff regarding the ETN. It seeks feedback on communication effectiveness, preferred contact methods, and overall satisfaction with ENS's responsiveness and support.

Efficiency Nova Scotia (ENS) engaged Research Into Action ("the evaluation team") to assess the effectiveness of its site visit quality assurance (QA) practices and procedures. Working collaboratively with ENS, Research Into Action identif...

AI summary Efficiency Nova Scotia (ENS) commissioned an evaluation of its site visit quality assurance (QA) practices and procedures. The study identified five key issues related to the effectiveness of internal and contractor-conducted site visits, their contribution to continuous improvement, and opportunities for enhancement. The evaluation involved document analysis and interviews with ENS staff, contractors, and external administrators.

-7-0) , help them improve, and to stop using their services if they do not improve. In addition, this process can be used to reduce the number of on-site visits needed for high performing DAs and SOs. Recommendation 4-1: ENS should use QA...

AI summary The document outlines recommendations for Efficiency Nova Scotia (ENS) to enhance Quality Assurance (QA) processes. Key proposals include using QA data to assess program performance, reducing site visits for high-performing entities, exploring phone inspections and smart technology, and standardizing customer feedback collection. ENS is advised to support underperforming entities or terminate ties if standards are unmet, while leveraging technology to minimize field inspections.

2.2. ENS Staff Interviews ENS evaluation staff recommended that the evaluation team conduct interviews with ENS staff who play a role in QA site visits: - 〉 Four QA committee members, including the person performing a portion of the CDMC r...

AI summary ENS evaluation staff conducted interviews in September 2018 with QA committee members, Service Delivery Managers, and program managers to assess how ENS manages QA site visits. The interviews compared programs using internal staff versus contracted QA inspectors and analyzed data via NVivo and Excel. Appendix B includes the interview guide.

2.3. QA Inspector Interviews The evaluation team interviewed three QA inspectors. The team gathered in-depth information about inspector interactions with the QA program including site visit goals, practices and procedures, QA site visit g...

AI summary The evaluation team interviewed three QA inspectors to assess interactions with the QA program, covering site visit practices, ENS support, and opportunities for improvement. Research Into Action conducted the October 2018 interviews, analyzing data via NVivo and Excel. Appendix C includes the interview guide.

2.4. Other Program Administrator Interviews The team interviewed staff involved with QA site visits from three other energy program administrators: - 〉 Energy Trust of Oregon (Energy Trust) a senior program manager in the residential group...

AI summary The evaluation team interviewed three energy program administrators (Energy Trust of Oregon, Saskatchewan Power, and Efficiency Vermont) to compare QA procedures. Energy Trust uses data-driven, technology-based methods; Saskatchewan Power employs a less formal approach; and Efficiency Vermont balances site visits with data analysis. Interviews were conducted in November 2018 and analyzed using NVivo and Excel. Appendix D contains the interview guide.

3.1.1. Purposes of QA Site Visits ENS staff and other program administrators conduct QA site visits for similar reasons that are essential to organizational success, as described below. QA visits: - 〉 Ensure energy savings are realized by...

AI summary ENS and program administrators conduct QA site visits to verify energy savings through eligible efficiency measures, ensure rebates are issued for installed equipment, and collect customer feedback to improve program administration.

3.1.3. Use of Internal Staff versus External QA Contractors The use of internal staff or external inspectors for QA site visits vary, with each approach having its own benefits . All ENS program managers said they were satisfied with the a...

AI summary The document discusses the use of internal staff versus external QA contractors for ENS program inspections. Program managers highlight benefits of internal staff's program familiarity and learning opportunities, while external inspectors are preferred for expertise and resource constraints. QA inspectors report satisfaction with current processes, emphasizing flexibility, support from ENS, and efficient survey systems.

QA Objective (from Framework Manual) Objective Accomplished Through QA Site Visit Guidelines? How QA Site Visit Guidelines Meet Manual Objectives Identify quality customer experience, quality work, quality documentation, safety, energy sav...

AI summary The QA Site Visit Guidelines aim to ensure quality customer experience, safety, and energy savings. They help identify process improvements, reduce evaluation risks, and align with program objectives. Some objectives are partially met, such as basing decisions on data and addressing underperforming DAs and SOs.

3.3.1. Site Visit Sampling All ENS staff and inspectors agree ENS programs conduct appropriate numbers of site visits. ENS staff explained that the ENS Evaluation Manager determines the number of QA site visits needed for each program comp...

AI summary ENS staff confirm site visits are statistically determined with 90% confidence and 10% margin of error. Most program managers currently do not use past site visit data to allocate future inspections but plan to, while one manager uses deficiencies to increase visits for underperforming DAs/SOs.

rogram managers, include a table to show how QA activities align with QA Framework Manual objectives (see [Table 3-1)](#page-18-0), and address QA data tracking, aggregation, analysis, and reporting. Conclusion 3: ENS staff and other progr...

AI summary The text discusses aligning QA activities with the QA Framework Manual, recommending a centralized QA site visit manager through the CDMC. It emphasizes using QA results to adjust site visits based on DA/SO performance, reducing visits for high performers while increasing them for underperformers.

Appendix A. ENS Documents Reviewed for this Study - 〉 Efficiency Nova Scotia. Appendix A Residential Programs Evaluation Criteria spreadsheet. 2017. - 〉 Efficiency Nova Scotia. General Participation Agreement. August, 2017. - 〉 Efficiency...

AI summary Appendix A lists Efficiency Nova Scotia (ENS) documents reviewed, including evaluation criteria, quality assurance frameworks, supplier performance reports, and home energy assessment surveys from 2014 to 2017. These materials focus on residential programs, QA processes, and program delivery metrics.

[ALL] Q3. What are the roles and responsibilities of the person/people involved with this QA site visit oversight? Who is in charge of the oversight of QA site visits across all ENS programs? [ Probes if current oversight is minimal ] Do y...

AI summary The text inquires about roles and oversight of QA site visits under ENS programs, questioning current oversight levels, potential benefits of increased coordination, and desired qualifications for the overseer. It probes whether minimal oversight exists and if more coordination would improve QA processes.

QA Site Visit Effectiveness at Serving Intended Purpose I'd like to shift gears a bit and talk about how ENS uses QA site visits results. [ALL] Q31. Who reports QA site visit findings? Where are the findings documented? How are they commun...

AI summary The document explores the effectiveness of QA site visits in achieving their intended purpose, focusing on reporting processes, data collection, and program improvements. It questions how ENS uses findings, whether communication channels could be simplified, and if data sufficiency impacts performance assessments. The discussion also addresses potential adjustments to future site visit frequencies based on organizational track records.

Successes, Challenges, and Opportunities To wrap-up I'd like to get your feedback about the successes and challenges of QA site visits, as well as about opportunities for the future. [ALL] Q36. What would you say are the greatest benefits...

AI summary The document seeks feedback on QA site visits' benefits, challenges, and opportunities for improvement, focusing on ENS programs. Key areas include management practices, reporting, and communication. The text includes questions for stakeholders and a request for anonymous quotes in the report.

Roles and Responsibilities My first questions are about your job, the programs your company works with through ENS, and the QA site visit services your company provides. - Q1. First, what is your job title? - Q2. Can you please verify the...

AI summary The document outlines a regulatory inquiry into QA inspection services provided by a company working with ENS. It asks about job roles, program-specific QA services (Home Energy Assessment, Home Warming, New Home Construction), geographic coverage, and collaboration with ENS personnel. Specific attention is given to Peck Home Inspections' coverage in Cape Breton.

QA Site Visit Guidelines Now I'd like to talk about QA site visit guidelines. Q13. What guidelines has ENS provided to you to conduct QA site visits for [ insert first/second/third program ]? [ If no guidelines, skip to [Q19](#page-35-0) ]...

AI summary The document outlines QA site visit guidelines provided by ENS for programs, focusing on documentation, effectiveness, adherence challenges, cost-efficiency, and areas for improvement. Questions probe sampling approaches, site selection, frequency, data collection, and cost-minimization strategies.

QA Site Visit Goals, and Overview of Practices and Procedures Q8. [ Ask once across all programs served ] How would you describe the overall goals or purposes of QA inspections for [ insert organization name ]? Now I'd like to learn more a...

AI summary The document outlines QA inspection goals and procedures for an organization, covering in-house vs. contracted inspections, visit timelines, equipment checks, data collection, and process challenges. It emphasizes oversight, scheduling, reporting, and program-specific variations.

Mission Statement With extensive experience in North America we can provide the full range of evaluation, verification, policy, management, planning, regulatory adaptation services – wherever and whenever there is a need.

AI summary The organization highlights its extensive North American experience and offers a comprehensive range of services including evaluation, verification, policy, management, planning, and regulatory adaptation, available wherever and whenever needed.

Suggested Citation: Peach, H. Gil & C. Eric Bonnyman, Verification Review of Program Year 2018 Evaluation Results, Report for the Nova Scotia Utility and Review Board. H. Gil Peach & Associates, April 2019.

AI summary A 2019 report by H. Gil Peach & Associates, commissioned by the Nova Scotia Utility and Review Board, conducts a verification review of the 2018 program evaluation results. The report assesses the accuracy and methodology of prior evaluations related to utility programs in Nova Scotia.

This report is a savings verification review for Calendar Year 2018 conducted by H. Gil Peach & Associates, LLC for the Nova Scotia Utility and Review Board (Board). The report is focused on verification of electricity energy savings and d...

AI summary This report by H. Gil Peach & Associates, LLC reviews and verifies electricity energy savings and demand reduction data from Efficiency Nova Scotia's Demand Side Management (DSM) programs in 2018. It focuses on impact evaluation, reviews evaluation methods, and provides recommendations for adjustments to the savings data.

A. Demand-Side Management as Continuous Improvement It can be useful in approaching evaluation to review how DSM works and where evaluation and savings verification fit. 2 DSM is a cycle of repeated activities with the 7 Page & lt;sup>1 No...

AI summary The document outlines Demand-Side Management (DSM) as a continuous improvement cycle, emphasizing its iterative process. It details the transition of DSM administration from Nova Scotia Power, Inc. to Efficiency Nova Scotia Corporation, noting program maturity by 2018. The DSM cycle includes planning, implementation, and evaluation phases, with periodic major planning efforts every 3–5 years.

2. Implementation The Implementation step in each cycle feeds information forward to Planning through the development of practical knowledge gained by program managers and delivery agents. Program implementation and results are recorded in...

AI summary The Implementation phase of the DSM cycle involves adapting planned programs to real-world conditions through continuous monitoring, data tracking, and iterative adjustments. Program managers and delivery agents gather practical knowledge, which informs planning and ensures programs remain responsive to emerging challenges and contextual constraints.

3. Evaluation The Evaluation step produces independent results assessment for the full portfolio of programs in a yearly formal evaluation report. Evaluation also should feed timely 9 Page & lt;sup>5 For an early article on this point, see...

AI summary The Evaluation step involves producing annual independent assessments of program portfolios, including measurements, surveys, and analyses. It provides ongoing feedback to the Implementation step for mid-year adjustments and develops program baselines and results. Special studies may also be conducted to support evaluations.

4. Savings Verification Both the Implementation step and the Evaluation step feed information forward to the Savings Verification. This information includes selection of methods, analysis plans, program documents, tracking records, electri...

AI summary Savings Verification integrates data from Implementation and Evaluation steps, including methods, analysis plans, program documents, and evaluation results, to confirm or question the validity of reported savings data and methodologies.

D. Evaluated Lifetime Net Energy Savings at the Generator Econoler lifetime evaluated net energy savings at the generator is shown in Table 3. These estimates of DSM component lifetime net energy savings take into account the savings-weigh...

AI summary The document discusses Econoler's evaluation of lifetime net energy savings at the generator, focusing on DSM components and comparing lifetime and first-year savings using data from Tables 3 and 4.

E. Evaluation of Market Transformation/Market Evolution Evaluation of market transformation 12 has two parts. First, analysis of resource acquisition programs that, over time, develop market effects that develop into possible market transf...

AI summary The evaluation of market transformation includes analyzing programs that develop market effects over time and those designed explicitly for transformation. Econoler's 2018 analysis of three Efficiency Nova Scotia measures (LED lamps, commercial lighting, and mini-split heat pumps) is deemed adequate. However, new construction programs like Passive House were not analyzed due to cost constraints and limited funding, though innovation in this area is noted.

G. Highlighted Evaluation Standards In this section we highlight five guidelines or standards for evaluation: independence, avoiding the risk of circularity in using automated evaluation, 20 P a g e 15 The "look-ahead" for a DSM Integrated...

AI summary The document outlines five evaluation standards, emphasizing independence, transparency, and long-term planning. It contrasts DSM's 20-30 year planning horizon with climate adaptation's 220-600 year timeframe, warning against short-term 'low-hanging fruit' strategies that may lock in suboptimal solutions. An example highlights a US utility's shift to oil-fired generation due to short-term cost considerations, leading to long-term inefficiencies.

1. Independent Evaluation The primary standard in Demand Side Management evaluation is that evaluation must be conducted by an independent evaluator to guarantee the integrity of reported savings and prevent conflict of interest. There has...

AI summary The text emphasizes the necessity of independent evaluators in Demand-Side Management (DSM) to ensure savings integrity and avoid conflicts of interest. It notes historical separation between program implementers and evaluators, regulatory requirements for external evaluations by 1992, and cites the Econoler evaluation as compliant with these standards.

whole building energy efficiency approaches. There is a growing recognition that whole building approaches to energy efficiency hold promise for realizing deep energy savings in commercial buildings. Automated metering infrastructure with...

AI summary The text discusses the potential of whole-building energy efficiency approaches for deep commercial building savings, emphasizing the need for automated metering infrastructure with high-frequency data and Energy Management Information Systems. It cautions that robotic approaches in 'Evaluation 2.0' may overlook data and analysis challenges, risking inaccuracies and misstatements of energy savings.

3. Transparency DSM evaluation plans and reports are made public and are open to inspection by any party. Third party review of evaluations helps insure objectivity and promotes credibility, and, when necessary, revision of evaluation resu...

AI summary The document emphasizes transparency in DSM evaluations, noting public access to plans and reports, the role of third-party reviews in ensuring credibility, and confirms the 2018 Econoler evaluation as well-structured and free of transparency issues.

4. Technical Resource Manual Most jurisdictions eventually develop a Technical Resource Manual (TRM) in which calculation methods, assumptions and (in some cases) default unitary values for energy savings and/or components used in the cons...

AI summary Efficiency Nova Scotia's electronic Technical Resource Manual (eTRM) is recognized as a useful tool for program purposes, aiding Econoler in independently verifying energy savings and demand-reduction measures. The text emphasizes the importance of maintaining independent checks to prevent circularity in eTRM usage and warns against streamlining monitoring and evaluation (M&V) to exclude actual project energy performance from financial return assessments.

5. Evaluation Guidelines Many jurisdictions also have a set of evaluation guidelines. 26 Econoler has demonstrated thorough knowledge of the Uniform Methods Project evaluation guidelines and other protocols that form the most current sets...

AI summary Econoler is recognized for its expertise in current DSM program evaluation guidelines, including the Uniform Methods Project protocols, which have replaced older guidelines from the California Public Utilities Commission, Oak Ridge National Laboratory, and Electric Power Research Institute.

III. General Findings There is one general finding for this Savings Verification study: SVF-1: All 2018 evaluations conducted by Econoler are within accepted industry frameworks and evaluation standards. - Each program evaluation is compre...

AI summary The 2018 Savings Verification study by Econoler is deemed compliant with industry standards, featuring comprehensive evaluations with transparent methodologies. Key strengths include independent analysis, market evolution insights for LEDs, climate mitigation assessments, and avoidance of circularity in results through critical eTRM usage.

IV. General Recommendations 1. Savings Verification Recommendation No. 1: The Savings Verification study recommends acceptance of the 2018 evaluation results for energy savings and for demand-reduction for all programs. SVR-1: The Savings...

AI summary The document outlines two key recommendations from the Savings Verification study. First, it recommends accepting the 2018 evaluation results for energy savings and demand reduction across all programs. Second, it advocates for enhanced process evaluations, including participant observation and comprehensive reporting, to better understand program implementation and identify improvements. The 737 Max analogy is used to emphasize the need for process evaluators to detect unforeseen operational discrepancies.

2. Instant Savings Instant Savings is administered by Efficiency Nova Scotia as an in-store discount program for energy-efficient products. 32 The program is implemented through a delivery agent and participating retailers throughout Nova...

AI summary Instant Savings, administered by Efficiency Nova Scotia, is an in-store discount program for energy-efficient products. The 2018 evaluation showed savings exceeded goals, with successful diversification to new products. Recommendations include a socket study and continued monitoring of LED market indicators. The evaluation followed the Uniform Methods Project protocol.

3. Home Energy Assessment Home Energy Assessment (HEA) provides financial incentives in the form of rebates or zero-interest financing to homeowners to reduce consumption of energy. HEA is focused on shell insulation measures, better elect...

AI summary The Home Energy Assessment (HEA) program offers rebates and financing for energy efficiency upgrades, focusing on insulation, heating systems, and water heating. Evaluations use HOT2000 simulations and 'test-in/test-out' audits, with adjustments via an overestimation ratio. The 2018 evaluation included billing analysis and corrections for simulation discrepancies. Econoler recommends improved evaluation methods and auditor training.

4. Green Heat The Green Heat Program focuses on replacement and supplementation of heating systems by installation of equipment that uses fuel derived from renewable resources. The new equipment may either fully replace or supplement exist...

AI summary The Green Heat Program in Nova Scotia incentivizes renewable heating systems, including biomass, solar, and heat pumps. Econoler evaluated the program through data analysis, site visits, and surveys, recommending improvements to tracking sheets and continued monitoring of barriers to high-efficiency heat pump adoption. The federal Low Carbon Economy Fund (LCEF) and Nova Scotia Power's on-bill financing support the initiative.

5. Residential Efficient Product Installation The Residential Efficient Product Installation program component provides free of charge direct installation of energy-efficient lighting and domestic hot water-heating products. The program is...

AI summary The Residential Efficient Product Installation program offers free installation of energy-efficient products like LED lamps and thermostatic shower valves. Econoler's evaluation included market analysis and product-specific assessments, recommending clearer customer explanations for thermostatic shower valves. The program targets homeowners and renters, with 2018 products listed.

6. New Residential Program The New Residential Program includes New Home Construction and a Passive House pilot. There were 682 completions in 2018 in the New Home Construction Program including 7 in the Passive House pilot. The program is...

AI summary The New Residential Program in Nova Scotia promotes energy-efficient new home construction and a Passive House pilot. It uses HOT2000 simulations, inspections, and certifications (Energy Star, R-2000, Passive House). Evaluations by Econoler identified data issues and recommended improving savings verification methods, including addressing overestimation ratios and extending useful life calculations for energy savings.

7. BNI Efficient Product Rebates This program serves the business, non-profit and institutional sector (BNI sector). The Efficient Product Rebates program for 2018 is the same as Business Energy Rebates (BER). The program has two component...

AI summary The BNI Efficient Product Rebates program (2018) offers prescriptive rebates for businesses, non-profits, and institutions via instant and mail-in methods. Evaluated by Econoler, it covered 366 projects, with 506,533 product rebates. The evaluation included stakeholder interviews, on-site reviews, and market analysis, noting LED market maturity and recommending improvements based on process evaluation.

8. BNI Custom Incentives Program For 2018, the BNI Custom Incentives Program includes three primary components: (1) Custom, (2) Energy Management Information Systems (EMIS) and (3) Strategic Energy Management (SEM). EMIS and SEM evaluation...

AI summary The BNI Custom Incentives Program (2018) includes retrofit, new construction, and building optimization. Retrofit contributes 77% of savings. Econoler evaluated projects, found errors in modeling, and recommended expanding analysis. Evaluation methods were deemed appropriate but with room for improvement.

9. BNI Energy Management Information Systems (EMIS) Energy Management Information Systems (EMIS) provide real-time energy consumption data from metered systems and enable businesses and institutions to make real-time energy decisions. The...

AI summary The EMIS program funds energy management systems for businesses, including audits, implementation plans, and equipment installation. Econoler evaluated the program, noting zero free-ridership and spillover, and recommended improving participant understanding of energy tracking. The evaluation focused on EMIS and SEM, with recommendations on baseline metrics and implementation gaps.

10. BNI Strategic Energy Management (SEM) Strategic Energy Management is an approach for integrating energy management into business practice – so that a focus on continually advancing energy-efficiency becomes an integral aspect of workpl...

AI summary Strategic Energy Management (SEM) integrates energy efficiency into business practices, inspired by Japanese Kaizen. In 2018, four SEM projects achieved energy savings, evaluated via regression analysis and onsite visits. Projects had a 3-year expected useful life, with no free-ridership. Econoler recommends improving participant understanding of energy tracking and sustaining initiatives through a 'socio-technical circuit rider' to ensure long-term viability.

11.BNI Direct Installation Program The BNI Direct Installation Program is identical with Small Business Energy Solutions (SBES), available to businesses that use less than 350,000 kWh annually. There are two paths within the program, the a...

AI summary The BNI Direct Installation Program mirrors the Small Business Energy Solutions (SBES) program, offering two paths (audit and DIY) for businesses using less than 350,000 kWh annually. In 2018, 501 DIY projects and 28 audit projects were completed. Evaluation included on-site visits, impact assessments, and EUL revisions. Econoler confirmed the evaluation's completeness, though no specific recommendations were provided. Efficiency Nova Scotia credits savings to ENS, with codes and standards deemed primarily provincial/federal responsibility.

VI. Summary of Findings SVF-1: All 2018 evaluations conducted by Econoler are within accepted industry frameworks and evaluation standards. (Page 26)

AI summary The 2018 evaluations by Econoler are validated as compliant with industry frameworks and standards, as noted in the Summary of Findings. This confirms the methodology and results of their work are acceptable within the regulatory context.

VII. Summary of Recommendations SVR-1: The Savings Verification study recommends acceptance of the 2018 evaluation results for energy savings and for demand-reduction for all programs. (Page 27) SVR-2: The Savings Verification study recomm...

AI summary The Savings Verification study recommends accepting 2018 energy savings results, enhancing process evaluation efforts, clarifying EUL and savings-weighted measure life calculations, addressing maintenance in EUL, examining errors in evaluations, and exploring circuit riders for SEM/EMIS programs. These aim to improve accuracy, longevity, and program effectiveness.

SUMMARY OF EVIDENCE 2 Q. Based on your review of the E1 application and the evidence before you, what are 3 your primary findings and observations? 4 A. My primary findings and observations are as follows: 5 First, the history of DSM in No...

AI summary The summary of evidence highlights concerns regarding EfficiencyOne's 2020-2022 DSM Preferred Plan, noting that its targets are overly aggressive and not affordable. The plan's budget increase is inconsistent with other provinces, and the accuracy of peak demand reduction estimates is questionable. A lower-budget DSM scenario is suggested as a more reasonable alternative.

2 Q. What was the objective of Mr. Reed's benchmarking analysis? - 3 A. According to Mr. Reed, the goal of his benchmarking analysis was "to assess where - 4 EfficiencyOne falls compared to its North American peers on commonly used - 5 ben...

AI summary Mr. Reed's benchmarking analysis aimed to evaluate EfficiencyOne's performance against North American peers using common metrics. The analysis focused on comparative assessment across key industry benchmarks.

11 Q. Do you agree with Mr. Reed's conclusions? - 12 A. No, I do not. I believe Mr. Reed's benchmarking analysis is flawed. Therefore, I question - the reasonableness of his conclusions. I recommend that the Board not put significant - wei...

AI summary The respondent disagrees with Mr. Reed's conclusions, citing flaws in his benchmarking analysis and advising the Board not to rely heavily on them regarding E1's Preferred Plan.

15 Q. Why not? - 16 A. The main problem I have with Mr. Reed's benchmarking analysis is that he chose to - compare EfficiencyOne's Preferred Plan only to those in a non-representative peer group - of leading program administrators. This co...

AI summary The response criticizes Mr. Reed's benchmarking analysis for using a non-representative peer group and ignoring relevant jurisdictional details, leading to an arbitrary and misleading comparison of EfficiencyOne's Preferred Plan. The analysis also notes that reliance on future data limited the sample size and that inherent limitations in cross-jurisdictional comparisons were not adequately addressed.

Mr. Reed stated that he did not include any Canadian program administrators because there "are no comparable reports or studies that we are aware of that duplicate the ACEEE Scorecard methodology for Canadian utilities, program administrat...

AI summary Mr. Reed excluded Canadian programs from EfficiencyOne's peer group due to lack of ACEEE-like studies, but the counterparty argues Canadian DSM data exists and should be included. The counterparty criticizes Reed's methodology as arbitrary, emphasizing that peer groups should be representative, not skewed.

Q. In your opinion, is this peer group representative of the U.S. DSM market? A. No. The methodology Mr. Reed chose to select his peer group resulted in a peer group that is biased toward program administrators that spend the most on DSM....

AI summary The peer group is not representative of the U.S. DSM market as it excludes states with lower DSM spending, favoring only leading program administrators. The methodology biases the analysis by omitting states that are more cautious in DSM spending.

Figure 4. 2017 DSM Savings by State The states represented in Mr. Reed's peer group of program administrators are colored red. The U.S. Median and U.S. Total (average) are colored green. All of the program administrators chosen by Mr. Reed...

AI summary Figure 4 highlights that Mr. Reed's peer group of program administrators consists of top U.S. states with high energy efficiency (EE) savings (above 0.66% of sales), excluding bottom 30 states. The peer group is criticized as non-representative, reflecting an a priori bias toward high-spending states with higher EE savings.

Q. Does Mr. Reed's chosen group of leading U.S. program administrators consist of EfficiencyOne's peers? No. Mr. Reed's own analysis does not support classifying EfficiencyOne as a leading North American DSM program administrator in the sa...

AI summary The analysis rejects Mr. Reed's classification of EfficiencyOne as a peer to leading U.S. DSM program administrators, citing lower budget percentages and savings compared to entities like National Grid and Eversource. EfficiencyOne's 2020 budget as a percentage of 2017 revenue and savings rates (1.4%) lag behind top administrators (2.6%-3.1%). Mr. Reed's reliance on outdated 2011-2013 data weakens his argument, as leading states have since improved their savings percentages.

Q. Is Mr. Reed's decision to examine only leading program administrators consistent with his stated objective? A. No. As I discussed earlier, Mr. Reed's testimony stated that his objective was "to assess where EfficiencyOne falls compared...

AI summary The response argues that Mr. Reed's decision to exclude non-leading program administrators contradicts his stated objective of benchmarking EfficiencyOne against North American peers. The analysis highlights that his exclusion of average or lower DSM spending jurisdictions undermines the representativeness of the benchmarking group.

3 of "Efficiency Program Industry by State and Region Appendices, 2017," Consortium for Energy Efficiency; March 21, 2018 (https://library.cee1.org/system/files/library/13566/2017 AIR Data Tables.pdf) & lt;sup>61 EfficiencyOne Evidence, Ap...

AI summary The analysis questions whether Mr. Reed's benchmarking between EfficiencyOne and other program administrators is equitable. Mr. Levitan's testimony references EfficiencyOne's proposed 2020 investment increase and compares it to ACEEE data showing average U.S. state electric efficiency spending changes (0.87% over 2013-2017). Concerns are raised about unaddressed differences in Mr. Reed's methodology.

Q. Do you have any concerns about the estimated lower costs on a dollar per watt basis in the 2020-2022 DSM Preferred Plan and Alternate scenario? A. Yes. Again, these estimates are based on the assumption that the results of the 2019 DSM...

AI summary The respondent expresses concerns about the 2020-2022 DSM Preferred Plan and Alternate scenario's cost estimates, which rely on unverified 2019 pilot program results and face extrapolation risks if pilot outcomes do not scale effectively to broader participation levels.

14 Q. Please describe the vetting process as part of the DSM portfolio determination. As EfficiencyOne explained, the vetting process is the crucial step in the DSM portfolio development. According to EfficiencyOne, it allows for the align...

AI summary The vetting process is a critical step in DSM portfolio development, ensuring alignment of EfficiencyOne's qualitative and quantitative design efforts. It involves analyzing model outputs and examining energy savings at the program component and measure levels to assess the reasonableness of the model.

Illustration of Differences in Annual Rate Changes as a Result of Proposed Changes in RBIA Methodology

AI summary The document illustrates differences in annual rate changes resulting from proposed changes in the RBIA methodology. It includes figures and images but no textual analysis, focusing on regulatory proceedings in Nova Scotia related to rate and bill impact assessments.

Illustration of Cumulative Differences in Rate Changes as a Result of Proposed Changes in RBIA Methodology

AI summary The document illustrates cumulative differences in rate changes resulting from proposed modifications to the RBIA (Rate and Bill Impact Analysis) methodology. Visual figures (Figure 2 and 3) are referenced but not described in the text, focusing instead on the analytical impact of methodological adjustments on rate structures.

NON-CONFIDENTIAL Request IR-02: What average saving per year is estimated for households living in buildings where the property has had retrofits or is committed to having retrofits under the First Nations Pilot? Response IR-02: The 2020-2...

AI summary The response to Request IR-02 estimates average annual savings of 7,312 kWh per household from retrofits under the First Nations Pilot, based on the 2020-2022 DSM Resource Plan. Preliminary results suggest actual savings may be lower, potentially due to a small sample size. EfficiencyOne plans to monitor outcomes to assess alignment with projections.

NON-CONFIDENTIAL 1 difference would be a decrease in the delivery of refrigeration control measures with 2 relatively short Effective Useful Life (EUL) values, and an increase of building envelope 3 measures with a relatively long EUL, rel...

AI summary The text discusses potential shifts in energy efficiency measure effectiveness, noting decreased refrigeration control measures with short Effective Useful Life (EUL) and increased building envelope measures with long EUL. EfficiencyOne (E1) outlines its approach to evaluating Lifetime Energy Savings (LES) using a multi-baseline method, with future evaluations at the evaluator's discretion.

Assumption Low income Nova Scotians are assumed to be 10 per cent as likely to participate as the general population (as estimated by a local low-income expert).

AI summary The proceeding assumes low-income Nova Scotians have a participation rate 10% of the general population, based on a local low-income expert's estimation. This assumption impacts program design and resource planning considerations.

Assumptions When tracking savings and expenditures, ENS includes appliance replacements (which are delivered through the HomeWarming service) within the Appliance Retirement program component, however the low income participation is calcul...

AI summary ENS includes appliance replacements (via HomeWarming) in the Appliance Retirement program but calculates low-income participation differently. Replacements are exclusively low-income, while retirements assume low-income Nova Scotians participate at 10% the rate of the general population, per a local expert estimate.

6.1 BUSINESS ENERGY REBATES - MAIL-IN

AI summary Section 6.1 outlines the Business Energy Rebates program administered via mail-in applications. Key stakeholders include Nova Scotia Power (NSP) and Efficiency Nova Scotia (ENS), with considerations for demand-side management (DSM) and integrated resource planning (IRP). The section addresses rebate eligibility, program administration, and alignment with broader energy efficiency goals.

Assumptions EfficiencyOne Estimation of Incidental Low Income Impacts Actual program participants are apartment building owners. Avoided energy benefits are assumed to flow-through to tenants either a) directly, where tenants pay power bil...

AI summary EfficiencyOne's assumption outlines how avoided energy benefits from its program flow to tenants in apartment buildings, either directly through power bill payments or indirectly via deferred rent increases. The analysis focuses on low-income impacts and program participant roles.

7 BNI - CUSTOM INCENTIVES

AI summary The section titled '7 BNI - CUSTOM INCENTIVES' outlines regulatory considerations for custom incentive programs. Key entities include Nova Scotia Power (NSP) and Efficiency Nova Scotia (ENS), with topics centered on incentive design and program implementation. No specific arguments or cited references are present in the provided text.

Assumption No low income participation. EfficiencyOne Estimation of Incidental Low Income Impacts

AI summary The assumption outlines no low-income participation in the EfficiencyOne program, with a focus on estimating incidental low-income impacts. This highlights a key consideration in the regulatory proceeding regarding program inclusivity and impact assessment.

NON-CONFIDENTIAL Request IR-14: Please provide any surveys or studies that E1 relied on for the development of 2020 – 2022 DSM Plan regarding Nova Scotia's low-income sector. Response IR-14: EfficiencyOne, through the administration of the...

AI summary EfficiencyOne (E1) responded to a request for studies underpinning the 2020–2022 DSM Plan for Nova Scotia’s low-income sector, citing the HomeWarming program, Affordable Energy Coalition engagement, and a 2017 agreement with the Province of Nova Scotia to include deep energy retrofit services for non-electrically heated buildings in the DSM Plan.

E1 Responses to Consumer Advocate (CA)

AI summary This section contains E1's responses to the Consumer Advocate (CA) in the regulatory proceeding. It likely includes E1's position on various issues raised by the CA, such as program effectiveness, cost recovery, and consumer impact.

ering the regulatory process around the 2020- 2022 DSM Resource Plan filing." ENS then circulated the document titled, Proposed Enhancements to EfficiencyOne Rate and Bill Impact Model to the DSMAG. Synapse reviewed this document and offer...

AI summary Synapse reviews ENS's proposed enhancements to the EfficiencyOne rate and bill impact model, noting ENS recommends deferring action on most changes due to questions about NS Power's modifications. Synapse agrees to defer broadly but recommends correcting a specific error in multi-year average bill impact calculations (Issue # NEW_5) due to tight timelines and unresolved questions.

6 Custom projects, EfficiencyOne asserts this IR, which is requesting individual, customer- 7 specific information, engages issues of relevance and confidentiality." Heritage Gas assumes 8 that its requests above, which ask for information...

AI summary EfficiencyOne (E1) is asked to explain how it determined baseline assumptions for energy savings under the Customs Incentive Program in the 2020–2022 DSM Resource Plan and Alternative Scenario. Heritage Gas requests detailed explanations and clarification on methodologies used for calculating savings.

Program Delivery "The Custom Incentives program structure is designed to overcome customer barriers associated with large upfront costs, lack of in-house capacity and business case requirements. The program is delivered through a combinati...

AI summary The Custom Incentives program aims to overcome customer barriers through a combination of EfficiencyOne staff, contracted partners, and third-party resources such as consulting engineering firms and HVAC automation companies.

NON-CONFIDENTIAL Critical peak rebates (CPR) - when utilities observe or anticipate high wholesale market prices or power system emergency conditions, they may call critical events during pre-specified time periods (e.g., 3 p.m.—6 p.m. sum...

AI summary The document discusses Critical Peak Rebates (CPR) and contrasts Demand Side Management (DSM) with rate structures. It highlights that DSM offers tailored incentives and customer education, while rate structures are generalized and may lack clarity. EfficiencyOne acknowledges NS Power's Time-of-Use rates as an indirect CPR mechanism but emphasizes DSM's advantages in customer engagement and economic alignment.

19. DISPUTE RESOLUTION - 19.1 In the event of a dispute in connection with this Agreement, a senior representative of EfficiencyOne and a senior representative of NSPI shall promptly meet to discuss and resolve the dispute and the Parties...

AI summary The dispute resolution process involves EfficiencyOne and NSPI attempting to resolve disputes within 30 days (or 10 days for urgent matters), with unresolved disputes referred to the UARB under Section 79P of the Act. EfficiencyOne must continue EECA implementation unless directed otherwise by UARB.

45 4 The 2017 payments owing by NSPI will be reduced to reflect any 2015 under-spending by EfficiencyOne, if any, against the 2015 UARB-approved DSM Resource Plan, together with any 2014 Balance Adjustment interest earned in 2015. 5 The 20...

AI summary The text outlines adjustments to payments owed by NSPI based on EfficiencyOne's performance under the UARB-approved DSM Resource Plan, with specific performance targets and thresholds set for compliance. A regulatory process is triggered if targets are not met.

NON-CONFIDENTIAL 1 [E1 responses to NSPI IRs] 2 Request IR-19: 3 4 Reference: E1 (NSPI) IR-15, Attachment 1 CLEAResult Report, p.51 of 206. 5 6 … Some educational initiatives are incurring savings attribution issues, and 7 have received te...

AI summary EfficiencyOne (E1) addresses concerns about savings attribution from educational initiatives, noting that some programs, like home energy reports, have faced issues with savings being tentatively disallowed. E1 acknowledges the need to consider these issues if the goal is to shift from financial incentives to educational ones and achieve market transformation in energy efficiency.

Affordable Multi-Family Housing and Non-Profit Organizations • Incremental Costs associated with measure are based on a draft characterization for the Custom Program Component and are not known with a high degree of confidence, given the l...

AI summary The text discusses uncertainty in incremental costs for a Custom Program Component due to limited historical data from a pilot program. EfficiencyOne states it will not offer incentives exceeding project costs for this new component, citing low participation in the current pilot.

Summary of E1's 2020-2022 DSM Plan We compared the proposed scenarios from E1's 2020-2022 DSM Plan presentation with E1's actual achievements in 2016 and 2017 and to planned achievements in 2018 and 2019. The results of this review are pre...

AI summary The document compares E1's proposed 2020-2022 DSM Plan scenarios (Preferred and Alternate) with historical performance (2016-2019). The Preferred Plan projects 27% higher spending than 2019's $34.1M, 2% higher energy savings, and 70% higher demand savings. The Alternate Plan shows 9% higher spending than historical highs, with 47% higher demand savings than 2016. Both plans aim for ~1.26% savings as a percent of sales, matching historical DSM achievements.

NON-CONFIDENTIAL Within the NSUARB approved Performance Targets which are cumulative for the three- year plan period, EfficiencyOne is able to make limited changes to the approved Plan through the mid-course adjustment process as accepted...

AI summary EfficiencyOne may adjust its DSM plan under NSUARB-approved performance targets through mid-course adjustments (MCAs), requiring explanations for changes exceeding 25% variance and advance notice in Annual Progress Reports (APRs). MCAs for the 2020-2022 plan must be filed in Q1. EfficiencyOne argues it cannot provide advance notice for adjustments based on third-party evaluation reports, as they occur immediately upon report receipt.

b) Please refer to the table below. Incentive Cost ($M) Total Cost ($M) Incentive as percent of total cost 2020 2021 2022 2020 2021 2022 2020 2021 2022 Efficient Product Rebates 6.1 6.2 6.5 7.3 7.5 7.8 83% 83% 84% Residential Efficient Pro...

AI summary The table compares incentive and total costs for two efficiency programs (Efficient Product Rebates and Residential Efficient Products Rebates) across 2020-2022, showing incentive costs as 83-84% and 62-66% of total costs respectively. Key factors differentiate these programs regarding incentive cost percentages.

Program administration The Instant Savings program is administered by a third-party delivery agent, whereas the BER program is administered internally. Delivery agent costs are a relatively higher portion of administrative costs for Instan...

AI summary The Instant Savings program is managed by a third-party delivery agent, while the BER program is administered internally. The use of a delivery agent increases administrative costs for Instant Savings compared to BER.

1.4.1 Four Scenarios of Achievable Potential Four achievable potential scenarios were created. Each scenario is based on modifying the incentive level. Each measure has an estimated consumer payback elasticity based on calibration year est...

AI summary Four scenarios assess achievable potential by modifying incentive levels, affecting consumer payback ratios, administrative costs, consumer awareness, and the net-to-gross ratio. Higher incentives reduce administrative costs, increase awareness, and improve the net-to-gross ratio, while lower incentives have the opposite effects.

2.3 Calculating Energy Efficiency Potential The model partitions its evaluation of each measure into technical, economic and achievable potential. Each assessment includes building stock estimates, technology densities, and measure impacts...

AI summary The EERAM model evaluates energy efficiency potential through three metrics: technical, economic, and achievable. Technical potential calculates maximum savings without cost or market considerations, economic potential applies cost-effectiveness via the TRC test, and achievable potential considers program administrator parameters. Replacement-on-burnout measures are limited by measure life, while other measures use full baseline populations.

Loadshapes for Potential Studies Loadshapes address impacts on system capacity by assuming that savings for a given end use match consumption patterns. Loadshapes are used to allocate a proportion of the annual savings to each hour of the...

AI summary Loadshapes allocate annual energy savings to hourly consumption patterns, improving accuracy in estimating variable-driven measures like weather-sensitive programs. They reduce uncertainty in savings potential calculations and are integrated into the ENSC Technical Reference Manual for demand savings during peak hours.

3.3.2 Characteristic Loadshapes for Nova Scotia The loadshapes used to generate the Nova Scotia potential study results were as follows (NS indicates the end use was modeled for Nova Scotia specific weather conditions):

AI summary The loadshapes used for the Nova Scotia potential study results are specific to Nova Scotia's weather conditions, indicated by 'NS'. These loadshapes model end-use scenarios under local climatic conditions, influencing energy demand projections.

3.4 Net‐to‐Gross Net‐to‐gross (NTG) values are specific to a unique combination of measure and delivery program, not just specific to a given measure (as are savings and EUL.) NTG values used in the measure characterizations were drawn exc...

AI summary Net-to-gross (NTG) values depend on specific measure-program combinations, not just individual measures. They are sourced from Econoler's 2011 DSM program evaluation or estimated using data from that document, highlighting program-specific NTG characterizations.

asure costs also are adjusted. Early Replacement : refers to an energy efficiency measure normally regarded as ROB is installed before the effective life of the measure it is replacing is reached. Economic Potential: the subset of the tech...

AI summary The glossary defines key energy efficiency terms, including 'Early Replacement,' 'Economic Potential,' 'Effective Useful Life (EUL),' 'Emerging Technology,' 'End-use,' and 'Energy Efficiency.' It emphasizes distinctions between technical and economic potential, programmatic costs, and the importance of demand response. Terms highlight cost-effectiveness, implementation challenges, and technical metrics for energy efficiency programs.

Nova Scotia 2012 Baseline Study:

AI summary The Nova Scotia 2012 Baseline Study examines energy efficiency initiatives, involving organizations like Nova Scotia Power and EfficiencyOne, with focus on Demand Side Management (DSM) and regulatory frameworks. Key entities include government agencies, research centers, and energy efficiency programs, highlighting data analysis and cost methodologies.

Residential Sector Baseline The primary source of data used in determining the residential baseline was a 2012 online general population panel survey conducted by Corporate Research Associates (CRA), Inc. on behalf of Navigant, referred to...

AI summary The residential sector baseline data relies on a 2012 CRA survey (Energy Usage Study) and supplementary sources, including the ENSC 2011 Socket Study, NRCan, and Statistics Canada datasets like the Comprehensive Energy Use Database and Census data.

4.2 Data Analysis Approach The approach for data analysis involved quality control, descriptive statistics, comparison of results across data sets, and summary of corroborated results to describe the market baselines. The analysis conclude...

AI summary The data analysis approach includes quality control, descriptive statistics, comparison across datasets, and summarizing corroborated results to establish market baselines. The analysis highlights findings relevant to program planning, focusing on validated data and baseline results.

5.4 Data Analysis Approach The approach for data analysis involved quality control, descriptive statistics, comparison of results across data sets, and summary of corroborated results to describe the market baselines. The analysis conclude...

AI summary The data analysis approach included quality control, descriptive statistics, cross-data comparisons, and summarizing corroborated results to establish market baselines. Engineers validated survey data, frequencies of responses were tabulated, and equipment saturation levels were calculated. Key findings relevant to program planning were emphasized.

6.1.2 Home Age Figure 47 reflects home vintages as reported by Statistics Canada. This indicates 58 percent of homes in Nova Scotia built since 1971.33 11% 8% 12% 11% 18% 8% 8% 6% 6% 6% 6% 0% 2% 4% 6% 8% 10% 12% 14% 16% 18% 20% Figure 47....

AI summary Figure 47 shows that 58% of Nova Scotia homes were built since 1971, with distribution data sourced from Statistics Canada's 2006 Census. The visualization highlights residential construction year breakdowns across the province.

NON-CONFIDENTIAL Request IR-11: Referring to E1's response to NSP IR-40(c), E1's 's statement, "Attachment 1 to Appendix A of the Application, provides the Total Resource Cost screening tests for demand reduction measures, which are relati...

AI summary EfficiencyOne (E1) explains that higher Total Resource Cost (TRC) values indicate affordability by reflecting the return on investment for utilities and participants. TRC calculates the ratio of benefits (avoided costs) to costs, excluding incentives. Upfront costs are addressed through financial incentives, though TRC provides an indication, not a full determination, of affordability.

NON-CONFIDENTIAL LineLossFactors LineLossFactors Instead of using a provincial average, E1 weighted line losses by sector based on historical program participation by rate class and line losses by rate class. The latter of which was provid...

AI summary E1's 2020-2022 DSM Resource Plan uses avoided costs from the 2014 Integrated Resource Plan, confirmed by NS Power. Transmission and distribution avoided costs were also determined by NS Power and presented to the DSM Advisory Group. The plan begins in 2020 with no inflation rate applied, and certain fields like reserve margin and CO2 density were not used in the model.

- 11 Resource Plan Application are reported. Performance Metric Performance Performance Reported Target Indicator Results Cumulative annual energy savings  2022 APR Cumulative annual system-peak demand  2022 APR savings Cumulative lifeti...

AI summary The document reports on the 11 Resource Plan Application, including performance metrics such as energy savings, system-peak demand, and ratepayer benefits. It outlines reporting requirements and includes responses from EfficiencyOne to the Small Business Advocate.

1 PAC costs include incentives and administrative costs per the definition in E1 (NSPI) RIR-30, Attachment 1 2022 Residential/Charitable (2,3,4) 10,916 12,610 227,299 $ 2,589,787 Small General (10) 37 137 2,478 $ 38,542 General Demand (11)...

AI summary The text presents a table with details on Program Administration and Compliance (PAC) costs, including incentives and administrative costs, across various rate classes in 2022. It includes data on peak demand savings, energy savings, and associated costs for residential, commercial, and industrial categories.

a. Please provide reports/studies conducted by EfficiencyOne or any other third parties that concluded "program results show that participants who follow the facilitated path save more energy and achieve greater electricity bill reductions...

AI summary EfficiencyOne's 2017 and 2018 annual program evaluations for the Direct Installation program show that participants who followed the facilitated (audit) path achieved higher energy savings and greater electricity bill reductions compared to those who followed the self-directed (Do-It-Yourself) path. The findings are presented in Table 1.

16 Table 1: Definitions of Field Names Field Name Definition Per Unit Direct Installation Cost ($) Cost to deliver direct install measures, e.g. residential efficient products measures. Per Unit DSM Administrator Cost (Incentive + Administ...

AI summary This table defines various financial and performance metrics used in the analysis of demand-side management (DSM) programs. It includes definitions for costs, benefits, and ratios such as net-to-gross ratio and total resource cost (TRC) test results, which are essential for evaluating the economic impact of energy efficiency initiatives.

E1 Responses to Small Business Advocate (SBA) 1 Request IR-44: 2 3 Regarding "custom incentives" program included in 2018 DSM Annual Progress Report 4 (Table 1, Page 2 of 86). 5 6 a. The Evaluation results show a net savings of 11.603 GWh...

AI summary The document outlines responses from EfficiencyOne to questions raised by the Small Business Advocate regarding the Custom Incentives program in the 2018 DSM Annual Progress Report. The response indicates that the program's net savings were below target due to lower-than-expected participation and savings per participant. The SBA also inquires about program similarities and planned enhancements for future energy savings targets.

NON-CONFIDENTIAL Request IR-08: - Refer to EfficiencyOne's evidence, page 60, lines 9 to 12. Are water savings included in a) the - Preferred Plan and b) the Alternate Plan? If yes, for each plan please indicate how these - benefits are ca...

AI summary EfficiencyOne confirms water savings are included in both the Preferred Plan and Alternate Scenario, though an incorrect conversion factor led to underestimation. They provided corrected methodologies using Halifax Water rates (adjusted for inflation) and note water benefits constitute 0.0002% of total benefits. No model modifications are sought despite the error.

1 M09096, 2018 DSM Evaluation Reports Final Report, March 27, 2019. 1 d) Please refer to the 2018 Existing Residential Program Evaluation Report and 2018 Efficient 6 the period of the 2020-2022 Plan? 7 8 b. Please provide an evaluation pla...

AI summary The text refers to the 2018 DSM Evaluation Reports and requests an evaluation plan for the 2020-2022 DSM Plan. EfficiencyOne plans to use a similar approach to the 2016-2019 evaluation, including process and market evaluations, and will finalize the plan based on recommendations from previous reports.

Considerations - EfficiencyOne held a series of stakeholder consultations in 2016 to develop a stakeholder-supported means of estimating the fixed cost adjustment - NS Power did not make recommendations on how this could be achieved within...

AI summary EfficiencyOne conducted 2016 consultations on fixed cost adjustment methods. NS Power initially proposed its own model, while Synapse, Resource Insight, and Drazen Consulting suggested a transparent method without detailed fixed cost data. NS Power later altered RBIA models using new approaches but withheld fixed cost data during DSMAG's advisory phase, potentially influencing the method selection.

Considerations - continued - While NS Power's methodology may in fact be sound and could potentially be adopted in the future, the information provided by NS Power (mainly the altered versions of EfficiencyOne's models) is not sufficient t...

AI summary NS Power's proposed methodology lacks sufficient transparency and justification for immediate adoption. The NSUARB emphasizes the need for further discussion, including clarifying data sources, addressing confidentiality, and simplifying the model. The existing method should continue, with future consideration of NS Power's proposal in RBIAs.

NON-CONFIDENTIAL - 1 governments might affect these expectations. Markets will also develop at varying paces, and so - 2 continued market monitoring and updates are important for good portfolio and program design. Date Filed: May 13, 2019...

AI summary The text highlights the importance of ongoing market monitoring and updates for effective portfolio and program design, noting that government actions and varying market development paces may influence expectations. The document was filed on May 13, 2019.

NON-CONFIDENTIAL Request IR-2: With respect to the E1 utility funded programs designed to address the needs of low income customers in the domestic class, including the homeowner programs and the multi family residential program, please co...

AI summary NS Power confirms existing programs like HomeWarming and HST rebates support low-income customers but recommends income testing for E1 programs to ensure benefits reach those most in need. They emphasize maximizing support through targeted subsidies.

NON-CONFIDENTIAL 1 Request IR-37: 2 3 Please define "bankability of the benefits" as Mr. Levitan uses that term at p. 50 of 4 Appendix A. 5 6 (a) Please provide the metrics by which the Board should determine the bankability of 7 a claimed...

AI summary The document requests clarification on the term 'bankability of the benefits' as used by Mr. Levitan in his testimony. It asks for metrics to assess bankability and ratings for specific benefits claimed by E1 and NS Power Maritime Link, along with supporting workpapers. Levitan responds that no such analyses were conducted as part of his evidence.

NON-CONFIDENTIAL Request IR-5: Do you believe that it is possible for E1 to become a "leading" program administrator? Why or why not? Response IR-5: NS Power does not agree with the definition of "leading" provided in the E1 evidence. Plea...

AI summary NSP disputes the definition of 'leading' in E1's evidence, citing Richard Levitan's testimony (Appendix A, pages 26-35) to support their position. The response focuses on program administration criteria within a regulatory proceeding.

2020-2022 DSM IG IR-05 Attachment 1 Page 54 of 158 REDACTED (CONFIDENTIAL INFORMATION REMOVED) 1 NS Power has representation on the A-10 Working group that is performing the review 2 for TFCP. Throughout 2017, Webex meetings have been held...

AI summary NS Power participates in the A-10 Working Group reviewing methodologies for NPCC directories under TFCP. Three proposals are being tested: a revised A-10 framework, a hybrid performance-based methodology, and a connectivity-based approach. The working group aims to improve clarity, apply stricter NPCC criteria, and identify critical facilities.

IMPACT OF INCENTIVE PROGRAMS Policy has a significant impact on solar demand, as highlighted earlier by the notable increase in solar installations in 2018 after the launch of the SolarHomes program. In this section, we assess the impact t...

AI summary The document analyzes how incentive programs influence Nova Scotia's residential solar PV market, referencing the SolarHomes program's 2018 success. It outlines scenarios for future incentives, emphasizing the need to balance short-term market growth with long-term sustainability through gradual incentive reductions to avoid boom-and-bust cycles.

2.1 Consensus Agreement [17] Ultimately, E1 and NS Power filed a Consensus Agreement which is attached as Appendix A to this Decision. In addition to setting the spending, energy savings target, and demand savings target levels of $110 mil...

AI summary E1 and NS Power filed a Consensus Agreement setting spending, energy savings, and demand savings targets for 2020-2022. Key provisions include DSM funding for First Nations and low-income programs, FAM-based expensing of DSM costs, HST refunds via FAM, and operational responsibilities for the HomeWarming Program. The agreement also withdraws the Lifetime Energy Savings target and revises DSMAG terms.

2.2 Terms of Settlement Agreement [18] HGL intervened in the proceeding and had a specific issue with ETs application. HGL objected to E1 's proposal to offer incentives underthe Custom Incentive Program for new construction multi-unit res...

AI summary HGL objected to E1's proposal for incentives in the Custom Incentive Program promoting electric heat pumps in multi-unit residential buildings where natural gas is available. A settlement agreement was reached, leading to a collaborative review and E1 refraining from new participants during the review period.

3.7 Evaluation and Verification Reports [53] E1 noted that no concern was raised with respect to the Econoler Evaluation Report for the 2018 DSM year, the Verification Report for the 2018 DSM year, or to ETs response to the recommendations...

AI summary E1 found no issues with the 2018 DSM evaluation and verification reports or ETs' response. The Board accepted these reports and ETs' response as evidence.

3.7.1 HomeWarming Program [55] Under the Consensus Agreement, and with the apparent agreement of the Clean Foundation, the HomeWarming Program, funded through a charitable contribution by NS Power, will be operated and administered by E1 f...

AI summary The HomeWarming Program, funded by NS Power via a charitable contribution, is administered by E1 for three years starting 2020. Not requiring Board approval due to non-ratepayer funding, but the Board mandates segregation of records to prevent ratepayer fund misuse and proper charging of E1's work to the program.

In the event DSMAG agreement on final revised terms of reference cannot be achieved by June 30, 2020, the finalization ofthe revised terms ofreference shall be referred to the UARB for determination. - 8. The existing HomeWarming program f...

AI summary The document outlines terms for DSMAG agreement deadlines, the transition of the HomeWarming program to E1 for 2020-2022, and mutual non-opposition to 2018 DSM evaluation and verification reports. Parties agree not to file rebuttal evidence but retain rights for future challenges.

APPENDIX "A" - 1 & lt; EfffdeneyOne (El) and Heritage Gas (HG) will engage In a collaborative study/rovlow, at the cost of E1t ofthe program design and operation of the Custom incentive Program related to YRF electric heat pump measures in...

AI summary A settlement agreement between EfficiencyOne (E1) and Heritage Gas (HG) outlines a collaborative study on the Custom Incentive Program's electric heat pump measures in Multi-Unit Residential Buildings (MURBs) where natural gas is available. The study, with a September 30, 2019, deadline, includes restrictions on new financial commitments by E1 during the review period. Disputes will be referred to the Nova Scotia Utility and Review Board (NSUARB).

In the event DSMAG agreement on final revised terms of reference cannot be achieved by June 30, 2020, the finalization ofthe revised terms ofreference shall be referred to the UARB for determination. - 8. The existing HomeWarming program f...

AI summary The document outlines terms for DSMAG agreement deadlines, transfers the HomeWarming program to El for 2020-2022, and notes non-opposition to 2018 DSM reports. Parties agree not to file rebuttal evidence but reserve rights for future challenges. The proceeding relates to the Public Utilities Act and references Board Order M09O96.

APPENDIX "A" - 1. EfficiencyOne (El) and Heritage Gas (HG) will engage in a collaborative study/review, at the cost of E1, of the program design and operation of the Custom Incentive Program related to VRF electric heat pump measures in Mu...

AI summary EfficiencyOne (E1) and Heritage Gas (HG) agree to collaborate on a study of the Custom Incentive Program for VRF electric heat pumps in Multi Unit Residential Buildings (MURBs) with natural gas availability. The study includes timelines, restrictions on new financial commitments during the study period, and potential referral of disputes to the Nova Scotia Utility and Review Board (NSUARB).

Document: 268936 Date Filed: April 29, 2019 Synapse (E1) Page 1 of 11 1 2 Request IR-1: programs. costs of Please describe how EfficiencyOne proposes to recover the its proposed 20 Focus on early retirement or replace on burnout b. 21 Cove...

AI summary The document outlines a request for information regarding EfficiencyOne's proposed programs, including cost recovery methods, customer eligibility, target segments, market barriers, and marketing strategies. It also references the 2020-2022 Plan and cost tracking categories used for program evaluation.

1 (b) Please produce all studies, calculations, or other documents and 2 evidence relied upon by E1 rely upon to quantify that risk? 3 (c) Is this submission regarding risk any different from the submission 4 regarding risk to industry cap...

AI summary The document includes requests for information related to risk quantification, weighting of aspects in a DSM Resource Plan, and investment forecasts. It also discusses the distinction between demand reduction and demand response activities, and highlights the potential risks of reduced investment in DSM programs.

28 (a) Regarding E1 (NSPI) RIR-5, from whom did E1 received general support 29 for increasing the emphasis on demand reduction? And for increasing 30 focus on helping underserved markets? 1 2 (b) Please add a column to the table to identif...

AI summary The document contains a series of regulatory requests and references related to EfficiencyOne (E1) and its programs, including demand reduction, underserved markets, incentive methodologies, and program enhancements. It also references reports and considerations on avoided costs and savings attribution issues.

Request to file Board-Only Confidential Response EfficiencyOne requests Board Only Confidential treatment of the following IR Response which contains commercially sensitive information: • NSUARB Pronko IR-09 – Attachment 1 I trust you will...

AI summary EfficiencyOne requests Board-Only Confidential treatment for a response containing commercially sensitive information, referencing NSUARB Pronko IR-09 – Attachment 1. The response will be delivered as six hard copies to the Board office. The Breton Law Group's James R. Gogan is the signatory, with a carbon copy to M09096 Participants.

Issue 1 - Evaluation Report of 2018 DSM Programs The Parties confirm no opposition to the Evaluation Report of 2018 DSM programs (Econoler);

AI summary The parties confirm no opposition to the 2018 DSM program evaluation report by Econoler, indicating agreement with its findings and methodology. NSP's 2018 DSM programs are under review for compliance with regulatory standards.

Summary of AEC Position The expert reports filed on behalf of the NSUARB, the Consumer Advocate and the AEC demonstrate that the preferred funding level for the First Nations and Kevin Russell, IPOANS, letter of comment May 22, 2019 Jeff D...

AI summary The AEC supports low-income energy efficiency programs but raises concerns about insufficient funding in the proposed Agreement. It argues that underfunding would hinder long-term affordability and deprive future generations of benefits. The AEC references past Board decisions emphasizing the need for alignment between the IRP and NSPI plans.

DEMAND REDUCTION/DEMAND RESPONSE In its Preferred Plan, E1 proposed to include $9.9 million ($3.3 million a year) for demand reduction. With the Consensus Agreement, Mr. MacDonald, for E1, explained during the hearing that $5.4 million is...

AI summary E1 proposed a demand reduction budget of $9.9 million, but with the Consensus Agreement, the amount was adjusted to $5.4 million. This funding can be used for both demand reduction and demand response initiatives. The Industrial Group emphasizes the importance of real-time demand management over scheduled approaches and criticizes E1's slow progress on its 2019 DSM pilot, which has only spent $30,000 of its $1 million budget.

2 Evaluation Reports - 3 No express opposition has been raised with respect to the Econoler Evaluation Report for the 2018 - DSM year, the Verification Report for the 2018 DSM year, or to EfficiencyOne's response 21 4 to - 5 the recommenda...

AI summary No opposition has been raised against the 2018 Econoler Evaluation Report, Verification Report, or EfficiencyOne's response. EfficiencyOne requests the NSUARB to accept the reports and responses as filed.

2.2 Terms of Settlement Agreement [18] HGL intervened in the proceeding and had a specific issue with ETs application. HGL objected to E1 's proposal to offer incentives underthe Custom Incentive Program for new construction multi-unit res...

AI summary HGL intervened and objected to E1's proposal for incentives promoting electric heat pumps in multi-unit residential buildings where natural gas is available. A settlement agreement was reached, leading to a collaborative review and E1 refraining from soliciting new program participants during that period.

3.7 Evaluation and Verification Reports [53] E1 noted that no concern was raised with respect to the Econoler Evaluation Report for the 2018 DSM year, the Verification Report for the 2018 DSM year, or to ETs response to the recommendations...

AI summary EfficiencyOne (E1) confirmed no concerns with the 2018 DSM year Econoler Evaluation and Verification Reports or ET's response to their recommendations. The Board accepted these reports and ET's response based on the evidence provided.

In the event DSMAG agreement on final revised terms of reference cannot be achieved by June 30, 2020, the finalization ofthe revised terms ofreference shall be referred to the UARB for determination. - 8. The existing HomeWarming program f...

AI summary The document outlines agreements between EfficiencyOne (E1) and NS Power regarding the HomeWarming program's administration from 2020-2022, terms of reference for DSMAG, and non-opposition to 2018 DSM evaluation and verification reports. Parties agree not to file rebuttal evidence but reserve rights to challenge evidence in future proceedings.

APPENDIX "A" - 1 & lt; EfffdeneyOne (El) and Heritage Gas (HG) will engage In a collaborative study/rovlow, at the cost of E1t ofthe program design and operation of the Custom incentive Program related to YRF electric heat pump measures in...

AI summary EfficiencyOne (E1) and Heritage Gas (HG) agree to collaborate on a study of the Custom Incentive Program's electric heat pump measures in Multi-Unit Residential Buildings (MURBs). The study includes timelines for completion, restrictions on new financial commitments during the review period, and provisions for NSUARB involvement if disagreements arise.

3. ISSUES

AI summary The document outlines regulatory issues related to Demand Side Management (DSM), Total Resource Cost Test (TRC), Program Administrator Cost Test (PAC), and Integrated Resource Plan (IRP) under the jurisdiction of the Nova Scotia Utility and Review Board (NSUARB). Key arguments and entities involved are not detailed in the provided text.

Settlement Agreement – Heritage Gas - EfficiencyOne and Heritage Gas have agreed to engage in a collaborative study of the - program design and operation of the Custom Incentives Program related to Variable - Refrigerant Flow (VRF) electri...

AI summary EfficiencyOne and Heritage Gas agreed to collaborate on a study of the Custom Incentives Program for VRF electric heat pumps in Multi-unit Residential Buildings (MURBs) where natural gas is available. The Terms of Reference were completed by June 30, 2019, and a consultant was engaged. The study and recommendations will be filed with the NSUARB by October 15, 2019.

2. DEVELOPMENT APPROACH AND DETAILS

AI summary The section outlines the development approach and details, referencing key acronyms and programs related to Nova Scotia's regulatory proceedings, including demand-side management, cost tests, and efficiency initiatives.

Cost-Effectiveness To assess the cost-effectiveness of the 2020-2022 DSM Resource Plan, EfficiencyOne used two industry standard screening tests: the TRC test and the Program Administrator Cost (PAC) test. The TRC was used as the primary t...

AI summary EfficiencyOne assessed the 2020-2022 DSM Resource Plan using TRC and PAC tests. TRC was mandated by NSUARB decision [4] requiring a TRC of 1 or greater. PAC test results were shared as informational, excluding voluntary contributions. Results by sector are in Table 1. NSUARB Order M03669 from 2011 is cited regarding DSM Plan approval.

4. RESIDENTIAL PROGRAMS AND SERVICES The DSM Resource Plan will allow EfficiencyOne to continue delivering cost-effective energy savings benefits for Nova Scotia's residential customers. The DSM Resource Plan pursues enhanced approaches to...

AI summary The DSM Resource Plan by EfficiencyOne aims to enhance residential energy efficiency in Nova Scotia through non-lighting measures, improved program accessibility, and leveraging customer data. The plan reflects increased customer emphasis on reducing energy use, as shown in a 2018 survey, and focuses on evolving programs to address market saturation and achieve higher savings through complex projects.

6 4.1.1 Overview 7 The Residential Efficient Product Rebates program provides residential customers 8 access to financial incentives for consumer products through retail channels and to 9 retire and/or replace old inefficient appliances. T...

AI summary The Residential Efficient Product Rebates program offers financial incentives for energy-efficient products through two components: Appliance Retirement (retiring old appliances) and Instant Savings (point-of-sale rebates). Appliance Retirement includes free replacements for low-income customers, while Instant Savings collaborates with retailers for rebates and in-store education. EfficiencyOne partners with retailers to deliver these initiatives.

4.1.2 Enhancements in 2020-2022 Two enhancements to the Residential Efficient Product Rebate program are being introduced in the DSM Resource Plan to help Nova Scotians make energy efficient choices about large residential appliances.

AI summary Two enhancements to the Residential Efficient Product Rebate program under the DSM Resource Plan aim to assist Nova Scotians in selecting energy-efficient large residential appliances, promoting energy efficiency in residential settings.

Appliance Replacements Appliance Retirement will place an increased focus on appliance replacements by offering a new turn-key service. Currently, Appliance Retirement replaces fridges, freezers and dehumidifiers for low-income qualified N...

AI summary Appliance Retirement expands appliance replacement services, including new appliances for low-income Nova Scotians via HomeWarming and Mi'kmaw Home Energy Efficiency programs. ENS will offer appliance replacement packages under the DSM Resource Plan, involving removal of old appliances and installation of efficient replacements.

4.1.3 Objectives - Objectives of the Residential Efficient Product Rebates program include: - make energy-efficient products more accessible to Nova Scotians across all income levels and geographic locations; - increase customer and retail...

AI summary The Residential Efficient Product Rebates program aims to increase access to energy-efficient products for all Nova Scotians, raise awareness of energy efficiency benefits, boost system-peak demand, expand product availability, remove inefficient appliances, and help customers reduce energy costs through rebates.

Market Barriers Barriers to participating in the Efficient Product Rebates program includes: - Affordability: The cost difference between efficient products and less efficient products can create a participation barrier. - Awareness: Some...

AI summary The Efficient Product Rebates program faces barriers including affordability, awareness, short decision periods, lack of trust, and lack of information. These issues hinder participation in energy-efficient product initiatives.

Program History Residential Efficient Product Rebates is a well-established program in Nova Scotia and has been operating as part of the ENS portfolio since 2010. Instant Savings on energyefficient products has been operating since 2009[10...

AI summary Residential Efficient Product Rebates and Appliance Retirement programs have evolved since 2009 under Efficiency Nova Scotia (ENS). Instant Savings, initially focused on CFLs, shifted to LEDs and expanded rebate availability. Appliance Retirement expanded province-wide and introduced incentives for new appliance categories. Both programs adapted rebate structures and product eligibility over time to align with market changes and energy efficiency goals.

4.1.5 Program Design

AI summary The section titled '4.1.5 Program Design' is referenced but contains no substantive text or analysis in the provided chunk. No details about program design, stakeholder positions, or regulatory considerations are included.

Program Delivery The Residential Efficient Product Rebates program uses both a self-serve and turn-key delivery approach to help residential customers make smart energy choices through the retirement and/or replacement of inefficient appli...

AI summary The document outlines three program delivery models under Nova Scotia's energy efficiency initiatives: self-serve/turn-key approaches for residential rebates, delivery agent models for appliance retirement, and retailer engagement strategies for instant savings. These methods aim to promote energy-efficient appliance adoption and retailer participation.

4.1.8 Low-Income Performance Indicators Low-Income performance indicators for the Residential Efficient Product Rebates program are provided in Table 8 below.

AI summary The section discusses low-income performance indicators for the Residential Efficient Product Rebates program, referencing Table 8 for detailed metrics. It focuses on evaluating program effectiveness for low-income households.

Existing Residential: Program Description

AI summary The document outlines the Existing Residential Program under Nova Scotia's regulatory framework, involving Demand Side Management (DSM) initiatives. Key entities include the Nova Scotia Utility and Review Board (NSUARB) and Efficiency Nova Scotia (ENS), with discussions on cost allocation methodologies and program evaluation.

Additional Support Increased financial support will be provided for heat pump water heaters and DWHR in both the Green Heat and Home Energy Assessment program components. Additional engagement with plumbers and plumbing contractors will be...

AI summary Increased financial support for heat pump water heaters and DWHR in Green Heat and Home Energy Assessment programs, with engagement of plumbers and contractors. Reference to Natural Resources Canada's 2016 energy data.

Mid-stream [12](#page-47-0) Delivery Approach for Cold Climate Ductless Heat Pumps Currently, incentives for ductless heat pumps are delivered through a downstream mail- in rebate via Green Heat or as part of whole home upgrades in Home En...

AI summary Transitioning from mail-in rebates to instant rebates for ductless heat pumps aims to increase participation by reducing administrative burdens and upfront costs. EfficiencyOne will collaborate with distributors to promote the program.

Deeper Energy Savings Support for Home Energy Assessment Participants Home upgrades such as increasing insulation and, energy efficient space and water heating systems are an important part of the residential sector portfolio. Achieving de...

AI summary The Home Energy Assessment program aims to increase participation through upgrades like insulation and efficient heating systems. With 17% market penetration by 2018, two enhancements are proposed to achieve deeper, long-lasting energy savings in residential sectors.

Demand Response Measures Demand response initiatives will be introduced as part of the broader DSM portfolio in the DSM Resource Plan. EfficiencyOne and NS Power will be working closely on the development, assessment and evaluation of dema...

AI summary Demand response initiatives are being introduced as part of Nova Scotia's DSM portfolio, with EfficiencyOne and NS Power collaborating on development and evaluation. These initiatives build on a 2019 demand reduction pilot and include ETS units and electric storage hot water heater timers within Green Heat and Home Energy Assessment programs.

4.2.8 Low-Income Performance Indicators 20 21 Low-income performance indicators for the Existing Residential program are provided in Table 10 below. 23 24 22

AI summary Section 4.2.8 outlines low-income performance indicators for the Existing Residential program, referencing Table 10 for detailed metrics. The text provides no further analysis or data beyond this reference.

4.3.2 Objectives Objectives of the New Residential program include: - deliver significant and long-lasting energy savings for homeowners; - increase homeowner and builder awareness of cost-effective options for improving the energy efficie...

AI summary The New Residential program aims to deliver energy savings, raise awareness of efficiency options, reduce lost energy savings opportunities, promote best practices in home design and construction, and improve energy efficiency in Nova Scotia's new housing stock including single-detached, semi-detached, and row homes.

5.1.2 Enhancements in 2020-2022

AI summary The section titled '5.1.2 Enhancements in 2020-2022' outlines improvements implemented during this period, though no specific details are provided in the text. The context includes regulatory and program-related acronyms relevant to Nova Scotia's utility and energy sectors.

5.1.8 Low-Income Performance Indicators 26 27 28 Low-income performance indicators for the BNI Efficient Product Rebate program are provided in Table 14 below. & lt;sup>a TRC is a benefit/cost ratio comparing lifetime benefits to the sum o...

AI summary The section outlines low-income performance indicators for the BNI Efficient Product Rebate program, including metrics like TRC, PAC, and levelized cost of saved energy. Table 14 details these indicators, with footnotes explaining calculations involving EfficiencyOne and Nova Scotia Power's WACC.

Table 14: 2020-2022 BNI Efficient Product Rebates Low Income Performance Indicators Year First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Peak Demand Savings (MW) Participation (products)a 2020 3.1 45.8 1.03 27,878 2021 2.9 41...

AI summary Table 14 summarizes BNI Efficient Product Rebates' low-income performance indicators from 2020-2022, showing annual energy savings (3.0-3.1 GWh), lifetime savings (129.5 GWh), peak demand reductions (3.22 MW), and participation (78,752 products). Metrics declined slightly annually despite cumulative gains.

Custom Incentives: Program Description

AI summary The document outlines a program description for Custom Incentives under Nova Scotia's regulatory framework, involving entities like NSUARB and ENS. Key terms include DSM, TRC, and PAC, with references to cost allocation and evaluation methodologies.

5.2.2 Enhancements in 2020-2022

AI summary Section 5.2.2 outlines regulatory enhancements in Nova Scotia from 2020-2022, focusing on demand-side management, cost allocation methodologies, and efficiency programs. Key entities include the NSUARB, ENS, and DSMAG, with acronyms related to utility regulation and energy efficiency initiatives.

Demand Response Demand response initiatives will be introduced as part of the broader DSM portfolio in the DSM Resource Plan. EfficiencyOne and NS Power will be working closely on the development, assessment and evaluation of demand respon...

AI summary Demand response initiatives are part of the DSM portfolio in the DSM Resource Plan, developed by EfficiencyOne and NS Power. They build on a 2019 demand reduction pilot, expanding customer offerings. The Custom Program supports demand response with incentives for system-peak savings, including feasibility studies and financial support.

5.2.3 Objectives - Objectives of the Custom Incentives program include: - influence electrical energy efficiency and system-peak demand reduction projects within Nova Scotia; - build awareness around the benefits of energy efficiency to pr...

AI summary The Custom Incentives program aims to promote energy efficiency in Nova Scotia by reducing system-peak demand, raising awareness among BNI customers, overcoming barriers to complex projects, and expanding ENS program offerings through trialed technologies. It also seeks to improve building design, enable energy management, and foster long-term customer relationships for sustainability.

5.2.5 Program Design

AI summary The section titled '5.2.5 Program Design' is part of a regulatory proceeding in Nova Scotia, though no substantive content is provided in the text beyond the heading. The context includes a list of acronyms relevant to energy management and regulatory processes.

Measures Promoted The Direct Installation Program provides financial and technical support to small - business customers through both a self-directed and facilitated pathway. This support includes: - no-cost energy audits to assess upgrade...

AI summary The Direct Installation Program offers financial and technical support to small businesses via self-directed and facilitated pathways, including energy audits, customized incentives, and prescriptive rebates for energy-efficient upgrades in lighting, HVAC, and system-peak demand reduction through ETS units.

5.3.6 Implementation Strategy

AI summary The section outlines the implementation strategy for demand-side management and resource cost tests, involving entities such as the Nova Scotia Utility and Review Board and Efficiency Nova Scotia. Key topics include strategic energy management and cost allocation methodologies.

5.3.8 Low-Income Performance Indicators Low-income performance indicators for the Direct Installation program are provided in Table 18 below.

AI summary The document references Table 18, which contains low-income performance indicators for the Direct Installation program. No specific data or details about the indicators are provided in the text.

Education and Outreach The objective of Education and Outreach activities is to increase program participation by effectively communicating what energy efficiency is and how it positively affects the lives of Nova Scotians. Education and O...

AI summary Education and Outreach aims to boost energy efficiency participation in Nova Scotia by promoting its benefits. While 71% of residents agree energy efficiency improves quality of life (2018), only 30% take action, indicating a gap. Strategies from 2020-2022 will build on EfficiencyOne's efforts and public feedback to drive behavioral change.

appropriate). 1 meant to build on the demand reduction pilot beginning in 2019 and expand 2 technical and policy support to both provincial and federal governments relating to 3 strategic electrification, demand response, energy storage, a...

AI summary The text outlines Regulatory Affairs activities related to DSM initiatives, including the development and negotiation of the 2023-2025 DSM Resource Plan, investigations into budget underspending and energy savings overestimation, and reporting requirements to the NSUARB and DSMAG.

7. EVALUATION EfficiencyOne proposes to take a similar approach to evaluation in 2020-2022 as in 2016-2019, where evaluation activities are conducted to ensure accurate determination of net electrical energy and net system-peak demand savi...

AI summary EfficiencyOne proposes to maintain its evaluation approach from 2016-2019 for 2020-2022, condensing activities where appropriate due to program maturity. Annual impact evaluations will be conducted with modified reporting structures to ensure accurate energy and demand savings assessments and continuous improvement.

1 design and conduct a full scope of evaluation activities for program components that 2 require a full impact evaluation. Process and Market Evaluations

AI summary The text outlines the need to design and conduct comprehensive evaluation activities for program components that require a full impact evaluation, focusing on process and market evaluations.

• adding a new Program; 2 terminating an existing Program; • 3 increasing the 3-year plan budget for the total Residential sector by more than 25 • 4 percent; 5 decreasing the 3-year plan budget for the total Residential sector by more tha...

AI summary The text outlines proposed changes to energy efficiency programs, including adding a new program, modifying existing ones, and adjusting budget and savings targets. EfficiencyOne plans to submit quarterly reports to the NSUARB and stakeholders, with mid-course adjustments made if necessary, particularly when there is a 25% variance in energy savings or investment.

supports a robust energy efficiency industry in Nova Scotia. M08946, EfficiencyOne 2018 Rate and Bill Impact Analysis (31 October 2018), Electronically filed model version, Microsoft Excel file). Over the past decade demand side management...

AI summary The document highlights Nova Scotia's successful demand-side management (DSM) programs, noting benefits exceeding investments by 4:1. The Preferred PlanDSM Resource Plan (2020-2022) is deemed cost-effective with a Total Resource Cost ratio of 2.02 and Program Administrator Cost ratio of 4.8, despite rising unit costs. It emphasizes expanding into complex markets and improving accessibility for underserved communities.

2. DEVELOPMENT APPROACH AND DETAILS 2 4 5 6 7 1 The Preferred Plan was developed for the purpose of delivering cost effective energy and system peak demand savings to Nova Scotia electricity ratepayers for the three-year plan period. Effic...

AI summary The Preferred Plan, developed by EfficiencyOne, aims to deliver cost-effective energy and peak demand savings for Nova Scotia ratepayers over three years. The plan was created using a multi-stage process to set performance targets, design a cost-effective portfolio, and structure programs to achieve these goals.

11 Vetting Process The final stage of model design is the vetting process. This step is crucial, as it allows for the alignment of EfficiencyOne's qualitative and quantitative design efforts. The vetting process involves analysis of the mo...

AI summary The vetting process is the final stage of model design, ensuring alignment of EfficiencyOne's qualitative and quantitative efforts. It involves analysis of model outputs by internal and external teams, with adjustments made based on findings, such as unexpected energy savings trends that impact delivery costs and market presence.

Table 4: 2021 DSM Resource Plan Investment and Savings 2021 Investment ($ million) Lifetime Benefits ($ million) a First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Peak Demand Savings (MW) Total Resource Cost Test (TRC) b Prog...

AI summary Table 4 outlines the 2021 Demand Side Management (DSM) Resource Plan Investment and Savings, detailing investments, benefits, energy savings, and cost tests for various residential and business programs. It includes data on energy savings, peak demand reduction, and cost evaluations like the Total Resource Cost Test (TRC) and Program Administrator Cost Test (PAC).

Annual avoided costs of energy and capacity were provided by NS Power, from the 2014 IRP using the Base level of DSM. Avoided costs of transmission and distribution were provided by NS Power in 2018. a Lifetime benefits are expressed as th...

AI summary The document discusses annual avoided costs of energy and capacity from NS Power's 2014 Integrated Resource Plan (IRP) and provides details on how lifetime benefits are calculated using net present value and the Total Resource Cost (TRC) and Program Administrator Cost (PAC) ratios. It also references EfficiencyOne's planned participation by low-income customers.

4. RESIDENTIAL PROGRAMS AND SERVICES The Preferred PlanDSM Resource Plan will allow EfficiencyOne to continue delivering cost-effective energy savings benefits for Nova Scotia's residential customers. The Preferred PlanDSM Resource Plan pu...

AI summary The Preferred PlanDSM Resource Plan by EfficiencyOne aims to enhance residential energy savings in Nova Scotia through customer-focused programs and non-lighting measures. High customer interest in reducing energy use (87% in 2018) supports this shift. The plan emphasizes expanded services, data-driven approaches, and system-peak demand reduction to address market saturation and improve efficiency.

6 Table 6: Preferred PlanDSM Resource Plan: Residential Sector Offerings Program Program Component Target Market Segment Delivery Approach Enhancements in 2020-2022 Plan Residential Efficient Product Rebates Appliance Retirement Residentia...

AI summary Table 6 outlines the residential sector offerings of the Preferred Plan DSM Resource Plan, including various energy efficiency programs and their components. Key programs include appliance retirement, instant savings, efficient product installation, and home energy assessments. The table also highlights enhancements made in the 2020-2022 plan and the renaming of the First Nations Home Energy Efficiency program to Mi'kmaw Home Energy Efficiency during the regulatory process for E1's 2020-2022 DSM Resource Plan Application (M09096).

4.1.3 Objectives - Objectives of the Residential Efficient Product Rebates program include: - make energy-efficient products more accessible to Nova Scotians across all income levels and geographic locations; - increase customer and retail...

AI summary The Residential Efficient Product Rebates program aims to increase access to energy-efficient products, raise awareness, remove inefficient appliances, and reduce energy costs for residential customers, including low-income and renters. Barriers include affordability, awareness, and trust issues. The program has been in place since 2010 under ENS.

4.1.5 Program Design

AI summary The section outlines Program Design considerations under Nova Scotia's regulatory framework, referencing key acronyms and entities involved in energy management and utility regulation. It highlights the role of organizations like NSUARB and ENS in shaping demand-side management initiatives.

1 4.1.8 Low-Income Performance Indicators 2 3 Low-Income performance indicators for the Residential Efficient Product Rebates 4 program are provided in Table 8 below. 5

AI summary Section 4.1.8 discusses Low-Income Performance Indicators for the Residential Efficient Product Rebates program, referencing data presented in Table 8. The section focuses on evaluating program outcomes for low-income households through specific performance metrics.

15 Program Alternatives 16 17 EfficiencyOne considered the same key principles in both the development of the 2020- a 9 The number of individual products rebated through Instant Savings and appliance retirement 2022 Preferred DSM Resource...

AI summary EfficiencyOne compared their 2020-2022 Preferred DSM Resource Plan with an alternate scenario, noting lower participation and energy savings in the alternate. Table 9 details the Residential Efficient Product Rebates program differences.

4.3.24.2.2 Enhancements in 2020-2022 Several new initiatives are introduced in 2020-2022 to enhance the Existing Residential Program. These are detailed in the following section.

AI summary In 2020-2022, several new initiatives were introduced to enhance the Existing Residential Program, aimed at improving energy efficiency and residential services. These initiatives are detailed in subsequent sections of the document.

Domestic Hot Water Support In Nova Scotia, energy used to heat potable water accounts for approximately 16 percent of household energy use. EfficiencyOne estimates that of the approximately 400,000 households in Nova Scotia, 55 percent use...

AI summary In Nova Scotia, 16% of household energy is used for domestic hot water, with 55% of households relying on electricity. EfficiencyOne has achieved 8-10% residential energy savings from water heating measures. The Preferred PlanDSM Resource Plan aims to reduce electricity use through enhanced residential programs.

Mid-stream[13](#page-145-0) Delivery Approach for Cold Climate Ductless Heat Pumps Currently, incentives for ductless heat pumps are delivered through a downstream mail- in rebate via Green Heat or as part of whole home upgrades in Home En...

AI summary The document proposes transitioning from downstream mail-in rebates to mid-stream delivery for ductless heat pumps via instant rebates, aiming to increase participation by reducing administrative burdens, improving understanding, and lowering upfront costs. EfficiencyOne will collaborate with distributors to promote the program.

Demand Reduction Response Measures Demand reduction response initiatives are beingwill be introduced as part of the broader DSM portfolio in the Preferred PlanDSM Resource Plan. EfficiencyOne and NS Power will be working closely on the dev...

AI summary Demand reduction initiatives are part of Nova Scotia's DSM portfolio, with EfficiencyOne and NS Power collaborating on development and evaluation. These efforts expand on a 2019 pilot, incorporating ETS units and electric storage hot water heater timers into Green Heat and Home Energy Assessment programs.

First NationsMi'kmaw Home Energy Efficiency This program component will continue the efforts of the pilot initiatives in both 2018 and 2019. Additional upgrades in First Nation Mi'kmaw homes will occur under the Existing Residential Progra...

AI summary The First NationsMi'kmaw Home Energy Efficiency program will expand on 2018-2019 pilot initiatives, implementing additional home upgrades under the Existing Residential Program within the Preferred PlanDSM Resource Plan framework.

4.3.64.2.6 Implementation Strategy

AI summary The section outlines the implementation strategy for demand-side management and related programs under Nova Scotia regulatory oversight, involving entities like NSUARB and ENS, with focus on cost allocation, evaluation, and compliance with regulatory tests.

4.3.84.2.8 Low-Income Performance Indicators Low-income performance indicators for the Existing Residential program are provided in Table 104 below. DATE FILED: February 28, 2019 August 27, 2019

AI summary The document outlines low-income performance indicators for the Existing Residential program, referencing Table 104. It includes filing dates of February 28, 2019, and August 27, 2019, though no specific claims or cross-references are detailed in the provided text.

1 Table 10: 2020-2022 Existing Residential Low Income Performance Indicators Year First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Peak Demand Savings (MW) Participation (products)a Participation (homes)b Participation (projec...

AI summary Table 10 presents residential low-income energy efficiency performance metrics from 2020-2022, showing cumulative energy savings, peak demand reductions, and participation numbers across programs like Efficient Product Installation and First Nations Home Retrofits. Total energy savings reached 231 GWh by 2022, with 244,109 products distributed.

4.3.9 Program Alternatives 2 4 5 6 7 1 EfficiencyOne considered the same key principles in both the development of the 2020-2022 Preferred DSM Resource Plan and alternate scenario. The significant difference between the Alternate scenario...

AI summary EfficiencyOne compared their 2020-2022 Preferred DSM Resource Plan with an alternate scenario, noting lower participation and investment levels in the alternate scenario. Table 12 illustrates differences in the Existing Residential program.

4.44.3 New Residential: Program Description 2526 27 28 29 30

AI summary The 'New Residential: Program Description' section appears to be under development or incomplete, as the provided text contains only section numbering and headings without substantive content or analysis.

4.4.8 Program Alternatives 31 32 EfficiencyOne considered the same key principles in both the development of the 2020- DATE FILED: February 28, 2019 August 27, 2019 2022 Preferred DSM Resource Plan and alternate scenario. The significant d...

AI summary EfficiencyOne's 2020-2022 Preferred DSM Resource Plan and alternate scenario differ in participation levels due to lower energy savings and investment. Table 14 details this for the New Residential program.

7 Efficient Product Rebates: Program Description 8

AI summary The document outlines the Efficient Product Rebates program under Demand Side Management (DSM) in Nova Scotia, managed by Efficiency Nova Scotia (ENS). It details cost allocation methodologies (CAM), evaluation processes (EVA), and reporting (RF) frameworks. Key stakeholders include the Nova Scotia Utility and Review Board (NSUARB) and the Efficiency Trade Network (ETN).

Demand Reduction Response Demand response initiatives will be introduced as part of the broader DSM portfolio in the DSM Resource Plan. EfficiencyOne and NS Power will be working closely on the development, assessment and evaluation of dem...

AI summary Demand response initiatives are integrated into Nova Scotia's DSM portfolio, led by EfficiencyOne and NS Power. The BNI Efficient Product Rebates program aims to promote energy-efficient technologies, facing barriers like upfront costs and lack of technical expertise. The program, launched in 2010, has evolved to adapt to market changes, including adjusting rebates in 2019.

5.1.8 Low-Income Performance Indicators Low-income performance indicators for the BNI Efficient Product Rebate program are 29 provided in Table 147 below. 1 2 3456789 10 12 13 14 15 26 27 DATE FILED: February 28, 2019 August 27, 2019

AI summary The document references low-income performance indicators for the BNI Efficient Product Rebate program, with data provided in Table 147. The text includes filing dates of February 28, 2019, and August 27, 2019, but no further details on the indicators or program outcomes are provided.

10 5.1.9 Program Alternatives 11 EfficiencyOne considered the same key principles in both the development of the 2020- 2022 Preferred DSM Resource Plan and alternate scenario. The significant difference between the Alternative scenario and...

AI summary EfficiencyOne compared its 2020-2022 Preferred DSM Resource Plan with an alternative scenario showing lower participation due to reduced energy savings and investment. The BNI Efficient Product Rebates program's differences are detailed in Table 18, highlighting reduced resource allocation in the alternative scenario.

5.2 Custom Incentives: Program Description

AI summary Section 5.2 outlines the description of Custom Incentives within a regulatory proceeding, likely detailing program structures, eligibility criteria, or implementation frameworks. Key entities and acronyms related to energy management and regulatory oversight are referenced.

5.2.1 Overview The Custom Incentives program provides financial incentives and technical assistance to help non-profit, institutional, commercial and industrial customers reduce their electrical energy consumption and system-peak demand. S...

AI summary The Custom Incentives program offers tailored financial and technical support to non-profit, institutional, commercial, and industrial customers to reduce energy consumption and peak demand. It includes three components: Custom, Energy Management Information Systems (EMIS), and Strategic Energy Management (SEM). Cost-effectiveness is evaluated via Total Resource Cost (TRC) and Program Administrator Cost (PAC) tests, using metrics like weighted average cost of capital (WACC).

Demand ReductionResponse Demand response initiatives will be introduced as part of the broader DSM portfolio in the DSM Resource Plan. EfficiencyOne and NS Power will be working closely on the development, assessment and evaluation of dema...

AI summary Demand response initiatives are integrated into the DSM portfolio under the Preferred Plan, building on a 2019 pilot. EfficiencyOne and NS Power collaborate on development and evaluation. The Custom Program supports system-peak demand savings through incentives for feasibility studies, direct financial support, and financing options.

5.2.3 Objectives Objectives of the Custom Incentives program include: • influence electrical energy efficiency and system-peak demand reduction projects within Nova Scotia; • build awareness around the benefits of energy efficiency to prog...

AI summary The Custom Incentives program aims to drive energy efficiency and reduce peak demand in Nova Scotia by targeting large BNI customers. It addresses barriers like financial constraints, payback periods, and technical expertise gaps. The program, administered by Efficiency Nova Scotia since 2010, has expanded through initiatives like compressed air optimization and building commissioning pilots since 2013.

Ouality Assurance - 7 The Custom Incentives program has an established framework for quality assurance. - 8 Quality control of projects includes pre and post measurement of energy consumption - 9 (e.g. direct, modelled, expert review), ran...

AI summary The Custom Incentives program employs a quality assurance framework involving pre/post energy consumption measurement (direct, modelled, expert review), random/targeted site visits, documentation reviews, and customer surveys to ensure project quality control.

5.2.8 Low-Income Performance Indicators Low-Income performance indicators for the Custom Incentives program are provided in Table 169 below.

AI summary The text references Low-Income performance indicators for the Custom Incentives program, noting that details are provided in Table 169. No specific claims, arguments, or cross-references are explicitly stated in the provided text.

5.2.9 Program Alternatives 5 6 7 9 10 1112 13 14 15 EfficiencyOne considered the same key principles in both the development of the 2020-2022 Preferred DSM Resource Plan and alternate scenario. The significant difference between the Altern...

AI summary EfficiencyOne developed both the 2020-2022 Preferred DSM Resource Plan and an alternate scenario with lower participation levels due to reduced energy savings and investment. Table 21 compares the Custom Incentives program's performance indicators between the two plans.

5.3 Direct Installation: Program Description 10

AI summary The section outlines the Direct Installation program under Demand Side Management (DSM), though specific details are not provided in the text. Key entities and acronyms related to Nova Scotia's energy regulation are referenced.

5.3.5 Program Design

AI summary The section discusses Program Design within the Nova Scotia regulatory proceeding, referencing key acronyms and entities involved in energy management and utility regulation. It highlights DSM, TRC, and other related terms, emphasizing cost allocation and evaluation methodologies.

5.3.7 Performance Indicators Performance indicators for the Direct Installation program are provided in Table 1722 below.

AI summary The section introduces performance indicators for the Direct Installation program, referencing Table 1722. It outlines metrics used to evaluate program effectiveness within the Nova Scotia regulatory framework.

5.3.8 Low-Income Performance Indicators Low-income performance indicators for the Direct Installation program are provided in Table 1823 below.

AI summary The section discusses low-income performance indicators for the Direct Installation program, referencing Table 1823 for details.

Table 18: 2020-2022 Direct Installation Low Income Performance Indicators Year First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Peak Demand Savings (MW) Participation (products) a 2020 0.01 0.1 0.00 270 2021 0.01 0.1 0.00 284...

AI summary Table 18 shows minimal first-year and lifetime energy savings (0.01-0.1 GWh annually) and zero peak demand savings from 2020-2022 under the Direct Installation Low Income program. Participation in Small Business Energy Solutions increased from 270 to 312 products over three years.

Table 23: 2020-2022 Direct Installation Low-Income Performance Indicators Year First-Year Energy Savings (GWh) Lifetime Energy Savings (GWh) Peak Demand Savings (MW) Participation (products) a 2020 0.01 0.1 0.00 296 2021 0.01 0.1 0.00 307...

AI summary Table 23 shows minimal first-year and lifetime energy savings (0.01–0.1 GWh annually) and no peak demand savings (0.00 MW) for Nova Scotia’s Direct Installation Low-Income programs (2020–2022). Participation in the Small Business Energy Solutions program grew from 296 to 320 products, totaling 923 units.

5.3.9 Program Alternatives EfficiencyOne considered the same key principles in both the development of the 2020-2022 Preferred DSM Resource Plan and Alternate scenario. The significant difference between the Alternate scenario and Efficien...

AI summary EfficiencyOne developed both a Preferred DSM Resource Plan and an Alternate scenario for 2020-2022, differing primarily in reduced participation levels in the Alternate due to lower energy savings and investment. Table 24 compares Direct Installation program performance indicators between the two plans.

Education and Outreach The objective of Education and Outreach activities is to increase program participation by effectively communicating what energy efficiency is and how it positively affects the lives of Nova Scotians. Education and O...

AI summary Education and Outreach activities aim to increase energy efficiency participation in Nova Scotia by promoting its benefits. While 71% of Nova Scotians agree energy efficiency improves quality of life (Q3 2018), only 30% reduce energy consumption, indicating a gap between perception and action. Strategies from 2020-2022 will build on EfficiencyOne's efforts and public feedback.

7. EVALUATION EfficiencyOne proposes to take a similar approach to evaluation in 2020-2022 as in 2016-2019, where evaluation activities are conducted to ensure accurate determination of net electrical energy and net system-peak demand savi...

AI summary EfficiencyOne proposes to continue its evaluation approach from 2016-2019, condensing activities for mature programs, conducting annual impact evaluations, and ensuring accurate savings determination for energy and demand.

Impact Evaluations Annual impact evaluations will provide EfficiencyOne, stakeholders, and the NSUARB with up-to-date impacts on net electrical energy and net system-peak demand savings as progress indicators towards the overall approved 2...

AI summary Annual impact evaluations by EfficiencyOne and NSUARB track progress toward DSM Resource Plan targets. Full evaluations are required for new or changed programs, while stable programs use condensed reports. Process evaluations follow past DSM criteria, focusing on newly created, changed, or underperforming components.

8. REPORTING EfficiencyOne proposes to report on the implementation of the 2020-2022 DSM Resource Plan through Quarterly Reports and Annual Progress Reports (APR) and other reporting requirements as outlined in the Standardized Filing Fram...

AI summary EfficiencyOne plans to report on the 2020-2022 DSM Resource Plan implementation through Quarterly Reports and Annual Progress Reports (APR), adhering to the Standardized Filing Framework's requirements.

Annual Progress Reports - In the first quarter of each calendar year, EfficiencyOne will file an APR with the NSUARB, which will include the following information: - a summary of the context, activities and milestones achieved in the prior...

AI summary EfficiencyOne must file Annual Progress Reports (APR) with the NSUARB, detailing prior-year activities, discrepancies, and program performance. Corrective Action Plans are required if results fall below 75% of forecasts. The NSUARB approved a Standardized Filing Framework for DSM Supply Agreements (M07543) under the 2016-2018 DSM Resource Plan Consensus Agreement.

1 terminating an existing Program; • 2 increasing the 3-year plan budget for the total Residential sector by more than 25 • 3 percent; 4 decreasing the 3-year plan budget for the total Residential sector by more than • 5 25 percent; 6 incr...

AI summary The text outlines proposed changes to the 3-year plan budget and savings targets for the Residential and BNI sectors, as well as the requirement for EfficiencyOne to submit quarterly reports to the NSUARB. It also describes the process for making mid-course adjustments to the DSM Resource Plan.

9. EFFICIENCYONE'S COVENANTS - 9.1 EfficiencyOne warrants, covenants and agrees with NSPI that: - (a) it has all requisite capacity and authority to execute, deliver and perform its obligations under this Agreement; - (b) this Agreement ha...

AI summary EfficiencyOne's covenants with NSPI include legal enforceability, compliance with laws, subcontractor management, and program delivery obligations. EfficiencyOne must ensure EECA compliance, obtain permits, and notify NSPI and UARB of supply disruptions. Subcontractors require NSPI approval, and EfficiencyOne remains liable for their actions.

19. DISPUTE RESOLUTION - 19.1 In the event of a dispute in connection with this Agreement, a senior representative of EfficiencyOne and a senior representative of NSPI shall promptly meet to discuss and resolve the dispute and the Parties...

AI summary The dispute resolution process requires EfficiencyOne and NSPI to meet promptly to resolve disputes within 30 days (or 10 days for urgent matters). If unresolved, disputes are referred to the UARB under Section 79P of the Act. EfficiencyOne must continue EECA implementation unless authorized by the UARB to suspend it.

25. COORDINATION MEETINGS AND REPORTS - 25.1 During the Term of this Agreement, EfficiencyOne shall prepare and deliver to the UARB and NSPI a quarterly report (the " Quarterly Report ") in a form acceptable to the UARB. - 25.2 EfficiencyO...

AI summary EfficiencyOne is required to submit quarterly and annual reports to the UARB and NSPI, detailing EECA progress, financials, and evaluations. Coordination meetings between EfficiencyOne, NSPI, and UARB are mandated quarterly to ensure effective EECA implementation.

50 51 SCHEDULE C 79 i. Cumulative annual net energy savings at generator 80 ii. Cumulative annual net peak demand savings at generator 81 iii. Lifetime Energy Savings 82 83 c) Performance Indicators (for UARB reporting) consist of: 84 i.An...

AI summary This document outlines the Performance Indicators required for UARB reporting, including energy and demand savings metrics, customer satisfaction, ratepayer benefits, and low-income program participation. EfficiencyOne is responsible for conducting and filing a historical rate and bill impact analysis annually.

IT IS HEREBY ORDERED that: 1. The Board approves a DSM Plan for 2020-2022 in the aggregate amount of $110 million with a target of total cumulative energy savings of 367.8 GWh and demand savings of 98.3 MW. Approved spending is $34.4 milli...

AI summary The Board approves a DSM Plan for 2020-2022 with a total budget of $110 million and sets specific spending targets for each year. The Supply Agreement between E1 and NS Power is approved, and E1 is directed to file terms of reference for an investigation into cost overestimation. The HST refund is to be returned to customers through the FAM, and records related to the HomeWarming Program must be segregated from ratepayer funds.

APPENDIX "A" - 1. EfficiencyOne (El) and Heritage Gas (HG) will engage in a collaborative study/review, at the cost of E1, of the program design and operation of the Custom Incentive Program related to VRF electric heat pump measures in Mu...

AI summary EfficiencyOne (E1) and Heritage Gas (HG) agree to collaborate on a study of the Custom Incentive Program for VRF electric heat pumps in Multi Unit Residential Buildings (MURBs) where natural gas is available. The study includes timelines, restrictions on new financial commitments by E1 during the study period, and a process for incorporating findings or referring disputes to the Nova Scotia Utility and Review Board (NSUARB).

Agreement between EfficiencyOne and Heritage Gas Dunsky's study aimed to determine how E1's baseline energy building model should be determined for new construction MURBs where natural gas is available. Dunsky found that the current baseli...

AI summary Dunsky's study identified flaws in EfficiencyOne's baseline energy model for new construction MURBs with natural gas availability, recommending modifications to the VRF baseline definition. EfficiencyOne and Heritage Gas agreed to implement these changes in the Custom Incentives Program, pending Board review of the Dunsky report.

VRF Program Review Prepared for: Efficiency One & Heritage Gas

AI summary The VRF Program Review is being conducted for Efficiency One and Heritage Gas, assessing the effectiveness of the Variable Refrigerant Flow program in Nova Scotia, with potential references to energy efficiency standards and building codes.

Context Efficiency One (E1) and Heritage Gas have agreed to engage in a collaborative study of the program design and operation of E1's Custom Incentive Program related to VRF electric heat pump measures in multi unit residential buildings...

AI summary Efficiency One (E1) and Heritage Gas are collaborating on a study of E1's Custom Incentive Program for VRF electric heat pumps in Multi-Unit Residential Buildings (MURBs) where natural gas is available. VRF systems use refrigerant for heat transfer, enabling simultaneous heating and cooling in different zones.

2.2.2 – Prescriptive Programs Some jurisdictions offer prescriptive programs for VRF heat pumps. These programs are mainly targeted at, but not limited to, retrofit projects. Prescriptive programs usually use a Technical Reference Manual (...

AI summary Prescriptive programs for VRF heat pumps use Technical Reference Manuals (TRMs) to calculate energy savings, relying on ASHRAE 90.1 baseline standards and simplified equations with nominal capacities and efficiency metrics like IEER. These programs target retrofit projects and use pre-defined performance levels for proposed equipment.

KPMG Approach and Work Plan To complete the study, KPMG will: - Obtain an understanding of the existing end-to-end DSM planning and implementation process at EfficiencyOne and document the current state by: - Conducting interviews with key...

AI summary KPMG will analyze EfficiencyOne's DSM planning processes through interviews, document reviews, and process walkthroughs. The study aims to assess current practices, identify improvements, and deliver a final report to NSUARB by March 31, 2020, detailing process flows, findings, and recommendations.

iled no later than November 4, 2019. The Small Business Advocate was the only stakeholder filing comments in response to the VRF Program Review report, indicating it had no concerns with the findings. EfficiencyOne has no reply comments. E...

AI summary The Small Business Advocate submitted comments with no concerns regarding the VRF Program Review report. EfficiencyOne requested approval of their agreement with Heritage Gas, citing their October 15, 2019 filing. The Breton Law Group submitted the document, with six hard copies filed. No other stakeholders provided reply comments.

22 19. DISPUTE RESOLUTION - 23 19.1 In the event of a dispute in connection with this Agreement, a senior representative of EfficiencyOne and a senior representative of NSPI shall promptly meet to discuss and resolve the dispute and the Pa...

AI summary The dispute resolution process requires EfficiencyOne and NSPI to meet promptly to resolve disputes within 30 days (or 10 days for urgent matters). If unresolved, disputes are referred to the UARB under Section 79P of the Act. EfficiencyOne must continue EECA implementation unless prohibited by the UARB.

e's financial statement for the previous year with 36 respect to the EECA, evaluation reports and a summary of planned versus actual 37 savings and costs for each metric.

AI summary The text references financial statements, evaluation reports, and summaries comparing planned versus actual savings and costs for EECA metrics. It emphasizes documentation requirements for EECA activities, including performance evaluations and financial accountability.

On the First Business Day of: 2020 2021 2022 January 2,261,535 3,050,000 3,250,000 February 2,261,535 3,050,000 3,250,000 March 2,261,535 3,050,000 3,250,000 April 2,261,535 3,050,000 3,250,000 May 2,261,535 3,050,000 3,250,000 June 2,261,...

AI summary The document outlines performance requirements and targets set by the UARB for EfficiencyOne over a three-year contract period. It specifies that compliance is determined based on cumulative annual net energy and peak demand savings at the generator level, with a 90% achievement threshold. If this threshold is not met, a regulatory process is triggered. The document also details performance indicators, including energy savings, customer satisfaction, and rate impacts.

Table 5: 2022 DSM Resource Plan Investment and Savings 2022 Investment (S million) Lifetime Beachts (S million) First-Year Energy Savings (GWb) Lifetime Energy Savings (GWh) Peak Demand Savings (MW) Total Resource Cost Test (TRC) h Program...

AI summary Table 5 outlines the 2022 DSM Resource Plan investment and savings, including details on efficient product rebates, with figures on investment, energy savings, and cost-benefit ratios.

4. RESIDENTIAL PROGRAMS AND SERVICES The DSM Resource Plan will all The DSM Resource Plan will allow EfficiencyOne to continue delivering cost-effective energy savings benefits for Nova Scotia's residential customers. The DSM Resource Plan...

AI summary The DSM Resource Plan enables EfficiencyOne to deliver cost-effective residential energy savings in Nova Scotia by focusing on non-lighting measures and leveraging customer data. It highlights increased customer interest in reducing energy use, with 87% of Nova Scotians prioritizing energy reduction in 2018. The plan evolves programs to address market saturation and promote complex, high-impact energy efficiency projects.

Program Delivery The Residential Efficient Product Rebates program uses both a self-serve and turn-key delivery approach to help residential customers make smart energy choices through the retirement and/or replacement of inefficient appli...

AI summary Nova Scotia Power (NSP) employs multiple delivery models for its energy efficiency programs. The Residential Efficient Product Rebates program uses self-serve and turn-key approaches. The Appliance Retirement program utilizes delivery agents for appliance management, while the Instant Savings program engages delivery agents to recruit retailers and provide training on energy-efficient products.

4.1.8 Low-Income Performance Indicators Low-Income performance indicators for the Residential Efficient Product Rebates program are provided in Table 8 below.

AI summary The section outlines Low-Income performance indicators for the Residential Efficient Product Rebates program, referencing Table 8 for detailed metrics. No specific data or claims are presented in the provided text.

17 Demand Response Measures 18 Demand response initiatives will be introduced as part of the broader DSM p01tfolio in 19 the DSM Resource Plan. EfficiencyOne and NS Power will be workjng closely on the 20 development, assessment and evalua...

AI summary Demand response initiatives will be integrated into Nova Scotia Power's DSM portfolio, with EfficiencyOne and NS Power collaborating on development and evaluation. These measures expand on a 2019 demand reduction pilot, including ETS units and electric storage hot water heater timers under the Green Heat and Home Energy Assessment program.

4.2.8 Low-Income Performance Indicators 19 20 21 Low-income performance indicators for the Existing Residential program are provided in Table 10 below. 22 23 24

AI summary The document section '4.2.8 Low-Income Performance Indicators' references Table 10, which provides low-income performance indicators for the Existing Residential program. The text highlights metrics related to low-income households under Nova Scotia's electricity efficiency initiatives.

20 Quality Assua·auce 21 The New Residential program has an established quality assmance framework, which 22 includes random and targeted site visits, model file review and rebuild, and customer 23 surveys. 24

AI summary The New Residential program employs a quality assurance framework involving random and targeted site visits, model file reviews, rebuilds, and customer surveys to ensure compliance and effectiveness.

5. BUSINESS, NON-PROF1T AND INSTITUTIONAL PROGRAMS AND SERVICES 2 3 4 The DSM Resource Plan maintains a focus on delivering energy savings benefits to Nova Scotia business customers through a variety of effective programs. Over the 2016-20...

AI summary The DSM Resource Plan focuses on expanding energy savings for Nova Scotia businesses through non-lighting upgrades, overcoming barriers like cost and complexity. It emphasizes increased program accessibility, broader benefits (e.g., system-peak demand reduction), and shifts away from lighting incentives. EfficiencyOne aims to leverage distributor engagement to enhance participation.

5.1.8 Low-Income Performance Indicators 25 26 27 Low-income performance indicators for the BNI Efficient Product Rebate program are 28 provided in Table 14 below. Mark

AI summary The section discusses low-income performance indicators for the BNI Efficient Product Rebate program, referencing Table 14 for detailed data. The focus is on measuring program effectiveness for low-income participants.

5.2.1 Overview The Custom Incentives program provides financial incentives and technical assistance to help non-profit, institutional, commercial and industrial customers reduce their electrical energy consumption and system-peak demand. S...

AI summary The Custom Incentives program offers financial and technical support to non-profit, institutional, commercial, and industrial customers to reduce energy consumption and peak demand. It includes three components: Custom, Energy Management Information Systems (EMIS), and Strategic Energy Management (SEM), targeting projects not covered by other programs.

3 Pt·ogram Delive1J' 4 The Custom Incentives program structure is designed to overcome customer barriers 5 associated with large upfront costs, Jack of in-house capacity and business case 6 requirements. The program is delivered through a...

AI summary The Custom Incentives program aims to address customer barriers through a combination of EfficiencyOne staff, contractors, and third-party resources, including engineering firms and HVAC automation companies, to implement energy-saving initiatives.

5.2.8 Low-Income Performance Indicators 2 1 Low-Income performance indicators for the Custom Incentives program are provided in Table 16 below. 5

AI summary The section outlines Low-Income Performance Indicators for the Custom Incentives program, referencing Table 16. It provides quantitative metrics but lacks detailed analysis or stakeholder positions.

5.3.1 Overview The Direct Installation program (marketed as Small Business Energy Solutions 'SBES') provides small business customers access to technical assistance and financial incentives for the installation of energy efficient and syst...

AI summary The Direct Installation program (Small Business Energy Solutions) offers small businesses technical assistance and financial incentives for energy-efficient upgrades. It includes self-directed and facilitated pathways, with support from Efficiency Trade Network (ETN). The program aims to increase awareness of energy efficiency, aid business profitability, and remove adoption barriers. Demand Response initiatives are part of the broader Demand Side Management (DSM) portfolio.

19 Program History 20 The Direct Installation program began in 2008 in Dartmouth and Pictou County with 21 incentives available for energy efficient lighting upgrades. A recycling 'component was 22 incorporated into this program in 2009. I...

AI summary The Direct Installation program, launched in 2008, expanded to include non-lighting measures and participant-selected contractors in 2015. The Efficiency Trade Network was introduced to connect participants with qualified contractors. The Affordable Multi-Family Housing pilot (2016) faced low participation, prompting adjustments like higher incentives and project management support. The DSM Resource Plan now includes a component for low-income renters.

5.3.5 Program Design

AI summary The section '5.3.5 Program Design' outlines considerations for designing energy efficiency programs in Nova Scotia. However, no specific content or details are provided in the given text.

24 Marketing Strategy 1 specifically for the small business vertical, refining messaging around non-energy 2 benefits, and collaborating closely with the Efficiency Trade Network to reach markets 3 and deliver messaging effectively. Specif...

AI summary The document outlines marketing strategies for small businesses, focusing on non-energy benefits and collaboration with the Efficiency Trade Network. It also discusses quality assurance measures and performance indicators for the Direct Installation program.

5.3.8 Low-Income Performance Indicators Low-income performance indicators for the Direct Installation program are provided in Table 18 below. 18 19 1 2 14 15 16 17

AI summary The text references low-income performance indicators for the Direct Installation program, citing Table 18. However, no specific data or analysis is provided in the excerpt, as the table content is not included.

13 Corpomte Research Associates. Au/umn2018 Atlantic Qum·terly 14 !bid 1 efficiency information and support with more Nova Scotians. 3 strategic electrification, demand Tesponse, energ)' storage, and other forms of DSM. 4 5 6.3.3 Regulator...

AI summary The text outlines Regulatory Affairs activities for 2020-2022, including the development and negotiation of the 2023-2025 DSM Resource Plan, investigation into budget and energy savings discrepancies, and the submission of various reports to the DSMAG and NSUARB, such as quarterly, evaluation, annual progress, and financial statements.

1 7. EVALUATION 2 3 EfficiencyOne proposes to take a similar approach to evah1ation in 2020-2022 as in 4 2016-2019, where evaluation activities are conducted to ensme accurate determination 5 of net electrical energy and net system-peak de...

AI summary EfficiencyOne proposes a 2020-2022 evaluation approach similar to 2016-2019, focusing on net electrical energy and system-peak demand savings. Activities will be condensed for mature programs, with annual impact evaluations for each program over three years and modified reporting structures to ensure accurate savings determination and continuous improvement.

1 design and conduct a full scope of evaluation activities for program components that 2 require a full impact evaluation. 3 4 7.2 Process and Market Evaluations 5 6 Program process and market evaluations will remain consistent with what h...

AI summary The document outlines the process for conducting program process and market evaluations, emphasizing consistency with the 2016-2018 DSM Resource Plan and specifying criteria for evaluating program components, such as newly created programs, major changes, and energy savings variances.

7 8.1 Annual Progress Reports 8 - 9 In the first quarter of each calendar year, EfficiencyOne will file an APR with the I o NSUARB, which will include the following information: - a summary of the context, activities and tnHestones achieve...

AI summary EfficiencyOne must file Annual Progress Reports (APR) with the NSUARB, detailing prior-year performance, discrepancies, and energy savings. Corrective Action Plans are required if results fall below 75% of forecasts. The text references a Consensus Agreement and Standardized Filing Framework approved by NSUARB (M07543).

1 adding a new Program; 2 terminating an existing Program; 3 increasing the 3-year plan budget for the total Residential sector by more than 25 4 percent; 5 decreasing the 3-year plan budget for the total Residential sector by more than 6...

AI summary The document outlines proposed changes to energy efficiency programs, including adding or terminating programs, adjusting budget and savings targets for residential and BNI sectors, and the requirement for quarterly reporting to the NSUARB. It also discusses mid-course adjustments to the DSM Resource Plan based on market conditions and evaluations.

Sm Pedormance Tal'gets consist of: 2 3 1. Cumulative annual energy savings; 4 ii. Cumulative annual system-peak demand savings; and 5 6 Performance Indicators consist of: 7 8 i. Annual incremental energy savings (reported by program and ra...

AI summary This text outlines performance targets and indicators for energy efficiency programs, including annual and cumulative energy and demand savings, ratepayer benefits, spending, customer satisfaction, and low-income participation reporting. These metrics are to be reported by program and rate class, with specific emphasis on EfficiencyOne's rate and bill impact analysis.

EfficiencyOne Performance Alignment Study FILED April 21, 2020

AI summary Nova Scotia Power Inc. (NS Power) filed a study on April 21, 2020, to align EfficiencyOne's performance with regulatory requirements. The study evaluates program design, cost-effectiveness, and compliance with Nova Scotia's energy efficiency regulations, aiming to ensure initiatives meet efficiency targets and undergo proper evaluation.

Focus of Study As part of this study, we answered the following questions posed by the NSUARB: - 1. Whether there is an upward bias in EfficiencyOne's estimate of resource costs; - 2. What are the factors that led to a historic overestimat...

AI summary The study addresses three NSUARB questions regarding EfficiencyOne's resource cost estimates, historic overestimation factors, and current operating environment. It focuses on how EfficiencyOne developed these estimates, using previous submissions and interviews with Efficiency Vermont and Maine.

Factors of overestimation – Result of management decision EfficiencyOne overestimated customer participation in Custom . Custom Retrofit, as a program component, is the highest cost program offered by EfficiencyOne. The 2016-2018 planned b...

AI summary EfficiencyOne overestimated customer participation in the Custom Retrofit program, leading to lower-than-planned costs. The 2015 Continuation Plan relied on historical data adjusted for future expectations rather than detailed measure-level modeling, which may reduce accuracy. NSUARB is involved in the regulatory review of these cost estimation methods.

2. What are the factors that led to a historic overestimation? To address this question, KPMG worked with EfficiencyOne to understand the variances of actual to DSM Resource Plan costs and energy savings in 2015 and 2016-2018. Once calcula...

AI summary KPMG and EfficiencyOne analyzed variances between actual and projected DSM Resource Plan costs and energy savings for 2015 and 2016-2018, identifying factors causing overestimation. Analysis was conducted at the program component level, with no data available for 2019.

3. Whether the factors that led to the overestimation continue to be present in EfficiencyOne's current operating environment KPMG worked with EfficiencyOne to assess whether the factors that resulted in variances in the past, as identifie...

AI summary KPMG assesses whether past factors causing variances in EfficiencyOne's DSM planning remain present, noting EfficiencyOne's improved maturity since 2015. The NSUARB focused on post-2015 plans, while context is provided for the 2013-2015 ENSC Plan. A jurisdictional review of Efficiency Vermont and Efficiency Maine Trust informs the analysis.

hanism by which NSPI collected funds to support DSM activities from ratepayers. This was applied to most ratepayers in Nova Scotia. This 4 2018 Annual Report 5 Nova Scotia 2015-2040 Demand Side Management (DSM) Potential Study mechanism ce...

AI summary The document discusses the funding mechanism used by NSPI to support DSM activities, which was replaced by EfficiencyOne and the Efficiency Nova Scotia franchise.

EfficiencyOne Performance Alignment Study April 21, 2020 - Not-for-profit, or Non-profit "Non-profit organization is a club, society, or association that is not a charity and that is organized and operated solely for social welfare, civic...

AI summary The document outlines EfficiencyOne's operational framework, including its annual operating budget aligned with NSUARB-approved DSM investment. It defines non-profit organizations, programs, and program components as part of EfficiencyOne's energy efficiency and conservation initiatives.

EfficiencyOne DSM Resource Plans ENSC (EfficiencyOne after January 1, 2015) filed the 2015 DSM Resource Plan on May 14, 2014. This Plan was a one-year Plan designed as a Continuation Plan. The NSUARB approved an investment of $38.98 millio...

AI summary EfficiencyOne submitted multiple DSM Resource Plans to the NSUARB over several years, with each plan requiring regulatory approval. The NSUARB adjusted investment amounts and energy savings targets based on regulatory proceedings, including the application of balance adjustments and compliance filings.

Implementation of DSM Resource Plans Within the Plan Application that is filed with the NSUARB, EfficiencyOne also includes language regarding the implementation of the Plan. The Plan is described in these filings not as an implementation...

AI summary EfficiencyOne's DSM Resource Plan is a planning tool, not an implementation plan, allowing adjustments based on market changes and evaluations. The NSUARB approves performance targets and funding, requiring advance notice for significant changes. Quarterly reports track progress and mid-course adjustments within approved energy savings and investment levels.

o the type and nature of the resource cost. The depth of support will also be influenced by factors such as the significance of the cost and the availability and quality of the supporting information. In our review, we noted that Efficienc...

AI summary The review highlights concerns about EfficiencyOne's reliance on historical data for cost estimates, lack of supporting documentation for updates, and inconsistent documentation practices. It notes increased management involvement in recent years but criticizes insufficient rationale for adjustments to historical data used in 2020-2020 estimates.

Estimation of Admin Costs Admin costs comprise all other costs remaining after the incentive costs have been removed. EfficiencyOne uses its Cost Allocation Model (CAM), which is audited, and the energy savings as evaluated by a third-part...

AI summary EfficiencyOne uses its audited Cost Allocation Model (CAM) and third-party energy savings evaluations to calculate admin cost rates for 2016-2018 and 2020-2022 plans. Historic costs (excluding direct incentives) were included in calculations, with samples aligning with third-party reports and minor exceptions in input table flows.

Overestimation in 2015 and 2016-2018 EfficiencyOne had an overestimation of costs in 2015 and 2016-2018 that resulted in the following total underspend: - − 2015 Plan to Actual Underspend of approximately $4.66 million or 12% of total budg...

AI summary EfficiencyOne overestimated costs in 2015 and 2016-2018, leading to underspends of $4.66M (12%) and $6.99M (7%) respectively. Factors contributing to the overestimation are discussed in response to Question 2.

4.1 Approach to responding to NSUARB Question 2 To respond to NSUARB Question 2, we conducted a variance analysis of costs and energy savings for 2015 and 2016-2018. We worked with EfficiencyOne to understand and document the reason for th...

AI summary The response to NSUARB Question 2 involved a variance analysis of 2015 and 2016-2018 DSM program costs and savings, identifying overestimation factors. EfficiencyOne relied on third-party modellers and faced jurisdictional comparability challenges, leading to limited Canadian benchmarks. NSUARB mandated cost reductions, and underspending declined over time, influenced by FOFI assumptions and market variations.

Factors of overestimation – Result of management decision EfficiencyOne overestimated customer participation in Custom . Custom Retrofit, as a program component, is the highest cost program offered by EfficiencyOne. The 2016-2018 planned b...

AI summary EfficiencyOne overestimated customer participation in the Custom Retrofit program, leading to lower-than-planned costs. The 2015 Continuation Plan relied on historical data adjusted for future expectations rather than detailed measure-level modeling, which may reduce accuracy. NSUARB is involved in the regulatory review of these cost estimation methods.

4.3 Variance analysis for 2015 and 2016-2018 For the purposes of tracking progress against DSM Resource Plans, EfficiencyOne does not have an automated mechanism to comparatively track actuals against Plan at the measure level. It is a 11...

AI summary EfficiencyOne lacks an automated mechanism to track progress against DSM Resource Plans due to differing detail levels between plans and tracking systems. Variance analysis was conducted at the program component level, focusing on units rebated/installed and lighting installation progress.

4.3.2.3 2016-2018 incentive cost and energy savings variance analysis We used the following reports to prepare the 2016-2018 incentive cost and energy savings variance analysis at the program component level: April 21, 2020

AI summary The 2016-2018 incentive cost and energy savings variance analysis was prepared using program-level reports. The analysis focuses on cost and savings variances but does not provide specific findings due to reliance on referenced reports and a lack of detailed data in the text.

Public Reports - 2016-2018 DSM Quarterly and Annual Progress Reports - 2016-2018 DSM Evaluation Reports

AI summary The document lists 2016-2018 DSM Quarterly and Annual Progress Reports, along with Evaluation Reports, as part of the Public Reports section. These reports likely assess DSM program performance and outcomes under Nova Scotia's regulatory framework.

Internal Reports Prepared by EfficiencyOne - EfficiencyOne Summary of 2016-2018 Approved and Actual Spending: This report, prepared by EfficiencyOne, provides a planned-to-actual spending variance analysis for several of the largest progra...

AI summary EfficiencyOne's internal reports from 2016-2018 analyze spending variances, rebate units, and LED lighting energy savings. The analysis uses actual vs. planned data but notes that no validation procedures were applied to the reports' outputs.

2016-2018 energy savings variance analysis The following table outlines variances between the DSM Resource Plan and the actual energy savings realized, by year. Of EfficiencyOne's 11 programs, eight of these did not achieve their respectiv...

AI summary The 2016-2018 energy savings variance analysis shows that eight of EfficiencyOne's 11 programs did not meet their energy saving targets. However, overall targets were exceeded by 13.08 GWh due to the Instant Savings and Efficient Product Rebates programs. The analysis identifies factors contributing to variances greater than 10 GWh in some program components.

Instant Savings Over a three-year period, the Instant Savings program surpassed its energy savings target by 51.19 GWh, surpassing target each year. Energy savings were driven by higher-than-planned program customer participation. As descr...

AI summary The Instant Savings program exceeded its energy savings target by 51.19 GWh over three years, driven by high customer participation in LED lighting. Despite lower per-unit energy savings, lighting measures contributed 91% of total savings, surpassing the planned 42%.

Residential Direct Install (RDI) During 2017, the Residential Direct Install and Rental Properties and Condos programs were merged into the Efficient Product Install (EPI) program. Over a three-year period RDI failed to meet its energy sav...

AI summary In 2017, the RDI and Rental Properties and Condos programs merged into EPI. Over three years, RDI missed energy savings targets by 14.53 GWh, and the Rental Properties and Condos program missed by 6.65 GWh. Despite higher rebate units, the mix of installations favored LED lighting, which has lower energy savings per unit compared to other measures like Embertec power bars.

Home Energy Assessments Over a three-year period, the Home Energy Assessment program failed to meet targeted energy savings by 14.83 GWh, falling below expectations each year. Lower-than-expected customer participation was the key reason f...

AI summary The Home Energy Assessment program (HEA) under EfficiencyOne failed to meet energy savings targets by 14.83 GWh over three years due to lower-than-expected customer participation, resulting in only 2,615 assessments completed instead of the expected 7,706.

Custom Incentives Custom Incentives failed to meet energy saving targets by 39.56 GWh in 2016-2018, falling below target each year. This underachievement is primarily due to lower customer participation than expected in the program. As des...

AI summary Custom Incentives failed to meet energy saving targets by 39.56 GWh in 2016-2018 due to lower customer participation than expected, leading to underachievement of energy savings.

Factors of overestimation – Inherent in the environment The success of programs and program components is dependent on market uptake . Variances between Plan estimates and actual performance may occur, since customer participation in Effic...

AI summary The success of EfficiencyOne program components depends on market uptake, leading to variances between estimated and actual performance. Customer choices among measures with varying costs and energy savings impact the realized measure mix.

Factors of overestimation – Inherent in the regulatory environment as defined by external factors The length of time between the development and implementation of the DSM Resource Plans . DSM Resource Plans and modelling inputs are develop...

AI summary The regulatory environment for Demand Side Management (DSM) plans in Nova Scotia involves a long development-to-implementation timeline, leading to potential overestimations due to changing external factors. EfficiencyOne adjusts plans mid-course based on evaluations, but current reporting may not fully address variances between planned and actual outcomes.

- 2. Quarterly progress reports We understand that EfficiencyOne submits a quarterly progress report to the NSUARB that outlines actual quarterly and year-to-date results for budget and energy savings. Currently, EfficiencyOne includes a t...

AI summary EfficiencyOne submits quarterly and annual progress reports to the NSUARB, but lacks detailed forecast data on energy savings and spending. Enhancements are recommended to provide more insight into trends, re-forecasting, and overestimation. Efficiency Vermont and Efficiency Maine use different regulatory thresholds for underspend, while EfficiencyOne addresses underspend at the end of its three-year Plan.

− Efficiency Maine Trust : Efficiency Maine Trust is the administrator for DSM programs in Maine. The Trust is a quasi-state agency governed by a Board of Trustees with oversight from the Maine Public Utilities Commission. Efficiency Maine...

AI summary Efficiency Maine Trust administers DSM programs in Maine, developing three-year plans with in-house modeling and third-party input. They have funding reallocation flexibility, no penalties for unmet targets, and provide annual regulatory reports. Changes require regulator approval, with specific budget carry-forward rules outlined.

7.1 2013-2015 DSM Resource Plan The 2013-2015 DSM Resource Plan was filed by ENSC on February 27, 2012. The NSUARB approved the first two years of the 2013-2015 DSM Resource Plan (i.e. 2013 and 2014). ENSC would be required to file a subse...

AI summary The 2013-2015 DSM Resource Plan was filed by ENSC in 2012, with NSUARB approving 2013-2014. The 2015 plan became irrelevant due to the Electricity Efficiency and Conservation Restructuring (2014) Act , which mandated investment levels. The transition to Efficiency Nova Scotia's franchise affected the 2015 plan's implementation, distinct from earlier ENSC-led plans.

2013 Results The analysis of 2013 results is based primarily on a review of the 2015 DSM Resource Plan Application submitted to the NSUARB. The following table outlines a summary of the results against the Plan as filed for 2013. We noted...

AI summary The 2013 results analysis focuses on the 2015 DSM Resource Plan Application to NSUARB, noting no change in investment levels post-mid-course adjustment. Key data is summarized in a table referencing the 2013-2015 DSM Plan revised on April 18, 2012.

The scope of the study included: - Review of DSM planning process at EfficiencyOne including the key considerations used to inform the development of DSM Resource Plans (both projected costs and associated energy savings); - Identify where...

AI summary The study's scope includes reviewing EfficiencyOne's DSM planning process, identifying information sources for DSM Resource Plans, assessing implementation effectiveness, evaluating constraints, and monitoring DSM cost and energy savings performance throughout the plan's term.

In light of the objective and scope, the following is a summary of our engagement approach: We started this engagement with a project kick-off meeting to reaffirm the objective of the engagement, obtain any relevant documents, and identify...

AI summary The engagement involved analyzing EfficiencyOne's DSM planning and implementation processes from 2013 to 2022 through interviews, document reviews, and process validation. The study aimed to assess current practices, identify improvements, and evaluate cost/energy saving models, focusing on planning methodologies and performance metrics.

Overview of 2015 DSM Resource Plan 2015 was the transition year from Efficiency Nova Scotia Corporation to Efficiency Nova Scotia (ENS) Franchise; therefore, the 2015 DSM Resource Plan was designed as a Continuation Plan that did not take...

AI summary The 2015 DSM Resource Plan served as a continuation plan during the transition from Efficiency Nova Scotia Corporation to Efficiency Nova Scotia (ENS) Franchise. It operated under a $35 million legislative cap, plus a $4 million 2013 surplus, totaling $39 million. The plan relied on historical data and market research, continuing 2013–2014 activities without modeling.

2016-2018 admin costs – model input approach by EfficiencyOne As identified by EfficiencyOne, admin costs are all other remaining costs after the incentive costs have been excluded. EfficiencyOne used the most recent audited full year of t...

AI summary EfficiencyOne calculated administrative costs for 2016-2018 by subtracting incentive costs from the 2013 CAM outputs and using first-year energy savings to derive an admin cost rate per kWh. Adjustments were made for two programs to reflect upcoming changes, with the model input approach based on NSUARB program-level data.

EfficiencyOne Performance Alignment Study April 21, 2020 - A list of new demand savings measures had been introduced and included in the Plan. Such measures do not produce energy savings but rather reduce the demand for electricity at syst...

AI summary The EfficiencyOne Performance Alignment Study discusses new demand savings measures reducing peak electricity demand, with admin costs allocated using average rates per measure unit. EfficiencyOne adjusted 2017 admin costs by adding new initiative costs and dividing by updated energy savings estimates to determine admin cost rates per kWh.

. The revised terms will focus on a collaborative and facilitated process with representation of the UARB, intended to keep stakeholders engaged on key DSM issues and development of future DSM Plans. - a. Development of a calendar and fram...

AI summary The revised terms aim to enhance stakeholder engagement in DSM planning through a collaborative process with the UARB, including updated avoided cost methodologies, stakeholder input timelines, joint filing formats, affordability criteria, and information sharing. The Terms of Reference introduce an 18-month rolling calendar and technical conferences to streamline information flow, as supported by EfficiencyOne.

Deliverables: To achieve this objective, the DSMAG shall complete the following tasks and deliverables: - Establish a framework that will facilitate future DSM Plan development by: - o Adopting a recommended format for joint filing of DSM...

AI summary The DSMAG is tasked with establishing a framework for DSM Plan development, including updating avoided costs, evaluating reports, setting affordability criteria under the PUA, and managing timelines. E1 must maintain an 18-month calendar for DSMAG activities. Stakeholders may present positions without prejudice, aiming to resolve issues pre-regulatory proceedings.