Topic:"Program Evaluation" in M06733

to the DSM Advisory Group on the implementation of recommendations of the Econoler and Peach reports with the Board (updates, as of February 2015, are included as Appendix C within this Application). • Ensured that the internal audit under...

AI summary The document outlines actions taken by ENS and ENSC in accordance with the September 8, 2014 Order, including internal audit reviews, quarterly reporting to the UARB, and submission of rate and bill impact analysis reports. It also mentions updates related to the DSM Advisory Group and implementation of recommendations from the Econoler and Peach reports.

2.2 2014 DSM Programs ENSC exceeded target in 2014, achieving 151.9 GWh of energy savings compared to the UARB-approved target of 137.8 GWh. These savings include results from both the Residential and Business, Non-profit, and Institutiona...

AI summary ENSC exceeded 2014 DSM energy savings targets by 14.1 GWh, driven by the Home Energy Report program. Customer satisfaction remained stable at 91.2, and results aligned with the UARB-approved 137.8 GWh target. The NSUARB (2012) DSM Settlement Agreement is referenced.

Existing Residential The Existing Residential program, comprised of the Residential Direct Install, Rental Properties and Condos, Home Energy Assessment, Green Heat, Residential Solar components, and Low Income Homeowner services, achieved...

AI summary The Existing Residential program exceeded its 2014 energy savings target (37.0 GWh vs. 34.2 GWh), with ENSC agreeing to separately report low-income program results under the 2015 DSM Settlement Agreement. The RDI component increased installations by switching from CFLs to LEDs, reducing free ridership and boosting participation.

Low Income Homeowner Service The Low Income Homeowner Service obtained energy savings of 2.3 GWh in 2014, an increase compared to the 1.7 GWh achieved in 2013. ENSC completed upgrades in 961 homes compared to the 739 homes in 2013. ENSC st...

AI summary The Low Income Homeowner Service achieved 2.3 GWh energy savings in 2014, up from 1.7 GWh in 2013, with ENSC upgrading 961 homes. The program prepared for transitioning to the Clean Foundation by January 1, 2015, requiring joint planning between ENSC and the Clean Foundation.

New Residential The New Residential program achieved energy savings of 4.6 GWh compared to its target of 5.9 GWh. The new housing sector experienced low levels of activity in 2014, with housing starts down 21 percent and completions down 2...

AI summary The New Residential program achieved 4.6 GWh in energy savings, missing its 5.9 GWh target. Low 2014 housing activity, with 21% fewer starts and 29% fewer completions than 2013, and a high number of unsold homes, hindered savings. However, the average EnerGuide rating improved, with 14 homes reaching 90+ in 2014, up from 6 in 2013.

Energy Savings Actions The 2014 Home Energy Report (HER) program achieved 25.4 GWh of energy savings compared to its target of 15.4 GWh. HER is the first behaviour-based program ENSC delivered; therefore, energy savings tracking and target...

AI summary The 2014 Home Energy Report (HER) program exceeded its energy savings target by 65%, achieving 25.4 GWh. ENSC's HER program, which provides personalized energy reports and web-based tools, saw high engagement with 84% of recipients reading reports and 15,880 unique web visits. Partnerships with Air Miles boosted Web-For-All registrations by 3,500 accounts in 2014.

Efficient Product Rebates The Efficient Product Rebates (BNI) program, marketed as the Business Energy Rebates (BER) service, includes both mail-in and point-of-purchase incentives. The service achieved total energy savings of 24.6 GWh in...

AI summary The Efficient Product Rebates (BNI) program, marketed as Business Energy Rebates (BER), achieved 24.6 GWh energy savings in 2014 (below its 27.0 GWh target). Mail-in rebates contributed 11.1 GWh, while Instant Rebates provided 13.5 GWh. Custom Incentive lighting projects were transferred to BER in 2014 to enhance service delivery and cost-effectiveness by standardizing processes for retrofits.

Custom Incentives The Custom Incentives program consists of the Custom Retrofit, Custom New Construction, Custom Existing Building Commissioning, and Energy Management Information Systems (EMIS) program components. Overall, Custom achieved...

AI summary The Custom Incentives program, including Retrofit, New Construction, and Commissioning components, achieved 33.6 GWh in 2014, exceeding its 23.9 GWh target. Custom Retrofit led savings with 20.3 GWh, while new initiatives like compressed air retrofits and SEM pilot (60% complete) were introduced. EMIS and Custom Existing Building Commissioning also contributed significantly through low-cost measures and energy management systems.

Direct Installation The Direct Installation program, consisting of the Business Energy Solutions (BES) and the Rental Properties and Condos (RP&C) Common Areas services, accounted for 13.2 GWh in energy savings compared to the 2014 target...

AI summary The Direct Installation program, including Business Energy Solutions (BES) and Rental Properties and Condos (RP&C), achieved 13.2 GWh in energy savings, slightly below the 2014 target of 14.0 GWh. 854 participants were involved, with 803 from BES and 51 from RP&C across 105 buildings. BES introduced linear LED T8 lamps, contributing 28% of lighting energy savings.

Development and Research ENSC's 2014 development and research activities focused on primary market research designed to guide strategic decision-making in a number of program areas including: - Impacts of product rebate levels on point-of-...

AI summary ENSC's 2014 development and research focused on market research to guide strategic decisions, including rebate impacts, incentive preferences, industry energy savings, residential financing pilot evaluation, and website usability. Progress was made on a unified program database for enhanced reporting.

3.1 Summary The 2016-2018 DSM Resource Plan, as presented in Appendix A, is a three-year plan in accordance with the requirements of the Public Utilities Act. The Plan proposes a three- year energy savings target and a three-year system pe...

AI summary The 2016-2018 DSM Resource Plan aligns with the Public Utilities Act, setting energy and peak demand savings targets. ENS will adapt programs based on research, improve customer engagement, and implement Enabling Strategies like education, research, and market transformation initiatives to drive energy efficiency in Nova Scotia.

4.1.4 Cost Efficiency Opportunities The 2016-2018 DSM Resource Plan is cost effective, per legislative and UARB requirements for DSM. Results from Navigant's EL-RAM show that all programs are cost-effective in each year of the Plan, using...

AI summary The 2016-2018 DSM Resource Plan is deemed cost-effective using TRC and PAC tests. ENS aims to reduce unit costs through program adjustments like removing the Home Energy Report and reducing Enabling Strategies investment. Navigant's 2015 report is cited for affordability considerations.

4.2 Evaluation ENS proposes that its evaluation activities include an annual impact evaluation for each program in each of the three years, with some modification to the evaluation methodology and reporting structure, as outlined below. An...

AI summary ENS proposes annual impact evaluations for its programs from 2016-2018, shifting focus to organizational processes and reducing costs via condensed reports and rolling evaluations. This approach aims to track energy and demand savings progress toward DSM targets while maintaining third-party evaluations.

Consistent with the DSM Settlement Agreement for 2013-2014, approved by the UARB on June 4, 2012, ENS proposes to undertake the following regular reporting to the UARB 1 and DSM Advisory Group for the 2016-2018 DSM Resource Plan: 2 • Annua...

AI summary ENS proposes to submit regular reports to the UARB in accordance with the DSM Settlement Agreement for 2013-2014. These reports include an Annual Progress Report (APR), which will cover activities, performance indicators, cost and savings summaries, and corrective actions if energy savings targets are not met. ENS also plans to notify the UARB of significant changes to the DSM Resource Plan.

percent have restricted their Performance Targets to include the metrics of energy savings and peak demand savings. Jurisdictions also sometimes include a metric associated with costs or expenditures. ENS Performance Targets: ENS agrees wi...

AI summary ENS agrees with Dunsky's recommendation to align Performance Targets with Subsection 79A(b)(v) of The Public Utilities Act , focusing on cumulative energy and peak demand savings. ENS proposes annual Performance Indicators including Total Ratepayer Benefits, Total Spending, and Customer Satisfaction, but excludes Total Spending as a Performance Target due to inherent business risks.

5.1 Cost-Effectiveness Testing The Total Resource Cost (TRC) test has been the primary cost-effectiveness test for demand-side management in Nova Scotia since the commencement of DSM-related activities in the province. In the early years,...

AI summary Nova Scotia's DSM program shifted from measure-level TRC testing to program-level screening in 2011, allowing strategic measures with TRC ratios below one. ENS now seeks UARB approval to replace TRC with PAC as the primary cost-effectiveness test for future DSM plans, citing the 2012 plan and Dunsky analysis.

ming from. If customers in a particular rate class are willing to participate in ENS's programs, ENS should be able to allow those willing customers to contribute to its achievement of energy savings. If an individual rate class is close t...

AI summary The text discusses challenges faced by Efficiency Nova Scotia (ENS) in managing program participation across different rate classes. It highlights the difficulty in limiting participation in certain programs when forecasted investment is exceeded, particularly for programs like Efficient Product Rebates (BNI) and Green Heat. It also notes internal reporting delays and the challenges of meeting energy-savings targets at year-end.

1. INTRODUCTION The 2016-2018 DSM Resource Plan has been developed based on ENS's growing experience and history in delivering successful DSM programs and services to Nova Scotians. As part of the process, ENS engaged Navigant Consulting a...

AI summary The 2016-2018 DSM Resource Plan by Efficiency Nova Scotia (ENS) outlines energy efficiency programs, emphasizing flexibility for mid-course adjustments based on market conditions and evaluations. It balances affordability, avoids electrical system capacity additions, and includes residential, business, and enabling strategy programs. The Plan is for planning and cost-effectiveness testing, not direct implementation.

Figure 1.2 - 2016 DSM Resource Plan Investment and Savings 2016 Investment ($ million) Lifetime Benefits ($ million) a Incremental Annual Net Energy Savings at Generator (GWh) Incremental Annual Net Demand Savings at Generator (MW) Total R...

AI summary Figure 1.2 presents the 2016 DSM Resource Plan Investment and Savings, detailing the investment amounts, lifetime benefits, and energy and demand savings for various residential and business programs. It includes data on program administrator costs and total resource costs.

1.2 Programs and Services Overview 5 4 The 2016-2018 Residential and Business, Non-profit and Institutional (BNI) programs are expected to include ongoing gradual evolution in order to address the following objectives: 9 10 11 12 7 - Respo...

AI summary The 2016-2018 Residential and Business, Non-profit and Institutional (BNI) programs aim to evolve by addressing market changes, incorporating research, and maintaining access across sectors. ENS plans to enhance customer experience through 'Programs 2.0,' including a one-window approach, improved IT, and tailored incentives, with implementation expected by 2016.

2.4 Update on Energy Saving Actions Efficiency Nova Scotia's 2016-2018 DSM Resource Plan does not include a target or investment for Energy Saving Actions. ENS piloted the Home Energy Report in 2013, and it will continue until early 2016....

AI summary Efficiency Nova Scotia (ENS) discontinued the Home Energy Report pilot due to affordability concerns, opting for a lower DSM Plan level. ENS will continue exploring behavior-based energy efficiency incentives and conduct R&D through Enabling Strategies. Future DSM plans may revisit the Home Energy Report if higher energy savings are required.

3.1 Efficient Product Rebates (BNI) The BNI Efficient Product Rebates program provides financial incentives, through prescriptive rebates, on a wide variety of products to encourage BNI end-users to reduce electrical energy consumption and...

AI summary The BNI Efficient Product Rebates program offers prescriptive rebates for energy-efficient products to reduce electrical consumption and peak demand. Eligible customers include commercial, industrial, and institutional sectors. The program aims to raise awareness, encourage efficient product use, increase market penetration, and transform industry practices through expanding rebate offerings and partnerships.

hoices than would otherwise have been purchased; • Discretionary retrofit: efficient components intended to replace existing equipment before the end of its useful life as a cost-effective retrofit. Technical and financial services support...

AI summary The Custom Incentives program under ENS provides rebates, financing, and technical support for energy efficiency retrofits and new construction. It targets specific markets like retail, education, and industry, with services tailored to participant needs. Implementation involves third-party contractors and focuses on promoting innovative energy solutions and best practices in Nova Scotia.

3.3 Direct Installation The Direct Installation program is designed to assist small to medium-sized businesses reduce their energy consumption with turnkey solutions identified through a no-charge assessment. Direct Installation is deliver...

AI summary The Direct Installation program, managed by Efficiency Nova Scotia (ENS), helps small to medium businesses reduce energy use via turnkey solutions. Delivery agents handle procurement and installation, with shared costs and interest-free financing. Target customers include retail shops, restaurants, and non-profits. From 2016-2018, ENS plans to expand contractor participation and product offerings to meet evolving market needs.

Multi-Year Plans A Dunsky report, Regulatory Oversight – A Balanced Approach for Efficiency Nova Scotia, January 24, 2012, included in ENSC's 2013-2015 DSM Plan Application as Appendix B, points out that ENS operates in an extremely comple...

AI summary The Dunsky report (2012) highlights ENS's challenges in a competitive market, emphasizing the discretionary nature of energy efficiency and the need for flexibility. The 2016-2018 DSM Plan aims to ensure program accessibility through a balanced portfolio, adapting to market conditions and stakeholder needs.

Update on Implementation of 2013 Verification and Evaluation Recommendations B C E F G K 2 Recommendation Text Source Status Expected Period of ENSC Comments on Recommendation Completion

AI summary The document provides an update on the implementation of 2013 verification and evaluation recommendations. It includes a table with columns for recommendation text, source, status, and expected period of completion, though specific details are not yet filled in.

Incorporation of Point-of-Sale Discount Programs ENS provided the following explanation in its 2014 rate and bill impact analysis report. However, stakeholders may have similar questions regarding participation rates, so the explanation of...

AI summary ENS explains its upstream point-of-sale discount programs (e.g., Instant Savings) and their impact on participation rates, noting alignment with Oregon's Energy Trust practices. Saturation in some rate classes does not preclude future DSM participation, as programs may adjust measures to influence purchases.

Overall Assumptions Differing from previous years, this rate and bill impact analysis is forward-looking and does not present historical results from 2011-2014. There are some instances however, that historical data were utilized; their sp...

AI summary The analysis is forward-looking, using ENS's 2016-2018 DSM Resource Plan and Navigant Consulting's EL-RAM model. It incorporates the 2014 IRP's energy forecasts up to 2040 provided by NS Power, with benefits extending 16 years beyond the plan's timeframe. Historical data is selectively used where relevant.

Participation Assumptions As part of the rate and bill impact analysis, overall estimated participation rates, rather than participation numbers, for each rate class are presented. This is based on feedback from Synapse Energy Economics. C...

AI summary ENS uses participation rates instead of account numbers for rate class analysis, adjusting for multiple accounts and excluding unlikely participants. Historical data from 2012-2013 informs participation assumptions, with adjustments for Large Industrial and Municipal Utility classes. Repeat participation in Residential Instant Savings was validated at 71% based on market research. Exclusions for commercial/industrial customers in Appliance Retirement were made per DSM Advisory Group feedback.

Alternative DSM Scenarios Alternative Scenarios explore the effect of varying levels of DSM investment. DSM Potential Study data ($M and GWh) for the Low, Base, and Mid-DSM Scenarios over 2016-2018 were used to inform the model with respec...

AI summary The analysis evaluates alternative DSM investment scenarios (Low, Base, Mid, and NS Power's 50% Low IRP) to assess energy savings impacts. ENS's proposed Plan is compared against these scenarios, with the Base scenario omitted due to similarity. NS Power's 50% Low Scenario, not vetted by ENS, uses conservative avoided costs. The model assumes 75% of energy savings changes stem from participant numbers, with 25% from adoption depth, capped at 100% participation.

6. ENS'S USE OF THE RESULTS - There are several ways in which ENS expects to use the results of this analysis: - ENS expects the analysis to help to inform ongoing discussions with NS Power and stakeholders in regards to the 2016-2018 DSM...

AI summary ENS plans to use analysis results for discussions with NS Power and stakeholders on the 2016-2018 DSM Resource Plan. It will focus recruitment efforts in specific rate classes while maintaining support for high-participation classes. ENS seeks input on integrating rate/bill impact analysis into other studies.

Assumptions used in ENS's 2016-2018 Rate and Bill Impact Analysis Stakeholder Stakeholder Comment ENSC's Response Inclusion in the model ENSC, with the help of NSPI, begin collecting customer data immediately that would allow it to better...

AI summary ENSC acknowledges the importance of collecting customer data to improve the estimation of program participation rates and commits to reviewing and modifying its program designs where feasible and cost-effective.

These assumptions are for rate and bill impact analysis purposes only and do not impact ENS's calculation of energy savings. Category Item Assumption Participation Assumption Calculation of participation impacts Participation impacts are c...

AI summary The document outlines assumptions used for rate and bill impact analysis, focusing on participation rates in energy programs. It explains that historical and forecasted participation rates are used, with participants in multiple programs counted in each program individually. However, cumulative participation rates count each participant only once, leading to higher individual program rates compared to overall rates.

2.2 Demand-Side Management is an Investment, Not a Cost Since 2008, demand-side resource investments have provided significant benefits to Nova Scotian households and businesses. On behalf of Efficiency Nova Scotia, Navigant's Electricity...

AI summary Since 2008, demand-side management (DSM) investments in Nova Scotia have delivered benefits to households and businesses. Efficiency Nova Scotia, using Navigant's EL-RAM model, assessed cost-effectiveness. The 2016-2018 plan optimized DSM investment for cost-effectiveness and broad participation, with program participants benefiting from lower bills and improved affordability.

SUMMARY SUMMARY& CONCLUSION & CONCLUSION The business of "selling" Demand-Side Management is not fundamentally different from most business ventures: when taking a long-term perspective, strategic planning involves balancing multiple objec...

AI summary Efficiency Nova Scotia (ENS) must balance multiple objectives in its Demand-Side Management (DSM) strategy, including maximizing short-term and long-term savings, minimizing costs, ensuring value, managing risks, preserving relationships, and ensuring broad access. A balanced approach is emphasized to achieve long-term success in DSM portfolio development.

1. INTRODUCTION In 2014, under the Public Utilities Act , the government of Nova Scotia created a new model for the delivery of energy efficiency in the province. Under this model, the Efficiency Nova Scotia (ENS) Franchise was created, an...

AI summary In 2014, Nova Scotia established the Efficiency Nova Scotia (ENS) Franchise under the Public Utilities Act, transitioning to EfficiencyOne. The UARB oversees franchise performance, while Dunsky was commissioned to recommend Target Performance Indicators (TPIs) for ENS, based on a jurisdictional scan and Nova Scotia-specific context. The report outlines background, jurisdictional analysis, and TPI recommendations.

2.2. MAIN USES In our literature review, we have referenced three main uses for target performance indicators in a regulatory process: 1. They may be used for reporting , i.e. for information purposes only. In this case, the program admini...

AI summary The text outlines three primary uses of target performance indicators in regulatory processes: reporting, triggering contract/licence renewal, and performance incentives. Efficiency Nova Scotia focuses on reporting or licence renewal triggers rather than financial rewards, contrasting with U.S. practices where performance incentives are common. Examples include Manitoba Hydro, Oregon's OPUC, and ACEEE references.

2.3. TYPES OF INDICATORS Based on our literature review, we identified four main areas of interest when reviewing the performance of program administrators in delivering energy efficiency. These can then be delineated in a number of metric...

AI summary The document outlines four main areas for evaluating energy efficiency program administrators through Target Performance Indicators (TPIs), with metrics detailed in Table 1. These indicators are used to assess performance in delivering energy efficiency initiatives, though specific categories are not listed in the provided text.

Table 3: Target performance indicators and Minimum Requirements in Vermont Target performance indicators Metric Unit Electricity savings (Net annual cumulative) MWh Total Resource Benefits (electric, fossil, water) $ NPV Summer Peak Demand...

AI summary Table 3 outlines target performance indicators and minimum requirements in Vermont, including metrics like electricity savings, Total Resource Benefits (TRB), and participation thresholds. TRB is calculated based on avoided cost forecasts and adjusted for changes over time.

Table 7: Target performance indicators in Oregon Target performance indicators Metric Unit Energy savings (annual) MWh, therms Levelized program cost $/kWh, $/therm Renewable resource development MWh, $/MWh Program delivery efficiency Admi...

AI summary Table 7 outlines target performance indicators in Oregon, including energy savings, program costs, renewable development, delivery efficiency, and customer satisfaction. These metrics are evaluated annually, with measure lives based on ex-ante values that are regularly updated.

3.4. TAKEAWAYS Returning to the four main categories of target performance indicators identified in Section 2, the chart below illustrates how each jurisdiction's target performance indicators align to the four categories of TPIs discussed...

AI summary Most regions prioritize energy savings and benefits in target performance indicators (TPIs), emphasizing simplicity and measurable metrics. Jurisdictions stress the need for transparent, independent measurement and verification (M&V) processes to ensure accuracy. Clear upfront definitions of performance metrics are highlighted as critical for program administrator planning.

Long-Term View / Depth of Savings - Three jurisdictions apply a broad array of target performance indicators regarding market transformation (Hawaii, Massachusetts and Vermont). Although Hawaii simply measures the number of participants to...

AI summary Three jurisdictions (Hawaii, Massachusetts, Vermont) use target performance indicators for market transformation. Hawaii measures participants, while Vermont and Massachusetts use complex methods. Only Vermont and Massachusetts value depth of savings in their TPIs.

4. RECOMMENDATIONS FOR NOVA SCOTIA Efficiency Nova Scotia has requested that we recommend a set of target performance indicators that would apply to the franchise holder over the 2016-2018 period.

AI summary Efficiency Nova Scotia has requested the recommendation of target performance indicators (TPIs) for the franchise holder during the 2016-2018 period. This involves establishing metrics to evaluate performance over the specified timeframe.

4.2. DISCUSSION & RECOMMENDATIONS Two target performance indicators meet all of the above-noted five criteria, namely: Cumulative annual energy savings, and Cumulative annual peak demand savings. These indicators are clearly within the sco...

AI summary Two Target Performance Indicators (cumulative annual energy and peak demand savings) are recommended for ENS due to their alignment with its mandate, measurability, and controllability. A third indicator (cumulative lifetime energy savings) is noted as important but lacks reporting history in Nova Scotia. The UARB would set specific targets for the first two indicators to assess ENS performance and inform franchise renewal decisions.

The table below summarizes our recommendations: Performance Indicator Target (TPI) Other (OPI) Note on metrics Cumulative Annual Electricity Savings GWh/yr (last year of plan) Cumulative Annual Peak Demand Savings MW (last year of plan) Cu...

AI summary The table outlines performance indicators for energy efficiency programs, including cumulative annual electricity and peak demand savings, lifetime electricity savings, and considerations for value and other factors. The document notes that one indicator should transition from an Other Performance Indicator (OPI) to a Target Performance Indicator (TPI) in the next three-year plan.

EXECUTIVE SUMMARY The Total Resource Cost (TRC) test was first defined, along with a series of other "standard" tests, in 1983, in the context of California's initial, utility-driven energy efficiency and demand-side management (DSM) progr...

AI summary The Total Resource Cost (TRC) test, introduced in 1983, has been widely used since the 1990s to evaluate demand-side management (DSM) cost-effectiveness. However, recent concerns question its continued use, citing four unresolved issues affecting decision-making in DSM programs.

INTRODUCTION TO DSM SCREENING

AI summary An introduction to Demand Side Management (DSM) screening in Nova Scotia, involving key organizations like Efficiency Nova Scotia (ENS) and Nova Scotia Power Inc. (NSPI), with references to regulatory frameworks and energy efficiency programs.

PARTICIPANT NON-ENERGY BENEFITS (NEBS) Participant NEBs are increasingly understood to play a significant role in the overall value proposition that consumers derive from many energy efficient technologies or services. To understand the ex...

AI summary Non-energy benefits (NEBs) are critical to the value of energy efficiency programs, emphasized by program marketers, academic research, and market data. NEBs like comfort and health improvements drive consumer adoption, while neglecting them risks underinvestment and higher costs. Tim Woolf highlights that excluding NEBs from TRC tests undermines program effectiveness.

SUMMARY OF NEB ISSUES Increasingly, non-energy benefits – especially those that accrue to participants – are viewed as significant benefit streams that the current TRC effectively neglects. This is critical to the extent that the TRC's pur...

AI summary The document critiques the Total Resource Cost (TRC) methodology for neglecting non-energy benefits (NEB), particularly for participants. It notes that some regions modify TRC to include NEB or adopt alternative tests. A study evaluated DSM scenarios with 1.0%-2.5% annual savings, referencing Nova Scotia's 2012 DSM achievement of 1.52% annual sales. The text also mentions deliberate low-rate choices to avoid discounting future generations' interests.

RECENT CHANGES TO STANDARD PRACTICES

AI summary The document outlines recent updates to standard practices in Nova Scotia's regulatory proceedings, involving entities like NSPI, ENS, and UARB. Key topics include energy efficiency programs, demand-side management, and regulatory frameworks. No specific arguments or cross-references are detailed in the provided text.

OPTION B. MOVE FOCUS TO PAC TEST The other primary option for Nova Scotia is to focus instead on the narrower but more straightforward PAC test. Using the PAC test provides a clear measure of a program's (past or anticipated) performance,...

AI summary Option B advocates shifting to the PAC test for evaluating DSM programs, emphasizing its clarity, symmetry in cost-benefit analysis, and alignment with other jurisdictions like Connecticut and Michigan. It addresses concerns about equity and non-electric energy impacts through policy exceptions and dedicated funding. The PAC test is seen as more accurate and straightforward compared to TRC, with existing familiarity among stakeholders.

NOTES ON APPLICATION Beyond the choice of tests, the way in which they are applied is also important. Indeed, screening tests can be applied in a number of ways: as information to be balanced with other considerations; as a hard threshold...

AI summary The document discusses the application of cost-effectiveness screening tests for Demand Side Management (DSM) within Nova Scotia Power Inc.'s (NSPI) Integrated Resource Plan (IRP). It argues against applying thresholds at the 'program' level, advocating instead for sector-level screening to avoid artificial delineations and ensure equity. Portfolio-level screening risks cross-subsidization between sectors, while sector-level screening allows flexibility for Efficiency Nova Scotia (ENS) to optimize its portfolio.

12. PERFORMANCE REQUIREMENTS AND EVALUATIONS 12.1 EfficiencyOne's performance under the terms of this Agreement shall be measured in accordance with the performance requirements established by the UARB pursuant to Section 79M of the Act as...

AI summary EfficiencyOne's performance under the Agreement is evaluated based on performance requirements set by the UARB under Section 79M of the Act, as detailed in Schedule 'C'. This establishes the framework for measuring compliance with regulatory standards.

19. DISPUTE RESOLUTION - 19.1 In the event of a dispute in connection with this Agreement, a senior representative of EfficiencyOne and a senior representative of NSPI shall promptly meet to discuss and resolve the dispute and the Parties...

AI summary The dispute resolution process requires EfficiencyOne and NSPI to meet promptly to resolve disputes within 30 days (or 10 days for urgent matters). If unresolved, disputes are referred to the UARB per Section 79P of the Act. EfficiencyOne must continue EECA implementation unless UARB authorizes suspension.

DEFINITIONS Base case A base case details the information on how assumed gross savings used in the tracking sheet have been established. Usually, these savings are calculated with a series of variables such as hours of operation, wattage o...

AI summary The document defines key terms related to energy efficiency program evaluation, including concepts like base case, billing calibration, distortion effects, free-ridership, gross and net energy savings, and net-to-gross ratio. These definitions are crucial for understanding how energy savings are measured and evaluated in regulatory contexts.

INTRODUCTION This document provides a summary of the 2014 evaluations conducted for the Efficiency Nova Scotia Corporation (ENSC) demand-side management (DSM) programs. Established in 2010, ENSC is an organization in charge of helping Nova...

AI summary This document summarizes the 2014 evaluations of Efficiency Nova Scotia Corporation's (ENSC) demand-side management (DSM) programs. The evaluations were conducted by Econoler, in collaboration with CRA and Equilibrium Engineering, and revealed significant energy and peak demand savings. The report also discusses the evaluation methods used for different program components.

1 EVALUATION OBJECTIVES AND METHODOLOGY This section presents the objectives of the 2014 evaluation as well as the methodology used and the activities carried out to evaluate ENSC's DSM program components.

AI summary This section outlines the 2014 evaluation of ENSC's Demand-side Management (DSM) program components, detailing the objectives and methodologies employed to assess their effectiveness.

1.2 Methodology To carry out the 2014 evaluation, the Evaluator first reviewed all relevant documentation and placed a particular focus on the modifications that ENSC made to the program components to implement the recommendations made in...

AI summary The 2014 evaluation methodology involved reviewing ENSC's program modifications based on prior recommendations, followed by data collection through interviews, surveys, on-site visits, billing calibration, and document reviews to assess process, market, and impact outcomes.

1.2.1 In-depth Interviews The 2014 evaluation methodology included in-depth interviews with ENSC staff, partners, participants and associations. Between August 2014 and January 2015, the Econoler team conducted 48 in-depth interviews with...

AI summary The 2014 evaluation methodology involved Econoler conducting 48 in-depth interviews with ENSC stakeholders, including program managers, delivery agents, and participants, to assess various energy efficiency programs. The table summarizes the number of interviews conducted per program component.

Annual Surveys Between October and December 2014, using computer-assisted telephone interviewing (CATI) technology, CRA conducted annual surveys with participants and builders for most of the program components. Although the content of the...

AI summary In 2014, CRA conducted annual surveys using CATI technology to gather data on program components, focusing on free-ridership, awareness, participant motivations, satisfaction, and recommendations for improvement. Surveys covered internal spillover effects and energy efficiency behaviors.

For the 2014 evaluation, the Econoler team visited a total of 222 participant sites. These visits were conducted between September and November 2014. The objective of the on-site visits was to collect data to allow establishing or validati...

AI summary For the 2014 evaluation, Econoler visited 222 participant sites between September and November 2014 to collect data on installation rates, interactive effects, and technical characteristics of implemented measures. Visits included observing direct installation processes and in-store client experiences for Instant Savings.

1.2.4 Unitary Savings Review For all the evaluated programs where savings were established on a unitary basis, the Evaluator reviewed the savings presented in the tracking system. First, their consistency with the result of the previous ev...

AI summary The Evaluator reviewed unitary savings for programs like BER Instant Rebates and Green Heat, ensuring consistency with prior evaluations. Methods included using Technical Reference Manuals (TRMs) from other jurisdictions, product specifications, and survey data (e.g., Atlantic Quarterly Survey). Sampling popular products helped establish average properties for categories with diverse offerings.

1.2.5 Project Files Review For those programs whose savings were established based on custom calculations for each measure installed, the Evaluator reviewed savings for a sample of projects. To ensure the accuracy of the calculations used,...

AI summary The Evaluator reviewed project files for programs using custom calculations, verifying accuracy through documentation and on-site visits. Adjustments were made to equations/parameters, sometimes extrapolated to non-sampled projects. Custom Retrofit sub-components (EMIS, EBC) received only file reviews, with qualitative recommendations instead of adjustments.

1.2.6 Billing Calibration For 2014, ENSC collected actual energy consumption and demand data for the buildings which participated in Custom New Construction from 2011 to 2013 evaluations, and provided them to the Evaluator to make a compar...

AI summary ENSC collected actual energy data from 2011-2013 for Custom New Construction participants to compare with simulated figures. Seven projects were evaluated using IPMVP guidelines, but the small sample size and limited data prevented conclusive accuracy assessments of energy simulations.

2 DSM PORTFOLIO PERFORMANCE This section presents an analysis of the impact evaluation results for all the program components. Those results were also used for making a comparison to the targets, as well as to analyze the evolution of savi...

AI summary This section evaluates the impact of DSM program components, comparing results to targets and analyzing savings trends over recent years. It focuses on assessing portfolio performance through quantitative analysis of program outcomes.

2.1 Overall Targets and Results ENSC programs encompass many components, which all share the same market. For instance, the Existing Residential program includes the Home Energy Assessment, Green Heat, Low Income Homeowner, Residential Dir...

AI summary ENSC programs, including the Existing Residential program, are evaluated against overall targets set by ENSC. The mid-course targets for program components were reviewed by the DSM Advisory Group, with overall energy and demand savings targets remaining consistent with those approved by the Nova Scotia Utility and Review Board (UARB) in 2014.

b Rental Properties and Condos Services common spaces measures are claimed under Business Energy Solutions. The following sub-sections report on the comparison between the evaluated savings and the tracked savings for each program componen...

AI summary The document discusses the evaluation of savings for various program components in 2014, focusing on the comparison between evaluated and tracked savings. It excludes components that only required validation of tracked savings by ENSC or a process evaluation.

2.3 Net-to-gross Ratio As shown in Tables 6 and 7 above, the interactive effects factors and NTGRs were applied to the gross savings impacts in order to estimate net savings impacts. NTGRs were established based on the levels of free-rider...

AI summary The document discusses the calculation of the Net-to-Gross Ratio (NTGR) for Energy Efficiency Nova Scotia Corporation (ENSC) programs in 2014. It outlines the methodology used to estimate free-ridership and internal spillover effects, which were applied to gross savings impacts to determine net savings. The NTGR formula is provided, and exceptions for certain programs are noted.

2.6 Overall Performance In 2014, ENSC's program component portfolio achieved a total of 151.888 GWh in net energy savings and 27.077 MW in net peak demand savings at the generator. In addition to the savings generated by ENSC's DSM program...

AI summary In 2014, ENSC achieved its overall energy savings targets through a combination of successful program components and new initiatives. While some program components did not meet their individual goals, others like Custom Incentives and Energy Savings Actions made up for the shortfalls. ENSC has made significant improvements in program tracking, partner relationships, and education efforts. However, some savings calculation parameters were not updated as recommended.

3.1 Program Manual A program manual that provides key information on program processes and tracking for internal use is an essential reference tool for all the program staff. In addition, a program manual is widely used by the Evaluator th...

AI summary The document discusses the importance of a program manual as a reference tool for program staff and evaluators. It outlines the contents of the manual, including program characteristics, parameters, and appendices such as process flow charts and program forms. The Evaluator provides recommendations on the program manuals.

4.1.1 Instant Savings The 2014 evaluation of Instant Savings demonstrated that most of the recommendations made specifically for Instant Savings in the previous evaluations were implemented. The Evaluator commends ENSC on the efforts it ma...

AI summary The 2014 evaluation of Instant Savings highlights successful implementation of prior recommendations, improvements in product range and marketing, and positive feedback from stakeholders. However, challenges remain, including inconsistent retailer engagement and inadequate in-store POP displays, which hinder program delivery.

The 2014 evaluation of Green Heat demonstrated that most of the recommendations made specifically for Green Heat in the last evaluations were implemented. The Evaluator commends ENSC on the efforts it made to improve and optimize Green Hea...

AI summary The 2014 evaluation of Green Heat noted that most recommendations from previous evaluations were implemented, with ENSC commended for improvements in marketing, outreach, and data collection. The deadline for equipment installation was extended to six months, leading to positive participant feedback. On-site visits confirmed that rebated equipment was installed and used as the primary heating source, though data accuracy in the tracking system requires improvement.

cking report contains enough information to allow carrying out the evaluation, it is recommended that further improvements be made to the accuracy of the data collected. Survey results showed that participants' satisfaction with Green Heat...

AI summary The evaluation of the Green Heat program found high participant satisfaction but noted a slight decline in participation since 2011, attributed to changes in rebate eligibility. Energy savings decreased in 2014 compared to previous years, with net savings of 1.472 GWh and peak demand savings of 0.594 MW. The evaluation considered free-ridership and used literature review data for calculations.

havioural change being related to turning off the lights. Other behavioural changes include increased awareness of power usage and saving energy, turning off appliances and reducing water consumption. A total of 13,945 participants partici...

AI summary The Residential Direct Install program saw a reduction in participants from 2012 to 2014, but achieved energy savings targets through increased efficiency measures like LED lighting and smart power controllers. The program also included a CBSM Pilot that encouraged reduced warm water usage for laundry, contributing additional energy savings.

4.1.4 Home Energy Report Launched in 2013, Home Energy Report is an innovative program intended to promote behavioural changes towards greater energy efficiency. Since its inception, a total of 93,119 participants have taken part in the pa...

AI summary The Home Energy Report program, launched in 2013, has achieved significant energy savings, particularly through its paper-based component. While the web-based component has had limited measurable impact, the program overall has contributed 34.789 GWh in net energy savings. Evaluation shows that participants adopted some energy-efficient behaviors after participation, though the web-based component's influence was less clear.

Table 15: Recommendations for Home Energy Report No. Recommendations HER-R1. Explain in greater detail the characteristics of Home Energy Report in the program documentation. Designed to influence and change participants' electricity use b...

AI summary The Home Energy Report (HER) program requires more detailed documentation of participant selection numbers and the process for recommending energy-saving tips. The Evaluator recommends that the program manual and evaluation plan provide greater clarity on these aspects to ensure effective implementation and evaluation of the program.

4.2.1 Business Energy Rebates The 2014 evaluation of Business Energy Rebates demonstrated that most of the recommendations pertaining to process issues made in the previous evaluations have been implemented. The Evaluator commends ENSC on...

AI summary The 2014 evaluation of Business Energy Rebates shows that ENSC has improved the program's process, including tracking systems and collaboration with distributors. However, savings calculations have not improved significantly. Participants were generally satisfied but faced challenges with information availability and process clarity.

No. Recommendations BER-R5. Be proactive in addressing issues related to contractors. In the 2013 evaluation of BER Mail-in, a quality issue with one contractor's work to install the electronically commutated motor (ECM) was identified. Th...

AI summary The 2013 evaluation of the BER Mail-in program identified quality issues with a contractor's installation of electronically commutated motors (ECM), leading to reduced savings. ENSC did not take concrete measures to address the issue, resulting in recurring problems in 2014 and the removal of 22 projects from claimed savings.

The 2014 evaluation of Custom Retrofit demonstrated that most of the recommendations made in previous evaluations have been implemented. The Evaluator commends ENSC on its efforts in improving and optimizing Custom Retrofit. Among the impr...

AI summary The 2014 evaluation of the Custom Retrofit program noted that many previous recommendations had been implemented, including transferring simple lighting projects to prescriptive programs, which may have contributed to a decline in participation. The evaluation confirmed that 100 projects completed in 2014 achieved good energy savings, and the verification process was found to be thorough.

thoroughly and properly conducted. One element that explains why adjustments to peak demand savings were more significant is that the Evaluator changed some of the diversity factors estimated by ENSC. Moreover, when calculating the net ene...

AI summary The document discusses adjustments to peak demand savings, noting that changes in diversity factors by the Evaluator impacted the results. In 2014, Custom Retrofit achieved significant energy and peak demand savings, while EBC and EMIS contributed additional energy savings. Participant satisfaction with Custom Retrofit remained high, with most recommending it to others and expressing interest in future ENSC programs.

Table 18: Recommendations for Custom Retrofit No. Recommendations Custom-R2. Improve the information presented in the DSMDS reports. The Evaluator found that most of the important information for evaluation purposes could be obtained from...

AI summary The Evaluator recommends improving the DSMDS reports by adding details such as line loss factor, rate code, verified savings at the meter, and free-ridership screening results. It also suggests including both total and current-year savings for better sample selection and adding unique identifiers to distinguish between new and ongoing projects.

The 2014 evaluation of Business Energy Solutions demonstrated that the program component generated important electrical savings in 2014. Even though Business Energy Solutions did not reach its targets in 2014, an increase in savings associ...

AI summary The 2014 evaluation of Business Energy Solutions showed that the program achieved significant electrical savings despite not meeting its targets. Participant satisfaction remained high, but some challenges such as contractor issues and lack of financing were reported. Recommendations include improving procedures for lighting intensity measurement and providing clearer information on replacement lamps.

Properties and Condos Service common space measures and 42 participants took part in the LED Blitz pilot, which makes for a total of 854 participants for the whole Business Energy Solutions component. The impact evaluation revealed that, w...

AI summary The Business Energy Solutions component, including the LED Blitz pilot, involved 854 participants and generated net energy savings of 13.175 GWh and peak demand savings of 2.570 MW in 2014. The evaluation considered interactive effects, installation rates, diversity factors, and freeridership and spillover effects from surveys.

Table 20: Recommendations for Business Energy Solutions No. Recommendations BES-R1. Make follow-up telephone calls to ensure participant satisfaction with the work done by the third-party contractor. Survey results showed that participants...

AI summary The text recommends that ENSC conduct follow-up phone calls with participants of the Business Energy Solutions program to ensure satisfaction with third-party contractors' work, as survey results indicated issues with contractor performance and quality of work.

10% Example participant Spillover Algorithm (none with spillover this Calculation Algorithm Calculation Questions Answer Result SO1. Since the time that you participated in IF 1. Yes: CONTINUE Custom Retrofit, have you implemented one or I...

AI summary This table outlines a spillover algorithm used to calculate the influence of the Custom Retrofit program on participants' subsequent energy efficiency measures. It includes questions about additional measures implemented, financing or rebate requests, types of measures, and the influence of the program on decisions, with calculations for spillover savings.

15% Spillover Algorithm Example I Participant Questions Calculation Algorithm Answer Calculation Result SO1. Since the time that you participated in RDI, have you IF 1. Yes: CONTINUE installed any additional energy-efficient products or re...

AI summary The text presents a spillover algorithm used to calculate the impact of the RDI program on participants' additional energy-efficient actions. It includes questions and calculations related to the installation of energy-efficient products, retirement of old appliances, and the influence of the RDI program on these actions. The spillover savings are calculated as 86%.

2.2 Methodology Description In 2014, a full-scale evaluation of ARet was not carried out. The evaluation of ARet involved substantiating ENSC's tracked savings with the parameters established in the 2013 evaluation, and re-evaluating the f...

AI summary In 2014, an evaluation of the Appliance Retirement (ARet) program was conducted by ENSC, updating energy consumption values of retired appliances and assessing parameters like free-ridership and induced consumption. A survey of 204 participants was carried out using CATI technology to gather insights on program impact and participant satisfaction.

Non-sampling error Errors arising during the course of all survey activities other than sampling. Non-sampling errors tend to lead to bias in measurements and are very difficult to quantify. Peak demand savings The demand savings that coin...

AI summary The text defines various terms related to energy efficiency programs, including non-sampling error, peak demand savings, precision, random sampling error, sample size, tracked savings, and unitary savings. These definitions are critical for understanding measurement accuracy and program evaluation in energy efficiency initiatives.

Table 2: Comparison of Tracked and Evaluated Savings at the Generator Initial Gross Savings Installed Gross Savings Installed Gross Savings with Interactive Effects NTGR Net Savings Energy Savings Tracked Savings from ENSC 16.879 GWh 15.92...

AI summary Table 2 compares tracked and evaluated savings from Energy Efficiency Nova Scotia Corporation (ENSC) programs, including energy savings and peak demand savings. The table includes metrics such as initial gross savings, installed gross savings, net-to-gross ratio (NTGR), and net savings for both tracked and evaluated results.

2.1 Presentation of the Team To carry out the 2014 evaluation, Econoler worked with two partner entities: Corporate Research Associates (CRA) and Equilibrium Engineering. Tasks were divided as follows: - Econoler acted as the team leader a...

AI summary Econoler collaborated with CRA and Equilibrium Engineering to conduct the 2014 evaluation. Econoler coordinated activities and prepared deliverables, CRA conducted interviews and surveys and analyzed data, and Equilibrium Engineering assisted with impact evaluation.

2.2 Evaluation Activities Figure 1 illustrates the research strategy and data collection activities involved in the 2014 evaluation. Figure 1: Methodological Model Each step of this methodological model is further detailed in the following...

AI summary This section outlines the evaluation activities for the 2014 evaluation, including a methodological model illustrated in Figure 1. The research strategy and data collection activities are detailed in subsequent subsections. Project No. 5870 is referenced.

2.2.1 Interview with Program Manager The Econoler team conducted one interview with the Program Manager (PM) in September 2014. This interview was intended, among other things, to follow-up on the 2012 and 2013 evaluation recommendations,...

AI summary An interview was conducted with the Program Manager in September 2014 by the Econoler team to follow up on evaluation recommendations from 2012 and 2013 and to understand changes in 2014 program delivery. This led to the development of a list of questions and topics for data collection tools.

3.1 Follow-up on 2012 and 2013 Evaluation Report Recommendations This section reports on the progress made in acting on the recommendations made by the Evaluator in the 2012 and 2013 evaluation reports. The Evaluator follows up on recommen...

AI summary This section provides an update on the progress made in implementing recommendations from the 2012 and 2013 evaluation reports. A monitoring tool is used to track the implementation status of each recommendation, ensuring transparency and accountability in following through on the evaluator's suggestions.

3.2 Program Documentation and Design As part of the evaluation, the Evaluator analyzed the program documentation and worked together with the PM to improve and revise the content of the program manual, the evaluation plan and the logic mod...

AI summary The Evaluator analyzed program documentation and worked with the Program Manager to revise the program manual, evaluation plan, and logic model. Key issues included the need to document changes to eligible products and the lack of participant identification in the Instant Savings program, which complicates evaluation efforts.

4.1 Partner Perspectives One interview with the DA and 14 interviews with retailers were conducted as part of the 2014 evaluation. The following sub-sections present the findings of an analysis of the feedback collected from these intervie...

AI summary This section discusses findings from interviews conducted with a DA and 14 retailers as part of the 2014 evaluation, focusing on partner perspectives.

plementation team has contributed to the development of strong relationships with retailers. The DA also believed that ENSC had offered sufficient opportunities to provide input about Instant Savings. The DA believed that Instant Savings w...

AI summary The Delivery Agent (DA) reports that Instant Savings has successfully raised awareness about energy efficiency and ENSC. The program's in-store events and app are effective tools, though some customers prefer human interaction. The DA has a process for addressing complaints, ensuring timely resolution and participant satisfaction.

Revised Savings Because both regular and specialty CFLs are no longer part of the Instant Savings rebated products as of the 2014 fall campaign, the unitary savings values were not reviewed this year, as last year's evaluation results are...

AI summary The document discusses the revised savings methodology for lighting programs, noting that unitary savings values for CFLs were not reviewed due to unchanged assumptions. The methodology now follows UMP Chapter 67, using one of two approaches to estimate efficient lamp replacements. The Evaluator chose to apply the first approach, impacting free-ridership estimates and the replacement ratio.

The table below compares the energy and demand savings established by this evaluation with the savings calculated in the 2014 tracking sheet.

AI summary The text references a comparison between energy and demand savings from a current evaluation and those calculated in the 2014 tracking sheet, highlighting a review or analysis of past and present savings data.

CONCLUSION The 2014 evaluation of Instant Savings demonstrated that most of the recommendations made specifically for Instant Savings in the previous evaluations were implemented. The Evaluator commends ENSC on the efforts it made to impro...

AI summary The 2014 evaluation of Instant Savings highlights improvements in the program, including the removal of CFLs and the promotion of LED lamps. However, challenges remain, such as retailer engagement and communication delays. Energy savings declined compared to previous years, partly due to budget cuts and lower unitary savings for certain products.

QB1. On a scale from 1 to 10, where 1 is very poor and 10 is excellent, please rate your satisfaction in regard to the following aspects of the Instant Savings program. Aspects of the program Score 1 = very poor 10 = excellent NA = Not app...

AI summary The text presents a questionnaire assessing participant satisfaction with the Instant Savings program, including questions about educational components, opportunities for input, and handling of complaints. It includes sections for rating satisfaction and providing feedback on program improvements.

EXECUTIVE SUMMARY The 2014 evaluation of Home Energy Assessment (HEA) involved validated Efficiency Nova Scotia Corporation's (ENSC) tracked savings as well as re-evaluating free-ridership and internal spillover. This report presents the v...

AI summary The 2014 evaluation of Home Energy Assessment (HEA) included validated Efficiency Nova Scotia Corporation's tracked savings and re-evaluation of free-ridership and internal spillover. The report details the validated gross and net savings for that year.

Key Findings Econoler reviewed the content of the 2014 HEA tracking sheet, which includes a total of 2,343 participants. As part of the 2014 evaluation, the Evaluator validated the content of the tracking system report, verified that the p...

AI summary Econoler evaluated the 2014 HEA tracking sheet with 2,343 participants. They validated the tracking system report, confirmed parameters used in gross savings calculations, applied the net-to-gross ratio (NTGR), and analyzed savings from former participants who were removed for not completing an E assessment within the 12-month program period.

3.2.2 Internal Spillover The annual participant survey was also used to assess internal spillover, which can occur when participants, following their previous participation, implement additional energy efficiency measures that were recomme...

AI summary The annual participant survey identified internal spillover, where participants implemented additional energy efficiency measures after their initial assessment. The internal spillover effect factor was six percent in 2014, higher than previous years. Certified energy advisors (CEAs) continue to recommend these measures, and more participants reported taking additional actions post-assessment.

S10. Thinking of when your post-retrofit assessment was conducted by the energy advisor, how long, in days, was it before you received your rebate? Length of Time to Receive Rebate 2014 Sample Size 60 7-9 days 2% 10-19 days 10% 20-29 days...

AI summary The text discusses the time it took for participants to receive rebates after a post-retrofit assessment and the importance of various factors in their decision to implement energy efficiency upgrades. Data is presented for 2014, showing the distribution of rebate receipt times and average importance ratings for different program aspects.

APPENDIX III ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity, effi...

AI summary This appendix outlines an algorithm for calculating free-ridership levels in energy efficiency programs. It uses survey responses to assess the likelihood that participants would have implemented energy efficiency upgrades without program assistance. Questions such as FR2a and FR2b are used to quantify program attribution and free-ridership.

100% -[FR4_P/(FR4_P+FR4_NP)] FR2c. If you had not participated in HEA, what is the likelihood that you would have implemented the exactly same energy efficiency upgrades that you implemented through program but at a later date? (Scale 0 to...

AI summary This section of the regulatory proceeding document asks respondents about the likelihood of implementing energy efficiency upgrades without the Home Energy Assistance (HEA) program and the potential delay in implementation if they had not participated in HEA. The responses are quantified on a scale from 0 to 10 and further categorized into time frames.

APPENDIX IV INTERNAL SPILLOVER METHODOLOGY Internal spillover was measured using a participant survey. Participants were asked whether following their participation in HEA, they implemented any additional energy efficiency measures that we...

AI summary This appendix outlines the methodology used to measure internal spillover from the Home Energy Assessment (HEA) program. Participants were surveyed to determine if they implemented additional energy efficiency measures beyond those incentivized by rebates, and the influence of the program on these decisions was quantified to assess spillover effects.

2.2 Evaluation Activities [Figure 1](#page-124-3) illustrates the research strategy and data collection activities used for the 2014 evaluation. Figure 1: Methodological Model Each step of this methodological model is further detailed in t...

AI summary This section outlines the research strategy and data collection activities used for the 2014 evaluation, as illustrated in Figure 1. The methodological model is further detailed in subsequent sub-sections.

2.2.1 Interview with Program Manager The Econoler team conducted one interview with the PM in September 2014. This interview was intended, among other things, to follow up on the 2012 and 2013 evaluation recommendations regarding process i...

AI summary An interview was conducted with the Program Manager in September 2014 by the Econoler team to follow up on 2012 and 2013 evaluation recommendations and understand changes in program delivery in 2014. This information was used to prepare a list of questions and topics for data collection tools.

2.2.3 Survey In October and November 2014, CRA staff in Halifax conducted a telephone survey with a total of 53 Green Heat participants, using computer-assisted telephone interviewing (CATI) technology. The average length of the survey was...

AI summary In 2014, CRA conducted a telephone survey with 53 Green Heat participants to gather feedback on program awareness, satisfaction, and recommendations for improvement. The survey results are detailed in appendices, and Table 3 provides sample sizes and margins of error for 2012, 2013, and 2014 surveys.

3.2 Follow-up on 2012 and 2013 Evaluation Report Recommendations This section reports on the progress in acting on the recommendations made by the Evaluator in the 2012 and 2013 evaluation reports. The Evaluator follows up on recommendatio...

AI summary This section discusses the follow-up on recommendations from the 2012 and 2013 evaluation reports. The PM uses a monitoring tool to track implementation status, and Table 4 summarizes the progress of each recommendation.

2012 Executive Summary Recommendations The Evaluator noticed that two of the three recommendations made in 2012 were implemented by ENSC. The implementation of these recommendations allowed for overall program improvement. One of them was...

AI summary The 2012 Executive Summary Recommendations highlight that two of three recommendations were implemented by ENSC, including continued marketing efforts and calibrated simulations for Green Heat. One recommendation regarding rebates for ductless mini-split heat pumps was not implemented due to concerns about high freeridership.

3.3 Program Documentation and Design As part of the evaluation, the Evaluator analyzed the program documentation and worked together with the PM to improve and revise the program manual, the evaluation plan and the logic model, where appli...

AI summary The Evaluator worked with the Program Manager to revise program documentation, including the program manual, evaluation plan, and logic model for Green Heat. A project workflow checklist was developed and integrated into the Data Management System to ensure proper application processing and prevent missing information.

Installed Systems The final tab in the tracking report contains a summary table of the equipment installed to date. The quantity of each equipment type was recorded and categorized in two groups, namely those that received financing and th...

AI summary The tracking report for installed systems provides a detailed summary of equipment installed, categorized by financing and rebate. The report is well-organized, but issues were identified, such as inaccuracies in unitary savings for heat pump projects and missing data like utility account numbers and backup heating sources. The Evaluator recommends improvements to data collection for future analysis.

3.5 On-site Visits Five on-site visits were carried out as part of 2014 Green Heat evaluation. These visits included an assessment of two wood stoves, one pellet stove, one central air source heat pump and one geothermal heat pump. The pur...

AI summary Five on-site visits were conducted as part of the 2014 Green Heat evaluation to confirm the installation and use of rebated heating equipment. The visits validated that the equipment was installed and in use, but identified discrepancies in the tracking system regarding the previous heating systems. Improvements to pre-screening and record-keeping are recommended.

5.2.1 Free-ridership In the case of Green Heat, free-ridership can occur when participants would have still installed the heating system in the absence of the program. The free-ridership level was measured through the participant survey, u...

AI summary The free-ridership level for the Green Heat program in 2014 was measured at 36%, indicating that 64% of the heating systems installed were influenced by the program. This level is consistent with previous years' evaluations, ranging from 32% in 2012 to 42% in 2011.

CONCLUSION The 2014 evaluation of Green Heat demonstrated that most of the recommendations made specifically for Green Heat in the last evaluations were implemented. The Evaluator commends ENSC on the efforts it made to improve and optimiz...

AI summary The 2014 evaluation of Green Heat highlighted successful implementation of past recommendations, improvements in marketing and data accuracy, and high participant satisfaction. However, participation slightly declined, and energy savings decreased compared to previous years. The evaluation also noted the impact of shifting focus to renewable fuel-based heating systems.

B2. What were those challenges or barriers? Specific Challenges Face in Installing New Equipment 2013 (#) 2014 (#) Sample Size 13 10 Problems with installation - 3 Energy-efficient equipment does not meet payback requirements 1 2 Paperwork...

AI summary The challenges faced in installing new energy-efficient equipment include issues with installation, paperwork, meeting deadlines, and finding qualified contractors. The importance of green heat programs, rebates, and information provided by salespeople was rated on a scale from 0 to 10, with program rebates and financing being the most important factors.

On-site Visit Protocol Similar to the other program evaluations, the Evaluator prepared a standardized site visit protocol to aid in collecting relevant information. Validation of unitary savings is limited primarily to confirming that ope...

AI summary The document outlines the On-site Visit Protocol used to evaluate program effectiveness, focusing on verifying unitary savings by confirming that new equipment has displaced electrical heating systems. Information such as building type, occupants, and equipment location is collected to validate data and identify process improvements.

2 VALIDATED SAVINGS In 2014, a full-scale evaluation of LIH was not carried out. The evaluation of LIH involved not only substantiating the savings tracked by ENSC who used the parameters established in the 2013 evaluation, but also reasse...

AI summary In 2014, a full-scale evaluation of the Low Income Homeowner (LIH) program was not conducted. The evaluation of LIH involved verifying savings tracked by ENSC using parameters from the 2013 evaluation and reassessing key parameters such as EnerGuide point value, modelled energy consumption, and unitary savings. This section discusses the validation of gross and net savings for LIH.

Non-sampling error Errors arising during the course of all survey activities other than sampling. Non-sampling errors tend to lead to bias in measurements and are very difficult to quantify. Peak demand savings The demand savings that coin...

AI summary The text defines several key terms related to energy efficiency programs and statistical methodologies, including non-sampling error, peak demand savings, precision, random sampling error, sample size, tracked savings, and unitary savings. These terms are relevant to the evaluation and tracking of energy savings in programs managed by Efficiency Nova Scotia Corporation (ENSC).

Participant Survey The participant survey was conducted with a total of 48 homeowner participants. The average length of the survey was 12 minutes. The main purpose of the participant survey was to revise the free-ridership level. Even tho...

AI summary A participant survey was conducted with 48 homeowners to revise the free-ridership level. The survey aimed to assess satisfaction with programs like Performance Plus and New Home Construction. Appendices I and II include the questionnaire and results, respectively.

Satisfaction with Program (S Series) - CS1. How did your company first learn of the programs offered by Efficiency Nova Scotia? DO NOT PROVIDE RESPONSE CATEGORIES. CODE AS MANY AS APPLICABLE. - 1. Media advertising - 2. Respondent was cont...

AI summary The text outlines survey questions related to customer satisfaction with Efficiency Nova Scotia's programs. It asks how companies learned about the programs, their level of direct contact with Efficiency Nova Scotia, and their satisfaction with various factors related to the programs.

APPENDIX VI INTERNAL SPILLOVER METHODOLOGY The marketing of New Home Construction is primarily conducted through builders who receive promotion and awareness documents on various energy efficiency measures. Consequently, market effects, wh...

AI summary The appendix discusses the methodology for calculating internal spillover effects in the context of energy efficiency programs. It focuses on how builders may have implemented energy efficiency measures without formally participating in the New Home Construction or Performance Plus programs, using data from 2014 to estimate market effects.

2 METHODOLOGY This section presents the Econoler team, the methodology used and the activities carried out for the RDI evaluation.

AI summary This section introduces the Econoler team and outlines the methodology and activities undertaken for the RDI evaluation.

2.1 Presentation of the Team To carry out the 2014 evaluation, Econoler worked with two partner entities: Corporate Research Associates (CRA) and Equilibrium Engineering. Tasks were divided as follows: - > Econoler acted as the team leader...

AI summary Econoler led the 2014 evaluation with support from CRA and Equilibrium Engineering. CRA conducted interviews and surveys, while Equilibrium Engineering performed on-site visits and assisted with impact evaluation.

2.2 Evaluation Activities Figure 1 illustrates the research strategy and data collection activities used for the 2014 evaluation. Figure 1: Methodological Model Each step of this methodological model is further detailed in the following su...

AI summary This section outlines the research strategy and data collection activities used for the 2014 evaluation, as illustrated in Figure 1. The methodological model is further detailed in subsequent subsections. Project No. 5870 is referenced in the text.

2.2.1 Interview with Program Manager The Econoler team conducted one interview with the PM in September 2014. This interview was intended, among other things, to follow up on the 2012 evaluation recommendations and to understand the main c...

AI summary An interview was conducted with the Program Manager in September 2014 to follow up on 2012 evaluation recommendations and understand changes to program delivery in 2014. This information was used to prepare a list of questions and topics for data collection tools.

For the quarterly surveys, four series of interviews with a total of 110 participants were conducted using CATI technology during four periods in April, July, October and December 2014. Such surveys were conducted to shorten the time gap b...

AI summary Quarterly surveys using CATI technology were conducted in April, July, October, and December 2014 with 110 participants to evaluate the RDI program's free-ridership and participant satisfaction with Efficiency Nova Scotia. The surveys were 9.5 minutes on average, and results are detailed in Appendices VII and VIII.

3.2 Follow-up on 2012 Evaluation Report Recommendations This section reports on the progress made in acting on the recommendations made by the Evaluator in the 2012 evaluation report. The Evaluator follows up on recommendations from 2012 o...

AI summary This section discusses the follow-up on recommendations from a 2012 evaluation report, noting that the 2013 evaluation was limited to a tracked savings report. A monitoring tool is used to track the implementation status of the recommendations, enhancing the program memory principle.

fficulty retrieving this information, which is used to establish the line loss factor. It should also be noted that this percentage is an improvement from last year's evaluation, down from 35 percent. RDI targets both low-income and non-lo...

AI summary The tracking system used for the RDI program includes features to calculate energy savings, apply income-based net-to-gross ratios, and capture product details. The Evaluator found the system complete and noted that some 2012 recommendations have been implemented, though further improvements are suggested.

4.1 Partner Perspectives Interviews with two DAs were conducted as part of the RDI evaluation. Overall, RDI is viewed as valuable, efficiently administered, and effective in promoting energy efficiency. Changes made to RDI over the past ye...

AI summary The RDI program is viewed as effective and efficiently administered by DAs, though marketing limitations and product selection issues are noted. DAs highlight the importance of referrals and word of mouth in program participation, while expressing concerns about short-term contracts and limited product variety. Suggestions for improving educational outreach and streamlining promotional materials are made.

4.2 Participant Perspectives An annual participant survey and four quarterly surveys were conducted as part of the RDI evaluation. In addition to the questions designed for impact evaluation purposes, survey participants were asked questio...

AI summary An annual participant survey and four quarterly surveys were conducted as part of the RDI evaluation, including questions on program awareness, barriers, and satisfaction, in addition to impact evaluation questions.

5 IMPACT EVALUATION FOR RDI The objective of the 2014 RDI impact evaluation is to determine the gross and net energy savings generated by the energy-efficient products installed in participating households. Both electrical energy and peak...

AI summary The 2014 RDI impact evaluation aims to assess the gross and net energy savings from energy-efficient product installations in participating households, considering factors like unitary savings values, installation rates, and free-ridership.

5.3.2 Internal Spillover The annual participant survey was also used to assess internal spillover, which can occur when participants purchase and install additional energy efficiency products following their previous participation in the p...

AI summary The annual participant survey was used to assess internal spillover, where participants who previously participated in energy efficiency programs purchased additional energy efficiency products. The 2014 survey found a 6% internal spillover effect among non-low-income participants, while the 2012 evaluation found a 3% effect.

This Appendix summarizes all the recommendations made by the Evaluator throughout this report as well as the sections from which the recommendations originated. Sections Recommendations 2 Follow up with DAs to identify the cause of entry e...

AI summary The appendix highlights a recommendation to investigate entry errors by DAs, as discrepancies in installation rates were observed during on-site visits, impacting the gross savings evaluated in 2014. ENSC's quality assurance program did not identify the same issues.

QD1b. If you answered "No", what else can Efficiency Nova Scotia do to involve delivery agents? Very knowledgeable Somewhat knowledgeable Not very knowledgeable Not at all knowledgeable QD4a. How knowledgeable are you/your staff regarding...

AI summary This document contains survey questions related to program performance and stakeholder engagement, focusing on Efficiency Nova Scotia's Residential Direct Installation program and the involvement of delivery agents.

Sampling Methodology For the 2014 RDI impact evaluation, 50 on-site visits were conducted with participants. The sampling plan was developed in September 2014 on the basis of the most up-to-date tracking data available. The sample selected...

AI summary The 2014 RDI impact evaluation involved 50 on-site visits, with a sample split between participants with CFLs and LEDs. The sampling plan aimed to balance participants across Delivery Agents but faced challenges due to differing territory sizes. The evaluation also focused on participants with additional RDI measures installed, such as hot water and Embertec devices, due to prior complaints.

VOLUNTEERED - 97. (Neither satisfied nor dissatisfied) - 98. (Don't know) - 99. (Refused) [IF MOSTLY/COMPLETELY DISSATISFIED IN S.24, CONTINUE, OTHERWISE SKIP TO S26.] - S25. What was the main reason for your dissatisfaction with the quali...

AI summary This section of the proceeding includes customer satisfaction survey questions related to Efficiency Nova Scotia's service quality, including dissatisfaction reasons and recommendations for their programs. It focuses on customer feedback regarding service attitudes, meeting deadlines, and issue resolution.

- S5. Now, using the same 10 point scale, how satisfied are you with Efficiency Nova Scotia's overall performance in working with you? 2 2013 2014 Satisfaction with Overall Performance Sample Size Satisfied Sample Size Satisfied Responsive...

AI summary The text presents survey results measuring customer satisfaction with Efficiency Nova Scotia's performance, including responsiveness, appointment times, and perceived value of services. The data shows high satisfaction levels, with mean scores around 9.4 to 9.6 on a 10-point scale.

APPENDIX X INTERNAL SPILLOVER METHODOLOGY Internal spillover was measured using a participant survey. Participants were asked whether following their participation in the program, they bought and implemented any additional energy efficienc...

AI summary Internal spillover was measured through a survey of program participants to determine if they implemented additional energy efficiency measures outside of rebates. The influence of the program on these additional measures was quantified to calculate the portion of savings attributable to the program.

DEFINITIONS Accuracy Reflects the proximity of measurements to the true value. Bias Systematic deviations of measurements from the true value. Confidence interval The estimated range of values which is likely to include the unknown populat...

AI summary This section provides definitions of key terms related to energy efficiency program evaluation, including concepts like accuracy, bias, confidence interval, distortion effects, free-ridership, gross and net energy savings, and net-to-gross ratio. These definitions support the analysis and measurement of program impacts.

2 METHODOLOGY This section presents the Econoler team involved in this evaluation and reports on the methodology used to evaluate RP&C.

AI summary This section introduces the Econoler team involved in the evaluation of the Rental Properties and Condos Service (RP&C) and outlines the methodology used for the evaluation.

The table below summarizes the validated energy and peak demand savings calculated in the 2014 tracking sheet. To confirm these savings, the Evaluator validated the data and information documented in the tracking system report, and verifie...

AI summary The table summarizes validated energy and peak demand savings from the 2014 tracking sheet. The Evaluator confirmed these savings by validating data and verifying key parameters used in gross and net savings calculations against those from the 2013 evaluation.

- 2. No [SAY "Perhaps you can help me anyway." GO TO INTRODUCTION] [INTRODUCTION] Hello, my name is _______ and I am with CRA, Corporate Research Associates, a Halifax-based survey research company, and we are performing an evaluation of e...

AI summary CRA is conducting an evaluation of Efficiency Nova Scotia's Rental Properties and Condos program, formerly the Multi-Unit Residential Program, and is seeking participant feedback to improve the program.

[ASK IF MEASURES IN COMMON AREAS=YES, IF NOT SKIP TO S SERIES] V3. I am going to read you a list of measures that, according to our records, were installed in the common area of your building(s) by the Program: [READ WHAT IS ON RECORD (MEA...

AI summary The text prompts the respondent to verify whether specific energy efficiency measures, installed in common areas of their building(s) by the Program, are accurate according to records. The respondent is asked to confirm if each measure was installed or not.

MEASURE VERIFIED IN V3 AND V4, RESPONDENT WILL ANSWER ABOUT THIS UNIQUE MEASURE ONLY.) The next questions will be about the [MEASURE 1] you had installed through the program. FR1M1. Did you have any specific plans to install [MEASURE 1] in...

AI summary The text outlines a series of questions related to the installation of a specific measure through the Rental Properties and Condos Program. It asks respondents about their prior plans to install the measure and their likelihood of taking similar actions without the program.

Table 4: Validated Gross Savings Measure Category DHW Air Space Heating Total Program Tracking Sheet Number of Projects 30 3 33 Tracked Energy Savings (GWh) 0.0806 0.0035 0.0841 Validated Energy Savings Adjustment Ratio 1.028 1.000 - Total...

AI summary Table 4 presents validated gross savings from energy efficiency measures, showing energy savings tracked and adjusted for factors like line loss and adjustment ratios, categorized by measure type such as domestic hot water and air space heating.

2014 HER-R1. Explain in greater detail the characteristics of HER in the program documentation. Designed to influence and change participants' electricity use behaviour, HER is different from other program components undertaken by ENSC. Th...

AI summary The Evaluator recommends that the Home Energy Report (HER) program documentation provide more detail on participant selection, tip recommendation processes, and available data. Confidentiality issues prevented full database review, but the methodology was deemed sound. A billing analysis is suggested to compare electricity consumption trends between treatment and control groups over five years to assess HER's impact.

2.2.2 Interviews with Opower During the evaluation process, Econoler conducted various interviews with Opower to collect information required to conduct the impact evaluation and, more precisely, to better understand the program design, th...

AI summary Econoler conducted interviews with Opower to gather information about the program design, participant selection, and billing analysis used to track program savings during the evaluation process.

3.2 Program Documentation As part of the evaluation, the Evaluator analyzed the program documentation and worked together with the PM to improve and revise the content of certain program documents. A number of changes have already been mad...

AI summary The Evaluator reviewed program documentation for the Home Energy Report (HER) and recommended updates to improve clarity and completeness. Key recommendations include updating participant numbers, adding home age criteria for group selection, and enhancing the tip library with an index and categorization. The Evaluator also suggested removing the gross savings calculation from the evaluation plan and ensuring all available data is included.

5 IMPACT EVALUATION FOR PAPER-BASED COMPONENT The objective of the 2014 impact evaluation of HER's paper-based component was to determine the net energy savings. Both electrical energy and demand savings were estimated by analyzing the sav...

AI summary The 2014 impact evaluation of the Home Energy Report's paper-based component aimed to determine net energy and demand savings using Opower's methodology. The evaluation concluded that savings calculated are accepted as 'net' without considering free-ridership effects.

- CS9. And how satisfied were you with the contact centre representative on each of the following service aspects? 2014 Satisfaction with Overall Performance Sample Size Satisfied Service attitude 61 92% Knowledge of programs available 61...

AI summary The text presents customer satisfaction survey results from 2014 regarding ENSC contact centre representatives, measuring satisfaction across service aspects such as service attitude, knowledge of programs, and overall service provided.

Recommendations Overall, the Econoler team assessed that Residential Financing was useful in helping participants complete energy efficiency upgrades. In addition to the general recommendations presented for all ENSC program components in...

AI summary The Econoler team recommends integrating Residential Financing into existing ENSC program components, increasing awareness of the financing option, developing a formal communications timeline, and monitoring the loan disbursement process to improve participant experience and program effectiveness.

3.2 Pilot Design and Evaluation Most incentives offered by energy efficiency programs are meant to offset part or all of the incremental cost of energy efficiency measures. If the participant does not have enough capital to pay for a measu...

AI summary The Evaluator recommends integrating Residential Financing into Green Heat, Solar, and HEA programs for evaluation purposes due to misleading distinctions. Issues with loan disbursement, including delays and misallocation, were reported but resolved by ENSC. Contractors and participants' satisfaction with the process and performance indicators should be monitored.

3.3 Pilot Documentation As part of the evaluation, the Evaluator analyzed the program documentation and worked together with the PM to improve and revise the program manual, the evaluation plan and the logic model, where applicable. More s...

AI summary The Evaluator reviewed pilot documentation for Residential Financing and worked with the Program Manager to revise program materials. Key issues included the need to address barriers like low creditworthiness and the inclusion of alternative financing sources. The Evaluator recommends integrating Residential Financing documentation into Green Heat, Solar, and HEA programs and using a workflow checklist in the Data Management System to improve administrative procedures.

This Appendix presents all recommendations made by the Evaluator throughout this report as well as the sections from which the recommendations originated. Sections Recommendations 3 Develop a formal communications timeline. The interviews...

AI summary The appendix outlines a recommendation to develop a formal communications timeline for the application review and loan disbursement process, based on participant feedback indicating a lack of communication during the preapproval to disbursement period.

Contractor IF No [SAY "Perhaps you can help me anyway." GO TO INTRODUCTION] INTRODUCTION Hello, my name is and I am with CRA (Corporate Research Associates), a Halifax-based survey research company. We are performing an evaluation of servi...

AI summary This text is from a survey conducted by Corporate Research Associates (CRA) on behalf of Efficiency Nova Scotia Corporation (ENSC) to evaluate customer experiences with a program, specifically focusing on whether participants completed home improvements themselves or hired a contractor.

Table 2: Overall Comparison of Tracked and Evaluated Savings at the Generator for BER Initial Gross Savings Adjusted Gross Savings Gross Savings Adjusted with Interactive Effects NTGR Net Savings Energy Savings Tracked Savings from ENSC 32...

AI summary The evaluation of the Business Energy Rebates (BER) program in 2014 showed slightly higher net energy savings compared to tracked savings, but lower peak demand savings. Adjustments in savings calculations for HVAC and lighting increased gross energy savings, while a lower NTGR and lack of diversity factors in tracking reduced net and peak demand savings, respectively.

2.1 Presentation of the Team To carry out the 2014 evaluation, Econoler worked together with two partner entities: Corporate Research Associates (CRA) and Equilibrium Engineering. Tasks were divided as follows: - › Econoler acted as the te...

AI summary Econoler led the 2014 evaluation in collaboration with CRA and Equilibrium Engineering. CRA conducted interviews and surveys, while Equilibrium Engineering performed on-site visits and impact evaluations.

2.2 Evaluation Activities Figure 1 illustrates the research strategy and data collection activities used for the 2014 evaluation. Figure 1: Methodological Model Each step of this methodological model is further detailed in the following su...

AI summary This section outlines the research strategy and data collection activities used for the 2014 evaluation, as illustrated in Figure 1. The methodological model is further detailed in subsequent subsections.

2.2.1 Interview with Program Manager The Econoler team conducted one interview with the project manager (PM) in September 2014. This interview was intended, among other things, to follow up on the 2012 and 2013 evaluation recommendations,...

AI summary An interview with the Program Manager was conducted in September 2014 by the Econoler team to follow up on evaluation recommendations from 2012 and 2013 and to understand changes in program delivery in 2014. A list of questions and topics for data collection tools was prepared based on the interview.

2.2.2 Interviews with Distributors In November and December 2014, eight interviews were conducted by CRA with the participating distributors for BER Instant Rebates. These interviews were mainly used to establish free-ridership levels by e...

AI summary In November and December 2014, CRA conducted eight interviews with distributors for the BER Instant Rebates program to assess free-ridership levels and distributor satisfaction with the program. The interview guide is referenced in Appendix II.

For the quarterly surveys, four series of interviews with a total of 68 participants were conducted in four periods in April, July, October and December 2014, using CATI technology. Such surveys were conducted to shorten the time gap betwe...

AI summary Quarterly surveys were conducted in 2014 using CATI technology with 68 participants across four periods to gather feedback on the BER Mail-in program, focusing on free-ridership and satisfaction. The surveys aimed to reduce the time gap between program participation and evaluation. Results and questionnaires are detailed in appendices, along with population and sample sizes and margin of error at a 90% confidence level.

3 PROCESS EVALUATION This section presents the findings of the 2014 BER process evaluation, which has been carried out based on the information gathered from the BER documentation and tracking system, as well as from an interview with the...

AI summary This section discusses the findings of the 2014 BER process evaluation, based on information from the BER documentation and tracking system and an interview with the PM.

3.2 Follow-up on 2012 and 2013 Evaluation Report Recommendations This section reports on the progress made in acting on the recommendations made by the Evaluator in the 2012 and 2013 evaluation reports. The Evaluator follows up on recommen...

AI summary This section outlines the follow-up on recommendations from the 2012 and 2013 evaluation reports. The Evaluator assessed whether ENSC implemented the recommendations, using a monitoring tool to track progress. A partial evaluation in 2013 did not review the implementation status of the 2012 recommendations.

hat is the sum of all of the measure's savings for the entire project. The Evaluator recommends always using a formula to link the total savings value to the measure's savings value to avoid mistakes. The Evaluator also saw a great improve...

AI summary The Evaluator highlights improvements in the quality of information in the tracking system, noting a higher percentage of complete free ridership responses. However, issues remain with the lack of existing equipment data in ECM and lighting worksheets, which affects the accuracy of impact evaluations.

5 IMPACT EVALUATION FOR BER MAIL-IN The objective of the 2014 impact evaluation for BER Mail-in was to determine the gross and net energy savings. Both electrical energy and peak demand savings were estimated by analyzing the following par...

AI summary The 2014 impact evaluation for BER Mail-in aimed to assess gross and net energy savings by analyzing parameters such as installation rates, equipment features, and load factors. Interactive effects were considered for lighting measures but not for others. Adjustments and diversity factors were established based on documentation and on-site visits.

5.1.3 Commercial Refrigeration Measures Three commercial refrigeration projects were sampled as part of the 2014 evaluation. The tracked energy savings were underestimated for all the three projects, and the tracked demand savings were und...

AI summary Three commercial refrigeration projects were evaluated, revealing underestimated energy and demand savings. Discrepancies in calculations and incorrect algorithm application led to revised savings estimates, with energy savings increasing by 31.2% and demand savings by 27.3%.

S2. You indicated a score of [answer from S1] on a 5-point scale for your overall satisfaction with the program. For what reasons were you not satisfied with the program overall? Reasons for Dissatisfaction 2012 (#) 2014 (#) Sample Size 3...

AI summary The document presents survey results regarding participant dissatisfaction with a program, highlighting reasons such as delays in receiving rebates, difficulty in signing up, insufficient rebate amounts, and lack of helpful staff. It also evaluates the ease of participating in the program, with many respondents finding it challenging due to information gaps, lengthy processes, and excessive paperwork.

APPENDIX VI QUARTERLY SURVEY RESULTS The BER Mail-in participant quarterly survey results are presented in the following tables.

AI summary This section presents the quarterly survey results for BER Mail-in participants, providing insights into their experiences and feedback.

\ \ Percentage of respondents who gave a rating of completely or mostly satisfied where 5 = 'Very satisfied' and 1 = 'Not at all satisfied'; Don't know removed from calculations \ \ Source: 2012 C-Sat Commercial Study S29. And based on you...

AI summary The text discusses customer satisfaction with Efficiency Nova Scotia's programs, referencing a 2012 C-Sat Commercial Study and asking respondents how likely they are to recommend the programs to others.

FR2a. If your company had not participated in BER, what is the likelihood that you would have installed exactly the same energy-efficient equipment that you installed through the program? (Scale 0 to 10) IF Pre-FR3 = Yes: FR2a = (Answer x...

AI summary The text outlines a set of questions and formulas used to calculate a PA1 score related to the Business Energy Rebates (BER) program. It assesses the likelihood that a company would have installed energy-efficient equipment without the program and how the score is calculated based on responses.

Satisfaction In 2014, nearly all participants claimed to be satisfied with Custom Retrofit overall. Other program aspects generally received good ratings, with the majority of participants offering good ratings for the initial confirmation...

AI summary In 2014, most participants were satisfied with the Custom Retrofit program, though satisfaction was lower for the timeliness of incentives and the paperwork involved. Despite this, all participants would recommend the program and consider participating in other ENSC programs.

2.2.2 Survey In the fall of 2014, CRA staff in Halifax conducted a telephone survey with a total of 11 Custom Retrofit participants, using computer-assisted telephone interviewing (CATI) technology. The average length of the survey was 16...

AI summary In 2014, CRA conducted a telephone survey with 11 Custom Retrofit participants to gather feedback on free-ridership, program awareness, motivations, satisfaction, and recommendations. A census was conducted due to the small population size of 27 participants.

2013 Executive Summary Recommendations Some recommendations made in the executive summary section of the 2013 evaluation report were very similar to those proposed in the 2012 evaluation report. It is the case for the recommendation aimed...

AI summary The 2013 Executive Summary Recommendations highlight issues with diversity factor calculations and the use of non-standardized methodologies in estimating energy savings from non-lighting projects. The report recommends the development of standardized tools, independent M&V, and screening tools to improve accuracy and compliance in Custom Retrofit projects.

Evaluation Report The Evaluation Report tab contains the most information, and is similar in scope to the 2013 tracking sheet used by ENSC. Information contained in this tab includes: project ID, project status, ENSC project owner, partici...

AI summary The Evaluation Report provides detailed tracking of energy and peak demand savings, including project IDs, participant contact information, and incentive payments. However, it lacks line loss factors and Nova Scotia Power rate codes, making it difficult to calculate savings at the meter. The report also notes that adding facility contact information has improved on-site coordination and evaluation processes.

Documents The Documents tab contains the most detailed information about the 2014 Custom Retrofit projects; it typically includes scoping studies, feasibility studies, the project development agreement (PDA), M&V documentation and other pr...

AI summary The 2014 Custom Retrofit tracking system is considered adequate with signs of improvement, but recommendations include adding Nova Scotia Power rate codes, explaining diversity factors, and identifying M&V adjustments in the DSMDS report to enhance evaluation accuracy and data clarity.

4.1 Participant Perspectives A participant survey was conducted as part of the Custom Retrofit evaluation. In addition to the questions designed for impact evaluation purposes, survey participants were asked questions related to program aw...

AI summary A participant survey was conducted as part of the Custom Retrofit evaluation, including questions on program awareness, influence, and satisfaction, in addition to impact evaluation questions.

5 IMPACT EVALUATION FOR CUSTOM RETROFIT The objective of the 2014 impact evaluation for Custom Retrofit was to determine the gross and net energy savings. Both electrical energy and peak demand savings were estimated by analyzing the follo...

AI summary The 2014 impact evaluation for Custom Retrofit aimed to assess gross and net energy savings by analyzing feasibility studies, M&V reports, on-site visits, and participant feedback, while considering factors like free-ridership and internal spillover.

5.2.2 Internal Spillover For Custom Retrofit, internal spillover occurs when participants implement eligible energy efficiency measures under the influence of their previous participation in the program, yet without having any kind of addi...

AI summary The 2013 and 2014 evaluations of the Custom Retrofit program found minimal internal spillover, with only 1% identified in 2013 and no significant spillover in 2014. The Evaluator tested new methods, including a web-based survey for free-ridership, but it was not effective due to low response rates. An Embedded Energy Manager (EEM) was investigated for potential spillover, but no significant impact was found.

6.2.1 Validated Gross Savings As explained in previous sections, the Evaluator did not make adjustments to the gross savings value reported by ENSC. The tracked gross energy savings values reported by ENSC are summarized in the table below...

AI summary The Evaluator did not adjust the gross savings values reported by ENSC, as explained in previous sections. Tracked gross energy savings values are summarized in a table, with no demand savings claimed for either of the two components.

This Appendix presents all recommendations made by the Evaluator throughout the report as well as the sections from which the recommendations originated. Sections Recommendations 2 Improve the information presented in the DSMDS reports. Th...

AI summary The Evaluator recommends improving the DSMDS reports by adding details such as line loss factor, rate code, verified savings at the meter, and free-ridership screening results. It also suggests including both total and current-year savings for better sample selection and adding unique identification codes for ongoing M&V adjustments.

Sections Recommendations Program Documentation and Design 7 The Evaluator also recommends continuing to monitor the types of projects submitted to Custom Retrofit in order to identify whether measures of the same type (becoming less custom...

AI summary The document outlines recommendations for improving program documentation and design, including monitoring project types in the Custom Retrofit program and ensuring standardized reporting of energy-saving measures. It also suggests collecting equipment specifications and providing a standardized summary for service providers to report implemented measures accurately.

INTRODUCTION Hello, my name is ______ and I am with CRA (Corporate Research Associates), a Halifax-based survey research company. We are performing an evaluation of energy efficiency services provided by Efficiency Nova Scotia Corporation....

AI summary A representative from CRA is conducting a survey to evaluate Efficiency Nova Scotia Corporation's Custom Retrofit Program, seeking feedback from participants to improve the program. The survey is expected to take about fifteen minutes.

2014 Evaluation Report

AI summary The 2014 Evaluation Report provides an assessment of energy efficiency initiatives and programs implemented during that year, focusing on their effectiveness and impact.

implemented? Please answer on a scale of 0 to 10, with a 0 indicating that you "Definitely Would Not Have Paid and/or Financed" and a 10 indicating that you "Definitely Would Have Paid and/or Financed." [PROBE FOR SPECIFIC RESPONSE – DO NO...

AI summary The text presents a survey asking respondents to rate on a scale of 0 to 10 their likelihood of having paid and/or financed energy efficiency measures, as well as the importance of factors influencing their decision to implement such measures through a program.

APPENDIX V INTERNAL SPILLOVER METHODOLOGY Internal spillover was measured using on-site visits. Participants were asked whether following their participation in the program, they implemented any additional energy efficiency measures, witho...

AI summary Internal spillover was measured through on-site visits, where participants were asked if they implemented additional energy efficiency measures outside of rebate programs. The influence of the program on these measures was quantified to determine the portion of savings attributable to the program, and internal spillover was calculated by dividing this attributable savings by total program savings.

6. Pre-Visit Assessment of the Project key observations fron main information to co report analysis. These no otes will serve on site to guide the visit and _ e Observations a on-site visit and indicate _ linas made on site. Tioport and I...

AI summary The text outlines a pre-visit assessment framework for a project, including key observations, spillover assessments, M&V post-implementation results, seasonal load profiles, and notes from M&V reports. The table format suggests a structured approach to evaluating project performance and outcomes.

DEFINITIONS Billing calibration An activity that consists in adjusting the expected energy savings based on the relative difference between the results of the building energy simulations and the actual energy consumption of the building. D...

AI summary The text defines key terms related to energy efficiency program evaluation, including billing calibration, distortion effects, free-ridership, gross and net energy savings, and net-to-gross ratio. These definitions are used to measure and evaluate the impact of energy efficiency initiatives.

Evaluation Report The evaluation report tab contains general project information including project ID, project status, ENSC project owner, participant/facility contact information, verified energy/peak demand savings, incentive(s) paid, ve...

AI summary The evaluation report highlights missing information in ENSC's tracking reports, such as line loss factors and Nova Scotia Power rate codes, which hinder accurate calculation of project savings. It also notes improvements made in 2014, including adding facility contact details to aid coordination and evaluation.

Project Summary The Project Summary tab of the DSMDS contains all of the relevant information required for a quick overview of any Customer NC project. Information within this tab includes the project information, notes, milestone dates, p...

AI summary The Project Summary tab in the DSMDS provides an overview of Customer NC projects, including budget, savings, and contact information. ENSC added sections for free-ridership screening and facility details to improve data collection and program offerings.

Documents The Documents tab contains the most detailed information about the 2014 Custom Retrofit projects, and typically includes the modelling summary report, the ENSC NC-EM2 Excel document, relevant calculation workbooks and other proje...

AI summary The Documents tab contains detailed information on the 2014 Custom Retrofit projects, including reports and project communications. While file-naming conventions are not standardized, document types and names are used for navigation. Missing files are stored internally and made available upon request. The Evaluator concludes the tracking system is adequate and improving, with recommendations for adding Nova Scotia Power's rate code and explaining diversity factor calculations.

4 IMPACT EVALUATION The objective of the 2014 Custom NC impact evaluation was to determine the gross and net savings. Both electrical energy and peak demand savings were estimated by analyzing the following: - › Feasibility studies, buildi...

AI summary The 2014 Custom NC impact evaluation aimed to assess gross and net savings from energy efficiency measures, analyzing feasibility studies, energy model simulations, M&V reports, interviews, billing calibration results, and free-ridership data. The evaluation involved reviewing nine project files, on-site visits, and participant interviews.

The Evaluator reviewed the protocol used in 2013 and deemed it appropriate for the 2014 impact evaluation, with the exception of minor adjustments. These adjustments included a space allocated for a list of the project's key variables, and...

AI summary The Evaluator reviewed and adjusted the 2013 protocol for the 2014 impact evaluation, incorporating a space for key variables and a free-ridership questionnaire checkbox. The protocol included tools like the on-site form, DSMDS files, and the free-ridership questionnaire to collect project details, building systems data, and utility bill information for evaluation.

n site. These files typically included items such as the initial energy model results, M&V reports, the Project Development Agreement (PDA), email correspondence and equipment drawings/specifications. The Evaluator used the provided inform...

AI summary The evaluation process involved reviewing project documents, conducting on-site verification, and using free-ridership questionnaires to assess the impact of funding on energy efficiency improvements in Custom NC participants. The process followed ASHRAE guidelines and included interviews and data collection.

重 ECC NOL≣R Net-to-gross ratio The ratio between the net energy savings and gross energy savings. Non-sampling error Errors arising during the course of all survey activities other than sampling. Non-sampling errors tend to lead to bias in...

AI summary The document defines several key terms related to energy efficiency and measurement, including net-to-gross ratio, non-sampling error, peak demand savings, precision, random sampling error, sample size, tracked savings, and unitary savings. These concepts are relevant to program evaluation and data collection in energy efficiency initiatives.

5.5 Net-to-Gross Ratios 49 5.5.1 Net-to-Gross Ratio for BES49 5.5.2 Net-to-Gross Ratio for RP&C Common Areas50 5.5.3 Net-to-Gross Ratio for the LED Blitz Pilot51 5.6 Net Savings51 5.6.1 Net Savings for BES Lighting Measures51 5.6.2 Net Sav...

AI summary The document outlines sections related to Net-to-Gross Ratios and Net Savings for various energy efficiency programs, including BES, RP&C Common Areas, and the LED Blitz Pilot. It includes appendices with recommendations, sampling protocols, participant surveys, and calculation methodologies.

Energy Savings The 2014 impact evaluation of BES was divided into four categories: BES lighting measures, BES non-lighting measures, measures implemented in RP&C common areas and measures implemented through the LED Blitz pilot. To calcula...

AI summary The 2014 impact evaluation of the Business Energy Solutions (BES) program categorized energy savings into lighting, non-lighting, and common area measures. The evaluation used on-site visits and surveys to estimate savings and account for free-ridership and spillover effects, with a 17% free-ridership rate and 0.3% spillover for BES, and 17% free-ridership for RP&C common area measures. The LED Blitz pilot assumed a net-to-gross ratio of 1.

Annual Survey For the annual survey, the interviews were conducted in October and November 2014 using computer-assisted telephone interviewing (CATI) technology. The average length of the survey was 9 minutes. The annual survey was used to...

AI summary The annual survey conducted in 2014 using CATI technology aimed to understand aspects of the Business Energy Solutions (BES) program, including spillover, program awareness, participant motivations, satisfaction, and recommendations for improvement. Survey results are detailed in Appendices III and IV.

Quarterly Surveys For the quarterly surveys, four rounds of interviews with a total of 129 participants were conducted in April, July, October and December 2014, using CATI technology. These surveys were conducted to shorten the time perio...

AI summary Quarterly surveys were conducted in 2014 with 129 participants to evaluate the BES program and understand free-ridership and satisfaction levels. Surveys averaged 9 minutes and were conducted using CATI technology. Results are detailed in Appendix V and VI, with population and sample size data provided in a table.

2.2.3 Unitary Savings Review To review the unitary savings values used in the tracking sheet, the Econoler team validated the parameters currently used in the tracked savings calculations by conducting a literature review of similar techni...

AI summary The Econoler team conducted a literature review and used engineering calculations to validate the unitary savings values in the tracking sheet, ensuring the use of the most recent and accurate data sources when reliable information was unavailable.

5 IMPACT EVALUATION The objective of the 2014 BES impact evaluation is to determine the gross and net energy savings associated with the measures implemented through BES, including the BES lighting and non-lighting measures, as well as mea...

AI summary The 2014 BES impact evaluation assesses energy savings from lighting and non-lighting measures, as well as common area and LED Blitz initiatives. It considers factors like unitary savings, installation rates, diversity factors, and free-ridership. Data from on-site visits, surveys, and previous evaluations are used to calculate net-to-gross ratios for the programs.

The following table compares the energy and peak demand savings established by this evaluation and those calculated in the 2014 tracking system.

AI summary The text references a comparison table between energy and peak demand savings from a recent evaluation and those calculated in the 2014 tracking system, indicating a focus on energy efficiency program performance tracking.

Table 34: Comparison of Tracked and Evaluated Savings Associated with LED Blitz at the Generator Initial Gross Savings Installed Gross Savings Installed Gross Savings with Interactive Effects NTGR Net Savings Energy Savings Tracked Savings...

AI summary Table 34 compares tracked and evaluated savings from the LED Blitz pilot program. Evaluated savings are 22% and 23% higher than tracked savings for energy and peak demand, respectively. The main factor explaining this difference is not specified in the text.

APPENDIX IV ANNUAL PARTICIPANT SURVEY RESULTS The BES participant survey results are presented in the following tables. - P2. What was the SINGLE most important reason your company or organization chose to participate in the Business Energ...

AI summary This section presents the results of the BES participant survey, focusing on the single most important reason companies or organizations chose to participate in the Business Energy Solutions program.

INTRODUCTION Hello, I am with CRA (Corporate Research Associates), and we are performing an evaluation of energy efficiency services provided by Efficiency Nova Scotia Corporation. Our records indicate that you or your firm recently partic...

AI summary CRA is conducting an evaluation of Efficiency Nova Scotia Corporation's Business Energy Solutions Program and is seeking input from participants. The survey aims to assess program effectiveness and identify areas for improvement.

- j. The ability to provide estimates of the savings or return on investment associated with the program. Response 98 Don't Know 99 Refused S5. performance in working with your business? [CODE ONE ONLY] Now, using the same 10 point scale,...

AI summary The text discusses the ability to provide estimates of savings or return on investment for a program, with some survey responses indicating 'Don't Know' or 'Refused' as answers. It also includes survey questions about performance and satisfaction with Efficiency Nova Scotia's services.

APPENDIX VI QUARTERLY PARTICIPANT SURVEY RESULTS The BES participant quarterly survey results are presented in the following tables.

AI summary This section presents the quarterly participant survey results for the BES program, providing insights into participant experiences and feedback.

\ \ Percentage of respondents who gave a rating of completely or mostly satisfied where 5 = 'Very satisfied' and 1 = 'Not at all satisfied'; Don't know removed from calculations \ \ Source: 2012 C-Sat Commercial Study \ \ \ Source: 2013 an...

AI summary The text discusses customer satisfaction with Efficiency Nova Scotia's programs, referencing survey data from 2012 and 2013, and asks respondents how likely they are to recommend these programs to others.

2.2 Methodological Model The figure below illustrates the research strategy used and the different activities involved in the 2014 evaluation. Figure 1: Methodological Model

AI summary This section outlines the methodological model used in the 2014 evaluation, which includes a visual representation of the research strategy and activities involved. The figure illustrates the approach taken to assess the effectiveness of the programs and initiatives.

Custom NTGR Custom Retrofit Unnamed: 1 Unnamed: 2 Unnamed: 3 Unnamed: 4 Unnamed: 5 Unnamed: 6 Unnamed: 7 Unnamed: 8 FR1a. I just want to make sure I understand - Before you decided to participate in RDI, you had already made the decision t...

AI summary The text outlines a survey related to the Custom Net Grant Recovery (NTGR) program, focusing on participant responses regarding their decision to participate in the Residential Direct Install (RDI) program, their willingness to pay for energy-efficient products, and the influence of the program on their decisions.

ABBREVIATIONS CATI Computer-assisted Telephone Interviewing CBSM Community-based Social Marketing CSA Canadian Standard Association CRA Corporate Research Associates DA Delivery Agent DSM Demand-side Management EER Energy Efficiency Ratio...

AI summary The document lists abbreviations relevant to energy efficiency, demand-side management, and regulatory proceedings in Nova Scotia. Key terms include DSM (Demand-side Management), ENSC (Efficiency Nova Scotia Corporation), and OPA (Ontario Power Authority), reflecting programmatic, methodological, and organizational elements central to the proceeding.

DEFINITIONS Accuracy Reflects the proximity of measurements to the true value. Bias Systematic deviations of measurements from the true value. Confidence interval The estimated range of values which is likely to include the unknown populat...

AI summary This section defines key terms related to energy efficiency program evaluation, including accuracy, bias, confidence intervals, distortion effects, free-ridership, internal spillover, and net energy savings. It outlines the importance of these metrics in assessing the effectiveness of energy efficiency initiatives.

EXECUTIVE SUMMARY This report presents the results of the 2014 process, market and impact evaluation of Home Energy Report (HER), also known as the Energy Savings Actions program. The 2014 evaluation was based on the data and information c...

AI summary The 2014 evaluation of the Home Energy Report (HER) program, also called Energy Savings Actions, included interviews with the Program Manager and Opower, a survey of 340 participants, billing analysis, and savings reviews to assess program impact and effectiveness.

Program Component Overview The purpose of HER is to enable participating households to compare their energy usage with similar neighbouring homes by mailing to participating households periodic reports illustrating their energy usage patte...

AI summary The Home Energy Report (HER) program mails households periodic energy usage reports and tips to reduce consumption. In April 2013, Opower (DA) targeted 98,000 households, with a web portal launched in October 2013. HER aimed for 15.4 GWh energy savings and 3.6 MW demand savings in 2014.

Evaluation Approach for the Paper-based Component In 2012, the State and Local Energy Efficiency Action Network (SEE Action), facilitated by the U.S. Department of Energy and U.S. Environmental Protection Agency, developed a guideline on h...

AI summary The evaluation approach for the paper-based component references a 2012 SEE Action guideline recommending randomized controlled trials (RCT) and panel data analysis for behavior-based energy programs. Opower used RCT to quantify HER savings, but ENSC did not follow the guideline's independent evaluation requirements due to pre-existing contracts and confidentiality issues with Econoler, limiting data access.

Key Findings Since its inception in 2013, a total of 93,119 participants have taken part in the paper-based component of HER, and 10,669 participants have taken part in the web-based component. In terms of net energy savings for 2014, the...

AI summary The Home Energy Report (HER) program, since 2013, has engaged 93,119 paper-based and 10,669 web-based participants. In 2014, HER achieved 25.336 GWh (paper) and 0.100 GWh (web-based) net energy savings, totaling 25.437 GWh, alongside 2.892 MW of peak demand savings.

Influence of HER on Behavioural Changes Participants in the web-based component of HER were first asked a number of survey questions about energy efficiency behaviours to find out whether they had adopted one or more of them in the 12 mont...

AI summary Participants in HER reported low influence (1.6-4.3/10) on adopting energy efficiency behaviors, yet post-HER data showed increased laundry in cold water, reduced shower time, and more frequent laundry drying. Most respondents indicated they would have adopted these behaviors without HER.

Energy Savings To calculate the net savings of HER in 2014, the Econoler team first reviewed the methodology used by Opower for calculating the paper-based component savings. The energy savings achieved by the paper-based component are con...

AI summary The document details the evaluation of the Home Energy Report (HER) program's energy savings in Nova Scotia. Econoler calculated net savings by comparing paper-based and web-based components, using control groups and self-reported data. HER achieved 34.711 GWh energy savings and 3.938 MW demand savings from April 2013 to December 2014.

Recommendations Overall, the Econoler team finds that the paper-based component of HER has succeeded in achieving the expected results in terms of changing participants' electricity consumption behaviour. The impact of the web-based compon...

AI summary The Econoler team found the paper-based HER component effective in changing electricity consumption behavior, while the web-based component's impact remains unclear. Recommendations focus on optimizing HER, building on 2014 DSM program evaluations. Key emphasis is on improving the web-based component's effectiveness.

2014 HER-R1. Explain in greater detail the characteristics of HER in the program documentation. Designed to influence and change participants' electricity use behaviour, HER is different from other program components undertaken by ENSC. Th...

AI summary The Evaluator emphasizes the need for detailed documentation of HER's characteristics, challenges, and evaluation methods. Key issues include discrepancies in participant numbers, selection processes, data confidentiality, and the need for comprehensive evaluation plans. Recommendations focus on validating data adjustments, comparing treatment/control groups, and analyzing long-term electricity consumption trends.

1 PROGRAM DESCRIPTION Home Energy Report (HER) helps Nova Scotian households reduce their energy consumption by changing their behaviours. More specifically, HER compares participating households' energy usage with similar neighbouring hom...

AI summary The Home Energy Report (HER) program in Nova Scotia aims to reduce household energy consumption through behavioral changes by comparing participants' usage with neighbors. Delivered via a tripartite agreement between Efficiency Nova Scotia Corporation (ENSC), Opower (DA), and Nova Scotia Power, HER was launched in 2013 with funding from rate-payers and tax-payers. It targeted 15.4 GWh energy savings and 3.6 MW demand savings in 2014 under the Energy Savings Actions program.

2 METHODOLOGY This section presents the Econoler team, the methodology used and the activities carried out for the HER evaluation.

AI summary This section outlines the Econoler team's role, the methodology employed, and activities conducted for the Home Energy Report (HER) evaluation. It focuses on the team's approach to assessing the HER program's effectiveness within the regulatory proceeding.

2.1 Presentation of the Team To carry out the 2014 evaluation, Econoler collaborated with Corporate Research Associates (CRA). Tasks were divided as follows: - > Econoler acted as the team leader and was responsible for coordinating all ev...

AI summary In 2014, Econoler collaborated with Corporate Research Associates (CRA) for an evaluation, with Econoler leading coordination and deliverables. CRA conducted telephone surveys and data analysis for the Home Energy Report's (HER) web-based component, highlighting task division between the two organizations.

2.2 Evaluation Activities Figure 1 illustrates the research strategy and data collection activities used for the 2014 evaluation. Analysis of Program Documentation Interviews Figure 1: Methodological Model Each step of this methodological...

AI summary Section 2.2 outlines evaluation activities, including a methodological model (Figure 1) with steps described in sub-sections. Key activities involve program documentation analysis, interviews, and data collection as part of the 2014 evaluation.

2.2.2 Interviews with Opower During the evaluation process, Econoler conducted various interviews with Opower to collect information required to conduct the impact evaluation and, more precisely, to better understand the program design, th...

AI summary Econoler interviewed Opower to gather data for an impact evaluation, focusing on program design, participant selection in treatment and control groups, and billing analysis methods used to track program savings.

2.2.5 Unitary Savings Review Econoler established the unitary savings values for seven tips selected to quantify the savings associated with the web-based component. To choose the most recent and accurate data sources for establishing the...

AI summary Econoler determined unitary savings values for seven web-based tips by reviewing technical manuals, studies, and public reports. When reliable data was unavailable, engineering calculations were used to estimate savings.

3 PROCESS EVALUATION This section presents the findings from the process evaluation of HER, which has been carried out on the basis of the information gathered from the documentation and an interview with the PM.

AI summary The process evaluation of the Home Energy Report (HER) program was conducted using documentation and an interview with the Program Manager (PM) to assess the program's implementation and effectiveness.

3.2 Program Documentation As part of the evaluation, the Evaluator analyzed the program documentation and worked together with the PM to improve and revise the content of certain program documents. A number of changes have already been mad...

AI summary The Evaluator reviewed program documentation for HER and recommended updates to clarify participant selection, criteria, and tip processes. They suggested removing gross savings calculations for HER, enhancing evaluation plan comprehensiveness, and improving tip library organization with an index. The Evaluator praised HER's report quality but noted cross-program tip references.

3.3 Tracking System Opower is in charge of tracking the savings of the paper-based component and submits savings summary reports to ENSC every month. ENSC has created its own internal tracking system using some of the data provided in thes...

AI summary Opower tracks paper-based component savings for ENSC, submitting monthly reports. ENSC uses internal systems for data analysis, but web-based component savings lack tracking. Reports include electricity savings, opt-outs, and web metrics. Opower provides customer databases (excluding web phone numbers) and tip actions, though data comparison is limited. CRA was commissioned to obtain missing phone numbers for surveys.

5 IMPACT EVALUATION FOR PAPER-BASED COMPONENT The objective of the 2014 impact evaluation of HER's paper-based component was to determine the net energy savings. In 2012, the State and Local Energy Efficiency Action Network (SEE Action), f...

AI summary The 2014 impact evaluation of HER's paper-based component aimed to assess net energy savings. SEE Action's guidelines recommended using RCT and panel data analysis, but Opower's evaluation lacked independent data cleaning and group assignment. Econoler's evaluation focused on verifying Opower's methodology due to confidentiality issues and prior contract constraints. No free-ridership effects were considered in the accepted savings calculations.

5.1 Methodology Review The approach to the impact evaluation involved reviewing the billing analyses performed by Opower. The savings are established by comparing the consumption of a group of participants (treatment group) to that of a gr...

AI summary The impact evaluation methodology reviewed Opower's billing analysis, comparing consumption between a treatment group (participants) and a control group (similar attributes) to establish energy savings.

6 IMPACT EVALUATION FOR WEB-BASED COMPONENT The Econoler team conducted a survey with customers who signed up on the HER web portal to look at specific tips that they could have implemented because of the report. When selecting the list of...

AI summary Econoler evaluated the impact of HER web portal tips by excluding redundant, low-saving, or hard-to-implement measures. Surveyed tips included energy-efficient appliances, insulation, and behavioral changes. Savings calculations follow.

Energy Calculation The average participant's energy savings associated with a typical window equipped with heat-shrink film in a residential building in Nova Scotia are calculated as follows: Energy $$kWh = Cp \times Q \times HDD \times 24...

AI summary The document calculates energy savings from heat-shrink film on windows using a formula involving Cp, Q, HDD, and 24 hours, resulting in 74.2 kWh. A survey found 25 participants (7.4% implementation rate) applied this measure in the past year.

6.1.7 Hang Laundry to Dry To calculate the unitary savings value associated with this behaviour, the energy consumption of the clothes dryer was estimated for each laundry load. Using the results of the 2014 annual survey for RDI, the aver...

AI summary The evaluation calculates energy savings from hanging laundry to dry by estimating dryer energy use (912 kWh/year) and using survey data showing a 0.5 increase in loads hung to dry. Savings were calculated at 46.5 kWh/year per household, with 46.2% implementation. All savings assumed electric due to low gas dryer prevalence in Nova Scotia.

6.3 Net-to-gross Ratio This section discusses HER web-based component's NTGR evaluation, which included the assessment of the free-ridership level associated with each product category.

AI summary The section evaluates the HER web-based component's Net-to-Gross Ratio (NTGR), focusing on assessing free-ridership levels across different product categories.

6.3.1 Free-ridership In HER's web-based component, free-ridership occurs when participants declare that they would still have implemented the energy-efficient measures in the absence of the program. The free-ridership level of each product...

AI summary The document discusses free-ridership in HER's web-based component, where participants claim they would have adopted energy-efficient measures regardless of the program. Free-ridership levels are assessed via surveys measuring participants' likelihood of adopting behaviors without HER and the influence of the online report. Responses are converted into program attribution to calculate free-ridership for each product category.

CONCLUSION Launched in 2013, HER is an innovative program intended to promote behavioural changes towards greater energy efficiency. Since its inception, a total of 93,119 participants have taken part in the paper-based component of HER, a...

AI summary HER, launched in 2013, has 93,119 paper-based and 10,662 web-based participants. The paper-based component achieved 34.498 GWh savings, while the web-based component had minimal impact (0.291 GWh). Evaluations showed mixed results, with the paper-based component effectively changing behavior but the web-based component showing limited influence. Net savings totaled 34.789 GWh, calculated using control groups for paper-based and self-reported data for web-based components.

This Appendix summarizes all the recommendations made by the Evaluator throughout this report as well as the sections from which the recommendations originated. Sections Recommendations Executive Summary 1 Explain in greater detail the cha...

AI summary The appendix outlines recommendations from the Evaluator regarding the Home Energy Report (HER) program. It suggests detailing HER's characteristics, reviewing Opower's databases, and conducting a billing analysis to compare electricity consumption trends between treatment and control groups over five years.

Program Participation (Series P) - P1. What was the SINGLE most important reason you decided to sign up online for your Home Energy Report? [ACCEPT ONE RESPONSE] [DO NOT READ] - 1. (To save on energy/to save on energy costs) - 2. (Comfort)...

AI summary The text outlines survey questions about participation in the Home Energy Report (HER) and prior engagement with Efficiency Nova Scotia's programs. It includes multiple-choice options for reasons for signing up, follow-up questions, and inquiries about previous program participation.

tisfied - 2. Mostly satisfied - 3. Mostly dissatisfied - 4. Completely dissatisfied - 7. (Neither satisfied nor dissatisfied) - 8. (Don't know) - 9. (Refused) - CS9. And how satisfied were you with the contact centre representative on each...

AI summary The document outlines survey questions assessing customer satisfaction with Efficiency Nova Scotia's programs, including satisfaction with contact centre representatives' service attitude, program knowledge, and advice quality. It also evaluates likelihood of recommending programs and future participation. Response options include satisfaction scales and likelihood categories.

HOME ENERGY REPORT 2014 DSM EVALUATION

AI summary Evaluation of Demand Side Management (DSM) programs in Nova Scotia's Home Energy Report for 2014, part of a regulatory proceeding assessing energy efficiency initiatives and their impact on electricity demand.

EFFICIENCY NOVA SCOTIA CORPORATION Final Report February 26March 18, 2015 2014 DSM Evaluation Report

AI summary Efficiency Nova Scotia Corporation submitted a final report dated February 26–March 18, 2015, including a 2014 Demand Side Management (DSM) Evaluation Report as part of a regulatory proceeding.

DEFINITIONS Accuracy Reflects the proximity of measurements to the true value. Bias Systematic deviations of measurements from the true value. Confidence interval The estimated range of values which is likely to include the unknown populat...

AI summary The document defines key terms related to energy efficiency program evaluation, including accuracy, bias, confidence intervals, free-ridership, and net energy savings, among others. These definitions are used to assess the effectiveness and reliability of energy efficiency initiatives.

EXECUTIVE SUMMARY This report presents the results of the 2014 process, market and impact evaluation of Home Energy Report (HER), also known as the Energy Savings Actions program. The 2014 evaluation was based on the data and information c...

AI summary This report details the 2014 evaluation of the Home Energy Report (HER) program, also called Energy Savings Actions. It analyzed data from interviews with the Program Manager (PM) and Opower, a survey of 340 HER participants, billing analysis, and unitary savings reviews to assess program effectiveness.

Program Component Overview The purpose of HER is to enable participating households to compare their energy usage with similar neighbouring homes by mailing to participating households periodic reports illustrating their energy usage patte...

AI summary The Home Energy Report (HER) program mails households periodic energy usage comparisons and efficiency tips to reduce consumption. Opower, as the delivery agent, mailed reports to 98,000 households starting in April 2013, with a web portal launched in October 2013. HER aimed for 15.4 GWh electrical energy savings and 3.6 MW demand savings in 2014.

Evaluation Approach for the Paper-based Component In 2012, the State and Local Energy Efficiency Action Network (SEE Action), facilitated by the U.S. Department of Energy and U.S. Environmental Protection Agency, developed a guideline on h...

AI summary The document discusses the evaluation of Opower's Home Energy Report (HER) using methods recommended by SEE Action, including randomized controlled trials (RCT) and panel data analysis. However, Opower's evaluation lacked independent assignment of control/treatment groups, and confidentiality issues limited data access for Econoler's verification. Econoler focused on validating Opower's methods rather than estimating savings directly.

Key Findings Since its inception in 2013, a total of 93,119 participants have taken part in the paper-based component of HER, and 10,669 participants have taken part in the web-based component. In terms of net energy savings for 2014, the...

AI summary The Home Energy Report (HER) program, since 2013, has engaged 93,119 participants in its paper-based component and 10,669 in the web-based component. In 2014, HER achieved 25.437 GWh of net energy savings and 2.892 MW of peak demand savings.

Energy Savings To calculate the net savings of HER in 2014, the Econoler team first reviewed the methodology used by Opower for calculating the paper-based component savings. The energy savings achieved by the paper-based component are con...

AI summary The Econoler team evaluated HER's energy savings by analyzing Opower's paper-based methodology and using surveys for web-based components. Net savings of 34.711 GWh and 3.938 MW were recorded from April 2013 to December 2014, using control groups and self-declared participant data.

Recommendations Overall, the Econoler team finds that the paper-based component of HER has succeeded in achieving the expected results in terms of changing participants' electricity consumption behaviour. The impact of the web-based compon...

AI summary The Econoler team found the paper-based component of HER successful in changing electricity consumption behavior, but the web-based component's impact was unclear. Key recommendations include detailing HER's characteristics in documentation, reviewing Opower's databases, and conducting a billing analysis comparing treatment and control groups. These steps aim to improve evaluation accuracy and program effectiveness.

1 PROGRAM DESCRIPTION Home Energy Report (HER) helps Nova Scotian households reduce their energy consumption by changing their behaviours. More specifically, HER compares participating households' energy usage with similar neighbouring hom...

AI summary The Home Energy Report (HER) program, managed by Efficiency Nova Scotia Corporation (ENSC) and delivered by Opower, aims to reduce energy consumption through behavioral changes. It compares households' energy use with neighbors and provides personalized tips. Funded by rate-payers and tax-payers, HER targets 15.4 GWh energy savings and 3.6 MW demand savings by 2014, with savings credited to the Energy Savings Actions program.

2 METHODOLOGY This section presents the Econoler team, the methodology used and the activities carried out for the HER evaluation.

AI summary The section introduces the Econoler team, outlines the methodology employed, and details activities conducted for evaluating the Home Energy Report (HER) program.

2.1 Presentation of the Team To carry out the 2014 evaluation, Econoler collaborated with Corporate Research Associates (CRA). Tasks were divided as follows: - Econoler acted as the team leader and was responsible for coordinating all eval...

AI summary Econoler led the 2014 evaluation, coordinating activities and preparing deliverables, while CRA conducted telephone surveys and analyzed data from HER's web-based component. The collaboration outlines distinct roles in evaluation tasks.

2.2 Evaluation Activities Figure 1 illustrates the research strategy and data collection activities used for the 2014 evaluation. Figure 1: Methodological Model Project No. 5870 Each step of this methodological model is further described i...

AI summary The section outlines evaluation activities for the 2014 program, referencing a methodological model (Figure 1) and Project No. 5870, which details research strategies and data collection approaches.

2.2.2 Interviews with Opower During the evaluation process, Econoler conducted various interviews with Opower to collect information required to conduct the impact evaluation and, more precisely, to better understand the program design, th...

AI summary Econoler conducted interviews with Opower during the evaluation process to gather information on program design, participant selection for treatment and control groups, and billing analysis used to track program savings.

2.2.5 Unitary Savings Review Econoler established the unitary savings values for seven tips selected to quantify the savings associated with the web-based component. To choose the most recent and accurate data sources for establishing the...

AI summary Econoler determined unitary savings values for seven web-based tips by reviewing technical literature and using engineering calculations when reliable data sources were unavailable. The process involved evaluating studies, manuals, and public reports to ensure accurate savings quantification.

3 PROCESS EVALUATION This section presents the findings from the process evaluation of HER, which has been carried out on the basis of the information gathered from the documentation and an interview with the PM.

AI summary The process evaluation of the Home Energy Report (HER) was conducted using documentation and an interview with the Program Manager (PM) as part of a Nova Scotia regulatory proceeding.

3.1 Program Design Participants in the paper-based component are provided with paper reports that illustrate their energy usage patterns, compare their energy usage to an anonymous group of similar neighbouring homes and offer tips on how...

AI summary The program uses paper reports and a web portal (HER) to compare participants' energy use with similar homes, encouraging behavioral changes. While behavioral adjustments may erode over time, purchasing energy-efficient products yields more persistent savings. The objective is to reduce energy consumption through both components.

3.3 Tracking System Opower is in charge of tracking the savings of the paper-based component and submits savings summary reports to ENSC every month. ENSC has created its own internal tracking system using some of the data provided in thes...

AI summary Opower tracks paper-based component savings for ENSC, submitting monthly reports. ENSC uses internal systems for tracking but lacks web-based tracking data. Opower provides customer databases and tip actions, but phone numbers for web-based participants were unavailable, requiring CRA's assistance. Databases and tip actions could not be compared to assess participant actions.

4.1 Participant Perspectives A participant survey was conducted as part of the HER evaluation. In addition to the questions designed for impact evaluation purposes, survey participants were asked questions related to behaviour change, awar...

AI summary A participant survey was conducted as part of the HER evaluation, assessing behavior change, awareness, and satisfaction. The survey aimed to evaluate the impact of the Home Energy Report program.

5 IMPACT EVALUATION FOR PAPER-BASED COMPONENT The objective of the 2014 impact evaluation of HER's paper-based component was to determine the net energy savings. BothIn 2012, the State and Local Energy Efficiency Action Network (SEE Action...

AI summary The 2014 impact evaluation of HER's paper-based component aimed to assess net energy savings using methods like RCT and panel data analysis. However, Opower's evaluation lacked independent oversight and data cleaning due to pre-existing contracts and confidentiality issues. Econoler's evaluation focused on verifying Opower's calculations rather than following SEE Action guidelines.

5.1 Methodology Review The approach to the impact evaluation involved reviewing the billing analyses performed by Opower. The savings are established by comparing the consumption of a group of participants (treatment group) to that of a gr...

AI summary The impact evaluation methodology reviewed Opower's billing analyses, which compare energy consumption between a treatment group (participants) and a control group (similar attributes) to establish savings. This approach assesses effectiveness by measuring consumption differences.

Selection of Participants First, Econoler reviewed the process used to build the two groups. A smaller group was selected by Opower to represent a random sample of the Nova Scotian population, while the other bigger group 4 SEE Action, Eva...

AI summary The document describes the selection process for participants in a residential energy efficiency program. Opower used a randomized controlled trial (RCT) to select 20,000 households randomly and 110,000 high electricity users, ensuring both groups were comparable in terms of usage, demographics, and other attributes to measure the program's effectiveness.

6 IMPACT EVALUATION FOR WEB-BASED COMPONENT The Econoler team conducted a survey with customers who signed up on the HER web portal to look at specific tips that they could have implemented because of the report. When selecting the list of...

AI summary The Econoler team evaluated the impact of HER web portal tips on energy savings, filtering out redundant, low-impact, or impractical measures. Selected tips included energy-efficient appliances and behavioral changes. Savings were calculated for each tip to assess effectiveness, ensuring no double-counting with ENSC programs.

Water-heating Energy Usage per Load Econoler used the total energy consumption value for a clothes washer from the 2013 Instant Savings evaluation report; this value was established based on the average Modified Energy Factor (MEF) of all...

AI summary The document details Econoler's calculation of water-heating energy usage for clothes washers, using the Modified Energy Factor (MEF) and data from Natural Resources Canada and Hydro-Québec. Adjustments were made based on Hydro-Québec's findings that Quebecers use 33% less energy for water heating than CSA test procedures assume, leading to an adjusted value of 0.51 kWh per load. The Evaluator assumes similar laundry behaviors in Nova Scotia as in Quebec.

Unitary Savings Value As previously discussed, CBSM Pilot participants achieved an average warm-water-usage reduction of 9 percent in comparison to the control group. This reduction percentage, multiplied by the water heating electricity u...

AI summary The CBSM Pilot achieved a 9% reduction in warm-water usage, leading to an annual unitary savings of 8.6 kWh per participant. The calculation considers water heating electricity use, laundry loads, and weeks per year. 52.4% of 178 participants implemented the tip.

6.3 Net-to-gross Ratio This section discusses HER web-based component's NTGR evaluation, which included the assessment of the free-ridership level associated with each product category.

AI summary This section evaluates the Home Energy Report (HER) web-based component's net-to-gross ratio (NTGR), focusing on assessing free-ridership levels across product categories to determine the effectiveness of energy efficiency programs.

6.3.1 Free-ridership In HER's web-based component, free-ridership occurs when participants declare that they would still have implemented the energy-efficient measures in the absence of the program. The free-ridership level of each product...

AI summary The analysis of free-ridership in HER's web-based component involves assessing participants' self-reported likelihood of adopting energy-efficient measures without the program. Surveys evaluated the influence of HER on decision-making by measuring participants' probability of action without HER and the report's impact on their choices. Program attribution levels were calculated from survey responses to determine free-ridership rates per product category.

CONCLUSION Launched in 2013, HER is an innovative program intended to promote behavioural changes towards greater energy efficiency. Since its inception, a total of 93,119 participants have taken part in the paper-based component of HER, a...

AI summary The Home Energy Report (HER) program, launched in 2013, achieved significant energy savings through its paper-based component (34.498 GWh) but had limited impact from its web-based component (0.291 GWh). Evaluation found behavioral changes in participants, though web-based effectiveness was harder to measure. Net savings totaled 34.789 GWh, calculated using Opower's methodology and Econoler's analysis.

This Appendix summarizes all the recommendations made by the Evaluator throughout this report as well as the sections from which the recommendations originated. Sections Recommendations Executive Summary 1 Explain in greater detail the cha...

AI summary The appendix outlines recommendations for improving the Home Energy Report (HER) program. It suggests detailing HER's characteristics, reviewing Opower's databases, and conducting a billing analysis to ensure the program's effectiveness is accurately evaluated.

Program Participation (Series P) - P1. What was the SINGLE most important reason you decided to sign up online for your Home Energy Report? [ACCEPT ONE RESPONSE] [DO NOT READ] - 1. (To save on energy/to save on energy costs) - 2. (Comfort)...

AI summary The document contains survey questions about participation in Efficiency Nova Scotia's Home Energy Report (HER), including motivations for enrollment and prior program participation. It references a 2014 DSM Evaluation Report and asks about reasons for joining HER, such as saving energy costs, environmental concerns, and improving home energy rankings.

96. (Other) [SPECIFY _________________]) 98. (Don't know) 99. (Refused) - S3. Now I'm going to ask you about your experience with specific aspects of the Home Energy Report. For each one, please tell me if you are completely satisfied, mos...

AI summary The text outlines survey questions related to customer satisfaction with the Home Energy Report and Efficiency Nova Scotia's contact centre services. It includes questions about the appearance, clarity, and usefulness of the report, as well as customer feedback on service quality and program recommendations.

Verification Review of Program Year 2014 Evaluation Results Report for the Nova Scotia Utilities and Review Board H. Gil Peach, Ph.D. John Mitchell, B.S. March 26, 2015

AI summary This document is a verification review of the 2014 program evaluation results submitted to the Nova Scotia Utilities and Review Board. Authored by H. Gil Peach, Ph.D., and John Mitchell, B.S., the report dates to March 26, 2015, and outlines the analysis of program outcomes for that year.

This report is a savings verification review conducted by H. Gil Peach & Associates, LLC for the Nova Scotia Utility and Review Board (Board). It reports on verification of electricity energy savings and demand reduction estimated by Econo...

AI summary This report by H. Gil Peach & Associates, LLC, commissioned by the Nova Scotia Utility and Review Board, verifies the electricity energy savings and demand reduction estimates from Efficiency Nova Scotia's 2014 programs. It reviews evaluation methods, data tracking systems, and conducts site visits to ensure accuracy and recommends adjustments if necessary.

II. Demand-Side Management It can be useful to understand DSM measurement and evaluation in context by reviewing how DSM works. Probably the most important thing is to see DSM measurement and evaluation as a single activity, but as a cycle...

AI summary The document describes Demand-Side Management (DSM) as a cyclical process involving planning, implementation, evaluation, and continuous improvement. It emphasizes bidirectional knowledge exchange between evaluators and program managers, with feedback loops enhancing program effectiveness and evaluation quality over time.

III. The Program Portfolio and First Year Results There are seventeen program components or initiatives for calendar 2014. Table 1[5,](#page-9-2) first column, shows first year net energy savings at generator as reported by the evaluator,...

AI summary The 2014 program portfolio includes 17 initiatives, with Econoler reporting 151,888 GWh in first-year net energy savings. Codes and Standards contributed 31.433 GWh in electricity savings and 5,164 MW in peak demand reduction. Overall first-year peak demand reduction was 27.077 MW at the generator.

B. A Better Analysis Currently, evaluations are required to produce the level of informational results shown above in Tables 1 & 2 and in Figures 2&3. Impact evaluations are to produce first year energy savings and first year demand reduct...

AI summary The document argues for a more comprehensive evaluation of DSM programs beyond first-year savings, considering long-term benefits. It references Figure 4 from a 2012 guide by the State and Local Energy Efficiency Action Network, highlighting the balance between evaluation cost and benefit.

A. Evaluation Standards The primary standard in Demand Side Management evaluation is that evaluation must be conducted by an independent evaluator to guarantee the integrity of reported savings and to prevent conflict of interest. There ha...

AI summary The document outlines the importance of independent evaluators in Demand-Side Management (DSM) to ensure savings integrity and avoid conflicts of interest. Historically, utilities conducted evaluations, but separation became critical after issues with performance contractors led to inflated savings claims. By 1992, regulators mandated independent evaluations for DSM programs.

B. Transparency Beyond this, DSM evaluation plans and reports are made public and are open to inspection by any party. Third party review of evaluations helps insure objectivity and promotes credibility, and, when necessary, revision of ev...

AI summary The text emphasizes transparency in Demand-Side Management (DSM) by making evaluation plans and reports publicly accessible for inspection. Third-party reviews are highlighted as critical for ensuring objectivity, credibility, and the potential revision of evaluation outcomes when necessary.

C. Technical Resource Manual & Evaluation Guidelines Most jurisdictions eventually develop a Technical Resource Manual (TRM) in which calculation methods, assumptions and (in some cases) default unitary values for energy savings and/or com...

AI summary Jurisdictions develop Technical Resource Manuals (TRMs) to standardize energy savings calculations, maintained by consultants and reviewed by committees. TRMs include methods and assumptions, updated via evaluations. Evaluation guidelines are also commonly established.

V. Savings Verification Approach The savings verification review was conducted as follows: - During the year, we conducted a set of due diligence site visits for each program. These provide an independent view of each program and of any ob...

AI summary The Savings Verification Approach involved site visits, tracking system reviews, and evaluation of installed energy savings. Focus was on methodological rigor rather than mathematical checks, with endorsement of evaluator recommendations. Key findings include program improvements and measurement enhancements.

VI. General Findings There is one primary finding: 1. Savings Verification Finding No. 1: All but one of the 2014 Evaluations conducted by Econoler are within accepted industry frameworks. Except for the Home Energy Reports evaluation, eac...

AI summary The 2014 evaluations by Econoler are largely compliant with industry standards, except for the Home Energy Reports evaluation, which lacked proper data access. The exception occurred because NSPI provided customer data to Opower (program vendor) instead of the independent evaluator, leading to non-independent analysis. Other evaluations were comprehensive, methodologically sound, and consistent in structure.

VII. General Recommendations 1. Savings Verification Recommendation No. 1: The Savings Verification study recommends acceptance of the 2014 evaluation results for energy savings and for demand-reduction for all programs except Home Energy...

AI summary The Savings Verification study recommends accepting 2014 evaluation results for energy savings and demand reduction across programs except Home Energy Reports. Key actions include establishing a Nova Scotia TRM, developing evaluation guidelines based on New York's model, and adopting formal evaluation protocols like UMP and IPMVP for future assessments.

VIII. Individual Program Component Review Econoler conducted evaluations of seventeen DSM Administrator program components or initiatives (Table 4, Page 20). For the Savings Verification examination, we focus primarily on impact evaluation...

AI summary Econoler evaluated 17 DSM Administrator program components, focusing on impact evaluation through full-scale evaluations and tracked savings validations. Tracked validations rely on prior evaluations and checks for consistency, sometimes supplemented by file reviews and data integration.

A. Appliance Retirement Program (Tracked Savings) The Appliance Retirement Program provides pick-up and environmentally sound disposal and recycling of components of household refrigerators, freezers and room air conditioners. The evaluato...

AI summary The Appliance Retirement Program in Nova Scotia facilitates environmentally responsible disposal of household appliances. The evaluation used a standardized protocol, considered factors like free-ridership and secondary market impacts, and was praised for its thoroughness. No recommendations were made due to the program's maturity and effective delivery by ARCA.

B. Instant Savings Evaluation (Full-Scale) Instant Savings is an "upstream discount" program component experienced by residential customers through discounts on energy efficient products when making purchases in stores. It is both a resour...

AI summary The Instant Savings program offers residential discounts on energy-efficient products, combining resource acquisition and market transformation. The evaluation uses interviews, surveys, and baseline analysis, emphasizing evolving markets. It follows the Universal Methods Project protocol, deemed excellent for its rigorous methodology and adherence to best practices.

Verification Review of Program Year 2014 Evaluation Results The evaluator recommendations for this program are all process recommendations except two that directly affect calculations and classification. These are: - Ensure that model numb...

AI summary The evaluation of Program Year 2014 recommends process improvements and two changes affecting calculations/classification. Savings verification supports these claims, with no additional recommendations beyond continuing future evaluations using the same methods unless improvements are identified. The evaluator's methods are deemed appropriate for this program type.

C. Home Energy Assessment (Tracked Savings) Home Energy Assessment (HEA) provides financial incentives in the form of rebates or zero-interest financing to homeowners to reduce consumption of energy. It is focused on shell insulation measu...

AI summary The Home Energy Assessment (HEA) program offers rebates and zero-interest financing for insulation to reduce energy consumption. Evaluation includes 'test-in/test-out' audits, data validation, and incorporation of prior 2012 analysis. The inclusion of 'Unconverted D Study Savings' strengthens program impact, suggesting past evaluations understated savings. The evaluator's methods are deemed appropriate with no recommendations.

D. Green Heat (Full-Scale) The Green Heat Program focuses on replacement and supplementation of heating systems by installation of equipment that uses fuel derived from renewable resources. Participants can choose between a rebate and a ze...

AI summary The Green Heat Program offers rebates and financing for renewable heating systems. Evaluation included interviews, site visits, and savings analysis. Five recommendations address efficiency calculations, data accuracy, and verification methods. ENSC is advised to update savings values and improve pre-screening processes. Discrepancies in program records triggered recommendations for enhanced verification.

E. Low Income Homeowner (Tracked Savings) The Low Income Homeowner (LIH) Program is aimed primarily at building shell improvements. It includes building envelope measures, such as draft-proofing, as well as insulation for basements, crawl...

AI summary The Low Income Homeowner (LIH) Program focuses on building envelope improvements, including insulation and ventilation. A 2014 evaluation re-examined EnerGuide point values using HOT 2000 data, concluding the new savings value was competently calculated. The evaluation's methods and assumptions were deemed appropriate for this type of assessment.

F. New Home Construction (Tracked Savings) The New Home Construction program, formerly Performance Plus, is designed to encourage homeowners and builders to exceed building code requirements for energy efficiency in new homes. Measurement...

AI summary The New Home Construction program, formerly Performance Plus, incentivizes energy efficiency in new homes through HOT2000 simulations, blower door tests, and certifications like Energy Star. The 2014 evaluation validated tracked savings, re-evaluated EnerGuide points, and analyzed free-ridership. The evaluator's methods are deemed sound, with an R-squared of 0.97 supporting results.

G. Residential Direct Install (Full-Scale) The Residential Direct Install Program (RDI) provides direct installation of standard energy-efficient lighting and domestic hot water-heating products free of charge. In addition, participants ma...

AI summary The Residential Direct Install Program (RDI) offers free energy-efficient home upgrades. Econoler's evaluation found increased savings from LED adoption and smart controllers, despite fewer households served. Data entry errors inflating savings were identified, prompting recommendations for improved error checks. The evaluation methods and assumptions were deemed valid.

H. Rental Properties and Condos Service (Tracked Savings) The Rentals Properties and Condos Service is the new name for the former Multi-Unit Residential Buildings program. It provides direct free-of-charge installation of energy-efficient...

AI summary The Rental Properties and Condos Service (formerly Multi-Unit Residential Buildings) installs energy-efficient products in rental units and condos. The 2014 evaluation focused on parameter validation, savings calculations, and surveys, concluding the approach is sound. Measures include CFLs, LED lamps, and insulation. The 2013 evaluation used interviews and site visits.

I. Solar (Tracked Savings) The Solar Program includes both residential solar hot water and residential solar space heating (to offset part of the home heating needs met by existing traditional 24 2013 Multi-Unit Residential Buildings Evalu...

AI summary The Solar Program includes residential solar hot water and space heating systems. In 2015, 30 DHW and 3 air space heating systems were installed. The DSM Administrator uses RETScreen analyses and Econoler adjustments from a 2013 evaluation to calculate gross and net savings, deemed a reasonable approach.

J. LED Holiday Light Exchange (Full-Scale) There were one-hundred and seventeen events for LED Holiday Light Exchange in 2014. The LED Holiday Light Exchange provides the opportunity to trade two sets of old inefficient holiday lights for...

AI summary The LED Holiday Light Exchange program conducted 117 events in 2014, offering residents to exchange inefficient holiday lights for LED ones as a community outreach initiative. The evaluation used program records, in-field surveys, and literature reviews, considering interaction effects and diversity. The evaluation's methods and assumptions are deemed reasonable and appropriate for this program type.

K. Home Energy Report (Full-Scale) The Home Energy Report analysis includes 2013 and 2014 since savings were not claimed in 2013. This program differs from all other of the DSM Administrator's programs in that it is a standalone behavioral...

AI summary The Home Energy Report (Full-Scale) is a standalone behavioral program differing from technology-focused DSM programs. It uses repetitive mailings and a web-based component to motivate energy-efficient behaviors. Savings are attributed to aggregated behavioral changes rather than specific equipment. Econoler evaluates it as two components: paper-based mailings and web-based engagement.

1. The Paper-Based Component In theory, evaluation of a Home Energy Report type program is conducted using a method of true experiment in which a group of homes is randomly allocated to either a participant group (the members of which will...

AI summary The text discusses evaluating Home Energy Report programs using true experiments with participant and control groups. It notes that the program's causation of energy savings is unclear compared to other programs, citing a 2012 report on behavior-based energy efficiency.

Econoler then applied the line loss factor determined total net savings at the generator as 34.498 (GWh) with 9.162 GWh of that in 2013 and 25.336 GWh in 2014.[31](#page-43-3) Opower did not compute a demand reduction; however, Econoler in...

AI summary Econoler calculated energy savings and demand reductions for a DSM program, but the evaluation was conducted by the program vendor, raising concerns about independence and integrity. The report highlights a conflict of interest and questions the methodology used, as no explanation was provided for combining datasets or lack of independent evaluation.

This standard is specifically supported by the SEE Action evaluation protocol for behavior-based programs (Figure 10): [32](#page-44-1) Star Rating Condition An independent, third-party evaluator transparently defines and implements: Progr...

AI summary The text discusses the importance of using an independent, third-party evaluator in the evaluation of behavior-based energy efficiency programs, as outlined in the SEE Action evaluation protocol and the Universal Methods Protocol. It highlights the conditions under which such evaluations are recommended and provides references to supporting documents.

Savings Verification Recommendation No. 11. Run additional comparisons. The evaluator should run additional comparisons using a NSPI database rather than the program vendor's database, including prevalence of e-mail address by group to see...

AI summary The evaluator is advised to use the NSPI database for additional comparisons to detect systematic differences between groups. Despite flawed protocols, the NSUARB may tentatively accept results if they align with similar studies. Recommendation 12 suggests conditional acceptance based on prior trends and equivalence checks, while questioning the program's value due to issues.

2. The Web-Based Component Evaluation of the Web-Based component was independently conducted by Econoler and was unable to establish any significant level of savings for this component. Econoler selected energy efficiency tips with reasona...

AI summary Econoler evaluated Nova Scotia's Web-Based Component, finding no significant energy savings due to survey biases like recall and social desirability. A single survey of 340 participants led to high free ridership, as many actions would have occurred without the program. The analysis recommends baseline vs. program surveys for future evaluations.

3. Summary Home Energy Report programs, introduced in 2008, have attracted participation by many utilities. Though initially pilots, some utilities now consider them DSM programs. The Home Energy Reports program type of evaluation has the...

AI summary Home Energy Report programs, initiated in 2008, are now considered DSM programs by some utilities. While their evaluation uses scientific methods like random household allocation, reliance on the program vendor's self-conducted evaluation creates a conflict of interest, violating procurement standards. Standalone behavioral programs show lower savings than initial analyses suggest.

L. Residential Financing (No Impact Evaluation) This is a zero interest buy-down program with sixty-six participants in 2014. Program savings are allocated to other programs (HEA, Solar and Green Heat). The financing enables all necessary...

AI summary A zero-interest residential financing program with 66 participants in 2014 was evaluated as pivotal in enabling energy improvements. Savings were allocated to other programs (HEA, Solar, Green Heat). Process evaluation via interviews confirmed participants would have postponed work without financing. Questions remain about cost-effectiveness and reliance on behavioral savings for resource planning.

M. Business Energy Rebates (Full-Scale) This program provides prescriptive rebates to business, non-profit and institutional organizations (abbreviated "BNI"). Originally, Business Energy Rebates (BER) was a mail-in rebate program. It now...

AI summary The Business Energy Rebates (BER) program offers prescriptive rebates for BNI organizations via mail-in and instant rebates through distributors. The evaluation involved interviews, surveys, and site visits, leading to 17 recommendations for the DSM Administrator to address impact accounting issues and include free ridership considerations. The evaluation is praised for its thoroughness and reasonableness.

N. Custom Retrofit (Full-Scale) This Custom Retrofit program for business, non-profit and institutional (BNI) customers provides an incentive to customers to implement retrofit projects that are deemed to produce significant annual savings...

AI summary The Custom Retrofit program incentivizes BNI customers to implement energy-saving retrofits through technical and financial support, with projects categorized into Tracks based on annual savings. It includes EMIS and EBC components, evaluated via DSM Administrator data, interviews, and on-site visits. The 2014 evaluation involved 100 projects, focusing on energy savings over peak load reduction.

Verification Review of Program Year 2014 Evaluation Results Administrator's response to five open recommendations from the 2012 evaluation and five recommendations from the 2013 evaluation. Econoler provided nine recommendations in the 201...

AI summary The Administrator addressed five open recommendations from the 2012 and 2013 evaluations, with Econoler's 2014 recommendations focusing on requiring IPMVP compliance for EMIS and EBC savings tracking and planning a 2016 impact evaluation. The Savings Verification Study supports these, emphasizing IPMVP use and electrical measurement focus.

Savings Verification Recommendation No. 16: Address Electrical Measurement. For future evaluations of this program, the evaluator should provide a table to explain the frequency and type of direct electrical measurement involved in the pro...

AI summary The recommendation mandates that future evaluations of the program include a table detailing direct electrical measurement frequency, type, execution methods, and responsible entities. It also requires partitioning energy savings and demand reduction by measurement type. The evaluation must be conducted by an experienced independent evaluator.

O. Custom New Construction (Full-Scale) This Business, Non-Profit and Institutional (BNI) program provides prescriptive rebates to organizations for the implementation of above-code building envelope, lighting and HVAC design implementatio...

AI summary The BNI program offers rebates for energy-efficient commercial construction. The 2014 evaluation used ASHRAE and IPMVP methods, recommending calibration analysis and delaying NECB 2011 baseline adoption until common practice. Code enforcement challenges (underfunding, inspector focus on health/safety) justify using current practices instead of new codes. The evaluation is deemed competent but data-limited.

Measures include: - Efficient lighting measures - Occupancy sensors and lighting controls - Ductless mini split heat pumps - Electronically commutated motors (ECMs) - Outside air economizers - Hot water heat pumps - Hot water tank wraps -...

AI summary The document outlines energy efficiency measures, evaluation methods, and recommendations for the Business Energy Solutions (BES) program. It highlights savings verification findings, including nine recommendations for BES and addressing barriers to participation. The evaluation involved site visits, surveys, and categorization of savings, with endorsement of all nine recommendations.

luded due to lack of data. For 2014, the primary sources of information for analysis were NRCan and industry 44 Econoler Business Energy Solutions, Page 12-14. trade associations. Each analysis requires data and understanding of the workin...

AI summary The evaluation of energy efficiency programs in Nova Scotia relies on data from Natural Resources Canada (NRCan) and industry associations, considering market characterization and non-compliance rates. The DSM Administrator does not claim credit for savings from federal/provincial standards but supports their implementation through staff involvement and ongoing evaluations.

IX. Summary of Findings & Recommendations Savings Verification Finding No. 1: All but one of the 2014 Evaluations conducted by Econoler are within accepted industry frameworks. Except for the Home Energy Reports evaluation, each evaluation...

AI summary The 2014 evaluations by Econoler are largely valid except for Home Energy Reports, which lacks independent verification. Recommendations include accepting evaluation results, establishing a Nova Scotia TRM, and developing evaluation guidelines based on New York standards. Efficiency Nova Scotia is urged to improve program planning and evaluation frameworks.

Savings Verification Recommendation No. 16: Address Electrical Measurement. For future evaluations of this program, the evaluator should provide a table to explain the frequency and type of direct electrical measurement involved in the pro...

AI summary Recommendations focus on improving savings verification through detailed electrical measurement reporting, calibration for new construction, adopting NECB 2011 standards when in practice, implementing Econoler's BES program recommendations, and addressing participation barriers. Emphasis is on data transparency, methodological rigor, and aligning with current industry practices.

X. References Donaldson, Stewart L., Christina A. Christie & Melvin M. Mark, eds., What Counts as Credible Evidence in Applied Research and Evaluation Practice? Los Angeles, London, New Delhi, Singapore: Sage Publications, 2009. Dunsky Ene...

AI summary The references section lists academic publications, industry reports, and white papers related to energy efficiency, demand-side management, and evaluation methodologies. Key documents include DSM evaluations, cost-effectiveness analyses, and savings estimation methods, with contributions from organizations like Efficiency Nova Scotia Corporation and Dunsky Energy Consulting.

NON-CONFIDENTIAL 1 2016, 2017 and 2018 would include the number of schools participating in the Green 2 Schools Nova Scotia program, the number of students participating in Green Teams and 3 the number of students affected by the program,...

AI summary The text outlines quantifiable benefits of energy efficiency programs from 2016-2018, including participation metrics for Green Schools Nova Scotia, community engagement outcomes, and social media impact. It references ENSC's Summer Tour growth, CRA survey results showing increased visitor satisfaction and energy behavior adoption, and the potential of social media for outreach.

t energy efficient behaviour. 21 22 Quantifiable benefits in 2016 to 2018 specifically attributable to the use of social media 23 as an education and outreach tool would build on benefits from earlier years. ENS uses 24 various metrics to...

AI summary Efficiency Nova Scotia (ENS) highlights the use of social media metrics (e.g., Facebook likes, Twitter followers, engagement) to evaluate the effectiveness of education and outreach efforts in promoting energy-efficient behavior. The text references a 2014 example showing increased social media engagement and cites a 2016-2018 Supply Agreement (EECA M06733).

27, 2015 E1 (NSPI) IR-4 Page 1 of 2 2016-2018 Supply Agreement for EECA M06733 (E-ENS-R-15) E1 Responses to NSPI Information Requests NON-CONFIDENTIAL 1 b) ENS gathers insights on the status of market transformation from a variety of activ...

AI summary ENS outlines methods for assessing market transformation through research, evaluations, and industry interactions, emphasizing that market size does not determine the need for such efforts. ENS also asserts that its measures are not high-risk.

g lifetime benefits to ENS’s costs. d RIM is a benefit/cost ratio comparing lifetime benefits to ENS’s costs and NSPI lost revenues. 2 3 Figure 2 - 2016 DSM Resource Plan Investment and Savings Incremental Incremental Annual Net Annual Net...

AI summary The text discusses metrics used in evaluating the 2016 DSM Resource Plan, including RIM, TRC, and PAC. These metrics compare lifetime benefits to ENS’s costs and NSPI’s lost revenues, focusing on energy and demand savings.

Other Enabling Strategies 0.6 Total 38.5 127.3 133.1 20.4 1.9 3.6 0.5 Currency is expressed in 2016 dollars. Columns may not add correctly, due to rounding. Annual avoided costs, calculated using ENSC’s DSM Potential Study at the Base Leve...

AI summary The text discusses avoided costs from ENSC's DSM Potential Study, including energy and capacity costs, and defines TRC, PAC, and RIM as benefit/cost ratios. It references the 2015 DSM Resource Plan Settlement Agreement and a 2016-2018 EECA supply agreement. Metrics include lifetime net present value of benefits and participation by low-income customers.

ate Filed: March 27, 2015 E1 (NSPI) IR-6 Page 3 of 3 2016-2018 Supply Agreement for EECA M06733 (E-ENS-R-15) E1 Responses to NSPI Information Requests NON-CONFIDENTIAL 1 Request IR-7: 2 3 Reference: EfficiencyOne, Appendix A – 2016-2018 DS...

AI summary E1 responds to NSPI's information request regarding income verification and participation statistics in residential programs. E1 states it does not collect income levels for most programs, relying instead on independent evaluations to assess program effectiveness and cost efficiency.

Filed: March 27, 2015 E1 (NSPI) IR-8 Page 2 of 2 2016-2018 Supply Agreement for EECA M06733 (E-ENS-R-15) E1 Responses to NSPI Information Requests NON-CONFIDENTIAL 1 Request IR-9: 2 3 Reference: EfficiencyOne, Evidence - Page 56, Lines 12-...

AI summary EfficiencyOne (E1) responds to NSPI's information request regarding measures with TRC<1.5 in the 2016-2018 DSM Resource Plan. E1 explains that programs are approved at the program level with a minimum TRC of 1.0, and individual measures with TRC<1.0 may be included if the overall program passes. Strategic benefits of including such measures are discussed in Attachment 1.

29,675 is expected that TRC ratios will improve due to fixed costs, such as marketing and signage, being better distributed. Doors are a highly desired retrofit option for Nova Scotian homeowners, despite having lower TRC values than other...

AI summary The text discusses the expected improvement in TRC ratios due to better distribution of fixed costs, such as marketing and signage, and highlights the importance of doors as a retrofit option for Nova Scotian homeowners despite their lower TRC values.

Date Filed: March 27, 2015 E1 (NSPI) IR-12 Page 1 of 9 2016-2018 Supply Agreement for EECA M06733 (E-ENS-R-15) E1 Responses to NSPI Information Requests NON-CONFIDENTIAL 1 description of how equity between participants and non-participants...

AI summary The document outlines a request for information regarding the 2016-2018 Supply Agreement for the Energy Efficiency Conservation Agreement (EECA M06733). It includes detailed queries about program eligibility, participation forecasts, cost ratios, incentive structures, and implementation budgets.

NON-CONFIDENTIAL Measure Analysis Part of Demand Response Program. Please refer Heat & Power Load Control to part c). Home Energy Report Program removed. Please refer to part c). Removed due to current expectations of 2016- Nest Thermostat...

AI summary The document discusses the removal of several energy efficiency measures due to low uptake and strategic rationale, and outlines the development of a revised DSM Resource Plan by ENS in collaboration with NSPI, considering system requirements and short-term affordability.

NON-CONFIDENTIAL 1 filed electronically, for the energy savings values, which can be found in column 2 E (column 5 in the printed version). 3 4 (ii) ENS does not have estimated measure-level participation rates, and the EL-RAM, 5 which has...

AI summary The document discusses the absence of estimated measure-level participation rates in the EL-RAM model, the importance of TRC, PAC, and RIM ratios in evaluating demand-side management programs, and references to EfficiencyOne's responses to NSPI IR-10 and IR-9 for detailed data on incentives and net-to-gross ratios.

y: Rates, Bills and Participation Impacts Slide 16 Date Filed: March 27, 2015 NSPI IR-12 Attachment 1 Page 17 of 26 Program Designs to Increase Participation • EE programs should address all end-uses. • EE programs should address all custo...

AI summary The document outlines program designs and policy options aimed at increasing participation in energy efficiency programs. It emphasizes addressing all customer types and end-uses, tailoring incentives, and improving data collection and analysis. It also suggests increasing budgets, setting explicit participation goals, and linking utility incentives to participation rates.

NON-CONFIDENTIAL 1 (g) Please explain why Ontario was the only Canadian province included in the 2 research sample. 3 4 (h) Which states or jurisdictions researched applied performance metrics only at the 5 end of a compliance or target pe...

AI summary The response addresses questions about performance metrics and targets in energy efficiency programs, noting that only California and Wisconsin explicitly use cumulative lifetime energy savings as performance targets, while others may use it implicitly. New Hampshire is the only jurisdiction using cost-effectiveness as a performance metric.

NON-CONFIDENTIAL 1 performance incentives. Elsewhere across the country, energy savings targets are used for 2 reporting purposes only, not as part of a performance contract mechanism. 3 4 h) For clarity, our report recommended that the cu...

AI summary The document discusses performance indicators for energy efficiency programs, including the inclusion of cumulative energy and peak demand savings as Target Performance Indicators. It references practices in Vermont and Oregon, such as Service Quality and Customer Satisfaction metrics, and notes that Nova Scotia considered similar metrics in its report.

& lt;sup>14 E1 (NSPI) IR-19 and IR-21, March 27, 2015. 1 provided to NS Power in the aggregate, making it extremely difficult for NS 2 Power to perform any type of substantive analysis on it. 3 4  E1 provides minimum detail on which to as...

AI summary The document highlights concerns raised by NS Power regarding the insufficient detail provided in E1's DSM plan application, making it difficult to assess the program's merits and reasonableness of costs. NS Power suggests the need for a standardized filing process for future DSM applications.

- 1 The reasonableness of the implementation costs associated with the 2 programs. - 3 The adequacy of the range of programs, program designs, and 4 spending levels considered by EfficiencyOne. - 5 The impacts of potential alternate levels...

AI summary The proceeding focuses on evaluating the reasonableness of implementation costs for two programs, the adequacy of program designs and spending levels by EfficiencyOne, the impacts of alternate spending levels, and the appropriateness of reporting standards and performance targets proposed by EfficiencyOne.

13 A. I find that: - 14 The program information provided by EfficiencyOne is insufficient for 15 regulatory approval and contract development, and I recommend that 16 EfficiencyOne be directed to provide additional information; - 17 The re...

AI summary The findings indicate that EfficiencyOne's program data lacks sufficiency, cost justification, and breadth. The board recommends enhanced data submission, broader program evaluation, alternative DSM portfolio analysis, improved reporting standards, and expanded performance targets. These issues require corrective action for regulatory approval.

15 Appropriateness of the Proposed DSM Program Portfolio - 17 Q. HAVE YOU REVIEWED EFFICIENCYONE'S APPLICATION AND 18 PROPOSED PORTFOLIO OF DSM PROGRAMS? - 19 A. Yes, I have reviewed the Application and proposed programs and find 20 three...

AI summary The reviewer identifies three issues with EfficiencyOne's DSM program proposal: incomplete information, potential excessive budgets, and insufficient alternate scenarios. Recommends rejecting the plan and evaluating alternatives.

1 Sufficiency of the Information Provided 2 3 Q. WHY DO YOU BELIEVE THAT INSUFFICIENT INFORMATION HAS 4 BEEN PROVIDED WITH RESPECT TO THE PROGRAMS? 5 A. In order to assess the prudence of the activities and budget associated 6 with each pr...

AI summary The testimony argues that EfficiencyOne (NSPI) provided insufficient program details, omitting key elements like incentive strategies, budgets, and staffing plans. This lack of information hinders regulatory assessment of program prudence and contract finalization, as per UARB requirements.

16 Range of Scenarios Considered - 18 Q. WHAT RANGE OF DSM PROGRAM TYPES DID EFFICIENCYONE 19 CONSIDER? - 20 A. According to Company IR-12(b) the only programs considered by 21 EfficiencyOne were the six included in the final proposal, alo...

AI summary EfficiencyOne considered only a limited range of DSM program types and expenditure levels in its proposal, excluding many low-cost programs and not conducting quantitative analysis on demand response programs. The expert testimony suggests that a broader range of programs and expenditures should have been considered for a more cost-effective and balanced portfolio.

11 Q. HOW DO YOU RECOMMEND THE UARB PROCEED? 12 A. I recommend that EfficiencyOne be directed to engage with NSP to 13 consider a broad range of program types and program expenditures, that 14 consider trade-offs between various policy obj...

AI summary The expert recommends that EfficiencyOne collaborate with NSP to evaluate diverse program types and expenditures, balancing policy objectives like rate impact, equity, and long-term resource needs. This process aims to ensure the UARB's approval of DSM portfolios reflects balanced, substantiated decisions.

13 Adequacy of the Description of the Scope of Services 14 15 Q. WHAT DESCRIPTION OF THE PROPOSED PROGRAMS AND SCOPE 16 OF WORK IS PROVIDED BY THE APPLICATION? 17 A. The most detailed description of the proposed programs is provided in 18...

AI summary The description of proposed programs in the application is criticized for being too brief and lacking necessary details to assess appropriateness, track implementation, or ensure delivery of promised activities. The response highlights the need for more detailed program descriptions and budget information to support prudence evaluation and contract development.

- 22 Annual budget detail, including at least the following categories: 23 incentives (cash), incentives (free/discounted services), administration, 1 marketing, EM&V, QA/QC, application/incentive processing, IT, and 2 other implementation...

AI summary The text discusses the annual budget detail requirements for programs, including categories such as incentives and administrative services. It also addresses the adequacy of EfficiencyOne's proposed reporting, with the response indicating that the reporting is not sufficient.

18 change program designs, budget, or goals – and many provide no 1 terms of the Agreement. Further, I recommend against attaching the 2 "program change" process to the APR process, since this may 3 unnecessarily delay important revisions....

AI summary The text discusses the need for flexibility in program designs, budgets, and goals, suggesting a mechanism to address this. It outlines specific triggers for flexibility, such as changes exceeding 5% in energy savings or budget, and proposes a process involving the UARB and NSP for approval.

- 22 These indicators would be at the portfolio level, for informational purposes 23 only, and would not be used to formally assess performance. 1 2 Q. DO YOU BELIEVE THAT THE PROPOSED PERFORMANCE TARGETS 3 ARE SUFFICIENT? 4 A. No. I recom...

AI summary The respondent does not believe the proposed performance targets are sufficient, suggesting a one-year time horizon for energy and demand portfolio performance targets and adding annual spending as a performance target. They also recommend program-level reporting and customer satisfaction metrics.

Attachment A Page 2 of 6 2016-2018 DSM NS Power Evidence Appendix A Page 45 of 100 Developed DSM program filings (including DSM potential, detailed program designs, regulatory filing and benchmarking documents, and full implementation serv...

AI summary The text details Mr. Pickles' work on demand-side management (DSM) programs for multiple utilities, including regulatory filings, energy efficiency initiatives, and financing programs. Projects span program design, cost-effectiveness analysis, and evaluations for utilities like Exelon, Delmarva Power, and Maui Electric, with a focus on compliance, implementation, and regulatory engagement.

ncing/leasing program to be offered nationally in conjunction with participating utilities. This project included program design, role of financial institutions, marketing approach, and related tasks. For a utility affiliate, developed int...

AI summary The text outlines the development of a national ncing/leasing program in collaboration with utilities, involving program design, financial institution roles, and marketing strategies. It also details a utility affiliate's efforts in integrating commodity supply, performance contracting, and financing in deregulated markets, along with joint bids and contract securing with a power marketing subsidiary.

Context and Limitations The unique nature of DSM programs (given utilities and program administrators with differing objectives, between individual programs within a single program administrator, between outwardly similar programs at diffe...

AI summary The text discusses challenges in evaluating Demand Side Management (DSM) programs due to differences in design, objectives, and metrics across utilities and program administrators. Variations in program structure, customer demographics, and regulatory environments complicate peer group analysis. Metrics remain unadjusted for factors like accounting practices and weather zones, limiting comprehensive comparisons.

Summary of Insights - The ENSC portfolio ranks highest on the list of jurisdictions reviewed for DSM spend per capita and per customer. - ENSC has the highest first year cost per kWh of energy savings of the jurisdictions reviewed. - Withi...

AI summary ENSC leads Canada in DSM energy savings and per capita spend but has high first-year costs per kWh. Nova Scotia plans the highest electrical DSM investment relative to energy sales. Despite industrial sector's cost-effectiveness, ENSC lacks targeted programs. ENSC's diverse DSM portfolio includes costly elements, and performance variances may impact system planning.

2 Scope The following DSM program administrators were chosen for research. While mostly Canadian administrators were chosen, Efficiency Maine was added due to proximity to NS. A cross section of sizes, maturities, regulatory environments a...

AI summary The scope section outlines the selection of DSM program administrators across Canada, including Efficiency Maine for proximity to Nova Scotia. Key data points researched include utility sales, DSM savings, and program performance. A complete dataset was not found due to limited public information availability.

for the period April 1 to June 30, 2014, August 7, 2014. Efficiency Nova Scotia, Q2 Demand Side Management Report, 2014 Quarter Two Activity for the period April 1 to June 30, 2014, August 27, 2014. EfficiencyOne, Evidence of Efficiency On...

AI summary The text references Efficiency Nova Scotia's Q2 2014 Demand Side Management (DSM) report, a 2016-2018 supply agreement application, and savings verification studies for DSM programs (2010-2011). It also cites a market trends report on Nova Scotia's electricity supply and demand. Documents span 2011-2015, focusing on energy efficiency programs and regulatory proceedings.

57 Manitoba Power 2013Ͳ2016 Power Smart Plan, OntarioͲIndependent Electricity System Operator (IESO) Business Structure "IESO works collaboratively with local distribution companies and other partners to deliver conservation programs throu...

AI summary The document outlines the Ontario Independent Electricity System Operator (IESO) and its role in delivering conservation programs through a systems benefit charge. It details the IESO's business structure, DSM funding mechanisms, customer numbers, and energy efficiency programs. The 2015-2020 DSM plan is outlined with financial figures and savings targets.

otia Corporation, 2012 DSM Evaluation Reports –– Final Report, March 22, 2013. Econoler for Efficiency Nova Scotia Corporation, Evaluation of 2011 DSM Programs – Executive Summary, February 23, 2013. Efficiency New Brunswick 2014/15Ͳ2016/1...

AI summary The document lists references to Efficiency Nova Scotia Corporation's Demand Side Management (DSM) evaluations, cost recovery riders, and applications for approval of DSM plans before the Nova Scotia Utility and Review Board (URB), covering periods from 2011 to 2015.

NON-CONFIDENTIAL 1 Request IR-4: 2 3 With reference to Appendix B, residential lighting and other elements 4 5 Does NS Power acknowledge that low income renters will experience hardship replacing 6 their lights with efficient bulbs due to...

AI summary The document addresses a request (IR-4) asking if NS Power acknowledges that low-income renters face hardship replacing bulbs with efficient ones due to costs and whether a direct install program will continue. NS Power responds by affirming support for low-income initiatives, collaboration with stakeholders like AEC, and alignment with affordability goals under the Public Utilities Act.

2016-2018 DSM Plan (NSUARB M06733) NSPI Responses to Consumer Advocate Information Requests 1 Request IR-6: 11 Please refer to revised Table 6 in EAC IR-7 Attachment 2. This table demonstrates that there 12 are lower cost alternatives than...

AI summary The document outlines responses from NSPI to information requests regarding the 2016-2018 DSM Plan. It references alternative cost scenarios and discusses spending commitments for low-income homeowners and renters, as well as evaluation plans for energy and demand savings.

NON-CONFIDENTIAL 1 Request IR-7: 2 3 (a) What is the rational of cutting "Enabling Strategies" by over 70% compared to E1 4 DSM plan as indicated in Evidence "Appendix B - NSPI Alternate DSM Plan 5 ELECTRONIC.xslx"? 6 7 (b) What are the pe...

AI summary The document discusses a request (IR-7) regarding the rationale for cutting 'Enabling Strategies' by over 70% compared to the E1 DSM plan and the percentage cuts for 'Education and Outreach' vs 'Development and Research' vs 'Other'. NS Power provided a response, noting an error in the summation of the 2016-2018 Enabling Strategies amount and corrected the figures accordingly.

NON-CONFIDENTIAL 1 Request IR-29: 2 3 Reference: Appendix A, Page 59 of 100, Exhibit 3 (Program Cost Effectiveness) 4 5 (a) Please provide the rationale for excluding BC Hydro's individual programs from 6 Mr. Pickles' benchmarking exercise...

AI summary The document contains a request and response regarding the exclusion of certain programs from a benchmarking exercise and the inclusion of all programs in a portfolio analysis. The response explains that data was aggregated and that the requested analysis has not been performed.

2016-2018 DSM Plan (NSUARB M06733) NSPI Responses to EfficiencyOne Information Requests 1 Request IR-30: 2 3 Reference: Appendix A, page 68 of 100, Exhibits 13 and 14 (Percentage Change from 4 Approved to Actual) and statement "Depending o...

AI summary The text discusses responses from NSPI to EfficiencyOne's information requests regarding the 2016-2018 DSM Plan. It addresses variances in program performance, comparisons to other regions, and the availability of data. The responses indicate that variances are outside the norm and that some analyses were not previously prepared.

NON-CONFIDENTIAL 1 Request IR-21: 9 funds from being moved between program years without appropriate approvals. 10 11 (b) Please refer to Section 79B(3) of the Public Utilities Act. This section prohibits NS 12 Power from being the franchi...

AI summary The document discusses concerns raised by NS Power regarding the management of funds by E1 and ENS, particularly the lack of approvals for moving funds between program years and the potential for E1 to make significant changes without Board approval. NS Power also highlights a 2014 report where ENS did not communicate potential budget variances and surplus, raising concerns about transparency and performance measurement.

une 30, 2016. This will allow sufficient time to deal with any such matters prior to the submission of the next DSM Plan. [25] For reasons that are explained later in this Decision, however, the Board does not approve the Quantum Agreement...

AI summary The Board does not approve the Quantum Agreement due to insufficient DSM spending in the public interest, despite support from multiple groups. It approves some aspects like the DSM Expenditure Justification Criteria and the Small Business Energy Study, though NSPI objects to the latter due to cost. The DOE supports equity principles and other sections of the agreements.

3.1 Evaluation Report of 2014 DSM Programs (Econoler) [28] As in the previous year, El engaged the services of Econoler Inc. ('Econoler") to conduct independent evaluations of the 2014 DSM programs. The Econoler team collaborated with two...

AI summary Econoler evaluated Nova Scotia's 2014 DSM programs under a rolling schedule from a 2012 Settlement Agreement, collaborating with Corporate Research and Equilibrium Engineering. The evaluation focused on validating ENSC's tracked savings and covered seven programs with 16 components, with reports filed in February 2015.

3.2 Verification Report of 2014 OSM Programs (Peach) [38] As in previous years, the Board engaged the services of H. Gil Peach & Associates to conduct an independent verification of the 2014 evaluated DSM savings results. Dr. Peach filed h...

AI summary The Board commissioned H. Gil Peach & Associates to verify the 2014 DSM savings results. The report reviewed evaluation methods, program performance, and identified 20 recommendations, with seven programs exceeding targets and seven underperforming. This follows the 2013 report, which had 30 recommendations.

3.3 Status of 2013 and 2014 Verification and Evaluation Recommendations [49] In Appendix C, attached to its application, El included Table 1 - Update on Implementation of 2013 Verification Recommendations, and Table 2 - Update on Implement...

AI summary Most 2013 and 2014 verification and evaluation recommendations are completed, with some ongoing. EfficiencyOne relies on 2015 evidence and will update in Q2. The Home Energy Report's savings were questioned, and Dr. Peach's evidence addressed this.

3.3.1 Findings [52] In his evidence, Dr. Peach commented on the status of the 2013 evaluation and verification recommendations: Q. Are you satisfied with the status of the 2013 verification and evaluation recommendations? A. Yes. In genera...

AI summary The Board accepts El's response to 2013 evaluation recommendations as satisfactory, directs an update on 2014 recommendations, and removes HER savings from 2014 totals due to verification concerns, noting HER's exclusion from the 2016-2018 DSM portfolio.

3.4 Status of KPMG Procurement Recommendations and Other Procurement Issues [55] The Board accepts the status report supplied by El on the implementation of the KPMG audit recommendations. With respect to procurement issues, this appears t...

AI summary The Board accepted El's status report on implementing KPMG audit recommendations, with procurement issues resolved through Murray Coolican's work and a May 2015 report reviewing Efficiency Nova Scotia's Business Energy Solutions Program.

programs, particularly as it relates to incentives. The Industrial Group expressed concern about the level of incentives as well as the role incentives play with respect to energy efficiency targets. - 45. The Industrial Group is very conc...

AI summary The Industrial Group, along with NSPI and the DOE, expressed concerns about the level of incentives in E1's energy efficiency programs and the impact on meeting targets. They recommended modeling various funding scenarios and suggested a significantly lower annual spending level, around $22 million.

3.5.2 Incentives [66] The Board, in its questioning of El's witnesses, and NSPI and the Industrial Group in their submissions, expressed significant concerns over the manner in which incentives are determined by El. It would appear from th...

AI summary The Board raised concerns about El's incentive structure for DSM programs, noting over 60% of the budget is allocated to participant incentives. Testimonies highlighted issues with justification, reasonableness, and lack of quantitative criteria. NSPI and the Industrial Group argued incentives may be excessive or poorly justified, while El's expert provided contrasting insights. The Board acknowledged concerns but found Mr. Dunsky's testimony more credible.

[69] Mr. Dunsky countered that argument as follows: Thank you. Just to explain a little bit more. So we do some of this work from time to time. We've done it for Efficiency Nova Scotia and others where we'll go out and, first of all, do pr...

AI summary Mr. Dunsky argues that pervasive market barriers, such as organizational silos in commercial kitchens, necessitate high incentives to overcome resistance. He cites a study on energy-efficient equipment showing significant barriers. E1 states incentives are determined by factors like market research and historical data.

3.7 Mid-Course Adjustments and Flexibility [112] In the Consensus Agreement, the parties agreed to the setting of targets over a three year period, instead of annual targets. El had sought the ability to make changes of up to 25% in target...

AI summary The Consensus Agreement allows El to adjust program targets by up to 25% annually at the sector level, requiring explanations for changes exceeding this threshold. El must avoid substantial annual impacts on customer classes and provide written notice for mid-course adjustments. The Industrial Group opposes this flexibility, arguing that adjustments exceeding 25% impact on customer classes should be denied.

3.7.1 Findings [114] The Board is satisfied that the provisions of the Consensus Agreement adequately address the ability of El to make mid-course adjustments and allow sufficient flexibility at the program level. Limiting the 25% adjustme...

AI summary The Board finds the Consensus Agreement's provisions sufficient for mid-course adjustments, limiting 25% program-level changes to reduce customer-class impacts. The Industrial Group is a signatory to the agreement.

3.12 Establishment of a Standardized Filing for Future Applications to approve a DSM Supply Agreement [124] The Consensus Agreement proposed to establish a standardized filing for future applications by El. The parties to the Consensus Agr...

AI summary The Consensus Agreement proposes a standardized filing for future DSM Supply Agreement applications, including energy savings, cost-effectiveness analysis, and rate impact details. The DSM Advisory Group will discuss and report back to the Board. El agrees to provide technical data in future plans.

10) NS POWER'S CHARITABLE CONTRIBUTION - a) The parties encourage Nova Scotia Power to provide the evaluated results or its low income program to the Board and to stakehotders an an annual basis and to coordinate administration and evaluat...

AI summary The parties encourage NS Power to annually report on its low-income program's results to the Board and stakeholders, coordinating with EfficiencyOne. They also agree that NS Power's charitable contribution-related DSM activities will not affect EfficiencyOne's performance targets.

3) PERFORMANCE TARGETS, INDICATORS AND THRESHOLDS - a) The parties agree to the following Performance Targets and Performance Indicators: - Performance Targets are set over the three-year contract period, rather than annually. - ) Efficien...

AI summary Parties agree to three-year performance targets for energy and peak demand savings, requiring 90% achievement for compliance. Indicators include annual savings, customer satisfaction, and rate impacts. EfficiencyOne must report by program and rate class, with specific methodologies for lifetime savings and ratepayer benefits.

4) COST ALLOCATION - a) The Parties agree to collaboratively work to develop new OSM cost allocation and p5Mcost recovery models to be submitted by October 31) 2015 for approval or Decision by the Board, or within a reasonable period of ti...

AI summary Parties agree to collaboratively develop OSM cost allocation models and p5M cost recovery by October 31, 2015, for Board approval. Topics include 2015-2018 cost allocation, RSA adjustments, and mid-course changes. Nova Scotia Power retains discretion over DSM cost treatment.

5) EVALUATION AND REPORTING - a) The Parties support EfficiencyOne's proposal for annual program impact evaluations and process evaluations at the organizational level with program process evaluations if required. EfficiencyOne wilt provid...

AI summary The parties support EfficiencyOne's proposal for annual program evaluations, including impact and process assessments. EfficiencyOne will report on performance requirements, explain substantial changes, avoid rate class impacts, and provide notice for mid-course adjustments. Reporting timelines and contents are subject to Board revisions.

Lagend: Filing has not historically triggered an automatic regulatory Filing has historically tr riggered a regulatory process 2015 Annual Progress Report End of March Summary of 2015 context, activities and milestones achieved Total inves...

AI summary The document outlines various reporting requirements and timelines for a regulatory proceeding, including annual progress reports, evaluation reports, and quarterly filings. These reports include details on program performance, financial statements, and analyses of rate and bill impacts.

IT IS HEREBY ORDERED that: - 1. The Board approves a DSM Plan for 2016-2018 in the aggregate amount of $102,150,000 with a target of total cumulative energy savings of 405.9 GWh and demand savings of 62.5 MW. Approved spending is $33,210,0...

AI summary The Board has approved a DSM Plan for 2016-2018 with a total budget of $102,150,000, setting energy and demand savings targets. It also approved a supply agreement between E1 and NSPI, and directed E1 and NSPI to file various reports and analyses, including on financing deferrals, accounting treatments, and locational DSM efforts.

1.2 Programs and Services Overview 5 6 7 4 The 2016-2018 Residential and Business, Non-profit and Institutional (BNI) programs are expected to include ongoing gradual evolution in order to address the following objectives: • 8 9 10 - Respo...

AI summary Efficiency Nova Scotia (ENS) outlines its 2016-2018 programs, emphasizing market adaptation, research integration, and sector balance. Programs 2.0 aim to enhance customer experience through streamlined services, IT upgrades, and flexible incentives. Residential initiatives include education, rebates, and product upgrades, with ongoing improvements based on market shifts and evaluations.

2.2 Existing Residential 19 20 21 22 23 24 25 26 The Existing Residential program is designed to help reduce electricity consumption for space and water heating and lighting. The goal is to promote cost-effective energy efficiency improvem...

AI summary The Existing Residential program, managed by EfficiencyOne (ENS), aims to reduce electricity consumption in Nova Scotia through energy efficiency improvements in residential buildings. It offers rebates, financing, and services like home energy assessments, with recent modifications including financing pilots and contractor partnerships. The program targets single-family homes, rentals, and multi-family buildings.

2.4 Update on Energy Saving Actions 1 2 3 4 5 6 7 8 9 Efficiency Nova Scotia's 2016-2018 DSM Resource Plan does not include a target or investment for Energy Saving Actions. ENS piloted the Home Energy Report in 2013, and it will continue...

AI summary Efficiency Nova Scotia's 2016-2018 DSM Resource Plan excludes Energy Saving Actions targets. The Home Energy Report pilot, though successful, is ending due to affordability concerns, with ENS prioritizing a balanced portfolio. ENS may explore alternative services for energy efficiency.

- 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 ENS 2016-2018 DSM FILING (E-ENS-R-15) Schedule E • Provide rebates for initial scoping studies and incentives or technical assistance towards detailed engineering assessments fo...

AI summary The Custom Incentives program under ENS (EfficiencyOne) offers rebates, financing, and technical support for energy efficiency projects in Nova Scotia. It targets sectors like retail, education, and industry, promoting innovative technologies and structured commissioning for new buildings. ENS emphasizes tailored services and collaboration with third-party experts to drive conservation efforts.

28 1 • Researching opportunities from otherjurisdictions; 2 of • Researching new measures, which demand-response and/or demand-control 3 be measures are expected to included; 4 of • from Piloting new programs and changes to existing progra...

AI summary The text discusses research into demand-response and demand-control measures, piloting new programs, and enhancing customer experience through improved information management systems. These initiatives aim to improve program delivery, marketing, and customer engagement, as well as increase efficiency and program uptake.

4) COST ALLOCATION 1111 - a) The Parties agree to collaboratively work to develop new DSM cost allocation and DSM cost recovery models to be submitted by October 31, 2015 for approval or Decision by the Board, or within a reasonable period...

AI summary Parties agree to develop DSM cost allocation models by October 31, 2015, for the Board's approval, including 2015 and 2016-2018 allocations, a 2014 rate-smoothing adjustment, and mid-course adjustments. It clarifies that NSPI's discretion regarding DSM cost applications to UARB is not restricted.

5) EVALUATION AND REPORTING - Advisory in 2016 for discussion. - b) EffidencyOne will explore methodologies of demand savings evaluations with its evaluator. - c) EffidencyOne agrees to provide a full report on its 2016-2018 Performance Re...

AI summary EfficiencyOne must report on demand savings evaluations, provide annual performance reports, explain substantial changes in energy savings, and avoid rate class impacts. Reporting timelines and contents are governed by Schedule 1, with Board input. EfficiencyOne may not provide advance notice for mid-course adjustments based on third-party evaluations.

PLACE: Hearing Room A & B, Office of the Board Date UT # REQUESTED OF DATE DUE June 15, 2015 1 To provide list of sources used in developing table 2 on pg 15 of Philippe Dunsky's evidence and how the verification was done. EfficiencyOne By...

AI summary The document outlines various requests made during a regulatory proceeding, primarily involving EfficiencyOne and NSPI. Requests include providing sources for evidence, responses to recommendations, proposed spending details, incentive assessments, and protocols for incentive setting. These requests are part of a broader regulatory process involving the Board and other stakeholders.

Issue 5-g Evaluation and reporting The Settlement Agreement signed by all parties discussed mid-course adjustments under this heading (clauses 5 e and 5g). The main concern with mid-course program changes was the possibility of rate class...

AI summary The Settlement Agreement allows mid-course adjustments, with concerns about rate class impacts. A new low-income rental program (2015-2018) requires significant residential funding. EfficiencyOne proposes 50% residential program funding, while the Affordable Energy Coalition argues for substantial residential funding to ensure equity and access.

is hearing is determining funding for the next 3 years so there is a timing problem. The research could not be completed in time for Efficiency One's February submission or even for this hearing date. It is our contention that during the 2...

AI summary The proceeding discusses funding for DSM programs over 2016-2018, emphasizing the need for pilot projects to expand low-income rental efficiency initiatives. Concerns are raised about budget cuts in the Settlement Agreement threatening program implementation, with witnesses citing risks to both new and existing initiatives. Equity of access and substantial efficiency savings for low-income populations are highlighted as critical.

Page 39: - 1 residentials, marginally viable commercial and industrial firms) to - 2 participate and reduce their bills. - 3 In some situations, careful program design may be able to overcome market - 4 barriers while charging participants...

AI summary The text discusses DSM program design challenges, including balancing cost recovery for participants and avoiding excessive early-rate impacts. It advises caution in delaying retrofit programs to align with higher avoided costs. A testimony by Tim Woolf on the EfficiencyOne 2016-2018 DSM Plan is referenced, highlighting program design risks and cost implications.

Page 32: - 1 necessary to consider issues that are more difficult to quantify but are important 2 nonetheless. For example, it is important to consider customer equity impacts and best 3 practices in program design. - 4 Q. How should custo...

AI summary The text emphasizes the importance of customer equity in DSM program design, arguing that NSPI's alternative plan excludes cost-effective measures, disproportionately affecting low-income and small business customers. Broader participation is advocated to ensure equitable access to efficiency programs, while NSPI's cost-focused approach is criticized as inequitable.

(2) A plan shall include: (i) an assessment of the estimated lifetime cost, reliability and magnitude of all available energy efficiency and demand reduction resources that are cost effective or less expensive than supply; (ii) the amount...

AI summary The Public Utilities Act mandates plans to assess cost-effective energy efficiency and demand reduction resources, propose demand resources, estimate energy cost savings, and detail programs enhancing affordability and reliability. Emphasis is on efficiency, demand response, load management, and supporting low-income customers through rate stability.

Short on Options 24. The IRP was an important starting point in the development of the E1 2016-2018 DSM Resource Plan. 36 The Province agrees that this is an important consideration, but one must be mindful of 33 NSPI has noted that energy...

AI summary The Province critiques E1's DSM plan for relying too heavily on the IRP without adequately addressing affordability and long-term capacity needs. E1's plan avoids significant generation capacity additions until 2032 but may not align with the IRP's broader goals. The Province argues E1 could have provided alternative scenarios for affordability discussions, while E1 cites resource constraints.

- 36. Based on the foregoing, the Province respectfully requests that E1 be directed to develop a plan at a much lower cost than it has requested (or has agreed to accept as a result of proposed settlement arrangements). This may require E...

AI summary The Province requests E1 to develop a lower-cost Demand Side Management (DSM) plan, suggesting removal of marginally cost-effective measures and reducing incentive spending. It emphasizes equitable program design, returning unspent funds, and requiring alternative plans in future filings. Targets include 100 GWh/year energy savings and 18 MW/year demand savings.

Consensus Settlement Agreement and Terms of Consensus Agreement 47. The Province supports some aspects of the terms of Consensus Agreement but does not agree with the DSM investment level and performance targets. The Province notes that in...

AI summary The Province supports aspects of the Consensus Agreement but disagrees with DSM investment levels and performance targets. Other topics for discussion include standardized filing, rate impact analysis, DSM expenditure criteria, and cost-effectiveness testing. The Province supports mid-course adjustments, flexibility for E1, and the Principles of Equity and Performance Targets.

33 Power's customers. Subsection 79L(6) states: DATE FILED: July 8, 2015 Page 9 of 50 Q _ (6) Notwithstanding subsection (5), in the application, the franchise holder is primarily responsible to provide information and evidence to the Boar...

AI summary The document discusses the lack of sufficient evidence provided by E1 to justify the affordability of its DSM programs. E1 did not present a lower-cost plan or alternative options to the Board, despite requests from NS Power. E1's preliminary scenario was not introduced as evidence and thus could not be used to assess affordability.

Response: Please refer to EfficiencyOne's response to NSPI IR‐10 Attachment 1, filed electronically, for measure‐level incentives modelled in the EL‐RAM, which are provided in column BK. The modelled incentive dollars provided reflect actu...

AI summary The response critiques EfficiencyOne's (E1) use of the ELRAM model for incentive calculations, citing lack of rationale, excessive incentives compared to other jurisdictions, and failure to consider cost-effectiveness or affordability. It highlights flaws in E1's process, including reliance on customer input without quantitative criteria and benchmarking against high-cost states, leading to potentially inappropriate incentive levels.

4 Evaluation and Verification Reports and Additional Reporting - 5 The Consensus Agreement addressed evaluation and reporting 1 , by which there would be annual - 6 program impact evaluations, as well as process evaluations at the organiza...

AI summary The Consensus Agreement outlines EfficiencyOne's obligations for annual program impact evaluations, process evaluations, and reporting on performance requirements. It addresses handling 'substantial changes' (≥25% variance), mid-course adjustments requiring advance notice, and avoiding annual rate-class impacts. EfficiencyOne seeks Board approval for the agreed evaluation reporting procedure.

& lt;sup>27 Exhibit 1, EfficiencyOne Evidence, Appendix B, page 1, lines 24-25. 1 I have reviewed Mr. Pickles' benchmarking exercise, and find no support 2 whatsoever for his conclusions. To the contrary, a more careful examination of the...

AI summary The reviewer found no support for Mr. Pickles' conclusions regarding Efficiency Nova Scotia's performance, noting that it aligns with Canadian peers and may be lower cost than U.S. counterparts. The Board also heard testimony about irregularities in Mr. Pickles' benchmarking methodology, including issues with jurisdiction selection and data application.

1 opportunities where you do need to incent. One thing I'll say is that there is only way to know and that's through understanding the market[72](#page-48-0) 2 . 4 [emphasis added] 5 3 6 In his opening statement, filed on behalf of the Ind...

AI summary The document discusses a proposed two-part test by Mr. Drazen on behalf of the Industrial Group, requiring EfficiencyOne to demonstrate cost-effectiveness and inversely proportional investment based on the TRC ratio. EfficiencyOne argues there is no evidence of excessive incentives and questions the assumptions behind the algorithmic approach, such as participants understanding bill savings and believing in the benefits of the measures.

[emphasis added] 25 Mr. Faulkner also advised that based on previous qualitative analysis, it is EfficiencyOne's 26 position that "incentives are the highest motivator to participation and the cost is the highest barrier"[80](#page-52-1) 2...

AI summary EfficiencyOne asserts that incentives are the primary motivator for participation in programs, with cost being the highest barrier. Mr. Dunsky corroborates this, emphasizing that barrier analysis is central to designing effective incentive structures.

(c) Vague and Unquantified Risks to "Efficiency Industry" - 17. E1 has argued not to have its budget reduced due to what it postulates will be negative short and longer-term impacts "including loss of industry capacity, erosion of an energ...

AI summary E1 argues against budget reductions, citing vague risks to the efficiency industry, such as loss of capacity and increased rates. However, these claims lack evidentiary support. E1's 2015 performance showed it met savings goals despite a budget cut, and comparisons to 2011 are deemed inapplicable due to differing contexts. Efficiency NS's early-stage operations in 2011 are highlighted as a qualitative difference from potential future capacity redevelopments.

our evidence? - Mr. Pickles: It's a matter of dispatching a program when needed, as I suggested, with an eye to the time between when you need that program to take full effect in the market. … - Mr. Gogan: But if we have an existing suppli...

AI summary Mr. Gogan argues reducing DSM programs risks harming Nova Scotia's supplier community and utility relationships, while Mr. Pickles contends proper program termination can mitigate harm and enable contractors to become independent. The discussion highlights concerns over contractor exit, loss of confidence, and program management practices.

we would do is look to other jurisdictions to see if they offer similar programs and what incentives they offer and reach out to them and understand how they arrived at that, was there research, etc. But even in our – whether it's an estab...

AI summary The discussion focuses on methods used to determine incentive levels for energy programs, including research, customer surveys, and direct negotiations. Mr. Faulkner explains that marketing teams determine optimal price points through customer surveys, while acknowledging the process has varying levels of rigor. The Chair questions whether the process sufficiently prevents overpayment in incentives.

ints overlap with the Drazen proposal. As noted on page 1, he states that only measures with a net TRC benefit cost ratio greater than 1.0 (i.e., the TRC ratio multiplied by the estimated measure net-to-gross ratio) should be included, unl...

AI summary The text discusses alternative proposals for demand-side management (DSM) measures, emphasizing a net TRC benefit cost ratio above 1.0 and simple payback periods. EfficiencyOne (E1) expresses concerns about delays in creating a step-change plan, while Paul Chernick and Mr. Pickles advocate for specific cost-benefit criteria. E1 has not yet presented a finalized implementation plan.

Small Business Energy Study As outlined in the Evidence provided by John Athas (Exhibit 41) on behalf of the Small Business Advocate (SBA), some constituents of the small business sector fail to participate in and benefit from DSM programs...

AI summary The document highlights that small businesses in Nova Scotia face operational challenges preventing participation in DSM programs, as noted by John Athas on behalf of the Small Business Advocate. The EAC supports a study to improve alignment between efficiency programs and sector needs, emphasizing that DSM program shortcomings should prompt recalibration, not elimination.

MID-COURSE ADJUSTMENTS The ability to adjust to changing conditions is critical to effective energy efficiency programming. The planning cycle for a three-year agreement generally starts one to two years in advance of the threeyear cycle,...

AI summary The document highlights the importance of mid-course adjustments in energy efficiency programming to adapt to changing economic, technological, and consumer conditions. It argues that overly burdensome correction processes reduce flexibility and increase costs, emphasizing the need to quickly implement programs based on ongoing research for low-income renters.

sup>16 NS Power Closing Submission, Page 44, Lines 26-30. 17 Exhibit E-33, NS Power Revised Evidence, Page 33, Figure 3.8. 18 NSDOE Closing Submission, Page 2, Paragraph 7. reflects a deliberate intent on the part of the legislature to ens...

AI summary The text emphasizes affordability as a key factor in DSM approval, citing legislative requirements and past Board practices. It disputes NS Power's claim of being a 'price leader' in DSM, citing benchmarking analysis showing Nova Scotia's DSM investment is middle-of-the-pack. NSDOE's submission is referenced, highlighting affordability considerations.

5 The need for effective control of incentives The Consumer Advocate agrees it is necessary to ensure a cost effective DSM program. That includes ensuring incentives are appropriate. The issue of what level of incentive is appropriate for...

AI summary The Consumer Advocate emphasizes the need for cost-effective DSM programs with appropriate incentives. EfficiencyOne's proposed incentive levels face scrutiny, though no evidence shows they are excessive in Nova Scotia's context. Concerns include determining fair levels, addressing income disparities, and evaluating participation rates. Recommendations include rigorous incentive evaluation, tracking free ridership, and referring programs to a Working Group.

2.0 BACKGROUND - [6] The Board considers it useful to set out some of the background of DSM in Nova Scotia to provide some context for this Decision. - [7] For a number of years prior to 2010, NSPI included requests for approval of spendin...

AI summary The document outlines the transition of DSM administration in Nova Scotia from NSPI to ENSC, established under the ENSC Act. The Board required approval for ENSC's programs and cost allocations, with oversight mandated by the EECR Act (2014), which amended the PUA and repealed the ENSC Act, reshaping DSM governance.

3.1 Evaluation Report of 2014 DSM Programs (Econoler) [28] As in the previous year, El engaged the services of Econoler Inc. ('Econoler") to conduct independent evaluations of the 2014 DSM programs. The Econoler team collaborated with two...

AI summary Econoler Inc. evaluated Nova Scotia's 2014 DSM programs, collaborating with Corporate Research Associates and Equilibrium Engineering. The evaluation followed a 2012 Settlement Agreement's rolling schedule, focusing on validating tracked savings rather than full-scale impact evaluations for mature programs. The 2014 portfolio included seven programs with 16 components, with reports filed in February 2015.

3.2 Verification Report of 2014 OSM Programs (Peach) [38] As in previous years, the Board engaged the services of H. Gil Peach & Associates to conduct an independent verification of the 2014 evaluated DSM savings results. Dr. Peach filed h...

AI summary The Board engaged H. Gil Peach & Associates to verify 2014 OSM DSM program savings. The report reviewed evaluation methods, program data systems, and conducted site visits. Seven programs exceeded energy savings targets, seven underperformed, and three had no targets. Twenty recommendations were identified, fewer than the 30 from the 2013 report.

3.3.1 Findings [52] In his evidence, Dr. Peach commented on the status of the 2013 evaluation and verification recommendations: Q. Are you satisfied with the status of the 2013 verification and evaluation recommendations? A. Yes. In genera...

AI summary The Board accepts El's response to 2013 evaluation recommendations as satisfactory but removes Home Energy Report (HER) energy savings from 2014 totals due to concerns. El must update on 2014 recommendations in its 2015 report. HER is excluded from the 2016-2018 DSM portfolio.

3.5.1 Program Development [56] El's 2016-2018 DSM Resource Plan, as modified by the Quantum Agreement, recommends DSM investments for the three year period of: - (1) $36.9 million in 2016, - (2) $37.8 million in 2017, - (3) $38.8 million i...

AI summary El's 2016-2018 DSM Resource Plan, modified by the Quantum Agreement, allocates $113.5 million over three years. El argues that this plan is 38% less than NSPI's Mid-DSM plan and aligns with past expenditures, including the $53 million from 2014 repurposed for 2015 fuel expenses by the Board.

update in 2009. So I believe we filed a quote from the Terms of Reference for the 2009 IRP and it lists basically what we're trying to evaluate in doing the IRP. Bullet number three says: Develop and evaluate alternative plans in order to...

AI summary The 2016-18 DSM Plan aligns with the 2014 IRP's objective to achieve cost savings and emissions reductions. DSM's primary purpose is to support the IRP's goals, including saving customers money and reducing carbon emissions. Past programs like '08-'09 met their targets, demonstrating the effectiveness of DSM initiatives.

3.5.9 Evaluation and Reporting [107] In approving the Consensus Agreement the Board approves Section 5 dealing with evaluation and reporting.

AI summary The Board approves Section 5 of the Consensus Agreement, which outlines requirements for evaluation and reporting. This section is part of the regulatory process for the agreement, ensuring compliance with evaluation and reporting standards.

3.7 Mid-Course Adjustments and Flexibility [112] In the Consensus Agreement, the parties agreed to the setting of targets over a three year period, instead of annual targets. El had sought the ability to make changes of up to 25% in target...

AI summary The Consensus Agreement sets three-year targets instead of annual ones, allowing El to adjust program savings by up to 25% at the sector level, with explanations for changes exceeding 25%. The Industrial Group opposes this if it impacts customer classes over 25%.

3.7.1 Findings [114] The Board is satisfied that the provisions of the Consensus Agreement adequately address the ability of El to make mid-course adjustments and allow sufficient flexibility at the program level. Limiting the 25% adjustme...

AI summary The Board approves the Consensus Agreement's provisions allowing mid-course adjustments limited to 25% per program, reducing customer class impacts. The Industrial Group's participation is noted.

4)2016-2018 PROGRAMS a) The DSM programs in 2016-2018 will be as proposed in EfficiencyOne's 2016-2018 DSM Resource Plan filing.

AI summary The 2016-2018 Demand Side Management (DSM) programs are outlined in EfficiencyOne's 2016-2018 DSM Resource Plan filing, which forms the basis for proposed initiatives during this period.

10) NS POWER'S CHARITABLE CONTRIBUTION - a) The parties encourage Nova Scotia Power to provide the evaluated results or its low income program to the Board and to stakehotders an an annual basis and to coordinate administration and evaluat...

AI summary Parties urge NS Power to annually report on its low-income program results to the Board and stakeholders, coordinating with EfficiencyOne. They agree that NS Power's charitable contribution-driven DSM activities will not affect EfficiencyOne's performance targets.

4) COST ALLOCATION - a) The Parties agree to collaboratively work to develop new OSM cost allocation and p5Mcost recovery models to be submitted by October 31) 2015 for approval or Decision by the Board, or within a reasonable period of ti...

AI summary Parties agree to develop OSM cost allocation and p5M cost recovery models by October 31, 2015, for Board approval. Key items include 2015 and 2016-2018 allocations, 2014 RSA, and mid-course adjustments. Nova Scotia Power retains discretion in DSM cost treatment.

5) EVALUATION AND REPORTING - a) The Parties support EfficiencyOne's proposal for annual program impact evaluations and process evaluations at the organizational level with program process evaluations if required. EfficiencyOne wilt provid...

AI summary EfficiencyOne agrees to annual impact and process evaluations, condensed reporting to OSM Advisory, and detailed performance reporting for 2016-2018. It will explain substantial changes (≥25% variance) and avoid rate-class impacts via cost allocation. Reporting timelines and content are subject to DSM Advisory Group input, with exceptions for third-party evaluation-driven mid-course adjustments.

Lagend: Filing has not historically triggered an automatic regulatory Filing has historically tr riggered a regulatory process 2015 Annual Progress Report End of March Summary of 2015 context, activities and milestones achieved Total inves...

AI summary The text outlines various filings and reports related to a regulatory process, including annual progress reports, evaluation reports, and financial statements. It details the timing and content of these filings, such as summaries of activities, investment status, and performance indicators.

2014 EVALUATION AND VERIFICATION RECOMMENDATIONS The Board directed EfficiencyOne to file an update on the status of the 2014 evaluation and verification recommendations in its next 2015 report. EfficiencyOne notes that its second-quarter...

AI summary The Board directed EfficiencyOne to update the 2014 evaluation and verification recommendations in its 2015 report. EfficiencyOne included this update in its August 2015 DSM report to the UARB, detailing progress on the 2014 recommendations.

HOME ENERGY REPORT PROGRAM - REPORTED TOTALS FOR 2014 - The Board directed EfficiencyOne to remove the energy and demand savings related to the - Home Energy Report program from the reported totals for 2014, with the ability to request the...

AI summary The Board directed EfficiencyOne to remove 2014 Home Energy Report Program savings from totals, with possible reinstatement if evaluation changes are made. EfficiencyOne will comply, implement evaluator and UARB consultant recommendations in 2015, allowing UARB to reassess and consider reinstating savings.

NOTICE OF MID-COURSE ADJUSTMENTS On the issue of mid-course adjustments, EfficiencyOne is seeking to clarify its position in regard to the provision of advanced notice to the Board and to Stakeholders. In its Decision, the Board stated wit...

AI summary EfficiencyOne seeks clarification on providing advance notice for mid-course adjustments, except when driven by evaluation reports requiring immediate action. The Consensus Settlement Agreement acknowledges this exception, allowing immediate implementation with subsequent communication.

19. DISPUTE RESOLUTION - 19.1 In the event of a dispute in connection with this Agreement, a senior representative of EfficiencyOne and a senior representative of NSPI shall promptly meet to discuss and resolve the dispute and the Parties...

AI summary The dispute resolution process between EfficiencyOne and NSPI involves initial discussions within 30 days (or 10 days for urgent matters), followed by referral to UARB if unresolved. EfficiencyOne must continue EECA implementation unless authorized by UARB.

1. INTRODUCTION The 2016-2018 Demand-Side Management (DSM) Resource Plan has been developed based on ENS's growing experience and history in delivering successful DSM programs and services to Nova Scotians. As part of the process, ENS enga...

AI summary The 2016-2018 Demand-Side Management (DSM) Resource Plan outlines ENS's comprehensive suite of programs and services for Nova Scotia electricity users. It emphasizes flexibility for mid-course adjustments based on market conditions and stakeholder agreements, while addressing affordability and long-term planning considerations.

1.2 Programs and Services Overview 5 7 8 4 The 2016-2018 Residential and Business, Non-profit and Institutional (BNI) programs are expected to include ongoing gradual evolution in order to address the following objectives: 9 10 11 12 13 -...

AI summary The 2016-2018 Residential and BNI programs aim to evolve by addressing market changes, research findings, and ensuring access across ratepayers. ENS plans 'Programs 2.0' to enhance customer experience through streamlined services, flexible support, and IT improvements, with implementation expected in 2016. The initiative seeks to maintain industry capacity stability and balance investments between sectors.

2.2 Existing Residential The Existing Residential program is designed to help reduce electricity consumption for space and water heating and lighting. The goal is to promote cost-effective energy efficiency improvements to Nova Scotia's ho...

AI summary The Existing Residential program aims to reduce electricity consumption through energy efficiency improvements in Nova Scotia's housing stock. It offers rebates, financing, and low-cost product installations, targeting single-detached homes, rentals, and multi-family buildings. ENS collaborates with service organizations and contractors, with recent initiatives including energy planning tools and property tax financing pilots.

hoices than would otherwise have been purchased; • Discretionary retrofit: efficient components intended to replace existing equipment before the end of its useful life as a cost-effective retrofit. Technical and financial services support...

AI summary The Custom Incentives program promotes energy efficiency through rebates, financing, and technical support for retrofit projects. ENS targets specific markets like retail, education, and industry, while BNI participants implement measures via third parties. Services include low-interest loans, expert referrals, and incentives for best practices in building systems.

4.2 Development and Research - Efficiency Nova Scotia uses evidence-based decision-making to improve program design and delivery and to guide business strategy. This approach ensures ENS is making the best possible decisions for evolving b...

AI summary Efficiency Nova Scotia employs evidence-based strategies to enhance program design and business strategy, focusing on two areas: research and development for DSM Resource Plans and improving service delivery to Nova Scotians. This approach minimizes risk and cost while aligning with evolving business needs.

4.2.1 Primary and Secondary Research - Innovation is critical to ensure ENS programs reflect current technologies and consumer behaviour patterns. As such, an important focus of research will be to explore new opportunities for DSM program...

AI summary ENS aims to enhance DSM programs through primary and secondary research, focusing on innovation, consumer behavior, and new opportunities like demand-response. Research initiatives include analyzing participation barriers, energy trends, and testing marketing approaches. A new information management system is proposed to improve customer experience, streamline reporting, and increase program efficiency.

4.3.1 Property-Assessed Clean Energy (PACE) Financing ENS recognizes a lack of upfront capital can be a barrier to customers adopting energy efficiency measures. For this reason, financing DSM activities is a complementary incentive struct...

AI summary ENS acknowledges upfront capital barriers hinder energy efficiency adoption and supports financing DSM activities as complementary incentives. Despite low historical participation rates in financing programs (median <0.5% in 2011), ENS will provide tools for municipalities to develop PACE programs, which allow property tax add-ons for energy upgrades. ENS's role is an Enabling Strategy, not direct program delivery.

1. INTRODUCTION The 2016-2018 DSMDemand-Side Management (DSM) Resource Plan has been developed based on ENS's growing experience and history in delivering successful DSM programs and services to Nova Scotians. As part of the process, ENS e...

AI summary The 2016-2018 DSM Resource Plan by ENS outlines programs and services for Nova Scotia electricity users, developed with consulting firms and aligned with the UARB's 2015 decision. The plan emphasizes flexibility for mid-course adjustments, affordability, and compliance with NS Power's IRP. It includes residential, BNI, and enabling strategies sections, with revised investment targets to meet annual DSM funding requirements.

a Lifetime benefits are expressed as the net present value of the avoided costs, including energy and capacity, over the life of the program measures. b TRC is a benefit/cost ratio comparing lifetime benefits to the sum of ENS's and partic...

AI summary The text discusses the calculation of lifetime benefits and the Total Benefit/Cost Ratio (TRC), which compares the net present value of avoided costs to the combined costs of ENS and participants over the life of a program.

2.2 Existing Residential The Existing Residential program is designed to help reduce electricity consumption for space and water heating and lighting. The goal is to promote cost-effective energy efficiency improvements to Nova Scotia's ho...

AI summary The Existing Residential program aims to reduce electricity consumption in Nova Scotia's housing stock through energy efficiency incentives, rebates, and financing. It targets single-family homes, rentals, and multi-family buildings, offering services like heating system upgrades and lighting improvements. Recent initiatives include energy planning tools and financing options tied to property taxes.

2.4 Update on Energy Saving Actions Efficiency Nova Scotia's 2016-2018 DSM Resource Plan does not include a target or investment for Energy Saving Actions. ENS piloted the Home Energy Report in 2013, and it will continue until early 2016....

AI summary Efficiency Nova Scotia's 2016-2018 DSM plan lacks energy-saving targets. The Home Energy Report pilot ends in 2016 due to affordability concerns, with ENS opting to discontinue it to minimize impact on portfolio balance and industry capacity. Future plans may revisit the program if higher savings are needed. Behavior-based efficiency remains a priority, with ENS exploring alternative incentives through research.

3.1 Efficient Product Rebates (BNI) The BNI Efficient Product Rebates program provides financial incentives, through prescriptive rebates, on a wide variety of products to encourage BNI end-users to reduce electrical energy consumption and...

AI summary The BNI Efficient Product Rebates program offers prescriptive rebates for energy-efficient products to reduce electrical consumption and peak demand. Eligible BNI customers can choose from predefined measures, with rebates administered via mail-in applications or point-of-purchase discounts. The program aims to raise awareness, promote efficient technologies, and transform market practices through expanding rebate offerings and streamlined processes.

3.2 Custom Incentives The Custom Incentives program provides financial incentives to help commercial, industrial, not-for-profit and institutional customers reduce their electrical energy consumption and peak demand. Incentives are provide...

AI summary The Custom Incentives program offers financial support to commercial, industrial, and non-profit customers for energy audits and efficiency upgrades, including measures not covered by other ENS programs. It accommodates various project phases and supports discretionary retrofits and new equipment replacements. ENS also plans to assist cogeneration projects outside the COMFIT program.

4. ENABLING STRATEGIES Enabling Strategies are essential to ensure that ENS is able to increase awareness about energy efficiency, evolve services, and provide information and tools needed by Nova Scotians to make informed energy choices....

AI summary Enabling Strategies aim to increase energy efficiency awareness, evolve DSM services, and drive market transformation through education, innovation, and outreach. ENS highlights cost efficiencies from activities like LED Holiday Light Exchange and Appliance Retirement, while committing to long-term DSM goals despite short-term affordability concerns. Investments in initiatives like Passive House and PACE financing are emphasized.

Specific Compliance Filing Comments The Small Business Advocate (SBA) offers the following comments specific to items within the EfficiencyOne Compliance Filing of September 15, 2015. - 1. The issue of flexibility in deviating from specifi...

AI summary The Small Business Advocate (SBA) provides comments on EfficiencyOne's 2015 compliance filing, raising concerns about Mid-Course Adjustments, budget increases for the Residential Efficiency Rebate Program despite lower TRC/PAC test results, missing Rate Impact analyses, and collaboration on a 2016 Small Business Energy Study. The SBA requests clarity on budget flexibility and highlights gaps in cost recovery analysis.

INCENTIVES REPORT With respect to incentives, the Board directed E1 to undertake research and make recommendations on a more rigorous program, to be filed with the Board by March 31, 2016. E1 requested an extension to June 30, 2016, to all...

AI summary The Board directed E1 to propose a more rigorous incentive program by March 31, 2016. E1 requested an extension to June 30, 2016, with the Industrial Group supporting the extension if revisions can be implemented promptly. The Industrial Group also recommends preserving flexibility to adjust incentives in long-term contracts.

1.2 Programs and Services Overview 5 7 8 4 The 2016-2018 Residential and Business, Non-profit and Institutional (BNI) programs are expected to include ongoing gradual evolution in order to address the following objectives: 9 10 11 12 13 14...

AI summary The 2016-2018 Residential and BNI programs aim to evolve by adapting to market changes, incorporating research, and ensuring accessibility. ENSC will implement Program 2.0 to enhance customer experience through streamlined access, IT improvements, and flexible support, with rollout expected in 2016. The initiative seeks to maintain industry capacity and balance investments between sectors.

2. RESIDENTIAL PROGRAMS AND SERVICES Efficiency Nova Scotia's Residential sector offerings include a variety of initiatives to help homeowners, renters and landlords become more efficient in their use of electricity. Educating potential pa...

AI summary Efficiency Nova Scotia (ENS) offers residential programs to promote energy efficiency through rebates, education, and home assessments. Programs include Efficient Product Rebates, Existing Residential, and New Residential services. ENS aims to maximize energy savings by encouraging multiple efficiency actions and will adapt services over a three-year period based on market needs and evaluations.

2.2 Existing Residential The Existing Residential program is designed to help reduce electricity consumption for space and water heating and lighting. The goal is to promote cost-effective energy efficiency improvements to Nova Scotia's ho...

AI summary The Existing Residential program aims to reduce electricity consumption in Nova Scotia through energy efficiency improvements in residential buildings. It offers rebates, financing, and services like home energy assessments, targeting single-family homes, rentals, and multi-family units. Recent initiatives include a personal energy planner, property tax financing pilots, and a trade partner directory on ENS's website.

2.4 Update on Energy Saving Actions Efficiency Nova Scotia's 2016-2018 DSM Resource Plan does not include a target or investment for Energy Saving Actions. ENS piloted the Home Energy Report in 2013, and it will continue until early 2016....

AI summary Efficiency Nova Scotia's 2016-2018 DSM Resource Plan lacks Energy Saving Actions targets. The Home Energy Report pilot (2013-2016) will end due to affordability concerns, despite its energy-saving success. ENS prioritizes minimizing impact on portfolio balance and industry capacity. Behavior-based programs remain important, with ENS exploring alternatives via Enabling Strategies.

hoices than would otherwise have been purchased; • Discretionary retrofit: efficient components intended to replace existing equipment before the end of its useful life as a cost-effective retrofit. Technical and financial services support...

AI summary The Custom Incentives program under Nova Scotia's energy efficiency initiatives provides rebates, financing, and technical support for retrofit projects, targeting specific markets like retail, education, and industry. ENS coordinates with third parties to implement measures, focusing on innovative technologies and best practices in building systems.

4.1 Education and Outreach The complexity of the electricity system means that many concepts and terms are not familiar or accessible to most Nova Scotians. The concept of energy efficiency is equally challenging to communicate effectively...

AI summary Education and Outreach is critical to DSM efforts in Nova Scotia, as energy efficiency concepts are complex and require public understanding to drive adoption. The 2014 Electricity Efficiency and Conservation Restructuring Act emphasizes energy efficiency as part of the electricity supply. While Enabling Strategies have improved public awareness (35% unaided awareness in 2014), further outreach is needed to increase participation in DSM programs. Strategies will build on feedback from Nova Scotians and past initiatives.

4.2 Development and Research - Efficiency Nova Scotia uses evidence-based decision-making to improve program design and delivery and to guide business strategy. This approach ensures ENS is making the best possible decisions for evolving b...

AI summary Efficiency Nova Scotia (ENS) employs evidence-based decision-making to enhance program design, delivery, and business strategy. ENS will invest in two areas: research and development for Demand Side Management (DSM) Resource Plans and improving service delivery to Nova Scotians.

IT IS HEREBY ORDERED that: - 1. The Board approves a DSM Plan for 2016-2018 in the aggregate amount of $102,150,000 with a target of total cumulative energy savings of 405.9 GWh and demand savings of 62.5 MW. Approved spending is $33,210,0...

AI summary The Board approves a DSM Plan for 2016-2018 with a budget of $102.15 million and sets targets for energy and demand savings. It also approves a supply agreement, consensus agreement, and various filing requirements. The TRC test is maintained, and E1 is directed to explore alternate DSM budget scenarios and improve incentive determination processes.

- (w) "Release" or "Released" means a releasing, adding, spilling, leaking, pumping, pouring, emitting, emptying, discharging, injecting, escaping, leaching, migrating, dispersing, dispensing, disposing or dumping. - (x) "Significant Chang...

AI summary The section defines key terms including 'Release,' 'Significant Changes,' 'Subcontractor,' and 'UARB,' establishing interpretive rules for the agreement. It outlines definitions related to environmental regulation, program management, and contractual obligations under the EECA Plan, with references to the UARB's authority.

3. ELECTRICITY EFFICIENCY and CONSERVATION ACTIVITIES - 3.1 For the Term of this Agreement, EfficiencyOne will, - (a) provide the EECA in accordance with this Agreement; - (b) provide sufficient resources to enable EfficiencyOne to perform...

AI summary EfficiencyOne is obligated to deliver the EECA Plan professionally, efficiently, and in compliance with applicable laws. NSPI is not liable for the EECA Plan unless its non-compliance with the Act is the cause. The agreement emphasizes timely performance and environmental safety.

1. INTRODUCTION 1 2 3 4 5 The 2016-2018 Demand-Side Management (DSM) Resource Plan has been developed based on ENS's growing experience and history in delivering successful DSM programs and services to Nova Scotians. As part ofthe process,...

AI summary The 2016-2018 Demand-Side Management (DSM) Resource Plan was developed by ENS with input from consulting firms. It outlines a range of programs and services for Nova Scotia electricity users, emphasizing flexibility for mid-course adjustments based on stakeholder agreements and regulatory decisions. The plan balances affordability and long-term planning while avoiding unnecessary system capacity additions.

1.2 Programs and Services Overview 5 6 7 4 The 2016-2018 Residential and Business, Non-profit and Institutional (BNI) programs are expected to include ongoing gradual evolution in order to address the following objectives: • 8 9 10 - Respo...

AI summary The 2016-2018 programs aim to evolve residential and BNI initiatives by addressing market changes, incorporating research, and ensuring access across sectors. Efficiency Nova Scotia (ENS) plans Programs 2.0 to improve customer experience through streamlined services, IT enhancements, and flexible incentives, with rollout in 2016. The 2015 DSM Resource Settlement Agreement influences low-income participation. Objectives include stability, sector investment balance, and expanded energy efficiency offerings.

2.2 Existing Residential 19 20 21 22 23 24 25 26 The Existing Residential program is designed to help reduce electricity consumption for space and water heating and lighting. The goal is to promote cost-effective energy efficiency improvem...

AI summary The Existing Residential program aims to reduce electricity consumption for heating, lighting, and water heating in Nova Scotia's housing stock through cost-effective energy efficiency improvements. Services include rebates, financing, and low-cost product installations, with examples of recent initiatives like personal energy planners and property tax-based financing pilots. ENS manages the program, collaborating with contractors and municipalities.

2.4 Update on Energy Saving Actions 1 2 3 4 5 6 7 8 9 Efficiency Nova Scotia's 2016-2018 DSM Resource Plan does not include a target or investment for Energy Saving Actions. ENS piloted the Home Energy Report in 2013, and it will continue...

AI summary Efficiency Nova Scotia's 2016-2018 DSM plan lacks energy-saving action targets. The Home Energy Report pilot, successful in energy savings, will end by early 2016 due to affordability concerns, leading to reduced DSM investment. ENS plans to explore alternative strategies while emphasizing the importance of behavior-based energy efficiency.

example, through the LED Holiday Light Exchange, ENS achieves a small amount of energy savings from an outreach-based activity. 1 14 15 16 17 13 higher DSM results in the longer term. 18 19 20 26 27 4.1 Education and Outreach The complexit...

AI summary ENS (Efficiency Nova Scotia) achieves energy savings through outreach programs like the LED Holiday Light Exchange. Education and outreach are critical for DSM (Demand-Side Management) success, supported by the Electricity Efficiency and Conservation Restructuring (2014) Act. Enabling Strategies focus on cost-efficient methods, including financing incentives and Passive House initiatives, with investments aligned with comparison jurisdictions.

5) EVALUATION AND REPORTING - Advisory in 2016 for discussion. - b) EffidencyOne will explore methodologies of demand savings evaluations with its evaluator. - c) EffidencyOne agrees to provide a full report on its 2016-2018 Performance Re...

AI summary EfficiencyOne must report on 2016-2018 performance, explain substantial changes (≥25% variance), avoid rate-class impacts via cost allocation, and provide advance notice for mid-course adjustments. The Board may revise report contents based on DSM Advisory Group discussions. EfficiencyOne claims inability to notify for third-party evaluation adjustments.

Summary of NSPI's proposed DSM plan 2016-2018[3](#page-11-3) - NSPI recommends a DSM plan with a spending level of approximately $22 million per year or $66 - million over the three year period. NSPI also made, among others, the following...

AI summary NSPI proposes a DSM plan with a spending level of approximately $22 million per year over three years. It requests annual allocation of the contract price, deferral of cost allocation decisions, rejection of a reserve fund and a change in cost effectiveness testing methodology, and the establishment of a standardized filing for future DSM applications.

- UARB Decision[6](#page-13-1) - On August 12, 2015, the UARB submitted its decision. A summary of the UARB's findings is as - follows: - The UARB did not approve the Quantum Agreement; however, it does approve an aggregate spending of $10...

AI summary The UARB approved an aggregate spending of $102.2 million for the EfficiencyOne DSM Plan, a 10% reduction from the Quantum Agreement. It also approved the Consensus Agreement, referring matters to the DSM Advisory Group and requiring EfficiencyOne to submit recommendations on incentive programs by March 31, 2016.

Residential programs - Efficient Product Rebates – consists of point-of-purchase discounts and incentives for the retirement of old, inefficient appliances. - Existing Residential - consists of the Residential Direct Install, Rental Proper...

AI summary Nova Scotia's residential energy efficiency programs include rebates for appliance retirement, existing home retrofits, new construction integration, and energy usage comparisons. The Energy Savings Actions program is set to terminate in 2016. These initiatives aim to reduce electricity consumption through targeted efficiency measures.

Residential Programs - Efficient Product Rebates – consists of point-of-purchase discounts and incentives for the retirement of old, inefficient appliances. - Existing Residential - consists of the Residential Direct Install, Rental Proper...

AI summary The document outlines residential energy efficiency programs in Nova Scotia, including rebates for efficient products, existing and new residential services, and energy savings initiatives aimed at reducing electricity consumption through various measures.