HomeProgram EvaluationM07543Evidence
Topic/Matter Intersection

Topic:"Program Evaluation" in M07543

Matter: E-ENS-R-16 - EfficiencyOne Application for Approval of 2016-2018 DSM Resource Plan Matter deferred for DSM Advisory Group CollaborationRelated to M06733
44 passages 3 documents

Program Evaluation across all matters →

E-1Consensus Agreement 15 passages
2.1 DSM BASELINE STUDY p. p. 17
2.1 DSM BASELINE STUDY EfficiencyOne will commission a DSM baseline study in advance of each DSM Potential Study. The DSM Baseline Study will identify current stocks of electricity consuming devices in all market sectors.

AI summary EfficiencyOne will commission a DSM baseline study prior to each DSM Potential Study to identify current stocks of electricity-consuming devices across all market sectors, establishing a reference point for demand-side management initiatives.

3.1 BALANCED PLAN APPROACH p. p. 17
3.1 BALANCED PLAN APPROACH EfficiencyOne will produce DSM Resource Plans that balance multiple objectives of DSM, including: - Maximize short-term and long-term energy and capacity avoidance; - Minimize program administration costs; - Maxi...

AI summary EfficiencyOne will develop DSM Resource Plans balancing objectives such as maximizing energy and capacity avoidance, minimizing costs, enhancing non-electric benefits, ensuring program diversity, preserving business relationships, and promoting broad program access across market sectors and rate classes.

Performance Indicators consist of: 5 p. p. 17
Performance Indicators consist of: 5 - i. Annual incremental energy savings (reported by program and rate class); - ii. Cumulative annual energy savings (reported by program and rate class); - iii. Lifetime savings (reported by program and...

AI summary The document outlines ten performance indicators for evaluating program effectiveness, including energy and peak demand savings, ratepayer benefits, spending, customer satisfaction, rate impact analysis, and low-income program metrics. Reporting requirements include annual and cumulative data, geographic census-based estimates, and annual filings by EfficiencyOne.

4. DSM TRACKING, EVALUATION AND VERIFICATION p. p. 17
4. DSM TRACKING, EVALUATION AND VERIFICATION

AI summary This section addresses the tracking, evaluation, and verification of Demand Side Management (DSM) programs under Nova Scotia Power's regulatory proceedings, overseen by the Utility and Regulatory Board (UARB).

4.1 TRACKING p. p. 17
4.1 TRACKING EfficiencyOne will track the energy and capacity savings resulting from each program. Tracked results will be used in quarterly reports.

AI summary EfficiencyOne is responsible for tracking energy and capacity savings from each program, with tracked results used in quarterly reports to monitor program effectiveness.

4.2 EVALUATION p. p. 17
4.2 EVALUATION EfficiencyOne will retain the services of an independent DSM evaluation firm to conduct annual evaluations for each DSM program, as described in Sections [5.5](#page-28-0) and [5.6.](#page-28-1)

AI summary EfficiencyOne will retain an independent DSM evaluation firm to conduct annual evaluations for each DSM program, as outlined in Sections 5.5 and 5.6.

4.3 VERIFICATION p. p. 17
4.3 VERIFICATION The UARB's savings verification consultant provides a verification review of the evaluated savings. The verification consultant will produce a report that states the net energy and peak demand savings for the programs, and...

AI summary The UARB's savings verification consultant reviews program savings, producing reports on net energy and peak demand savings while outlining adjustments to evaluation reports. This process ensures accuracy in assessing program effectiveness.

5.2 ANNUAL PROGRESS REPORTS p. p. 17
5.2 ANNUAL PROGRESS REPORTS In the first quarter of the calendar year of each intervening year between multi-year filings, ENS will file an Annual Progress Report (APR) with the UARB, which will include the following information: 7 - A sum...

AI summary ENS must submit Annual Progress Reports (APR) to the UARB, detailing prior year activities, discrepancies, and cost/savings. Corrective Action Plans are required if results fall below 75% of forecasts. Significant plan changes, like budget or target adjustments over 25%, must be notified in APRs.

5.5 IMPACT EVALUATION p. pp. 17-28
5.5 IMPACT EVALUATION ENS will file impact evaluations for each program annually, produced by an independent third party DSM program evaluator.

AI summary ENS will submit annual impact evaluations for each program, conducted by an independent third-party DSM program evaluator.

5.6 PROCESS EVALUATION p. p. 28
5.6 PROCESS EVALUATION ENS will file process evaluations for individual programs, produced by an independent third party DSM program evaluator as necessary. Examples of instances in which a program-level evaluation would occur include newl...

AI summary ENS will submit process evaluations for individual programs, conducted by an independent third-party DSM program evaluator, when new components are created, major changes occur, numerous recommendations are received, or energy savings variance exceeds 25% of planned.

1) EST ABLI SHM ENT OF A STANDARDIZE D FILING FOR FUTU RE APPLICATIONS T O A PPROV E A DSM SUPPLY A GREEMENT p. p. 31
1) EST ABLI SHM ENT OF A STANDARDIZE D FILING FOR FUTU RE APPLICATIONS T O A PPROV E A DSM SUPPLY A GREEMENT - a) The Parties agree to the establishment of a standardized filing for future applications, the substance of which will be vette...

AI summary Parties agree to establish a standardized filing process for future DSM supply agreements, subject to DSM Advisory Group approval. The filing will include program descriptions, energy savings metrics, cost-effectiveness analyses, and rate impact details, with EfficiencyOne retaining flexibility to add relevant information and provide technical data.

3) PERFORMAN CE TARG ETS , INDICATORS AND THRESHOLDS p. p. 31
3) PERFORMAN CE TARG ETS , INDICATORS AND THRESHOLDS - a) The parties agree to the following Performance Targets and Performance Indicators: - i) Performance Targets are set over the three-year contract period, rather than annually. - ii)...

AI summary Parties agree to three-year performance targets for cumulative energy and peak demand savings, with 90% compliance required to avoid regulatory action. Indicators include annual savings, lifetime benefits, and customer satisfaction. EfficiencyOne must report by program and rate class, with specific rate impact analyses and low-income participation metrics.

5) EVALUATION AND REPORTlNG p. p. 31
5) EVALUATION AND REPORTlNG - a) The Parties support EfficiencyOne's proposal for annual program impact evaluations and process evaluations at the organizational level with program process evaluations if required. EfficiencyOne will provid...

AI summary Parties support EfficiencyOne's proposal for annual program evaluations and impact reporting. EfficiencyOne will provide performance reports, explain substantial changes (≥25% variance), avoid rate-class impacts via cost allocation, and notify mid-course adjustments. Reporting timelines and contents are subject to Board revisions.

Filing has historically triggered a regulatory process. p. p. 31
Filing has historically triggered a regulatory process. Year Report/ Process Filing Timeframe Inclusions 2015 2015 Q2 Report July/Aug • Quarterly and YTD Highlights: Comparison of targets, mid-course adjustments, and results (by program) 0...

AI summary The text outlines a historical regulatory process triggered by filings, including quarterly and YTD reports, sector highlights, and meetings with the Demand Side Management Advisory Group (DSMAG). These reports include comparisons of targets, results, investments, and other activities related to energy efficiency programs.

4) 2016-2018 PROGRAMS p. p. 31
4) 2016-2018 PROGRAMS a) The DSM programs in 2016-2018 will be as proposed in EfficiencyOne's 2016-2018 DSM Resource Plan filing.

AI summary The 2016-2018 DSM programs will follow EfficiencyOne's proposed 2016-2018 DSM Resource Plan filing, as outlined in the regulatory proceeding document.

E-2Revised Consensus Agreement 12 passages
4.2.1 DSM BASELINE STUDY p. p. 20
4.2.1 DSM BASELINE STUDY EfficiencyOne will commission a DSM baseline study in advance of each DSM Potential Study. The DSM Baseline Study will identify current stocks of electricity consuming devices in all market sectors.

AI summary EfficiencyOne will commission a DSM baseline study prior to each DSM Potential Study to identify current stocks of electricity-consuming devices across all market sectors, forming the foundation for assessing demand-side management opportunities.

Performance Indicators consist of:[12](#page-23-1) p. p. 22
Performance Indicators consist of:[12](#page-23-1) - i. Annual incremental energy savings (reported by program and rate class); - ii. Cumulative annual energy savings (reported by program and rate class); - iii. Lifetime savings (reported...

AI summary The document outlines performance indicators for demand-side management (DSM) programs, including energy and peak demand savings, ratepayer benefits, customer satisfaction, and low-income program reporting. EfficiencyOne is required to submit annual rate impact analyses by October 31, with data aggregated by program and rate class.

4.3.4 DSM PROGRAMS p. pp. 22-23
4.3.4 DSM PROGRAMS Investments in DSM programs reduce energy consumption through technology replacements and behaviour change. DSM programs are offered to the Residential and the Business, Not-for-Profit and Institutional (BNI) sectors as...

AI summary Investments in DSM programs reduce energy consumption through technology and behavior changes, targeting residential and BNI sectors with rebates, incentives, and installations. Programs include efficient product rebates, energy savings actions, and custom incentives for different sectors.

4.4.2 EVALUATION p. p. 24
4.4.2 EVALUATION EfficiencyOne will retain the services of an independent DSM evaluation firm to conduct annual evaluations for each DSM program, as described in Sections [5.5](#page-27-0) and [5.6.](#page-27-1)

AI summary EfficiencyOne will retain an independent DSM evaluation firm to conduct annual evaluations for each DSM program, as outlined in Sections 5.5 and 5.6. This ensures compliance with regulatory requirements for program performance assessment.

4.4.3 VERIFICATION p. p. 24
4.4.3 VERIFICATION The UARB's savings verification consultant provides a verification review of the evaluated savings. The verification consultant will produce a report that states the net energy and peak demand savings for the programs, a...

AI summary The UARB's savings verification consultant reviews evaluated savings, producing a report detailing net energy and peak demand savings for programs and outlining adjustments to evaluation reports. This process ensures accuracy in savings calculations for regulatory compliance.

4.5.2 ANNUAL PROGRESS REPORTS p. pp. 24-25
4.5.2 ANNUAL PROGRESS REPORTS In the first quarter of the calendar year of each intervening year between multi-year filings, ENS will file an Annual Progress Report (APR) with the UARB, which will include the following information:[14](#pa...

AI summary ENS must submit Annual Progress Reports (APR) to the UARB, detailing performance, discrepancies, and corrective actions if energy savings fall below 75% of forecasts. Significant changes to programs or budgets require advance notice.

4.5.5 IMPACT EVALUATION p. pp. 26-27
4.5.5 IMPACT EVALUATION ENS will file impact evaluations for each program annually, produced by an independent third party DSM program evaluator.

AI summary ENS will submit annual impact evaluations for each program, conducted by an independent third-party DSM program evaluator.

4.5.6 PROCESS EVALUATION p. p. 27
4.5.6 PROCESS EVALUATION ENS will file process evaluations for individual programs, produced by an independent third party DSM program evaluator as necessary. Examples of instances in which a program-level evaluation would occur include ne...

AI summary ENS will submit process evaluations for DSM programs by an independent third-party evaluator when certain conditions are met, such as new programs, major changes, high recommendations, or energy savings variance exceeding 25%.

5) EVALUATION AND REPORTlNG p. p. 30
5) EVALUATION AND REPORTlNG - a) The Parties support EfficiencyOne's proposal for annual program impact evaluations and process evaluations at the organizational level with program process evaluations if required. EfficiencyOne will provid...

AI summary Parties support EfficiencyOne's proposal for annual program evaluations, including impact and process assessments. EfficiencyOne will report on 2016-2018 performance in 2019, explain substantial changes (≥25% variance), and avoid rate-class impacts via cost allocation. Reporting timelines and content are outlined in Schedule 1, with mid-course adjustments requiring advance notice except for third-party evaluation-driven changes.

Filing has historically triggered a regulatory process. p. p. 30
Filing has historically triggered a regulatory process. Year Report/ Process Filing Timeframe Inclusions 2015 Annual Progress Report End of March • Summary of 2015 context, activities and milestones achieved • 2015 investment by rate class...

AI summary The document outlines the historical regulatory process triggered by filings, including annual progress reports, evaluation reports, and financial statements. These filings provide summaries of activities, investments, performance targets, and program evaluations, with specific timelines and inclusions for each report.

4) 2016-2018 PROGRAMS p. p. 30
4) 2016-2018 PROGRAMS a) The DSM programs in 2016-2018 will be as proposed in EfficiencyOne's 2016-2018 DSM Resource Plan filing.

AI summary The 2016-2018 DSM programs will follow EfficiencyOne's 2016-2018 DSM Resource Plan filing, as outlined in the regulatory proceeding document.

1 0) NS POWER'S CHARlTABLE CONTRIBUTION p. p. 30
1 0) NS POWER'S CHARlTABLE CONTRIBUTION - a) The parties encourage Nova Scotia Power to provide the evaluated results of its low income program to the Board and to stakeholders on an annual basis and to coordinate administration and evalua...

AI summary The parties urge NS Power to annually report on its low-income program results and coordinate with EfficiencyOne. They also agree that DSM activities from NS Power's charitable contributions won't affect EfficiencyOne's performance targets.

E-3Executed Consensus Agreement 17 passages
2. BACKGROUND p. p. 14
2. BACKGROUND On June 16, 2015, EfficiencyOne, Nova Scotia Power Incorporated (NS Power), the Consumer Advocate, the Small Business Advocate, the Ecology Action Centre, the Affordable Energy Coalition, and the Industrial Group signed a Con...

AI summary In 2015, EfficiencyOne and Nova Scotia Power Inc. (NSP) signed a Consensus Agreement establishing a standardized DSM filing framework, approved by the Utility and Review Board in 2015. The framework, based on Efficiency Maine's model, includes DSM program standards and evaluation processes, with a deadline for Board approval by June 30, 2016.

Table 1: STANDARDIZED FILING FRAMEWORK p. pp. 14-16
Table 1: STANDARDIZED FILING FRAMEWORK ITEM DESCRIPTION 1. INTRODUCTION A brief introduction to the DSM filing and a brief overview of any agreements reached between EfficiencyOne and NSPI. All agreements between EfficiencyOne and NSPI wil...

AI summary The document outlines the standardized filing framework for the DSM (Demand Side Management) plan, including an introduction, background, and a summary of previous DSM expenditures and energy savings results. It also discusses the results of each program in the most recently completed DSM Resource Plan.

Appendix 1 Standardized Filing Framework p. pp. 16-18
Appendix 1 Standardized Filing Framework ITEM DESCRIPTION 4.2 Program Level Energy Savings and Investment A summary of program-level savings and investment for the upcoming period. Reference to benchmarks of plans from other jurisdictions...

AI summary The appendix outlines the standardized filing framework for program-level energy savings and investment, program descriptions, and the development of the upcoming period's DSM Resource Plan. It includes details on metrics, evaluation, and reporting requirements.

4.2.1 DSM BASELINE STUDY p. p. 20
4.2.1 DSM BASELINE STUDY EfficiencyOne will commission a DSM baseline study in advance of each DSM Potential Study. The DSM Baseline Study will identify current stocks of electricity consuming devices in all market sectors.

AI summary EfficiencyOne will commission a DSM baseline study prior to each DSM Potential Study to identify current electricity-consuming devices in all market sectors, as part of Nova Scotia's regulatory process.

4.3.1 BALANCED PLAN APPROACH p. p. 20
4.3.1 BALANCED PLAN APPROACH EfficiencyOne will produce DSM Resource Plans that balance multiple aspects of DSM for the benefit of customers, including: - Short-term and long-term energy and capacity avoidance; - Program delivery costs; -...

AI summary EfficiencyOne will develop DSM Resource Plans balancing energy avoidance, program costs, avoided investments, non-electric benefits, program diversity, market access, and rate impacts to benefit customers.

Performance Indicators consist of:[12](#page-23-1) p. p. 22
Performance Indicators consist of:[12](#page-23-1) - i. Annual incremental energy savings (reported by program and rate class); - ii. Cumulative annual energy savings (reported by program and rate class); - iii. Lifetime savings (reported...

AI summary Nova Scotia Power Inc. (NSP) is required to report ten performance indicators related to energy savings, demand reduction, ratepayer benefits, and program effectiveness. These include annual and cumulative energy/peak demand savings, lifetime savings, spending, customer satisfaction, rate impact analysis, and low-income program metrics, with specific reporting deadlines and methodologies.

4.4.1 TRACKING p. p. 24
4.4.1 TRACKING EfficiencyOne will track the energy and capacity savings resulting from each program. Tracked results will be used in quarterly reports.

AI summary EfficiencyOne is responsible for tracking energy and capacity savings from programs, with results reported quarterly. This process ensures accountability and transparency in program outcomes.

4.4.3 VERIFICATION p. p. 24
4.4.3 VERIFICATION The UARB's savings verification consultant provides a verification review of the evaluated savings. The verification consultant will produce a report that states the net energy and peak demand savings for the programs, a...

AI summary The UARB's savings verification consultant reviews program savings, producing a report on net energy and peak demand savings, and outlines adjustments to evaluation reports as part of the verification process.

4.5.2 ANNUAL PROGRESS REPORTS p. pp. 24-25
4.5.2 ANNUAL PROGRESS REPORTS In the first quarter of the calendar year of each intervening year between multi-year filings, ENS will file an Annual Progress Report (APR) with the UARB, which will include the following information:[14](#pa...

AI summary ENS must file Annual Progress Reports (APR) with the UARB, detailing prior-year performance, discrepancies, and program costs. If energy savings fall below 75% of forecasts, a Corrective Action Plan is required. Significant changes to programs or budgets (e.g., ±25% adjustments) must be notified in APRs.

4.5.5 IMPACT EVALUATION p. pp. 26-27
4.5.5 IMPACT EVALUATION ENS will file impact evaluations for each program annually, produced by an independent third party DSM program evaluator.

AI summary ENS will file annual impact evaluations for each program, conducted by an independent third-party DSM program evaluator. This ensures objective assessment of program effectiveness.

4.5.6 PROCESS EVALUATION p. p. 27
4.5.6 PROCESS EVALUATION ENS will file process evaluations for individual programs, produced by an independent third party DSM program evaluator as necessary. Examples of instances in which a program-level evaluation would occur include ne...

AI summary ENS will file process evaluations for individual programs, conducted by an independent third-party DSM evaluator, when programs are newly created, have major changes, receive many recommendations, or show energy savings variance exceeding 25% of planned.

1) EST ABLI SHM ENT OF A STANDARDIZE D FILING FOR FUTU RE APPLICATIONS T O A PPROV E A DSM SUPPLY A GREEMENT p. p. 30
1) EST ABLI SHM ENT OF A STANDARDIZE D FILING FOR FUTU RE APPLICATIONS T O A PPROV E A DSM SUPPLY A GREEMENT - a) The Parties agree to the establishment of a standardized filing for future applications, the substance of which will be vette...

AI summary Parties agree to establish a standardized filing for future DSM supply agreement applications, including program descriptions, energy savings data, cost-effectiveness analysis, and rate impact details. The template will be reviewed by the DSM Advisory Group, with EfficiencyOne allowed to add relevant information.

3) PERFORMAN CE TARG ETS , INDICATORS AND THRESHOLDS p. p. 30
3) PERFORMAN CE TARG ETS , INDICATORS AND THRESHOLDS - a) The parties agree to the following Performance Targets and Performance Indicators: - i) Performance Targets are set over the three-year contract period, rather than annually. - ii)...

AI summary Parties agree on three-year performance targets and indicators for EfficiencyOne, including cumulative energy and peak demand savings. Compliance requires 90% achievement on two targets; otherwise, a regulatory process is triggered. Metrics include annual savings, customer satisfaction, and rate impact analysis.

4) COST ALLOCATION p. p. 30
4) COST ALLOCATION - a) The Parties agree to collaboratively work to develop new DSM cost allocation and DSM cost recovery models to be submitted by October 31, 2015 for approval or Decision by the Board, or within a reasonable period of t...

AI summary Parties agree to collaboratively develop DSM cost allocation models by October 31, 2015, covering 2015, 2016-2018 allocations, 2014 RSA, and mid-course adjustments. This does not restrict NSP's discretion to apply to UARB regarding DSM cost accounting and recovery mechanisms.

5) EVALUATION AND REPORTlNG p. p. 30
5) EVALUATION AND REPORTlNG - a) The Parties support EfficiencyOne's proposal for annual program impact evaluations and process evaluations at the organizational level with program process evaluations if required. EfficiencyOne will provid...

AI summary Parties support EfficiencyOne's proposal for annual program evaluations and reporting, including impact and process assessments. EfficiencyOne will provide performance reports, explain substantial changes, and adhere to reporting timelines outlined in Schedule 1. Mid-course adjustments require advance notice, except those based on third-party evaluations.

Filing has historically triggered a regulatory process. p. p. 30
Filing has historically triggered a regulatory process. Year Report/ Process Filing Timeframe Inclusions 2016 Evaluation Reports End of March • Impact evaluation (all programs) • Process evaluation (as proposed in EfficiencyOne's Evidence)...

AI summary The document outlines the historical regulatory process triggered by filings, including various reports and meetings. It details timelines, inclusions, and recurring processes such as impact evaluations, financial statements, and meetings with the Demand Side Management Advisory Group (DSMAG).

1 0) NS POWER'S CHARlTABLE CONTRIBUTION p. p. 30
1 0) NS POWER'S CHARlTABLE CONTRIBUTION - a) The parties encourage Nova Scotia Power to provide the evaluated results of its low income program to the Board and to stakeholders on an annual basis and to coordinate administration and evalua...

AI summary Parties urge NS Power to annually report low-income program results to the Board and stakeholders, coordinating with EfficiencyOne. They agree DSM activities from NS Power's charitable contribution will not affect EfficiencyOne's performance targets.

Disclaimer: These summaries were generated by AI from the filings they describe. We take care to make them accurate, but errors are possible - and they aren't advice. Only the filings themselves are the record: if you're relying on something here, confirm it against the source documents or the Nova Scotia Energy Board's own record. Full disclaimer →