Topic:"Performance Monitoring" in M03669

10. PERFORMANCE-BASED APPROACH The creation of ENSC flows from the recommendations of a stakeholder consultation process facilitated by Dr. David Wheeler. 17 The final report resulting from this process envisioned a performance-driven over...

AI summary The document discusses the creation of ENSC based on a stakeholder consultation process led by Dr. David Wheeler, proposing a performance-based oversight mechanism for energy and demand savings. This model would shift regulatory focus from annual filings to multi-year frameworks, similar to those used in Vermont, with the UARB's role evolving to evaluate and verify performance.

OVERSIGHT IN A PERFORMANCE-BASED MODEL Regulatory oversight of a dedicated DSM "utility" like ENSC is broadly analogous to regulatory oversight of other monopoly functions. In this respect, regulatory models exist on a continuum, ranging f...

AI summary The text discusses regulatory oversight of ENSC, a dedicated DSM utility in Nova Scotia, under a performance-based model. It contrasts this with the traditional cost-of-service model used by NSPI and highlights the shift in UARB's oversight role from pre-approving plans to focusing on budget and performance reviews.

& lt;sup>3 Evaluation, measurement and verification. ANNUAL PLANS REVIEW ex: NSPI (past) PERFORMANCE-BASED APPROACH ADMINISTRATOR • Proposes plan to achieve cost-effective savings • Requests approval of budget and plan for set period (e.g....

AI summary The document discusses a shift from an annual plan review model to a performance-based approach for Demand Side Management (DSM) programs. This change would provide ENSC with greater flexibility to adjust plans based on feedback and outcomes, while the regulator would focus on evaluating ex-post results and verifying claimed savings.

RECOMMENDATIONS Based on the issues analyses above, we find a number of significant risks inherent in the determination, interpretation and reasonableness of the savings targets and expected costs thereof, and recommend these be most urgen...

AI summary The document highlights risks related to the clarity and achievability of savings targets in energy efficiency programs. It emphasizes the need to clarify whether targets are incremental or cumulative and to adjust for previous excess savings and long-term degradation.

ENT PRODUCTS – RETAIL PROGRAM (POWER DOWN - PD) ............................................................... 14 3.4.1 CFL Component ...........................................................................................................

AI summary The document outlines energy efficiency programs including retail and direct installation initiatives, home energy assessments, new housing programs, appliance retirement/replacement, and support for low-income households. It also references an executive summary evaluating program impacts and processes.

dditional spot audits or site inspections by program staff for a sample of participants: SBLS, LIH, and DI.2 The DSM Administrator should consider devoting resources to conduct spot audits or site inspections, on a quarterly basis, on a sa...

AI summary The DSM Administrator is recommended to conduct quarterly spot audits/inspections for SBLS, LIH, and DI participants, increasing frequency if issues are found. Missing data in billing records for SBLS participants (multiple meters not included) complicates analysis, requiring improved tracking methods.

ome cases requiring several days before requests could be fulfilled.3 These delays were especially problematic for generating monthly participation lists required by NMR to complete telephone surveys. 1.3.3 Recommendations Data tracking an...

AI summary The 2010 DSM program evaluation highlighted delays in data fulfillment due to resource allocation during the transition to Efficiency Nova Scotia Corporation. While a centralized data system was implemented, improvements in data entry, reporting, and tracking remain critical for effective program management and evaluation.

oncurrent with this evaluation. NMR Evaluation 2010 DSM Programs Executive Summary Page 6 The DSM Administrator should examine their data tracking processes and procedures for each program and consider the following recommendations regardi...

AI summary The evaluation recommends improving data tracking protocols for DSM programs, including standardizing data entry, automating reports, enhancing audit processes for specific programs, and ensuring systems capture historical billing data to support program evaluation and management.

3.1 C&I Custom Program (C&I) The C&I Custom program is a well run program with a well-documented and detailed data tracking process, rigorous policies and procedures to screen out free-riders, and a rigorous monitoring and verification (M&...

AI summary The C&I Custom program demonstrated strong energy savings in 2010 but missed demand targets. NMR recommends adapting incentives to include demand response. Program success was driven by expanded outreach via Sales Leads, though long implementation timelines may delay impact realization. The program's rigorous M&V and free-rider screening were noted as strengths.

p levels continue to rise, consider adjusting the if it continues to increase it may become an area of concern. screening procedures used to identify free-riders. C&I-F2. C&I-R2. Due to the compressed time frame between the end of the prog...

AI summary The text discusses challenges in the C&I Custom program's evaluation process, including compressed timelines, data entry errors, and the need for improved screening procedures and evaluation schedules to ensure accurate and rigorous impact assessments.

please tell me if you are very satisfied, satisfied, neither satisfied nor dissatisfied, dissatisfied, or very dissatisfied with your experience with that specific aspect of the program. VS S Neither Dissat V.Dissat DK/Ref a. Program marke...

AI summary The text presents a survey format asking participants to rate their satisfaction with various aspects of the Power Down program, followed by questions about barriers to participation and recommendations for improvement. It includes rating scales and open-ended questions for feedback.

Marketing and Verification: 16. Please explain the various marketing activities utilized by each program. What do you think is particularly good about program marketing? How could program marketing be improved? 17. Overall, how successful...

AI summary The document outlines a series of questions related to program marketing, delivery, success, free-ridership safeguards, coverage gaps, and the adoption of 2009 recommendations. It also asks about program strengths, weaknesses, and potential improvements.

Scotia Power? If not, what data should be captured? Do you think the data is being captured and communicated in the most efficient possible way? IF NO: How could the data capture and communication be improved? 16. [IF NOT MENTIONED ABOVE]...

AI summary The text outlines a series of questions related to data collection and program delivery processes for energy efficiency initiatives. It focuses on data capture, communication, and program implementation, including audit timelines, customer follow-up, and challenges in program delivery.

se in the mean and median consumption for the pre to post period. The comparison of the NAC between groups for each period demonstrates that the control group is well matched to the participant group. Table 2-3: Distribution of Electric NA...

AI summary The text discusses the analysis of energy consumption data for participants and control groups before and after program installation, using statistical methods to quantify energy impacts. The analysis involved stratification based on pre-participation NAC to ensure accurate projections of program savings.

16. In general, how well do you think the program tracking and reporting process is working? Do you believe all the necessary data is being captured and passed on to Conserve Nova Scotia? To Nova Scotia Power? If not, what data should be c...

AI summary The text asks about the effectiveness of the program tracking and reporting process, data capture, program delivery timing, vendor selection, and factors affecting program delivery. It seeks improvements and insights into the delivery process and vendor relationships.

tion explored issues that included program administration, satisfaction, motivation, barriers to participation and how the rebates incentivized participants to implement energy efficiency measures. NMR Evaluation—2010 New Houses Program Pa...

AI summary The impact evaluation of the 2010 New Houses Program found that it achieved 680 MWh of energy savings and 810 kW of demand savings, falling short of the energy savings target of 2,000 MWh but exceeding the demand savings target of 640 kW. Net savings were calculated using a 46% net-to-gross ratio.

10. What are the major components and activities of the program, and what are they intended to accomplish? a. In the short term? b. Intermediate term? c. Long term? 11. What are the key outputs from each activity? 12. Is there any sequence...

AI summary The questions focus on the structure, sequence, and measurement of program activities, outputs, and outcomes over short, intermediate, and long-term periods. They also explore assumptions related to resource availability, customer motivation, and program effectiveness.

Marketing and Verification: 17. Please explain the various marketing activities utilized by each program. What do you think is particularly good about program marketing? How could program marketing be improved? 18. Overall, how successful...

AI summary The text outlines a series of questions related to program marketing, delivery, success, free-ridership safeguards, coverage gaps, and evaluation of past recommendations. It also asks about program strengths, weaknesses, and needed improvements.

will be terminated once the legislation is enacted. The impact evaluation was based on visits to nine sites with installed lighting and visits with four of the six major distributors for the program. Impact Evaluation Findings For the BER...

AI summary The impact evaluation of the BER and SLC programs found that combined net generator-level impacts were 6,748.3 MWh of energy savings and 1,267.3 kW of demand savings, falling short of the combined program targets of 10,000 MWh and 2,420.0 kW. The evaluation used site visits, program records, and telephone surveys to estimate free-ridership and spillover effects.

avings goal of 3,410 kW. However, the 2010 savings exceed the evaluated savings for 2008 and 2009 combined (16,311 MWh and 2,403 kW), which shows significant growth for the C&I Custom program in 2010. Table 1: 2010 Program Energy and Deman...

AI summary The C&I Custom program achieved significant energy and demand savings in 2010, exceeding the combined savings of 2008 and 2009. The program is well-run with robust data tracking and free-rider screening, though staff constraints and data entry errors impacted NMR's evaluation process.

(3) where, = Savings weighted average operating hours [h] = Lighting group i = Operating hours for lighting group i = Energy savings for lighting group i The peak coincidence factor was then determined by dividing (5,813 hours) by 8,760 ho...

AI summary The document discusses the methodology for calculating energy savings in a lighting project, using weighted average operating hours and a peak coincidence factor. It also mentions the use of Metrix software for M&V projects, due to challenges with existing spreadsheets and disorganized lighting panels at the hotel.

od. Equation 3 was applied to all retrofitted areas of the building served by HVAC systems (100% in this case). Savings from all areas were summed to arrive at interactive effects peak demand savings. 7.0 Conclusions Annual energy savings...

AI summary The evaluation of the 2010 C&I Custom Program found that annual energy savings were 82.9% of the tracking savings, with reductions partly due to removing double-counted savings and adjusting operating hours. Peak demand savings exceeded tracking projections by 1.9% due to higher coincidence factors used in the evaluation.

92.4 150 96.2 NMR Evaluation of 2010 C&I Custom Program Page A68 Note that the motor efficiencies and sizes listed in Table 2 reflect changes made during the evaluation. With respect to motor size, only motor #6 was changed based on site c...

AI summary The document discusses the evaluation of the 2010 C&I Custom Program, focusing on motor efficiency changes and the calculation of tracking savings using a spreadsheet-based approach. It also notes errors in the tracking analysis and provides formulas for calculating the power factor of both preexisting and installed motors.

4,027 Total Connected Load (kW) 352.3 Total Connected Load (kW) 38.4 Note that the fixture quantities listed in Table 2 reflect changes made during the evaluation. 4.0 Tracking Savings Review and Calculations Since the project was not comp...

AI summary The document discusses the calculation of energy savings from a lighting retrofit project using a spreadsheet-based approach. It outlines how energy consumption was determined for pre-existing and installed fixtures based on quantities, wattage, and operating schedules, and how savings were calculated by subtracting the installed case from the pre-existing case.

tage [W] = Incandescent fixture operating factor = LED fixture quantity = LED fixture wattage [W] = LED fixture operating factor 1009 = W to kW conversion factor The various operating schedule factors, and , used in the analysis were deriv...

AI summary The text provides detailed assumptions about the operating schedules of traffic signals, including incandescent and LED fixtures, and their respective operating factors. These factors are used in the M&V savings analysis to calculate energy consumption and efficiency improvements.

was then subtracted from the instantaneous peak demand of the incandescent case to calculate demand savings. Demand savings from each intersection were then summed to calculate project demand savings. 5.0 On-Site Methodology The evaluation...

AI summary The document outlines the on-site methodology used to evaluate the 2010 C&I Custom Program. It describes how demand savings were calculated by comparing LED and incandescent fixtures and includes a site visit to verify installations and fixture counts.

ues used in NSPI‘s M&V analysis. NMR Evaluation of 2010 C&I Custom Program Page A82 Table 4: Summary of verified and M&V signal wattages Signal Type Verified Wattage M&V Wattage 12" Green Traffic Signal 12 12 12" Amber Traffic Signal 13 17...

AI summary The document provides a summary of verified and M&V signal wattages for various traffic signals and pedestrian signals under NSPI's 2010 C&I Custom Program. The table lists wattages for different signal types, with some discrepancies between verified and M&V wattages.

l 10 14 PED Walk/Don't Walk Signal 6 6 PED Countdown Unverified 9 Although the verified wattages were lower than the wattages used in the M&V analysis, the site contact noted that the light types used throughout the project have changed. A...

AI summary The document discusses discrepancies between verified wattages and M&V analysis wattages for LED lights in a 2010 C&I Custom Program project. The site contact noted changes in light types, and the M&V wattages may have been accurate for earlier installations. The evaluation used M&V data for consistency, and a spreadsheet provided by the site contact was used to verify the number of retrofitted intersections.

0 0 0 0 1 1 0 -4 Intersection 9 0 0 0 0 0 0 0 0 0 0 Intersection 10 0 1 1 0 0 0 -1 -1 -1 -1 Intersection 11 0 0 0 0 0 0 0 0 0 0 In general, the discrepancies were relatively minor and were not all biased in the same direction. However, it...

AI summary The text discusses minor discrepancies in fixture counts at intersections, with 7 out of 11 verified intersections showing errors. The discrepancies were deemed trivial, so no further verification or scaling was applied. Energy savings calculations used updated operating factors in the M&V analysis, which previously failed to account for protected left turns at intersections.

3 This Savings Verification study is focused on impact, so also addresses the first nine program areas. In preparing for this study, which includes review of the NMR impact evaluations, the savings verification team had initial meetings wi...

AI summary This Savings Verification study focuses on reviewing the impact evaluations of DSM programs conducted by NMR Group. The study involved meetings with the Board, DSM Administrator, and NMR, as well as on-site visits. It evaluated NMR's estimates of energy savings and demand reductions, including adjustments for free-ridership and spillover effects, and focused on the generator level for 2010.

Basic Findings and Recommendation There are two basic findings in this 2010 savings verification study: - Finding 1: All of the 2010 DSM programs were competently administered by the DSM Administrator. This finding is based on the NMR eval...

AI summary The 2010 savings verification study found that DSM programs were competently administered, with NMR evaluations supporting the findings. The study recommends accepting NMR results for energy savings and demand reduction, except for a 10% adjustment for Efficient Products-Direct Install. Some areas for improvement were identified, including internal program control and electrical measurement.

. The participant cost can be financed, interest free, for up to two years. Eligible small businesses have an average demand of less than 100 kW and an annual electricity use of less than 300,000 kWh. NMR approached the impact evaluation t...

AI summary The 2009 Direct Install (Small Business Lighting Solutions Program – SBLS) allows eligible small businesses to finance participant costs interest-free for up to two years. NMR faced challenges in evaluating the program's impact due to data limitations but used 2008 site work data for the 2010 analysis and recommended on-site and time-of-use metering for 2011. The study estimated energy savings and accounted for spillover and free ridership.

Executive Summary: In early February, 2011 Efficiency Nova Scotia Corporation (ENSC) requested that Energy Performance Services (EPS/Canada) Inc. (EPS) conduct a preliminary review of information submitted by 2 industrial facilities: New P...

AI summary In February 2011, Efficiency Nova Scotia Corporation (ENSC) requested a review of energy efficiency projects by New Page Port Hawkesbury Ltd. (NPPH). EPS conducted a preliminary assessment, finding NPPH's claims credible based on submitted data. The report highlights energy efficiency improvements, particularly in refining systems, and suggests the need for more comprehensive data and a formalized Measurement & Verification (M&V) process for future validation.

5 WHAT ARE YOU CONCLUSIONS? - 7 My conclusions are as follows: - 8 a) With the exception of one new program and the addition of new enabling 9 strategies, the DSM programs proposed for 2012 are expanded continuations of 10 programs previou...

AI summary The 2012 DSM programs are largely continuations of prior approved programs but require adjustments due to lower projected savings. Key approvals include program structure changes, stakeholder engagement, and alignment with IRP. Evaluations of past programs have been implemented to improve effectiveness.

so understands that this proposed level of DSM investment is broadly supported by other ratepayer representatives including the Consumer Advocate, the Avon Group, and the Municipal Electric Utilities. As a result, following our review of t...

AI summary NPB initially planned to avoid participating in the hearing but changed course after intervenor evidence suggested increasing ENSC's 2012 DSM spending. NPB supports cost-effective DSM but notes the plan already exceeds 2009 IRP targets. Both Bowater and NewPage have conducted internal energy initiatives beyond ratepayer-funded programs.

In 2009 - White paper and roadmap for Northeastern states interested in adopting mandatory building energy labelling and upgrade policies, for the Northeast Energy Efficiency Partnerships (NEEP). - Strategic evaluation of Manitoba Hydro's...

AI summary The text outlines various energy efficiency initiatives and advisory roles from 2009, including program evaluations for Manitoba Hydro, Hydro-Québec, and Efficiency New Brunswick, strategic planning for New Jersey's energy targets, and regulatory counsel for Quebec's Energy Efficiency Agency. It emphasizes program design, market analysis, and policy development across multiple jurisdictions.

IT IS FURTHER ORDERED that: - 1) With regard to the SVS, the Board is satisfied that ENSC is reviewing the recommendations and orders ENSC to file its response to the recommendations no later than July 31, 2011, for consideration by the Bo...

AI summary The Board orders ENSC to respond to recommendations, improve rate impact data, complete a free ridership study, develop policies for non-electricity programs, continue PDWG engagement, and meet quarterly to review program progress. These actions aim to enhance transparency, stakeholder involvement, and accountability in energy efficiency initiatives.

d on the data tracking problems identified by NMR, noting he had no concerns and that data tracking is "coming along nicely". He expected it would be used productively by ENSC (Transcript, p. 315-316) [31] Dr. Peach's expectations were sup...

AI summary The text discusses ENSC's progress in data tracking, Dr. Peach's confidence in its improvement, and the SVS recommendation for an organizational study. ENSC's commitment to data quality and evaluation improvements is emphasized, with Mr. Foote stressing the need for ongoing evaluation recommendations.

INFORMATION REQUESTS to ENSC from NewPage and Bowater Mersey NON-CONFIDENTIAL 1 Request IR-7: 2 Reference: ENSC Evidence, page 33, lines 22-28. 3 4 (a) Please provide ENSC's best available estimate of the potential GWh and MW savings that...

AI summary NewPage and Bowater Mersey request ENSC to estimate energy savings from adopting codes/standards by 2012, outline steps to encourage adoption, respond to evaluation report recommendations, comment on evaluation points, and address data tracking concerns. The requests reference specific reports and pages, focusing on energy efficiency, program evaluation, and data quality.

Request IR-20 - With respect to Appendix A, page 14, line 23 - a) Please explain why the Home Energy Report is proposed as a stand-alone program, as opposed to being included as a measure in other programs such as the Existing Houses progr...

AI summary The request seeks clarification on the Home Energy Report's standalone status, evaluation of its savings, and sustainability of behavior-based energy savings. It questions why the report isn't integrated into other programs, how savings are verified, and the long-term effectiveness of behavior-focused measures.

PRELIMINARY ISSUES LIST The following issues will be dealt with in the public hearing on Efficiency Nova Scotia's ("ENS") Application for approval of its electricity Demand Side Management ("DSM") Plan for 2012: - 1. Evaluation and verific...

AI summary The document outlines preliminary issues for a public hearing on Efficiency Nova Scotia's 2012 DSM Plan application, including evaluation of past programs, TRC test criteria, free ridership approaches, pilot programs (fuel substitution, green schools, advanced houses), reporting methods, and administrative models.

Performance-Based Model NSDOE supports ENSC's proposal to engage the DARB and stakeholders in 2011 to assess the possibility ofadopting a performance based model for the delivery and oversight ofDSM programs. As part of this process, NSDOE...

AI summary NSDOE supports ENSC's proposal to engage DARB and stakeholders in 2011 to assess a performance-based model for DSM programs. NSDOE agrees with the Board Chair to investigate whether the Public Utilities Act permits performance-based oversight of DSM, potentially requiring legislative changes.

IN THE MATTER of the PUBLIC UTILITIES ACT RSNS.c380 as amended. IN THE MATTER of AN APPLICATION to Approve Efficiency Nova Scotia Corporation's Electricity Demand Side Management (DSM) Plans for 2012. Closing Submission by QUETTA INC. May...

AI summary The submission highlights the need for Efficiency Nova Scotia to develop a formal Communication Plan to publicize DSM benefits and improve transparency. It references past Commission Rulings and suggests ISO 9000 certification for evaluation processes to ensure consistency. Education and Communication expenses are emphasized as critical for stakeholder engagement.

IT IS FURTHER ORDERED that: - 1) With regard to the SVS, the Board is satisfied that ENSC is reviewing the recommendations and orders ENSC to file its response to the recommendations no later than July 31, 2011, for consideration by the Bo...

AI summary The Board orders ENSC to address SVS recommendations, conduct studies on free ridership and non-electricity programs, enhance rate impact information, and maintain stakeholder engagement. ENSC must also track program progress quarterly and align with the 2013 DSM Plan.

NSPI's role in DSM and consequently, whether the DSM Plan it proposes is in the public interest, is cost effective, meets the established objectives, and warrants approval. [2010 NSUARB 155, pp. 5-6] - [3] The shift in responsibility for D...

AI summary The document outlines the evaluation of NSPI's proposed 2012 DSM Plan by the Board, focusing on public interest, cost-effectiveness, and compliance with objectives. Key issues include program evaluation, free ridership, pilot programs, and reporting requirements, with the Board's Final Issues List highlighting specific criteria for assessment.

[26] The SVS recommended acceptance of: ... the NMR evaluation results for ... 2010, except for a ten percent (10%) cut for Efficient Products-Direct Install. .. [Exhibit E-3, p. 6] [27] Additional recommendations were made in the SVS for...

AI summary The SVS recommended accepting NMR evaluation results except for a 10% cut for Efficient Products-Direct Install. It proposed method improvements, with Dr. Peach emphasizing methodology concerns over NMR results and praising DSM program execution. Data tracking issues were noted but deemed improving.

9.0 SUMMARY OF BOARD FINDINGS [153] The Board accepts the 2010 DSM Plan evaluation and verification, with the qualification made in the SVS for a 10% reduction for the Efficient Products-Direct Install program. [154] The Board understands...

AI summary The Board accepts the 2010 DSM Plan evaluation, approves the 2012 DSM investment, and sets conditions for ENSC, including quarterly meetings and a free ridership study. It also approves changes to the TRC test and allows exploration of a PBM. The Board reserves jurisdiction to rule on costs if EAC and ENSC cannot agree.

Status of 2010 Evaluation Recommendations – and – 2010 Savings Verification Study Action Items July 29, 2011

AI summary The document provides an update on the status of 2010 evaluation recommendations and action items from a 2010 savings verification study, dated July 29, 2011. It outlines the progress or unresolved issues related to these initiatives within a Nova Scotia regulatory proceeding.