E-2Evidence of ENSC as DSM Administrator
11 passages
DATE FILED: February 27, 2012 Page 14 of 45 1 a management discussion and analysis of any major discrepancies relative 2 to the original plan's intent and forecasts 3 a summary of costs and savings for each program or target market are...
AI summary The document discusses recommendations for evaluating DSM program savings through a revised multi-year process, including ongoing tracking, free ridership surveys, and full-scale evaluations. It also proposes a trigger mechanism to ensure energy savings targets are met and outlines reporting requirements to the UARB and other stakeholders.
The table below summarizes our findings. CRITERIA: PERFORMANCE DRIVERS LATITUDE OVERSIGHT Components No D isin ce nti ve s Inc en tiv es Re so urc es Re sp on siv en es s Ab ilit y t o C om mi t Tra ns pa ren cy Sa feg ua rds Inf lue nc e...
AI summary The table summarizes findings related to oversight and performance drivers for ENSC, highlighting areas such as incentives, resources, and transparency. It notes that ENSC has no sales disincentive, strong reputational incentives, and challenges with long-term commitment and annual approval processes. The section will provide recommendations to address these shortcomings while maintaining current strengths.
CRITERIA: PERFORMANCE DRIVERS LATITUDE OVERSIGHT Components No D isin ce nti ve s Inc en tiv es Re so urc es Re sp on siv en es s Ab ilit y t o C om mi t Tra ns pa ren cy Sa feg ua rds Inf lue nc e Co st Examples Are profits unaffected by...
AI summary The document evaluates the performance drivers and oversight criteria for Efficiency Nova Scotia (ENSC), focusing on incentives, resources, transparency, and cost considerations. It notes that ENSC has no sales disincentives, has a budget on the higher end of the typical range, and has moved to a 3-year approval process with some long-term predictability still missing.
2.1 TMP plant flowsheets As the TMP plant is the largest electricity consuming operating unit at the FACILITY, we have included simplified process diagrams of the TMP plant in figures 2 through 5 below: - Figure 2 shows line 1 & 2 chip han...
AI summary The TMP plant is identified as the largest electricity-consuming unit at the facility, with simplified process diagrams (Figures 2-5) illustrating its operations, including chip handling, refining, bleaching, and pulp processing. Auxiliary equipment power consumption is noted as approximately 6.0 MW for Lines 1 & 2 and 9.6 MW for Lines 3, rejects refiners, and the bleach plant.
4. EVALUATION PROTOCOL & METHODOLOGY We have principally relied on the Superior Energy Performance (SEP) measurement & verification protocol found in Appendix-1 in conducting the M&V evaluation. We have relied on this document as it is ver...
AI summary The evaluation uses the Superior Energy Performance (SEP) and IPMVP protocols to validate NPPH's self-reported energy performance data from the INITIAL REPORT. The SEP approach requires two components to assess energy improvements, focusing on verifying preliminary estimates that lacked independent audit.
4.1Measurement Boundaries The measurement boundary for all projects is the whole mill. Note that the reported refining energy consumption does not include electrical consumption of any auxiliary equipment located within the TMP plant. The...
AI summary The measurement boundary for energy consumption includes the whole mill but excludes TMP plant auxiliary equipment due to lack of metering. Auxiliary consumption (11.5% of TMP load) is deemed negligible (<5% IPMVP threshold). The top-down analysis boundary includes NPPH mill (including PB3), though PB3 may be excluded in the future due to NSPI ownership.
Accuracy The electricity data reported at the whole of mill level is very accurate and has been checked against billing records from NSPI. TMP refining data is taken from motor loads and is time weighted. Paper production data is accurate...
AI summary The document discusses the accuracy of electricity data from NSPI, verified against billing records. TMP refining data is time-weighted, and paper production data is cross-checked by mill staff. However, TMP production data may have a ±10% error due to chip bulk density variability.
6. ANALYSIS OF PROJECT RESULTS One of the key requirements of the SEP M&V protocol is that top-down energy performance for facilities be calculated and then "sanity-checked" against aggregated bottom-up calculations of individual Energy Co...
AI summary The analysis emphasizes the SEP M&V protocol's requirement to cross-verify top-down energy performance calculations with bottom-up Energy Conservation Measure aggregations, ensuring accuracy in evaluating Nova Scotia's energy efficiency projects.
on function reasonably approximates the actual real world situation. Figure 10 – Scatter plots of actual data vs linear regression model baselines, 3 reporting periods Figure 11 shows the actual reported values vs. those predicted by the m...
AI summary The analysis uses linear regression models to compare actual TMP plant energy consumption data with predicted values, showing the model's accuracy and indicating effective energy management by staff during Year 4. Figures highlight model overestimation and operational ranges, suggesting staff successfully managed energy performance.
8. CONCLUSIONS & RECOMMENDATIONS The top-down electricity savings estimate for the whole mill described in Section-5 of this Report is consistent with the M&V requirements defined in the SEP M&V Protocol and meets all the IPMVP criteria (a...
AI summary The top-down electricity savings estimate for the NPPH mill aligns with SEP M&V Protocol and IPMVP criteria, validating its accuracy. It closely matches the initial report but may overstate savings due to limited bottom-up data. The analysis concludes the top-down method provides a reliable energy savings representation.
MARKETING ENSC will conduct marketing and outreach activities to increase awareness and confidence in Green Heating Systems. Marketing strategies would outline the key green heat systems being offered, their characteristics, as well as the...
AI summary ENSC will implement marketing strategies to promote Green Heating Systems, emphasizing system characteristics, selection factors, and case studies. Materials will encourage a holistic view of home energy performance to build customer confidence.
E-2(r)Revised ENSC Evidence
9 passages
DATE FILED: February 27, 2012 Page 14 of 45 1 a management discussion and analysis of any major discrepancies relative 2 to the original plan's intent and forecasts 3 a summary of costs and savings for each program or target market are...
AI summary The text discusses recommendations for evaluating and adjusting the Demand Side Management (DSM) program, including the adoption of a trigger mechanism if savings fall below 75% of forecasts and a revised evaluation approach with ongoing tracking, surveys, and reporting to the UARB.
The following table provides an overview of the oversight process we have recommended, while also indicating the extra-regulatory oversight involved. THREE-YEAR PLAN 2012 2013 2014 2015 2016 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4...
AI summary The table outlines a recommended oversight process, including regulatory and extra-regulatory activities, with specific actions such as filings, hearings, meetings, and reports over a three-year period from 2012 to 2016, highlighting the sequence dependency of tasks prior to the start of the plan.
CRITERIA: PERFORMANCE DRIVERS LATITUDE OVERSIGHT Components No D isin ce nti ve s Inc en tiv es Re so urc es Re sp on siv en es s Ab ilit y t o C om mi t Tra ns pa ren cy Sa feg ua rds Inf lue nc e Co st Examples Are profits unaffected by...
AI summary This table discusses the criteria and performance drivers for ENSC (Energy Efficiency Nova Scotia), including components such as incentives, resources, responsiveness, and oversight. It outlines ENSC's current status, proposed changes, and notes on budget, flexibility, and transparency. The table also highlights the regulatory cost and long-term predictability challenges.
CONCLUSION The regulatory framework that oversees Efficiency Nova Scotia Corporation includes a number of important strengths, including most notably a culture of focusing on results rather than micromanaging operations. Furthermore, the U...
AI summary The regulatory framework for Efficiency Nova Scotia Corporation (ENSC) emphasizes results over micromanagement, supported by recent UARB flexibility measures. However, the short-term approval process hampers ENSC's ability to engage market actors and meet DSM goals. Proposed solutions include annual reports and triggers to offset longer approval lags, balancing oversight and performance. The UARB retains discretion for unforeseen events.
2.1 TMP plant flowsheets As the TMP plant is the largest electricity consuming operating unit at the FACILITY, we have included simplified process diagrams of the TMP plant in figures 2 through 5 below: - Figure 2 shows line 1 & 2 chip han...
AI summary The TMP plant, the largest electricity consumer at the FACILITY, is detailed through simplified process diagrams (figures 2-5), outlining chip handling, refining, bleaching, and pulp systems. Auxiliary equipment power consumption estimates are provided for TMP lines and bleach plant operations.
4. EVALUATION PROTOCOL & METHODOLOGY We have principally relied on the Superior Energy Performance (SEP) measurement & verification protocol found in Appendix-1 in conducting the M&V evaluation. We have relied on this document as it is ver...
AI summary The evaluation relies on the Superior Energy Performance (SEP) and International Performance Measurement and Verification Protocol (IPMVP) to assess energy performance improvements at NPPH. The goal is to validate preliminary self-reported energy data from NPPH's INITIAL REPORT, which lacked independent auditing.
4.1Measurement Boundaries The measurement boundary for all projects is the whole mill. Note that the reported refining energy consumption does not include electrical consumption of any auxiliary equipment located within the TMP plant. The...
AI summary The measurement boundary for projects is the whole mill, excluding TMP plant auxiliary equipment due to lack of metering. Auxiliary consumption (15.6 MW, 11.5% of TMP plant use) is excluded as it varies ±20% but represents <5% of average load, per IPMVP guidelines. The NPPH mill facility (including PB3) is the top-down analysis boundary, with PB3 likely excluded in the future due to NSPI ownership.
Accuracy The electricity data reported at the whole of mill level is very accurate and has been checked against billing records from NSPI. TMP refining data is taken from motor loads and is time weighted. Paper production data is accurate...
AI summary The text discusses the accuracy of electricity and production data, citing checks against NSPI billing records, cross-verification by mill staff, and a ±10% error margin for TMP data due to chip bulk density variability.
Outdoor light bulbs are less common than permanent light bulbs and plug-in lamp bulbs. Nova Scotia residents own an average of only four outdoor light bulbs. Three-quarters of the population have fewer than five outdoor light bulbs (74%)....
AI summary Nova Scotia residents own an average of four outdoor light bulbs, with 74% having fewer than five. Only 20% have five to nine, 5% have 10-19, and 1% have 20 or more. Table A9a provides detailed distribution data.
E-3ENSC 2011 DSM Evaluation Report prepared by Econoler
44 passages
TABLE OF CONTENTS 1 DSM PORTFOLIO PERFORMANCE ......................................................................................... 1 1.1 Overview ...........................................................................................
AI summary The document outlines the evaluation of a Demand Side Management (DSM) portfolio, covering performance analysis, achieved savings, and evaluation methodology. It includes sections on process evaluation, interviews, on-site visits, surveys, and impact assessment, concluding with overall recommendations for program improvement.
and workplaces. For the 2011 program year, Econoler conducted impact and process evaluations for the following programs. Table 1: Type(s) of Evaluation Conducted per Program Type(s) of Evaluation Program Process Impact Appliance Retirement...
AI summary Econoler conducted impact and process evaluations for multiple programs in 2011, including appliance retirement, low-income initiatives, and energy efficiency measures. The table lists programs evaluated, with some receiving both process and impact assessments.
2011 Evaluated 2011 Targets Results DSM PROGRAM GWh MW GWh MW RESIDENTIAL PROGRAMS a Efficient Products 42.89 4.79 49.415 8.912 b EnerGuide for Existing Houses 7.80 2.14 6.375 2.328 c Low Income 9.08 1.98 12.445 2.710 Performance Plus (New...
AI summary The document presents a 2011 evaluation of Nova Scotia's Demand Side Management (DSM) programs, comparing targets and results for residential and commercial/industrial (C&I) initiatives. Residential programs exceeded targets in energy savings (70.69 GWh vs. 62.37 GWh), while C&I programs fell slightly short (71.06 GWh vs. 96.12 GWh). Footnotes clarify program inclusions and exclusions.
ated for 2011. Moreover, while some adjustments were applied to the unitary savings estimates used in the tracking sheet, they were in most cases revised upward. Multi-Unit Residential Renter Program The MURR program net evaluated savings...
AI summary Evaluations of 2011 DSM programs show discrepancies between tracked and evaluated savings. The Multi-Unit Residential Renter Program exceeded ENSC-tracked savings by 6%, attributed to revised unitary savings values and interactive effects. Conversely, the Efficient Products – Direct Install Program fell short by 12%, despite upward revisions to evaluation metrics.
Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary 2.2.5 Impact Evaluation The impact evaluations integrated findings from the telephone surveys, program data from the tracking system, on-site visits and/or interviews wi...
AI summary The impact evaluation of ENSC programs integrated data from surveys, tracking systems, on-site visits, and billing analysis. Methods included metering for ARet/ARep programs and HOT20001 simulations for EEH/Performance Plus/Low Income. Billing analysis for LIR faced limitations due to low participation, though it was recommended for future use to enhance savings verification accuracy.
participants or units Objectives monitoring (tracked savings) Data from the program tracking system Objectives realization rate (%) Ratio between targets and tracked savings Business case Details on expected gross and net savings calculati...
AI summary The document outlines key metrics and evaluation criteria for energy efficiency programs, including objectives monitoring, realization rates, business case calculations, and types of evaluations required. It emphasizes factors such as baseline energy levels, technical distortions, free-ridership, and spillover effects in calculating net savings.
ERGY STAR criterion and to identify the energy consumption of the appliance would ensure that savings are calculated correctly. 4.1.3 Retail Markdown Program The 2011 evaluation of the RMP demonstrated that the program used the right appro...
AI summary The 2011 evaluation of the Retail Markdown Program (RMP) showed increased participation and significant energy and demand savings. However, awareness of the program and its promotions decreased, with issues like disorganized displays and inadequate marketing materials identified as barriers to effectiveness.
r has the following recommendations that aim at optimizing specific aspects of each program: Table 25: Recommendations for the C&IC Program No. Recommendations C&IC-R1. Clearly define the M&V requirements before signing the PDA: The Evalua...
AI summary The document recommends clearly defining Measurement and Verification (M&V) requirements before signing the Project Development Agreement (PDA) for the C&IC Program. It highlights that most projects lack a dedicated M&V plan despite being marked as complete and approved. The Evaluator suggests using M&V plan templates compliant with the International Performance Measurement and Verification Protocol (IPMVP) to standardize M&V activities.
ams Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary C&IC-R2. Envisage performing third-party M&V for a number of C&IC projects: ENSC should consider performing third-party M&V on projects where the implementation firm...
AI summary The Efficiency Nova Scotia Corporation (ENSC) is advised to consider third-party M&V for C&IC projects where the implementation firm also conducts M&V, to ensure compliance with IPMVP and accuracy of results. A minimum energy savings threshold may be defined to determine when third-party M&V is required.
No. Recommendations CINC-R1. Conduct a separate complete evaluation for the CINC program: In 2010, only one new construction project was included in the C&IC program. This project was implemented using a “whole building” approach and its s...
AI summary The document recommends conducting a separate evaluation for the CINC program in 2012 to better assess its impacts and address uncertainties in savings calculations. It also suggests comparing real building consumption with design simulations to improve accuracy in M&V activities.
e paper mill in Port Hawkesbury, Nova Scotia. The M&V report was produced by EPS and is titled “Detailed Review of Completed Energy Efficiency Projects at New Page, Port Hawkesbury,” October 17, 2011. The report methodology adhered to the...
AI summary The M&V report evaluated energy efficiency projects at a paper mill in Port Hawkesbury, using the SEP protocol based on IPMVP. The top-down analysis showed 154.2 GWh in energy savings, 26% higher than the bottom-up analysis. The evaluator concluded the savings are a fair representation of the project's impact.
Efficiency Nova Scotia Corporation 2011 Evaluation Report should document these parameters so that the PM and the Evaluator can keep track of the assumptions used to estimate the program objectives. Moreover, the parameters should be conti...
AI summary The document outlines recommendations for improving program management and evaluation processes, including documenting parameters, refining marketing plans, and completing the program manual. It also mentions the need for more detailed tracking sheets for program administration and evaluation.
he rationale behind the two short periods? Page 10 Q: Who provide the associate training? Q: The delivery agent? Is the same as the implementation contractor? If yes why do we use different names? C: The socket study is a very good initiat...
AI summary The text contains a series of questions and comments from a regulatory proceeding related to the Retail Markdown Program (RMP) and Efficiency Nova Scotia Corporation's 2011 evaluation report. Topics include program activities, customer service, data tracking, evaluation methods, and potential program distortions.
list of questions and topics to include in the program partner interviews for the process evaluation was finalized. 2.2.3 In-Depth Interviews with Program Partners Interview with Delivery Agent In September, one in-depth interview was cond...
AI summary The document outlines the methodology used in evaluating the Efficient Products – Low Income Renter Program, including in-depth interviews with the program delivery agent and its subcontractor, as well as on-site visits to validate product installations and savings assumptions.
at keeps the records? Q: Do you plan to do a post evaluation cost effectiveness test? Q: since this a new program, did you have an evaluation plan designed at the same time the program was designed? Q: Will there be a detailed program mark...
AI summary The text includes a series of questions from an evaluation process for an energy efficiency program, focusing on program design, evaluation plans, marketing strategies, and database usability. It also provides instructions for completing a questionnaire for program partners.
y the DA to the facility manager, such as technical information regarding the use of the products installed through the program. This approach aimed to ensure that program delivery goals would be met. The methodology used for the on-site v...
AI summary The EP-DI program conducted on-site visits and a telephone survey with 70 participants to evaluate program impact and participant experiences, including motivations, barriers, and satisfaction. The survey aimed to understand program features and included data on sampling error.
usion between representative and delivery agent. Page 7 C: Make sure that replaced lamps where functional before replacing them (they were not burned) to get an accurate calculation of the savings. C: Interactive effects will have to be ca...
AI summary The text discusses the Efficient Products – Direct Install Program by Efficiency Nova Scotia Corporation, focusing on program evaluation, delivery agents, quality assurance, and process documentation. It includes questions about program structure, participant forms, barriers addressed, and evaluation plans.
Efficiency Nova Scotia Corporation 2011 Evaluation Report The logic model We proposed a modification for the logic model to include other parties beside ENSC. We sent the modification to the PM for comments. Source: General Q: Please indic...
AI summary The document outlines a process evaluation questionnaire for Efficiency Nova Scotia Corporation's EnerGuide for Existing Houses program, focusing on program partners, evaluation plans, marketing strategies, and data management challenges. It also includes questions about program barriers and cost-effectiveness testing.
ed to validate the new measures implemented, collect information on the previous heating and hot water system as well as gather data on the usage of the different energy sources available at the site. The methodology used for the on-site v...
AI summary The Fuel Substitution Pilot involved on-site visits and a participant survey to evaluate the pilot's impact. The survey, conducted by CRA, aimed to understand participant experiences, motivations, and the pilot's effectiveness. Sampling error data is provided for the 2011 telephone survey.
vities: The Evaluator recommends that outreach activities be monitored with performance indicators to evaluate the effectiveness of each activity in terms of enrolment in the program. Ref.: 5725 8 Low Income Program Efficiency Nova Scotia...
AI summary The Evaluator recommends monitoring outreach activities with performance indicators to assess program effectiveness. The program manual lacks a 'base case' for calculating gross savings and does not document parameters used to estimate program objectives, which should be based on past evaluations and adjusted annually.
ings evaluation, Econoler finally modified a number of energy savings per prescriptive measure used by ENSC, on the basis of national demand-side management (DSM) studies carried out in 2010 and 2011. In its net savings calculations, Econo...
AI summary The evaluation of the Performance Plus program found that free-ridership levels decreased from 79% in 2010 to 32% in 2011, while spillover effects were not significant. Market effects were estimated at 5%, leading to a net-to-gross ratio of 0.73. The program achieved net energy savings of 2.454 GWh and demand savings of 0.861 MW in 2011.
g equivalent weight to both market effect percentages found; i.e., from participating and non-participating builder interviews. The final market effects were therefore evaluated at 5 percent for 2011. In light of the above, Econoler recomm...
AI summary The evaluation of the Performance Plus program in 2011 found that market effects were estimated at 5%, based on interviews with participating and non-participating builders. Econoler recommended increasing the number of interviews in future evaluations to better capture market effects. Net savings were calculated using the interactive effects factors and the Net-to-Gross Ratio (NTGR).
7 0.001 0.026 0.002 0 0.036 0 0.122 N/A N/A N/A (GWh) – at Meter Line Loss Factor 1.105 1.105 1.105 1.105 1.105 1.105 1.105 1.105 N/A N/A N/A Total Net Energy Savings 2.505 0.001 0.029 0.002 0 0.040 0 0.134 N/A N/A N/A (GWh) – at Generator...
AI summary The document presents data on energy savings and demand reductions related to the Performance Plus Program by Efficiency Nova Scotia Corporation, including line loss factors and net-to-gross ratios, and references an evaluation report from 2011.
acked Savings from ENSC 1.560 MW 1.560 MW 0.46 0.717 MW Evaluation Results 1.324 MW 1.180 MW 0.73 0.861 MW As per the last table, the evaluated net energy savings exceeded those tracked by ENSC by more than 80 percent. This is mainly due t...
AI summary The evaluation of the Performance Plus Program by ENSC shows that net energy savings exceeded initial tracking by over 80%, primarily due to adjustments in the house rating baseline and the inclusion of energy and demand savings from efficient lighting. The Net-to-Gross Ratio (NTGR) increased from 0.46 to 0.73, reflecting changes in free-rider evaluation approaches. Demand savings realization was lower at 120% due to adjustments in peak demand savings calculations.
who signs the form, we need to have a box check to identify who is signing this form, the builder or the owner in case we need some clarification or contact that person for evaluation purposes. Assignment of rebate to builder Insert a form...
AI summary The document outlines questions related to the Performance Plus Program by Efficiency Nova Scotia Corporation, including delivery agents, free-ridership, barriers, evaluation processes, and database usability. It seeks insights for process interviews and program evaluation.
tors and Drives category is identified in three different ways. This will facilitate the site sampling process and the savings validation once a systematic validation can be conducted. Ref.: 5725 10 Business Energy Rebates Program Efficien...
AI summary The Business Energy Rebates Program, managed by Efficiency Nova Scotia Corporation, has seen significant growth in participation, with 106 participants in 2011 compared to 13 in the first year. The program was upgraded with streamlined application processes, market push strategies, and free-rider screening. Econoler provided recommendations for further improvements.
rporation 2011 Evaluation Report 4 IMPACT EVALUATION 4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evaluation is aimed at determining the gross and net savings of the program for 2011. Both energy and demand savings were c...
AI summary The impact evaluation for 2011 assesses the program's energy and demand savings by analyzing factors such as savings methodology, installation rates, and free-ridership. It involved on-site visits, participant surveys, and interviews to verify data and establish adjustment ratios for energy savings calculations.
rms of net savings. To that effect, the program objectives include any distortion effects, whether positive or negative. They also include interactive effects, when not taken into account in the base case. These parameters are usually base...
AI summary The text discusses the importance of documenting program parameters and refining marketing plans for the Business Energy Rebates program. It emphasizes the need to account for distortion and interactive effects in program objectives and to use performance indicators for monitoring and evaluation.
Efficiency Nova Scotia Corporation 2011 Evaluation Report Q: Please describe who are the program partners and what are their roles. This should guide us in asking the appropriate questions in the process evaluation. (Sales leads, marketing...
AI summary The document contains a series of questions for evaluating the Efficiency Nova Scotia Corporation (ENSC) Business Energy Rebates (BER) program, including inquiries about program partners, design considerations, barriers, evaluation plans, marketing strategies, and database usability. It also includes an interview guide for participants in the program evaluation.
lues for the fields listed above. Nevertheless, these invoices were approved by the PM. The missing information might not be essential for program administration but is useful for evaluation purposes. For each sale, the information in the...
AI summary The evaluation of the Smart Lighting Choices Program highlights that while invoices contain necessary information for rebate administration, additional details such as product specifications are missing. The Program Manager uses product numbers to determine lamp wattage and ballast types for tracking savings. The Evaluator suggests improvements to invoice consistency and program evaluation.
med 25 on-site visits as well as a telephone survey of 27 program participants. The analysis and program evaluation results are presented separately for each of the two C&I Custom program components. PROGRAM OVERVIEW The C&I Custom program...
AI summary The C&I Custom programs offer technical assistance, financial incentives, and project financing to medium and large C&I customers to reduce energy consumption and demand. The C&IC program component, launched in 2008, was upgraded in 2011 with improved staffing, focus on larger projects, and enhanced sales outreach to improve peak demand savings.
rams in the overall executive summary of the 2011 demand-side management (DSM) programs, the Evaluator has the following recommendations that are aimed at optimizing specific aspects of each program: Recommendations for the C&IC Program: C...
AI summary The Evaluator recommends clearly defining M&V requirements for the C&IC Program before signing the PDA, ensuring compliance with IPMVP standards. Templates for M&V plans were introduced in 2011 to standardize activities under the program and assist participants in developing their own plans.
ates should significantly help program participants develop their own M&V plan and is a first step toward standardizing the M&V activities performed under the C&IC program. C&IC-R2. Envisage performing third-party M&V for a number of C&IC...
AI summary The document discusses recommendations for the C&IC program, suggesting that third-party monitoring and verification (M&V) should be used for certain projects to ensure compliance and reduce risk. It also mentions the importance of developing standardized M&V plans for program participants.
g computer-assisted telephone interviewing (CATI). The average length of the survey was 17.5 minutes. The participant survey was used to gain a better understanding of the following program features: > previous program participation; > how...
AI summary The participant survey, conducted via computer-assisted telephone interviewing (CATI), aimed to understand program features such as previous participation, learning sources, spillover effects, motivations, and satisfaction. The survey lasted 17.5 minutes on average. Appendix III and VII provide demographic data and the questionnaire, respectively. Table 3 outlines sample sizes and sampling errors for 2010 and 2011.
Program 13. Develop an evaluation plan in parallel with program design and Design and development: This program has no evaluation plan. The Evaluator strongly Implementation recommends that for each new program, an evaluation plan be prepa...
AI summary The text emphasizes the importance of developing an evaluation plan alongside program design, comparing actual building consumption with simulations for accuracy, and setting performance indicators for project delivery. These steps aim to improve program effectiveness and ensure accurate monitoring and verification.
h when data are available. 15. Set performance indicators on project delivery process: In different sections of the program manual there are references to time limits to perform a given task. With the aim of evaluating project delivery pro...
AI summary The document recommends establishing performance indicators for project delivery efficiency and clarifying minimum requirements for CINC projects to improve compliance and reduce issues during the M&V step. It also suggests providing standardized documentation and examples to assist participants in meeting CPG requirements.
interested in internal procedures. Q: Do you have a participation flow chart that illustrates the different steps for the participants that could be a good support for the program manual writing? Ref.: 5725 80 Commercial & Industrial Custo...
AI summary The text includes questions and comments related to program eligibility, internal procedures, terminology consistency, time limits, and program funding caps in the Commercial & Industrial Custom and New Construction Program. Concerns are raised about free-ridership, clarity of documentation, and potential barriers caused by funding limitations.
cts because of that limitation? Section 4.4.2.2 C: The 85% ratio for incentive of the total program budget seems a very good ratio for a new program. I have to congratulate you if this is the case. Q: I understand that you do not allow red...
AI summary The text includes questions and comments regarding program design, payback periods, commissioning plans, legal reviews, training materials, marketing strategies, program logic models, and potential distortion effects such as free-riders and spillovers. These discussions pertain to the evaluation and structure of the Commercial & Industrial Custom and New Construction Program.
eral Q: is there a program logic model? Q: When the program was initially designed did it include some distortion effects (free-riders, spillover) and were they quantified to establish net savings? Q: Do you perform the cost effectiveness...
AI summary The text contains a series of questions related to the evaluation of the Commercial & Industrial Custom and New Construction Program, including program logic models, distortion effects, cost-effectiveness tests, program partners, evaluation plans, and database usability. It also references an evaluation report and recommendations.
Care to comment? Q: In the appendix A, we count eleven (11) forms for that program. Could that be a reason for any bottleneck in tracking the program data and entering them in a centralized database? C: Custom Client Response Process (afte...
AI summary The text discusses questions raised during a regulatory proceeding regarding program data tracking, methodology appendices, marketing strategies, and program evaluation. It highlights concerns about bottlenecks, missing appendices, and the need for evaluation plans and cost-effectiveness testing.
that use the Whole Building Path Participant in the kick-off meeting with ENSC and the client Site inspections Measurement & Verification (M&V) Design assistance, if needed Other Ref.: 5725 91 Commercial & Industrial Custom and New Constru...
AI summary The text outlines various stages and processes involved in a commercial and industrial energy efficiency program, including kick-off meetings, site inspections, measurement and verification, and design assistance. It also includes a series of questions regarding program verification, commissioning, and relationships with stakeholders such as clients, consultants, and contractors.
in future evaluations. The Evaluator recommends increasing the number of sites where data loggers are installed in order to obtain a more reliable self-declaration ratio. 4.2.3 Installation Rate The installation rate of the program was ass...
AI summary The evaluation of the Small Business Energy Solutions Program highlights the need for more data loggers and on-site visits to improve the reliability of installation and self-declaration ratios. Discrepancies between on-site data and tracking sheets suggest potential issues with reporting and updates.
ng a minimum number of installations? Page 7 Q: If the main objective of ENSC is to save electricity, why are municipal utilities not eligible for the bill financing of 20% like the clients of NSP? Q: What is the proportion (%) of particip...
AI summary The text contains a series of questions raised during a regulatory proceeding regarding the Small Business Energy Solutions Program operated by Efficiency Nova Scotia Corporation. The questions focus on program eligibility, incentive levels, verification processes, and administrative procedures.
satisfaction (say from 1 to 10) for most of the questions instead of a straight yes or no or not sure. C: Replace question # 3, by if the score is under .8, ask for the reason(s). Source: General Q: Could you please describe who the progra...
AI summary The text outlines a process evaluation questionnaire for Efficiency Nova Scotia Corporation's Small Business Energy Solutions Program, aimed at gathering feedback from program partners regarding their roles, program design, barriers, cost-effectiveness testing, marketing strategies, and database usability.
120102012 DSM Evaluation Reports
20 passages
1 EVALUATION OBJECTIVES & METHODOLOGY
AI summary The section outlines the evaluation objectives and methodology for assessing energy efficiency programs and initiatives. It sets the framework for analyzing program effectiveness, cost recovery, and compliance with regulatory standards.
2 DSM PORTFOLIO PERFORMANCE
AI summary The section discusses the performance of the Demand-Side Management (DSM) portfolio, likely covering program outcomes, efficiency initiatives, and related metrics under Nova Scotia's regulatory framework.
Table 11: General Recommendations on ENSC Program Manuals No. Recommendations OV-R2. Update the program manuals with the most recent information on eligible measures: Program manuals are widely used by the Evaluator throughout the program...
AI summary The document recommends updating ENSC program manuals with the most recent eligible measure information and implementing quality assurance protocols for all programs. These updates aim to improve evaluation accuracy and ensure consistent quality across ENSC initiatives.
objectives to be achieved, clarify reasonable expectations and, finally, improve the overall execution of the marketing strategy. The Evaluator has the following recommendation on the marketing plan: Make the performance indicators more qu...
AI summary The Evaluator recommends making performance indicators in the marketing plan more quantitative and specific, focusing on the performance of individual marketing strategy tools rather than general program status, and indicating revision dates to ensure ongoing effectiveness.
Table 4: Program Manual Content – Instant Savings Program Manual Content 2011 2012 Document revisions 4 4 Program description (including nature or type of program) 4 4 Program justification Δ 4 Program objectives 1 1 Incentives 4 4 Eligibi...
AI summary Table 4 outlines the content of the Instant Savings program manual across different years, detailing sections such as program description, incentives, eligibility, and evaluation plans. It shows the inclusion or absence of various elements in the manual for 2011 and 2012.
proved contractors for the benefit of participants is being studied in consultation with ENSC trade allies. The marketing strategy implemented can make the difference between a program's success and failure. To assess the effectiveness of...
AI summary The document discusses the importance of quantitative performance indicators in the marketing plan for energy efficiency programs. It highlights that while performance indicators have been integrated since 2011, they should be made more specific and measurable to improve the effectiveness of the marketing strategy and support informed decision-making.
This Appendix presents all recommendations made by the Evaluator throughout the report as well as the sections where the recommendations originated. Sections Recommendations Marketing and Outreach Activities 8. Make the performance indicat...
AI summary The appendix outlines a recommendation to enhance the marketing plan by making performance indicators more quantitative and specific, focusing on the effectiveness of individual marketing strategies and including revision dates to ensure ongoing relevance and accuracy.
Table 6: Program Manual Content – Performance Plus Program Manual Content 2012 Document revisions Program description (including nature or type of program) Program justification Program objectives Incentives Eligibility criteria Program pa...
AI summary Table 6 outlines the content of the Program Manual for the Performance Plus initiative, detailing sections such as program description, objectives, incentives, eligibility, and evaluation plans. It includes a list of program manual content items for the year 2012, indicating what information is included, partially included, or missing.
CONCLUSION The 2012 evaluation of Performance Plus demonstrated that the program underwent a series of changes that altered its design and implementation. Indeed, Performance Plus went from attributing distinctive incentives for every impl...
AI summary The 2012 evaluation of the Performance Plus program showed significant improvements since 2011, including better program design, increased promotion, and higher participant satisfaction. The program saw an increase in participants and achieved higher energy and demand savings. However, program partners noted that more marketing and information on the assessment process were needed.
IN3. On a scale from 1 to 10 (where 1 is very poor and 10 is excellent), how would you rate your satisfaction in regard to the…? Aspects of the program Score 1=very poor 10=excellent Reason If you answered 8 or less, please share the reaso...
AI summary The text presents a survey assessing participant satisfaction with various aspects of an energy efficiency program, including program marketing, relationships with ENSC staff, and the assessment process. It includes questions about the appropriateness of the EnerGuide methodology and the need for additional information or changes to the assessment process.
2.2.5 Participant Survey A telephone survey with a total of 181 program participants was conducted by Econoler's subcontractor, Corporate Research Associates, Inc. (CRA), from its offices in Halifax. The interviews were conducted in Octobe...
AI summary A telephone survey of 181 RDI program participants was conducted in October 2012 by CRA using CATI technology. The survey aimed to gather feedback on spillover, free-ridership, program awareness, participant motivations, satisfaction, and recommendations for improvement. Only non-low-income participants who joined the program since July 2012 were surveyed.
PA2 Score: FR4. Level of influence (Scale 0 to 10) Factors a, b and c = Program factors
AI summary The document references the PA2 Score and discusses the Level of influence on a scale from 0 to 10, focusing on Program factors a, b, and c. This appears to be part of a regulatory evaluation or assessment process.
DEFINITIONS Base Case A base case details the information on how assumed gross savings used in the tracking sheet have been established. Usually, these savings are calculated with a series of variables such as hours of operation, wattage o...
AI summary The text defines key terms related to energy efficiency programs, including base case, demand savings, distortion effects, and net-to-gross ratio. It outlines how energy savings are calculated, considering factors like interactive effects and free-ridership.
n. The tracking sheet includes a column where some energy savings are calculated by the DA using old energy savings values, but this column is only used for establishing the DA's targeted performance. In the light of these observations, th...
AI summary The tracking sheet is used to calculate energy savings and monitor program performance, but it has issues with incomplete data collection. The Evaluator recommends collecting more detailed installation data and ensuring all fields are systematically filled out for better program evaluation and on-site visits.
4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evaluation is aimed at determining the gross and net savings of the program for 2012. Both energy and demand savings were examined in this evaluation. To do so, the following p...
AI summary The impact evaluation assesses the gross and net savings of the MURB program for 2012, analyzing unitary savings values, installation rates, and free-ridership. On-site visits and interviews were conducted to validate installation and savings calculations, focusing only on tenant units.
Executive Summary 3. Collect quantity of products installed in the tracking sheet for each individual tenant unit\ : In 2012, the quantity of products installed in each individual unit was only collected on paper forms from mid-August. In...
AI summary The text discusses recommendations for improving data collection and tracking sheets in energy efficiency programs. It suggests collecting product installation data by unit number instead of tenant names to respect privacy and improve landlord communication. It also recommends enhancing the tracking sheet with additional fields for better evaluation of program impacts and savings.
Marketing and Outreach Activities 9. Make the performance indicators more quantitative: To make the current performance indicators in the marketing plan more precise, specific and effective, they should be modified to reflect more quantita...
AI summary The text discusses improvements to marketing performance indicators and data collection in a program. It recommends making performance indicators more quantitative, ensuring all fields in the tracking sheet are filled, and collecting additional data such as CFL installation location and heating/air conditioning information for better evaluation.
4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evaluation for mail-in rebate is aimed at determining the gross and net savings of this component of BER for 2012. Both energy and demand savings were considered in the evaluat...
AI summary The impact evaluation for the mail-in rebate component of the Business Energy Rebates (BER) program in 2012 aimed to determine gross and net savings, considering energy and demand savings. The evaluation involved analyzing parameters such as savings methodology, equipment characteristics, and free-ridership, supported by tracking sheets, 50 on-site visits, and participant surveys.
s during which the facility is closed, or in some cases by taking into consideration that the equipment operates continuously during the peak demand hours. Ref.: 5790 xi Custom-R4. Promote more active and extensive use of the M&V procedure...
AI summary The document recommends promoting the use of M&V procedures for Standard Custom Retrofit projects, emphasizing the importance of conducting M&V on large projects and those with significant energy savings potential. It highlights the need to define M&V procedures early in project planning to ensure accurate baseline data collection.
5.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION This Impact Evaluation section aims at determining the gross and net savings of CDI for 2012. Both energy and demand savings are considered in this evaluation. To do so, the following par...
AI summary This section outlines the approach used to evaluate the impact of the Commercial Demand Initiative (CDI) in 2012, focusing on energy and demand savings. Econoler analyzed factors such as unitary savings values, installation rates, interactive effects, and free-ridership, using data from program tracking sheets, literature, on-site visits, and participant surveys to calculate net savings.