E-22014 Electricity Demand Side Management Plan Evaluation Reports
104 passages
INTRODUCTION This document provides a summary of the 2014 evaluations conducted for the Efficiency Nova Scotia Corporation (ENSC) demand-side management (DSM) programs. Established in 2010, ENSC is an organization in charge of helping Nova...
AI summary This document summarizes the 2014 evaluations of Efficiency Nova Scotia Corporation's (ENSC) demand-side management (DSM) programs. The evaluations were conducted by Econoler, in collaboration with CRA and Equilibrium Engineering, and revealed significant energy and peak demand savings. The report also discusses the evaluation methods used for different program components.
Annual Surveys Between October and December 2014, using computer-assisted telephone interviewing (CATI) technology, CRA conducted annual surveys with participants and builders for most of the program components. Although the content of the...
AI summary In 2014, CRA conducted annual surveys using CATI technology to gather data on program components, focusing on free-ridership, awareness, participant motivations, satisfaction, and recommendations for improvement. Surveys covered internal spillover effects and energy efficiency behaviors.
Quarterly Surveys In 2014, using CATI technology, CRA conducted quarterly surveys with Business Energy Rebates (BER), Business Energy Solutions and Residential Direct Install participants. These surveys consisted of contacting a sample of...
AI summary In 2014, CRA conducted quarterly surveys via CATI with BER, Business Energy Solutions, and Residential Direct Install participants to assess free-ridership and satisfaction. This method shortened the evaluation timeline compared to prior approaches, improving precision in program effectiveness analysis.
Instant Savings In 2014, Instant Savings generated 9.360 GWh in net electricity savings, and 1.479 MW in net peak demand savings. The evaluated net energy savings were found to be 38 percent lower than the corresponding tracked value, whil...
AI summary In 2014, Instant Savings achieved 9.360 GWh in net electricity savings and 1.479 MW in net peak demand savings. However, evaluated savings were 38% and 31% lower than tracked values, respectively. Adjustments to baseline wattage for LED lamps and changes in free-ridership levels contributed to the discrepancies.
Residential Direct Install Residential Direct Install had a total of 13,945 participants in 2014, and achieved net energy and peak demand savings of 24.552 GWh and 5.721 MW respectively. In addition to the regular Residential Direct Instal...
AI summary The Residential Direct Install program achieved significant energy and peak demand savings in 2014, with additional savings from a CBSM Pilot. Evaluated savings were slightly lower than tracked values due to adjustments in unitary savings, installation rates, and free-ridership levels, which were offset by increased internal spillover effects.
Custom Retrofit In 2014, the Custom Retrofit component had a total of 100 projects implemented, which was lower than the previous years. Custom Retrofit generated net energy savings of 20.292 GWh and net peak demand savings of 1.599 MW in...
AI summary In 2014, the Custom Retrofit program had 100 projects, achieving 20.292 GWh in net energy savings and 1.599 MW in peak demand savings. EBC and EMIS contributed additional energy savings but no peak demand savings. Evaluated savings were lower than tracked savings due to changes in NTGR and adjustments to gross savings.
Table 8: 2014 Free-ridership, Spillover and NTGRs Program Component Free ridership Levels Spillover Levels NTGR Refrigerators - a Appliance Retirement Freezers - 4% 0.60 Room AC Units - Regular CFLs 54% 28% 0.74 Instant Savings LED Lamps 0...
AI summary Table 8 presents 2014 data on free-ridership, spillover, and NTGRs for various energy efficiency programs. The table includes metrics such as free-ridership levels, spillover levels, and NTGR for different program components, such as appliance retirement, instant savings, and business energy rebates.
cking report contains enough information to allow carrying out the evaluation, it is recommended that further improvements be made to the accuracy of the data collected. Survey results showed that participants' satisfaction with Green Heat...
AI summary The evaluation of the Green Heat program found high participant satisfaction but noted a slight decline in participation since 2011, attributed to changes in rebate eligibility. Energy savings decreased in 2014 compared to previous years, with net savings of 1.472 GWh and peak demand savings of 0.594 MW. The evaluation considered free-ridership and used literature review data for calculations.
havioural change being related to turning off the lights. Other behavioural changes include increased awareness of power usage and saving energy, turning off appliances and reducing water consumption. A total of 13,945 participants partici...
AI summary The Residential Direct Install program saw a reduction in participants from 2012 to 2014, but achieved energy savings targets through increased efficiency measures like LED lighting and smart power controllers. The program also included a CBSM Pilot that encouraged reduced warm water usage for laundry, contributing additional energy savings.
nt of information regarding the process, time-consuming process, eligibility hard to ensure and communication issues. Participants also recommended that more information be provided about the program. Similar to last year, distributors exp...
AI summary The Business Energy Rebates (BER) program faces challenges with rebate tracking, reporting, and communication. Distributors are dissatisfied with the time required for rebate processing, financial responsibilities due to errors, and complexity in applying rebates. The Evaluator calculated net savings by adjusting gross savings estimates with free-ridership levels, resulting in an NTGR of 0.73 for energy savings.
No. Recommendations BER-R6. Re-assess the product offerings to consider the baseline improvement observed in the market. In 2014, the free-ridership level increased to an average of 26 percent for Business Energy Rebates. This was a signif...
AI summary The text discusses the need to re-assess product offerings under the Business Energy Rebates program due to increased free-ridership levels, indicating that some rebated products may be aligning with current market practices. This is attributed to rapid changes in the lighting market, driven by falling technology prices and new regulations.
Table 18: Recommendations for Custom Retrofit No. Recommendations Custom-R3. Improve the free-ridership pre-screening procedure. This year again, ENSC discussed the clients' payback period threshold and the importance of the incentive for...
AI summary The document recommends improving the free-ridership pre-screening procedure for the Custom Retrofit program. ENSC discussed payback period thresholds and project incentives, and found that some answers in the annual survey were weak. It suggests standardizing questions and defining acceptable answers, similar to the approach used in Business Energy Rebates.
APPENDIX II NTGR CALCULATIONS This appendix presents some examples of how the Evaluator has made the calculations to establish the free-ridership, internal spillover and net-to-gross ratio values in the 2014 evaluation. To demonstrate how...
AI summary This appendix provides examples of how the Evaluator calculated free-ridership, internal spillover, and net-to-gross ratio values for the 2014 evaluation, focusing on the Custom Retrofit and Residential Direct Install program components. A similar approach was used for other program components.
Overall Executive Summary Custom Retrofit Free-ridership algorithm Low free-ridership participant High free-ridership participant Average free-ridership participant Questions Calculation Algorithm Answer Calculation Result Answer Calculati...
AI summary The text discusses the calculation of free-ridership scores for participants in a custom energy efficiency program. It outlines algorithms and questions used to determine the likelihood of participants implementing energy efficiency measures without the program and assesses the influence of various factors on their participation.
Evaluation of 2014 DSM Programs Efficiency Nova Scotia Corporation Overall Executive Summary Overall free-ridership level (%) for the program component $$FR_{total} = \frac{\sum_{i=1}^{n} (FR_i \times Gross_Savings_i)}{\sum_{i=1}^{n} Gross...
AI summary The document evaluates the 2014 DSM programs of the Energy Efficiency Nova Scotia Corporation, calculating the overall free-ridership level using a formula that aggregates individual free-ridership rates and gross savings across participants.
2.2 Methodology Description In 2014, a full-scale evaluation of ARet was not carried out. The evaluation of ARet involved substantiating ENSC's tracked savings with the parameters established in the 2013 evaluation, and re-evaluating the f...
AI summary In 2014, an evaluation of the Appliance Retirement (ARet) program was conducted by ENSC, updating energy consumption values of retired appliances and assessing parameters like free-ridership and induced consumption. A survey of 204 participants was carried out using CATI technology to gather insights on program impact and participant satisfaction.
Free-ridership The following table presents the different discarding scenarios and the proportion of participants who would have disposed of their freezers without the program, and who are therefore identified as cases of free-ridership.
AI summary The text discusses free-ridership in the context of a program, presenting scenarios and the proportion of participants who would have disposed of their freezers without the program.
Free-ridership The following table presents the different scenarios for discarding and the proportion of participants who would have disposed of their air conditioners without the program. These participants are identified as cases of free...
AI summary The text discusses free-ridership in the context of a program, identifying participants who disposed of their air conditioners without the program's involvement.
Table 26: Savings per Room Air-conditioning Unit Free-ridership ar nd Sec ondary Market Impac ts Would Have Discard Would-be Acquirer % Alternate ate Overall Energy Consumption (kWh/year) Savings Kept Unit % Scenario % Finds an Alternate U...
AI summary Table 26 presents savings per room air-conditioning unit, analyzing scenarios where units are discarded, transferred, or disposed of. It includes data on energy consumption, savings, and program-induced consumption, providing insights into free-ridership and secondary market impacts.
Replacement Section (RE Series) - RE1. Did you replace the [refrigerator/stand-alone freezer/air conditioner unit] that you turned in through Efficiency Nova Scotia's Appliance Retirement Program? - 1. Yes - 2. No [GO TO FREERIDERSHIP SECT...
AI summary This section of the document includes a series of questions aimed at understanding customer behavior related to appliance replacement, particularly through Efficiency Nova Scotia's Appliance Retirement Program. It explores motivations, the influence of the program, and whether rebates were a determining factor in replacement decisions.
Free-Ridership Section (FR Series) Please continue thinking about just that one [refrigerator/stand-alone freezer/air conditioner unit]. - FR1. Had you already planned to dispose of the one [refrigerator/stand-alone freezer/air conditioner...
AI summary This section of the Free-Ridership (FR Series) asks respondents whether they would have disposed of an appliance even if the Efficiency Nova Scotia Appliance Retirement Program was not available, aiming to assess program participation and free-riding.
APPENDIX III ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity, effi...
AI summary This appendix outlines an algorithm for calculating free-ridership levels based on participant survey data. The survey assessed various aspects of a program, such as planning, efficiency, and cost, which were used to determine program attribution and free-ridership levels for each participant.
Many elements can explain why the evaluated savings, both gross and net, have been lower than the corresponding tracked values. First of all, the baseline wattage for LED lamps, the best-selling product, was adjusted to take into account t...
AI summary The evaluated energy savings were lower than tracked values due to baseline adjustments for LED lamps and changes in free-ridership levels. The adjusted baseline for LED lamps reduced unitary savings by 57%, while increased free-ridership for regular CFLs also impacted the results. The net energy savings were 38% lower and net peak demand savings were 31% lower than tracked values.
Revised Savings Because both regular and specialty CFLs are no longer part of the Instant Savings rebated products as of the 2014 fall campaign, the unitary savings values were not reviewed this year, as last year's evaluation results are...
AI summary The document discusses the revised savings methodology for lighting programs, noting that unitary savings values for CFLs were not reviewed due to unchanged assumptions. The methodology now follows UMP Chapter 67, using one of two approaches to estimate efficient lamp replacements. The Evaluator chose to apply the first approach, impacting free-ridership estimates and the replacement ratio.
5.3 Net-to-gross Ratio This section presents the evaluation of NTGR for Instant Savings, which included the assessment of free-ridership and spillover (through market effects) for two specific products: regular CFLs and LED lamps. These pr...
AI summary This section evaluates the net-to-gross ratio (NTGR) for the Instant Savings program, focusing on free-ridership and spillover effects for regular CFLs and LED lamps, which account for 69% of total tracked gross savings.
5.3.1 Free-ridership The free-ridership levels for regular CFLs were assessed through the intercept survey, using the same algorithm as in the previous evaluations. The algorithm is presented in Appendix VII. For the LED lamps, a free-ride...
AI summary The free-ridership levels for regular CFLs were assessed using an algorithm from previous evaluations, while LED lamps were assumed to have 0% free-ridership based on the UMP approach discussed in Section 5.1.2.
CFLs The free-ridership level obtained for CFLs sold during the spring campaign is 54 percent. This value is higher than the 44 percent obtained in 2013. It was expected that the percentage of free-ridership would increase in 2014 as CFLs...
AI summary The free-ridership level for CFLs sold during the 2014 spring campaign was 54%, higher than 44% in 2013. This increase was expected due to CFLs becoming the standard product as incandescent lamps were phased out. ENSC decided to exclude CFLs from Instant Savings rebates after the 2014 campaign. Specialty CFLs had a lower penetration rate and were assigned a NTGR of 1.
5.3.3 NTGR Calculation The NTGR values for regular CFLs and LED lamps were established using the free-ridership and spillover levels, based on the equation below. $$NTGR = (1 - \% \text{ free-ridership} + \% \text{ spillover})$$ The table...
AI summary The NTGR values for regular CFLs and LED lamps are calculated using free-ridership and spillover levels, while other specialized products like dimmer switches and occupancy sensors use a NTGR of 1 due to difficulties in assessing their distortion effects and reaching their smaller buyer populations.
CONCLUSION The 2014 evaluation of Instant Savings demonstrated that most of the recommendations made specifically for Instant Savings in the previous evaluations were implemented. The Evaluator commends ENSC on the efforts it made to impro...
AI summary The 2014 evaluation of Instant Savings highlights improvements in the program, including the removal of CFLs and the promotion of LED lamps. However, challenges remain, such as retailer engagement and communication delays. Energy savings declined compared to previous years, partly due to budget cuts and lower unitary savings for certain products.
Free-Ridership (FR Series) [ONLY ASK ONE FR SECTION PER PARTICIPANT]: [IF A RESPONDENT GETS I2, THEN THEY GET THE CFL FR SEQUENCE] [IF A RESPONDENT GETS I2A, THEY GET THE LED FR SEQUENCE] [IF A RESPONDENT GETS I2B, IF THEIR RESPONSE IS COD...
AI summary The text outlines procedures for handling free-ridership (FR) sections in a regulatory proceeding, specifying different sequences based on participant responses and codes. It includes conditional logic for assigning CFL or LED FR sequences depending on the response received.
APPENDIX VII ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity, effi...
AI summary This appendix outlines an algorithm for calculating free-ridership levels based on participant survey data. The survey assessed various aspects of energy efficiency programs, with responses used to determine the level of program attribution and associated free-ridership.
EXECUTIVE SUMMARY The 2014 evaluation of Home Energy Assessment (HEA) involved validated Efficiency Nova Scotia Corporation's (ENSC) tracked savings as well as re-evaluating free-ridership and internal spillover. This report presents the v...
AI summary The 2014 evaluation of Home Energy Assessment (HEA) included validated Efficiency Nova Scotia Corporation's tracked savings and re-evaluation of free-ridership and internal spillover. The report details the validated gross and net savings for that year.
Table 1: Distortion Effects and Net-to-Gross Ratio Parameter 2014 Result Free-ridership Level 31% Spillover Level 6% NTGR 0.75 Project No. 5870 vii
AI summary Table 1 presents the free-ridership level at 31%, spillover level at 6%, and a net-to-gross ratio (NTGR) of 0.75 for the year 2014. These metrics provide insights into the distortion effects and efficiency of the program.
3.2.1 Free-ridership In the case of HEA, free-ridership can occur when participants would have still implemented the energy efficiency upgrades and measures in the absence of the program. The free-ridership level was measured through the a...
AI summary The free-ridership level for the Home Energy Assessment (HEA) program was measured at 31 percent in 2014, consistent with levels from previous years (2011-2013). This indicates that 31 percent of participants would have implemented energy efficiency upgrades even without the program.
3.2.3 NTGR Calculation The NTGR is calculated using the following equation: NTGR = (1 – % free-ridership + % internal spillover) Using the free-ridership and spillover levels established for HEA, the NTGR value is estimated at 0.75.
AI summary The Net-to-Gross Ratio (NTGR) is calculated using the formula (1 – % free-ridership + % internal spillover). Based on established free-ridership and spillover levels from the Home Energy Assessment (HEA), the NTGR is estimated at 0.75.
4 UNCONVERTED D STUDY SAVINGS In 2013, many participants did not complete the E assessment. The partner's interviews from the 2013 process evaluation showed that the main reason for this was the length of time to complete the E assessment...
AI summary The document discusses the 2013 Unconverted D Study Savings, focusing on participants who did not complete the E assessment. It outlines the methodology used to calculate energy savings from unconverted participants, including survey results, the influence of energy assessments, and the calculation of net energy and peak demand savings.
Free-Ridership [FR Series] Now I'm going to ask you to think of all the energy-efficient upgrades that were implemented to your home under the Home Energy Assessment program. - FR1. BEFORE participating in the Home Energy Assessment progra...
AI summary The text asks participants in the Home Energy Assessment program whether they had plans to implement specific energy-efficient upgrades before the program. This is part of a free-ridership analysis to assess if the program influenced the upgrades.
DEFINITIONS Accuracy Reflects the proximity of measurements to the true value. Bias Systematic deviations of measurements from the true value. Confidence interval The estimated range of values which is likely to include the unknown populat...
AI summary This section provides definitions related to energy efficiency program evaluation, including terms such as accuracy, bias, confidence intervals, distortion effects, free-ridership, gross and net energy savings, and net-to-gross ratio. It outlines how savings are calculated and evaluated, and the factors that influence measurement accuracy.
Energy Savings To calculate the net savings of Green Heat in 2014, the Evaluator reviewed the gross savings values estimated by ENSC by making a literature review mainly regarding the central ducted, geothermal and air-to-water heat pumps,...
AI summary The Evaluator calculated the net savings of Green Heat in 2014 by reviewing ENSC's gross savings estimates and considering a free-ridership level of 36 percent, based on literature reviews and participant surveys. Free-ridership levels were 34 percent in 2013 and 32 percent in 2012.
2012 Executive Summary Recommendations The Evaluator noticed that two of the three recommendations made in 2012 were implemented by ENSC. The implementation of these recommendations allowed for overall program improvement. One of them was...
AI summary The 2012 Executive Summary Recommendations highlight that two of three recommendations were implemented by ENSC, including continued marketing efforts and calibrated simulations for Green Heat. One recommendation regarding rebates for ductless mini-split heat pumps was not implemented due to concerns about high freeridership.
5 IMPACT EVALUATION The objective of the 2014 Green Heat impact evaluation is to determine the gross and net energy savings. Both electrical energy and peak demand savings were estimated by analyzing two main parameters: the unitary saving...
AI summary The 2014 Green Heat impact evaluation aims to assess gross and net energy savings, focusing on electrical energy and peak demand savings. This is done by analyzing unitary savings values for installed equipment and the free-ridership level of the program.
5.2.1 Free-ridership In the case of Green Heat, free-ridership can occur when participants would have still installed the heating system in the absence of the program. The free-ridership level was measured through the participant survey, u...
AI summary The free-ridership level for the Green Heat program in 2014 was measured at 36%, indicating that 64% of the heating systems installed were influenced by the program. This level is consistent with previous years' evaluations, ranging from 32% in 2012 to 42% in 2011.
5.2.2 NTGR Calculation The NTGR has been calculated using the following equation: $$NTGR = (1 - \% \text{ free-ridership}).$$ Using the free-ridership level established for Green Heat, the NTGR value has been established at 0.64.
AI summary The NTGR (Net-to-Gross Ratio) is calculated as (1 - % free-ridership), with a value of 0.64 established based on the free-ridership level for Green Heat.
CONCLUSION The 2014 evaluation of Green Heat demonstrated that most of the recommendations made specifically for Green Heat in the last evaluations were implemented. The Evaluator commends ENSC on the efforts it made to improve and optimiz...
AI summary The 2014 evaluation of Green Heat highlighted successful implementation of past recommendations, improvements in marketing and data accuracy, and high participant satisfaction. However, participation slightly declined, and energy savings decreased compared to previous years. The evaluation also noted the impact of shifting focus to renewable fuel-based heating systems.
APPENDIX IV ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity, effic...
AI summary This appendix outlines an algorithm for calculating free-ridership levels in the Green Heat program. It uses survey responses to assess the likelihood that participants would have made energy-efficient heating decisions without the program, and applies a scoring system based on their answers.
Key Findings Econoler reviewed the content of the 2014 tracking sheet. A total of 846 participants took part in New Home Construction in 2014 (including 709 participants registered under Performance Plus). To calculate the gross savings of...
AI summary Econoler evaluated the New Home Construction program in 2014, finding a net-to-gross ratio (NTGR) of 0.78 after accounting for free-ridership and market effects. The savings per EnerGuide point increased slightly compared to 2013, and free-ridership levels rose among builders and homeowners.
Participant Survey The participant survey was conducted with a total of 48 homeowner participants. The average length of the survey was 12 minutes. The main purpose of the participant survey was to revise the free-ridership level. Even tho...
AI summary A participant survey was conducted with 48 homeowners to revise the free-ridership level. The survey aimed to assess satisfaction with programs like Performance Plus and New Home Construction. Appendices I and II include the questionnaire and results, respectively.
3.3.1 Free-ridership In the case of New Home Construction, free-ridership can occur when participants or builders would have still implemented the energy efficiency measures in the absence of the program. The free-ridership level was measu...
AI summary The text discusses free-ridership in the context of New Home Construction programs, noting that 33% of participants in 2014 were free-riders, based on survey data and a calculation algorithm developed in 2011. Free-riders are those who would have implemented energy efficiency measures even without the program.
3.3.3 NTGR Calculation The NTGR has been calculated using the following equation: NTGR ൌ ሺ1 – % free‐ridership % spillover ሺmarket effectsሻሻ The NTGR value for New Home Construction is estimated at 0.78.
AI summary The NTGR is calculated using a formula that accounts for free-ridership and spillover effects. The NTGR value for New Home Construction is estimated at 0.78, indicating the proportion of energy efficiency benefits captured by the program.
APPENDIX V ALGORITHM FOR FREE-RIDERSHIP CALCULATION - PARTICIPANT The figures below present the algorithms for calculating the free-ridership level. The participant and builder survey questionnaires included questions designed to assess th...
AI summary This appendix outlines the algorithm used to calculate free-ridership levels based on participant and builder survey data. The surveys assessed various aspects of the program, including planning, quantity, efficiency, period, cost, and influence, which were used to determine program attribution and free-ridership levels.
Final Free-Ridership MEAN VALUE OF: (PA1 ; PA2 ; PA3) Inconsistency Test #1 IF ABS(FR2a- FR2b) <:: 30%: PA1 =MIN OF (FR2a ; FR2b) Inconsistency Test #2 IF FR3 <:: 70% AND IF (FR2a OR FR2b < 70%: PA2 =EMPTY
AI summary The text outlines two inconsistency tests related to free-ridership calculations. The first test determines PA1 based on the minimum of FR2a and FR2b if their difference is less than 30%. The second test sets PA2 as empty if FR3 is less than 70% and either FR2a or FR2b is also less than 70%.
PA2 Score: Final Free-Ridership Inconsistency Test #1 Revised Free-Ridership IF 1. Yes: Use FR1a IF 2. No OR 99 : FR1 = 0% IF 1. Yes: FR1 = 100% AND GO TO FR3 IF 2. No OR 99 : FR1 = 0% FR2 = FR2a I [#] of houses IF FR1 = 0% : FR2 I 2 OTHER...
AI summary The text outlines a calculation process for determining free-ridership in a regulatory proceeding, involving multiple conditional tests and formulas to assess the percentage of free-riders based on factors like the number of houses and mean values from previous assessments.
Energy Savings To calculate the net savings of RDI in 2014, the Econoler team reviewed the gross savings estimated by ENSC and conducted 50 on-site visits to establish the installation rates for each category of products installed through...
AI summary The Econoler team calculated the net savings of the Residential Direct Install (RDI) program in 2014 by adjusting gross savings estimates from ENSC with factors for free-ridership and spillover effects. A 15% free-ridership and 6% spillover were identified for non-low-income participants, while low-income participants had negligible distortion effects, resulting in an overall net-to-gross ratio (NTGR) of 0.93.
5.3.1 Free-ridership In the case of RDI, free-ridership can occur when participants would have still installed the energy efficiency products in the absence of the program. The free-ridership level was measured through the quarterly survey...
AI summary The free-ridership level for the RDI program was measured at 15% in 2014, down from 19% in 2012. This decrease may be due to the increased use of LED lamps over CFLs in the latter part of 2014. The calculation uses an algorithm detailed in Appendix IX.
5.3.3 NTGR Calculation The NTGR is calculated using the following equation: NTGR = (1 – % free-ridership + % internal spillover) Using the free-ridership and internal spillover levels established for non-low-income participants, the NTGR v...
AI summary The NTGR is calculated using a formula that accounts for free-ridership and internal spillover. For non-low-income participants, the NTGR is estimated at 0.91, while for low-income participants, it is assumed to be 1.00. The overall NTGR for the program is calculated as 0.93, which is used in the gross savings calculation.
Table 28: Comparison of Tracked and Evaluated Savings at the Generator Initial Gross Savings Installed Gross Savings Installed Gross Savings with Interactive Effects NTGR Net Savings Energy Savings Tracked Savings from ENSC 32.001 GWh 32.0...
AI summary The evaluated energy and peak demand savings from the program are slightly lower than the tracked savings. The evaluator adjusted unitary savings downward for some products, and installation rates have decreased. However, lower free-ridership and higher spillover levels increased the NTGR, partially offsetting these reductions, resulting in a 2% decrease in net energy savings.
SELECTION METHOD FOR THE TWO MEASURES: - › IF LED BULBS ARE VERIFIED IN V3 AND V4, RESPONDENT WILL AUTOMATICALLY ANSWER ACCORDING TO LED BULBS - › THEN, CHOOSE ANOTHER MEASURE VERIFIED IN V3 AND V4 AT RANDOM, AMONG THE FOLLOWING: - Low flo...
AI summary The selection method outlines how respondents will be assigned measures for verification in V3 and V4. If LED bulbs are verified, respondents will automatically answer according to LED bulbs. Otherwise, a random measure from a list is selected. LED nightlights are excluded from the free-ridership section.
APPENDIX IX ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity, effic...
AI summary This appendix outlines an algorithm for calculating free-ridership levels based on participant survey data. The survey assessed various aspects of programs, including planning, quantity, efficiency, cost, and influence, which were used to determine program attribution and free-ridership levels.
FR2a. If you had not participated in RDI, what is the likelihood that you would have installed the same energy-efficient products that you installed through RDI? (Scale 0 to 10) FR2a = Answer x 10% PA1 Score: FR2a FR1. Did you or anyone in...
AI summary This section of the document asks participants about their likelihood of installing energy-efficient products without the RDI program, their prior plans, and the influence of the program on their decisions. It also includes scoring mechanisms to assess free-ridership based on responses.
DEFINITIONS Accuracy Reflects the proximity of measurements to the true value. Bias Systematic deviations of measurements from the true value. Confidence interval The estimated range of values which is likely to include the unknown populat...
AI summary This section provides definitions of key terms related to energy efficiency program evaluation, including concepts like accuracy, bias, confidence interval, distortion effects, free-ridership, gross and net energy savings, and net-to-gross ratio. These definitions support the analysis and measurement of program impacts.
3.3.1 Free-ridership The free-ridership level is directly applied to the savings generated by the products installed in the individual tenant units. The free-ridership level has to be measured through interviews with tenants during the on-...
AI summary Free-ridership is calculated based on tenant interviews during on-site visits, not landlord surveys. In 2013, interviews were conducted, but in 2014, the previous year's 17% free-ridership rate was reused due to the absence of on-site visits.
3.3.2 NTGR Calculation The NTGR was calculated using the following equation: $$NTGR = (1 - \% \text{ free-ridership})$$ Using the free-ridership established in 2013, the NTGR value has been estimated at 0.83.
AI summary The Net-to-Gross Ratio (NTGR) is calculated as 1 minus the percentage of free-ridership, with a value of 0.83 estimated using the free-ridership data from 2013.
2.2 Net-to-Gross Ratio The net-to-gross ratio (NTGR) evaluation is based on a self-report approach which relies on a series of questions designed to measure the influence of Solar on the participants' decision to install solar heating syst...
AI summary The net-to-gross ratio (NTGR) is calculated using a self-report approach and considers free-ridership, where participants may have installed solar heating systems without the program. A 35% free-ridership rate from a 2013 survey is used, resulting in an NTGR of 0.65.
6.3 Net-to-gross Ratio This section discusses HER web-based component's NTGR evaluation, which included the assessment of the free-ridership level associated with each product category.
AI summary This section evaluates the net-to-gross ratio (NTGR) of the Home Energy Report (HER) web-based component, focusing on the assessment of free-ridership levels for each product category.
6.3.1 Free-ridership In HER's web-based component, free-ridership occurs when participants declare that they would still have implemented the energy-efficient measures in the absence of the program. The free-ridership level of each product...
AI summary Free-ridership in the Home Energy Report (HER) web-based component occurs when participants claim they would have adopted energy-efficient measures regardless of the program. Surveys were used to assess the influence of HER on participants' decisions and calculate the free-ridership level for each product category.
6.3.2 NTGR Calculation The NTGR value of each product category has been established by applying its free-ridership level established and the following equation: NTGR = (1 – % free-ridership) The table below summarizes the results of these...
AI summary The NTGR value for each product category is calculated using the formula NTGR = (1 – % free-ridership), based on the established free-ridership level for each category. A table summarizes the results of these calculations.
Energy Savings To calculate the net savings of the mail-in rebate approach in 2014, the Econoler team reviewed ENSC's estimate of gross savings by analyzing the results of 58 on-site visits and measuring the distortion effects associated w...
AI summary The document discusses the calculation of net savings for the mail-in rebate approach in 2014, using a free-ridership level of 25% and a net-to-gross ratio (NTGR) of 0.75, except for LED tubes with promotional rebates. For the instant rebate approach, the free-ridership level was calculated for three major product categories based on distributor interviews.
Table 1: Distortion Effects and Net-to-gross Ratio 2014 Instant Rebate 2014 Mail-in Rebate LED Outdoor Wallpacks LED Downlights Free-ridership Level 25% 46% 29% 35% NTGR 0.75 0.54 0.71 0.65
AI summary Table 1 presents the free-ridership levels and net-to-gross ratios for various rebate programs in 2014, including the Instant Rebate, Mail-in Rebate, LED Outdoor Wallpacks, and LED Downlights. The data highlights the distortion effects of these programs and the efficiency of rebate distribution.
herefore also recommended to present each of these three variables in a separate column so that they can be easily validated and used to allow energy and demand savings to be automatically calculated. 2014 BER-R5. Be proactive in addressin...
AI summary The text discusses issues with contractor quality in the BER program, leading to reduced savings, and recommends re-evaluating product offerings due to market changes and increased free-ridership. It highlights the need for improved contractor oversight and alignment with current market practices.
2.2.2 Interviews with Distributors In November and December 2014, eight interviews were conducted by CRA with the participating distributors for BER Instant Rebates. These interviews were mainly used to establish free-ridership levels by e...
AI summary In November and December 2014, CRA conducted eight interviews with distributors for the BER Instant Rebates program to assess free-ridership levels and distributor satisfaction with the program. The interview guide is referenced in Appendix II.
For the quarterly surveys, four series of interviews with a total of 68 participants were conducted in four periods in April, July, October and December 2014, using CATI technology. Such surveys were conducted to shorten the time gap betwe...
AI summary Quarterly surveys were conducted in 2014 using CATI technology with 68 participants across four periods to gather feedback on the BER Mail-in program, focusing on free-ridership and satisfaction. The surveys aimed to reduce the time gap between program participation and evaluation. Results and questionnaires are detailed in appendices, along with population and sample sizes and margin of error at a 90% confidence level.
hat is the sum of all of the measure's savings for the entire project. The Evaluator recommends always using a formula to link the total savings value to the measure's savings value to avoid mistakes. The Evaluator also saw a great improve...
AI summary The Evaluator highlights improvements in the quality of information in the tracking system, noting a higher percentage of complete free ridership responses. However, issues remain with the lack of existing equipment data in ECM and lighting worksheets, which affects the accuracy of impact evaluations.
5 IMPACT EVALUATION FOR BER MAIL-IN The objective of the 2014 impact evaluation for BER Mail-in was to determine the gross and net energy savings. Both electrical energy and peak demand savings were estimated by analyzing the following par...
AI summary The 2014 impact evaluation for BER Mail-in aimed to assess gross and net energy savings by analyzing parameters such as installation rates, equipment features, and load factors. Interactive effects were considered for lighting measures but not for others. Adjustments and diversity factors were established based on documentation and on-site visits.
5.2.1 Free-ridership In the case of BER Mail-in, free-ridership can occur when participants would have still implemented the energy efficiency upgrades and measures in the absence of the program. The free-ridership level was measured throu...
AI summary The BER Mail-in program's free-ridership level was measured at 25% in 2014, an increase from previous years. This increase is attributed to the removal of ECM projects from the sample and the increased proportion of lighting measures, which have higher free-ridership rates. LED tubes with promotional rebates were excluded from the sample and considered to have nil free-ridership.
5.2.2 NTGR Calculation The NTGR is calculated using the following equation: $$NTGR = (1 - \% free-ridership)$$ Using the free-ridership level established for BER Mail-in, the NTGR value is estimated at 0.75, with the exception of promotion...
AI summary The NTGR is calculated using the formula (1 - % free-ridership). For BER Mail-in, the NTGR is estimated at 0.75, except for promotional rebates LED tubes, where it is 1.00.
6 IMPACT EVALUATION FOR BER INSTANT REBATES The objective of the 2014 impact evaluation for BER Instant Rebates was to determine the gross and net energy savings. Both electrical energy and demand savings were estimated by analyzing the fo...
AI summary The 2014 impact evaluation for BER Instant Rebates aimed to assess gross and net energy savings, considering factors such as savings calculation methodology, diversity factor, interactive effects, and free-ridership for both electrical energy and demand savings.
6.3.1 Free-ridership For BER Instant Rebates, free-ridership corresponds to the natural market trend. Thus, the free-ridership assessment aims to estimate what would have been the sales of energy-efficient products in a market that evolves...
AI summary This section discusses the free-ridership assessment for BER Instant Rebates, estimating how much of the energy-efficient product sales would have occurred naturally without the program. The assessment used in-depth interviews with distributors and targeted three specific products, revealing increasing free-ridership levels from 2012 to 2014.
6.3.2 NTGR Calculation The NTGR is calculated using the following equation: NTGR = (1 – % free-ridership) Using the free-ridership levels established for BER Instant Rebates, the NTGR established for each product included in the analysis:
AI summary The NTGR is calculated using the equation NTGR = (1 – % free-ridership), based on free-ridership levels established for BER Instant Rebates, and applied to each product included in the analysis.
This Appendix summarizes all the recommendations made by the Evaluator throughout this report as well as the sections from which the recommendations originated. Sections Recommendations 6 Re-assess the product offerings to consider the bas...
AI summary The Evaluator recommends re-assessing product offerings in the BER program due to increased free-ridership levels, indicating that some rebated products may no longer be significantly more efficient than current market practices. This is attributed to rapid changes in the lighting market, including falling technology prices and new regulations.
APPENDIX VIII ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity, eff...
AI summary This appendix outlines an algorithm for calculating free-ridership levels based on participant survey data. The survey assessed various aspects of a program, including planning, quantity, efficiency, cost, and influence, which were used to determine the level of program attribution and associated free-ridership.
Table 1: Distortion Effects and Net-to-Gross Ratio for Custom Retrofit 2014 Free-Ridership Level 10% Spillover Level 0% Net-to-Gross Ratio 0.90 Project No. 5870 viii
AI summary Table 1 presents the distortion effects and net-to-gross ratio for a custom retrofit in 2014, including a free-ridership level of 10% and a net-to-gross ratio of 0.90. This data is associated with Project No. 5870.
Project Summary The Project Summary tab of the DSMDS contains all the relevant information required for a quick overview of any Customer Retrofit project. Information within this tab includes the project information, notes, milestone dates...
AI summary The Project Summary tab in the DSMDS includes key information for Customer Retrofit projects, such as project details, budget, savings summaries, and client contact data. ENSC added a section to document free-ridership screening and facility details, improving data management and enabling future program adjustments.
5.2.1 Free-ridership In the case of Custom Retrofit, free-ridership can occur when participants would have still implemented the energy efficiency upgrades and measures in the absence of the program. The freeridership level was measured th...
AI summary Free-ridership in Custom Retrofit programs was measured through participant surveys, with an overall level of 10 percent in 2014, slightly higher than previous years. The calculation used an algorithm detailed in Appendix IV, and adjustments were made for participants who completed pre-screening questions.
5.2.3 NTGR Calculation The NTGR was calculated using the following equation: NTGR = (1 – % free-ridership + % internal spillover). Using the free-ridership and spillover levels established for Custom Retrofit, the NTGR value was estimated...
AI summary The NTGR was calculated using the equation NTGR = (1 – % free-ridership + % internal spillover), with an estimated value of 0.90 based on free-ridership and spillover levels established for Custom Retrofit.
This Appendix presents all recommendations made by the Evaluator throughout the report as well as the sections from which the recommendations originated. Sections Recommendations 2 Improve the information presented in the DSMDS reports. Th...
AI summary The Evaluator recommends improving the DSMDS reports by adding details such as line loss factor, rate code, verified savings at the meter, and free-ridership screening results. It also suggests including both total and current-year savings for better sample selection and adding unique identification codes for ongoing M&V adjustments.
APPENDIX IV ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity, effic...
AI summary This appendix outlines an algorithm for calculating free-ridership levels in energy efficiency programs. It uses survey responses to assess the likelihood that participants would have implemented energy efficiency measures without the program. The algorithm includes questions like FR2a and FR2b, which are used to quantify the program's influence on energy efficiency decisions.
(PA1 ; PA2 ; PA3 ; PA4) Inconsistency Test #1 IF ABS(FR2a – FR2b) ≥ 30%: PA1 = MIN OF (FR2a ; FR2b) Inconsistency Test #2 IF FR3 ≥ 70% AND IF (FR2a OR FR2b < 70%: PA2 = EMPTY Revised Free-Ridership MEAN VALUE OF: (PA1 ; PA2 ; PA3 ; PA4)
AI summary The text outlines two inconsistency tests related to free-ridership calculations, defining conditions under which values are assigned or left empty, and references a mean value calculation involving multiple parameters.
2.2.1 Project File, On-site Visits and Interviews In October and November 2014, nine on-site visits and full project technical documentation reviews were conducted by Equilibrium at facilities that had participated in Custom NC. These site...
AI summary In October and November 2014, Equilibrium conducted nine on-site visits and technical reviews at facilities that participated in Custom NC. These visits aimed to validate energy-efficient equipment specifications, collect facility information, and gather data on free-ridership through in-depth interviews.
Project Summary The Project Summary tab of the DSMDS contains all of the relevant information required for a quick overview of any Customer NC project. Information within this tab includes the project information, notes, milestone dates, p...
AI summary The Project Summary tab in the DSMDS provides an overview of Customer NC projects, including budget, savings, and contact information. ENSC added sections for free-ridership screening and facility details to improve data collection and program offerings.
4 IMPACT EVALUATION The objective of the 2014 Custom NC impact evaluation was to determine the gross and net savings. Both electrical energy and peak demand savings were estimated by analyzing the following: - › Feasibility studies, buildi...
AI summary The 2014 Custom NC impact evaluation aimed to assess gross and net savings from energy efficiency measures, analyzing feasibility studies, energy model simulations, M&V reports, interviews, billing calibration results, and free-ridership data. The evaluation involved reviewing nine project files, on-site visits, and participant interviews.
APPENDIX III ON-SITE VISIT SAMPLING AND PROTOCOL The 2014 Custom NC impact evaluation was mandated to conduct on-site visits, including an assessment of the free-ridership levels. The sampling methodology is presented in the following sect...
AI summary The 2014 Custom NC impact evaluation required on-site visits to assess free-ridership levels. The sampling methodology and on-site visit protocol are detailed in this appendix.
n site. These files typically included items such as the initial energy model results, M&V reports, the Project Development Agreement (PDA), email correspondence and equipment drawings/specifications. The Evaluator used the provided inform...
AI summary The evaluation process involved reviewing project documents, conducting on-site verification, and using free-ridership questionnaires to assess the impact of funding on energy efficiency improvements in Custom NC participants. The process followed ASHRAE guidelines and included interviews and data collection.
On-Site Visit Protocol 7. On-Site Observations and Findings Report the on-site visit and indicate the key observations and findings made on site. 8. Free-Ridership Assessment Free Ridership Questionnaire Completed? (Y/N) 9. Energy and Dema...
AI summary The document outlines an on-site visit protocol, including sections for reporting observations, free-ridership assessment, energy and demand savings adjustments, and additional notes. It includes placeholders for data such as energy savings, demand savings, and diversity factors used by Efficiency Nova Scotia Corporation (ENSC) and Econoler.
Energy Savings The 2014 impact evaluation of BES was divided into four categories: BES lighting measures, BES non-lighting measures, measures implemented in RP&C common areas and measures implemented through the LED Blitz pilot. To calcula...
AI summary The 2014 impact evaluation of the Business Energy Solutions (BES) program categorized energy savings into lighting, non-lighting, and common area measures. The evaluation used on-site visits and surveys to estimate savings and account for free-ridership and spillover effects, with a 17% free-ridership rate and 0.3% spillover for BES, and 17% free-ridership for RP&C common area measures. The LED Blitz pilot assumed a net-to-gross ratio of 1.
Table 1: Distortion Effects and Net-to-Gross Ratio BES RP&C Common Area LED Blitz Free-ridership Level 17% 17% - Spillover Level 0.3% - - Net-to-Gross Ratio 0.83 0.83 1.00
AI summary Table 1 presents the distortion effects and net-to-gross ratios for different programs, including BES, RP&C Common Area, and LED Blitz. The free-ridership level is 17% for both BES and RP&C Common Area, while the net-to-gross ratio is 0.83 for BES and RP&C Common Area, and 1.00 for LED Blitz.
Quarterly Surveys For the quarterly surveys, four rounds of interviews with a total of 129 participants were conducted in April, July, October and December 2014, using CATI technology. These surveys were conducted to shorten the time perio...
AI summary Quarterly surveys were conducted in 2014 with 129 participants to evaluate the BES program and understand free-ridership and satisfaction levels. Surveys averaged 9 minutes and were conducted using CATI technology. Results are detailed in Appendix V and VI, with population and sample size data provided in a table.
5 IMPACT EVALUATION The objective of the 2014 BES impact evaluation is to determine the gross and net energy savings associated with the measures implemented through BES, including the BES lighting and non-lighting measures, as well as mea...
AI summary The 2014 BES impact evaluation assesses energy savings from lighting and non-lighting measures, as well as common area and LED Blitz initiatives. It considers factors like unitary savings, installation rates, diversity factors, and free-ridership. Data from on-site visits, surveys, and previous evaluations are used to calculate net-to-gross ratios for the programs.
Free-ridership In the case of BES, free-ridership can occur when participants would have still implemented the energy efficiency measures in the absence of the program. The free-ridership level was measured through the quarterly surveys on...
AI summary The free-ridership level for BES was measured at 17 percent through quarterly surveys on a sample of 129 participants, using an algorithm consistent with previous evaluations. This level is similar to recent years but slightly higher than the 12.8 percent recorded in 2011.
NTGR Calculation The NTGR for BES has been calculated using the following equation: NTGR = (1 – % free-ridership + % internal spillover). Using the free-ridership and spillover levels established for BES, the NTGR value is estimated at 0.8...
AI summary The NTGR for BES is calculated using the formula (1 – % free-ridership + % internal spillover), resulting in an estimated value of 0.83 based on established free-ridership and spillover levels.
5.5.2 Net-to-Gross Ratio for RP&C Common Areas To determine the NTGR for RP&C Common Areas, one distortion effect was assessed, namely free-ridership.
AI summary The document discusses the assessment of a distortion effect called free-ridership in determining the Net-to-Gross Ratio for RP&C Common Areas.
Free-Ridership (Series FR) The following questions will be about the free initial assessment and the energy-efficient products that were installed at a low cost through the Business Energy Solutions program. - FR1. BEFORE participating in...
AI summary The text outlines a set of questions related to free-ridership in the Business Energy Solutions program, focusing on whether participants had prior plans to install energy-efficient products and assessing the likelihood of taking similar actions without the program's incentives.
APPENDIX VII ALGORITHM FOR FREE-RIDERSHIP CALCULATION (BES) The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity...
AI summary This appendix outlines an algorithm used to calculate free-ridership levels in the BES program by assessing participants' responses to survey questions. The algorithm considers factors such as likelihood of purchasing energy-efficient products without the program, influence of the program, and timing of installations.
APPENDIX IX ALGORITHM FOR FREE-RIDERSHIP CALCULATION (RP&C) The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity...
AI summary This appendix outlines an algorithm for calculating free-ridership levels in a program. The algorithm uses data collected from participant surveys, which assess various aspects of the program, including planning, quantity, efficiency, period, cost, and influence. These data points are used to determine the level of program attribution and, subsequently, the free-ridership level for each participant.
FR2a. If your company had not participated in RP&C, what is the likelihood that you would have installed exactly the same energy-efficient products that you installed through RP&C? (Scale 0 to 10) FR2a = Answer x 10% FR2b. If your company...
AI summary The document outlines a scoring methodology used to assess free-ridership in a program, using responses to questions about energy-efficient product installation and participation in the RP&C program. It includes formulas to calculate scores based on participant responses.