Topic:"Free Ridership Measurement" in M04819

Responsibility and accountability for the administration of DSM programs were transferred from Nova Scotia Power Inc. (NSPI) to ENSC effective October 1, 2010, with transfer of operational activities phased in during the fall of 2010. The...

AI summary Responsibility for DSM programs was transferred from NSPI to ENSC in 2010. ENSC submitted its first DSM Plan in 2011, which was approved by the UARB. ENSC also filed several reports and methodologies in response to UARB orders, including a free ridership and spillover study.

Responsibility and accountability for the administration of DSM programs were transferred from Nova Scotia Power Inc. (NSPI) to ENSC effective October 1, 2010, with transfer of operational activities phased in during the fall of 2010. The...

AI summary Responsibility for DSM programs was transferred from NSPI to ENSC in 2010. ENSC submitted its first DSM Plan in 2011, which was approved by the UARB. ENSC also filed responses and reports in accordance with UARB orders, including a free ridership and spillover study.

LIST OF TABLES Table 1: Type(s) of Evaluation Conducted per Program ....................................................................... 1 Table 2: 2011 Savings Targets, Tracked Savings and Evaluated Results for Each Program ..............

AI summary The document lists tables related to program evaluations, savings targets, performance metrics, free-ridership analysis, and recommendations for energy efficiency programs. It outlines data tracking, evaluation methodologies, and general recommendations for specific initiatives like appliance retirement and low-income renter programs.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary Retail Markdown Program In the case of the RMP, the net evaluated savings fell short of those tracked by ENSC by 23 percent. The main element that explains this result i...

AI summary The Retail Markdown Program (RMP) and Low Income Renter Program (LIR) evaluations showed net savings below tracked figures due to methodological adjustments, replacement ratios, and free-ridership. RMP savings were 23% lower, linked to NTGR discrepancies and reduced promotion awareness. LIR savings were 7% lower, influenced by interactive effects and updated line loss factors.

he interactive effects factor applied to the gross savings and by the difference between the NTGR calculated for the SLC program (0.81) and the one used in the tracked savings (0.84). Custom Program The evaluated net energy savings of the...

AI summary The evaluation compares tracked and evaluated savings for DSM programs. Custom Program (C&IC/CINC) showed 1% higher net energy savings due to improved free-ridership screening. SBES program had 11% lower net savings, attributed to interactive effects factors and NTGR discrepancies. Econoler adjusted diversity factors, increasing demand savings estimates.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary 2.2.4 Participant Surveys A total of 761 interviews with 2011 program participants and 70 interviews with non-participants (Table 7) were completed for this evaluation....

AI summary The 2011 evaluation of Efficiency Nova Scotia Corporation programs involved 761 participant and 70 non-participant interviews, assessing satisfaction, program effectiveness, free-ridership, and barriers. Surveys were conducted via CATI and RDD between September-December 2011 to evaluate program impacts and gather improvement recommendations.

proach could be put in place. Following this evaluation, discussions should be held with ENSC to clearly define where a dual baseline is realistic and how it can be implemented for future evaluations. For all programs, interactive effects...

AI summary The evaluation of ENSC's programs uses a self-report method to estimate free-ridership, incorporating enhancements such as a 0 to 10 scoring system and a more comprehensive consideration of factors influencing energy efficiency decisions. This approach aligns with methods used in other jurisdictions and follows discussions from a PDWG meeting.

In addition, this approach is in line with one of the many methodologies to estimating free-ridership that were discussed at a PDWG meeting held in May 2010 for developing a Nova Scotia NTGR protocol. The table below summarizes the free-ri...

AI summary The text discusses the estimation of free-ridership levels using methodologies from a PDWG meeting in May 2010, which were used to develop a Nova Scotia NTGR protocol. A table is referenced summarizing free-ridership levels from 2010 and 2011 evaluations.

Nova Scotia Corporation ECONOL:R Overall Executive Summary Table 8: Free-Ridership Levels

AI summary The text references Table 8, which outlines free-ridership levels. However, no specific details or discussions about free-ridership are provided in the text.

Free-Ridership Levels Program 2010 2011 Refrigerators 31% 20% Freezers 18% 26% ARet Dehumidifiers 47% 21% Room AC units 0% ARep Regular CFLs 78% RMP Refrigerators 72% 17% Clothes Washers 85% 53% LIR MURR 17% EP-DI 17.5% 15.4% EEH 24% 31% F...

AI summary The document presents free-ridership levels for various energy efficiency programs in Nova Scotia for the years 2010 and 2011. It shows the percentage of participants who did not directly benefit from the programs but still received benefits, with significant variations across different program categories.

g and advertising are optimal. It would inform customers of the existence of the program and guide them towards eligible products, which in turn should reduce the free-ridership level. RMP-R2. Consider conducting exit surveys: The challeng...

AI summary The text discusses strategies to improve program awareness and reduce free-ridership, including advertising and exit surveys. Exit surveys are suggested as a more effective method to assess program impact by interviewing participants immediately after purchase, improving recall and data accuracy.

on the use of power bars with integrated timer. This strategy could help participants use the product correctly as they would be aware of all its advantages. Ref.: 5725 31 Evaluation of 2011 DSM Programs Efficiency Nova Scotia Corporation...

AI summary The text discusses the importance of targeting multi-unit renters with energy efficiency programs, as they are less likely to install energy-efficient products due to not owning the property or being responsible for electricity bills. The low level of free-ridership indicates the program's effectiveness in encouraging participation.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary Survey results showed that half of the participants had learned about the Fuel Substitution Pilot at the store where they purchased their new equipment. This finding exp...

AI summary Survey results indicate that 50% of participants learned about the Fuel Substitution Pilot at the store where they purchased equipment, contributing to a 42% free-ridership level. Greater promotion and partnerships with retailers are recommended to improve program reach and effectiveness.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary Fuel-R4. Conduct a billing analysis in order to evaluate energy consumption for heating: A billing analysis would provide a more precise evaluation of the energy consump...

AI summary The document discusses the importance of conducting a billing analysis to evaluate heating energy consumption and improve energy savings calculations. It also suggests continuing to target participants for natural gas system installations to reduce free-ridership and increase program effectiveness.

Programs Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary SBES-R4. Revise the list of products eligible for an incentive through the SBES program: Restricting eligibility to high-end products like LED lamps or high- pe...

AI summary The document discusses revising the SBES program to restrict eligibility to high-end energy-efficient products in order to reduce free-ridership. It also references an evaluation of energy efficiency projects at New Page paper mill, conducted as part of the 2011 ENSC program evaluation.

ir satisfaction with the program. Moreover, almost all participants (98%) reported that they would recommend the ARet program to a friend or family member, which is a strong indicator of satisfaction. The program partners interviewed were...

AI summary The Appliance Retirement (ARet) program received high satisfaction ratings from participants, with 98% willing to recommend it. Program partners were also satisfied, though a transport contractor suggested improving the tracking system for appliance units. The program's net savings were calculated by Econoler, taking into account free-ridership and internal spillover effects, resulting in a 22% free-ridership level.

on. To do so, Econoler reviewed the following parameters: > adjusted unitary savings; > energy-to-demand ratio; > interactive effects; > free-ridership; and > spillover. The review of the unitary savings calculations is mainly based on the...

AI summary The document discusses the evaluation of the Efficient Products – Appliance Retirement Program in 2011, focusing on parameters like unitary savings, free-ridership, and spillover effects. It also describes the sampling methodology for on-site visits and the types of appliances retired, with refrigerators being the most common.

NTGR = (1 – % free-ridership + % spillover) 20 RETScreen, Climatic Data for Halifax International Airport. 21 From the socket study conducted by CRA with 1,004 households of Nova Scotia. Ref.: 5725 50 Efficient Products – Appliance Retirem...

AI summary The free-ridership level for the Efficient Products – Appliance Retirement Program was measured through participant surveys, assessing factors such as prior disposal intentions, alternative disposal methods, and the influence of the program on appliance retirement decisions. The survey excluded room air conditioners due to low participation numbers.

he small number of participants for this appliance compared to the three other appliances. Since that type of appliance was new in the program in 2011, its free-ridership level was assumed to be null. Each question was transposed into a le...

AI summary The document discusses the calculation of free-ridership levels for different appliance categories in the Appliance Retirement Program. It explains that free-ridership was assumed to be null for a new appliance type in 2011, and that an average free-ridership level of 22% was calculated based on energy savings proportions. A 0% free-ridership level is applied to appliances retired through in-store weekend events.

rmation on the model, such as the capacity and the age of manufacture, and information on usage patterns by asking the participants during which seasons they operate their appliances and for how long. The NTGR was evaluated at 0.79 for the...

AI summary The evaluation of the Appliance Retirement Program discusses the Net Total Gross Replacement (NTGR) rates for appliances retired through the program and in-store events, as well as the assessment of free-ridership and interactive effects on home energy consumption. The NTGR was slightly higher than previously used, and free-ridership was estimated at 1 percent.

he other program or calculate the net savings in this program? Q: If it is replaced by another unit not part of any other of your program do you still calculate the savings as if it was not replaced? C: Saturation - The cream skimming phen...

AI summary The text discusses questions and responses related to the Appliance Retirement Program by Efficiency Nova Scotia Corporation, including eligibility criteria, verification methods, program separation, and issues like free ridership and cream skimming. It also references evaluation reports and program logic models.

s concerning relatively high free ridership levels? Q: What is the status regarding the recommendation to screen the free-ridership? C: Cream skimming could look like a lot of free riders. Page 51 ARR-R12 Q: what is the status about this r...

AI summary The text discusses questions and comments regarding free ridership levels, communication issues among multiple organizations, and the evaluation of the Appliance Retirement Program. It also raises inquiries about data sources, distortion effects, barriers to appliance retirement, and the evaluation processes used.

s there a process flow chart for that program? The web site explains all the steps but there is no illustration. Q: was there an evaluation plan associated to that program when it was first designed? Q: Nowhere do we see the role of the de...

AI summary The document includes a series of questions and comments related to the evaluation and implementation of the Efficient Products – Appliance Retirement Program by Efficiency Nova Scotia Corporation. Questions focus on program design, evaluation plans, delivery processes, and barriers to customer participation.

Number not replaced at all: Article I. Dehumidifier Usage (site contact declaration) Number of months per year plugged in: Number of hours per day in operation: New Dehumidifier Information (on-site observation or on manufacturer’s website...

AI summary This document outlines the algorithm for calculating free-ridership in the Appliance Retirement (ARet) program. It includes a survey question (FR1) to determine if participants had already considered disposing of their refrigerator before learning about the program, with a scoring system based on their response.

= MAX(a; b; c) Factors a, b and c = Program factors PA3 Score: (10 - FR4_P) x 10% FR4. [Ask if FR3 = 10] How soon would you have disposed of your old appliance? IF 1. : FR4 = EMPTY 1. Within a year of when the program took it IF 2. : FR4 =...

AI summary The document describes a free-ridership calculation process for the Appliance Retirement Program, including a test for inconsistencies in participant responses. If the difference between FR5 and FR7 is 30% or more, PA2 is adjusted to the smaller of the two values.

FR5 – FR7) ≥ 30%. In that case, the participant’s answers to FR5 and FR7 represented an inconsistency and PA2 became equal to the smallest value between FR5 and FR7. Otherwise, PA2 remained unchanged. Finally, the average free-ridership le...

AI summary The document discusses the calculation of free-ridership levels in an energy efficiency program, considering participant responses and energy savings. It also references an evaluation report on an appliance replacement program conducted by Efficiency Nova Scotia Corporation in 2011.

visit the stores before the markdown periods to assist the staff in the preparation to launch the program by making sure that all marketing tools are well installed. This Ref.: 5725 x Efficient Products – Retail Markdown Program Efficiency...

AI summary The text discusses the importance of preparing stores before markdown periods to ensure effective marketing of the Retail Markdown Program by Efficiency Nova Scotia Corporation, aiming to reduce free-ridership.

rtising are optimal. It would inform customers of the existence of the program and guide them towards eligible products, which in turn should reduce the free-ridership level. RMP-R2. Consider conducting exit surveys: The challenge of the E...

AI summary The text discusses strategies to improve the effectiveness of a program by informing customers about its existence and guiding them toward eligible products, which can reduce free-ridership. It also suggests conducting exit surveys to better assess program impact and participant awareness.

Efficiency Nova Scotia Corporation 2011 Evaluation Report > Consider conducting exit surveys: The challenge of the Evaluator for such a program lies in the fact that participants are unknown and it is necessary to survey a large number of...

AI summary The report suggests conducting exit surveys to better monitor program influence and upgrading eligible discounted appliances to reduce free-ridership. It also discusses outreach and marketing efforts, including the ENSC website and on-site visits.

vity. This section presents the methodology used to transform information obtained through survey and interview questions into a NTGR. For the RMP, the NTGR includes the assessment of two distortion Ref.: 5725 53 Efficient Products – Retai...

AI summary This section outlines the methodology for calculating the Net Total Gross Reduction (NTGR) for the Retail Markdown Program (RMP) by assessing free-ridership and spillover effects. It includes survey-based questions to evaluate participant behavior related to purchasing Compact Fluorescent Lamps (CFLs) under discounts.

d into a level of program attribution which is used to calculate the global free-ridership level for each participant and retailer. The algorithm behind this calculation is presented in Appendix VIII. Econoler’s approach is consistent with...

AI summary The evaluation of the Retail Markdown Program (RMP) by Econoler uses a 0 to 10 scoring system to assess free-ridership levels, revealing that 78% of participants did not benefit from the program's discount due to poor visibility of the offer. This highlights challenges in program awareness and effectiveness.

Efficiency Nova Scotia Corporation 2011 Evaluation Report finding out about the discount or only once they were at the cash register for payment, making it difficult to associate the program influence with their decision to purchase CFLs....

AI summary The evaluation report discusses the free-ridership level for CFLs, finding that only about 10% of sales during markdown periods were due to the program. It also notes a change in methodology this year, separating free-ridership from spillover effects. For refrigerators and clothes washers, the approach involved in-depth interviews with retailers due to the small buyer population.

t difficult to reach them using a general population telephone survey, the free-ridership level was measured through in-depth interviews with retailers. To do so, the retailers were asked to estimate: > the program influence on their custo...

AI summary The free-ridership level for ENERGY STAR appliances was measured through retailer interviews, showing a significant decrease from 2010 levels. This reduction is attributed to the program's shift to higher efficiency standards (CEE Tier 3) and changes in evaluation methodology.

r the same period of the year. This type of comparison was not possible in 2011 since more than a year was separating the introduction of the appliance component in the RMP and the evaluation period. Ref.: 5725 55 Efficient Products – Reta...

AI summary The evaluation report discusses free-ridership and spillover effects in the Retail Markdown Program (RMP) in 2011. It notes higher free-ridership for clothes washers than refrigerators and explains that spillover effects occur due to increased awareness and changes in retailer offers, even when customers are unaware of the discount.

onsumers to find an adequate sample of participants. Even then, a portion of these participants may be unaware or have forgotten that there was a discount in their purchase, making the mass survey an imprecise tool for monitoring the marke...

AI summary The text discusses the use of exit surveys to improve the accuracy of monitoring program participation and reduce free-ridership by interviewing buyers immediately after purchase. It also suggests upgrading eligible discounted appliances to lower free-ridership, though this may result in lower gross savings due to a dynamic baseline.

he rationale behind the two short periods? Page 10 Q: Who provide the associate training? Q: The delivery agent? Is the same as the implementation contractor? If yes why do we use different names? C: The socket study is a very good initiat...

AI summary The text contains a series of questions and comments from a regulatory proceeding related to the Retail Markdown Program (RMP) and Efficiency Nova Scotia Corporation's 2011 evaluation report. Topics include program activities, customer service, data tracking, evaluation methods, and potential program distortions.

AR logo mean? (Ask only if the ENERGY STAR logo is displayed.) 6. Could you tell me how these products (products eligible for the instant discount) differ from other products sold in your store? Ref.: 5725 128 Efficient Products – Retail M...

AI summary The text discusses a free-ridership calculation algorithm for the Retail Markdown Program (RMP), which evaluates participant responses to determine the extent to which they would have purchased energy-efficient products (CFLs) without the program's discount.

swer) x 10% to purchase the CFLs you purchased this year? (Scale 0 to 10) PA4 Score: FR7 MEAN VALUE OF : Final Free-Ridership (PA1 ; PA2 ; PA3 ; PA4) Ref.: 5725 129 Efficient Products – Retail Markdown Program Efficiency Nova Scotia Corpor...

AI summary The document discusses the calculation of free-ridership levels in the Efficient Products – Retail Markdown Program, including an inconsistency test applied to participant responses and the use of weighted averages to determine the program's average free-ridership level.

r is the component of the power bar responsible for the energy savings generated. This observation has resulted in a low installation rate for power bars with integrated timer. Program Energy Savings To calculate the net savings of the MUR...

AI summary The MURR program's energy savings were evaluated, revealing a 17% free-ridership level and a net-to-gross ratio of 0.83 in 2011. The evaluation considered installation rates, interactive effects, and participant intentions, showing that most participants would not have installed energy-efficient products without the program.

mitment and involvement required from the tenants. This would prevent losing tenants who would have showed up to the events but did not because the information was confusing. MURR-R2. Improve measure sustainability: The on-site visits reve...

AI summary The text discusses the importance of tenant engagement and information provision in energy efficiency programs for multi-unit renters. It highlights the need for continued outreach, improved product usage education, and program sustainability to ensure long-term energy savings and participant satisfaction.

zed computer-assisted telephone interviewing (CATI). The average length of the survey was 12 minutes. The participant survey was used to gain a better understanding of the following program features: > spillover and free-ridership; > parti...

AI summary The survey aimed to understand program features such as spillover, free-ridership, participant motivations, and satisfaction with the Efficient Products – Multi-Unit Residential Renter Program. The 2011 survey had a population of 92 participants and a sample size of 30, with a sampling error of ±14.2% at the 90% confidence level.

to estimate the installation rate for each category of products. Finally, the participant survey was used to estimate the free ridership ratio and evaluate if the program had generated spillover. Ref.: 5725 17 Efficient Products – Multi-Un...

AI summary The evaluation report discusses the Efficient Products – Multi-Unit Residential Renter Program, including the installation of energy-efficient products and the use of participant surveys to estimate free ridership and spillover effects. Five on-site visits were conducted in 2011 to assess program implementation.

was transposed into a level of program attribution which is used to calculate the global free-ridership level for each participant. The algorithm behind this calculation is presented in Appendix VIII. Econoler’s approach to estimating free...

AI summary The text discusses the estimation of free-ridership in the Efficient Products – Multi-Unit Residential Renter Program using a scoring system and survey results, which indicate a 17% free-ridership level among participants. The approach aligns with methods used in other jurisdictions.

that the MURR program was new this year and was targeting multi-unit renters, which often represent customers that are less interested in energy efficiency, explains this low level of free-ridership. This result is in line with the survey...

AI summary The MURR program targets multi-unit renters, a group less likely to engage in energy efficiency. Survey results show that the program's free installation of energy-efficient products was a key factor in participation, with low free-ridership (17%). Internal spillover effects were also observed, as participants were influenced to purchase more energy-efficient products after program involvement.

E VERIFIED IN V3 AND V4, RESPONDENT WILL ANSWER ABOUT THIS UNIQUE MEASURE ONLY.) FREE-RIDERSHIP [FR series] The next questions will be about the [MEASURE 1] you had installed through the program. FR1M1. Did you or anyone in your household...

AI summary The text contains survey questions related to free-ridership in the context of the Multi-Unit Residential Program, asking participants if they had prior plans to install a specific measure and assessing the likelihood of taking action without the program.

Efficiency Nova Scotia Corporation 2011 Evaluation Report APPENDIX VIII - ALGORITHM FOR FREE-RIDERSHIP CALCULATION The following algorithm describes the free-ridership calculation for the Efficient Products – Multi-Unit Residential Renter...

AI summary This section of the 2011 Evaluation Report by Efficiency Nova Scotia Corporation outlines an algorithm used to calculate free-ridership for the Efficient Products – Multi-Unit Residential Renter program, including steps for inconsistency testing and final free-ridership level calculation.

savings calculation methodology for each type of product; > hours of operation; > installation rate; > interactive effects; > free-ridership; and > internal spillover. The impact evaluation was based on a review of the program tracking she...

AI summary The evaluation of the program's savings calculation methodology included on-site visits and participant surveys to assess installation rates, hours of operation, interactive effects, free-ridership, and internal spillover. Data collected was used to determine a unitary savings value for eligible products and to calculate the net-to-gross ratio (NTGR), which accounts for free-ridership and internal spillover.

hat they would still have purchased the efficient products in the absence of the program. The telephone survey included four free-ridership questions divided into four groups that attempted to assess: > if participant had any plans to inst...

AI summary The document discusses the methodology used to assess free-ridership in the EP-DI program through a telephone survey that includes questions about participant behavior and program influence. Econoler's approach is aligned with methods used in other jurisdictions and includes a 0 to 10 scoring system for evaluation.

previously used to estimate the free-ridership level of the program were preserved in Econoler’s approach. However, the enhancement below was incorporated by using: > A 0 to 10 scoring system. Ref.: 5725 49 Efficient Products – Direct Inst...

AI summary The 2011 evaluation report for the Efficient Products – Direct Install Program discusses the free-ridership level, measured at 15.4 percent, and the use of a 0 to 10 scoring system to assess the influence of various factors on customer decision-making. The report also examines internal spillover effects by asking participants if they purchased additional energy-efficient products after program participation.

3. Small Business Lighting Solution 4. Efficient Lighting Products Direct Install Program 5. Direct Install Program. Q: Care to explain why all these changes? Page I Q: When they mention changes in the free-riders calculations, do they mea...

AI summary The text discusses questions and comments regarding the Efficient Products – Direct Install Program, including free-ridership calculations, the status of recommendations, and concerns about the program's design and effectiveness in the small business sector. It also raises questions about the logic model and the accuracy of savings calculations.

way) 4. (Installed them at another location) 96. (Other [Specify _) 98. (Don’t know/Don’t recall) 99. (Refused) Section FR. Free-ridership (FOR SECTION FR REPEAT FOR UP TO TWO MEASURES VERIFIED IN VA1-VA3.) The next questions will be about...

AI summary This section of the document focuses on evaluating the Direct Install Program by asking participants about their pre-program intentions and likelihood of taking energy efficiency actions without the program's support. It includes questions about free-ridership and measures installed through the program.

UP. IF ‘DON’T KNOW,’ PROBE FOR BEST GUESS TO NARROW IN ON A NUMBER.] [RECORD PERCENT] _% [98 = Don’t know/Don’t recall] ASK the following question if LEDs are installed at this site: P11C. Before participating in the Efficient Products Pro...

AI summary The text outlines a survey methodology for determining free-ridership in the Efficient Products – Direct Install program. It includes questions about the percentage of exit signs using CFLs and a calculation algorithm based on responses to FR questions.

IF 7. : FR2cc = 0% 9. (Don’t know / Refused) IF 9. : FR2cc = 0% FR3. If ENSC had not installed energy-efficient products for free, would IF 1. Yes: FR3 = 100% you have paid the full cost of installing these products? IF 2 OR 9 : FR3 = 0% I...

AI summary The document describes a method for calculating free-ridership levels for participants in the Efficient Products – Direct Install Program, including inconsistency tests applied to the results. It outlines a formula for determining the final free-ridership score based on participant responses.

In that case, the participant’s answers to FR2a and FR2b represented an inconsistency and PA1 became equal to the smallest value between FR2a and FR2b. Otherwise, PA1 remained unchanged. > The second inconsistency test consisted in verifyi...

AI summary The text discusses a method for identifying inconsistencies in participant responses related to free-ridership calculations, adjusting PA1 and PA2 accordingly, and calculating the average free-ridership level using weighted averages based on energy savings.

per energy-efficient product implemented or installed under the pilot projects. These adjustments were made on the basis of national demand-side management (DSM) studies carried out in 2010 and 2011. In its net savings calculations, Econol...

AI summary The evaluation of the EnerGuide for Existing Houses Program found net energy savings of 4.805 GWh and demand savings of 1.543 MW in 2011. Free-ridership was measured at 31%, while spillover effects were very low at 1%, leading to a net-to-gross ratio of 0.70.

is evaluation. To do so, Econoler analyzed the following parameters: > HOT2000 simulations; > prescriptive measure savings; > free-ridership; and > internal spillover. The impact evaluation was essentially based on a comparative analysis o...

AI summary Econoler evaluated the program's impact by analyzing HOT2000 simulations, prescriptive measure savings, free-ridership, and internal spillover. The evaluation involved comparing program tracking sheets, building simulations, and participant surveys to estimate net energy savings and account for free-ridership and internal spillover.

efficiency measures in the absence of the program. The free-ridership level for this program was measured through participant surveys. The questionnaire included six questions that intended to assess: > if participants had any plans to imp...

AI summary The text discusses the measurement of free-ridership in an energy efficiency program using participant surveys. Six questions were used to assess participants' behavior, and the results were used to calculate the program's attribution level. Econoler’s approach preserved key elements of the previous method but included enhancements.

ost important elements of the approach previously used to estimate the free-ridership level of the program were preserved in Econoler’s approach. However, the following enhancements were incorporated: > Introduction of a 0 to 10 scoring sy...

AI summary Econoler's approach to estimating free-ridership in the EnerGuide for Existing Houses Program was enhanced with a 0 to 10 scoring system and broader consideration of decision-making factors. The free-ridership level was found to be 31 percent, slightly higher than the previous year's 24 percent, likely due to the methodological improvements.

nstall Plus). Noteworthy is that the Direct Install Plus evaluated savings were slightly higher than ENSC’s as a result of an increase in unitary savings related to aerator and CFL bulb installations. Another reason to explain the drop in...

AI summary The Direct Install Plus program's evaluated energy savings were slightly higher than ENSC's due to increased unitary savings from aerator and CFL bulb installations. The drop in net energy savings is attributed to interactive effects from energy-efficient lighting and insulation measures. The NTGR decreased from 0.76 to 0.70, influenced by changes in free-ridership evaluation methods. Econoler adjusted ENSC's demand savings calculations, reducing them by over 35%.

h of the following income categories best describes your total annual household income before taxes in 2010? Stop me when I reach the right category. [READ LIST; SELECT ONE RESPONSE] 1. Less than $15,000 2. $15,000 - $24,999 3. $25,000 - $...

AI summary This document includes a survey question about household income and gender, followed by a reference to an evaluation report on the EnerGuide for Existing Houses Program. It outlines an algorithm for calculating free-ridership in the program and mentions inconsistency tests applied to the results.

2011 Evaluation Report Subsequently, the final free-ridership level calculated for each participant was submitted to two inconsistency tests: > The first inconsistency test consisted in verifying if (FR2a - FR2b) ≥ 30%. In that case, the p...

AI summary The 2011 Evaluation Report outlines a methodology for calculating free-ridership levels in a program by applying two inconsistency tests to participant responses. Adjustments are made based on discrepancies between responses, and the final free-ridership level is calculated as a weighted average.

ore they are at the stage of shopping. This aims to influence decision making of homeowners who have not already decided to replace or substitute their electric space heating/DHW system. Satisfaction Satisfaction towards the pilot was very...

AI summary The Fuel Substitution Pilot was highly satisfactory to participants, with no dissatisfaction reported. The program achieved net energy savings of 1.570 GWh and demand savings of 0.785 MW in 2011. A 42% free-ridership level was identified, but no spillover effects were found.

to increase promotion as well as act as a lever to strengthen awareness. However, upstream advertising should also be done in order to influence decision making among Ref.: 5725 vii Fuel Substitution Pilot Efficiency Nova Scotia Corporatio...

AI summary The text discusses the need for improved promotion and awareness strategies to reduce free-ridership in a fuel substitution pilot program. It also highlights the need for better tracking sheets to include project status, system capacities, and heating load information for accurate savings calculation.

information on the heating load provided by a secondary heating source would give a basis for savings adjustment when high usage of a secondary heating source is identified. Fuel-R4. Conduct a billing analysis in order to evaluate energy c...

AI summary The document discusses the Fuel Substitution Pilot program by Efficiency Nova Scotia Corporation, focusing on evaluating energy consumption for heating through billing analysis and targeting participants for natural gas system installations to reduce free-ridership and increase energy savings.

hip level of the Fuel Substitution Pilot is consistent with evaluation, measurement and verification methods used in other jurisdictions such as California, New York, Oregon and Pennsylvania by using: > A 0 to 10 scoring system. > Question...

AI summary The Fuel Substitution Pilot Program's evaluation used a 0 to 10 scoring system to assess free-ridership, finding a 42% free-ridership level. Many participants had already decided to proceed with energy efficiency measures before the program, indicating limited program influence.

t the Fuel Substitution Pilot at the store where they purchased their new equipment. This is an indication that they were already strongly considering a retrofit even before knowing about the program. The sample size for each category, exc...

AI summary The Fuel Substitution Pilot program showed high free-ridership levels for wood and pellet stoves, suggesting eligibility criteria could be improved. Natural gas systems had lower free-ridership. Internal spillover effects were identified for participants who switched from electricity to natural gas, potentially leading to additional electricity savings.

ility) Q: 10th point: about receiving more incentives than the total cost. How do you verify this? And what happens if you have such a case? Rebate Application form: This form needs a revision date. C: The logic model was developed by the...

AI summary The text includes questions about program evaluation, incentive verification, and cost-effectiveness testing. It references a 2011 evaluation report by Efficiency Nova Scotia Corporation and discusses program partners, assumptions about distortion effects, and the use of social cost tests for emission reduction.

Efficiency Nova Scotia Corporation 2011 Evaluation Report APPENDIX VII – ALGORITHM FOR FREE-RIDERSHIP CALCULATION The following algorithm describes the free-ridership calculation for the Fuel Substitution Pilot. For each participant, four...

AI summary This section outlines the algorithm used to calculate free-ridership for the Fuel Substitution Pilot program. It includes steps for testing inconsistencies in participant responses and adjusting free-ridership levels accordingly. The final free-ridership level is determined as a weighted average of adjusted levels based on energy savings.

ship level for the program corresponded to the weighted average of the final adjusted free-ridership levels calculated for each participant with the energy savings associated with each participant. Ref.: 5725 54 160, rue Saint-Paul, bureau...

AI summary The document discusses the evaluation of a low-income program by Efficiency Nova Scotia Corporation in 2011, focusing on the impact and process of the program, including the calculation of free-ridership levels and energy savings associated with participants.

ings evaluation, Econoler finally modified a number of energy savings per prescriptive measure used by ENSC, on the basis of national demand-side management (DSM) studies carried out in 2010 and 2011. In its net savings calculations, Econo...

AI summary The evaluation of the Performance Plus program found that free-ridership levels decreased from 79% in 2010 to 32% in 2011, while spillover effects were not significant. Market effects were estimated at 5%, leading to a net-to-gross ratio of 0.73. The program achieved net energy savings of 2.454 GWh and demand savings of 0.861 MW in 2011.

tion is aimed at determining the gross and net savings of the program for 2011. Both energy and demand savings were considered in this evaluation. To do so, Econoler analyzed the following parameters: > outcomes from HOT2000 simulations pe...

AI summary The evaluation of the Performance Plus program in 2011 considered both energy and demand savings, using data from HOT2000 simulations and the EEH program. Due to complications with obtaining simulation files from NRCan, EEH program savings data was used instead. A participant survey and builder interviews were used to calculate the net-to-gross ratio, including free-ridership, internal spillover, and market effects.

level of efficiency if they had not participated in the program; and > the influence of the program on builders’ decision to build houses reaching an EnerGuide rating of 83 or higher. Each group of questions was transposed into a level of...

AI summary The text discusses the methodology used to estimate free-ridership levels in the Performance Plus Program, including the use of a 0 to 10 scoring system and the consideration of multiple factors influencing energy efficiency decisions, rather than focusing only on program importance.

e complex nature of the real-world decision making and helps ensure that all non-program influences are considered in the free-ridership assessment in addition to program influences. Econoler’s approach is consistent with evaluation, measu...

AI summary The text discusses the evaluation of free-ridership levels in energy efficiency programs, noting a significant decrease from previous years. It mentions a 32% overall free-ridership level, with 37% among homeowners and 23% among builders. The approach used is consistent with methods in other jurisdictions, and improvements in evaluation methods may explain the lower builder free-ridership compared to 2010.

43 70 Male 8 63% 69% Female 2 37 31 Ref.: 5725 Performance Plus Program Efficiency Nova Scotia Corporation 2011 Evaluation Report APPENDIX III - INTERVIEW GUIDE WITH PROGRAM MANAGER Process Evaluation Program Name: Performance Plus (New Ho...

AI summary The text discusses the Performance Plus Program evaluation report from 2011, including interview questions with the program manager regarding the program's status, free-ridership, baseline standards for new construction, and the status of various recommendations.

h of the following income categories best describes your total annual household income before taxes in 2010? Stop me when I reach the right category. [READ LIST; SELECT ONE RESPONSE] 1. Less than $15,000 2. $15,000 - $24,999 3. $25,000 - $...

AI summary The text includes a survey question about household income and gender, followed by a section from an evaluation report on the Performance Plus Program by Efficiency Nova Scotia Corporation, discussing an algorithm for free-ridership calculation and inconsistency tests.

2011 Evaluation Report Subsequently, the final free-ridership level calculated for each participant was submitted to two inconsistency tests: > The first inconsistency test consisted in verifying if (FR2a - FR2b) ≥ 30%. In that case, the p...

AI summary The 2011 Evaluation Report discusses the process of calculating free-ridership levels for participants in the Business Energy Rebates Program. It outlines two inconsistency tests applied to ensure consistency in responses and adjusts free-ridership levels accordingly. The final free-ridership level is determined as a weighted average of adjusted values.

lent communication tool for the program. Word of mouth was also mentioned as an important source of awareness, which should be considered as a strong indicator of program satisfaction. Satisfaction Satisfaction towards the program is high...

AI summary The Business Energy Rebates (BER) program has high participant satisfaction, with many expressing contentment with the program's communication and effectiveness. Recommendations for improvement include better marketing and increased customer interaction. Program energy savings were calculated by Econoler, accounting for free-ridership and internal spillover effects, resulting in a 17.6% free-ridership rate and 0.2% spillover rate.

and internal spillover measured as part of the participant survey. Through this approach, a free-ridership level of 17.6 percent was captured, while a spillover level of 0.2 percent was identified. Ref.: 5725 vi Business Energy Rebates Pro...

AI summary The Business Energy Rebates (BER) program evaluation found a free-ridership level of 17.6% and a spillover level of 0.2%. The program achieved net energy savings of 7.002 GWh and demand savings of 1.419 MW at the generator in 2011, with a net-to-gross ratio of 0.83.

inspected. - The scoring mechanism to calculate the free-ridership percentage from the three questions included in the application form should be documented in the program manual. Ref.: 5725 7 Business Energy Rebates Program Efficiency Nov...

AI summary The document discusses the need to document the scoring mechanism for calculating free-ridership percentage in the Business Energy Rebates Program and the importance of refining and disseminating marketing plans. It emphasizes the need for program manuals to include parameters for estimating program objectives and performance indicators for monitoring and evaluation.

ing this process were taken into account in conjunction with telephone survey answers. The telephone survey included eight free-ridership questions divided into four groups that attempted to measure: > the probability that the customer wou...

AI summary The text discusses a method for measuring free-ridership in energy efficiency programs, using a telephone survey with eight questions divided into four groups. It outlines the algorithm for calculating free-ridership levels and highlights enhancements made to the approach, including a scoring system and broader consideration of influencing factors.

the complex nature of real-world decision making and helps ensure that all non-program influences are considered in the free-ridership assessment in addition to program influences. Ref.: 5725 33 Business Energy Rebates Efficiency Nova Scot...

AI summary The document discusses the evaluation of the Business Energy Rebates program, highlighting a reduction in free-ridership from 46% in 2010 to 17.6% in 2011, potentially due to stricter screening processes. It also mentions internal spillover effects measured through participant surveys.

Program Manual 1. Document important program assumptions or practices: Content – The Evaluator understands that the measures included in the program as well as the gross savings they generate are based on a similar program run by EVT. Rega...

AI summary The document discusses the need for a comprehensive program manual that includes assumptions, practices, and parameters for estimating program objectives. It emphasizes documenting savings calculations, incentive structures, project selection criteria, and free-ridership scoring mechanisms for accuracy and transparency in program evaluation.

ndent 8 67% Part of a larger company 3 30% Don’t know 2% The majority of respondents report that their organizations have between one and five business locations in Nova Scotia (72%), and two in 10 have six or more business locations (21%)...

AI summary The document discusses the Business Energy Rebates (BER) program managed by Efficiency Nova Scotia Corporation, including a recommendation to improve incentive levels and develop a rational incentive structure. It references a 46% free-ridership rate and mentions a questionnaire used in the application process.

an you comment on that recommendation? BER-R1 What is the status of this recommendation about the free-riders (46%) is it the 3 questions you ask in the application form available from your web site? BER-R2 Are you using more contractors a...

AI summary The document discusses the Business Energy Rebates program, including questions about free-ridership, application processes, data collection, and the handling of non-admissible incentive requests. It also references an evaluation report and application forms.

Efficiency Nova Scotia Corporation 2011 Evaluation Report APPENDIX VII – ALGORITHM FOR FREE-RIDERSHIP CALCULATION The following algorithm describes the free-ridership calculation for the Business Energy Rebates Program. For each participan...

AI summary This document outlines an algorithm for calculating free-ridership within the Business Energy Rebates Program. It involves survey-based attribution levels (FR1, FR2a, FR2b) to determine the likelihood that participants would have implemented energy-efficient measures without the program's support.

the same energy-efficient equipment but at a later Otherwise: PA4 = EMPTY date? (Scale 0 to 10) FR2cc. Approximately how many months later would you have IF 1. : FR2cc = 100% installed this equipment ? IF 2. : FR2cc = 50% 1. Less than 6 mo...

AI summary The text contains survey questions related to the timing of energy-efficient equipment installation, with scoring mechanisms for free-ridership evaluation. It includes conditional logic for calculating scores based on responses to questions about delays in installation.

MEAN VALUE OF: Final Free -Ridership (PA1 ; PA2 ; PA3 ; PA4) Ref.:5725 86 Business Energy Rebates Program Efficiency Nova Scotia Corporation 2011 Evaluation Report Subsequently, the final free-ridership level calculated for each participan...

AI summary The document discusses the evaluation of the Business Energy Rebates Program and the Smart Lighting Choices Program by Efficiency Nova Scotia Corporation in 2011. It outlines the methodology for calculating free-ridership levels and the inconsistency test applied to ensure accurate results.

a Corporation 2011 Evaluation Report The SLC program aimed at achieving net electricity savings of 8.04 GWh in 2011. KEY FINDINGS The 2011 evaluation of the SLC program demonstrated that the latter is well designed and has a good potential...

AI summary The SLC program achieved significant energy and demand savings in 2011, with net energy savings of 7.954 GWh and demand savings of 2.050 MW. The program's success was supported by increased product sales and a 19% free-ridership level, leading to a net-to-gross ratio of 0.81.

obtained from the following four sources: > ENSC website; > 2010 evaluation report; > program manual; > distributor invoices. 2.2.2 In-Depth Interview with Program Manager Econoler staff conducted one interview in September with the Progra...

AI summary The evaluation of the Smart Lighting Choices Program involves data from multiple sources, including interviews with the Program Manager and distributors, as well as on-site visits. The interviews aimed to understand program justification, savings calculations, barriers, marketing strategies, and free-ridership.

blish installation rates, hours of operation and interactive effects on program demand and energy savings. The gross energy savings evaluation is the result of data collection and savings adjustments. The distributor interviews provided in...

AI summary The document discusses the evaluation of the Smart Lighting Choices Program, including the calculation of net-to-gross ratio based on free-ridership and sampling methodology for on-site visits. Data on lamp and ballast sales from distributors is used to assess program effectiveness.

Parameters Buildings Electric heating with air conditioning 14.71% -43.4% Electric heating without air conditioning 8.82% -49.0% No electric heating with air conditioning 52.94% 5.7% No electric heating without air conditioning 23.53% 0.0%...

AI summary The document presents data on the distribution of electric heating and air conditioning usage, along with a weighted interactive effect factor. It references a 1992 report by ADS ASSOCIÉS on energy efficiency evaluations and discusses the Net-to-Gross Ratio (NTGR) methodology for the Smart Lighting Choices (SLC) program, including the assessment of free-ridership.

ew questions into a NTGR. For the SLC program, the NTGR includes the assessment of one distortion effect: free-ridership. Once this effect is quantified, the NTGR is calculated based on this equation: Net-to-gross ratio = (1 – % free-rider...

AI summary The text discusses the calculation of the Net-to-Gross Ratio (NTGR) for the SLC program, focusing on free-ridership as a distortion effect. Distributors were interviewed to estimate the program's influence on customer purchasing decisions and the percentage of products that would have been sold without the program. Free-ridership was calculated as a weighted average based on energy savings per product category.

ucts. The final free-ridership value for the program was obtained by calculating the weighted average of the free- ridership with the corresponding total energy savings, for each category of products. Using this approach, in-depth intervie...

AI summary The evaluation report discusses the Smart Lighting Choices (SLC) program, calculating a free-ridership level of 19% and a Net-to-Gross Ratio (NTGR) of 0.81. The SLC program significantly influenced the sale of high-performance lighting products, while the UBER sub-program had a NTGR of 1 due to the recent introduction of expensive lighting products.

Free-Ridership Level 7% Spillover Level 0% Net-to-Gross Ratio 0.93 The evaluation revealed that the C&IC and CINC programs had respectively generated net energy savings of 30.323 GWh and 2.607 GWh at the generator in 2011. Regarding electr...

AI summary The evaluation of the C&IC and CINC programs in 2011 showed higher net energy savings compared to ENSC's tracked savings, attributed to a reduction in free-ridership from 10% in 2010 to 7% in 2011. This improvement was due to an enhanced screening process implemented by ENSC for participants who signed the PDA in 2011.

tems. Measures involving demand limiting controls, power factor correction systems, cogeneration or fuel switching are deemed ineligible for reasons that are explicitly detailed in the program manual. With regard to project cost eligibilit...

AI summary The C&IC program outlines eligibility criteria for project costs, including engineering fees, equipment purchases, and installation labor, while excluding contingency amounts. It also includes free-ridership screening to identify projects that would have been completed without ENSC assistance.

eving net electricity savings of approximately 4.8 GWh for the year 2011. With regard to net demand savings, the combined overall target of the C&IC and CINC program components was 10.4 MW in 2011. Ref.: 5725 4 Commercial & Industrial Cust...

AI summary The 2011 evaluation report discusses the Commercial & Industrial Custom and New Construction (CINC) program's eligibility criteria, emphasizing cost-effective energy-saving measures. ENSC has authority to determine eligibility and screens for free-ridership before offering incentives, typically providing support only for measures beyond common practice.

s with the consultants who conducted the energy audits. At the end of 2011, ENSC mentioned that they had already started working on a system to track energy audits that are not accepted. > Standardize the internal screening process: Free-r...

AI summary The document discusses the need for ENSC to standardize its internal screening process for the C&IC program, particularly regarding free-ridership. Econoler recommends developing tracking mechanisms to collect and analyze responses from potential participants who are screened out, to improve the program's efficiency and effectiveness.

at found for the C&IC program. 14 For the year 2011, the target energy and demand savings of the CINC component of the C&I Custom program accounts for only 10 percent of total forecast savings. Ref.: 5725 54 Commercial & Industrial Custom...

AI summary The 2011 evaluation report discusses free-ridership in the Commercial & Industrial Custom and New Construction Program, noting that ENSC improved screening processes to identify participants who would have implemented energy efficiency measures without the program. The report outlines survey questions used to assess the impact of the program on customer decisions.

efficient equivalent model; > the factors, other than the program, that might have affected the customer’s decision; and > the temporal sequence of the program and the customer’s decision. Each group of questions are transposed into a leve...

AI summary The document describes a method for assessing free-ridership in energy efficiency programs, emphasizing a scoring system and a more comprehensive evaluation of factors influencing customer decisions. The approach is consistent with methods used in other jurisdictions and builds on previous years' assessments with enhancements.

eworthy is that the Evaluator’s approach is consistent with evaluation, measurement and verification methods used in other jurisdictions such as California, New York State, Oregon and Pennsylvania. Ref.: 5725 55 Commercial & Industrial Cus...

AI summary The 2011 evaluation of the Commercial & Industrial Custom and New Construction Program found a 7% free-ridership level, a decrease from 10% in 2010. This improvement is attributed to an enhanced screening process implemented by ENSC, particularly with participants who signed the PDA in 2011.

in 2011. A lower level of free-ridership was observed with these participants than with participants who signed the PDA in 2010 but finalized their project implementation in 2011. 5.3.2 Spillover Within typical programs, the internal spill...

AI summary The text discusses free-ridership and spillover effects within the C&IC program. It notes lower free-ridership in 2011 compared to 2010. Spillover effects refer to energy savings resulting from program influence without direct support, and internal spillover is assessed for the C&IC program but considered negligible for the CINC program.

vings Tracked Savings from ENSC 3.949 MW 0.90 3.554 MW Evaluation Results 4.047 MW 0.93 3.764 MW As per the last table, the evaluated net energy savings of the C&IC and CINC programs are higher than those tracked by ENSC by approximately 1...

AI summary The evaluated net energy savings from the C&IC and CINC programs are slightly higher than those tracked by ENSC, primarily due to improvements in the free-ridership level. Adjustments were made to some C&IC projects based on sample project evaluations, while CINC program savings were not adjusted due to data gaps and inaccuracies in assessing NCCP and NCWB projects.

Program 11. Develop an evaluation plan in parallel with program design and Design and development: This program has no evaluation plan. The Evaluator strongly Implementation recommends that for each new program, an evaluation plan be prepa...

AI summary The text emphasizes the need for an evaluation plan for new programs, tracking rejected energy audits, and standardizing the free-ridership screening process. These measures aim to improve program performance, ensure clarity in eligibility criteria, and reduce potential issues with audit quality.

free-ridership is currently being screened based on the customer’s investment criteria. The program manual also presents a list of free-ridership screening questions used by ENSC at the early stage of a project. However, ENSC does not comp...

AI summary The text discusses free-ridership screening in energy efficiency programs and suggests improving tracking mechanisms for participants who are screened out. It also recommends expanding eligibility criteria for the C&IC program to include industrial sector companies and large institutional customers.

cts because of that limitation? Section 4.4.2.2 C: The 85% ratio for incentive of the total program budget seems a very good ratio for a new program. I have to congratulate you if this is the case. Q: I understand that you do not allow red...

AI summary The text includes questions and comments regarding program design, payback periods, commissioning plans, legal reviews, training materials, marketing strategies, program logic models, and potential distortion effects such as free-riders and spillovers. These discussions pertain to the evaluation and structure of the Commercial & Industrial Custom and New Construction Program.

e design of the program to increase demand savings? Q: Are the “Sales Leads” part of ENSC team? C&I –R2 What is the status of this recommendation? C&I –R3 What is the status of this recommendation? C&I – R6 What is the status of this recom...

AI summary The document includes questions about the design of a program to increase demand savings, the role of 'Sales Leads' in ENSC, the status of various recommendations, and the methodology for measuring free ridership. It also raises concerns about the clarity of incentive levels and the tracking of Sales Leads activities.

Efficiency Nova Scotia Corporation 2011 Evaluation Report APPENDIX X – ALGORITHM FOR FREE-RIDERSHIP CALCULATION FR1. Before participating in the program , did your company have plans to IF 1. Yes: Use FR1a implement the specific energy eff...

AI summary This section provides an algorithm for calculating free-ridership in energy efficiency programs. It includes a series of questions to determine whether participants would have implemented energy efficiency measures without the program's assistance.

munication need to be observed closely considering the fact that more changes will be made to the program in 2012. Indeed, ENSC is planning on including measures other than lighting to the program. Ref.: 5725 vi Small Business Energy Solut...

AI summary The evaluation of the Small Business Energy Solutions (SBES) program in 2011 found net energy savings of 23.176 GWh and demand savings of 6.820 MW. Free-ridership was estimated at 12.8%, and internal spillover at 0.8%, resulting in a net-to-gross ratio of 0.88.

on at more sites and obtaining a more reliable self-declaration ratio. Increasing the number of on-site visits would also allow calculating more reliable installation ratios. SBES-R4. Revise the list of products eligible for an incentive t...

AI summary The SBES program provides energy-efficient lighting retrofits to small businesses in Nova Scotia, with participants covering 20% of the costs and ENSC covering up to 80%. The program allows financing of the participant's portion through NSPI bills over 24 months at 0% interest. The text suggests revising product eligibility to reduce free-ridership by focusing on high-end products.

aimed at determining the gross and net savings of the program for 2011. Both energy and demand savings were considered in this evaluation. To do so, the following parameters were analyzed by Econoler: > unitary wattage of the lighting prod...

AI summary The evaluation of the program's energy and demand savings for 2011 considered various parameters such as unitary wattage, hours of operation, and free-ridership. Data was collected through on-site visits, program tracking sheets, and participant surveys to assess gross and net savings, including interactive effects and diversity factors.

hting measures for regular spaces, the total gross energy and demand savings at the meter for the SBES program are estimated at 24.449 GWh and at 7.209 MW, respectively. 4.4 NET-TO-GROSS RATIO The NTGR evaluation of the program is based on...

AI summary The evaluation report discusses the Net-to-Gross Ratio (NTGR) for the Small Business Energy Solutions (SBES) program, focusing on free-ridership and internal spillover effects. The NTGR is calculated using a self-report approach based on participant survey responses.

ll have purchased the energy-efficient lighting products in the absence of the program. The telephone survey included eight free-ridership questions divided into four groups that attempted to measure: > the probability that the customer wo...

AI summary The text discusses a method for estimating free-ridership in an energy efficiency program by analyzing customer behavior, including whether they would have purchased energy-efficient lighting without the program and the factors influencing their decisions. The approach includes a scoring system and considers multiple influencing factors, aligning with methods used in other jurisdictions.

ition to program influences. Econoler’s approach is consistent with evaluation, measurement and verification methods used in other jurisdictions such as California, New York, Oregon and Pennsylvania. Using this approach, the survey results...

AI summary The evaluation of the Small Business Energy Solutions (SBES) program found a free-ridership level of 12.8 percent, close to the 13.6 percent from 2010. The report suggests revising rebate-eligible products to high-end items to reduce free-ridership. Internal spillover effects were also measured through participant surveys.

sing the format indicated in the data extraction section below. The following procedures, extracted from the SmartWare Operator’s guide, must be used for data extraction and saving. Data Extraction: > Connect Lighting Logger to computer, u...

AI summary The text outlines procedures for data extraction using the SmartWare software and describes an algorithm for calculating free-ridership in the Small Business Energy Solutions Program. The algorithm is based on survey responses from participants.

gy Solutions Program. For each participant, four levels of program attribution are calculated based on the FR questions included in the survey and are then transposed into a final free-ridership level FR1. Before participating in the progr...

AI summary The text outlines a method for calculating free-ridership levels in an energy efficiency program by asking participants a series of questions about their pre-participation intentions and likelihood of installing energy-efficient lighting products without the program's influence.

energy-efficient lighting products but at a Otherwise: PA4 = EMPTY later date? (Scale 0 to 10) FR2cc. Approximately how many months later would you have IF 1. : FR2cc = 100% installed these products? IF 2. : FR2cc = 50% 1. Less than 6 mont...

AI summary The text presents a survey question related to the timing of energy-efficient lighting product installation, with options for response intervals and corresponding scoring values. It also references a free-ridership score calculation based on multiple factors.

MEAN VALUE OF : Final Free-Ridership (PA1 ; PA2 ; PA3 ; PA4) Ref.: 5725 99 Small Business Energy Solutions Program Efficiency Nova Scotia Corporation 2011 Evaluation Report Subsequently, the final free-ridership level calculated for each p...

AI summary The text discusses the methodology used to calculate the final free-ridership level for the Small Business Energy Solutions Program, including two inconsistency tests applied to participant responses and the calculation of the program's average free-ridership level using weighted averages.

1.3 Efficient Products – Retail Markdown The Retail Markdown program provides retailer-level discounts to offset the cost of purchasing energy efficient products. CFLs, ENERGY STAR refrigerators and ENERGY STAR clothes washers provide a la...

AI summary The Retail Markdown program offers retailer discounts to offset costs of energy-efficient products like CFLs and ENERGY STAR appliances. Savings from these products are significant, and free-ridership is assessed using two approaches.

Free-Ridership The free-ridership level for this program is measured through questions included in a participant survey. Participants are considered to be free-riders when they declare they would have implemented the energy efficiency upgr...

AI summary Free-ridership is measured via participant surveys assessing whether energy efficiency upgrades would have been implemented without the program. Criteria include prior planning, number of upgrades, timing, and program influence on decisions.

EP – APPLIANCE RETIREMENT - › Free-ridership will be measured through participant surveys for each appliance. - › Participants will be considered as FR when they declare that they would still have acted the same without the program. - › Th...

AI summary The appliance retirement program measures free-ridership through participant surveys, identifying individuals who would have acted identically without the program. Criteria include prior disposal intentions, unplugging appliances, and removal timelines post-participation.

EP – RETAIL MARKDOWN - › Free-ridership will be measured for three products using two different approaches. - › For CFLs, FR will be measured through participant surveys. - › Participants will be considered as FR when they declare that the...

AI summary The document outlines methods to measure free-ridership for three products, focusing on CFLs via participant surveys. Free-riders are those who would have purchased the product without the program rebate, assessed through questions on purchase intent, quantity, timing, and discount influence.

EP – MULTI-UNIT RESIDENTIAL RENTER - › Free-ridership will be measured through participant surveys. - › Participants will be considered as FR when they declare that they would still have implemented the energy-efficient measures if the pro...

AI summary The document outlines a methodology to measure free-ridership (FR) in the EP – MULTI-UNIT RESIDENTIAL RENTER program. FR is defined as participants who would have implemented energy-efficient measures regardless of the program. Criteria include pre-program planning, number of measures, timing, and influence of the discount.

EP – DIRECT INSTALL ("PART OF THE SOLUTION") - › Free-ridership will be measured through participant surveys. - › Participants will be considered as FR when they declare that their company would still have installed the products if the pro...

AI summary The document outlines a methodology to measure free-ridership (FR) in the EP – DIRECT INSTALL program through participant surveys. FR is defined as participants declaring their company would have installed products regardless of the program, assessed via criteria including pre-program planning, installation timing, quantity, and program influence.

EXISTING HOUSES – FUEL SUBSTITUTION - › Free-ridership will be measured through participant surveys. - › Participants will be considered as FR when they declare that they would still have replaced their heating equipment if the program had...

AI summary The document outlines methods to measure free-ridership (FR) in fuel substitution programs for existing homes. FR is determined via participant surveys, assessing whether replacements would have occurred without the program, contractor engagement prior to the program, and the program's influence on replacement timing.

LOW-INCOME HOUSEHOLDS - › No free-ridership or spillover effects will be measured for this program in 2011. - › This program offers financial incentives for building envelope upgrades as well as for the installation of programmable thermos...

AI summary The program targets low-income households with financial incentives for energy efficiency upgrades. It assumes no significant distortion effects and uses surveys/interviews to measure free-ridership (FR), spillover (SO), and market effects. FR is calculated based on decision-makers (homeowners vs. builders), while SO is assessed through post-participation energy measures. The net-to-gross ratio (NTGR) is set at 100%.

CUSTOM - › Free-ridership will be measured through participant surveys. - › FR for this program is expected to be low, considering the process requirement. - › Participants will be considered as FR when they declare that they would have im...

AI summary The program measures free-ridership (FR) via participant surveys, expecting low FR due to process requirements. Participants are classified as FR if they would have implemented energy efficiency measures without the rebate. FR determination involves three criteria: implementation intent, timing, and program influence.

1 Request IR-15: 2 - 3 Please provide an estimate of free ridership for the Green Heating Program and what - 4 steps, if any, have been taken by ENSC to reduce free ridership levels from that reported - 5 with respect to the Fuel Substitut...

AI summary The request asks for an estimate of free ridership for the Green Heating Program and steps taken by ENSC to reduce it, referencing the Fuel Substitution Pilot. The response indicates that free ridership levels are provided in a table by technology and market.

13 Strategies that ENSC has already taken to reduce free ridership in the 2012 Fuel Substitution 14 program that could be applied to the Green Heating initiative include the following: 15 16 focusing on mid-stream retailer advertising to m...

AI summary ENSC has implemented strategies to reduce free ridership in the 2012 Fuel Substitution program, such as targeting mid-stream retailer advertising to inform customers about rebates before they visit retailers, rather than advertising in areas where customers are already seeking fuel substitution options.

1  eliminating or reducing options, such as mini-split heat pumps, for which there is 2 already substantial demand, which leads to high free ridership 3 4 ENSC will limit free ridership for the Green Heating initiative by providing incent...

AI summary The document discusses ENSC's approach to reducing free ridership in the Green Heating initiative by limiting incentives to the highest-performing systems. It also includes a request for information on program changes ENSC plans to ensure energy savings from the 2013-15 initiative.

1 Request IR-15: 2 - 3 Please provide an estimate of free ridership for the Green Heating Program and what - 4 steps, if any, have been taken by ENSC to reduce free ridership levels from that reported - 5 with respect to the Fuel Substitut...

AI summary Request IR-15 asks for an estimate of free ridership for the Green Heating Program and steps taken to reduce it based on the Fuel Substitution Pilot. The response mentions that anticipated free ridership levels are presented in a table by technology and market.

1  eliminating or reducing options, such as mini-split heat pumps, for which there is 2 already substantial demand, which leads to high free ridership 3 4 ENSC will limit free ridership for the Green Heating initiative by providing incent...

AI summary The document discusses ENSC's approach to limit free ridership in the Green Heating initiative by incentivizing only the highest-performing systems. It also requests a list of program changes ENSC plans to ensure the 2013-15 energy savings.

upgrades, in the Low Income program. 1 Request IR-2: 16  the level of satisfaction of program participants such as energy users and partners 17 (e.g. trade allies, energy auditors , retailers) 18  the scope of issues raised in past impac...

AI summary The text discusses requests and responses related to the evaluation of the Low Income program, including participant satisfaction, free ridership, and the process for developing Figure 4.2. It also references the Efficient Products program and the derivation of TRC values.

- savings are based on the program results for 2011, corrected to account for a market penetration - of 100 percent. - Gross and net standard savings - The new regulation may potentially lead some businesses to stockpile T12 lamps in order...

AI summary The document discusses adjustments to energy savings estimates for lighting programs, considering market penetration, free-ridership, and changes in building energy codes. It highlights the impact of the 2011 NECB on energy consumption reductions and the correction of data to reflect current construction trends.

- savings are based on the program results for 2011, corrected to account for a market penetration - of 100 percent. - Gross and net standard savings - The new regulation may potentially lead some businesses to stockpile T12 lamps in order...

AI summary The text discusses energy savings estimates for the 2011 NECB, accounting for market penetration, free-ridership, and adjustments for lighting improvements. It also mentions potential impacts of the new regulation on business behavior and the use of baseline data for assessing savings.

NON-CONFIDENTIAL 1 Request IR-29: 2 3 Please identify which sub-program elements as described in the figures provided in 4 response to Consumer Advocate IR-3 account for the majority of additional investment in 5 the revised application an...

AI summary The response to Request IR-29 explains that the increased investment in the revised application is due to correcting the Energy Efficiency Resource Assessment Model (RAM Tool) to account for incentive costs related to free riders. Programs with higher free ridership, such as Existing Houses, New Residential, and BNI Efficient Product Rebates, account for the majority of this additional investment.

Q. Do you have any concerns about free ridership? - A. Yes. There are a small number of programs that account for the majority of the increase - in investment between the initial filing on February 27 and the March 30 revision. As noted in...

AI summary The witness expresses concerns about free ridership in certain programs, noting significant cost increases in energy efficiency initiatives. ENSC acknowledges an error in its Energy Efficiency Resource Assessment Model that led to understated costs, particularly for free riders. The testimony also addresses ENSC's budget administration, suggesting a management audit and improved budget transparency.

1 Request IR-13: 2 3 Please provide specific examples from each program area where recommendations made by Econoler have or will be implemented. 4 5 Request IR-14: 6 7 Please provide an update on the status of progress regarding developmen...

AI summary The document contains a series of requests directed at Energy Nova Scotia Corporation (ENSC) regarding the implementation of recommendations, progress on evaluation plans, free ridership in the Green Heating Program, program changes to meet energy savings targets, re-evaluation of the Low Income Home target, and the evaluation plan for Enabling Strategies.

For the 2012 evaluations, Econoler visited a total of 325 participant sites, 20 retail stores and one recycling facility. These visits were conducted between October and December 2012 for all programs. The objective of the participant site...

AI summary Econoler conducted site visits in 2012 to evaluate program effectiveness, including 325 participant sites, 20 retail stores, and one recycling facility. The visits aimed to validate parameters like installation rates, free-ridership, and recycling processes, and assess in-store experiences and employee knowledge.

A total of 1,042 interviews with participants and 57 interviews with builders (Table 4) were completed for this evaluation. Although the content of the surveys varied from one program to another, the survey instruments were used to capture...

AI summary The evaluation involved 1,042 participant interviews and 57 builder interviews conducted between October and November 2012. The surveys captured data on spillover, free-ridership, program awareness, participant motivations, satisfaction, and recommendations. In-store intercept surveys and CATI technology were used for different programs.

y the participant, the number of sites to be visited was increased for the 2012 evaluations to allow for establishing reliable installation rates and self-declaration ratios on the hours of operation. The 2011 verification study suggested...

AI summary The evaluation enhanced data collection methods by increasing site visits and using billing analysis to improve savings estimates. Direct measurement and expanded samples improved accuracy for programs like HEA and BES, while other programs relied on file reviews and literature. Net savings adjustments incorporated free-ridership and spillover factors via NTGR calculations.

net savings impacts, interactive effects factors as well as NTGRs that incorporated levels of free-ridership and, in some cases, spillover, were applied to the gross savings impacts, where applicable. The estimation of NTGRs for the 2012 e...

AI summary The text discusses the estimation of net-to-gross ratios (NTGRs) for ENSC's programs in 2012, incorporating free-ridership and spillover effects. A self-report approach with surveys and interviews was used to determine free-ridership levels, which were then applied to gross savings impacts. The methodology aligns with practices in other jurisdictions like California and New York.

Table 5: Free-Ridership Levels Ducani Free-Ridership Levels Progra 2011 2012 Refrigerators 20% 17% Appliance Retirement (ARet) Freezers 26% 16% , Room AC Units a 24% Regular CFLs 78% 59% Instant Savings LED Lamps 33% Clothes Washers 53% 78...

AI summary Table 5 presents free-ridership levels for various energy efficiency programs in Nova Scotia from 2011 to 2012, showing varying degrees of free-ridership across different initiatives such as appliance retirement, home energy assessments, and business energy rebates.

& lt;sup>b The 2011 free-ridership level refers to Energuide for Existing Houses. & lt;sup>c The free-ridership level calculated for RDI is for the non-low-income participants. & lt;sup>d The 2011 free-ridership level refers to Smart Light...

AI summary The text discusses the calculation of the Net-to-Gross Ratio (NTGR) for ENSC's programs, using free-ridership and spillover levels. The NTGR formula is provided, and the evaluation includes the impact of spillover effects on program effectiveness.

Fuel Substitution The net energy savings calculated for Fuel Substitution are 3 percent higher than those calculated from the tracking sheet. This can be explained by the increase in the NTGR calculated for this evaluation in comparison to...

AI summary The net energy savings from Fuel Substitution are 3% higher than those from the tracking sheet due to an updated NTGR calculation. Free-ridership levels decreased in 2012, likely due to increased marketing efforts, but savings from wood and pellet stoves were reduced after billing analysis.

Multi-Unit Residential Buildings The net evaluated savings were slightly higher than those tracked by ENSC for MURB. Some unitary savings values were revised during this evaluation. However, the main factors that explain the difference in...

AI summary The net evaluated savings for Multi-Unit Residential Buildings (MURB) were slightly higher than those tracked by ENSC. Differences in savings are attributed to revised unitary savings values, the review of interactive effects for regular CFLs installed outdoors, and a free-ridership level of 16 percent measured for this evaluation.

Custom Retrofit The adjusted gross energy savings of Custom Retrofit were higher than those tracked by ENSC by approximately 0.05 percent. The Evaluator made some minor adjustments to ENSC's energy savings, due to issues found in interacti...

AI summary The Custom Retrofit program's adjusted gross energy savings were slightly higher than ENSC's, with minor adjustments due to issues in interactive effect calculations and discrepancies in equipment counts. The net energy savings were 2.1% lower due to a higher free-ridership level in 2012. Gross demand savings were 13% higher, attributed to updated diversity factors used by Econoler, which led to an 11% difference in net demand savings.

Custom New Construction The net energy savings at the generator calculated by Econoler are approximately 22 percent lower than those tracked by ENSC. This difference is mainly due to the NTGR ratio established as part of this year's evalua...

AI summary The net energy savings calculated by Econoler are 22% lower than those tracked by ENSC, mainly due to the NTGR ratio. The peak demand savings difference is 33%, influenced by adjustments in diversity factors and discrepancies in project claims. Free-ridership is also noted, with participants implementing energy efficiency measures for reasons beyond the program.

Table 11: General Recommendations on ENSC Program Manuals No. Recommendations OV-R1. Continue to document key elements of the programs: With the new standardized format, the program manuals now include most of the information about the pro...

AI summary The table outlines recommendations for improving the documentation of ENSC program manuals. It emphasizes the need to continue documenting key program elements, including major changes, program characteristics, incentive calculations, and free-ridership approaches.

Table 16: Recommendations for Instant Savings No. Recommendations Instant-R3. Focus on LED products going forward with the program: Some retailers recommended upgrading the lighting offer under Instant Savings. Indeed, they believe that LE...

AI summary The table recommends focusing on LED products for the Instant Savings program, citing declining demand for CFLs and high free-ridership levels. ENSC added LED recessed downlight fixtures in 2012, and Econoler suggests removing regular CFLs from eligibility by 2014.

T2000 software by NRCan. They reported that the software still contained several deficiencies and that NRCan should grant more human resources to finally fix this issue. When asked about the program marketing and outreach activities, the m...

AI summary The evaluation of the Home Energy Assessment (HEA) program in 2012 showed an increase in participants and energy savings compared to 2011. Program partners were satisfied with marketing improvements and suggested continuing aggressive outreach. Econoler recommended enhancing information on program measures and noted the absence of internal spillover in 2012.

The 2012 evaluation of Fuel Substitution found that the transition from a pilot to a component of the Existing Houses program was successful. Participants expressed high levels of satisfaction with the program overall, as well as with its...

AI summary The 2012 evaluation of the Fuel Substitution program showed increased participant satisfaction and program improvements, including new tools for management and enhanced upstream promotion. ENSC's efforts raised program awareness, reducing free-ridership from 42% in 2011 to 32% in 2012. The program had 282 participants in 2012, generating energy and demand savings comparable to the previous year.

used in the tracking sheet by conducting a billing analysis and a literature review. Moreover, Econoler took into consideration the free-ridership and the spillover measured in the participant survey. Based on the evaluation results, the m...

AI summary Econoler conducted a billing analysis and literature review for the tracking sheet, considering free-ridership and spillover effects from participant surveys. Key recommendations were made based on the evaluation results.

Table 18: Recommendations for Fuel Substitution No. Recommendations Fuel-R1. Continue marketing efforts and outreach activities: In 2011, the Evaluator recommended the addition of upstream advertising in program strategy. This recommendati...

AI summary The document recommends continuing marketing and outreach efforts for fuel substitution programs, citing successful implementation since 2011 and the impact on reducing free-ridership and increasing participation.

Table 20: Recommendations for Performance Plus No. Recommendations PP-R5. Investigate the baseline EnerGuide rating for new houses in Nova Scotia: Four studies were performed in 2011 with a view to fine-tuning the baseline EnerGuide value...

AI summary The text recommends that ENSC investigate the baseline EnerGuide rating for new houses in Nova Scotia, considering changes in high-efficiency technology and observed free-ridership under the Performance Plus program. The baseline was previously set at 78, but an update may be necessary for 2013.

Table 22: Recommendations for Multi-Unit Residential Buildings No. Recommendations MURB-R1. Analyze the possibility of rewarding building superintendents' support: The new marketing strategy, which involves direct collaboration with landlo...

AI summary The document recommends analyzing ways to reward building superintendents for their support in energy efficiency programs, continuing to provide information on energy efficiency to multi-unit renters, and collecting data on installed products per tenant unit for better planning and tenant engagement.

Table 23: Recommendations for Solar No. Recommendations Solar-R1. Complete a RETScreen simulation for all the projects to improve the accuracy of the deemed savings: The RETScreen simulation tool is very easy to use and understand. With ad...

AI summary The document recommends using RETScreen simulations for solar projects to improve deemed savings accuracy, suggests involving solar installers in this process, and proposes including participant surveys to estimate free-ridership if participation levels are high enough.

The program saw a total of 8 projects implemented for the year of 2012, which is similar to the number of projects in 2011 (9). This year's evaluation also revealed that NC generated net energy savings of 4.644 GWh at the generator in 2012...

AI summary In 2012, the program implemented 8 projects, achieving 4.644 GWh of net energy savings and 0.525 MW of peak demand savings. Econoler evaluated these results using on-site visits and interviews, accounting for free-ridership to calculate net savings. Recommendations were made based on the evaluation findings.

Program Energy Savings To calculate the net savings of ARet in 2012, Econoler reviewed the gross savings estimated by ENSC using results from a metering study conducted for the 2011 evaluation at the recycling facility and from other studi...

AI summary To calculate the net savings of ARet in 2012, Econoler used gross savings estimates from ENSC, incorporating metering study results, appliance usage data, and free-ridership and internal spillover measurements from participant surveys. A free-ridership level of 17 percent and a spillover level of 1 percent were identified.

Table 1: Distortion Effects and Net-to-Gross Ratio 2012 Free-Ridership Level 17% Spillover Level 1% Net-to-Gross Ratio 0.84 The evaluation revealed that ARet generated net energy savings of 6.795 GWh and demand savings of 0.999 MW at the g...

AI summary Table 1 presents the free-ridership level, spillover level, and net-to-gross ratio for 2012, along with the energy and demand savings generated by ARet in that year.

Another factor that explains the differences between the tracked savings and the evaluation results is the NTGR. In the tracking sheet, ENSC used a NTGR of 0.79, based on the 2011 evaluation report. For this year's evaluation, the NTGR was...

AI summary The difference between tracked savings and evaluation results is explained by changes in the NTGR. ENSC used a NTGR of 0.79 in the tracking sheet, based on the 2011 evaluation report, but updated it to 0.84 for this year's evaluation due to lower free-ridership in refrigerators and freezers. An internal spillover level of 1 percent was also captured.

2.2.5 Participant Survey A telephone survey with a total of 201 program participants was conducted by Econoler's subcontractor, Corporate Research Associates, Inc. (CRA), from its offices in Halifax. The interviews were conducted in Octobe...

AI summary A telephone survey of 201 program participants was conducted by CRA in 2012 to gather feedback on the ARET program, covering aspects like spillover, free-ridership, program awareness, participant motivations, and satisfaction. The survey included questions about refrigerators, freezers, and air conditioners, with demographic data and questionnaires detailed in appendices.

4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evaluation is aimed at determining the gross and net savings of the program for 2012. Both energy and demand savings were considered in this evaluation. To do so, Econoler revi...

AI summary The impact evaluation aims to determine the gross and net savings of the program for 2012, considering both energy and demand savings. Econoler reviewed parameters such as unitary savings values, demand-to-energy ratio, interactive effects, free-ridership, and internal spillover, using metering data, literature reviews, and participant surveys.

4.4.1 Free-Ridership The free-ridership level was measured using the participant survey. The questionnaire included a number of questions that attempted to assess the following variables: - > if participants had already considered disposin...

AI summary The free-ridership level for the Appliance Retirement (ARET) program was measured using participant surveys, assessing factors like pre-program appliance disposal intentions and the importance of various influences on disposal decisions. The calculated free-ridership level was 17% in 2012, with refrigerator and freezer levels at 17% and 16%, respectively, and room air conditioners at 24%. This level is used to adjust the program's total energy savings estimates.

4.4.3 NTGR Calculation Using the free-ridership and spillover levels established above, the NTGR value for the program is shown below. $$NTGR = 1 - \%$$ free-ridership + % spillover = 1 - 17% + 1% = 0.84

AI summary The NTGR value for the program is calculated using free-ridership and spillover levels, resulting in an NTGR of 0.84 after accounting for 17% free-ridership and 1% spillover.

Refrigerator Free-Ridership Section [RFR Series] Please continue thinking about just that one refrigerator. - RFR1. Had you already considered disposing of the refrigerator before you heard about Efficiency Nova Scotia's Appliance Retireme...

AI summary This section of the regulatory proceeding focuses on assessing free-ridership related to the Efficiency Nova Scotia Appliance Retirement Program, specifically regarding refrigerator disposal. It asks respondents whether they would have disposed of the refrigerator without the program and how likely they would have paid for the service themselves.

Air Conditioner Unit Free-Ridership [AFR Series] Please continue thinking about just that one air conditioner unit. - AFR1. Had you already considered disposing of the air conditioner unit before you heard about Efficiency Nova Scotia's Ap...

AI summary This section of the regulatory proceeding document asks respondents about their behavior regarding disposing of an air conditioner unit, specifically in relation to the Appliance Retirement Program offered by Efficiency Nova Scotia. It explores whether the program influenced their decision to retire the appliance and how likely they were to have paid for the service themselves.

APPENDIX VI – ALGORITHM FOR FREE-RIDERSHIP CALCULATION FR1. Had you already considered disposing of your appliance before you heard about the program? IF 2. No: FR1 = 0% OTHERWISE: GO TO FR3 FR3. If the program had not been available, what...

AI summary This appendix presents an algorithm for calculating free-ridership in a program, asking participants whether they would have disposed of their appliance before the program and how they would have handled it if the program had not been available. The algorithm assigns different percentages based on the participant's response.

PA3 Score: FR4 Final Free-Ridership MEAN VALUE OF: (PA1; PA2; PA3)

AI summary The document presents the PA3 score as part of the final free-ridership calculation, which is based on the mean value derived from PA1, PA2, and PA3. The visual representation of the data is included in the document.

ffectiveness of the campaigns. They reported the challenge that lies in communicating all the necessary information to their store personnel and in involving and engaging them, as indicated by the DA. The success of Instant Savings relies...

AI summary The document discusses the effectiveness of the Instant Savings program, highlighting the importance of retailer collaboration and engagement. It also addresses the need to shift focus from CFLs to LED products due to changing market trends and the high free-ridership level of CFLs. Recommendations include strengthening relationships with retailers and phasing out CFLs.

Interviews with Retailers In October and November 2012, a total of 17 in-depth interviews were conducted with program retailers. Of the 17 retailers, eight were corporate retailers and nine were independent retailers. These interviews focu...

AI summary In 2012, 17 interviews with retailers were conducted to assess their experiences with efficiency programs, focusing on ENERGY STAR® CFLs, LED lamps, and CEE Tier 3 clothes washers. The study measured free-ridership for LED lamps and clothes washers and spillover effects for all three products, while CFL free-ridership was measured through intercept surveys.

4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evaluation is aimed at determining the gross and net savings of Instant Savings for 2012. Both energy and demand savings were examined in this evaluation. To do so, the followi...

AI summary The impact evaluation for Instant Savings in 2012 assesses both energy and demand savings. Econoler analyzed unitary savings values, replacement ratios, demand-to-energy ratios, free-ridership, and market spillover effects. Activities included reviewing data sources, conducting literature reviews, and using intercept surveys and retailer interviews.

CFLs The free-ridership level for CFLs was evaluated at 78 percent in the past evaluation. This value was established using a phone survey conducted with participating CFL buyers. As recommended in the 2011 evaluation report, the assessmen...

AI summary The free-ridership level for CFLs was evaluated at 78 percent based on an intercept survey conducted after participants' product purchase during the fall campaign. The evaluation used five questions to assess the influence of discounts on purchasing decisions and calculated program attribution for each participant.

LED Lamps The free-ridership level for LED lamps sold through the program was evaluated for the first time in 2012. The assessment of free-ridership for this product is based on the intercept survey conducted right after the participant's...

AI summary The free-ridership level for LED lamps sold through the program was evaluated at 33 percent in 2012, based on an intercept survey. This level reflects the influence of discounts on purchase decisions and highlights the effectiveness of in-store signage in communicating the discount. The free-ridership level applies only to lamps sold through spring and fall campaigns, while a NTGR of 1 is used for in-store events.

Clothes Washers For clothes washers, the approach is somewhat different. Since the population of buyers for this product is small, it is difficult to intercept them during an in-store survey. Therefore, the free-ridership level was measure...

AI summary The free-ridership level for CEE Tier 3 clothes washers sold through the program in 2012 was estimated at 78%, a decrease from 85% the previous year. This remains high due to limited appliance choices and customers' pre-existing decisions on appliance models.

4.4.3 NTGR Calculation The NTGR values for each category of product were established using the free-ridership and spillover levels presented above. The table below summarizes the results of these calculations.

AI summary The NTGR values for each product category were determined based on free-ridership and spillover levels. The results of these calculations are summarized in a table.

Executive Summary 3. Focus on LED products going forward with the program\ : Some retailers recommended upgrading the lighting offer under Instant Savings. Indeed, they believe that LED lamps are the future, and that the demand for regular...

AI summary The Executive Summary discusses the shift from CFLs to LED products in the Instant Savings program and the need to adjust appliance offers to focus on more available and energy-efficient models. Recommendations include phasing out regular CFLs and incorporating smaller, more efficient CEE Tier 2 refrigerators and higher-efficiency clothes washers.

Free-Ridership (FR Series) [ONLY ASK ONE FR SECTION PER PARTICIPANT] [IF A RESPONDENT GETS I2, THEN THEY GET THE CFL FR SEQUENCE] [IF A RESPONDENT GETS I2A, THEY GET THE LED FR SEQUENCE] [IF A RESPONDENT GETS I2B, IF THEIR RESPONSE IS CODE...

AI summary The text outlines procedures for handling free-ridership (FR) sections in a regulatory proceeding, specifying different sequences based on the participant's response codes. It includes conditional logic for assigning either the CFL or LED FR sequence depending on the response received.

APPENDIX VII - ALGORITHM FOR FREE-RIDERSHIP CALCULATION FR0a. Before paying at the cash register, were you aware that a discount was offered on the purchase of [CFLs or LEDs]? IF 2 OR 9: Ask FR0b FR0b. I just want to make sure - You did no...

AI summary This appendix outlines an algorithm for calculating free-ridership in the context of energy-efficient product purchases, specifically focusing on whether customers were aware of discounts on CFLs or LEDs before making a purchase.

MEAN VALUE OF: (PA1; PA2; PA3; PA4; PA5) Inconsistency Test #1 IF FR3 ≥ 70% AND IF FR1 = 0%: PA2 = EMPTY Inconsistency Test #2 IF ABS(FR5-FR7) ≥ 30%: KEEP MIN (PA4; PA5) Revised Free-Ridership MEAN VALUE OF: (PA1; PA2; PA3; PA4; PA5) Ref.:...

AI summary The text outlines two inconsistency tests related to free-ridership calculations, including conditions for setting PA2 to empty and keeping the minimum of PA4 and PA5. It also references a revised free-ridership calculation and cites a reference number.

4.4.1 Free-Ridership In the case of HEA, free-ridership can occur when participants would have still implemented the energy efficiency measures in the absence of the program. The free-ridership level for this program was measured through p...

AI summary The free-ridership level for the HEA program was measured at 30 percent, indicating that 30% of participants would have implemented energy efficiency measures without the program. This is similar to last year's 31 percent. The program influenced 70 percent of energy efficiency measures implemented in 2012.

Free-Ridership [FR Series] In addition to the recommended measures which we have just discussed, the [service/program] could have implemented other energy-efficient upgrades to your home. Now I'm going to ask you to think of all the energy...

AI summary The text outlines a survey process to assess free-ridership in energy efficiency programs, specifically asking participants if they had plans to implement energy-efficient upgrades before participating in the Home Energy Assessment or EnerGuide for Existing Houses Program.

APPENDIX VII – ALGORITHM FOR FREE-RIDERSHIP CALCULATION FR2a. If you had not participated in the program, what is the likelihood that you would have implemented exactly the same energy efficiency upgrades that you implemented through the p...

AI summary This appendix outlines an algorithm for calculating free-ridership in energy efficiency programs. It includes two questions (FR2a and FR2b) that assess the likelihood of participants implementing energy efficiency upgrades without program participation and the likelihood of using standard equipment instead of energy-efficient equipment.

Revised Free-Ridership MEAN VALUE OF: (PA1; PA2; PA3; PA4)

AI summary The document references a revised free-ridership calculation, indicated by the mean value of multiple parameters (PA1; PA2; PA3; PA4).

DEFINITIONS Base Case A base case details the information on how assumed gross savings used in the tracking sheet have been established. Usually, these savings are calculated with a series of variables such as hours of operation, wattage o...

AI summary The text defines key terms related to energy efficiency programs, including base case, demand savings, distortion effects, gross and net energy savings, and net-to-gross ratio. It outlines the evaluation process for energy efficiency programs and highlights the importance of accounting for factors like free-ridership and interactive effects.

4.2.1 Unitary Savings Values Review Based on Billing Analysis 28 4.2.2 Unitary Savings Values Review Based on a Literature Review 35 4.2.3 On-Site Visit Results 38 4.2.4 Revised Gross Savings 39 4.3 Ne et-To-Gross Ratio 41 4.3.1 Free-Rider...

AI summary The text outlines various sections of a regulatory proceeding document, including reviews of unitary savings values, net-to-gross ratio analysis, free-ridership, spillover effects, and demographic data. It also references appendices containing recommendations, interview guides, on-site visit protocols, and algorithms for free-ridership calculation.

Program Energy Savings To calculate the net savings of Fuel Substitution in 2012, Econoler reviewed the gross savings estimated by ENSC by means of a billing analysis and a literature review. Moreover, Econoler took into consideration the...

AI summary Econoler calculated the net savings of Fuel Substitution in 2012 by reviewing ENSC's gross savings estimates, considering free-ridership and spillover from participant surveys. The free-ridership dropped from 42% in 2011 to 32% in 2012, likely due to increased marketing and outreach efforts influencing homeowner decisions before purchasing equipment.

Table 2: Comparison of Tracked and Evaluated Savings at the Generator Initial Gross Savings NTGR Net Savings Energy Savings Tracked Savings from ENSC 2.592 GWh 0.58 1.503 GWh Evaluation Results 2.245 GWh 0.69 1.549 GWh Demand Savings Track...

AI summary Table 2 compares tracked and evaluated energy and demand savings from the Efficiency Nova Scotia Corporation (ENSC) program in 2012. The net energy savings are 3% higher than tracked savings due to an improved NTGR and lower free-ridership, but unitary savings for wood and pellet stoves decreased after billing analysis.

2.2.4 Participant Survey A telephone survey with a total of 75 participants was conducted by Econoler's subcontractor, Corporate Research Associates, Inc. (CRA), from its offices in Halifax. The interviews were conducted in October 2012 us...

AI summary A telephone survey with 75 participants was conducted in October 2012 to gather feedback on the Fuel Substitution program, covering aspects like spillover, free-ridership, program awareness, and participant satisfaction. The survey was conducted by CRA using CATI technology, with results detailed in appendices and a table showing population and sample sizes.

Review of the Ductless Mini-Split Heat Pump Incentive under ENSC's Portfolio Up until 2012, ductless mini-split heat pumps were eligible for a financial rebate through ENSC's EnerGuide for Existing Houses. As of April 1, 2012, ENSC incenti...

AI summary This document reviews the discontinuation of ductless mini-split heat pump incentives by ENSC in 2012 due to high free-ridership. A market study and analysis were conducted, including interviews and surveys, to evaluate the potential reintroduction of the incentive into ENSC's Fuel Substitution program.

Existing Programs Review The Evaluator conducted an exhaustive analysis on the existing residential incentive programs which include ductless mini-split heat pumps. This review was meant to learn more about the programs promoting this ener...

AI summary The Evaluator reviewed residential incentive programs for ductless mini-split heat pumps, noting that only British Columbia in Canada and several U.S. states offer such incentives. Eligibility typically requires ENERGY STAR-rated equipment, with baselines often being less efficient heating systems. Rhode Island National Grid estimated a 15% free-ridership rate for these programs.

Survey with Participants from Home Energy Assessment Since ductless mini-split heat pumps were once rebated under HEA, but are now only recommended under the audit reports, a question was added to the HEA participant survey in order to ass...

AI summary A survey of HEA participants found that 46% would not have installed ductless mini-split heat pumps without the rebate, suggesting the rebate influenced some decisions. However, the small sample size (13 respondents) limits the reliability of this figure. The quality of equipment chosen without the rebate is also unknown.

4.3.1 Free-Ridership Free-ridership can occur when participants declare that they would still have replaced or substituted their electric space heating or DHW heater system in the absence of the program. The telephone survey included eight...

AI summary The free-ridership level for the program was found to be 32 percent, a significant decrease from 42 percent in 2011. This improvement is attributed to increased marketing and outreach efforts that influenced homeowners' decisions to replace or substitute their equipment.

4.3.3 NTGR Result Based on the free-ridership and spillover levels obtained, the NTGR for the Program is 0.69.

AI summary The NTGR for the Program is calculated as 0.69 based on the free-ridership and spillover levels obtained.

Table 27: Comparison of Tracked and Evaluated Savings at the Generator Initial Gross Savings NTGR Net Savings Energy Savings Tracked Savings from ENSC 2.592 GWh 0.58 1.503 GWh Evaluation Results 2.245 GWh 0.69 1.549 GWh Demand Savings Trac...

AI summary Table 27 compares tracked and evaluated savings from energy efficiency programs in 2012. Net savings are slightly higher than tracked savings, attributed to a lower free-ridership level due to increased marketing efforts. However, unitary savings for popular products like wood and pellet stoves decreased after billing analysis, affecting overall energy savings.

CONCLUSION The 2012 evaluation of Fuel Substitution found that the transition from a pilot to a full-fledged program was successful. Participants expressed high levels of satisfaction with the program overall, as well as with its specific...

AI summary The 2012 evaluation of the Fuel Substitution program found it successful, with high participant satisfaction and improvements since 2011. ENSC implemented key recommendations, and new tools improved program performance. Free-ridership dropped to 32% in 2012, and program awareness increased through upstream promotion. The program had 282 participants, generating energy and demand savings.

This Appendix presents all recommendations made by the Evaluator throughout the report as well as the sections where the recommendations originated. Sections Recommendations Executive Summary 1. Continue marketing efforts and outreach acti...

AI summary The appendix highlights a recommendation to continue marketing and outreach efforts by the Evaluator, noting that these activities have successfully reduced free-ridership and increased program participation since 2011. These efforts are attributed to ENSC advertising, which influenced homeowner decisions.

Explain: M2. Since April 1st, 2012, Efficiency Nova Scotia no longer finances the purchase of mini-split heat pumps through its programs. Mini-split heat pumps were once included in Efficiency Nova Scotia's EnerGuide programs but were with...

AI summary Since April 1st, 2012, Efficiency Nova Scotia no longer finances the purchase of mini-split heat pumps through its programs. This decision was made to prevent high free-ridership, where participants would have purchased the products regardless of program financing.

Free-ridership [FR Series] - FR1. Had you already considered replacing or substituting your space heating or domestic hot water system with another heating source before you heard about the Fuel Substitution Program? - 1. Yes - 2. No - 98....

AI summary This section of the regulatory proceeding document addresses free-ridership in the Fuel Substitution Program through a series of questions. It asks participants whether they had already decided to replace their heating systems before learning about the program and assesses the likelihood they would have taken the action without the program.

APPENDIX VI – ALGORITHM FOR FREE-RIDERSHIP CALCULATION FR2a. In the absence of the program, what is the likehood that you would have replaced or substituted your space heating or domestic hot water system with one that did not use electric...

AI summary This section outlines an algorithm for calculating free-ridership in a program, using two questions (FR2a and FR2b) with responses scaled from 0 to 10. The algorithm calculates the likelihood of program participants replacing their heating or hot water systems with non-electric or electric alternatives in the absence of the program.

Final Free-Ridership MEAN VALUE OF: (PA1; PA2; PA3; PA4) Inconsistency Test #1 IF ABS(FR2a - FR2b) ≥ 30%: PA1 = MIN OF (FR2a; FR2b) Inconsistency Test #2 IF FR3 ≥ 70% AND IF (FR2a OR FR2b < 70%: PA2 = EMPTY Revised Free-Ridership MEAN VALU...

AI summary The text outlines two inconsistency tests related to free-ridership calculations, including conditions for determining mean values and emptying PA2 based on specific thresholds. It also references a revised free-ridership calculation and includes a reference to a document (Ref.: 5790 72) and an image.

Table 2: Distortion Effects and Net-to-Gross Ratio Distortion Effects 2012 Free-Ridership Level 37% Market Effects 13% (hhh((market(markeeffects) Net-to-Gross Ratio 0.76 The evaluation revealed that Performance Plus generated net energy sa...

AI summary Table 2 outlines distortion effects and the net-to-gross ratio for 2012, highlighting a free-ridership level of 37% and a net-to-gross ratio of 0.76. The evaluation also shows that the Performance Plus program achieved significant energy and demand savings in 2012.

Participant Survey The participant survey was conducted with a total of 70 homeowner participants. The average length of the survey was 14 minutes. The participant survey was meant to generate feedback on the following aspects of the progr...

AI summary A participant survey was conducted with 70 homeowner participants to gather feedback on program aspects such as free-ridership, awareness, motivations, satisfaction, and recommendations for improvement. The survey took an average of 14 minutes to complete, and demographic data and sampling errors are detailed in appendices.

4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evaluation is aimed at determining the gross and net savings of the program for 2012. Both energy and demand savings were considered in this evaluation. To do so, Econoler anal...

AI summary The impact evaluation for 2012 assesses both gross and net energy and demand savings, considering factors such as HOT2000 simulations, prescriptive measure savings, interactive effects, free-ridership, and market spillover. The evaluation used methods from the 2011 approach and included participant and builder surveys to calculate the net-to-gross ratio.

Free-Ridership (FR Series) - FR1. When building a house in Nova Scotia to code, one would expect an EnerGuide rating of 80. Did you decide to build or buy a house with a high level of energy efficiency, reaching an EnerGuide rating of 83 o...

AI summary The text presents a survey question related to free-ridership in the Performance Plus program, asking participants whether they decided to build or buy a highly energy-efficient home before joining the program and assessing their likelihood of taking energy efficiency actions without the program.

Revised Free-Ridership MEAN VALUE OF: (PA1; PA2; PA3)

AI summary The document discusses the revised free-ridership, referencing the mean value of three parameters (PA1, PA2, PA3) and includes a visual representation of the data.

PA2 Score: FR3 Final Free-Ridership MEAN VALUE OF: (PA1 ; PA2) Inconsistency Test #1 IF $(FR2 - FR3) \ge 30\%$ : PA1 = EMPTY Revised Free-Ridership MEAN VALUE OF: (PA1; PA2)

AI summary The text presents a calculation involving PA2 Score, FR3, and a revised free-ridership mean value, with an inconsistency test based on the difference between FR2 and FR3. If the difference is 30% or greater, PA1 is set to empty.

out the contact person (landlord or renter) and the number of units visited. ENSC was aware of this issue and is currently working on a way to improve the tracking of multi-residential units for 2013. The program is aimed at both low-incom...

AI summary The tracking sheet used by ENSC for the program includes information on participants, including whether they are low-income or not, which is essential for calculating net-to-gross ratios and free-ridership levels. While 78% of participants had their income levels recorded, the remaining 22% were identified during community events where income was not disclosed, and assumptions were made based on community averages. Energy savings calculations are based on products installed and unitary savings values from 2011.

SELECTION METHOD FOR THE TWO MEASURES: - IF CFL ARE VERIFIED IN V3 AND V4, RESPONDENT WILL AUTOMATICALLY ANSWER ACCORDING TO CFL - THEN, CHOOSE ANOTHER MEASURE VERIFIED IN V3 AND V4 AT RANDOM, AMONG THE FOLLOWING: - o Low flow showerheads...

AI summary The document outlines a selection method for two measures in a survey, where respondents are automatically assigned based on CFL verification in V3 and V4. If CFL is not available, another verified measure is selected at random. LEDs are excluded from the free-ridership section. The survey includes questions about pre-program installation intentions and likelihood of taking actions without the program.

Revised Free-Ridership MEAN VALUE OF: (PA1; PA2; PA3; PA4) Ref.: 5790 81

AI summary The text references a revised free-ridership calculation with a mean value referenced across multiple pages and a document number provided. It includes a citation and an image placeholder, but lacks detailed discussion on the topic.

Program Energy Savings To calculate the net savings of the MURB program in 2012, Econoler reviewed the parameters and the source of data used in Efficiency Nova Scotia Corporation's (ENSC) unitary savings estimates for each product categor...

AI summary Econoler evaluated the MURB program's energy savings in 2012, considering data from Efficiency Nova Scotia Corporation, installation rates, and a 16% free-ridership level. The program targets less energy-efficient customers, highlighting the need to continue focusing on the multi-unit market.

Table 2: Comparison of Tracked and Evaluated Savings at the Generator Initial Gross Savings Installed Gross Savings Installed Gross Savings with Interactive Effects NTGR Net Savings Energy Savings Tracked Savings from ENSC 3.185 GWh 3.185...

AI summary Table 2 compares tracked and evaluated savings from energy and demand programs. Net evaluated savings were slightly higher than tracked savings, with differences attributed to revised unitary savings values, interactive effects of regular CFLs installed outdoors, and a measured free-ridership level of 16 percent.

2.2.4 On-Site Visits In October and November 2012, a total of 31 on-site visits were conducted in individual tenant units where energy-efficient products had been installed. These visits were conducted by Econoler's subcontractor, Equilibr...

AI summary In October and November 2012, 31 on-site visits were conducted in tenant units with energy-efficient products to validate installation and collect technical data. Interviews were also conducted to assess free-ridership levels. Methodology details are provided in the Impact Evaluation section and Appendix III.

On-Site Visit Protocol The on-site visits were conducted to validate the installation of the products according to the data found in the paper forms and to establish the percentage of products removed, if any, and the causes for removing t...

AI summary On-site visits were conducted to verify product installations, assess product removal rates and reasons, collect technical information, and interview tenants to evaluate freeridership levels.

4.4 NET-TO-GROSS RATIO The net-to-gross ratio (NTGR) is based on a self-report approach which relies on a series of questions designed to measure the influence of the program on end-users' decisions whether to participate in the program. T...

AI summary This section discusses the methodology for calculating the net-to-gross ratio (NTGR), which measures the influence of a program on end-users' participation decisions. For MURB, the NTGR calculation focuses on quantifying free-ridership and applying the formula NTGR = (1 - % free-ridership).

4.4.2 NTGR Calculation Using the free-ridership level established, the NTGR value for the program is estimated at 0.84. This value is applied to the gross savings.

AI summary The NTGR value for the program is estimated at 0.84 based on the free-ridership level established, and this value is applied to the gross savings.

Table 32: Comparison of Tracked and Evaluated Savings at the Generator Initial Gross Savings Installed Gross Savings Installed Gross Savings with Interactive Effects NTGR Net Savings Energy Savings Tracked Savings from ENSC 3.185 GWh 3.185...

AI summary The table compares tracked and evaluated energy and demand savings from ENSC's programs. Evaluated savings were slightly higher than tracked savings, with differences attributed to revised unitary savings values, interactive effects of regular CFLs, freeridership levels, and a revised line loss factor.

APPENDIX VI – ALGORITHM FOR FREE-RIDERSHIP CALCULATION FR1. Did you have any specific plans to install energy-efficient products prior to learning about the program? IF 2. No: FR1 = 0% AND STOP OTHERWISE CONTINUE PA1 Score: FR1 FR2. If you...

AI summary This appendix outlines an algorithm for calculating free-ridership in energy efficiency programs. It includes a series of questions to assess the likelihood that participants would have installed energy-efficient products without the program's assistance, with scores calculated based on responses.

KEY FINDINGS To calculate the net savings of Solar for 2012, Econoler first reviewed the parameters used for estimating the unitary savings values of each type of equipment installed and then completed some RETScreen simulations to validat...

AI summary Econoler evaluated the net savings of Solar in 2012 by reviewing parameters, conducting RETScreen simulations, and performing on-site visits. Due to low participation and energy savings, no survey was conducted, and the evaluator assumed zero free-ridership with a net-to-gross ratio (NTGR) of 1 for Solar.

4.3 NET-TO-GROSS RATIO To estimate the tracked net savings, ENSC used a Net to Gross Ratio (NTGR) of 0.7 (30% freeridership), based on participants' responses to a single screening question asked in the pre-approval application process. Th...

AI summary The document discusses the use of a Net-to-Gross Ratio (NTGR) of 0.7 to estimate tracked net savings by ENSC, based on a single screening question from pre-approval applications. However, due to a small number of participants and low energy savings, the Evaluator assumes zero free-ridership and an NTGR of 1 for the 2012 evaluation.

APPENDIX I - RECOMMENDATIONS This Appendix presents all recommendations made by the Evaluator throughout the report as well as the sections where the recommendations originated. Sections Recommendations Executive Summary 1. Complete a RETS...

AI summary The appendix includes three recommendations: using RETScreen simulations for accurate deemed savings, requiring solar installers to perform these simulations, and including participant surveys to estimate free-ridership if participation levels are high enough.

2.2.3 Interviews with Distributors In October 2012, 10 interviews were conducted with the participating distributors. These interviews were mainly used to establish the free-ridership. The questions were meant to estimate how the market wo...

AI summary In October 2012, 10 interviews were conducted with participating distributors to assess free-ridership and understand how the market would have reacted without the program. The interview guide is referenced in Appendix II.

2.2.5 Participant Survey A telephone survey with a total of 56 mail-in rebate participants was conducted by Econoler's subcontractor, Corporate Research Associates, Inc. (CRA), from its offices in Halifax. The interviews were conducted in...

AI summary A telephone survey was conducted with 56 mail-in rebate participants to gather feedback on the Business Energy Rebates (BER) program, focusing on free-ridership, program awareness, participant motivations, and satisfaction. The survey was carried out in 2012 using CATI technology and lasted an average of 13 minutes.

y working on this issue by making necessary adaptions to the DSMDS so that it will be possible to include in one report all the essential information needed for administration and evaluation purposes. The information in the Project Summary...

AI summary The text discusses updates to the DSMDS to improve reporting and evaluation, including the inclusion of project details and standardized fields. It also mentions the addition of participant responses to free-ridership questions for better monitoring and evaluation.

4.4 NET-TO-GROSS RATIO The NTGR evaluation for the mail-in rebate is based on a self-report approach which relies on a series of questions designed to measure the influence of the program on participants' decision to implement program-elig...

AI summary The section discusses the Net-to-Gross Ratio (NTGR) evaluation for a mail-in rebate program, using a self-report approach to measure the influence of the program on participants' decisions to implement energy efficiency measures. The NTGR is calculated as (1 - % free-ridership), incorporating an assessment of free-ridership.

4.4.1 Free-Ridership For the mail-in rebate approach, free-ridership can occur when participants declare they would still have implemented the energy efficiency measures in the absence of the program. Ref.: 5790 38 10 ADS ASSOCIÉS, "Évalua...

AI summary The document discusses free-ridership in energy efficiency programs, explaining how participants might have implemented measures without the program. It outlines methods used to measure free-ridership, including pre-screening questions and telephone surveys, and reports a stable free-ridership level of 18% since 2011.

4.4.2 NTGR Calculation Using the free-ridership level established, the NTGR value for the mail-in rebate approach has been estimated at 0.82. This value was applied to the gross savings calculation.

AI summary The NTGR value for the mail-in rebate approach is estimated at 0.82, which was used in the gross savings calculation based on the free-ridership level established.

5.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evaluation for instant rebate is aimed at determining the gross and net savings of this component of BER for 2012. Both energy and demand savings were considered in this evalua...

AI summary The impact evaluation for the instant rebate component of the Business Energy Rebates (BER) program in 2012 aimed to determine gross and net savings, considering energy and demand savings. Econoler analyzed parameters such as savings calculation methodology, diversity factor, interactive effects, and free-ridership. Monthly reporting sheets and distributor interviews were used to calculate net savings, including the Non-Technical Generation Ratios (NTGR).

5.4.1 Free-Ridership For the instant rebate, free-ridership corresponds to the natural market trend. Thus, the free-ridership assessment aims at estimating what would have been the sales of energy-efficient products in a market that evolve...

AI summary The free-ridership assessment for the instant rebate program evaluated how much of the energy-efficient product sales were due to the program versus natural market trends. The assessment focused on three lighting products and used in-depth interviews with distributors to estimate the program's influence on sales.

Table 37: Free-Ridership for Instant Rebate Product Free-Ridership Level High performance and low wattage T8 27% High performance electronic ballasts; 24% LED lighting systems 11% A level of free-ridership of 27 percent was calculated for...

AI summary Table 37 presents free-ridership levels for various energy-efficient lighting products, including high performance T8 lamps, electronic ballasts, and LED lighting systems. Free-ridership levels have increased for some products compared to last year, with LED lighting systems being evaluated for the first time in 2012.

5.4.2 NTGR Calculation The NTGRs were calculated using the free-ridership levels established for each product included in the analysis:

AI summary The NTGRs were calculated using free-ridership levels established for each product included in the analysis.

Table 38: NTGRs for Instant Rebate Product NTGR HP-T8 and RW-T8 lamps 0.73 High performance electronic ballasts 0.76 LED lighting systems 0.89 For the other products sold through the instant rebate approach, an NTGR of 1 has been used. The...

AI summary Table 38 lists the NTGRs for instant rebate products, including HP-T8 and RW-T8 lamps, high performance electronic ballasts, and LED lighting systems. Other products not introduced until late 2011, with low sales and concentrated distribution, were assigned an NTGR of 1 and excluded from the free-ridership assessment by Econoler.

APPENDIX VI – ALGORITHM FOR FREE-RIDERSHIP CALCULATION IF Pre-FR3 = Yes: FR2a. If your company had not participated in the program, what is the FR2a = (Answer x 10%) /2 likelihood that you would have installed exactly the same energy-effic...

AI summary This document outlines an algorithm used to calculate free-ridership in energy efficiency programs. It includes multiple questions and formulas to assess the likelihood that participants would have implemented energy efficiency measures without program incentives, and how program factors influence these decisions.

DEFINITIONS Base case A base case details the information on how assumed gross savings used in the tracking sheet have been established. Usually, these savings are calculated with a series of variables such as hours of operation, wattage o...

AI summary The text defines key terms related to energy efficiency and program evaluation, including base case, demand savings, distortion effects, and net-to-gross ratio. It outlines concepts such as free-ridership, interactive effects, and evaluated savings, which are important for assessing the impact of energy efficiency programs.

Table 1: Distortion Effects and Net-to-Gross Ratio Distortion Factors 2012 Free-Ridership Level 9% Spillover Level 0% Net-to-Gross Ratio 0.91 Ref.: 5790 ix

AI summary Table 1 presents distortion effects and the Net-to-Gross Ratio for 2012, including a free-ridership level of 9%, a spillover level of 0%, and a Net-to-Gross Ratio of 0.91.

Table 2: 2012 Net Savings at the Generator of Custom Retrofit Initial Gross Savings Adjusted Gross Savings NTGR Net Savings Energy Savings Tracked Savings from ENSC 32.536 GWh 31.885 GWh 0.93 29.653 GWh Evaluation Results 32.536 GWh 31.803...

AI summary The table shows energy and demand savings from the Custom Retrofit program in 2012, with adjusted gross savings slightly lower than those tracked by ENSC. Adjustments were made due to minor issues in calculations and discrepancies found during on-site visits. The net savings were 2.4% lower than ENSC's figure due to a higher free-ridership level in 2012, but the evaluator believes free-ridership remains under control.

1.2 PROGRAM ELIGIBILITY As stated in its program manual, project sites eligible to participate in Custom Retrofit must be institutional, charitable, commercial or industrial facilities. Eligible accounts typically have a peak electricity d...

AI summary The Custom Retrofit program outlines eligibility criteria for institutional, charitable, commercial, and industrial facilities with a peak demand of 250 kW or higher. Projects must have electricity savings of more than 20 MWh per year and cannot include energy from non-utility sources. Eligible costs include engineering fees, equipment, installation, and HST. Free-ridership screening is part of the selection process.

2.2.5 Participant Survey A telephone survey with a total of 27 program participants was conducted by Econoler's subcontractor, Corporate Research Associates, Inc. (CRA), from its offices in Halifax. The interviews were conducted in Novembe...

AI summary A telephone survey of 27 program participants was conducted by CRA in November 2012 to gather feedback on the Custom Retrofit program, focusing on spillover, free-ridership, awareness, motivations, satisfaction, and recommendations for improvement.

4.1 OBJECTIVES AND APPROACH OF THE IMPACT EVALUATION The Custom Retrofit impact evaluation aims at determining the gross and net savings for the year of 2012. Both energy and demand savings were considered in this evaluation. To do so, Eco...

AI summary The Custom Retrofit impact evaluation for 2012 determined gross and net energy and demand savings by analyzing project documents, on-site visits, and participant surveys. Adjustments were made using an overall adjustment factor and NTGR to account for free-ridership and internal spillover effects.

APPENDIX VI – ALGORITHM FOR FREE-RIDERSHIP CALCULATION FR2a. If your company had not participated in the program, what is the likelihood that you would have implemented exactly the same energy efficiency measures that you implemented throu...

AI summary This appendix outlines an algorithm for calculating free-ridership in energy efficiency programs. It includes two questions (FR2a and FR2b) with scales from 0 to 10, used to assess the likelihood of implementing energy efficiency measures without program participation and the likelihood of installing standard equipment instead of energy-efficient equipment.

PA4 Score: FR2cc Final Free-Ridership MEAN VALUE OF: (PA1 ; PA2 ; PA3 ; PA4) Inconsistency Test #1 IF ABS(FR2a – FR2b) ≥ 30%: PA1 = MIN OF (FR2a ; FR2b) Inconsistency Test #2 IF FR3 ≥ 70% AND IF (FR2a OR FR2b < 70%: PA2 = EMPTY Revised Fre...

AI summary This section outlines the calculation and evaluation of free-ridership mean values for PA1 to PA4, including two inconsistency tests. The first test checks for a 30% difference between FR2a and FR2b, while the second test evaluates conditions based on FR3 and FR2a or FR2b thresholds.

2.2.3 On-Site Visits In November 2012, 10 on-site visits were conducted at facilities that had participated in NC 1 . These on-site visits were conducted by Econoler's subcontractor, Equilibrium Engineering. These site visits helped to val...

AI summary In November 2012, 10 on-site visits were conducted at facilities that participated in NC projects to validate the technical specifications and operation schedule of new energy-efficient equipment. In-depth interviews were also conducted to collect information on free-ridership. Protocols for these visits are included in Appendix II.

4.1 OBJECTIVES AND APPROACH OF THE IMPACT EVALUATION The impact evaluation for NC is aimed at determining the gross and net savings of this program for 2012. Both energy and demand savings were examined in this evaluation. To do so, Econol...

AI summary The impact evaluation for NC in 2012 aimed to determine gross and net energy and demand savings. Econoler analyzed feasibility studies, design validation reports, and conducted on-site interviews to assess free-ridership. Gross savings were calculated using project-specific parameters, and the net savings were determined using the NTGR based on interview data.

4.4 NET-TO-GROSS RATIO The NTGR evaluation of the program is based on a self-report approach which relies on a series of questions designed to measure the influence of the program on participants' decision to implement program-eligible ene...

AI summary The net-to-gross ratio (NTGR) for the program is calculated as (1 – % free-ridership), based on self-reported data from participant interviews assessing the influence of the program on energy efficiency design decisions in newly constructed buildings.

4.4.1 Free-Ridership In NC, free-ridership occurs when participants declare they would still have implemented the energy efficiency measures within their new building design in the absence of the program. Econoler evaluated the free-riders...

AI summary The document discusses the assessment of free-ridership in the Nova Scotia Conservation Program (NC) through in-depth interviews with participants. Econoler evaluated the extent to which participants would have implemented energy efficiency measures without the program, leading to a calculated free-ridership level of 26 percent.

CONCLUSION The program saw a total of 8 projects implemented for the year of 2012, which is similar to the number of projects in 2011 (9). This year's evaluation also revealed that NC generated net energy savings of 4.644 GWh at the genera...

AI summary In 2012, the program implemented 8 projects, achieving net energy savings of 4.644 GWh and net peak demand savings of 0.525 MW. The evaluation used on-site visits and participant interviews to calculate gross and net savings, considering free-ridership to establish an appropriate NTGR.

APPENDIX III – ALGORITHM FOR FREE-RIDERSHIP CALCULATION A5. In the absence of the program, what is the likelihood that you would have implemented exactly the same energy efficiency measures in your new building that you implemented through...

AI summary This appendix outlines an algorithm for calculating free-ridership in energy efficiency programs. It includes a series of questions and scoring mechanisms to assess the likelihood of implementing energy efficiency measures without program incentives and to determine the influence of program and non-program factors on decision-making.

2.2.4 Participant Survey A telephone survey with a total of 151 program participants was conducted by Econoler's subcontractor, Corporate Research Associates, Inc. (CRA), from its offices in Halifax. The interviews were conducted in Novemb...

AI summary A telephone survey of 151 program participants was conducted in November 2012 by CRA to assess program features such as spillover, free-ridership, awareness, participant motivations, satisfaction, and recommendations for improvements. The survey used CATI technology and took an average of 11 minutes per interview.

5.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION This Impact Evaluation section aims at determining the gross and net savings of CDI for 2012. Both energy and demand savings are considered in this evaluation. To do so, the following par...

AI summary This section outlines the approach used to evaluate the impact of the Commercial Demand Initiative (CDI) in 2012, focusing on energy and demand savings. Econoler analyzed factors such as unitary savings values, installation rates, interactive effects, and free-ridership, using data from program tracking sheets, literature, on-site visits, and participant surveys to calculate net savings.

5.5.1 Free-Ridership Free-ridership occurs when participants declare that they would still have installed the energy-efficient products in the absence of the program. The telephone survey included a number of free-ridership questions that...

AI summary The text discusses free-ridership in energy efficiency programs, specifically the Commercial Demand Improvement (CDI) program in 2012. It outlines survey methods to measure free-ridership and reports a 13% free-ridership level for CDI, lower than the 15% in the 2011 evaluation. Changes in product mix, such as the inclusion of high-end products like LED lamps, are suggested as a reason for the lower free-ridership rate.

5.5.2 NTGR Calculation Using the free-ridership of 13 percent established for this evaluation, the NTGR value for CDI is estimated at 0.87.

AI summary The NTGR value for CDI is estimated at 0.87, calculated using a free-ridership rate of 13 percent established for this evaluation.

Free-Ridership SBES (Series FRS) [ASK THIS SECTION TO RESPONDENTS FROM THE SBES COMPONENT ONLY] The following questions will be about the lighting measures, such as T8 fluorescent lamps, compact fluorescent light bulbs and L-E-D lamps that...

AI summary This section of the regulatory proceeding focuses on assessing free-ridership in the Small Business Energy Solutions (SBES) program by asking participants whether they had plans to install energy-efficient lighting before joining the program and what actions they would have taken in its absence.

SBES Component FR1. Before participating in SBES, did your company have plans to install the specific energy-efficient lighting products that were installed through SBES? IF 1. Yes: Use FR1a IF 2 OR 9 : FR1 = 0% FR1a. I just want to make s...

AI summary The text outlines a series of questions and formulas used to assess free-ridership in the SBES program, focusing on whether companies would have installed energy-efficient lighting products without the program's incentives and the timing of such installations. It includes scoring mechanisms and consistency tests to evaluate the impact of the program.

Final Free-Ridership (PA1; PA2; PA3; PA4) Inconsistency Test #1 IF ABS(FR2a – FR2b) ≥ 30%: PA1 = MIN OF (FR2a; FR2b) Inconsistency Test #2 IF FR3 ≥ 70% AND IF (FR2a OR FR2b) < 70%: PA2 = EMPTY

AI summary This document outlines two inconsistency tests related to free-ridership calculations. The first test compares FR2a and FR2b, and if their difference is 30% or more, PA1 is set to the minimum of the two. The second test checks if FR3 is 70% or higher and if either FR2a or FR2b is below 70%, in which case PA2 is set to empty.

Revised Free-Ridership MEAN VALUE OF: (PA1; PA2; PA3; PA4)

AI summary The document introduces a revised free-ridership calculation, referencing multiple data points (PA1 to PA4) and including a visual representation on page 56.