E-52018 DSM Evaluation Reports
106 passages
Phone Surveys Between September and December 2018, CRA conducted phone surveys with participants of four program components. The contents of the surveys varied from one program component to another. The surveys were used to collect informa...
AI summary CRA conducted phone surveys between September and December 2018 with participants of four program components to gather data on participation motivations, barriers, satisfaction, recommendations, free-ridership, demographics, and program effectiveness, focusing on energy efficiency initiatives managed by ENS.
Intercept Survey As part of the Instant Savings evaluation, an in-store intercept survey was conducted with participants who purchased eligible LED lamps and fixtures. The in-store interviews were conducted throughout the 2018 fall campaig...
AI summary An intercept survey was conducted during the 2018 fall campaign to evaluate Instant Savings, focusing on LED purchases, consumer awareness, and free-ridership. The survey involved 194 participants across five retail chains, gathering insights on product usage, program awareness, and in-store experiences.
3.2 Net-to-gross Ratio The NTGRs, outlined in Table 5 and Table 6 above, were applied to the gross savings to estimate net savings. NTGRs were established based on the levels of free-ridership and, in some cases, spillover. NTGR estimation...
AI summary This section discusses the calculation of the net-to-gross ratio (NTGR) used to estimate net savings from energy efficiency programs. The NTGR accounts for free-ridership and spillover effects, with free-ridership levels determined through surveys and interviews. Spillover was assessed by evaluating additional energy efficiency measures taken by participants and market effects for specific programs like Instant Savings and New Home Construction.
Table 7: 2018 Free-ridership, Spillover and NTGRs Program Component Free ridership Levels Spillover Levels NTGR Refrigerators - 0.57 Freezers - 0.48 Air Conditioners - 0% 0.53 Appliance Retirementa Small Refrigerators - 0.69 Small Freezers...
AI summary Table 7 presents free-ridership levels, spillover levels, and NTGRs for various energy efficiency programs in 2018. It highlights varying levels of free-ridership across different appliance categories and participant groups, with some programs showing high free-ridership and others showing no calculated free-ridership.
Residential programs achieved 37.668 MW in net peak demand savings at the generator during the 2016-2018 period. Programs exceeded peak demand savings targets except for Existing Residential. Nonetheless, Existing Residential represented o...
AI summary Residential and BNI programs achieved significant energy and peak demand savings during 2016-2018. Efficient Product Rebates exceeded targets by over 60%, while other programs like Custom Incentives and Direct Installation underperformed but were offset by these successes. The success is attributed to the popularity of LED products and effective delivery channels, despite challenges like high free-ridership.
Instant Savings: LED lamps ENS has been active in the Nova Scotia residential LED market since 2011 through Instant Savings. A socket study conducted in 2016 indicated that residential LED lamp socket saturation was 21 percent for permanen...
AI summary ENS has been promoting LED lamp adoption in Nova Scotia through the Instant Savings program since 2011. LED lamp shipments to Atlantic Canada increased significantly between 2016 and 2017, with A-type bulbs dominating. Prices have decreased over time, and the market is approaching maturity. A-type lamps are now more competitive, leading to the removal of rebates in 2019. A 39% free-ridership level was identified in 2018.
Business Energy Rebates: LED Lighting ENS has been active in the LED market of the BNI sector through Business Energy Rebates since 2010. Following a similar trend as the residential market, the share of LED technology among lighting shipm...
AI summary ENS has been providing Business Energy Rebates for LED lighting in the BNI sector since 2010. The LED market has grown significantly, with 56% of lighting shipments being LED in 2017. Prices have declined, and LED products are widely available. Free-ridership for LED products ranged between 29 and 37% in 2018. ENS plans to remove certain LED products from the rebate program as they approach maturity, while LED linear fixtures remain in a growth phase.
Margin of Error of the Free-ridership Levels The Evaluator used the margin of error calculation of the free-ridership level for biomass and solar measures installed through Green Heat in 2017 as an example. Below are the steps followed to...
AI summary The Evaluator used the margin of error calculation of the free-ridership level for biomass and solar measures installed through Green Heat in 2017 as an example to illustrate the methodology used.
Calculation of the Weighted Average of Free-ridership Levels The weighted average was calculated by using the following formula: $$Weighted\ Average\ FR = \frac{\sum_{i=1}^{N} Free\ Ridership\ Level_i \times Revised\ Gross\ Energy\ Savings...
AI summary The weighted average free-ridership level was calculated using a formula that multiplies each participant's free-ridership level by their revised gross energy savings, then divides the sum by the total revised gross energy savings. The result was 36%.
Calculation of the Weighted Standard Deviation Since the free-ridership level is based on a weighted average, the Evaluator used the weighted standard deviation of the free-ridership for the calculation instead of the standard deviation. T...
AI summary The weighted standard deviation of free-ridership was calculated using a specific formula, resulting in a value of 26.2 percent for biomass and solar measures. This approach was used instead of the standard deviation due to the weighted average nature of the free-ridership level.
Calculation of the Margin of Error The margin of error of the free-ridership level of biomass and solar measures was established by using the following formula, which applies to samples drawn from a small population: Margin of Error $$FR =...
AI summary The margin of error for the free-ridership level of biomass and solar measures was calculated using a specific formula with a sample size of 16 and a population size of 86, resulting in a margin of error of ±4.9%. Certain program components were excluded from this calculation due to various reasons, including nil free-ridership levels or lack of measurement.
APPENDIX III NTGR CALCULATIONS This appendix provides some examples to illustrate the Evaluator's calculations of free-ridership, participant spillover and net-to-gross ratio values in the 2018 evaluation. To demonstrate how to apply the a...
AI summary This appendix provides examples of free-ridership, participant spillover, and net-to-gross ratio calculations from the 2018 evaluation, using the EPI program component and Custom Retrofit service as examples. Similar methods were applied to other program components, with more details available in individual program evaluation reports.
Executive Summary – Appendix Report NTGR calculation for non-low-income part ticipants, LED lighting ree-ridership level (%) for LED lighting, for owners $FR_{LED,owners} =$ $= \frac{\sum_{i=1}^{n} (FR_i \times Gross_Savings_i)}{\sum_{i=1}...
AI summary This section presents calculations related to free-ridership and spillover effects for LED lighting programs, including the NTGR (Net-to-Gross Evaluation) for non-low-income participants and overall LED lighting. The free-ridership level for owners is 23%, spillover level for owners is 3%, and the NTGR for LED lighting is calculated as 0.80 for non-low-income participants and 0.86 overall.
Custom Retrofit PA4 Score FR2c - 0% - 20% - 30% Inconsistency Test PA1 IF ABS(FR2a - FR3) ≥ 50%: PA1 = MIN OF (FR2a ; FR3) - 20% - 45% - 30% Inconsistency Test PA2 IF FR1c = 100% AND FR2a OR FR3 < 70%: PA2 = EMPTY - 0% - 0% - 0% Free-rider...
AI summary The table presents data on a custom retrofit program, including scores and tests related to participation and free-ridership. It includes percentages for various tests and factors influencing participation in energy efficiency programs.
Evaluation of 2018 DSM Programs Efficiency Nova Scotia Executive Summary – Appendix Report Overall free-ridership level (%) for the program component $$FR_{category} = \frac{\sum_{i=1}^{n} (FR_i \times Gross_Savings_i)}{\sum_{i=1}^{n} Gros...
AI summary The document presents a formula to calculate the overall free-ridership level for the 2018 DSM programs in Efficiency Nova Scotia. It defines free-ridership as the percentage of energy savings that are not captured due to participant behavior, calculated across three categories: Audit, DIY-Lighting, and DIY-HVAC.
ARet Energy Savings For the 2018 evaluation, the Evaluator revised the unitary savings values of appliances retired through ARet and HomeWarming using a methodology similar to that used in previous evaluations, except that induced consumpt...
AI summary The 2018 evaluation of ARet Energy Savings revised unitary savings values for retired appliances, using 2017 metering data due to inconsistencies in 2018 data. Net unitary savings for refrigerators and freezers decreased, while those for air conditioners and small appliances increased. The equivalent net-to-gross ratio (NTGR) was calculated using updated free-ridership and spillover values.
Unitary Savings Review For ARet, the Evaluator reviewed the unitary savings of the retired refrigerators, freezers, air conditioners and small appliances based on the metering data collected by ENS and information found in the literature o...
AI summary The Unitary Savings Review assesses energy savings from appliance retirements through data collected by ENS and ARet. It considers factors like free-ridership and secondary market impacts, and uses survey data to calculate net energy savings per unit. The review includes data from 4,633 participants who retired at least one appliance.
Table 12: Final Energy Consumption Values for Refrigerators Measured Consumption (kWh/year) Part-use Factor Final Consumption (kWh/year) Retired Refrigerators 982 0.70 687 Replacement Refrigerators 378 0.70 265 Two effects were considered...
AI summary Table 12 shows energy consumption values for retired and replacement refrigerators, with 687 kWh/year and 265 kWh/year respectively. Net unitary savings of 389 kWh per retired refrigerator were calculated, considering free-ridership and secondary market impacts.
9.2.1 Free-ridership In the case of Instant Savings, the Evaluator assessed the free-ridership level by determining which LED lamps would still have been bought by participants in the absence of the program component. The free-ridership le...
AI summary The free-ridership level for LED lamps sold through Instant Savings in 2018 was 39%, higher than 32% in 2017. The assessment used a self-reporting approach and an algorithm that considers variables like awareness of discounts and purchase intent. Free-ridership for other products rebated through Instant Savings was considered nil, though future assessments may need to include these products.
9.2.3 NTGR Calculation The NTGR is calculated using the following equation: $$NTGR = (1 - \% \text{ free-ridership} + \% \text{ spillover})$$ Using this equation, the NTGR for LED lamps was estimated at 0.86. For all other products, a NTGR...
AI summary The NTGR is calculated using an equation that accounts for free-ridership and spillover effects. For LED lamps, the NTGR was estimated at 0.86, while a NTGR of 1.00 was used for all other products due to the difficulty in assessing free-ridership and spillover for non-LED products.
10.2 Measured Free-ridership The Evaluator analyzed the free-ridership level to gain insights into the evolution of LED lamp market adoption in Nova Scotia. The 2018 intercept survey revealed a free-ridership level of 39 percent for LED la...
AI summary The Evaluator analyzed free-ridership levels for LED lamps sold through the Instant Savings program in Nova Scotia. In 2018, the free-ridership level was 39 percent, a 7 percent increase from 2017 but only marginally higher than the 37 percent in 2015.
Table 44: Free-ridership Level for LED Lamps Free-ridership 2015 2016 2017 2018 ENERGY STAR Certified LED Lamps 37% 33% 32% 39% 33 The Energy Efficiency Regulation on general-service lamps covers most A-type lamps. Natural Resources Canada...
AI summary Table 44 presents the free-ridership level for ENERGY STAR Certified LED Lamps from 2015 to 2018, showing varying percentages across the years. The footnote references the Energy Efficiency Regulation on general-service lamps and a report by Natural Resources Canada.
APPENDIX III ARET: ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess if each participant wo...
AI summary This appendix outlines an algorithm for calculating free-ridership in the Appliance Retirement (ARET) program. The algorithm includes survey questions to determine whether participants would have disposed of their appliances without the program's influence.
Free-ridership Free-ridership corresponds to the energy consumption of appliances that would have been disposed of in the absence of ARet. It does not include the consumption of those appliances that would have been transferred to other ow...
AI summary Free-ridership refers to energy consumption from appliances that would have been disposed of without the Appliance Retirement (ARET) program. The Evaluator surveyed participants to determine their disposal actions, such as selling, donating, or recycling, to assess free-ridership. A table summarizes these scenarios and identifies free-riders.
Net Unitary Savings Two effects were considered to calculate the net unitary savings for freezers, namely free-ridership and secondary market impacts. These two effects are examined below.
AI summary The calculation of net unitary savings for freezers considers two effects: free-ridership and secondary market impacts. These factors are analyzed to determine the overall savings.
Net Unitary Savings Two effects were taken to calculate the net savings value for retired air conditioners, namely freeridership and secondary market impacts, as described below. 17 Ecox, Technical Information Bulletin No. E-004-EN: SEER,...
AI summary The calculation of net unitary savings for retired air conditioners considers two factors: freeridership and secondary market impacts. References to technical documents and program requirements are provided for context.
Free-ridership Table 19 presents the discarding scenarios and the proportion of participants who would have disposed of their air conditioners without the program component. These participants are identified as free-riders.
AI summary Table 19 outlines scenarios for discarding air conditioners and identifies participants who would have disposed of them without the program, labeled as free-riders.
Free-Ridership (FR Series) [READ FOLLOWING SENTENCE IF I1a=1 and 2] The next series of questions is specifically about the non-pear-shaped L-E-D bulbs you purchased.
AI summary The text discusses a series of questions related to non-pear-shaped LED bulbs purchased, specifically under the Free-Ridership (FR Series) context. It includes a conditional instruction based on the value of I1a.
APPENDIX XII IS: ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating free-ridership levels. The participant survey questionnaire included questions designed to assess the planning, quantity, eff...
AI summary This appendix describes an algorithm for calculating free-ridership levels in a program, using participant survey data to assess program components. The algorithm accounts for different baseline scenarios and excludes cases where no energy savings were generated.
Section 1 - Free-ridership level for those who were unaware of discount before paying FR0a. Before paying at the cash register, were you aware that a discount was offered on the purchase of L-E-Ds? IF Yes: GO TO Section 2 IF No OR REF: Ask...
AI summary This section of the proceeding asks respondents whether they were aware of a discount on LED purchases before paying at the cash register. If they were not aware, it is considered a case of free-ridership, where individuals benefit from a program without prior knowledge of its existence.
PA1 Score: FR0b Free-Ridership Level for those who were unaware of discount before paying PA1 OTHERWISE: GO TO Section 2
AI summary This section discusses the PA1 score related to free-ridership level for individuals who were unaware of a discount before paying, directing to Section 2 for further details.
PA3 Score: FR5 Free-Ridership Level for those who postponed their purchase because of the program MEAN VALUE OF (PA2;PA3) OTHERWISE GO TO Section 3
AI summary This section discusses the PA3 Score, focusing on the free-ridership level for individuals who postponed purchases due to a program. It references the mean value of PA2 and PA3 scores and directs to Section 3 for further information.
Section 3 - Free-ridership level for regular participants (aware of discount, did not postpone purchase) FR3. How likely would you have been to buy the L-E-Ds that you purchased today if You had to pay the full price? (Scale 0 to 10) FR3 =...
AI summary This section examines the free-ridership level for regular participants who were aware of a discount but did not postpone their purchase. It includes questions about likelihood of purchase at full price and alternative bulb choices if the discount was not available.
PA6 Score: Inconsistency Test #1 FR5 IF FR3 ≥ 70% AND FR2a-b = 0%: PA4 = EMPTY IF FR3 ≤ 30% AND FR5 ≥ 50% PA6 = EMPTY Inconsistency Test #2 MEAN VALUE OF: (PA4; PA5; PA6) Free-Ridership Level (after inconsistency tests) for regular partici...
AI summary This section outlines two inconsistency tests for PA6 Score calculations. The first test checks conditions involving FR3, FR2a-b, and PA4, while the second calculates the mean value of PA4, PA5, and PA6. These tests are used to determine the free-ridership level for regular participants.
HEA Energy Savings The objective of the 2018 HEA impact evaluation was to determine net energy and peak demand savings. To calculate gross savings, the Evaluator reviewed the contents of the 2018 tracking sheet. The Evaluator employed the...
AI summary The 2018 HEA impact evaluation calculated net energy and peak demand savings using updated ORs and unitary savings values. The evaluation did not update free-ridership or spillover levels due to recent HEA changes, so 2017 levels were used. A NTGR of 0.76 was applied based on 2017 data.
Table 2: HEA Net-to-gross Ratio 2017 Free-ridership Level 25% Spillover Level 1% Net-to-gross Ratio 0.76 Another spillover effect, associated with unconverted D assessment savings, was also considered in the net energy and peak demand savi...
AI summary Table 2 presents the HEA Net-to-gross Ratio for 2017, with a free-ridership level of 25% and a spillover level of 1%. The net-to-gross ratio is 0.76. A spillover effect from unconverted D assessment savings is also noted, contributing 0.836 GWh and 0.236 MW in energy and peak demand savings.
Green Heat Energy Savings To calculate Green Heat gross energy savings, the Evaluator reviewed the unitary savings values used for each type of equipment category based on the information in the tracking sheet, site visit results, literatu...
AI summary The Evaluator calculated Green Heat energy savings by reviewing unitary savings values, site visits, and billing analysis. Discrepancies were found in tracked data, particularly for MSHPs and ASHPs, leading to adjustments in savings estimates. Free-ridership levels increased significantly in 2018 due to a new delivery mechanism, with 54% of MSHP participants already deciding to install equipment before the program.
EPI Energy Savings To calculate EPI gross energy savings, the Evaluator performed a literature review of the unitary savings values of each category of product tracked and installed through EPI. The Evaluator found that the values used to...
AI summary The Evaluator calculated EPI gross energy savings by reviewing unitary savings values for various products and updating them based on new data. Installation rates for certain products were adjusted, and the NTGR was determined to estimate net energy savings, with different values for low-income and non-low-income participants.
2 HEA EVALUATION OBJECTIVE AND METHODOLOGY The main objective of the HEA evaluation is as follows: › Calculating program results, namely electrical first-year and lifetime energy savings, peak demand savings, and avoided GHG emissions This...
AI summary The HEA evaluation aims to calculate program results, including energy savings and GHG emissions. The methodology involves reviewing program documentation, meeting with the program manager, and collecting data through structured instruments. The evaluation also calculates margins of error for free-ridership and spillover levels to ensure the precision of quantitative results.
Table 17: Average Free-ridership Level for HEA Average Free-ridership Level Sample Size Population Size Margin of Error 25% 61 931 5.2% 3.3.2 Participant Spillover
AI summary Table 17 provides the average free-ridership level for HEA at 25% with a sample size of 61 and a margin of error of 5.2%. Section 3.3.2 discusses participant spillover, which refers to the impact of program participation on non-participants.
In 2017, a participant survey was used to assess participant spillover, which occurs when participants implement additional energy efficiency measures recommended in their initial energy assessments after their participation in the program...
AI summary In 2017, a participant survey was conducted to assess participant spillover, which refers to the implementation of additional energy efficiency measures following initial energy assessments. No data collection was done in 2018 to update this level, so the 2017 level was used in the evaluation. Table 18 outlines the 2017 participant spillover level.
Participant Survey In October and November 2018, CRA conducted a telephone survey with 90 participants. The average length of the survey was 16 minutes. The questionnaire and complete survey results are presented in Appendices IV and V. Th...
AI summary In 2018, CRA conducted a telephone survey with 90 participants to gather feedback on the Green Heat Program, covering aspects such as program awareness, participation motivations, equipment usage, free-ridership, satisfaction, barriers to installation, and demographic information. The survey results are detailed in Appendices IV and V.
8.2.1 Free-ridership For Green Heat, free-ridership occurs when participants would still have installed a heating system in the absence of the program component. The free-ridership level was assessed using a self-reporting approach that in...
AI summary The free-ridership level for the Green Heat Program was assessed using a self-reporting approach through telephone surveys of participants. Different question sets were used based on the type of heating system installed, and the results were analyzed using algorithms in Appendix IX.
Fuel-switching Measure For biomass or solar heating systems, the questionnaire assessed the likelihood of participants replacing their electrical system with a non-electrical system in the absence of the program component. Additional quest...
AI summary The free-ridership level for biomass and solar heating systems increased significantly from 36% in 2017 to 58% in 2018, attributed to a new delivery mechanism that allows rebate claims after purchase, reducing reliance on ENS approval. This change impacted the influence of rebates and information provided by ENS on participant decisions.
Central Heat Pump Measure For centrally-ducted heat pump measures, the questionnaire assessed the likelihood of participants, in the absence of Green Heat, replacing their electrical heating system with a centrally-ducted heat pump of the...
AI summary The Central Heat Pump Measure evaluates free-ridership levels for centrally-ducted heat pumps, finding a 29% free-ridership rate, down from 44% in 2017. The decrease is attributed to a new 2018 survey question capturing the influence of retailer and contractor information on participant decisions.
MSHP Measure For MSHPs, which constitute by far the most popular Green Heat measure, the Evaluator assessed free-ridership by using two factors: (1) a first series of questions regarding participants' decision to install a heat pump instea...
AI summary The Evaluator assessed free-ridership for MSHPs by analyzing participants' decisions to install a heat pump and their influence from ENS programs. Results show 71% had already decided to install MSHPs before Green Heat, and free-ridership was 54%, highlighting ENS's influence on equipment choices.
Table 30: Average Free-ridership Level by Measure Category for Green Heat Measure Category Average Free ridership Level Sample Size Population Size Margin of Error Biomass and Solar Measures 58% 23 137 9.9% Centrally-ducted Heat Pumps 29%...
AI summary Table 30 presents the average free-ridership levels for different measure categories under the Green Heat Program. The data shows that biomass and solar measures have the highest free-ridership level at 58%, followed by MSHPs at 54%, and centrally-ducted heat pumps at 29%. The sample sizes and margin of error are also provided for each category.
8.2.2 Net-to-gross Ratio Calculation The NTGR was calculated using the following equation: $$NTGR = (1 - \% \text{ free-ridership})$$ Using the free-ridership levels established for each measure type, the NTGR value was established at 0.42...
AI summary The Net-to-gross Ratio (NTGR) was calculated using a formula that accounts for free-ridership levels. The NTGR values vary by measure type, with values ranging from 0.42 for biomass and solar measures to 1.00 for heat pump water heaters (HPWHs).
9.2.7 Measured Free-ridership The MSHP free-ridership level was established at 54 percent in 2018, compared to 51 percent in 2017.29 As discussed in Subsection 8.2.1, one factor contributing to the high overall free-ridership rate was that...
AI summary The free-ridership level for the MSHP program was 54% in 2018, up from 51% in 2017. A significant portion of participants had already decided to install MSHPs before learning about the Green Heat program. A distributor noted that factors like weather and equipment reliability, rather than incentives, influenced consumer decisions.
Participant Survey In October 2018, CRA conducted a telephone survey with a total of 100 non-low-income participants39 comprising 70 owners and 30 tenants. The average length of the survey was 18 minutes. The questionnaire and complete sur...
AI summary A telephone survey conducted by CRA in October 2018 with 100 non-low-income participants assessed feedback on the Efficient Product Installation (EPI) program, including installation satisfaction, barriers to energy efficiency upgrades, and recommendations for improvement. The survey aimed to evaluate free-ridership and spillover effects.
13.2.1 Free-ridership For EPI, free-ridership occurs when participants would have installed the energy efficient products in the absence of the program component. The free-ridership level was assessed using a self-report approach that invo...
AI summary This section discusses the assessment of free-ridership in the Efficient Product Installation (EPI) program, focusing on LED lamps and low-flow showerheads. The free-ridership levels for these products were determined through a self-report approach using a telephone survey. Free-ridership levels were calculated separately for owners and tenants, with overall free-ridership levels of 16% for all non-low-income participants.
Table 48: Average Free-ridership Level by Product Category for EPI Non-low-income Participants Product Category Average Free ridership Level Sample Size Population Size61 Margin of Error Percentage of Gross Energy Savings LED Lighting Owne...
AI summary Table 48 presents the average free-ridership levels by product category for EPI non-low-income participants, showing varying levels of free-ridership across different product categories and participant types. The data includes metrics such as sample size, population size, margin of error, and percentage of gross energy savings.
Green Heat Green Heat achieved 4.227 GWh in net electrical energy savings and 4.042 MW in net peak demand savings in 2018, thus surpassing both the planned 3.7 GWh in electrical energy savings and the planned 3.8 MW in peak demand savings....
AI summary Green Heat achieved significant energy savings in 2018, surpassing planned targets. Factors like the removal of pre-approval and increased marketing contributed to higher participation. The program's evaluation highlighted the importance of contractor awareness and participant satisfaction, while also noting challenges with data accuracy in billing analyses.
Green Heat Appendix IV GH: Participant Survey Questionnaire Appendix V GH: Participant Survey Results Appendix VI GH: On-site Visit Sampling Methodology and Protocol Appendix VII GH: Distributors Interview Guide Appendix VIII GH: Savings R...
AI summary The 'Green Heat' section includes appendices related to a participant survey questionnaire, survey results, on-site visit sampling methodology, distributor interviews, savings reviews, free-ridership calculation algorithms, and 2018 recommendations.
Free-Ridership – Mini-split Heat Pumps [IF EQUIPMENT TYPE = MINI-SPLIT HEAT PUMPS (MSHP)] [FRM Series] Moving along to another topic… I would like to ask you a series of questions regarding your decision to install a high efficiency heat p...
AI summary The discussion focuses on free-ridership related to the installation of mini-split heat pumps, questioning the decision to install high efficiency heat pumps instead of other heating systems or maintaining existing ones.
Free-Ridership – Heat Pumps [IF EQUIPMENT TYPE = AIR-SOURCE HEAT PUMPS OR GROUND SOURCE HEAT PUMP] [FRH Series] FRH1. Moving along to another topic… Had you already decided to install a high efficiency [EQUIPMENT] before you heard about th...
AI summary The document discusses the topic of free-ridership in the context of heat pump installations, specifically asking if a high efficiency equipment was already decided upon before the Green Heat program was known.
Free-Ridership – Solar and Biomass [IF EQUIPMENT TYPE = Solar water heating, Wood Stove, Pellet Stove or Wood Boiler/ Furnace] [FRS Series] - FRS1. Moving along to another topic… Had you already decided to install a high efficiency [EQUIPM...
AI summary The document discusses a free-ridership issue related to the Green Heat program, specifically asking if a high efficiency [EQUIPMENT] was already planned before the program was known.
APPENDIX IX GH: ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figures below show the algorithm for calculating the free-ridership level for each type of measure. The participant survey questionnaire included questions designed to assess the...
AI summary This appendix outlines an algorithm for calculating free-ridership levels in energy efficiency programs. It discusses how participants' responses to surveys are converted into values that indicate program component attribution. The algorithm has two weighted portions for those who installed mini-split heat pumps, with different considerations for installation and purchase decisions.
Free-Ridership IF PA4 < MEAN (PA1; PA2; PA3): MEAN (PA1; PA2; PA3; PA4) OTHERWISE MEAN (PA1; PA2; PA3) CI2/4a. [Your previous participation in an ENS program]/[The energy efficiency promotional materials distributed by ENS] was a major fac...
AI summary The document discusses a revised free-ridership calculation method, incorporating customer interaction indicators (CI) based on participation in energy efficiency programs or exposure to promotional materials. The formula adjusts the free-ridership (FR) value depending on the CI score, reducing it by 25% or 50% for higher levels of engagement.
Free-Ridership IF PA4 < MEAN (PA1; PA2; PA3): MEAN (PA1; PA2; PA3; PA4) OTHERWISE MEAN (PA1; PA2; PA3) CI2/4a. [Your previous participation in an ENS program]/[The energy efficiency promotional materials distributed by ENS] was a major fac...
AI summary The text discusses free-ridership in the context of energy efficiency programs, using a formula to calculate participation based on responses to questions about the influence of promotional materials from ENS on the installation of energy-efficient heating systems.
Revised Free-Ridership IF CI=0 OR 1, Revised FR = FR IF CI=2, Revised FR = FR\ .75 IF CI=3, Revised FR = FR\ .50
AI summary The document presents a formula for revised free-ridership (FR) based on the value of CI (a parameter). If CI is 0 or 1, the revised FR remains unchanged. If CI is 2, the revised FR is 75% of the original FR. If CI is 3, the revised FR is 50% of the original FR.
Free-Ridership 0.75xPA1+0.25xPA2 CI2/4a. [Your previous participation in an ENS program]/[The energy efficiency promotional materials distributed by ENS] was a major factor in your decision to install a [EQUIPMENT] in your home. CI2/4b. [Y...
AI summary The text outlines a free-ridership calculation formula (0.75xPA1+0.25xPA2) and includes customer impact indicators (CI2/4a, CI2/4b, CI2/4c) related to participation in energy efficiency programs and their influence on decisions regarding heating equipment installation.
Revised Free-Ridership IF CI=0 OR 1, Revised FR = FR IF CI=2, Revised FR = FR\ .75 IF CI=3, Revised FR = FR\ .50
AI summary The document introduces a revised free-ridership formula based on the coefficient index (CI). If CI is 0 or 1, the revised free-ridership (FR) remains unchanged. If CI is 2, FR is reduced by 25%, and if CI is 3, FR is reduced by 50%.
Free-Ridership [FR Series] INSTRUCTION: FR SERIES SHOULD BE ASKED ONLY TO RESPONDENTS WHO INDICATED: ‐ "YES" IN V1a (LED Bulbs) OR ‐ "YES" IN V1e ( low-flow showerheads) AND IF Own/Rent = "OWN" IN DATABASE OTHERWISE, SKIP TO SO SERIES.
AI summary The Free-Ridership [FR Series] section outlines instructions for respondents to answer questions only if they indicated 'YES' in V1a (LED Bulbs) or 'YES' in V1e (low-flow showerheads) and own their residence. Otherwise, they should skip to the SO Series.
APPENDIX XV EPI: ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below presents the algorithm for calculating the free-ridership level. The participant survey questionnaire included questions designed to assess the planning, quantity,...
AI summary This appendix outlines an algorithm for calculating free-ridership in the context of ENS' energy efficiency programs, specifically the EPI Service. It includes survey questions designed to assess participant behavior and the influence of previous program participation on current energy efficiency decisions.
Revised Free-Ridership IF CI ≥ 7 AND CI < 9, Revised FR\ 75% IF CI ≥ 9, Revised FR\ 50%
AI summary The revised free-ridership calculation is based on the customer impact index (CI), with different percentages applied depending on whether CI is between 7 and 9 or 9 and above.
NHC Energy Savings The objective of the 2018 NHC impact evaluation was to establish net energy and peak demand savings. Prior to reviewing the gross savings calculations, the Evaluator reviewed the contents of the 2018 tracking sheet to en...
AI summary The 2018 NHC impact evaluation calculated net energy and peak demand savings by adjusting gross energy savings with overestimation ratios and applying net-to-gross ratios (NTGRs). Free-ridership and market effects levels from 2017 were used, resulting in NTGRs of 0.95 for NHC and 0.39 for the Passive House pilot. Net savings were determined as 4.481 GWh and 1.268 MW for NHC, and 0.035 GWh and 0.010 MW for the Passive House pilot.
4.3.1 Free-ridership Free-ridership occurs when participants would have still implemented energy efficiency measures in the absence of the program component. Free-ridership was assessed in 2017 for both NHC and the Passive House pilot thro...
AI summary Free-ridership refers to participants who would have implemented energy efficiency measures even without the program. In 2017, free-ridership was assessed for NHC and the Passive House pilot using participant surveys. No new data was collected in 2018 due to minimal changes in the program and similar participation patterns between homeowners and builders.
Average Free ridership Level Sample Size Population Size NHC – Homeowner Participants 26% 12 57 NHC – Participating Builders 29% 40 363 NHC – Combined (Homeowners + Builders) 29% 52 420 Passive House Pilot – Participants 61% 4 6 Table 16:...
AI summary Table 16 presents average free-ridership levels for the Nova Scotia Home Builders' Association (NHC) and Passive House Pilot participants, showing varying percentages across different participant groups.
4.3.3 NTGR Calculation The NHC NTGR is calculated using the following equation: NTGR = (1 – % Free-ridership + % Spillover (Market Effects)) By applying the free-ridership and spillover levels discussed in the previous subsections, the NTG...
AI summary The document explains the calculation of the Net Targeted Generation Rate (NTGR) for NHC and the Passive House pilot. The NTGR is calculated using free-ridership and spillover percentages, resulting in an NTGR of 0.95 for NHC and 0.39 for the Passive House pilot.
Table 18: Free-ridership for BER Instant Rebates 46 Table 19: NTGR for BER Instant Rebates 47 Table 20: Evaluated Net Energy and Peak Demand Savings for BER Instant Rebates 49 Table 21: Comparison of Tracked and Evaluated Savings at the Ge...
AI summary The document presents tables and figures related to the Business Energy Rebates (BER) program, including free-ridership analysis, net-to-gross ratios, energy and peak demand savings, rebate values, and participant satisfaction metrics. It evaluates the effectiveness and participation rates of the BER program from 2012 to 2018.
To establish the gross savings of Instant Rebates for 2018, the Evaluator reviewed the tracked savings to ensure that the recommended savings values from the 2016 evaluation were applied correctly and made only minor adjustments. Net savin...
AI summary The Evaluator calculated the net savings for Instant Rebates in 2018 by applying NTGRs to gross savings and measured free-ridership using surveys and interviews, resulting in an overall NTGR of 0.72 for energy savings.
Participant Survey In October and November 2018, CRA conducted a telephone survey with a total of 50 Instant Rebates participants. Of the 50 participants, 30 were end users who had purchased LED lighting measures for their own business and...
AI summary In October and November 2018, CRA conducted a telephone survey with 50 Instant Rebates participants to gather feedback on their reasons for participation, awareness of ENS rebates, and the influence of promotional materials. The survey aimed to understand decision-making processes and project types for eligible measures, with a margin of error of 11.8% at a 90% confidence level.
Interviews with Distributors In November 2018, CRA conducted 11 interviews with Instant Rebates participating distributors. These interviews mainly served to establish free-ridership levels for the highest-selling lighting measure categori...
AI summary In November 2018, CRA conducted interviews with Instant Rebates participating distributors to assess free-ridership levels, distributor satisfaction, and ways to improve the service. Distributors also provided feedback on incentive levels and the relationship between Mail-in and Instant Rebates programs.
Free-ridership In the case of Mail-in, free-ridership occurs when participants would have still implemented the energy efficiency upgrades and measures in the absence of the service. The assessment of the free-ridership level is based on a...
AI summary The document discusses the assessment of free-ridership in the Mail-in program, using a self-report approach through telephone surveys. The overall free-ridership level was found to be 17%, with a margin of error of 2.7%. This is higher than the 14% in 2017, and lighting measures had a free-ridership level of 12% in 2018, up from 8% in 2017.
NTGR Calculation The NTGR is calculated using the following equation: $$NTGR = (1 - \% Free-ridership + \% Spillover)$$ Based on the free-ridership and spillover levels established for BER Mail-in, the NTGR value was estimated at 0.83, as...
AI summary The NTGR is calculated as (1 - % Free-ridership + % Spillover). For BER Mail-in, with a free-ridership of 17% and spillover of 0%, the NTGR value is estimated at 0.83, as shown in Table 12.
Free-ridership For Instant Rebates, free-ridership corresponds to the proportion of savings that is due to natural market trends. Thus, the free-ridership assessment aims to estimate what the sales of energy efficient measures would have b...
AI summary The free-ridership assessment for Instant Rebates evaluates the proportion of energy savings due to natural market trends rather than the program. The Evaluator used surveys and interviews with participants and distributors to estimate this, focusing on LED lighting measures. The approach incorporates multiple methods to improve accuracy and defensibility of the NTGR estimate.
NTGR Calculation The NTGR is calculated using the following equation: $$NTGR = (1 - \% Free-ridership)$$ Using the free-ridership levels established in Subsection 5.2.1, NTGRs were established for the main measure categories. For the other...
AI summary The NTGR is calculated using the formula (1 - % Free-ridership), with free-ridership levels established in Subsection 5.2.1. A NTGR of 1.00 was applied to Instant Rebates, resulting in weighted overall NTGRs of 0.72 for energy savings and 0.74 for peak demand savings.
7.2 Evaluation Results The Evaluator looked at the unitary savings values and free-ridership levels to gain insights into the evolution of the LED BNI market in Nova Scotia.
AI summary The Evaluator analyzed unitary savings values and free-ridership levels to understand the development of the LED BNI market in Nova Scotia.
Free-ridership Levels For Instant Rebates, free-ridership corresponds to the proportion of savings that is due to natural market trends. The free-ridership levels were measured through in-depth interviews with distributors through the same...
AI summary The document discusses free-ridership levels for Instant Rebates, noting that they are measured through distributor interviews and end-user surveys. Free-ridership levels have remained relatively steady since 2016, with small decreases observed in 2018, particularly for LED measures, which ranged between 29 and 37 percent.
Table 25: LED Free-ridership Levels for BER Instant Rebates Measure Category 2012 2013 2014 2015 2016 2017 2018 LED Linear Fixtures - - - 25% 37% 32% 29% LED Downlight Fixtures19 11% 24% 35% 34% 37% 36% 34% LED Reflector Lamps - - 33% 34%...
AI summary This section presents a table showing the free-ridership levels for LED measures under the BER Instant Rebates program from 2012 to 2018. The data indicates the percentage of participants who may have benefited from the program without actively participating in the rebate process.
Free-Ridership (FR Series) FR1a. [ASK IF AWARE (P9=1 or P10=2)] before knowing that these products were rebated? Had you already decided to purchase [PRODUCT] 3. 4. Yes No 100. (Don't know) 101. (Refused) FR1b. those products? Had you alre...
AI summary The text presents a series of survey questions related to free-ridership, specifically focusing on whether respondents would have purchased energy-efficient products without rebates. It includes response scales and probing questions to assess customer behavior and decision-making in the absence of financial incentives.
APPENDIX XI BER :MAIL-IN ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below present the algorithm for calculating the free-ridership level of Mail-in measures, along with the participant survey questionnaire. The latter included que...
AI summary This appendix outlines an algorithm for calculating free-ridership levels in the Mail-in program, using participant survey responses. Questions assess whether participants would have implemented energy-efficient measures without the rebate, and whether they were aware of product standards. The algorithm helps determine the extent to which the program influenced participants' decisions.
Free-Ridership CI2/4a. [The company's previous participation in an ENS program]/[The energy efficiency promotional materials distributed by ENS] was a major factor in your decision to implement an energy-efficient measure. CI2/4b. [The com...
AI summary The text outlines a methodology for calculating free-ridership in energy efficiency programs, involving conditions based on company participation in ENS programs or exposure to promotional materials. It includes formulas for determining free-ridership (FR) and a revised FR calculation depending on the number of conditions met.
APPENDIX XV BER:INSTANT REBATES ALGORITHM FOR FREE-RIDERSHIP CALCULATION The figure below present the algorithms for calculating the free-ridership level of Instant Rebates measures, along with the participant survey questionnaire. The lat...
AI summary This appendix outlines the algorithm used to calculate free-ridership levels for Instant Rebates measures, including a participant survey questionnaire and distributor interview guide. The survey assesses variables like planning, quantity, efficiency, timing, cost, and program influence to determine program attribution and free-ridership levels.
PA4 Score: Min (FR3b; FR3c) Inconsistency Test PA1 IF ABS(FR3 - FR3a) ≥ 50% PA1 = MIN (FR3; FR3a) Inconsistency Test PA2 IF FR1 = 100% AND FR3 < 70% PA2 = EMPTY Free-Ridership IF PA4 < MEAN (PA1; PA2; PA3): MEAN (PA1; PA2; PA3; PA4) OTHERW...
AI summary The text outlines a set of calculations and tests related to free-ridership and program effectiveness, including the Inconsistency Test PA1, PA2, and the revised free-ridership formula. It includes questions related to the influence of energy efficiency promotional materials on decision-making and cost-effectiveness considerations.
This appendix summarizes all the recommendations made by the Evaluator as part of the 2018 evaluation, as well as all 2017 evaluation recommendations that were not fully implemented. Sections Recommendations 2017 Recommendation (Not fully...
AI summary This section discusses the 2017 evaluation recommendation that ENS should diversify its BER Mail-in program to include underrepresented BNI sectors, as lighting projects dominate savings and LED adoption may reduce future savings.
Retrofit Retrofit accounted for both 77 percent of Custom savings and 84 percent of Custom projects completed in 2018 (58 of the 69 projects with final savings being claimed in 2018). The number of completed projects increased with respect...
AI summary In 2018, Retrofit accounted for a large portion of Custom savings and projects. The evaluation noted improved documentation and participant satisfaction, but also identified issues with quality assurance, non-routine adjustments in M&V calculations, and peak demand savings adjustments. The free-ridership level was measured at 14 percent.
New Construction Impact Evaluation During the site visits, the Evaluator found that all energy efficiency measures had been implemented for the four visited projects. The energy savings were reduced by 36 percent for those four projects be...
AI summary The New Construction Impact Evaluation found that energy efficiency measures were implemented in four projects, but energy savings were reduced by 36% due to errors in energy models. Free-ridership was measured at 36%, and the NTGR applied was 0.64. The program generated 1.500 GWh in net electrical energy savings and 0.500 MW in net peak demand savings, avoiding 835 tonnes of CO2 eq annually.
EMIS Energy Savings To evaluate the energy savings, the Evaluator reviewed the preliminary project documentation provided by ENS to prepare a phone interview for the continuing participant and an on-site visit for the new participant. The...
AI summary The Evaluator reviewed EMIS Energy Savings project documentation and conducted interviews and on-site visits to validate energy savings calculations. The new participant used a building automation system for adjustments, leading to a more limited project scope. Savings were accurately tracked, and free-ridership and spillover effects were assumed to be nil due to low market penetration of energy management systems.
SEM Energy Savings To evaluate energy savings, the Evaluator reviewed the preliminary project documentation provided by ENS to prepare on-site visits and understand the key operating variables that had been chosen to create the regression...
AI summary The Evaluator assessed the energy savings from the Strategic Energy Management (SEM) program in 2018, finding that the tracked savings required minimal adjustments, primarily due to errors in ENS tracking. Peak demand savings were calculated by the Evaluator, and an average effective useful life of three years was applied to the savings. Free-ridership and spillover effects were assumed to be nil, but the Evaluator recommended continued monitoring. A special adjustment was made for a participant who installed high-efficiency lighting through Business Energy Rebates (BER) before starting SEM.
Project File Review and On-site Visits In the fall of 2018, Equilibrium and Technosim, a subcontractor of Econoler, carried out a full technical review of project documentation and on-site visits on a sample of 2018 Retrofit, New Construct...
AI summary In 2018, Equilibrium and Technosim reviewed 25 Retrofit, 4 New Construction, and 3 Building Optimization projects to assess free-ridership, participant satisfaction, and implementation barriers. On-site visits and interviews were conducted to validate technical specifications and collect data on project characteristics and operations.
4.2.1 Free-ridership In the case of Retrofit, free-ridership occurs when participants would have still implemented the energy efficiency upgrades and measures in the absence of the service. The free-ridership level was assessed using a sel...
AI summary Free-ridership in the Retrofit program was assessed through self-reporting during on-site interviews. The 2018 survey found a 14% free-ridership level, slightly higher than previous years. The assessment considered factors like prior ENS program participation and awareness efforts. An algorithm in Appendix VI was used to calculate the overall free-ridership level.
6.2.1 Free-ridership In the case of New Construction, free-ridership occurs when participants would have still implemented the energy efficiency measures in the absence of the service. The assessment of the free-ridership level is based on...
AI summary This section discusses the assessment of free-ridership in New Construction projects under the Energy Nova Scotia (ENS) program. A self-report approach was used, and an overall free-ridership level of 36 percent was calculated. Due to a small sample size, the margin of error could not be determined, but the free-ridership rate was applied to all 2018 projects. A different method was used between 2014 and 2017, which did not yield a free-ridership rate.
On-site Visits and Savings Review In the fall of 2018, the Evaluator carried out a review of project documentation for all SEM projects in preparation for site visits. The on-site visits, also performed in the fall of 2018, allowed the Eva...
AI summary In the fall of 2018, an Evaluator reviewed project documentation and conducted on-site visits for SEM projects to understand energy consumption drivers, validate energy models, and assess savings calculations. The visits also aimed to evaluate free-ridership and program satisfaction.
Custom Custom is comprised of the Retrofit, New Construction and Building Optimization services. Altogether, these services generated 11.603 GWh in net electrical energy savings and 1.200 MW in net peak demand savings at the generator in 2...
AI summary The Custom program, including Retrofit, New Construction, and Building Optimization services, achieved significant energy and peak demand savings in 2018. However, the Evaluator noted issues with documentation accuracy and free-ridership, particularly in New Construction, and recommended improvements in communication and process clarity.
Market Questions Satisfaction S1. rate your satisfaction with the Custom program overall? Using a scale from 1 to 10 where 1 is "not at all satisfied" and 10 is "completely satisfied" how would you S2. [IF S1<8] Why were you not more satis...
AI summary The text contains survey questions related to customer satisfaction with a Custom program and free-ridership inquiries. It includes questions about overall satisfaction, reasons for dissatisfaction, and whether energy efficiency measures would have been identified without support from an on-site energy manager.
Project Review Protocol The Evaluator modified the 2017 New Construction on-site visit and simulation review protocols for the 2018 evaluation. The protocols were merged into a single protocol that was used to prepare the on-site visits, c...
AI summary The Evaluator updated the 2017 New Construction on-site visit and simulation review protocols for 2018, merging them into a single document. The protocol includes key findings, energy savings adjustments, and details on building characteristics and efficiency measures. Site visits and follow-up calls were used to gather information and assess market evaluation and free-ridership.
APPENDIX VI CUSTOM: RETROFIT ALGORITHM FOR FREE-RIDERSHIP CALCULATION FR2a. If the program support or financial incentive had not been offered, what is the likelihood that you would have implemented exactly the same energy efficiency measu...
AI summary This section outlines a retrofit algorithm for calculating free-ridership in energy efficiency programs. It includes questions about the likelihood of implementing energy efficiency measures without financial incentives and whether the payback period would have been short enough for implementation.
PA4 Score: FR2c Inconsistency Test PA1 IF ABS(FR2a – FR3) ≥ 50%: PA1 = MIN OF (FR2a ; FR3) Inconsistency Test PA2 IF FR1c=100% AND FR2a OR FR3 < 70%: PA2 = EMPTY Free-Ridership IF PA4 < MEAN (PA1; PA2; PA3) FR = MEAN (PA1; PA2; PA3; PA4) O...
AI summary The text outlines a scoring system used to evaluate participation in energy efficiency programs, including factors like previous participation in ENS programs and the influence of promotional materials on decision-making. It includes formulas for calculating scores and determining free-ridership.
APPENDIX VIII CUSTOM: NEW CONSTRUCTION ALGORITHM FOR FREE-RIDERSHIP CALCULATION
AI summary This appendix presents a new algorithm for calculating free-ridership in the context of new construction. It is part of a regulatory proceeding and includes a visual representation of the algorithm.
APPENDIX XII SEM: ON-SITE VISIT PROTOCOL The 2018 SEM impact evaluation involved conducting on-site visits, including assessing free-ridership, satisfaction and barrier levels, as well as gathering insight on the persistency of savings for...
AI summary This appendix outlines the on-site visit protocol used during the 2018 SEM impact evaluation, which included assessing free-ridership, satisfaction, barriers, and the persistency of savings for SEM projects.
This appendix summarizes all the recommendations made by the Evaluator as part of the 2018 EMIS and SEM evaluations, as well as all 2017 evaluation recommendations that were not fully implemented. Sections Recommendations SEM Net-to-gross...
AI summary This appendix outlines recommendations from the 2018 EMIS and SEM evaluations, highlighting that one SEM participant had prior knowledge of strategic energy management but no immediate implementation plans. The Evaluator suggests ENS continue monitoring knowledge and interest in SEM to potentially address future free-ridership concerns.
Comparison with 2017 Evaluation Scope No participant survey was carried out for SBES in 2018; hence, the market evaluation scope was considered reduced for 2018. The impact evaluation scope was also considered reduced since the freeridersh...
AI summary The evaluation scope for the 2018 SBES program was reduced due to the absence of a participant survey and the lack of freeridership measurement. These changes were influenced by the evaluation objectives, previous results, and program updates. Further details are outlined in Section 1 of the DSM Programs Evaluation Executive Summary.
4.2.1 Free-ridership Free-ridership occurs when participants would have implemented energy efficiency upgrades in the absence of the program component. Free-ridership levels were assessed in 2017 using the results of a telephone survey wit...
AI summary Free-ridership levels for the Smart Building Energy Savings (SBES) program were assessed in 2017 through a telephone survey, with 7% for the audit path and 13% for the DIY path. These figures were reapplied in 2018 to calculate net evaluated savings, as shown in Table 9.
4.2.3 NTGR Calculation The NTGR for SBES was calculated using the following equation: NTGR = (1 – % Free-ridership + % Participant Spillover). By applying the free-ridership and spillover levels established for SBES, the NTGR was estimated...
AI summary The NTGR for SBES was calculated using an equation that factors in free-ridership and participant spillover levels. The estimated NTGR was 0.93 for the audit path and 0.87 for the DIY path.