Topic:"Program Evaluation" in M04819

Responsibility and accountability for the administration of DSM programs were transferred from Nova Scotia Power Inc. (NSPI) to ENSC effective October 1, 2010, with transfer of operational activities phased in during the fall of 2010. The...

AI summary Responsibility for DSM programs was transferred from NSPI to ENSC in 2010. ENSC submitted its first DSM Plan in 2011, which was approved by the UARB. ENSC also filed several reports and methodologies in response to UARB orders, including a free ridership and spillover study.

DATE FILED: February 27, 2012 Page 1 of 45 1 The June 30, 2011 UARB Order also directed ENSC to: 2 3  engage stakeholders regarding changes to the Program Development 4 Working Group (PDWG) or the creation of a new stakeholder process – 5...

AI summary The UARB directed ENSC to engage stakeholders regarding changes to the Program Development Working Group, meet quarterly with UARB staff, and provide enhanced information on rate and bill impacts for the 2013 DSM Plan. ENSC was also ordered to review cost allocation methodology and address three issues related to CFL disposal, financing, and savings evaluations.

1 [2010] NSUARB 155. 1 as part of its evaluation of 2011 DSM Programs; the results are documented in the 2011 2 DSM Evaluation Report filed separately. 3 4 The evaluated results for the ELI projects are: 154.2 GWh of energy savings, compar...

AI summary The 2011 DSM Programs achieved 154.2 GWh of energy savings and 17.8 MW of demand savings, exceeding preliminary estimates. The UARB approved up to $41.9 million for the 2011 DSM Plan, with actual expenditures totaling $35.8 million based on unaudited financial results. Figure 2.2 provides a breakdown of expenditures and energy savings by program category.

DATE FILED: February 27, 2012 Page 14 of 45 1  a management discussion and analysis of any major discrepancies relative 2 to the original plan's intent and forecasts 3  a summary of costs and savings for each program or target market are...

AI summary The document discusses recommendations for evaluating DSM program savings through a revised multi-year process, including ongoing tracking, free ridership surveys, and full-scale evaluations. It also proposes a trigger mechanism to ensure energy savings targets are met and outlines reporting requirements to the UARB and other stakeholders.

3.4 Quarterly Meetings and Reports ENSC recommends that it continue to meet quarterly with the UARB. Regular meetings with the DSM Advisory Group will provide ongoing opportunities to update stakeholders and discuss issues and concerns. Th...

AI summary ENSC proposes quarterly meetings with UARB and the DSM Advisory Group to update stakeholders, discuss issues, and provide status updates on the DSM Plan. Reports will highlight progress and communicate changes to the approved DSM Plan.

6. ENSC'S RESPONSE TO VERIFICATION CONSULTANT'S REQUESTS On January 9, 2012, the UARB directed ENSC to address, as part of its 2013 DSM filing, three issues arising from Dr. Peach's review of ENSC's Report on 2010 Evaluation and Verificati...

AI summary ENSC was directed by the UARB in January 2012 to address three issues in its 2013 DSM filing, stemming from Dr. Peach's review of ENSC's 2010 evaluation report and prior responses to information requests. The issues and ENSC's responses are detailed in the document.

ENSC's Response: ENSC recognizes that lack of financial capital may be a barrier to customers adopting energy efficiency measures. Removal of this barrier could increase participation in energy efficiency programs and therefore increase en...

AI summary ENSC acknowledges financial barriers to energy efficiency and proposes on-bill financing with NSPI and other partners. Discussions include expanding financing options, leveraging bank partnerships, and using rebates for mortgage down payments. Cost-benefit analyses will guide program implementation in 2012.

Dr. Peach states: In Response to IR-25, ENSC notes that it is seeking advice on a dual baseline approach from its evaluation consultant which, if appropriate, could be implemented as part of the evaluation of the 2012 programs. This is a r...

AI summary ENSC is considering implementing a dual baseline approach for evaluating 2012 programs, which compares energy savings from retrofitting new equipment against existing and current standard equipment. ENSC plans to develop this approach during 2012, acknowledging its complexity and commitment to its implementation.

ould occur whenever a replaced measure reaches the end of its EUL. Tracking these results as well as changes in common practices and standards would require a greater investment of time and resources. Application of dual baselines across t...

AI summary ENSC acknowledges the value of a dual baseline approach for DSM program evaluations but emphasizes the need for a measured implementation due to potential high costs and resource demands. The organization commits to further analysis in 2012 to assess feasibility, balancing accuracy gains against practical challenges.

and the economy, are not as readily understood by the general public. Efficiency Nova Scotia is committed to communicating these benefits, through education, community outreach and awareness-building. ENSC recognizes that, in the long term...

AI summary ENSC emphasizes the importance of public education and community engagement to drive energy efficiency in Nova Scotia. They aim to change energy culture through initiatives like the home energy report and community-based social marketing, building on the 2012 Plan to achieve long-term energy savings and societal norms.

8 10 11 12 13 Figures 1.2, 1.3 and 1.4 present program investment budgets, and the incremental annual GWh energy and the MW demand net savings at generator for 2013, 2014 and 2015, respectively. They also provide the lifetime total resourc...

AI summary The text discusses program investment budgets, energy and demand savings, and the results of the total resource cost (TRC) and program administrator cost (PAC) tests for 2013, 2014, and 2015. It presents net present value of avoided costs and benefit/cost ratios for each year.

Figure 1.2 - 2013 DSM Plan Savings and Investment 2013 Investment ($ million) Lifetime Benefits ($ million) a Incremental Annual Net Energy Savings at Generator (GWh) Incremental Annual Net Demand Savings at Generator (MW) Total Resource C...

AI summary Figure 1.2 presents the 2013 DSM Plan Savings and Investment, highlighting the investment amounts, lifetime benefits, and energy and demand savings for various programs under residential and business/non-profit categories. It also includes metrics like the Total Resource Cost Test (TRC) and Program Administrator Cost Test (PAC).

Figure 1.4 - 2015 DSM Plan Savings and Investment 2015 Investment ($ million) Lifetime Benefits ($ million) a Incremental Annual Net Energy Savings at Generator (GWh) Incremental Annual Net Demand Savings at Generator (MW) Total Resource C...

AI summary Figure 1.4 presents the 2015 DSM Plan Savings and Investment, detailing investment amounts, lifetime benefits, and energy and demand savings across various programs. The table includes data on residential and business programs, as well as enabling strategies, with metrics such as the Total Resource Cost Test (TRC) and Program Administrator Cost Test (PAC).

2.2 Existing Residential The Existing Residential service is designed to promote cost-effective energy efficiency improvements to Nova Scotia's housing stock of single detached houses, duplexes, rental housing, mobile/mini homes and multi-...

AI summary The Existing Residential program promotes energy efficiency in Nova Scotia's housing stock through incentives for lighting, water heating, and appliance upgrades. Enhancements include renter eligibility, direct low-cost measure installation, innovative financing, and contractor training. The Province of Nova Scotia funds non-electric rebates, while ENSC manages the program via contracted service organizations.

3.1 Efficient Product Rebates The Efficient Product Rebates category is intended to secure cost-effective electrical energy savings for customers in the retrofit and new construction markets, through promotion and rebates on high-efficienc...

AI summary The Efficient Product Rebates program, managed by ENSC, aims to reduce energy costs for customers through rebates and financing for high-efficiency equipment. It combines the Business Energy Rebates (BER) and Smart Lighting Choices (SLC) programs in 2012, targeting retrofit and new construction markets. BER offers prescriptive rebates for reliable energy-saving equipment, focusing on sectors like lighting, HVAC, and refrigeration, with eligibility for businesses and multi-unit residential buildings.

in their equipment or buildings over several years). The one-year approval period can further lead to missed savings as well as diverted organizational time and focus, especially of senior management. Given the above, as well as stakeholde...

AI summary ENSC proposes a framework to address concerns about its multi-year planning and oversight, including a five-year plan requiring UARB approval for the first three years, annual progress reports, quarterly meetings, and rate rider adjustments. The framework aims to maintain oversight while improving efficiency and stakeholder engagement.

The chart below illustrates the recommended approach, including both the regulatory and extraregulatory oversight mechanisms. THREE-YEAR PLAN 2012 2013 2014 2015 2016 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Multi-Year Plan F H A...

AI summary The text presents a chart outlining the recommended approach for regulatory and extraregulatory oversight mechanisms within a three-year plan, detailing various activities such as filings, hearings, meetings, reports, and approvals by the Board of Directors and the Nova Scotia Utility and Review Board.

LATITUDE Even if Efficiency Nova Scotia has the clarity of purpose and built-in incentives to perform, does it have the ability to do so to maximum effect? ENSC operates in an extremely complex market environment, one that is in many respe...

AI summary The document argues that Efficiency Nova Scotia Corporation (ENSC) requires sufficient latitude to compete effectively in complex markets where energy efficiency is discretionary. ENSC faces challenges competing with non-energy priorities and must balance resources, responsiveness, and commitment to influence consumer behavior. The text emphasizes the need for adequate incentives, adaptability, and long-term credibility for Demand Side Management (DSM) programs to maximize ratepayer funds.

RECENT ADJUSTMENTS The regulatory framework to oversee DSM began with NSPI as the interim administrator and transitioned as the DSM administrator role was taken over by ENSC in the fall of 2010. As part of its decision on ENSC's 2012 filin...

AI summary The UARB adjusted DSM regulatory framework criteria in 2012, including shifting TRC threshold evaluation to the program level, adopting cumulative savings analysis, and initiating multi-annual plan considerations. These changes followed ENSC's 2012 filing and NSPI's prior interim administration role.

. ISO 50000), and/or energy benchmarking (e.g. through Energy Star Portfolio Manager). Since these are not "quick-hit" equipment replacements, they do not lend themselves to one-time incentives as much as they do to a committed, multi-year...

AI summary The text highlights ENSC's challenge in securing multi-year commitments for long-term energy efficiency initiatives, which limits market credibility. While short-term goals are achievable within a twelve-month process, sustained efforts like ISO 50000 compliance and Energy Star Portfolio Manager benchmarking require ongoing support ENSC cannot formally guarantee.

3. MISSED SAVINGS OPPORTUNITIES ENSC's current 12-month approval process can act as a disincentive to securing certain energy savings opportunities, both short- and long-term. For example, there may be opportunity within a program that inc...

AI summary ENSC's 12-month approval process may discourage long-term energy savings by creating disincentives for contractors to pursue follow-up activities or upstream training. Contractors prioritize short-term gains and expensive resource acquisition strategies over long-term savings opportunities due to lack of incentives.

The table below summarizes our findings. CRITERIA: PERFORMANCE DRIVERS LATITUDE OVERSIGHT Components No D isin ce nti ve s Inc en tiv es Re so urc es Re sp on siv en es s Ab ilit y t o C om mi t Tra ns pa ren cy Sa feg ua rds Inf lue nc e...

AI summary The table summarizes findings related to oversight and performance drivers for ENSC, highlighting areas such as incentives, resources, and transparency. It notes that ENSC has no sales disincentive, strong reputational incentives, and challenges with long-term commitment and annual approval processes. The section will provide recommendations to address these shortcomings while maintaining current strengths.

#1. MULTI-YEAR DSM PLAN FILING In order to improve ENSC's ability to contract efficiently, to build capacity within Nova Scotia, to effectively engage trade allies and large organizations, and to focus more organizational effort on DSM del...

AI summary The document recommends transitioning to a multi-year DSM plan for ENSC to enhance efficiency, stakeholder engagement, and operational focus. It proposes a 3-year plan with two additional years of outlook, subject to UARB approval and regulatory hearings, ensuring continuous vision communication and evaluation frameworks.

#2. ANNUAL PROGRESS REPORTS In order to provide both the UARB and stakeholders with the information needed to track the corporation's progress, to keep all parties apprised of any changes or risks that may arise, and to safeguard against u...

AI summary The document recommends adopting Annual Progress Reports to track ENSC's performance, ensure transparency, and implement a trigger mechanism requiring a Corrective Action Plan if savings fall below 75% of forecasts. Reports would include context, activities, discrepancies, and savings details, with a focus on clarity and adherence to evaluation plans.

#3. EVALUATION ACTIVITIES In order to measure ENSC's performance toward its objectives, to facilitate allocation of DSM costs to rate classes, and to improve and inform program delivery through rapid and reliable feedback, we

AI summary Evaluation activities aim to measure ENSC's performance, allocate DSM costs to rate classes, and improve program delivery through feedback. The text outlines the purpose of these activities but does not detail specific methods or outcomes.

#4. QUARTERLY MEETINGS & REPORTS In order to maximize transparency, to ensure that stakeholders and the UARB are kept apprised of results as they evolve, and to provide opportunity to discuss concerns and/or make suggestions to ENSC, we re...

AI summary The document recommends maintaining quarterly meetings with the UARB and stakeholders, transitioning the Program Development Working Group to a DSM Advisory Group for strategic discussions, and distributing savings reports prior to meetings. No changes to UARB meetings are proposed, while stakeholder engagement is to be restructured.

4. EVALUATION PROTOCOL & METHODOLOGY We have principally relied on the Superior Energy Performance (SEP) measurement & verification protocol found in Appendix-1 in conducting the M&V evaluation. We have relied on this document as it is ver...

AI summary The evaluation uses the Superior Energy Performance (SEP) and IPMVP protocols to validate NPPH's self-reported energy performance data from the INITIAL REPORT. The SEP approach requires two components to assess energy improvements, focusing on verifying preliminary estimates that lacked independent audit.

4.1Measurement Boundaries The measurement boundary for all projects is the whole mill. Note that the reported refining energy consumption does not include electrical consumption of any auxiliary equipment located within the TMP plant. The...

AI summary The measurement boundary for energy consumption includes the whole mill but excludes TMP plant auxiliary equipment due to lack of metering. Auxiliary consumption (11.5% of TMP load) is deemed negligible (<5% IPMVP threshold). The top-down analysis boundary includes NPPH mill (including PB3), though PB3 may be excluded in the future due to NSPI ownership.

4.4Period of Analysis, Energy & Conditions Since TMP refining energy (electricity) consumption represents a full two-thirds of the NPPH mill's electric consumption a first analysis was done on TMP refining energy. Because of its relative i...

AI summary The analysis focuses on TMP refining energy consumption, which constitutes two-thirds of NPPH's electric use. Detailed records from NPPH enabled statistical analysis, with data collected from mid-2007 to establish a baseline before energy efficiency projects starting in mid-2009. A model linking refining energy to production was developed, resulting in a CUSUM chart (Figure 7) to monitor trends.

Completeness Because we are working at the full facility level in the top-down analysis, the data we are using capture all electrical use. Because the mill is continuously producing more steam than it can use, and because any electricity g...

AI summary The analysis assumes electricity consumption in a facility exporting excess power to the Nova Scotia grid is unaffected by steam production, as data captures full electrical use. The assumption is based on the mill's continuous steam production and direct electricity export, though the reverse relationship is not valid.

Relevance The statistical analysis methodology allows us to quickly evaluate which factors are the most relevant, and to eliminate factors which are not relevant. A substantial amount of work goes into this part of the exercise to ensure m...

AI summary The statistical analysis methodology is used to assess factor relevance and eliminate non-relevant ones, requiring significant effort to ensure maximum relevancy in the evaluation process.

8. CONCLUSIONS & RECOMMENDATIONS The top-down electricity savings estimate for the whole mill described in Section-5 of this Report is consistent with the M&V requirements defined in the SEP M&V Protocol and meets all the IPMVP criteria (a...

AI summary The top-down electricity savings estimate for the NPPH mill aligns with SEP M&V Protocol and IPMVP criteria, validating its accuracy. It closely matches the initial report but may overstate savings due to limited bottom-up data. The analysis concludes the top-down method provides a reliable energy savings representation.

BACKGROUND In its 2012 DSM Plan filing, ENSC filed an Electricity Demand Side Management Review. Prepared by Dunsky Energy Consulting, the report reviewed ENSC's portfolio of programs, and made a number of recommendations aimed at maximizi...

AI summary ENSC's 2012 DSM Plan filing included a program review by Dunsky Energy Consulting, recommending six new strategies, including a 'Renewable Heating Industry Strategy' with potential for significant long-term electricity savings. The report emphasized program improvements and cost-effective savings.

1- Electric Space Heating Households - by channel and heat distribution systems As can be seen, the vast majority of Nova Scotia's electrically heated homes are not being reached by the existing comprehensive energy efficiency programs, an...

AI summary The text highlights that most electrically heated homes in Nova Scotia are not covered by existing energy efficiency programs, with many using zoned baseboard heating systems. Table 2 provides a qualitative assessment of market potential by technology and heat distribution system.

KEY PERFORMANCE ASSUMPTIONS Our assessment of the likely costs, benefits and electricity savings associated with this program is built upon hundreds of important inputs that address such issues as incremental costs, savings, baseline techn...

AI summary The program's performance assumptions focus on promoting high-efficiency air source heat pumps (ducted and ductless) with specific HSPF targets, referencing Energy Trust of Oregon and Energy Star standards. It addresses market penetration, energy savings, and penalties for inadvertent load increases from heat pump installations.

SAVINGS 2013 2014 2015 Gross Savings (Incr. Ann.) 1st Yr Electricity Svgs (MWh) 20,330 25,391 30,816 Levelized-Lifetime (MWh) 230,543 290,735 358,749 Net Savings (Incr. Ann) 1st Yr Electricity Svgs (MWh) 10,150 12,768 15,664 Levelized-Life...

AI summary The Green Heating Systems initiative demonstrates cost-effectiveness with a benefit-cost ratio exceeding 2.8 and passing both the Total Resource Cost and Program Administrator Cost tests, indicating that for every dollar invested by ENSC, there is approximately $3 in savings.

Introduction This report presents the results of the 2011 Socket Study conducted by Corporate Research Associates Inc. on behalf of Efficiency Nova Scotia. The overall goal of this study was to determine market penetration of energy effici...

AI summary This 2011 Socket Study by Corporate Research Associates Inc. for Efficiency Nova Scotia assesses energy-efficient lighting (CFL, LED) market penetration in Nova Scotia. The study involved an online survey of 1,004 residents, in-home verification visits, and analysis of lighting usage and adoption intentions. Results are weighted to reflect population parameters and include data tables and methodology details.

Household Will Replace Light Bulb Types With… (% Saying Yes, applies) In terms of replacing one light fixture with one that is more energy efficient, the only population difference that emerged was for residents who heat their home with oi...

AI summary The document examines household willingness to replace light bulbs with energy-efficient alternatives, noting that residents heating with oil are less likely to do so than those using electricity. Owners are more likely than non-owners to replace bulbs with CFLs, and higher-income households show greater intent to adopt energy-efficient lighting. Apartment dwellers are less likely to replace bulbs than those in single-family homes.

Questionnaire Design and Survey Administration The questionnaire used for this study was designed by CRA, in consultation with Efficiency Nova Scotia staff members. Prior to being finalized, the survey was pre-tested on a small number of r...

AI summary The questionnaire was designed by CRA with Efficiency Nova Scotia, pre-tested, and administered online (Sep 26-29, 2011) to 1,004 Nova Scotia residents. In-home verification visits (Oct-Nov 2011) counted light bulbs, with data weighted to match provincial demographics. 50 visits occurred across regions, including Halifax Regional Municipality.

• Next Steps: - Continuing the program in 2012 - RFP to be released in November - Program will expand to include more schools - 2011 participants will move to next phase of Sustainability Plans - Building on existing relationships and scho...

AI summary The proceeding outlines next steps including program continuation in 2012, an RFP release in November, expansion to include more schools, progression of 2011 participants to the next Sustainability Plan phase, and leveraging existing school relationships and resources.

Responsibility and accountability for the administration of DSM programs were transferred from Nova Scotia Power Inc. (NSPI) to ENSC effective October 1, 2010, with transfer of operational activities phased in during the fall of 2010. The...

AI summary Responsibility for DSM programs was transferred from NSPI to ENSC in 2010. ENSC submitted its first DSM Plan in 2011, which was approved by the UARB. ENSC also filed responses and reports in accordance with UARB orders, including a free ridership and spillover study.

DATE FILED: February 27, 2012 Page 1 of 45 1 The June 30, 2011 UARB Order also directed ENSC to: 2 3  engage stakeholders regarding changes to the Program Development 4 Working Group (PDWG) or the creation of a new stakeholder process – 5...

AI summary The UARB directed ENSC to engage stakeholders regarding changes to the Program Development Working Group, meet quarterly with UARB staff, and provide enhanced information on rate and bill impacts for the 2013 DSM Plan. ENSC was also ordered to review the cost allocation methodology and address issues related to CFL disposal, financing, and savings evaluations.

3 2.1 2011 Energy Savings Achieved 4 In its July 27, 2010 Decision 1 5 , the UARB approved the 2011 DSM Plan, filed by NSPI, to 6 achieve an energy savings target of 158.5 GWh at an expenditure of up to $41.9 million. 7 8 Figure 2.1 shows...

AI summary The UARB approved the 2011 DSM Plan by NSPI to achieve 158.5 GWh of energy savings with a budget of up to $41.9 million. The evaluated savings results for 2011 are subject to final verification by the UARB's savings verification consultant.

1 [2010] NSUARB 155. 1 as part of its evaluation of 2011 DSM Programs; the results are documented in the 2011 2 DSM Evaluation Report filed separately. 3 4 The evaluated results for the ELI projects are: 154.2 GWh of energy savings, compar...

AI summary The document discusses the evaluation of the 2011 DSM Programs, highlighting energy savings of 154.2 GWh and demand savings of 17.8 MW, compared to preliminary values. Expenditures for the 2011 DSM Plan totaled $35.8 million, below the approved $41.9 million. Figure 2.2 provides a breakdown of expenditures and energy savings by program.

DATE FILED: February 27, 2012 Page 14 of 45 1  a management discussion and analysis of any major discrepancies relative 2 to the original plan's intent and forecasts 3  a summary of costs and savings for each program or target market are...

AI summary The text discusses recommendations for evaluating and adjusting the Demand Side Management (DSM) program, including the adoption of a trigger mechanism if savings fall below 75% of forecasts and a revised evaluation approach with ongoing tracking, surveys, and reporting to the UARB.

Figure 4.1 - 2013-2015 DSM Plan Savings and Investment including Outlook to 2017 Year Investment ($ million) Lifetime Benefits ($ million) a Incremental Annual Net Energy Savings at Generator (GWh) Incremental Annual Net Demand Savings at...

AI summary Figure 4.1 presents data from the 2013-2015 DSM Plan, showing investment amounts, lifetime benefits, and energy savings over time. The table includes metrics such as incremental annual net energy and demand savings, as well as cost tests for the program.

& lt;sup>a Lifetime benefits are expressed as the net present value of the avoided costs, including energy and capacity, over the life of the program measures. & lt;sup>b TRC is a benefit/cost ratio comparing lifetime benefits to the sum o...

AI summary The text discusses lifetime benefits, TRC, and PAC ratios in the context of energy efficiency programs, highlighting avoided costs and participation by low-income households.

& lt;sup>a Lifetime benefits are expressed as the net present value of the avoided costs, including energy and capacity, over the life of the program measures. b TRC is a benefit/cost ratio comparing lifetime benefits to the sum of ENSC's...

AI summary The text defines key metrics used in evaluating energy efficiency programs, including lifetime benefits, TRC (Total Benefit/Cost Ratio), and PAC (Program Benefit/Cost Ratio), with an emphasis on avoided energy and capacity costs, and inclusion of low-income household participation.

6. ENSC'S RESPONSE TO VERIFICATION CONSULTANT'S REQUESTS On January 9, 2012, the UARB directed ENSC to address, as part of its 2013 DSM filing, three issues arising from Dr. Peach's review of ENSC's Report on 2010 Evaluation and Verificati...

AI summary ENSC responded to the UARB's directive from January 9, 2012, addressing three issues from Dr. Peach's review of ENSC's 2010 DSM evaluation report and subsequent information requests. The response is part of ENSC's 2013 DSM filing.

Dr. Peach states: The response to IR-20 states that for the Small Business Energy Solutions program there is an option for on-bill financing. This concept of facilitating leverage through on-bill financing or, by extension, other sources o...

AI summary Dr. Peach discusses the potential of on-bill financing for Nova Scotia's Small Business Energy Solutions program, arguing it could multiply energy savings, reduce DSM Administrator costs per kWh conserved, and enhance ENSC's effectiveness through strategic leveraging. He emphasizes gradual expansion of such financing mechanisms.

ENSC's Response: ENSC recognizes that lack of financial capital may be a barrier to customers adopting energy efficiency measures. Removal of this barrier could increase participation in energy efficiency programs and therefore increase en...

AI summary ENSC acknowledges financial barriers hinder energy efficiency adoption and proposes on-bill financing with NSPI and other partners to expand DSM participation. Discussions include bank partnerships and leveraging rebates for broader program access, with cost-benefit analyses planned for 2012 implementation.

ould occur whenever a replaced measure reaches the end of its EUL. Tracking these results as well as changes in common practices and standards would require a greater investment of time and resources. Application of dual baselines across t...

AI summary ENSC acknowledges the potential benefits of a dual baseline approach for program evaluation but argues that implementation may be impractical due to high costs and resource demands. They propose a measured approach, prioritizing feasibility analysis before widespread adoption, citing challenges in programs with frequent product changes or limited user interaction.

the noted concerns, it is prudent for ENSC to complete a more thorough analysis to determine if the implementation of a dual baseline approach is feasible. ENSC commits to the following tasks in 2012: determine the programs in which early...

AI summary The text discusses ENSC's commitment to analyzing the feasibility of a dual baseline approach in 2012, including evaluating other jurisdictions' experiences and assessing the potential benefits and costs of implementation in Nova Scotia.

8 9 10 11 12 13 Figures 1.2, 1.3 and 1.4 present program investment budgets, and the incremental annual GWh energy and the MW demand net savings at generator for 2013, 2014 and 2015, respectively. They also provide the lifetime total resou...

AI summary The text discusses program investment budgets and their associated energy and demand savings for 2013 to 2015. It also references the Total Resource Benefits, Total Resource Cost (TRC) test results, and Program Administrator Cost (PAC) test results for the same period.

& lt;sup>c PAC is a benefit/cost ratio comparing lifetime benefits to ENSC's costs. Figure 1.2 - 2013 DSM Plan Savings and Investment 2013 Investment ($ million) Lifetime Benefits ($ million) a Incremental Annual Net Energy Savings at Gene...

AI summary The text presents a table detailing the 2013 DSM Plan, showing investment, lifetime benefits, and various cost and benefit ratios for different programs, including residential and business initiatives. The PAC, a benefit/cost ratio, is highlighted as a key metric for evaluating program efficiency.

& lt;sup>a Lifetime benefits are expressed as the net present value of the avoided costs, including energy and capacity, over the life of the program measures. b TRC is a benefit/cost ratio comparing lifetime benefits to the sum of ENSC's...

AI summary The text explains how lifetime benefits are calculated as the net present value of avoided costs, including energy and capacity, over the program's lifetime. It also defines TRC and PAC as benefit/cost ratios that compare these benefits to the combined and individual costs of ENSC and participants.

& lt;sup>d Includes participation by low income households. Figure 1.3 - 2014 DSM Plan Savings and Investment 2014 2014 Investment ($ million) Lifetime Benefits ($ million)^a Incremental Annual Net Energy Savings at Generator (GWh) Increme...

AI summary The 2014 DSM Plan Savings and Investment table outlines the financial and energy savings from various demand-side management programs, including residential and business initiatives, with metrics such as investment, benefits, energy savings, and cost tests.

& lt;sup>a Lifetime benefits are expressed as the net present value of the avoided costs, including energy and capacity, over the life of the program measures. b TRC is a benefit/cost ratio comparing lifetime benefits to the sum of ENSC's...

AI summary The text discusses how lifetime benefits of program measures are calculated using net present value of avoided costs, including energy and capacity, and introduces the TRC, a benefit/cost ratio that compares these benefits to the combined costs of ENSC and participants.

& lt;sup>c PAC is a benefit/cost ratio comparing lifetime benefits to ENSC's costs. d Includes participation by low income households. Figure 1.4 - 2015 DSM Plan Savings and Investment 2015 Investment ($ million) Lifetime Benefits ($ milli...

AI summary The text presents a table summarizing the 2015 DSM Plan Savings and Investment, including investment amounts, lifetime benefits, energy and demand savings, and various cost-benefit ratios for different DSM programs in Nova Scotia.

2.2 Existing Residential The Existing Residential service is designed to promote cost-effective energy efficiency improvements to Nova Scotia's housing stock of single detached houses, duplexes, rental housing, mobile/mini homes and multi-...

AI summary The Existing Residential program promotes energy efficiency in Nova Scotia's housing stock through incentives for lighting, heating, and appliance upgrades. It includes renter eligibility, direct installation of low-cost measures, and enhanced customer support. Funding comes from the Province of Nova Scotia, with ENSC managing service organizations for implementation.

Low Income The Low Income Homeowners component builds on the existing program, providing free energy audits and turnkey implementation of energy efficiency measures at no cost to participants. Building envelope measures include upgrades su...

AI summary The Low Income Homeowners program offers free energy audits and no-cost efficiency upgrades for low-income households, including insulation, CFLs, and ENERGY STAR appliances. It expands to renters with direct installation services and education. Measures aim to reduce energy costs through envelope improvements, appliance replacements, and behavioral education.

3.1 Efficient Product Rebates The Efficient Product Rebates category is intended to secure cost-effective electrical energy savings for customers in the retrofit and new construction markets, through promotion and rebates on high-efficienc...

AI summary ENSC's Efficient Product Rebates aim to reduce customer costs for energy-efficient technologies through rebates and financing, targeting retrofit and new construction markets. The Business Energy Rebates (BER) program combines previous initiatives and offers prescriptive rebates for equipment with measurable energy savings, focusing on market-driven opportunities and specific industries.

4.3 Innovative Financing ENSC recognizes that a lack of upfront capital can be a barrier to customers adopting energy efficiency measures. ENSC's objective is to deliver innovative financing to remove this barrier and increase participatio...

AI summary ENSC aims to address upfront capital barriers for energy efficiency adoption through innovative financing, targeting DSM programs like the Existing Residential initiative. Financing options will support capital-intensive projects such as green heating systems, benefiting residential and commercial customers.

ABOUT DUNSKY ENERGY CONSULTING Dunsky Energy Consulting is a Montreal-based firm specialized in the design, analysis and implementation of successful energy efficiency and renewable energy programs and policies. Our clients include leading...

AI summary Dunsky Energy Consulting is a Montreal-based firm specializing in energy efficiency and renewable energy program design, analysis, and implementation. They serve utilities, government agencies, private firms, and non-profits in Canada and the U.S.

in their equipment or buildings over several years). The one-year approval period can further lead to missed savings as well as diverted organizational time and focus, especially of senior management. Given the above, as well as stakeholde...

AI summary The text outlines concerns about the one-year approval period for ENSC's programs, leading to missed savings and diverted focus. A proposed framework includes a multi-year plan, annual progress reports, ongoing evaluation, quarterly meetings, rate rider adjustments, and an independent ENSC Board of Directors to improve oversight and performance.

The chart below illustrates the recommended approach, including both the regulatory and extraregulatory oversight mechanisms. THREE-YEAR PLAN 2012 2013 2014 2015 2016 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Multi-Year Plan F H A...

AI summary The chart outlines a three-year plan with regulatory and extraregulatory oversight mechanisms, detailing activities such as progress reports, evaluations, meetings, and approvals for the Multi-Year Plan and Rate Rider. It includes filing, hearing, meeting, and reporting requirements over the years 2012 to 2016.

LATITUDE Even if Efficiency Nova Scotia has the clarity of purpose and built-in incentives to perform, does it have the ability to do so to maximum effect? ENSC operates in an extremely complex market environment, one that is in many respe...

AI summary Efficiency Nova Scotia (ENSC) faces challenges in competing for consumer attention in a complex market. Its success depends on three factors: resources, responsiveness, and commitment. The document argues that ENSC requires sufficient latitude to effectively influence energy efficiency decisions and maximize ratepayer fund utilization.

STRENGTHS While the UARB's oversight of DSM is relatively new as compared to many other regions of North America, both the framework and the approach it has taken to the task offer benefits that others do not have. These include: - 1. Trus...

AI summary The UARB's oversight of DSM in Nova Scotia is highlighted for its strengths, including trust, clarity of purpose, flexibility, resources, and a long-term view. These factors contribute to effective DSM implementation and oversight, distinguishing Nova Scotia from other regions.

- Retooling: To be successful, ENSC will need to convince market actors to invest in the development of new lines of business. For example, it may wish to encourage firms to invest in the provision of Energy Management Information Services...

AI summary ENSC must build market confidence to drive investment in new energy services like EMIS and wood pellet infrastructure, and shift consumer procurement practices toward energy efficiency. This requires long-term commitment to demonstrate demand for these innovations.

#1. MULTI-YEAR DSM PLAN FILING In order to improve ENSC's ability to contract efficiently, to build capacity within Nova Scotia, to effectively engage trade allies and large organizations, and to focus more organizational effort on DSM del...

AI summary ENSC recommends a multi-year DSM plan to enhance efficiency, build local capacity, and engage stakeholders. The 3-year plan includes a rolling outlook for directional guidance, with a focus on clear vision, cost forecasts, energy savings, and evaluation timelines. Regulatory approval and hearings would be required.

#2. ANNUAL PROGRESS REPORTS In order to provide both the UARB and stakeholders with the information needed to track the corporation's progress, to keep all parties apprised of any changes or risks that may arise, and to safeguard against u...

AI summary Recommends annual progress reports for ENSC to track progress, address discrepancies, and ensure savings targets. Includes a trigger mechanism for corrective action if savings fall below 75% of forecasts.

#3. EVALUATION ACTIVITIES In order to measure ENSC's performance toward its objectives, to facilitate allocation of DSM costs to rate classes, and to improve and inform program delivery through rapid and reliable feedback, we

AI summary Evaluation activities aim to measure ENSC's performance, allocate DSM costs to rate classes, and enhance program delivery through feedback. The focus is on ensuring effective DSM implementation and cost recovery mechanisms.

recommend that ENSC adjust its EM&V schedule to an ongoing (as opposed to annual "all-in-one") process. As indicated previously, evaluation activities can be comprised of a number of different components. Currently, ENSC submits a complete...

AI summary The document recommends that ENSC shift from an annual 'all-in-one' EM&V schedule to an ongoing process. Current annual evaluations are criticized for rushed timelines, lack of mid-year feedback, and limited spillover analysis. A layered approach with quarterly reports, rapid surveys, and rolling evaluations is proposed to improve timeliness and accuracy of savings estimates.

#4. QUARTERLY MEETINGS & REPORTS In order to maximize transparency, to ensure that stakeholders and the UARB are kept apprised of results as they evolve, and to provide opportunity to discuss concerns and/or make suggestions to ENSC, we re...

AI summary The text recommends quarterly meetings with the UARB and stakeholders, suggests transitioning the Program Development Working Group (PDWG) to a DSM Advisory Group for strategic discussions, and emphasizes distributing savings reports before meetings to ensure transparency and stakeholder engagement.

The following table provides an overview of the oversight process we have recommended, while also indicating the extra-regulatory oversight involved. THREE-YEAR PLAN 2012 2013 2014 2015 2016 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4...

AI summary The table outlines a recommended oversight process, including regulatory and extra-regulatory activities, with specific actions such as filings, hearings, meetings, and reports over a three-year period from 2012 to 2016, highlighting the sequence dependency of tasks prior to the start of the plan.

CRITERIA: PERFORMANCE DRIVERS LATITUDE OVERSIGHT Components No D isin ce nti ve s Inc en tiv es Re so urc es Re sp on siv en es s Ab ilit y t o C om mi t Tra ns pa ren cy Sa feg ua rds Inf lue nc e Co st Examples Are profits unaffected by...

AI summary This table discusses the criteria and performance drivers for ENSC (Energy Efficiency Nova Scotia), including components such as incentives, resources, responsiveness, and oversight. It outlines ENSC's current status, proposed changes, and notes on budget, flexibility, and transparency. The table also highlights the regulatory cost and long-term predictability challenges.

4. EVALUATION PROTOCOL & METHODOLOGY We have principally relied on the Superior Energy Performance (SEP) measurement & verification protocol found in Appendix-1 in conducting the M&V evaluation. We have relied on this document as it is ver...

AI summary The evaluation relies on the Superior Energy Performance (SEP) and International Performance Measurement and Verification Protocol (IPMVP) to assess energy performance improvements at NPPH. The goal is to validate preliminary self-reported energy data from NPPH's INITIAL REPORT, which lacked independent auditing.

4.1Measurement Boundaries The measurement boundary for all projects is the whole mill. Note that the reported refining energy consumption does not include electrical consumption of any auxiliary equipment located within the TMP plant. The...

AI summary The measurement boundary for projects is the whole mill, excluding TMP plant auxiliary equipment due to lack of metering. Auxiliary consumption (15.6 MW, 11.5% of TMP plant use) is excluded as it varies ±20% but represents <5% of average load, per IPMVP guidelines. The NPPH mill facility (including PB3) is the top-down analysis boundary, with PB3 likely excluded in the future due to NSPI ownership.

Relevance The statistical analysis methodology allows us to quickly evaluate which factors are the most relevant, and to eliminate factors which are not relevant. A substantial amount of work goes into this part of the exercise to ensure m...

AI summary The statistical analysis methodology is used to evaluate relevant factors and eliminate irrelevant ones, requiring significant effort to ensure maximum relevancy.

8. CONCLUSIONS & RECOMMENDATIONS The top-down electricity savings estimate for the whole mill described in Section-5 of this Report is consistent with the M&V requirements defined in the SEP M&V Protocol and meets all the IPMVP criteria (a...

AI summary The top-down electricity savings estimate for NPPH aligns with SEP M&V and IPMVP criteria, validating its accuracy. It closely matches the initial report but may be higher due to limited data for bottom-up analysis. The estimate is deemed a reasonable reflection of actual energy savings achieved.

ABOUT DUNSKY ENERGY CONSULTING Dunsky Energy Consulting is a Montreal-based firm specialized in the design, analysis and implementation of successful energy efficiency and renewable energy programs and policies. Our clients include leading...

AI summary Dunsky Energy Consulting is a Montreal-based firm specializing in designing, analyzing, and implementing energy efficiency and renewable energy programs and policies for clients including utilities, government agencies, private firms, and non-profits in Canada and the U.S.

BACKGROUND In its 2012 DSM Plan filing, ENSC filed an Electricity Demand Side Management Review. Prepared by Dunsky Energy Consulting, the report reviewed ENSC's portfolio of programs, and made a number of recommendations aimed at maximizi...

AI summary ENSC submitted a 2012 DSM Plan reviewed by Dunsky Energy Consulting, recommending program changes and six new strategies, including a 'Renewable Heating Industry Strategy' for significant long-term savings. The report focused on enhancing cost-effective electricity savings through regulatory and program adjustments.

OBJECTIVES Green Heating Systems, which we have defined to include systems that deliver all or most of their heat directly from renewable resources, have the potential to deliver significant benefits to Nova Scotia, including electricity s...

AI summary The initiative aims to promote Green Heating Systems, which use renewable resources for heating, to achieve electricity savings and reduce emissions. Current ENSC programs like EnerGuide for Houses and Performance Plus focus on comprehensive home improvements but miss opportunities for homeowners needing only heating system upgrades. The new initiative will use incentives, training, and marketing to expand adoption, targeting HVAC installers and builders.

INCENTIVES The initiative provides financial incentives for selected technologies, and also assumes the provision of some form of financing (developed through the Innovative Financing Enabling Strategy). The program administrator may choos...

AI summary The initiative offers financial incentives for specific technologies, with the program administrator potentially using incentive funds to reduce financing interest rates for technologies like ground-source heat pumps and solar thermal systems. This approach is limited to certain technologies deemed suitable for such measures.

Introduction This report presents the results of the 2011 Socket Study conducted by Corporate Research Associates Inc. on behalf of Efficiency Nova Scotia. The overall goal of this study was to determine market penetration of energy effici...

AI summary This report details the 2011 Socket Study by Corporate Research Associates Inc. for Efficiency Nova Scotia, assessing energy-efficient lighting (CFL and LED) market penetration and transformation. Methods included an online survey of 1,004 Nova Scotians and 50 in-home bulb counts, with results weighted by region and housing type.

How to take part - 1. Send pre-approval application form to ENSC - 2. Receive approval - 3. Purchase and install qualifying equipment - 4. Send in rebate application form and supporting docs - 5. Receive rebate cheque

AI summary The document outlines a five-step process for participating in a rebate program: submitting a pre-approval application to ENSC, receiving approval, purchasing qualifying equipment, submitting a rebate application with documentation, and receiving a rebate cheque. The process emphasizes program administration through ENSC.

• Next Steps: - Continuing the program in 2012 - RFP to be released in November - Program will expand to include more schools - 2011 participants will move to next phase of Sustainability Plans - Building on existing relationships and scho...

AI summary The proceeding outlines next steps for a program, including continuation in 2012, an RFP release in November, expansion to more schools, progression of 2011 participants to the next phase of Sustainability Plans, and leveraging existing school relationships and resources.

• Overview: - Formerly known as Advanced Houses and EcoHome - Goal: Educate the general public, residential construction industry, government and special interest groups on the importance of (and new technologies in) energy efficiency in n...

AI summary The document outlines a program formerly known as Advanced Houses and EcoHome, aimed at promoting energy efficiency in residential construction through partnerships with the NS Home Builders' Association. Two model homes built by Denim Homes and Whitestone Developments achieved high EnerGuide ratings (96 and 94) and were used for public awareness campaigns involving events, media, and digital outreach.

TABLE OF CONTENTS 1 DSM PORTFOLIO PERFORMANCE ......................................................................................... 1 1.1 Overview ...........................................................................................

AI summary The document outlines the evaluation of a Demand Side Management (DSM) portfolio, covering performance analysis, achieved savings, and evaluation methodology. It includes sections on process evaluation, interviews, on-site visits, surveys, and impact assessment, concluding with overall recommendations for program improvement.

................................................................... 17 3.1 Program Manual ............................................................................................................... 17 3.2 Program Data Tracking............

AI summary The text outlines sections of a program manual and evaluation plan for residential energy efficiency initiatives under Nova Scotia's Demand Side Management (DSM) framework, including appliance retirement, replacement, LED holiday lights, low-income renter programs, and fuel substitution pilots.

.................................... 34 4.1.9 Fuel Substitution Pilot ................................................................................................... 36 4.1.10 Low Income Program ...........................................

AI summary The document outlines various energy efficiency programs, including residential and commercial initiatives like the Low Income Program and Performance Plus Program, and references an evaluation of 2011 DSM programs by Efficiency Nova Scotia Corporation. It includes sections on fuel substitution pilots and business energy rebates.

LIST OF TABLES Table 1: Type(s) of Evaluation Conducted per Program ....................................................................... 1 Table 2: 2011 Savings Targets, Tracked Savings and Evaluated Results for Each Program ..............

AI summary The document lists tables related to program evaluations, savings targets, performance metrics, free-ridership analysis, and recommendations for energy efficiency programs. It outlines data tracking, evaluation methodologies, and general recommendations for specific initiatives like appliance retirement and low-income renter programs.

5 Table 15: Recommendations for the Retail Markdown Program......................................................... 27 Table 16: Recommendations for the Low Income Renter Program .................................................... 29 Tab...

AI summary The document lists tables with recommendations for various energy efficiency and demand-side management programs, including low-income initiatives, residential retrofits, and business rebates. It references an evaluation of 2011 DSM programs by Efficiency Nova Scotia Corporation and an executive summary from ECONOL:R.

and workplaces. For the 2011 program year, Econoler conducted impact and process evaluations for the following programs. Table 1: Type(s) of Evaluation Conducted per Program Type(s) of Evaluation Program Process Impact Appliance Retirement...

AI summary Econoler conducted impact and process evaluations for multiple programs in 2011, including appliance retirement, low-income initiatives, and energy efficiency measures. The table lists programs evaluated, with some receiving both process and impact assessments.

x x Small Business Energy Solutions (SBES) x x program Ref.: 5725 1 Evaluation of 2011 DSM Programs Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary It is the opinion of Econoler that the portfolio of programs evaluate...

AI summary Econoler evaluated ENSC's 2011 DSM programs, noting efficient management and significant energy/demand savings (141.751 GWh and 28.864 MW) compared to 2010. Program design improvements and expanded market coverage drove success, though marketing/communication required enhancement. ENSC transitioned from NSPI as administrator in 2010.

ipants. Indeed, for many programs, there was an increase in the participation level in comparison to 2010. That being said, program marketing and communication still represent an area for improvement. The current report aims at presenting...

AI summary ENSC's 2011 DSM programs achieved 11% less energy savings than targets (141.751 GWh) and 28.864 MW demand savings. Some programs exceeded goals, while others fell short. The report highlights the need for improved marketing and communication.

each program offered by ENSC in 2011. Table 2: 2011 Savings Targets, Tracked Savings and Evaluated Results for Each Program (Net Energy and Demand Savings at the Generator)

AI summary The text references Table 2, which evaluates energy and demand savings from ENSC's 2011 programs, focusing on net generator-level metrics. The document discusses program performance tracking and evaluation within a regulatory proceeding context.

2011 Energy Savings (GWh) 2011 Demand Savings (MW) DSM PROGRAM Tracked Evaluated Tracked Evaluated Targets Targets Savings Savings Savings Savings RESIDENTIAL PROGRAMS Efficient Products Programs ARet program 7.27 4.189 7.175 1.16 0.668 1....

AI summary The table presents 2011 energy and demand savings data for various DSM programs, including residential and C&I initiatives, showing tracked and evaluated savings against targets, with some programs exceeding their goals while others fell short.

1.419 6.52 SLC program 8.04 7.730 7.954 2.267 2.050 C&IC program 47.80 32.565 32.930 10.42 3.554 3.764 SBES program 18.48 26.080 23.176 4.27 7.682 6.820 C&I TOTAL 96.12 73.487 71.062 21.21 14.985 14.053 PORTFOLIO TOTAL 158.49 149.002 141.7...

AI summary The document evaluates the 2011 Demand Side Management (DSM) programs by Efficiency Nova Scotia Corporation (ENSC), comparing revised targets with program results. Table 3 summarizes savings targets and outcomes, grouped by program categories.

2011. The following table details these targets by larger categories in comparison with the evaluated results. Table 3: 2011 Savings Targets Presented to the PDWG and Evaluated Results

AI summary The text references a 2011 table comparing savings targets presented to the PDWG with evaluated results, though the specific details of the table are not provided.

2011 Evaluated 2011 Targets Results DSM PROGRAM GWh MW GWh MW RESIDENTIAL PROGRAMS a Efficient Products 42.89 4.79 49.415 8.912 b EnerGuide for Existing Houses 7.80 2.14 6.375 2.328 c Low Income 9.08 1.98 12.445 2.710 Performance Plus (New...

AI summary The document presents a 2011 evaluation of Nova Scotia's Demand Side Management (DSM) programs, comparing targets and results for residential and commercial/industrial (C&I) initiatives. Residential programs exceeded targets in energy savings (70.69 GWh vs. 62.37 GWh), while C&I programs fell slightly short (71.06 GWh vs. 96.12 GWh). Footnotes clarify program inclusions and exclusions.

program b Including the Fuel Substitution pilot c Including the Low Income Renter program d Including the BER and SLC programs Appliance Retirement Program The net savings achieved by the ARet program greatly exceeded those tracked by ENSC...

AI summary The Appliance Retirement (ARet) and Appliance Replacement (ARep) programs achieved significantly higher net savings than Efficiency Nova Scotia Corporation (ENSC) tracked, due to revised unitary savings values based on metering data. Econoler's evaluation methods for dehumidifiers and air conditioners also contributed. The Retail Markdown Program is mentioned in the context of DSM program evaluations.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary Retail Markdown Program In the case of the RMP, the net evaluated savings fell short of those tracked by ENSC by 23 percent. The main element that explains this result i...

AI summary The Retail Markdown Program (RMP) and Low Income Renter Program (LIR) evaluations showed net savings below tracked figures due to methodological adjustments, replacement ratios, and free-ridership. RMP savings were 23% lower, linked to NTGR discrepancies and reduced promotion awareness. LIR savings were 7% lower, influenced by interactive effects and updated line loss factors.

ated for 2011. Moreover, while some adjustments were applied to the unitary savings estimates used in the tracking sheet, they were in most cases revised upward. Multi-Unit Residential Renter Program The MURR program net evaluated savings...

AI summary Evaluations of 2011 DSM programs show discrepancies between tracked and evaluated savings. The Multi-Unit Residential Renter Program exceeded ENSC-tracked savings by 6%, attributed to revised unitary savings values and interactive effects. Conversely, the Efficient Products – Direct Install Program fell short by 12%, despite upward revisions to evaluation metrics.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary EnerGuide for Existing Houses Program The evaluated net energy savings are lower than those tracked by ENSC by approximately 26 percent. This difference is mainly due to...

AI summary The EnerGuide for Existing Houses Program's evaluated net energy savings are 26% lower than ENSC's tracking due to adjusted EnerGuide point values and revised unitary savings. The Fuel Substitution Pilot showed higher net savings than ENSC's tracking. Econoler adjusted savings calculations for pilot projects and prescriptive measures based on updated studies.

Substitution pilot revealed net savings higher than those tracked by ENSC. The difference between the NTGR used for the evaluation and in the tracking sheet explains this result. Low Income Program The net evaluated savings of the Low Inco...

AI summary The document compares evaluated savings from energy efficiency programs (Substitution pilot, Low Income, Performance Plus) with ENSC's tracked savings. Discrepancies arise from adjustments in baseline values, unitary savings calculations, and interactive effects of measures like lighting and thermal storage systems.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary 1.3 OVERALL PORTFOLIO ANALYSIS In addition to the performance of individual programs, it is worth looking at individual programs’ contributions over the years from a mor...

AI summary The document presents an overall portfolio analysis of program contributions to total energy savings between 2008 and 2011, evaluating individual programs' performance from a global perspective. Table 4 quantifies each program's share of portfolio savings during this period.

he table below shows the evaluated contribution of each program to total portfolio savings between 2008 and 2011. Table 4: Program Performance as Percentage of Total Portfolio

AI summary The text references a table evaluating the contribution of each program to total portfolio savings between 2008 and 2011, focusing on program performance as a percentage of the overall portfolio.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary In 2011, programs were launched as pilots while several pilot projects were integrated into existing or new programs. For example, the Fuel Substitution pilot as well as...

AI summary Efficiency Nova Scotia Corporation (ENSC) launched and integrated multiple pilot programs in 2011, including Fuel Substitution, MURR, and LIR, targeting diverse markets. These programs provided valuable experience, though some were reconfigured or discontinued (e.g., Appliance Replacement). ENSC expanded energy efficiency measures in 2011, diversifying incentives beyond lighting in programs like EP-DI.

r than lighting. Besides CFLs, it promoted power bars with integrated timer, hot water tank wraps and programmable thermostats. ENSC is planning to maintain this diversification approach through 2012. It is important to recognize that in p...

AI summary ENSC diversified its DSM programs beyond lighting in 2011, introducing initiatives like LIR, MURR, and Fuel Substitution pilots. While the 2011 evaluation deemed the portfolio 'quite complete,' it highlighted challenges in aligning product offerings with specific market needs, such as differing savings evaluations for commercial vs. residential uses of the EP-DI program. Better market-specific product definitions were recommended for uniform evaluation.

GR can be adequately applied across all products or measures of a same program. The same observation applies to pilot projects as they should be developed in consideration of program characteristics. Ref.: 5725 9 Evaluation of 2011 DSM Pro...

AI summary The 2011 evaluation of ENSC’s DSM programs aimed to assess process effectiveness, calculate gross/net savings, and recommend improvements. Methodology included document analysis, interviews with the Program Manager and partners, and participant/non-participant surveys.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary 2.2.2 In-Depth Interviews The 2011 evaluation methodology included in-depth interviews with program staff as well as with different program partners. Between September 2...

AI summary Efficiency Nova Scotia Corporation's 2011 evaluation methodology involved 76 in-depth interviews with stakeholders including program managers, contractors, distributors, and participants between September and November 2011. The interviews aimed to assess program implementation and effectiveness across various roles.

1 3 4 Total 15 13 13 10 10 6 9 Ref.: 5725 11 Evaluation of 2011 DSM Programs Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary 2.2.3 On-Site Visits For the 2011 evaluations, Econoler visited a total of 115 participant s...

AI summary Econoler conducted on-site visits to 115 participant sites and 10 retail stores in 2011 to evaluate DSM programs, collecting data on installation rates, operational hours, and program effectiveness through mystery shopper assessments and retail store observations.

oducts and the program on the part of employees. The complete results of the site work are provided in the individual program reports. Table 6: 2011 On-Site Visits On-Site Visits Completed in 2011 Program Participant Sites Retailer Stores...

AI summary The text presents data from 2011 on-site visits for various DSM programs, including participant sites and retailer stores, and references an evaluation of 2011 DSM programs by Efficiency Nova Scotia Corporation. It also notes a section on participant surveys (2.2.4).

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary 2.2.4 Participant Surveys A total of 761 interviews with 2011 program participants and 70 interviews with non-participants (Table 7) were completed for this evaluation....

AI summary The 2011 evaluation of Efficiency Nova Scotia Corporation programs involved 761 participant and 70 non-participant interviews, assessing satisfaction, program effectiveness, free-ridership, and barriers. Surveys were conducted via CATI and RDD between September-December 2011 to evaluate program impacts and gather improvement recommendations.

to reach non- participants, and participants in the remaining programs were surveyed utilizing contact information provided by ENSC. Table 7: 2011 Telephone Surveys Surveys Completed in 2011 Program Non- Participants Participants ARet 90 R...

AI summary The text outlines telephone surveys conducted in 2011 for various DSM programs, with ENSC providing participant contact information. The evaluation of these programs is discussed, including survey completion numbers for different initiatives.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary 2.2.5 Impact Evaluation The impact evaluations integrated findings from the telephone surveys, program data from the tracking system, on-site visits and/or interviews wi...

AI summary The impact evaluation of ENSC programs integrated data from surveys, tracking systems, on-site visits, and billing analysis. Methods included metering for ARet/ARep programs and HOT20001 simulations for EEH/Performance Plus/Low Income. Billing analysis for LIR faced limitations due to low participation, though it was recommended for future use to enhance savings verification accuracy.

ately estimate savings in some instances. Recommendations presented for specific programs in the following sections include ways in which the billing analysis could support ENSC in future evaluations. The 2010 verification study also menti...

AI summary The text discusses challenges in evaluating energy efficiency programs due to complexities around early replacement of equipment. It highlights differing approaches by jurisdictions like New York and California, while noting no consensus exists. The evaluation did not address early replacement due to time constraints, emphasizing the need for careful consideration with ENSC.

constraints, early replacement situations were not addressed. It is important to address this issue carefully with ENSC in order to better understand where dual baselines could be implemented across 1 HOT2000 is residential energy analysis...

AI summary The text discusses the need to address early replacement situations in ENSC's programs and the potential use of dual baselines for evaluation. It notes that residential programs may not be suitable for dual baselines due to information challenges, while commercial programs may be viable candidates. Discussions with ENSC are recommended to define realistic implementation strategies.

proach could be put in place. Following this evaluation, discussions should be held with ENSC to clearly define where a dual baseline is realistic and how it can be implemented for future evaluations. For all programs, interactive effects...

AI summary The evaluation of ENSC's programs uses a self-report method to estimate free-ridership, incorporating enhancements such as a 0 to 10 scoring system and a more comprehensive consideration of factors influencing energy efficiency decisions. This approach aligns with methods used in other jurisdictions and follows discussions from a PDWG meeting.

13.6% 12.8% In 2010, the free-ridership level for CFLs sold through the RMP was integrated with the spillover in a global NTGR. Ref.: 5725 16 Evaluation of 2011 DSM Programs Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Sum...

AI summary The document highlights the need for improved program manuals for Efficiency Nova Scotia Corporation (ENSC) to enhance documentation, data management, and program evaluation. Econoler identified missing components in the current manuals and provided recommendations for improvement.

r has the following recommendations, where applicable, to supplement and improve the tool: Table 9: General Recommendations on ENSC Program Manuals No. Recommendations OV-R1. Provide a “base case”: The program manuals do not provide a “bas...

AI summary The text outlines two recommendations for improving ENSC program manuals. The first suggests including a 'base case' to document variables used in calculating gross savings. The second recommends documenting parameters used to estimate program objectives, including distortion and interactive effects, and adjusting them annually based on evaluation results.

ep track of the assumptions used to estimate the program objectives. The parameters should then be adjusted annually based on the most recent evaluation results. Ref.: 5725 17 Evaluation of 2011 DSM Programs Efficiency Nova Scotia Corporat...

AI summary The text discusses the need to track assumptions used in estimating program objectives and adjust parameters annually based on the most recent evaluation results. It references an evaluation of 2011 DSM programs by Efficiency Nova Scotia Corporation.

No. Recommendations OV-R6. Adjust the tracked savings on the basis of the evaluation results: In order to provide a more precise estimation of savings, ENSC should track the gross and net savings of each program on the basis of the most re...

AI summary The recommendations focus on improving the accuracy and consistency of savings tracking for energy efficiency programs. ENSC is advised to adjust tracked savings based on evaluation results, use average unitary savings values for residential programs, and establish standardized data tracking protocols across all programs.

presence of air conditioning unit or system, wattage information, etc.). This will allow for a more precise evaluation of savings. 3.3 EVALUATION PLAN The evaluation plan identifies key variables that must be collected as part of program o...

AI summary The text discusses the importance of developing an evaluation plan in parallel with program design, emphasizing that this approach ensures more rigorous evaluation and covers research topics important to program managers. The recommendation is made by Econoler in the context of evaluating DSM programs.

valuation plan can be tailored to the specifics of a given program. However, a certain amount of basic information is typically included in evaluation plans. The table below presents such information. Table 12: Information Typically Contai...

AI summary The text outlines the typical components of an evaluation plan for a program, including the program description, marketing strategy, partners, evaluation window, objectives, and metrics for monitoring and realizing program targets.

participants or units Objectives monitoring (tracked savings) Data from the program tracking system Objectives realization rate (%) Ratio between targets and tracked savings Business case Details on expected gross and net savings calculati...

AI summary The document outlines key metrics and evaluation criteria for energy efficiency programs, including objectives monitoring, realization rates, business case calculations, and types of evaluations required. It emphasizes factors such as baseline energy levels, technical distortions, free-ridership, and spillover effects in calculating net savings.

for each of the programs. Note that the numbering of the recommendations corresponds to the numbering presented in the individual reports. 4.1 RESIDENTIAL 4.1.1 Appliance Retirement Program The 2011 evaluation of the ARet program demonstra...

AI summary The 2011 evaluation of the Appliance Retirement (ARet) program showed high participation and significant energy savings. However, participants and the DA suggested improvements in marketing and outreach, citing challenges with the third-party marketing agency's lack of expertise and understanding of program goals.

ARet-R1. Strengthen the marketing strategy: The 2011 evaluation results highlight the importance of marketing and advertising in the promotion and awareness of the ARet program. Indeed, most participants have read or heard about the progra...

AI summary The text discusses recommendations for improving the ARet program, emphasizing the need to strengthen marketing strategies and ensure comprehensive data collection in tracking sheets for evaluation purposes. It highlights the importance of marketing in program awareness and the need to collect specific appliance data for accurate energy consumption estimation.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary ARet-R4 Conduct on-site metering for dehumidifiers and room air conditioners: The metering conducted at the recycling facility included the consumption measurement of 29...

AI summary The document discusses the evaluation of an appliance retirement program (ARET) and an appliance replacement program (ARep) in Nova Scotia. It highlights the limitations of metering data collected at a recycling facility and recommends on-site metering during the summer in homes. The ARep program achieved energy and demand savings in 2011 through refrigerator and freezer replacements.

viewed the unitary savings estimates, using the metering data from the ARet program and the theoretical energy consumption of the new models installed, based on the ENERGY STAR-qualified product list. As for the process evaluation of the A...

AI summary The evaluation of the Appliance Replacement Program (ARep) highlights the importance of offering financing options to overcome barriers to purchasing large quantities of appliances. Retailers expressed high satisfaction with the program, but noted that upfront payment requirements limited participation. Recommendations include improving access to upfront capital for landlords.

ERGY STAR criterion and to identify the energy consumption of the appliance would ensure that savings are calculated correctly. 4.1.3 Retail Markdown Program The 2011 evaluation of the RMP demonstrated that the program used the right appro...

AI summary The 2011 evaluation of the Retail Markdown Program (RMP) showed increased participation and significant energy and demand savings. However, awareness of the program and its promotions decreased, with issues like disorganized displays and inadequate marketing materials identified as barriers to effectiveness.

g and advertising are optimal. It would inform customers of the existence of the program and guide them towards eligible products, which in turn should reduce the free-ridership level. RMP-R2. Consider conducting exit surveys: The challeng...

AI summary The text discusses strategies to improve program awareness and reduce free-ridership, including advertising and exit surveys. Exit surveys are suggested as a more effective method to assess program impact by interviewing participants immediately after purchase, improving recall and data accuracy.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary RMP-R3. Increase the number of retailer interviews planned for the evaluation: During retailer interviews, Econoler noticed that the program had not only influenced the...

AI summary The document discusses the need to increase the number of retailer interviews in the evaluation of a program to better understand its indirect market influences. It also mentions the LED Holiday Light Exchange Program, which has distributed over 46,000 LED light sets since 2007 and is being evaluated for electricity savings.

s been conducted since the program started its activities. Therefore, the evaluation conducted this year for this program aimed to evaluate the electricity savings generated by the program since 2007. The 2007-2011 evaluation of the progra...

AI summary The evaluation of the program since 2007 shows net energy savings of 1.447 GWh and demand savings of 3.618 MW, though net savings fell short of tracked savings due to interactive effects and adjustments. The Low Income Renter Program (LIR) generated 4.756 GWh and 1.066 MW savings in 2011, but faced challenges due to limited participant eligibility.

LIR-R3 Increase the number of on-site visits to validate product installation: During the 15 on-site visits conducted for this evaluation, Econoler noted that a removal phenomenon existed for CFLs, and more significantly for LED nightlight...

AI summary The evaluation of the program recommends increasing on-site visits to validate product installations and collecting more detailed data, such as heating types and air conditioning usage, to improve the precision of savings evaluations and impact assessments.

ld lamps replaced is another element that could be relevant for validating the baseline case and for ensuring that the new lamps installed actually replaced less efficient lamps. At first, Econoler had planned to validate such information...

AI summary The document discusses the validation of energy savings from the Multi-Unit Residential Renter Program (MURR) in 2011, highlighting the accuracy of tracking sheets and installation rates, particularly for CFLs. It also mentions the importance of verifying lamp replacements to ensure energy efficiency gains.

No. Recommendations MURR-R1. Review marketing material used for lobby events: The program partners have mentioned that the information related to time commitment shown on the marketing posters used to promote the lobby events was misleadin...

AI summary The recommendations focus on improving the marketing of lobby events for the MURR program to avoid misleading tenants about time commitments and enhancing participant education on the proper use of energy-saving products, such as power bars with integrated timers, to ensure long-term energy savings.

EP-DI-R1. Improve the tracking sheet to allow for a better validation of savings: Several fields in the tracking sheet are not required for program administration. Those fields are present even though they are not filled and should be remo...

AI summary The document recommends improving the EP-DI program's tracking sheet by removing unnecessary fields and ensuring required fields are consistently filled. It also suggests enhancing marketing strategies, as most participants learned about the program through direct interactions rather than marketing materials, and there is a desire for more effective advertising.

nformation for these categories and the establishment of adjustment values that could be used to correct savings. 4.1.8 EnerGuide for Existing Houses Program The 2011 evaluation of the EEH program demonstrated that it is a good energy effi...

AI summary The EnerGuide for Existing Houses (EEH) program in 2011 achieved energy and demand savings, with 1,494 participants. Evaluation highlighted program success but noted concerns about future continuation due to uncertainty around federal government involvement and inconsistent marketing efforts.

No. Recommendations Fuel-R1. Consider making partnerships for program expansion: At this point, the program is a pilot and does not include delivery agents (DAs) or contractors for instance. For such a pilot to become a program, a DA would...

AI summary The recommendations focus on expanding the program through partnerships, increasing awareness via advertising and collaboration with stores, and improving the tracking sheet with more detailed information on project status and system capacities to better justify savings.

No. Recommendations LI-R1. Assess the installation rate of certain prescriptive measures: In 2011, the savings related to the increase of EnerGuide points accounted for only 13 percent of total program energy savings, the remaining proport...

AI summary The document outlines recommendations for improving energy efficiency program evaluations, including assessing the installation rate of prescriptive measures, reviewing HOT2000 models, and ensuring final audits are completed after implementing energy efficiency measures. These recommendations aim to enhance the accuracy and effectiveness of program evaluations.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary 4.1.11 Performance Plus Program The 2011 evaluation of the Performance Plus program demonstrated that the program is well designed. The program totalled 701 participants...

AI summary The 2011 evaluation of the Performance Plus program showed it is well-designed, with significant participation growth and notable energy and demand savings. Builders were identified as key partners, and participants were satisfied with the program. Recommendations aim to further optimize its performance.

the following recommendations that aim at optimizing specific aspects of the program: Table 22: Recommendations for the Performance Plus Program No. Recommendations PP-R1. Increase the number of in-depth interviews with home builders: When...

AI summary The document recommends increasing the number of in-depth interviews with home builders in the Performance Plus Program to better assess market effects, as the current sample size was too small to draw definitive conclusions about the program's impact.

tia Corporation ECONOL:R Overall Executive Summary 4.2 COMMERCIAL & INDUSTRIAL 4.2.1 Business Energy Rebates Program The 2011 evaluation of the BER program demonstrated that the program is well designed and has a good potential for success...

AI summary The Business Energy Rebates (BER) program saw significant growth in 2011, with 106 participants and substantial energy and demand savings. Evaluation highlighted the program's success but noted areas for improvement, including communication and marketing. The ENSC website was effective, but further engagement with participants is recommended to enhance program effectiveness.

BER-R2. Inform participants about expected customer savings: Once the final rebate is disbursed to clients, Econoler recommends informing them about the approximate savings to be expected from the project, in terms of energy and money. Thi...

AI summary The document outlines several recommendations for improving the BER program, including informing participants about expected savings, increasing promotion efforts, and collecting additional information to better calculate energy savings from various efficiency measures.

heating source and the use of air conditioning should be collected during the surveys with C&I customers to better estimate the interactive effects. BER-R5. Increase the number of on-site visits to include an acceptable quantity of project...

AI summary The text discusses the need to collect data on heating and air conditioning usage from C&I customers to better estimate interactive effects. It also suggests increasing on-site visits to ensure sufficient data collection for each category of equipment installed through the program, to properly assess adjustments to energy and demand savings.

No. Recommendations SLC-R1. Improve the quality of distributors’ invoices and develop a tracking sheet that monitors program savings for the whole year: Several formats are used in the invoices provided by distributors. These invoices do n...

AI summary The recommendations focus on improving distributor invoice quality and collecting additional data through telephone surveys with C&I customers to better monitor program savings and evaluate retrofit activities, including de-lamping and T8 lamp replacements.

No. Recommendations CINC-R1. Conduct a separate complete evaluation for the CINC program: In 2010, only one new construction project was included in the C&IC program. This project was implemented using a “whole building” approach and its s...

AI summary The document recommends conducting a separate evaluation for the CINC program in 2012 to better assess its impacts and address uncertainties in savings calculations. It also suggests comparing real building consumption with design simulations to improve accuracy in M&V activities.

Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary CINC-R3. Clearly define the CPG minimum requirements at the early stage of the CINC projects: The Evaluator noticed that the M&V step of the program process was an issue...

AI summary The Evaluator recommends clearly defining the CPG minimum requirements early in CINC projects to improve M&V processes and encourages ENSC to provide detailed examples and templates. Additionally, the Evaluator suggests incorporating limited peak demand savings into project impact calculations for the CINC program to enhance overall program impact.

they could raise the overall impact of the program with future increases in the number of program participants. 4.2.4 Small Business Energy Solutions Program The 2011 evaluation of the SBES program demonstrated that the program is well des...

AI summary The Small Business Energy Solutions Program (SBES) has shown positive results with increasing participation and energy savings. The 2011 evaluation noted 1,468 participants and energy savings of 23.180 GWh. Recommendations focus on improving communication and marketing to increase awareness and participation.

Programs Efficiency Nova Scotia Corporation ECONOL:R Overall Executive Summary SBES-R4. Revise the list of products eligible for an incentive through the SBES program: Restricting eligibility to high-end products like LED lamps or high- pe...

AI summary The document discusses revising the SBES program to restrict eligibility to high-end energy-efficient products in order to reduce free-ridership. It also references an evaluation of energy efficiency projects at New Page paper mill, conducted as part of the 2011 ENSC program evaluation.

ir satisfaction with the program. Moreover, almost all participants (98%) reported that they would recommend the ARet program to a friend or family member, which is a strong indicator of satisfaction. The program partners interviewed were...

AI summary The Appliance Retirement (ARet) program received high satisfaction ratings from participants, with 98% willing to recommend it. Program partners were also satisfied, though a transport contractor suggested improving the tracking system for appliance units. The program's net savings were calculated by Econoler, taking into account free-ridership and internal spillover effects, resulting in a 22% free-ridership level.

: Distortion Effects and Net-to-Gross Ratio 2011 Free-Ridership Level 22% Spillover Level 1% Net-to-Gross Ratio 0.79 The evaluation revealed that the ARet program had generated net energy savings of 7.175 GWh and demand savings of 1.144 MW...

AI summary The ARet program achieved net energy savings of 7.175 GWh and demand savings of 1.144 MW in 2011. These savings exceeded the tracked savings by ENSC by 71%, largely due to revised unitary savings values based on metering data and studies from Ontario.

am logic model below shows the causal links between program activities and the changes expected in the market. Figure 1: Efficient Products – Appliance Retirement Program Logic Model Ref.: 5725 2 Efficient Products – Appliance Retirement P...

AI summary The document outlines the methodology used in the 2011 evaluation of the Efficient Products – Appliance Retirement Program. It includes a logic model showing causal links between program activities and market changes, as well as a methodological model with research tools and data sources such as the ENSC website, previous evaluation reports, and program manuals.

thodology used for the on-site visits for the ARet program is further explained in the program impact evaluation section of this report. A copy of the site visit protocol is included in Appendix VII. Ref.: 5725 4 Efficient Products – Appli...

AI summary The report discusses the methodology used for on-site visits in the Appliance Retirement (ARET) program and mentions a participant survey conducted by Econoler’s subcontractor, Corporate Research Associates, Inc. (CRA), in 2011. The survey aimed to understand participant experiences and program impact.

y on the three most important appliances: refrigerators, freezers and room air conditioners. Considering all appliance types, the total population of participants in the program amounts to 6,596. Ref.: 5725 5 Efficient Products – Appliance...

AI summary The document outlines the process evaluation of the Appliance Retirement Program (ARet) conducted by Efficiency Nova Scotia Corporation (ENSC), focusing on assessing the program's design and delivery effectiveness through interviews and surveys. It also discusses the content of the ARet program manual used by program staff and evaluators.

s found in the ARet program manual. Table 4: Program Manual Content Program Manual Content ARet Program Manual Document revisions Program description (including nature or type of program) Program justification Program objectives Incentives...

AI summary The document outlines the content of the ARet Program Manual, which includes sections on program description, incentives, eligibility criteria, cost-effectiveness tests, marketing and evaluation plans, and program theory. It also references a 2011 evaluation report by Efficiency Nova Scotia Corporation.

ain program barriers identified is the customers’ resistance to get rid of a working appliance. Econoler recommends that the marketing strategy be oriented towards that specific barrier. > Develop an evaluation plan in parallel with progra...

AI summary Econoler identifies customer resistance to retiring working appliances as a barrier to the program and recommends aligning marketing strategies with this issue. An evaluation plan is recommended for the program to ensure rigorous assessment and data collection, with a focus on methodology and pre- and post-data. The ENSC website provides program information and online enrollment, contributing to ease of participation.

ram asset by Econoler. The online booking may contribute to the positive evaluation of survey respondents as to the ease of participation in the program (see Section 3.7.1 for additional information). As part of the evaluation, Econoler no...

AI summary The evaluation of the ARET program highlights high satisfaction among program partners with ENSC’s team and overall program. While the delivery agent found the participation process simple, the transport contractor noted some complexity due to logistics. Complaints included missed pick-ups and lost cheques. The program name change was viewed differently by partners, with some preferring the old name for its user-friendliness.

that the former program name, “Pull the Plug,” was more grabbing and more user friendly to customers, the recycling contractor mentions that the new name is more representative of the program itself. The recycling and transport contractors...

AI summary The Appliance Retirement Program faced challenges in implementation, including difficulties in finding reliable subcontractors and effective marketing strategies. Program partners and the delivery agent highlighted issues with third-party creative agencies and the complexity of managing multiple subcontractors.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Nine in 10 respondents found the process of scheduling the time for pick-up easy (90%), or a mean score of 4.6, which is consistent with findings from last year. From the three resp...

AI summary The 2011 Evaluation Report indicates that 90% of respondents found scheduling pick-up times easy, with a mean score of 4.6, consistent with the previous year. A small number of respondents faced challenges, such as difficulty contacting someone or unavailability of program representatives.

ements needed 7 No recommendations 56 71 Multiple responses Ref.: 5725 26 Efficient Products – Appliance Retirement Program Efficiency Nova Scotia Corporation 2011 Evaluation Report Four in 10 respondents (40%) do not believe a diagram ill...

AI summary The 2011 Evaluation Report on the Efficient Products – Appliance Retirement Program found that while 40% of respondents did not believe a diagram would facilitate participation, 28% believed it would significantly help. Around half (46%) thought the diagram would be helpful, suggesting that the flow chart developed by ENSC was a positive initiative to simplify future participation.

This result indicates that the participation process flow chart developed by ENSC in late 2011 was a good initiative as it will potentially simplify the participation of future program participants. Table 30: Diagram Illustrating Steps of...

AI summary The 2011 evaluation report for the Appliance Retirement Program (ARet) by Efficiency Nova Scotia Corporation (ENSC) assesses the program's impact on energy and demand savings. The report includes a flowchart developed in 2011 to improve future participant engagement and evaluates factors such as adjusted unitary savings, energy-to-demand ratio, and free-ridership.

on. To do so, Econoler reviewed the following parameters: > adjusted unitary savings; > energy-to-demand ratio; > interactive effects; > free-ridership; and > spillover. The review of the unitary savings calculations is mainly based on the...

AI summary The document discusses the evaluation of the Efficient Products – Appliance Retirement Program in 2011, focusing on parameters like unitary savings, free-ridership, and spillover effects. It also describes the sampling methodology for on-site visits and the types of appliances retired, with refrigerators being the most common.

used appliance replaced the unit retired, specifications of this appliance were collected by the Evaluator to, among other things, determine whether the new appliance met ENERGY STAR specifications. Ref.: 5725 29 Efficient Products – Appli...

AI summary The evaluation report discusses the Appliance Retirement Program by Efficiency Nova Scotia Corporation, noting that estimated savings for appliances are not tracked in the tracking sheet. Instead, the annual energy consumption of retired appliances is recorded, and a metering activity was conducted at the recycling facility to measure energy consumption using a protocol based on the New York Technical Resource Manual.

metering test of 26 hours. The table below presents the number of units tested for each appliance retired through the program. Table 32: Number of Appliances Metered Number of Units Number of Units Appliance Retired Tested Refrigerators 4,...

AI summary The document discusses the appliance retirement program, focusing on the number of units tested for each appliance type and the calculation of unitary savings values for refrigerators. It references a technical resource manual and outlines parameters considered in the evaluation process.

he equation below. The energy savings (kWh) associated with the additional retirements were estimated using the adjusted unitary savings value reviewed in this evaluation for each type of appliances. % From the 90 participants surveyed, tw...

AI summary The evaluation report estimates energy savings from the Appliance Retirement Program, considering spillover effects and free-ridership. It calculates a net energy savings of 6.493 GWh and 1.036 MW at the meter, and 7.175 GWh and 1.144 MW at the generator, using the NTGR value of 0.79.

rmation on the model, such as the capacity and the age of manufacture, and information on usage patterns by asking the participants during which seasons they operate their appliances and for how long. The NTGR was evaluated at 0.79 for the...

AI summary The evaluation of the Appliance Retirement Program discusses the Net Total Gross Replacement (NTGR) rates for appliances retired through the program and in-store events, as well as the assessment of free-ridership and interactive effects on home energy consumption. The NTGR was slightly higher than previously used, and free-ridership was estimated at 1 percent.

Program 1. Provide a “base case”: The program manual does not provide a “base case” Manual that provides information on how the assumed gross savings have been Content established. For refrigerators and freezers, they are calculated on a c...

AI summary The document highlights the need for the program manual to include a 'base case' for calculating gross savings, document parameters used for estimating program objectives, and refine and disseminate marketing plans. It emphasizes the importance of transparency, validation, and updating of methodologies and assumptions for accurate forecasting and evaluation.

s, even if they are prepared in another department, should cover a whole year of activities and be included in the program manual. The plans should also identify for each activity the performance indicators that should be collected for mon...

AI summary The document emphasizes the importance of comprehensive program manuals that cover annual activities and include performance indicators for monitoring and evaluation. It also highlights the need for standardization and regular updates to ensure consistency and clarity, especially regarding program details such as the retirement of both primary and secondary units.

Program 9. Develop an evaluation plan in parallel with program design and Design and development: This program has no evaluation plan. Econoler strongly Implementation recommends that for each new program, an evaluation plan be prepared in...

AI summary The text highlights the need for an evaluation plan for a program, the importance of strengthening marketing strategies, communication about appliance disposal, and the pursuit of metering for refrigerators and freezers at the recycling facility to improve program effectiveness and participant engagement.

he other program or calculate the net savings in this program? Q: If it is replaced by another unit not part of any other of your program do you still calculate the savings as if it was not replaced? C: Saturation - The cream skimming phen...

AI summary The text discusses questions and responses related to the Appliance Retirement Program by Efficiency Nova Scotia Corporation, including eligibility criteria, verification methods, program separation, and issues like free ridership and cream skimming. It also references evaluation reports and program logic models.

s concerning relatively high free ridership levels? Q: What is the status regarding the recommendation to screen the free-ridership? C: Cream skimming could look like a lot of free riders. Page 51 ARR-R12 Q: what is the status about this r...

AI summary The text discusses questions and comments regarding free ridership levels, communication issues among multiple organizations, and the evaluation of the Appliance Retirement Program. It also raises inquiries about data sources, distortion effects, barriers to appliance retirement, and the evaluation processes used.

s there a process flow chart for that program? The web site explains all the steps but there is no illustration. Q: was there an evaluation plan associated to that program when it was first designed? Q: Nowhere do we see the role of the de...

AI summary The document includes a series of questions and comments related to the evaluation and implementation of the Efficient Products – Appliance Retirement Program by Efficiency Nova Scotia Corporation. Questions focus on program design, evaluation plans, delivery processes, and barriers to customer participation.

evaluation? And if not why? Q: was there an evaluation plan when this program was first designed? Q: Is there a written marketing and outreach strategy for that program with performance indicators? Q: How would you rate the facility or dif...

AI summary The document includes a series of evaluation questions for the Appliance Retirement Program operated by Efficiency Nova Scotia Corporation (ENSC), as well as an interview guide for program partners. The questions focus on program evaluation, marketing strategy, and ease of use of a centralized database.

u had that role (specify months or years)? Q1b - If you were a program partner before it changed status and name from Conserve Nova Scotia to ENSC, how was this transition perceived in the market? Not applicable Unnoticed Some confusion A...

AI summary The text includes survey questions about the transition of a program from Conserve Nova Scotia to ENSC, the impact on relationships with the Program Administrator, and complaints received from program participants. It references an evaluation report from 2011.

n regard to the program name that has changed from ‘’Pull the Plug’’ to Appliance Retirement and Replacement Program (ARR) and to Appliance Retirement Program (ARet) since its first implementation? Q14- What is your opinion in regard to pr...

AI summary The text discusses the renaming of a program from 'Pull the Plug' to the Appliance Retirement and Replacement Program (ARR) and Appliance Retirement Program (ARet), and asks about program modifications, complaints from partners, and barriers to implementation. The document is an evaluation report from Efficiency Nova Scotia Corporation from 2011.

2011 Evaluation Report Q4 – How would you qualify your participation process in this program? Simple or easy Complex Q4a - If you checked the Complex box, please elaborate. No comment / no opinion Q5- On a scale from 1 to 10 (where 1 is ve...

AI summary The text contains a series of survey questions from a 2011 evaluation report on the Appliance Retirement Program by Efficiency Nova Scotia Corporation. The questions aim to assess participant satisfaction, program complexity, and suggestions for improvement, including views on marketing, outreach, and third-party involvement.

our opinion on the number of third parties involved in this program other than you (delivery agent, transport contractor, call center). Are they? Too few Adequate Too many No opinion Q9a- If you answered Too Few or Too Many, please comment...

AI summary The text includes survey questions related to the Efficient Products – Appliance Retirement Program by Efficiency Nova Scotia Corporation, asking about the number of third parties involved, market confusion, relationship ratings with program partners, lead sources, and opinions on program name changes and modifications.

m name (new territory, additional equipment, etc.)? Easy to adjust to the way you work Requires minor changes to the way you work Requires major changes to the way you work No opinion Ref.: 5725 76 Efficient Products – Appliance Retirement...

AI summary This document contains a survey questionnaire from the 2011 Evaluation Report of the Appliance Retirement Program by Efficiency Nova Scotia Corporation. It includes questions about program implementation barriers, complaints from partners, and participant feedback.

READ. PROBE FOR SPECIFIC REASONS. ACCEPT MULTIPLE] S4. How did you initially sign up for the program? Did you sign up over the phone with a toll free number or did you sign up online? 1. (Over the phone) 2. (Signed up online) 3. (Both) 98....

AI summary The text includes survey questions related to the Appliance Retirement Program, focusing on how participants signed up, their experience with online and phone sign-up processes, and difficulties encountered. It also asks for recommendations to improve the program.

FR5 – FR7) ≥ 30%. In that case, the participant’s answers to FR5 and FR7 represented an inconsistency and PA2 became equal to the smallest value between FR5 and FR7. Otherwise, PA2 remained unchanged. Finally, the average free-ridership le...

AI summary The document discusses the calculation of free-ridership levels in an energy efficiency program, considering participant responses and energy savings. It also references an evaluation report on an appliance replacement program conducted by Efficiency Nova Scotia Corporation in 2011.

Initial Gross NTGR Net Savings Savings Energy Savings Tracked Savings from ENSC 0.362 GWh 0.74 0.268 GWh Evaluation Results 0.548 GWh 1.00 0.548 GWh Demand Savings Tracked Savings from ENSC 0.043 MW 0.74 0.032 MW Evaluation Results 0.065 M...

AI summary The evaluation report highlights that the net evaluated savings from the Appliance Replacement Program more than doubled compared to the tracked savings. This is attributed to an upward revision of unitary savings values for refrigerators based on metering data from the ARET program and the NTGR of 1. The program, though discontinued in 2012, is noted to have worked well overall and recommendations are provided for potential future implementations.

m logic model below shows the causal links between program activities and the changes expected in the market. Figure 1: Efficient Products – Appliance Replacement Program Logic Model Ref.: 5725 2 Efficient Products – Appliance Replacement...

AI summary The document outlines the methodology used in the 2011 evaluation of the Efficient Products – Appliance Replacement Program, including the analysis of program documentation and in-depth interviews with the program manager.

obtained from the following four sources: > ENSC website; > 2010 evaluation report; > program manual; > tracking sheet. 2.2.2 In-Depth Interview with Program Manager Econoler staff conducted one interview in September with the Program Mana...

AI summary The document outlines the data sources and interview processes used in evaluating the Appliance Replacement Program by Efficiency Nova Scotia Corporation. It includes interviews with the Program Manager and a Retailer Partner, as well as on-site visits, to gather information on program justification, savings calculations, barriers, marketing strategies, and participation processes.

Efficiency Nova Scotia Corporation 2011 Evaluation Report 2.2.4 On-Site Visits In November, two on-site visits were conducted at multi-unit residential buildings in which appliances had been replaced through the ARep program. In each multi...

AI summary This section of the 2011 Evaluation Report discusses on-site visits conducted in November at multi-unit residential buildings where appliances were replaced through the Appliance Replacement Program (AREP). The visits aimed to validate the installation and characteristics of new refrigerators and were conducted by a subcontractor of Econoler.

fectiveness of the program design and delivery.” The process evaluation relied upon in-depth interviews conducted with the PM and with the program partner (retailer). 3.2 PROGRAM MANUAL CONTENT The ARep program features a manual that conta...

AI summary The evaluation of the Appliance Replacement Program (AREP) includes a process evaluation based on interviews with the Program Manager and a program partner. The program manual contains essential components such as program description, objectives, incentives, eligibility criteria, and marketing plans, tailored to internal use by staff and evaluators.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Program Manual Content ARep Program Manual Evaluation plan Program theory Logic model Program process flow chart Partner or participant process flow chart Program forms Information...

AI summary The evaluation report for the Appliance Retirement Program (AREP) notes that the program manual lacks detailed criteria for rebate determination and does not provide a 'base case' for calculating assumed gross savings. Econoler recommends improving the documentation to enhance transparency and validation of program assumptions.

bles such as operating time, wattage or base consumption. The identification and value of each of these variables should be available and documented for validation and updating purposes. > Provide the parameters used to estimate the progra...

AI summary The text discusses the need for documenting variables such as operating time and wattage for validation, and the importance of estimating program objectives using parameters based on past evaluations and market intelligence. It also highlights the need to refine and disseminate marketing plans with performance indicators for monitoring and evaluation.

year of activities and be included in the program manual. For each activity, the plans should identify the performance indicators to be collected for monitoring and evaluation purposes. > Complete the program manual to keep track of change...

AI summary The document discusses the need to complete and standardize the program manual for tracking activities and performance indicators. It also reviews the structure and content of the ARep tracking sheet, noting its usefulness in monitoring refrigerator installations and replacements.

eet also contains a field that refers to the age of the unit retired. This field is essential to validate that the refrigerators replaced under the program are older than ten years, which is one of Ref.: 5725 8 Efficient Products – Applian...

AI summary The evaluation report discusses the Appliance Replacement Program's tracking sheet, noting that while it meets basic monitoring needs, it lacks energy savings monitoring. The report recommends adding a field for average unitary savings values to improve evaluation accuracy.

ore, Econoler did not apply any adjustments in the savings calculations but repeats its recommendation to include a field to validate that the ENERGY STAR criterion has been respected. > Include a field to indicate the annual energy use of...

AI summary Econoler evaluated the Appliance Replacement Program and found it well-designed but with potential for improvement. It recommended adding a field to track annual energy use of new appliances and validating the ENERGY STAR criterion in the tracking sheet to enhance evaluation accuracy.

ng program design and implementation. The following are comments and recommendations that would have a positive impact on the design and delivery of the program, should it be re-offered in the future: > Consider offering financing: ENSC ne...

AI summary The text discusses recommendations for improving the design and delivery of a program, including offering financing to landlords and developing an evaluation plan in parallel with program development to ensure rigorous assessment and data collection.

mportant to the PM are covered. The two most important components of the plan are the evaluation methodology as well as the pre- and post-data required to apply the selected methodology. > Focus on a resource acquisition objective: Having...

AI summary The evaluation of the Appliance Replacement Program emphasizes the importance of the evaluation methodology and data collection. The program is focused on resource acquisition rather than market transformation due to its rebate structure and limited advertising. There were challenges with the transition from Nova Scotia Power to Efficiency Nova Scotia Corporation, causing confusion and delays.

ration 2011 Evaluation Report 4 IMPACT EVALUATION 4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evaluation is aimed at determining the gross and net savings of the ARep program for 2011. Both energy and demand savings were...

AI summary The 2011 impact evaluation of the Appliance Replacement Program (AREP) assessed energy and demand savings. Econoler reviewed unitary savings and conducted on-site visits to validate installations and refrigerator characteristics. The net-to-gross ratio (NTGR) was assumed to be 1 due to insufficient participant numbers for a telephone survey.

ternal spillover. 8 From the 2011 socket study conducted by CRA with 1,004 households of Nova Scotia. 9 Statistics Canada (CANSIM), Households having air conditioning, Nova Scotia, 2009. Ref.: 5725 20 Efficient Products – Appliance Replace...

AI summary The ARep program's 2011 evaluation report estimates net energy and demand savings, using a net-to-gross ratio (NTGR) of 1 and assuming no interactive effects. The total net energy savings are 0.497 GWh at the meter and 0.548 GWh at the generator, with corresponding demand savings of 0.059 MW and 0.065 MW.

Demand Savings Tracked Savings from ENSC 0.043 MW 0.74 0.032 MW Evaluation Results 0.065 MW 1.00 0.065 MW The net evaluated savings more than doubled with relation to the net evaluated savings tracked by ENSC. This result is mainly due to...

AI summary The evaluation of the Appliance Replacement Program (ARET) by Efficiency Nova Scotia Corporation (ENSC) showed that net evaluated savings more than doubled compared to tracked savings, primarily due to an updated unitary savings value for refrigerators. The evaluation also considered installation rates, interactive effects, and the net-to-gross ratio (NTGR), concluding that free-ridership and spillover effects were negligible due to low participation.

rogram manual should document these parameters so that the PM and the Evaluator can keep track of the assumptions used to estimate the program objectives. The parameters should then be adjusted annually based on the most recent evaluation...

AI summary The document discusses the need to document parameters in the program manual to track assumptions used in estimating program objectives and the importance of refining and disseminating annual marketing plans that include performance indicators for monitoring and evaluation. It references an evaluation report for the Appliance Replacement Program by Efficiency Nova Scotia Corporation.

Program 5. Complete the program manual to keep track of changes and standardize Manual the content: The program manual is well written but important information is Content missing to serve as “program memory” in case of modifications or st...

AI summary The document outlines recommendations for improving the program manual and tracking sheet for the Appliance Replacement Program. It suggests standardizing the manual, updating it with recent forms, and adding a field to validate ENERGY STAR qualifications in the tracking sheet to ensure compliance and accuracy.

Program 9. Consider offering financing: ENSC needs to improve the availability of upfront Design and capital from landlords. Indeed, the financing barrier to purchasing large quantities Implementation of appliances was raised through the p...

AI summary Econoler suggests improving financing availability for appliance purchases by landlords and recommends developing an evaluation plan alongside program design. It also advises focusing on resource acquisition rather than market transformation for this program.

rocess Evaluation Program Name: Appliance Replacement Program Telephone Interview with the Program Manager Date: List of questions (Q) and comments (C) discussed Source: Program Manual Page 24 Q: Are you tracking the participants who recei...

AI summary The document outlines a telephone interview with the Program Manager of the Appliance Replacement Program, discussing program implementation, participant tracking, delivery agents, partnership roles, barriers related to landlord-tenant relationships and upfront capital, and performance indicators. It also references an evaluation report and questions about energy consumption data.

fficult task. To be discussed with PM. Q: Do you have the source and detail related to the 1608 kWh for the old fridge (this is without degradation factor) so in theory it should be higher? Page 59 C: In figure 2-2 we think that the bubble...

AI summary The text includes a series of questions raised during an evaluation of the Appliance Replacement Program by Efficiency Nova Scotia Corporation. Topics include program name changes, participant confusion, evaluation methods, and the effectiveness of the program's design. Questions also address data sources, evaluation plans, and challenges in implementation.

2011 Evaluation Report Q4 – How would you qualify your participation process in this program? Simple or easy Complex Q4a - If you checked the Complex box, please elaborate. No comment / no opinion Q5- On a scale from 1 to 10 (where 1 is ve...

AI summary The document is a 2011 evaluation report for the Appliance Replacement Program by Efficiency Nova Scotia Corporation. It includes survey questions about participant satisfaction, program complexity, and suggestions for improvement, as well as inquiries about the number of parties involved in the program.

n the change of program name)? Easy to adjust to the way you work Requires minor changes to the way you work Requires major changes to the way you work No opinion Not Applicable Ref.: 5725 33 Efficient Products – Appliance Replacement Prog...

AI summary The document contains survey questions and an on-site visit protocol from an evaluation report of Efficiency Nova Scotia Corporation's Efficient Products – Appliance Replacement Program from 2011. It includes questions about program name changes, barriers to implementation, and complaints from program partners, along with a protocol for site visits.

Efficiency Nova Scotia Corporation 2011 Evaluation Report KEY FINDINGS The 2011 evaluation of the RMP demonstrated that the program constitutes the right approach in a market transformation and resource acquisition perspective. The inciden...

AI summary The 2011 evaluation of the Retail Markdown Program (RMP) found that participant incidence increased slightly from 31% in 2010 to 37% in 2011. However, awareness of the program dropped, with fewer participants and non-participants recalling in-store promotions or discounts. Marketing materials were found to be disorganized, making it difficult for customers to identify discounted products.

ams in the overall executive summary of the 2011 demand-side management programs, the Evaluator has the following specific recommendations that are aimed at optimizing specific aspects of the program: RMP-R1. Review marketing material and...

AI summary The Evaluator recommends improving the marketing and in-store display of the 2011 demand-side management programs to increase awareness. The issues identified include the need for better design and implementation of marketing materials, as well as improved collaboration with retailers to ensure proper installation and visibility of program materials.

rtising are optimal. It would inform customers of the existence of the program and guide them towards eligible products, which in turn should reduce the free-ridership level. RMP-R2. Consider conducting exit surveys: The challenge of the E...

AI summary The text discusses strategies to improve the effectiveness of a program by informing customers about its existence and guiding them toward eligible products, which can reduce free-ridership. It also suggests conducting exit surveys to better assess program impact and participant awareness.

ng these exit surveys. For instance, an exit survey targeting thermostat buyers would allow collecting information on the housing type and the main source of energy they use. RMP-R3. Increase the number of retailer interviews planned for t...

AI summary The document discusses improvements to exit surveys and retailer interviews for evaluating the Retail Markdown Program (RMP). It suggests increasing the number of interviews to better capture indirect market influences and spillover effects from the program.

as the analysis of the program documentation. At that stage, key program information was reviewed. The information used to conduct this analysis was obtained primarily from the following four sources: > ENSC website; > 2010 evaluation repo...

AI summary The evaluation of the Retail Markdown Program involved reviewing program documentation, conducting interviews with the Program Manager, and engaging with the delivery agent and retailers. Key areas discussed included program justification, savings calculations, barriers, marketing strategies, and stakeholder involvement.

er things, to understand the delivery agent’s involvement in the program, their participation process in the program and their perception and satisfaction with the program. Interviews with Retailers In November, six in-depth interviews wer...

AI summary The document discusses interviews with retailers and on-site visits to evaluate the Retail Markdown Program (RMP) and its impact on product promotion and customer experience. It includes assessments of free-ridership, spillover effects, and retailer satisfaction with the program.

+9.8% Non-Participant Survey 260,023 70 +9.8% Overall Residential Survey 376,845 141 +6.9% Ref.: 5725 7 Efficient Products – Retail Markdown Program Efficiency Nova Scotia Corporation 2011 Evaluation Report 3 PROCESS EVALUATION 3.1 OBJECTI...

AI summary The document discusses the process evaluation of the Retail Markdown Program (RMP) by Efficiency Nova Scotia Corporation (ENSC), focusing on assessing the program's design and delivery. The evaluation involved interviews, surveys, and in-store visits. The RMP includes a program manual with internal components, though specifics are not fully detailed in the text.

al. Table 6: Program Manual Content Program Manual Content RMP Program Manual Document revisions Program description (including nature or type of program) Program justification Program objectives Incentives Eligibility criteria Not Applica...

AI summary The document outlines the content of the RMP Program Manual, including sections like program description, incentives, eligibility criteria, and budget. Econoler has evaluated the manual and provided recommendations for improvement.

Econoler has analyzed the RMP manual. It contains relevant information that is useful for both the PM and the Evaluator. However, Econoler proposes the following recommendations to improve the tool: > Document the major characteristics of...

AI summary Econoler has reviewed the RMP manual and found it lacks documentation on key program characteristics, a base case for gross savings calculations, and parameters used to estimate program objectives. These gaps hinder validation and updating of the program's evaluation.

Efficiency Nova Scotia Corporation 2011 Evaluation Report should document these parameters so that the PM and the Evaluator can keep track of the assumptions used to estimate the program objectives. Moreover, the parameters should be conti...

AI summary The document outlines recommendations for improving program management and evaluation processes, including documenting parameters, refining marketing plans, and completing the program manual. It also mentions the need for more detailed tracking sheets for program administration and evaluation.

HEET Econoler reviewed the content of the tracking sheet for the RMP. In general, the tracking sheet is consistent but contains minimal information for program administration and evaluation purposes. The tracking sheet is filled in with da...

AI summary Econoler reviewed the RMP tracking sheet, noting its consistency but lack of detailed administrative and evaluation data. The tracking sheet monitors product sales and returns but lacks package and product-specific details, which are stored in a separate database. Econoler supports ENSC's plan to require DAs to upload data into their management system in 2012.

Efficiency Nova Scotia Corporation 2011 Evaluation Report The tracking sheet also provides information on the retail pricing and the promotional pricing with the discount offered. However, the total discount amount given by ENSC to retaile...

AI summary The 2011 Evaluation Report discusses issues with the tracking sheet used by Efficiency Nova Scotia Corporation (ENSC) to monitor program performance. The sheet lacks information on total discount amounts and does not calculate gross energy savings. Econoler recommends adding a table of unitary savings values and a formula to compute savings directly in the tracking sheet.

noler has identified potential means of improving program design and implementation. The following are comments and recommendations that would have an impact on the design and delivery of the program: > Develop an evaluation plan in parall...

AI summary Econoler suggests improving program design and implementation by developing an evaluation plan in parallel with program development and standardizing the program name across all channels to avoid confusion and ensure consistent evaluation and tracking.

Efficiency Nova Scotia Corporation 2011 Evaluation Report > Consider conducting exit surveys: The challenge of the Evaluator for such a program lies in the fact that participants are unknown and it is necessary to survey a large number of...

AI summary The report suggests conducting exit surveys to better monitor program influence and upgrading eligible discounted appliances to reduce free-ridership. It also discusses outreach and marketing efforts, including the ENSC website and on-site visits.

8% Nothing 2 16% 15% Don't know 5% 4% Ref.: 5725 32 Efficient Products – Retail Markdown Program Efficiency Nova Scotia Corporation 2011 Evaluation Report

AI summary The text provides a brief statistical summary and references an evaluation report on the Retail Markdown Program by Efficiency Nova Scotia Corporation in 2011, highlighting participation and response rates.

11 3 6 5 Not at all 2 2 2 1 Satisfied Ref.: 5725 35 Efficient Products – Retail Markdown Program Efficiency Nova Scotia Corporation 2011 Evaluation Report 4 IMPACT EVALUATION 4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact e...

AI summary This section outlines the impact evaluation of the Retail Markdown Program (RMP) in 2011, focusing on determining energy and demand savings. The evaluation considers unitary savings per product, replacement ratios, and market effects. New products added in 2011 include LED lamps and motion sensors.

nducted a literature review to find studies that had analyzed the savings resulting from their installation. For CFLs, the participant survey was used to establish the replacement ratio of CFL to CFL. The participant survey as well as reta...

AI summary The document discusses the methodology used to estimate energy savings from the RMP, including the use of a participant survey and retailer interviews to determine free ridership and market spillover effects. Unitary savings values for products like CFLs are based on the OPA's 2010 Prescriptive Measures and Assumptions report.

vity. This section presents the methodology used to transform information obtained through survey and interview questions into a NTGR. For the RMP, the NTGR includes the assessment of two distortion Ref.: 5725 53 Efficient Products – Retai...

AI summary This section outlines the methodology for calculating the Net Total Gross Reduction (NTGR) for the Retail Markdown Program (RMP) by assessing free-ridership and spillover effects. It includes survey-based questions to evaluate participant behavior related to purchasing Compact Fluorescent Lamps (CFLs) under discounts.

d into a level of program attribution which is used to calculate the global free-ridership level for each participant and retailer. The algorithm behind this calculation is presented in Appendix VIII. Econoler’s approach is consistent with...

AI summary The evaluation of the Retail Markdown Program (RMP) by Econoler uses a 0 to 10 scoring system to assess free-ridership levels, revealing that 78% of participants did not benefit from the program's discount due to poor visibility of the offer. This highlights challenges in program awareness and effectiveness.

Efficiency Nova Scotia Corporation 2011 Evaluation Report finding out about the discount or only once they were at the cash register for payment, making it difficult to associate the program influence with their decision to purchase CFLs....

AI summary The evaluation report discusses the free-ridership level for CFLs, finding that only about 10% of sales during markdown periods were due to the program. It also notes a change in methodology this year, separating free-ridership from spillover effects. For refrigerators and clothes washers, the approach involved in-depth interviews with retailers due to the small buyer population.

t difficult to reach them using a general population telephone survey, the free-ridership level was measured through in-depth interviews with retailers. To do so, the retailers were asked to estimate: > the program influence on their custo...

AI summary The free-ridership level for ENERGY STAR appliances was measured through retailer interviews, showing a significant decrease from 2010 levels. This reduction is attributed to the program's shift to higher efficiency standards (CEE Tier 3) and changes in evaluation methodology.

r the same period of the year. This type of comparison was not possible in 2011 since more than a year was separating the introduction of the appliance component in the RMP and the evaluation period. Ref.: 5725 55 Efficient Products – Reta...

AI summary The evaluation report discusses free-ridership and spillover effects in the Retail Markdown Program (RMP) in 2011. It notes higher free-ridership for clothes washers than refrigerators and explains that spillover effects occur due to increased awareness and changes in retailer offers, even when customers are unaware of the discount.

Program 5. Complete the program manual to keep track of changes and standardize Manual the content: The program manual is well written but important information is Content missing to serve as “program memory” in case of modifications or st...

AI summary The text outlines recommendations for improving the program manual and tracking sheet used by ENSC. It suggests standardizing the manual, adding unitary savings values to the tracking sheet, tracking package-to-unit conversions, and including technical product information for better evaluation.

Program 11. Standardize the program name across all channels: To avoid confusion, Tracking Sheet and to ensure adequate evaluation and tracking, the program name should always be the same whether it is for administrative reasons for ENSC (...

AI summary The document discusses the need to standardize the program name for ENSC's energy efficiency initiative, analyze market offers to adjust product discounts, and consider exit surveys to evaluate program effectiveness. It highlights the importance of consistency in branding and the need for data-driven adjustments to ensure program success.

onsumers to find an adequate sample of participants. Even then, a portion of these participants may be unaware or have forgotten that there was a discount in their purchase, making the mass survey an imprecise tool for monitoring the marke...

AI summary The text discusses the use of exit surveys to improve the accuracy of monitoring program participation and reduce free-ridership by interviewing buyers immediately after purchase. It also suggests upgrading eligible discounted appliances to lower free-ridership, though this may result in lower gross savings due to a dynamic baseline.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Relationship 21. Offer more training and support to retailers: One retailer wishes to see more with Partners training offered to the salespeople. According to them, ENSC’s sales rep...

AI summary The 2011 Evaluation Report for Efficiency Nova Scotia Corporation highlights the need for more training and support for retailers, as well as increasing the number of retailer interviews to better assess the program's indirect market influence and quantify market effects.

rogram. What is the status of these recommendations? Q: On page V, We would like to know the status of the following recommendation: R1 R3 Page VI – Status on recommandations R6 Page VII R2 Ref.: 5725 73 Efficient Products – Retail Markdow...

AI summary The text discusses the status of recommendations (R1, R2, R3, R6) and questions about the Retail Markdown Program managed by Efficiency Nova Scotia Corporation. It includes queries regarding the logic model, training for retailers, program name changes, and the rationale behind the program's short duration.

he rationale behind the two short periods? Page 10 Q: Who provide the associate training? Q: The delivery agent? Is the same as the implementation contractor? If yes why do we use different names? C: The socket study is a very good initiat...

AI summary The text contains a series of questions and comments from a regulatory proceeding related to the Retail Markdown Program (RMP) and Efficiency Nova Scotia Corporation's 2011 evaluation report. Topics include program activities, customer service, data tracking, evaluation methods, and potential program distortions.

for such a score? Reason(s): Q3 – Did you receive any complaints from participants in the program? Yes What was the complaint about? No Don’t Know Refused Not applicable Ref.: 5725 77 Efficient Products – Retail Markdown Program Efficiency...

AI summary The document presents a series of questions from an evaluation report on the Retail Markdown Program by Efficiency Nova Scotia Corporation in 2011. It asks participants about their experience with the program, including complaints, satisfaction levels, and suggestions for improvement.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Q8 – Last year, have you been interviewed by another evaluator about the same program? Yes No Not applicable Q8a – If you answered Yes to Q8, we would like your opinion on the frequ...

AI summary The document is part of an evaluation report for the Retail Markdown Program by Efficiency Nova Scotia Corporation in 2011. It includes survey questions about program evaluations, retailer involvement, relationships with retailers, and the program's name changes over time.

pant retailers? Q13- What is your opinion in regard to the program name that has changed many times since its first implementation (Power Down, Plug into Savings and now Retail Markdown Program)? Q14- What is your opinion in regard to prog...

AI summary The text contains a series of survey questions related to the Retail Markdown Program, including opinions on program name changes, modifications, data collection, and barriers to implementation. The questions are part of an evaluation report conducted by Efficiency Nova Scotia Corporation in 2011.

ion report) and we hope that they will contribute to improving program performance. If we need to clarify some of your answers, we might call you back. Your name Date Phone number E-mail Ref.: 5725 81 Efficient Products – Retail Markdown P...

AI summary This document is an interview guide used by Efficiency Nova Scotia Corporation for the Retail Markdown Program, formerly known as the Power Down program. It outlines the process for contacting and interviewing corporate retailers as part of the 2011 evaluation report.

eason(s): S10. On a scale from 1 to 10 (where 1 is very bad and 10 is excellent), what is your satisfaction level in regard to the tracking and reporting of discounts? Scale: S10a If your answer to S10 was equal to or less than 8, would yo...

AI summary The text contains survey questions and responses related to the Efficient Products – Retail Markdown Program by Efficiency Nova Scotia Corporation. It asks about participant satisfaction, barriers to program implementation, program duration, promotion timing, complaints, and suggestions for improvement.

AR logo mean? (Ask only if the ENERGY STAR logo is displayed.) 6. Could you tell me how these products (products eligible for the instant discount) differ from other products sold in your store? Ref.: 5725 128 Efficient Products – Retail M...

AI summary The text discusses a free-ridership calculation algorithm for the Retail Markdown Program (RMP), which evaluates participant responses to determine the extent to which they would have purchased energy-efficient products (CFLs) without the program's discount.

swer) x 10% to purchase the CFLs you purchased this year? (Scale 0 to 10) PA4 Score: FR7 MEAN VALUE OF : Final Free-Ridership (PA1 ; PA2 ; PA3 ; PA4) Ref.: 5725 129 Efficient Products – Retail Markdown Program Efficiency Nova Scotia Corpor...

AI summary The document discusses the calculation of free-ridership levels in the Efficient Products – Retail Markdown Program, including an inconsistency test applied to participant responses and the use of weighted averages to determine the program's average free-ridership level.

GS The 2007-2011 evaluation of the program demonstrated good results. Since 2007, the program has handed out a total of 46,399 LED holiday light sets and has generated net energy savings of 1.447 GWh. To calculate the net savings of the pr...

AI summary The LHLE program, which distributed 46,399 LED holiday light sets from 2007 to 2011, achieved net energy savings of 1.447 GWh and demand savings of 3.618 MW. The evaluation assumed a net-to-gross ratio of 1, as free-ridership and spillover effects were not measured.

Tracked savings from ENSC 9.136 MW 9.136 MW 1.00 9.136 MW Evaluation results 4.512 MW 3.618 MW 1.00 3.618 MW Ref.: 5725 iv LED Holiday Lighting Exchange Program Efficiency Nova Scotia Corporation 2007 to 2011 Impact Evaluation Report These...

AI summary The LED Holiday Lighting Exchange (LHLE) program, run by Efficiency Nova Scotia Corporation (ENSC), aimed to promote energy-efficient LED lights for holiday use. An evaluation found that net energy savings were 20.8% lower than tracked savings, and demand savings were 60.4% lower, partly due to adjustments in diversity and line loss factors.

Efficiency Nova Scotia Corporation 2007 to 2011 Impact Evaluation Report As shown below, the gross and net savings resulting from this evaluation were compared to the gross and net savings estimates from the 2011 tracking sheet. Table 7: C...

AI summary This report compares tracked and evaluated energy and demand savings from 2007 to 2011. Evaluated savings are lower than tracked savings due to the inclusion of interactive effects, particularly from the LED Holiday Lighting Exchange (LHLE) program, which reduced savings by 19.8%.

ults –Net Energy and Demand Savings by Product ...................................... 38 Table 30: Comparison of Tracked and Evaluated Savings at the Generator ........................................ 39 LIST OF FIGURES Figure 1: Efficient...

AI summary This 2011 evaluation report assesses the Efficient Products – Low Income Renter (LIR) program, which installs energy-efficient products in subsidized housing for low-income renters in Nova Scotia. The evaluation involved interviews, site visits, and a survey of participants.

inted by stakeholders of the low-income rental market. Such needs include, among others, achieving energy efficiency upgrades in homes and providing further information on energy-efficient behaviours. In order to be eligible, participants...

AI summary The LIR program aimed to achieve energy efficiency upgrades in low-income rental homes and promote energy-efficient behaviors. It installed various energy-efficient products and achieved significant electricity and demand savings in 2011. The program was evaluated as having good potential for success as a pilot targeting an unexplored market.

allation rates and the interactive effects factors, the evaluation revealed that the LIR program had generated net energy savings of 4.809 GWh and demand savings of 1.078 MW at the generator in 2011. Table 1: Comparison of Tracked and Eval...

AI summary The evaluation of the LIR program in 2011 showed net energy savings of 4.809 GWh and demand savings of 1.078 MW, which were 7% lower than the tracked savings by ENSC. The difference was attributed to the installation rate for power bars with integrated timers and interactive effects, as well as adjustments made to unitary savings estimates.

of on-site visits in order to have a reasonable precision level that would allow for the establishment of installation rates for CFLs, LED nightlights and faucet aerators. Ref.: 5725 viii Efficient Products – Low Income Renter Program Effi...

AI summary The document discusses the need for more precise evaluation of savings in the Efficient Products – Low Income Renter Program. It highlights the need to collect additional data, such as heating types and air conditioning use, to improve the accuracy of impact evaluations and ensure that new lighting products effectively replace less efficient ones.

pies of the interview guides and the survey questionnaire are included in Appendices IV, V and VI. Figure 2: Methodological Model 2.2 METHODOLOGY DESCRIPTION 2.2.1 Analyzing Existing Program Information The first task in the process evalua...

AI summary The evaluation of the Low Income Renter (LIR) program involved analyzing program documentation, conducting interviews with the Program Manager, and planning interviews with program partners. The evaluation focused on program justification, savings calculations, barriers, marketing strategies, and the roles of partners.

list of questions and topics to include in the program partner interviews for the process evaluation was finalized. 2.2.3 In-Depth Interviews with Program Partners Interview with Delivery Agent In September, one in-depth interview was cond...

AI summary The document outlines the methodology used in evaluating the Efficient Products – Low Income Renter Program, including in-depth interviews with the program delivery agent and its subcontractor, as well as on-site visits to validate product installations and savings assumptions.

Efficiency Nova Scotia Corporation 2011 Evaluation Report The methodology used for the on-site visits under the LIR program is further explained in the program impact evaluation section of this report. A copy of the site visit protocol is...

AI summary This section of the 2011 Evaluation Report discusses the methodology used for on-site visits and telephone surveys conducted under the Low Income Renter (LIR) program. A survey of 70 participants was conducted to assess program impact, satisfaction, and recommendations for improvement.

or the 2011 survey included 1,887 participants (1,689 participants with no missing names, phone numbers, or both), which was the number of program participants at the time of conducting the survey. Ref.: 5725 5 Efficient Products – Low Inc...

AI summary The 2011 evaluation report for the Low Income Renter Program discusses the process evaluation conducted by Efficiency Nova Scotia Corporation. The evaluation aimed to assess the program's design and delivery effectiveness through interviews and participant surveys. The program manual is still in development as the program is a pilot.

ually included in program manuals intended for internal use. The table below lists the information found in the LIR program manual. Table 4: Program Manual Content LIR Program Program Manual Content Manual Document revisions N/A Program de...

AI summary This document outlines the content of the LIR Program manual, including program description, objectives, eligibility criteria, program partners, savings calculations, budget, cost-effectiveness tests, market studies, marketing plans, and evaluation plans. It is part of an evaluation report from 2011 by Efficiency Nova Scotia Corporation.

Cost-effectiveness test results Market study or technical study that supports program elements or assumptions Marketing plan Evaluation plan Program theory Logic model Program process flow chart Partner or participant process flow chart Pr...

AI summary Econoler evaluated the Low Income Renter (LIR) program manual and found it contains useful information but recommends improvements, such as documenting the disposal of old products and providing guidelines for energy source usage and lighting product installation.

Efficiency Nova Scotia Corporation 2011 Evaluation Report > Provide a “base case”: The program manual does not provide a “base case” that provides information on how the assumed gross savings have been established. Usually, these savings a...

AI summary The 2011 Evaluation Report highlights the need for a 'base case' in the program manual to document assumptions used for calculating gross savings. It also emphasizes the importance of documenting parameters used to estimate program objectives and standardizing the program manual to ensure consistency and ease of use.

more, the content of all program manuals should be standardized based on the same template so that it is easier to locate specific sections or subjects. 3.3 PROGRAM TRACKING SHEET Econoler reviewed the content of the tracking sheet for the...

AI summary The report discusses the need for standardizing program manuals and reviews the tracking sheet for the Low Income Renter (LIR) program. It highlights the tracking sheet's functionality, including unique project identification numbers and energy savings calculations, but notes missing customer information and inconsistencies in product categorization.

type, power and number of old lamps. This information could be used for validating the baseline case and for ensuring that the new lamps installed actually replaced less efficient lamps. > Ensure that all customer information is filled in...

AI summary The text discusses the importance of systematically collecting customer information for program evaluation, such as names, postal codes, and phone numbers, to support activities like customer surveys and on-site visits. It also highlights the success of the Efficient Products – Low Income Renter Program, which had 4,920 participants and benefited from collaboration between ENSC and housing authorities.

Efficiency Nova Scotia Corporation 2011 Evaluation Report > Develop an evaluation plan in parallel with program design and development: This program has no evaluation plan. Econoler strongly recommends that for each new program, an evaluat...

AI summary The evaluation report highlights the need for an evaluation plan to be developed in parallel with program design and development, and recommends consistency in program naming to avoid confusion. The report also notes that program partners are satisfied with their relationship with ENSC’s team.

concerns are related to CFLs (too dim, presence of mercury, etc.). Questions to investigate these barriers were included in the participant survey. It appears that only one respondent out of 70 has Ref.: 5725 10 Efficient Products – Low In...

AI summary The document discusses concerns about CFLs, including their dimness and mercury content, and mentions that only one out of 70 survey respondents expressed concerns about mercury. It highlights the need to monitor program barriers and adjust marketing strategies. The DA suggests using NSPI's customer database to target eligible participants, while ENSC must determine if this data is accessible.

15 Refused 5 Don’t know 7 65 Ref.: 5725 11 Efficient Products – Low Income Renter Program Efficiency Nova Scotia Corporation 2011 Evaluation Report The vast majority of participants did not have any concerns about taking part in the progra...

AI summary The 2011 evaluation report on the Efficient Products – Low Income Renter Program found that 93% of participants had no concerns about joining the program, while only 3% had concerns, primarily related to health risks. Most participants retained all installed energy efficiency products, with 89% keeping them and 7% removing at least one.

ough the program. Since the installation, most surveyed participants stated that they had kept all installed products (89%), as just under one in 10 indicated having removed at least one product (7%). When it comes to product removal, ther...

AI summary The program's evaluation found that most participants retained installed energy efficiency products, but some removed them. On-site visits revealed discrepancies between self-reported removal and actual findings, with only a few instances of product removal. The Evaluator recommends improving participant education on product benefits to enhance program sustainability.

2 Other 17 Don’t know 14 Ref.: 5725 13 Efficient Products – Low Income Renter Program Efficiency Nova Scotia Corporation 2011 Evaluation Report Just under four in 10 participants indicated that the products installed were successful in low...

AI summary The 2011 evaluation report on the Efficient Products – Low Income Renter Program found that 37% of participants noticed a decrease in energy bills after installation, while 30% saw no change and 11% saw an increase. A significant portion (21%) were uncertain about the impact due to recent installation or lack of information.

11 Too soon to tell 7 Don’t know 14 Participants were asked a series of questions to assess improvements that had occurred since participating in the program. Using a 5-point scale, where 1 meant no improvement experienced and 5 meant cons...

AI summary A survey of participants in the LIR program found that a small majority reported improvements in energy efficiency interest, knowledge, and home comfort since joining the program. Specific impacts included improved indoor lighting, longer-lasting hot water, and fewer drafts, with most participants reporting noticeable benefits.

ed improved indoor lighting (81%), while one- half indicate that the products have provided longer lasting hot water (53%). Another three in 10 have noticed fewer drafts throughout their home (29%). Ref.: 5725 14 Efficient Products – Low I...

AI summary The evaluation report discusses the impact of products installed through the Low Income Renter (LIR) program, noting that 81% of participants reported improved indoor lighting, 53% longer lasting hot water, and 29% fewer drafts. However, the report cautions that the latter finding may be inconsistent due to the absence of air sealing measures in the program. Most participants expressed satisfaction with the program, with 78% rating it 4 or 5 out of 5.

69% 27 5 Overall communication 62 66% 18 10 2 4 Don’t know/no answer removed from calculations Ref.: 5725 17 Efficient Products – Low Income Renter Program Efficiency Nova Scotia Corporation 2011 Evaluation Report 3.6.5 Recommendations for...

AI summary The 2011 evaluation report for the Low Income Renter Program found that 81% of respondents had no recommendations for improvement, while the remaining 19% suggested improvements such as better lighting products, more product options, and increased information on installed products.

1 Other 6 No recommendations 81 Ref.: 5725 18 Efficient Products – Low Income Renter Program Efficiency Nova Scotia Corporation 2011 Evaluation Report 4 IMPACT EVALUATION 4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evalu...

AI summary This section outlines the impact evaluation of the Efficient Products – Low Income Renter Program in 2011, focusing on determining gross and net savings through unitary savings analysis and on-site visits to validate installations and data accuracy.

ation, such as the power of lamps replaced, was also collected to validate the parameters used in the unitary savings calculations. 4.1.1 On-Site Visit Sampling and Protocol Sampling Methodology A total of 15 on-site visits were conducted...

AI summary The 2011 evaluation of ENSC’s Low Income Renter (LIR) program involved 15 on-site visits to validate product installations and unitary savings calculations. Sampling focused on Halifax and Dartmouth due to high installation rates, and product removal rates and reasons were documented.

Efficiency Nova Scotia Corporation 2011 Evaluation Report The annual unitary savings for both single- and multi-family households were estimated at 270 kWh. Since the assumptions used by the OPA to estimate this unitary savings value are c...

AI summary The 2011 Evaluation Report by Efficiency Nova Scotia Corporation estimates annual unitary savings at 270 kWh for single- and multi-family households. The report discusses the LIR program's direct installation approach, product removal verification, and methods for measuring installation rates, including the use of timers on energy-efficient power bars.

2011 Evaluation Report Table 29: Evaluation Results –Net Energy and Demand Savings by Product

AI summary The 2011 Evaluation Report includes Table 29, which presents evaluation results focusing on net energy and demand savings by product. This table likely provides data on the effectiveness of various energy efficiency programs or initiatives in reducing energy consumption and demand.

es and phone numbers. This information is essential for conducting evaluation activities such as customer surveys and on-site visits. In the future, ENSC should ensure that these fields are filled in for all customers. 7. Develop an evalua...

AI summary The document highlights the need for ENSC to ensure complete customer information for evaluation activities and recommends developing an evaluation plan in parallel with program design. It also emphasizes the importance of using a consistent program name to avoid confusion.

cent of the CFLs installed through the program. Nevertheless, the on-site visits did not allow Econoler to confirm that 23 watt CFLs had been used to replace old incandescent lamps with an equivalent light output. Since participants could...

AI summary The evaluation report for the Efficient Products – Low Income Renter Program highlights issues with data collection during on-site visits, including the inability to confirm wattage replacements and the need for more visits to accurately assess installation rates. It also recommends collecting information on air conditioning use for future evaluations.

2011 Evaluation Report APPENDIX IV - INTERVIEW GUIDE WITH PROGRAM MANAGER Process Evaluation Program Name: Low Income Renter Telephone Interview with the Program Manager Date: List of questions (Q) and comments (C) discussed Source: Progra...

AI summary The 2011 Evaluation Report discusses the Low Income Renter Program, including its name change from Low Income Direct Install, challenges in evaluating intangible benefits, and questions about data tracking and gross savings calculations. The report also highlights the program's outreach strategies and participation processes.

Efficiency Nova Scotia Corporation 2011 Evaluation Report C: It would be useful to know what kind of arrangement there is between the building administration and the low-income renter (for each building) in regards to the method of sharing...

AI summary The text discusses questions and comments related to the evaluation of a program by Efficiency Nova Scotia Corporation, focusing on cost-sharing arrangements between building administrations and low-income renters, process evaluation, program theory, and barriers addressed by the program. It also asks about evaluation plans, marketing strategies, and data management challenges.

ifficult 10 is very easy) Q: Any other subject the PM wishes to include in the process examination of the program partners and or participants. Thank you very much for your time and cooperation. Ref.: 5725 50 Efficient Products – Low Incom...

AI summary This document is an evaluation report and questionnaire for Efficiency Nova Scotia Corporation's Low-Income Renter Program, focusing on gathering feedback from program partners and participants. It includes instructions for completing the form and questions about the partner's role and experience with the program.

On a scale from 1 to 10 (where 1 is very bad and 10 is excellent), how would you rate your relationship with the other program partners or subcontractors (Clean Nova Scotia) in this program? Score: Q9a - If your answer to Q9 was equal to o...

AI summary The document contains survey questions related to the Efficient Products – Low Income Renter Program delivered by Efficiency Nova Scotia Corporation. It asks about program partner relationships, lead sources, market confusion, barriers to implementation, program name changes, and complaints received.

y of that program? Yes: If yes, from which party? (Please do not mention names, just the position of the party.) No Don’t know Not applicable Q15a- What was the complaint about? Ref.: 5725 55 Efficient Products – Low Income Renter Program...

AI summary This text is part of a survey questionnaire from the 2011 Evaluation Report of the Efficient Products – Low Income Renter Program by Efficiency Nova Scotia Corporation. It includes instructions for participants and a list of questions to be answered confidentially.

lledDateJob.ProcessingDate]. Since these measures were installed, what changes, if any, have you noticed in your energy bills? Have ... READ STATEMENTS IN ORDER - RECORD ONE RESPONSE 1. Your bills gone down 2. Your bills gone up, or 3. Has...

AI summary This section of the document asks participants in the Low Income Renter Program about changes in their energy bills and comfort levels after energy efficiency measures were installed. It includes questions on perceived improvements in comfort, energy bill changes, and knowledge of energy efficiency.

Validation Date of installation: Number of units installed: Number of units removed after installation: Explanation (contact declaration): Source of energy for water heating: Ref.: 5725 69 Efficient Products – Low Income Renter Program Eff...

AI summary The document outlines validation forms and evaluation reports related to energy efficiency programs in Nova Scotia, including the Efficient Products – Low Income Renter Program and the Efficient Products – Multi-Unit Residential Renter Program, with data collection details and a 2011 evaluation report.

r is the component of the power bar responsible for the energy savings generated. This observation has resulted in a low installation rate for power bars with integrated timer. Program Energy Savings To calculate the net savings of the MUR...

AI summary The MURR program's energy savings were evaluated, revealing a 17% free-ridership level and a net-to-gross ratio of 0.83 in 2011. The evaluation considered installation rates, interactive effects, and participant intentions, showing that most participants would not have installed energy-efficient products without the program.

this evaluation. However, no specific process evaluation or telephone survey was conducted for these pilot projects since they were implemented after the beginning of the evaluation field activities. Ref.: 5725 1 Efficient Products – Multi...

AI summary This section of the 2011 evaluation report discusses the methodology used for evaluating the Efficient Products – Multi-Unit Residential Renter Program. It notes that no specific process evaluation or telephone survey was conducted for the pilot projects implemented after the evaluation field activities began.

onnaire are included in Appendices IV, V and VI. Figure 2: Methodological Model 2.2 METHODOLOGY DESCRIPTION 2.2.1 Analyzing Existing Program Information The first task in the process evaluation of the MURR program was the analysis of the p...

AI summary The evaluation of the MURR program involved analyzing program documentation, conducting interviews with the Program Manager and Delivery Agent, and examining topics such as program justification, savings calculations, barriers, marketing strategies, and partner roles.

gram DA. This interview was intended, among other things, to understand the DA’s involvement in the program, their participation process as well as their perception and satisfaction with the program. 2.2.4 On-Site Visits In November, five...

AI summary The document describes the evaluation of the Multi-Unit Residential Renter Program, including on-site visits to validate product installations and a telephone survey of participants to assess their experiences and perceptions of the program.

zed computer-assisted telephone interviewing (CATI). The average length of the survey was 12 minutes. The participant survey was used to gain a better understanding of the following program features: > spillover and free-ridership; > parti...

AI summary The survey aimed to understand program features such as spillover, free-ridership, participant motivations, and satisfaction with the Efficient Products – Multi-Unit Residential Renter Program. The 2011 survey had a population of 92 participants and a sample size of 30, with a sampling error of ±14.2% at the 90% confidence level.

on 2011 Evaluation Report 3 PROCESS EVALUATION 3.1 OBJECTIVE AND APPROACH OF THE PROCESS EVALUATION The process evaluation conducted under the MURR program focuses on one of ENSC’s evaluation objectives, which is “assessing the effectivene...

AI summary The process evaluation of the MURR program under ENSC assesses the effectiveness of program design and delivery. The evaluation relied on interviews with the PM and program partners, and a telephone survey of participants. The current program manual is limited due to the program being a pilot, with more detailed content planned for an official launch.

details of gross savings and hypothesis for free- ridership and other effects) Details about the savings calculations and type of products Budget per year Ref.: 5725 6 Efficient Products – Multi-Unit Residential Renter Program Efficiency N...

AI summary The document discusses the need for an in-depth program manual for the Multi-Unit Residential Renter Program, highlighting the current lack of detailed content such as cost-effectiveness test results, marketing plans, and evaluation plans. Econoler has proposed recommendations for improving the manual if the program is officially launched.

bles such as operating time, wattage or base consumption. The identification and value of each of these variables should be available and documented for validation and updating purposes. > Provide the parameters used to estimate program ob...

AI summary The text discusses the importance of documenting program variables and parameters for validation and updating, as well as the need to refine and disseminate marketing plans for program tracking. It references the Efficient Products – Multi-Unit Residential Renter Program and its 2011 Evaluation Report.

nitoring and evaluation purposes. 3.3 PROGRAM TRACKING SHEET Econoler has reviewed the content of the tracking sheet for the MURR program. The tracking sheet presents information in one sheet. In general, the tracking sheet is easy to use...

AI summary The tracking sheet for the MURR program is functional for program administration but lacks direct monitoring of savings. Econoler recommends adding unitary savings values and establishing a validation protocol to improve data accuracy and program evaluation.

port source used for domestic hot water heating. This way, it will be possible to confirm that product replacements have only been made where domestic hot water is electrically heated. > Collect information for establishing base cases: The...

AI summary The text outlines steps for collecting information to establish base cases and line loss factors for program evaluation. It emphasizes the importance of tracking product replacements, particularly for electrically heated domestic hot water systems, and suggests collecting specific data such as old lamp wattage and thermostat types for accurate savings estimation.

d again in the future, Econoler recommends collecting the participants' rate codes in order to establish the line loss factor in a more precise way. 3.4 PROGRAM DESIGN AND IMPLEMENTATION The MURR program was launched in 2011 as a pilot pro...

AI summary The document discusses the MURR program, launched in 2011 as a pilot, and highlights the lack of an evaluation plan. Econoler recommends creating an evaluation plan during program design to ensure data collection and rigorous evaluation. The delivery agent reports satisfaction with the program and no major barriers, though challenges arose from the program's short duration and timing.

24 7 3 The energy evaluation of your apartment 25 48% 44 8 Don’t know/don’t recall removed from calculations Ref.: 5725 16 Efficient Products – Multi-Unit Residential Renter Program Efficiency Nova Scotia Corporation 2011 Evaluation Report...

AI summary The 2011 impact evaluation of the Efficient Products – Multi-Unit Residential Renter Program assessed energy and demand savings, analyzing unitary savings, installation rates, energy-to-demand ratios, and interactive effects. On-site visits and participant surveys were used to validate data and estimate free ridership and spillover effects.

to estimate the installation rate for each category of products. Finally, the participant survey was used to estimate the free ridership ratio and evaluate if the program had generated spillover. Ref.: 5725 17 Efficient Products – Multi-Un...

AI summary The evaluation report discusses the Efficient Products – Multi-Unit Residential Renter Program, including the installation of energy-efficient products and the use of participant surveys to estimate free ridership and spillover effects. Five on-site visits were conducted in 2011 to assess program implementation.

ation to participants on how to use the timer on the power bar. To maintain measure sustainability, participants need to understand the necessity of using the timer to benefit from the energy savings. The on-site visits were scheduled main...

AI summary The evaluation report discusses the need for more on-site visits to accurately determine the installation rate of power bars with timers in the MURR program. It also outlines the energy-to-demand ratio used to calculate demand savings for the program.

2011 Evaluation Report Table 25: Evaluation Results – Gross Energy and Demand Savings

AI summary The 2011 Evaluation Report presents the results of an assessment of energy and demand savings, specifically highlighting gross energy and demand savings as outlined in Table 25. The table likely contains key data on the effectiveness of energy efficiency initiatives or programs.

cur when participants purchase eligible energy-efficient products following their previous participation in the program because of its influence, thereby demonstrating the advantages of such products. During the telephone survey, participa...

AI summary The evaluation report assesses the impact of the Efficient Products – Multi-Unit Residential Renter Program by analyzing participant behavior, including whether they purchased additional energy-efficient products after initial participation and how much of the energy savings from these purchases can be attributed to the program.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Only one participant declared having purchased additional energy-efficient products following his previous participation in the program. More precisely, the participant declared hav...

AI summary The 2011 Evaluation Report for Efficiency Nova Scotia Corporation indicates that the MURR program had minimal internal spillover, with only one participant reporting additional energy-efficient product purchases influenced by the program. The NTGR value of 0.83 is applied to the program and two additional pilot projects due to their similarities.

2011 Evaluation Report Table 28: Evaluation Results –Net Energy and Demand Savings

AI summary The 2011 Evaluation Report includes Table 28, which presents evaluation results related to net energy and demand savings. The table likely contains data on energy efficiency programs and their impact on energy consumption and demand reduction.

heet presented in the table below include the savings from the MURR program and the two additional pilot projects. Table 29: Comparison of Tracked and Evaluated Savings at the Generator Installed Gross Savings Initial Gross Installed with...

AI summary The evaluation results for energy and demand savings from the ENSC program show 6% higher savings than initially tracked. The difference is attributed to the revision or addition of parameters in the evaluation process.

lculations. > NTGR: There was a small difference between the evaluated NTGR of 0.83, which was estimated through the participant survey, and the NTGR of 0.85 used in the tracking sheet. Ref.: 5725 38 Efficient Products – Multi-Unit Residen...

AI summary The document discusses the evaluation of the Efficient Products – Multi-Unit Residential Renter Program by Efficiency Nova Scotia Corporation in 2011. It highlights adjustments to unitary savings values and the inclusion of interactive effects factors, which led to higher-than-expected energy and demand savings. The line loss factor used in the tracking sheet was also noted.

Program 10. Develop an evaluation plan in parallel with program design and Design and development: When a program is launched, Econoler strongly recommends Implementation preparing an evaluation plan in parallel with program design and dev...

AI summary The document outlines recommendations for improving program design and implementation, including developing an evaluation plan in parallel with program development and modifying marketing materials to accurately reflect time commitments. It also highlights the need to increase on-site visits to better evaluate the installation rates of power bars with integrated timers.

imer installed through the program. Therefore, an installation rate of 100 percent was used. However, since a significant number of sites visited did not use the timer with their power bar, Econoler recommends increasing the number of on-s...

AI summary The document discusses the Efficient Products – Multi-Unit Residential Renter Program, focusing on the evaluation of educational materials for energy efficiency. It highlights the need for increased on-site visits due to low timer usage with power bars and outlines program theory and performance indicators.

3 Three in 10 respondents are aged 18 to 24 (30%), while just over two in 10 are 25 to 34 (23%). Table 35: Age Age 2011 Sample Size 30 18 to 24 30% 25 to 34 23 35 to 44 13 45 to 54 17 55 to 64 13 65 or over 3 Ref.: 5725 46 Efficient Produc...

AI summary The text provides demographic data on respondents, highlighting that 30% are aged 18 to 24 and 53% have a college or university degree. This data is presented in tables and relates to an evaluation report on an energy efficiency program.

you provide information on what is their role in this program? This will help us to ask the appropriate question in the process evaluation survey. Q: Is there a reason why you selected 26 buildings? C: I understand that the energy audits w...

AI summary The text includes a series of questions and responses from an evaluation of the Efficient Products – Multi-Unit Residential Renter Program by Efficiency Nova Scotia Corporation. Topics include program design, market transformation, energy savings calculations, and evaluation processes.

at keeps the records? Q: Do you plan to do a post evaluation cost effectiveness test? Q: since this a new program, did you have an evaluation plan designed at the same time the program was designed? Q: Will there be a detailed program mark...

AI summary The text includes a series of questions from an evaluation process for an energy efficiency program, focusing on program design, evaluation plans, marketing strategies, and database usability. It also provides instructions for completing a questionnaire for program partners.

ons Please indicate your company name: Q1 - How would you define your role(s) as an ENSC energy efficiency program partner? Q1a – How long have you had that role (specify months or years)? Q1b - If you were a program partner before it chan...

AI summary The text contains a series of questions directed at ENSC energy efficiency program partners regarding their roles, the transition from Conserve Nova Scotia to ENSC, their relationship with the Program Administrator, and any complaints received from program participants.

s for such a score? Reason(s): Q3 – Did you receive any complaint from participants in the program? Yes What was the complaint about? No Don’t Know Refused Not applicable Ref.: 5725 51 Efficient Products – Multi-Unit Residential Renter Pro...

AI summary This text is part of an evaluation report for the Efficient Products – Multi-Unit Residential Renter Program by Efficiency Nova Scotia Corporation from 2011. It includes survey questions about participant satisfaction, complaints, and suggestions for improvement.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Q8 – Last year, have you been interviewed by another evaluator about the same program? Yes No Not applicable Q8a – If you answered Yes to Q8, we would like your opinion on the frequ...

AI summary This document is part of a 2011 evaluation report on the Multi-Unit Residential Renter Program by Efficiency Nova Scotia Corporation. It includes survey questions about program evaluation, market confusion, complaints, and barriers to implementation.

ion report) and we hope that they will contribute to improving program performance. If we need to clarify some of your answers, we might call you back. Your name Date Phone number E-mail Ref.: 5725 54 Efficient Products – Multi-Unit Reside...

AI summary This document is a participant survey questionnaire from Efficiency Nova Scotia Corporation's 2011 evaluation report for the Multi-Unit Residential Renter Program. It aims to gather feedback from participants to improve program performance.

2011 Evaluation Report IF RESPONDENT HAS DIFFICULTY SPECIFYING AN FR2ccM1 ANSWER IN MONTHS, READ: Would it have been within . . . 1. Less than 6 months? 2. 6 months to less than 1 year later? 3. 1 to less than 2 years later? 4. 2 to less t...

AI summary This text is from a 2011 evaluation report related to the Efficient Products – Multi-Unit Residential Renter Program by Efficiency Nova Scotia Corporation. It contains survey questions about customer behavior, including whether respondents would have installed energy efficiency measures without the program and if they had prior plans to install them.

ipate in the Multi-Unit Residential Program, you had already made the decision to install [MEASURE 2]? 1. Yes 2. No 98. (Don’t know) 99. (Refused) [READ FIRST TIME THROUGH ONLY] Now I would like to ask you to consider what actions you woul...

AI summary The text contains survey questions related to customer participation in the Multi-Unit Residential Program and their likelihood of taking energy efficiency actions without the program. It also references an evaluation report on the Efficient Products – Multi-Unit Residential Renter Program by Efficiency Nova Scotia Corporation from 2011.

ship level for the program corresponded to the weighted average of the final adjusted free-ridership levels calculated for each participant with the energy savings associated with each participant. Ref.: 5725 75 160, rue Saint-Paul, bureau...

AI summary The document discusses the Efficient Products – Direct Install Program by Efficiency Nova Scotia Corporation, focusing on its impact and process evaluation from 2011. The program's ship level is tied to the weighted average of free-ridership levels and energy savings per participant.

in Non-Residential Facilities 47 Table 27: Interactive Effects Factor for Hot Water Tank Wraps Installed in Individual Rental Units of Multi-Unit Buildings ...................................................................... 48 Table 28:...

AI summary This 2011 evaluation report assesses the Efficient Products-Direct Install (EP-DI) program managed by Efficiency Nova Scotia Corporation. It includes interviews, on-site visits, and a survey of participants to evaluate the program's process and impact.

ormation in general. It is to be noted that the addition of dimmable CFLs to the product list later in 2011 addresses some of the issues identified during the 2011 evaluation. Program Energy Savings To calculate the net savings of the EP-D...

AI summary The evaluation of the EP-DI program in 2011 calculated net savings by accounting for free-ridership and spillover effects, resulting in a net-to-gross ratio of 0.94. Combined with the Retail LED Direct Install pilot project, the program achieved 25.792 GWh in energy savings and 2.593 MW in demand savings.

MW 2.731 MW 0.95 2.593 MW NTGR of 0.94 for EPDI program and NTGR of 1 for Retail LED Direct Install pilot project. The combined NTGR value for all savings is 0.95. These net evaluated savings fell short of those tracked by ENSC. The adjust...

AI summary The document discusses the evaluation of energy efficiency programs, noting that net evaluated savings were lower than tracked savings due to adjustments and interactive effects. Econoler recommends improving tracking sheets for better validation and data accuracy.

code values for the facility where the products were installed were missing or not available for 20 percent of the records. Finally, usage group labelling could be improved Ref.: 5725 viii Efficient Products – Direct Install Program Effici...

AI summary The 2011 evaluation of the Efficient Products – Direct Install Program highlights issues with data collection, such as missing facility codes for 20% of records and the need for better usage group labeling. It also recommends expanding marketing strategies beyond call centres and one-on-one encounters to improve program promotion and participant engagement.

11. These targets exclude savings for the Retail LED Direct Install pilot project. The EP-DI program generated net electricity savings of 25.23 GWh in 2010 and 39.52 GWh for 2008 and 2009 combined. Ref.: 5725 2 Efficient Products – Direct...

AI summary The text discusses the Efficient Products – Direct Install (EP-DI) program's electricity savings and evaluation methodology. It excludes savings from the Retail LED Direct Install pilot project and outlines the program's logic model and research strategy for the 2011 evaluation.

ting Program Information The first task in the process evaluation of the EP-DI program was the analysis of the program documentation. At that stage, all available program information was reviewed. Ref.: 5725 4 Efficient Products – Direct I...

AI summary The evaluation of the EP-DI program involved analyzing program documentation, conducting interviews with the Program Manager and Delivery Agent, and performing on-site visits. The process aimed to assess the program's effectiveness, barriers, and overall implementation.

ded, among other things, to understand the DA’s involvement in the program, their participation process in the program and their perception and satisfaction with the program. 2.2.4 On-Site Visits In November, 15 on-site visits were conduct...

AI summary The report discusses on-site visits conducted in November to assess the installation of EP-DI products. These visits were carried out by Equilibrium Engineering and involved evaluating the installation process and validating data from the tracking sheet. Some visits occurred during the installation, allowing for evaluation of the DA's data collection and communication with facility managers.

y the DA to the facility manager, such as technical information regarding the use of the products installed through the program. This approach aimed to ensure that program delivery goals would be met. The methodology used for the on-site v...

AI summary The EP-DI program conducted on-site visits and a telephone survey with 70 participants to evaluate program impact and participant experiences, including motivations, barriers, and satisfaction. The survey aimed to understand program features and included data on sampling error.

2011 Evaluation Report 3 PROCESS EVALUATION 3.1 OBJECTIVE AND APPROACH OF THE PROCESS EVALUATION The process evaluation conducted under the EP-DI program focuses on one of ENSC’s evaluation objectives, which is “assessing the effectiveness...

AI summary The 2011 Evaluation Report discusses the process evaluation of the EP-DI program, focusing on assessing the effectiveness of program design and delivery. The evaluation involved interviews with the Program Manager (PM) and the Director of Administration (DA), as well as a telephone survey of participants. The report also outlines the content of the program manual, including components such as program description, objectives, incentives, eligibility criteria, and savings calculations.

riers Total savings objectives (with details of gross savings and hypothesis for free-ridership and other effects) Details about the savings calculations and type of products Ref.: 5725 8 Efficient Products – Direct Install Program Efficie...

AI summary The document discusses the Efficient Products – Direct Install (EP-DI) Program, highlighting the content of its program manual, including budget, cost-effectiveness, marketing plans, and evaluation strategies. Econoler's analysis notes that the manual provides useful information for program monitoring, though it lacks specific indicators for measuring marketing success.

the marketing outreach section of the program manual does not specify indicators to measure the success of different efforts, these efforts are sufficiently described for further monitoring purposes. However, the program manual is missing...

AI summary The program manual for the Efficient Products – Direct Install Program lacks specific indicators to measure the success of marketing efforts and does not provide a 'base case' for validating assumed gross savings. Recommendations include documenting program characteristics and providing detailed variables for calculating savings.

Efficiency Nova Scotia Corporation 2011 Evaluation Report > Provide the parameters used to estimate the program objectives: After estimating the gross savings from the base case established in the program manual, the objectives are then fo...

AI summary The document outlines the need to refine parameters for estimating program objectives, incorporating distortion and interactive effects, and emphasizes the importance of maintaining and standardizing the program manual to ensure consistency and track changes over time.

rovided by participants. From this information, energy savings are calculated by the PM for 13 W and 23 W CFLs installed by the participant using the equation below when the information is available. Ref.: 5725 10 Efficient Products – Dire...

AI summary The Efficient Products – Direct Install Program's tracking sheet was evaluated and found to provide necessary information, though improvements are recommended, including removing unnecessary fields to enhance clarity and usability.

hat several fields in the tracking sheet are not required for program administration. Those fields are present even though they are not filled and should be removed for clarity purposes. > Ensure that all fields are filled in systematicall...

AI summary The text discusses improvements to the tracking sheet used in the Efficient Products – Direct Install Program, suggesting the removal of unnecessary fields and the systematic filling of required fields. It also highlights issues with missing rate code values and the need to improve the labelling of the usage group field to reduce the use of the 'Other' category.

tion, water heater blankets, power bars with timers and occupancy sensors were also piloted in 2011. Econoler has the following comments and recommendations on the design and delivery of the program: > Develop an evaluation plan in paralle...

AI summary Econoler recommends developing an evaluation plan in parallel with program design and standardizing the program name across all channels. The program currently lacks an evaluation plan and has inconsistent naming, which may cause confusion.

itoring name is “Efficient Products Direct Install.” The Evaluator’s recommendation is to limit changing names as much as possible and use the same name in all contexts. 3.5 ENSC WEBSITE Customers can consult the ENSC website to find relev...

AI summary The text discusses the EP-DI program's website and product listings, noting discrepancies between the website and the program manual. It also highlights confusion caused by the transition of responsibilities from Nova Scotia Power to ENSC, along with challenges from mid-course modifications and resource constraints faced by sub-contractors.

eover, mid-course modifications require major changes to the way the DA operates and there have been complaints from the sub-contractor related to resource constraints due to additional scope changes. Satisfaction with the relationship bet...

AI summary The document discusses mid-course modifications to a program, highlighting complaints from sub-contractors about resource constraints due to scope changes. It also notes high satisfaction with the relationship between ENSC and sub-contractors, but emphasizes the need for better-defined program scope and improved advertising to enhance promotion.

This result indicates that the participation process flow chart developed by ENSC in late 2011 was a good initiative as it will potentially simplify the participation of future program participants. Table 17: Provision of a Diagram Illustr...

AI summary The document highlights the development of a participation process flow chart by ENSC in 2011, which was seen as a beneficial initiative for future program participants. It also outlines the objective of an impact evaluation conducted in 2011 to assess the program's energy and demand savings, including parameters such as savings calculation methodology, installation rates, and free-ridership.

savings calculation methodology for each type of product; > hours of operation; > installation rate; > interactive effects; > free-ridership; and > internal spillover. The impact evaluation was based on a review of the program tracking she...

AI summary The evaluation of the program's savings calculation methodology included on-site visits and participant surveys to assess installation rates, hours of operation, interactive effects, free-ridership, and internal spillover. Data collected was used to determine a unitary savings value for eligible products and to calculate the net-to-gross ratio (NTGR), which accounts for free-ridership and internal spillover.

nt surveys provided information to calculate the net-to-gross ratio (NTGR) for this program, including free-ridership and internal spillover. The NTGR was used to calculate the program net savings. Ref.: 5725 23 Efficient Products – Direct...

AI summary The text discusses the calculation of the net-to-gross ratio (NTGR) for the Efficient Products – Direct Install Program, using survey data to account for free-ridership and internal spillover. It also outlines the sampling methodology used for on-site visits, including the breakdown of installations in rental units, commercial buildings, and common areas.

t. Thus, the total unitary savings value associated with the installation of a programmable thermostat is equal to 179 kWh per year. This value will be used in the 2011 impact evaluation of the RMP. 4.2.10 Occupancy Sensors For occupancy s...

AI summary The report evaluates the Efficient Products – Direct Install Program, noting that the unitary savings value for programmable thermostats is 179 kWh per year and for occupancy sensors is 391 kWh per unit. No on-site visits were conducted for occupancy sensors due to their low impact, but recommendations are made for future evaluations.

rs and hot water tank wraps, the total gross energy savings at the meter for the EP-DI program were estimated at 24.737 GWh while the total demand savings at the meter were estimated at 2.487 MW. Ref.: 5725 48 Efficient Products – Direct I...

AI summary The EP-DI program's energy and demand savings were estimated at 24.737 GWh and 2.487 MW, respectively. The evaluation uses a self-report approach to assess the program's influence on customer decisions, including measuring free-ridership and spillover effects to calculate the net-to-gross ratio.

previously used to estimate the free-ridership level of the program were preserved in Econoler’s approach. However, the enhancement below was incorporated by using: > A 0 to 10 scoring system. Ref.: 5725 49 Efficient Products – Direct Inst...

AI summary The 2011 evaluation report for the Efficient Products – Direct Install Program discusses the free-ridership level, measured at 15.4 percent, and the use of a 0 to 10 scoring system to assess the influence of various factors on customer decision-making. The report also examines internal spillover effects by asking participants if they purchased additional energy-efficient products after program participation.

nd installed additional energy-efficient products following their previous participation in the program. Additional questions were used to verify the eligibility of the additional purchases by asking: > If they have benefited from any othe...

AI summary The evaluation of the Efficient Products – Direct Install Program found a low level of internal spillover, with only 12 participants out of 70 surveyed flagged for spillover. Of these, only four confirmed purchasing additional energy-efficient lighting products, resulting in 17.66 MWh of energy savings and a spillover level of 9.5 percent. The program's NTGR value is calculated as 0.94.

35.678 GWh 35.678 GWh 0.83 29.435 GWh Evaluation Results 29.995 GWh 29.995 GWh 27.161 GWh 0.95 25.792 GWh Demand Savings Tracked Savings from ENSC 3.589 MW 3.589 MW 3.589 MW 0.83 2.961 MW Evaluation Results 3.017 MW 3.017 MW 2.731 MW 0.95...

AI summary The evaluation of the Efficient Products – Direct Install Program in 2011 found that net energy savings were slightly lower than tracked savings, primarily due to adjustments in unitary savings values and interactive effects factors. The Net-to-Gross Ratio (NTGR) was revised upward for certain programs but did not fully offset the impact of these adjustments.

2. Provide a “base case”: The program manual does not provide a “base case” that details information on how the assumed gross savings have been established. Usually, these savings are calculated with an algorithm using a series of variable...

AI summary The document highlights the need for a 'base case' in the program manual to establish gross savings through documented variables. It also emphasizes the importance of including parameters for estimating program objectives, accounting for distortion and interactive effects, and updating the manual to maintain consistency and track changes over time.

ions, the Evaluator recommends that the DA collect information on the hot water tank volume. This will help provide a better estimate of energy savings for this product. 16. Collect additional information for each room where a commercial p...

AI summary The Evaluator recommends collecting additional data on hot water tank volumes and room-specific thermostat settings to improve energy savings estimates. On-site visits are also recommended to determine the wattage and operating hours of lamps connected to occupancy sensors, with a minimum load criterion of 105 W for each occupancy sensor installation.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Impact 18. Collect information on dishwasher spray valve usage: Since no on-site visit Evaluation was conducted for dishwasher spray valves, no indication on the usage hours is avai...

AI summary The 2011 Evaluation Report by Efficiency Nova Scotia Corporation highlights the need for improved data collection methods in energy efficiency programs, such as on-site monitoring for dishwasher spray valves and increased on-site visits for CFL installations. It also recommends collecting information on heating sources and air conditioning use during telephone surveys and program participation to better assess program effectiveness.

3. Small Business Lighting Solution 4. Efficient Lighting Products Direct Install Program 5. Direct Install Program. Q: Care to explain why all these changes? Page I Q: When they mention changes in the free-riders calculations, do they mea...

AI summary The text discusses questions and comments regarding the Efficient Products – Direct Install Program, including free-ridership calculations, the status of recommendations, and concerns about the program's design and effectiveness in the small business sector. It also raises questions about the logic model and the accuracy of savings calculations.

usion between representative and delivery agent. Page 7 C: Make sure that replaced lamps where functional before replacing them (they were not burned) to get an accurate calculation of the savings. C: Interactive effects will have to be ca...

AI summary The text discusses the Efficient Products – Direct Install Program by Efficiency Nova Scotia Corporation, focusing on program evaluation, delivery agents, quality assurance, and process documentation. It includes questions about program structure, participant forms, barriers addressed, and evaluation plans.

Since this a new program, did you have an evaluation plan designed at the same time the program was designed? Q: Will there be a detailed program marketing strategy along with performance indicators? Q: How would you rate the facility or d...

AI summary The text outlines a questionnaire for partners in the Efficient Products – Direct Install Program, asking about their role, experience, and perception of the transition from Conserve Nova Scotia to Efficiency Nova Scotia Corporation. It includes instructions for completing the form and provides contact information for submission.

u had that role (specify months or years)? Q1b - If you were a program partner before it changed status and name from Conserve Nova Scotia to ENSC, how was this transition perceived in the market? Not applicable Unnoticed Some confusion A...

AI summary The text includes survey questions about the transition from Conserve Nova Scotia to ENSC, the impact on program partners, and participant complaints related to the Efficient Products – Direct Install Program. It also references an evaluation report from 2011.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Q4 – How would you qualify your participation process in this program? Simple or easy Complex Q4a - If you checked the Complex box, please elaborate. No comment / no opinion Q5- On...

AI summary The document contains a 2011 evaluation report for the Efficient Products – Direct Install Program by Efficiency Nova Scotia Corporation. It includes survey questions about program participation, satisfaction, and suggestions for improvement, as well as questions about prior evaluations and marketing outreach.

– If you answered Yes to Q8, we would like your opinion on the frequency of these evaluations. Too frequent Adequate No opinion Part II: Questions Specific to the Direct Install Program Q9- On a scale from 1 to 10 (where 1 is very bad and...

AI summary The text includes survey questions related to the Direct Install Program, focusing on participant experiences with program partners, lead generation, market confusion, program name changes, modifications, and complaints. It references an evaluation report from 2011.

uires minor changes to the way you work Requires major changes to the way you work No opinion Q14- Did you receive any complaints from other parties involved in the delivery of that program? Yes: If yes, which party was that? (Please do no...

AI summary This text is from a participant survey questionnaire for the Efficient Products – Direct Install Program conducted by Efficiency Nova Scotia Corporation in 2011. It includes questions about complaints, barriers to program implementation, and participant contact information.

way) 4. (Installed them at another location) 96. (Other [Specify _) 98. (Don’t know/Don’t recall) 99. (Refused) Section FR. Free-ridership (FOR SECTION FR REPEAT FOR UP TO TWO MEASURES VERIFIED IN VA1-VA3.) The next questions will be about...

AI summary This section of the document focuses on evaluating the Direct Install Program by asking participants about their pre-program intentions and likelihood of taking energy efficiency actions without the program's support. It includes questions about free-ridership and measures installed through the program.

er) 3. (At the same time) 98. (Don’t know) 99. (Refused) IF RESPONDENT HAS DIFFICULTY SPECIFYING AN FR2ccM1 ANSWER IN MONTHS, READ: Would it have been within . . . 1. Less than 6 months? 2. 6 months to less than 1 year later 3. 1 to less t...

AI summary The text includes survey questions related to the installation of energy-efficient products through the Efficient Products – Direct Install Program by Efficiency Nova Scotia Corporation. It asks respondents about the timing of installation and whether they would have paid for the measure if it had not been installed for free.

0 to 10) FR4_P = MAX(a; b; c) Factors a, b and c = Program factors PA2 Score: (10 - FR4_P) x 10% FR2c. In the absence of the program, what is the likelihood that you would IF FR2c > 5 : ASK FR2cc have installed exactly the same energy-effi...

AI summary The text outlines a scoring mechanism (PA2 Score) based on responses to questions about the likelihood of installing energy-efficient products without a program and the timing of such installations. The scoring depends on responses to FR2c and FR2cc, with different weightings based on the time delay.

per energy-efficient product implemented or installed under the pilot projects. These adjustments were made on the basis of national demand-side management (DSM) studies carried out in 2010 and 2011. In its net savings calculations, Econol...

AI summary The evaluation of the EnerGuide for Existing Houses Program found net energy savings of 4.805 GWh and demand savings of 1.543 MW in 2011. Free-ridership was measured at 31%, while spillover effects were very low at 1%, leading to a net-to-gross ratio of 0.70.

7 Standard + Plus Pipe Insulation 74 74 Standard + Plus Hot Water Tank Wraps 399 270 Ref.: 5725 ix EnerGuide for Existing Houses Program Efficiency Nova Scotia Corporation 2011 Evaluation Report Finally, the addition of interactive effects...

AI summary The 2011 EnerGuide for Existing Houses Program evaluation report notes that net-to-gross ratios were lower in 2011 compared to 2010, and that demand savings were adjusted downward by over 35% due to revised estimates for electric thermal storage systems.

r Existing Houses Program Logic Model4 4 The numbers 1 through 11 contained in this logic model explain the relationship between the different levels involved. They are presented in Appendix II. Ref.: 5725 5 EnerGuide for Existing Houses P...

AI summary This document outlines the methodology used in the 2011 evaluation of the EnerGuide for Existing Houses Program by Efficiency Nova Scotia Corporation. It includes a methodological model, sources of program information, and details of an in-depth interview with the program manager.

obtained primarily from the following sources: > ENSC website; > 2010 evaluation report; > program manual; > tracking sheet. 2.2.2 In-Depth Interview with Program Manager Econoler staff conducted one interview in September with the Program...

AI summary The evaluation process includes interviews with the Program Manager and program partners, as well as on-site visits to assess the EEH program's implementation. The interviews covered program justification, savings calculations, marketing strategies, and participant feedback, while on-site visits evaluated the effectiveness of energy efficiency measures.

mented. The billing information for these 25 participants was also used to compare real annual consumption with the HOT2000 consumption and calculate an adjustment ratio. 2.2.6 Participant Survey A telephone survey with a total of 70 progr...

AI summary The document discusses a participant survey conducted by Econoler’s subcontractor, Corporate Research Associates, Inc. (CRA), to evaluate the EnerGuide for Existing Houses Program. The survey aimed to understand participant motivations, concerns, and program impact, with 70 participants interviewed via telephone in October and November.

ple size as well as the associated sampling error at the 90 percent confidence level for the 2009, 2010 and 2011 telephone surveys. Table 5: Sample Size and Sampling Error Sampling Error at 90% Survey Population Sample Size (n) Confidence...

AI summary The process evaluation of the EnerGuide for Existing Houses (EEH) program, conducted by Efficiency Nova Scotia Corporation (ENSC), focuses on assessing the effectiveness of the program's design and delivery. The evaluation involved interviews with program managers and partners, on-site visits, and a telephone survey of participants.

interviews conducted with the PM and with the program partners, through on-site visits with participants as well as through a telephone survey of program participants. 3.2 PROGRAM MANUAL CONTENT The EEH program features a manual that conta...

AI summary The EnerGuide for Existing Houses (EEH) program includes a program manual with components such as program description, objectives, incentives, eligibility criteria, and savings calculations. The manual is a critical tool for program staff and evaluators, and is tailored to meet specific organizational needs.

Efficiency Nova Scotia Corporation 2011 Evaluation Report EEH Program Program Manual Content Manual Budget per year Cost-effectiveness test results Market study or technical study that supports program elements or assumptions Marketing pla...

AI summary The 2011 Evaluation Report for the EEH Program reviewed the program manual and found that it contains relevant information for program managers and evaluators but lacks completeness. Recommendations were made to supplement and improve the tool.

Econoler analyzed the EEH program manual. It contains relevant information useful for both the PM and the Evaluator. The following are recommendations in order to supplement and improve the tool: > Document important program assumptions or...

AI summary Econoler reviewed the EEH program manual and provided recommendations to improve clarity and usability, including detailing program assumptions, defining audit types, and including rebate calculation sources in the manual.

Efficiency Nova Scotia Corporation 2011 Evaluation Report > Provide the parameters used to estimate the program objectives: After estimating the gross savings from the base case established in the program manual, the objectives are then fo...

AI summary The document outlines the need to refine program objectives by incorporating distortion and interactive effects, standardize marketing plans with performance indicators, and improve the program manual to serve as a comprehensive and standardized reference for tracking changes and program memory.

ving the fields that are not necessary to calculate energy savings including the “estimated kWh savings for individual measures” column to facilitate understanding of the tracking sheet. > Add the period or end date of the renovation: Duri...

AI summary The report recommends adding the renovation completion date and project type to the tracking sheet to improve the accuracy of energy savings calculations and facilitate better program evaluation. These adjustments would help in conducting more thorough billing calibrations and analyzing the impact of energy efficiency measures.

Efficiency Nova Scotia Corporation 2011 Evaluation Report > Develop an evaluation plan in parallel with program design and development: This program has no evaluation plan. Econoler strongly recommends that for each new program, an evaluat...

AI summary The 2011 Evaluation Report highlights the need for an evaluation plan during program design, stronger partnership with DAs, and the creation of a list of pre-approved contractors to enhance program implementation and effectiveness.

tle interaction between the service organizations (DAs and contractors) and that some contractors continue to show a lack of understanding of EE programs, which can lead to confusion among homeowners. While one energy auditor expressed a h...

AI summary The evaluation report highlights concerns about the lack of understanding of EE programs by some contractors and the need for better support after training. Program partners also criticize the marketing efforts and suggest increased provincial funding and new rebates to compensate for the loss of federal support.

r a price of $39. Direct installation of low cost measures was also included in the Team Buy offer. For more information on the Team Buy approach, visit the following website: http://www.teambuy.ca/. Ref.: 5725 19 EnerGuide for Existing Ho...

AI summary The EnerGuide for Existing Houses (EEH) program's evaluation report highlights that 40% of participants learned about it through word of mouth, with additional awareness from newspapers, the internet, and other media. Marketing activities also play a role in program awareness.

29 Refused 1 Multiple responses Ref.: 5725 21 EnerGuide for Existing Houses Program Efficiency Nova Scotia Corporation 2011 Evaluation Report Six percent of participants had concerns about the EEH program prior to taking part, which is con...

AI summary The evaluation report highlights that 6% of participants had concerns about the EnerGuide for Existing Houses (EEH) program before participation, with issues related to rebate amounts, cost, and time. The energy auditor's advice was considered the most important factor in participants' decisions to implement energy-efficient measures.

9 Hot water lasts longer 3 Don’t have to put wood in stove 5 2 Heat is not as comfortable/basement is colder 5 2 Other 7 10 Don’t know 2 2 Multiple responses Ref.: 5725 27 EnerGuide for Existing Houses Program Efficiency Nova Scotia Corpor...

AI summary The evaluation report indicates that 57% of respondents noted a decrease in their energy bills following the implementation of energy efficiency measures, with 7% reporting an increase and 32% noting no change or insufficient time to determine the impact.

This result indicates that the participation process flow chart developed by ENSC in late 2011 was a good initiative as it will potentially simplify the participation of future program participants. Table 22: Provision of a Diagram Illustr...

AI summary The document discusses an impact evaluation of the EnerGuide for Existing Houses Program in 2011, focusing on energy and demand savings. The evaluation considered factors such as HOT2000 simulations, prescriptive measure savings, free-ridership, and internal spillover to determine the program's gross and net savings.

is evaluation. To do so, Econoler analyzed the following parameters: > HOT2000 simulations; > prescriptive measure savings; > free-ridership; and > internal spillover. The impact evaluation was essentially based on a comparative analysis o...

AI summary Econoler evaluated the program's impact by analyzing HOT2000 simulations, prescriptive measure savings, free-ridership, and internal spillover. The evaluation involved comparing program tracking sheets, building simulations, and participant surveys to estimate net energy savings and account for free-ridership and internal spillover.

rveys provided information to calculate the net-to-gross ratio (NTGR) for this program, including free-ridership and internal spillover. The NTGR established was used to calculate program net savings. Last year’s verification study recomme...

AI summary The evaluation of the EnerGuide for Existing Houses Program used the net-to-gross ratio (NTGR) to calculate program net savings, considering free-ridership and internal spillover. The previous year's verification study suggested using a non-equivalent control group design, but this was not implemented due to time constraints and challenges with selectivity bias.

Efficiency Nova Scotia Corporation 2011 Evaluation Report A better way to use the comparison group could be to look for trends or to construct a trend line that can be incorporated into the analysis. For the billing analysis, the trend lin...

AI summary The document discusses methods for improving the comparison group analysis in efficiency programs, suggesting the use of trend lines and economic indicators. It also outlines how gross savings were estimated for Efficiency Nova Scotia Corporation in 2011, noting data gaps in some projects.

ctor -48.3% For all other products installed, interactive effects were considered as negligible. 4.4 NET-TO-GROSS RATIO The NTGR evaluation of the program is based on a self-report approach which relies on a series of questions designed to...

AI summary The evaluation of the EnerGuide for Existing Houses Program includes a Net-to-Gross Ratio (NTGR) analysis, which assesses free-ridership and internal spillover effects based on participant self-reports. The NTGR is calculated using a specific formula that accounts for these distortion effects.

efficiency measures in the absence of the program. The free-ridership level for this program was measured through participant surveys. The questionnaire included six questions that intended to assess: > if participants had any plans to imp...

AI summary The text discusses the measurement of free-ridership in an energy efficiency program using participant surveys. Six questions were used to assess participants' behavior, and the results were used to calculate the program's attribution level. Econoler’s approach preserved key elements of the previous method but included enhancements.

Efficiency Nova Scotia Corporation 2011 Evaluation Report 4.4.2 Internal Spillover The participant survey was also used for assessing internal spillover. In the case of the EEH program, internal spillover can occur when participants declar...

AI summary The 2011 evaluation of the Efficiency Nova Scotia Corporation's EEH program found minimal internal spillover, with only one participant out of 70 implementing an additional energy efficiency measure (programmable thermostats) after previous participation. This accounted for 0.5% of total gross energy savings, equivalent to 37.3 MWh.

2011 Evaluation Report Table 33: Evaluation Results – Net Energy and Demand Savings

AI summary The 2011 Evaluation Report includes Table 33, which presents evaluation results related to net energy and demand savings. This table likely provides quantitative data on energy and demand savings achieved through various programs or initiatives.

tor compared the net energy savings values calculated in the previous table with the EEH program tracked net savings for 2011. The next table details the final evaluated and tracked impacts for 2011. Table 34: Comparison of Tracked and Eva...

AI summary The evaluated net energy savings for the EEH program in 2011 are approximately 25% lower than the tracked savings, primarily due to adjustments in gross energy savings per EnerGuide point and updated national studies. Econoler also made adjustments to savings from pilot projects, with Direct Install Plus showing slightly higher savings due to changes in unitary savings for aerator and CFL bulb installations.

nstall Plus). Noteworthy is that the Direct Install Plus evaluated savings were slightly higher than ENSC’s as a result of an increase in unitary savings related to aerator and CFL bulb installations. Another reason to explain the drop in...

AI summary The Direct Install Plus program's evaluated energy savings were slightly higher than ENSC's due to increased unitary savings from aerator and CFL bulb installations. The drop in net energy savings is attributed to interactive effects from energy-efficient lighting and insulation measures. The NTGR decreased from 0.76 to 0.70, influenced by changes in free-ridership evaluation methods. Econoler adjusted ENSC's demand savings calculations, reducing them by over 35%.

d for each prescriptive measure are available in the program tracking sheet. However, Econoler recommends adding this information in the program manual. 2. Provide the parameters used to estimate the program objectives: After estimating th...

AI summary The text discusses the need to document parameters used for estimating program objectives, including distortion and interactive effects, and the importance of refining and disseminating marketing plans within the program manual for effective monitoring and evaluation.

gram manual. The plans should also identify for each activity the performance indicators that should be collected for monitoring and evaluation purposes. Ref.: 5725 67 EnerGuide for Existing Houses Program Efficiency Nova Scotia Corporatio...

AI summary The document highlights the need for a comprehensive program manual for the EnerGuide for Existing Houses Program, emphasizing the importance of standardizing content and including performance indicators for effective monitoring and evaluation.

t necessary to calculate energy savings including the “estimated kWh savings for individual measures” column to facilitate understanding of the tracking sheet. 6. Add the period or end date of the renovation: During the program impact eval...

AI summary The document outlines recommendations for improving the tracking sheet used in program impact evaluations. It suggests adding the renovation completion date and project type to enhance billing calibration and analysis of energy efficiency measures.

age of missing entries for the EnerGuide rating is quite low for 2011 (only 3%), the Evaluator cannot provide ENSC with gross energy savings for these projects. Program 10. Develop an evaluation plan in parallel with program design and Des...

AI summary The Evaluator cannot provide ENSC with gross energy savings for 2011 due to a low rate of missing EnerGuide ratings. Econoler recommends developing an evaluation plan in parallel with program design and suggests strengthening partnerships with DAs by involving them in program modifications and EE measure decisions.

report their cost-effectiveness, the mentioned in item #4. participant has all the information required to make an informed decision. Ref.: 5725 74 EnerGuide for Existing Houses Program Efficiency Nova Scotia Corporation 2011 Evaluation Re...

AI summary The document discusses the EnerGuide for Existing Houses Program, highlighting how participants can implement energy efficiency measures recommended in audits, with incentives available to cover some of the costs. Performance indicators include the compilation of measures implemented and their deemed savings.

Efficiency Nova Scotia Corporation 2011 Evaluation Report APPENDIX IV – INTERVIEW GUIDE WITH PROGRAM MANAGER Process Evaluation Program Name: EnerGuide for Existing Houses & Multi-Units Telephone Interview with the Program Manager Date: Li...

AI summary The document discusses the 2011 evaluation report of the EnerGuide for Existing Houses & Multi-Units program, including interview questions and comments related to the program's status with Natural Resources Canada (NRCAN), the Provincial Government, and Efficiency Nova Scotia Corporation (ENSC). It also raises questions about the status of various recommendations and findings, including discrepancies in thermostat savings between existing and new houses.

Efficiency Nova Scotia Corporation 2011 Evaluation Report The logic model We proposed a modification for the logic model to include other parties beside ENSC. We sent the modification to the PM for comments. Source: General Q: Please indic...

AI summary The document outlines a process evaluation questionnaire for Efficiency Nova Scotia Corporation's EnerGuide for Existing Houses program, focusing on program partners, evaluation plans, marketing strategies, and data management challenges. It also includes questions about program barriers and cost-effectiveness testing.

W GUIDE WITH DELIVERY AGENTS PROCESS EVALUATION QUESTIONNAIRE FOR ENSC ENERGY EFFICIENCY PROGRAM PARTNERS Program Name: EnerGuide for Existing Houses & Multi-Units How to fill this form: This is a word document that integrates some form fe...

AI summary This document is a process evaluation questionnaire for ENSC energy efficiency program partners, focusing on their role, experience with the transition from Conserve Nova Scotia to ENSC, and their relationship with the Program Administrator. It is part of an evaluation report from 2011.

applicable It was the same Program Administrator I had to deal with a new PA The transition went smoothly The transition caused some delays or adjustments Other, please comment Q2 - On a scale from 1 to 10 (where 1 is very bad and 10 is ex...

AI summary The text contains survey questions related to participant experiences with the ENSC Program Administrator, including transition challenges, relationship satisfaction, complaints, and program improvements. It also includes a reference to an evaluation report on the EnerGuide for Existing Houses Program.

Q7 – On a scale from 1 to 10 (where 1 is very unsatisfied and 10 is very satisfied), what is your satisfaction level in regard to the marketing and outreach activities to implement the program? Q 7a - If your answer to Q7 was equal to or l...

AI summary The text contains survey questions from an evaluation report on the EnerGuide for Existing Houses Program by Efficiency Nova Scotia Corporation in 2011. It asks about satisfaction with marketing and outreach, frequency of evaluations, and opinions on the number of parties and organizations involved in the program.

tion report) and we hope that they will contribute to improving program performance. If we need to clarify some of your answers, we might call you back. Your name Date Phone number E-mail Ref.: 5725 90 EnerGuide for Existing Houses Program...

AI summary This document is an interview guide for energy auditors participating in the EnerGuide for Existing Houses Program managed by Efficiency Nova Scotia Corporation. It outlines the process for completing a questionnaire to evaluate program performance and includes instructions for submission.

for other energy-saving measures? It simplifies the participation process for the delivery agent It simplifies the implementation process for the participant It does not change anything Ref.: 5725 96 EnerGuide for Existing Houses Program E...

AI summary The text includes survey questions related to the EnerGuide for Existing Houses Program, focusing on participation processes, complaints from partners, barriers to implementation, and evaluations of training and software performance. It does not provide specific responses or data.

racy of the HOT 2000 software that you are using to perform your audit? Q19a – If your answer to Q18 was equal to or less than 8, would you care to share the reason or reasons for such a score? Ref.: 5725 97 EnerGuide for Existing Houses P...

AI summary This text is part of a participant survey questionnaire from the 2011 EnerGuide for Existing Houses Program evaluation report by Efficiency Nova Scotia Corporation. It includes questions about software accuracy and participant feedback, with a focus on confidentiality and program improvement.

PROMPT WORKS; IF RESPONDENT STILL SAYS NO: “Is there someone else in the household who would know about having participated in the EnerGuide for Existing Houses program?”] Ref.: 5725 99 EnerGuide for Existing Houses Program Efficiency Nova...

AI summary The text outlines procedures for determining if a respondent has participated in the EnerGuide for Existing Houses program, including prompts and recoding instructions. It also includes a section on how respondents learned about the program.

5. (Don’t think I really need it) 6. (Rebate not big enough) 7. (Want to install other upgrades that aren’t covered) 8. (Plan to install in the future) Ref.: 5725 107 EnerGuide for Existing Houses Program Efficiency Nova Scotia Corporation...

AI summary The text outlines survey questions from an evaluation report on the EnerGuide for Existing Houses Program, focusing on reasons participants did not install recommended energy-efficient measures and assessing whether participants had pre-existing plans for the upgrades.

ame energy efficiency upgrades that you implemented through the program, but at a later date? _ Response _98 Don’t Know _99 Refused IF FR2c > 5, then ask: FR2cc. DO NOT ASK FR2cc IF DON’T KNOW OR REFUSED IN Q.FR2c You indicated in your res...

AI summary This text is a survey question related to the EnerGuide for Existing Houses Program, asking respondents about the likelihood and timing of implementing energy efficiency upgrades without the program. It also provides alternative response options for respondents who have difficulty specifying a timeframe.

ore they are at the stage of shopping. This aims to influence decision making of homeowners who have not already decided to replace or substitute their electric space heating/DHW system. Satisfaction Satisfaction towards the pilot was very...

AI summary The Fuel Substitution Pilot was highly satisfactory to participants, with no dissatisfaction reported. The program achieved net energy savings of 1.570 GWh and demand savings of 0.785 MW in 2011. A 42% free-ridership level was identified, but no spillover effects were found.

to increase promotion as well as act as a lever to strengthen awareness. However, upstream advertising should also be done in order to influence decision making among Ref.: 5725 vii Fuel Substitution Pilot Efficiency Nova Scotia Corporatio...

AI summary The text discusses the need for improved promotion and awareness strategies to reduce free-ridership in a fuel substitution pilot program. It also highlights the need for better tracking sheets to include project status, system capacities, and heating load information for accurate savings calculation.

g, Technologies Heritage Gas Activities Marketing Strategy Admissible Equipment Financial Incentives Data Tracking 5 1 2 3 4 Market Push & Both Program Additional Market Pull Strategy Validation and Updating List of Financial Forms are Reb...

AI summary The text outlines a program involving marketing strategies, admissible equipment, financial incentives, and data tracking for gas and wood conversions. It includes a table with columns for market push and pull strategies, validation of equipment, financial incentives, and data tracking in an Excel database.

y questionnaire are included in Appendices IV and V. Figure 2: Methodological Model 2.2 METHODOLOGY DESCRIPTION 2.2.1 Analyzing Existing Pilot Information The first task in the process evaluation of the Fuel Substitution Pilot was the anal...

AI summary The evaluation of the Fuel Substitution Pilot involved analyzing existing documentation, conducting an interview with the Program Manager, and performing on-site visits to participating households to validate measures and gather data on energy usage.

ed to validate the new measures implemented, collect information on the previous heating and hot water system as well as gather data on the usage of the different energy sources available at the site. The methodology used for the on-site v...

AI summary The Fuel Substitution Pilot involved on-site visits and a participant survey to evaluate the pilot's impact. The survey, conducted by CRA, aimed to understand participant experiences, motivations, and the pilot's effectiveness. Sampling error data is provided for the 2011 telephone survey.

d sample size as well as the associated sampling error at the 90 percent confidence level for the 2011 telephone survey. Table 3: Sample Size and Sampling Error Sampling Error at 90% Survey Population Sample Size (n) Confidence Interval 20...

AI summary The document discusses a process evaluation of the Fuel Substitution Pilot conducted by Efficiency Nova Scotia Corporation in 2011. It highlights the evaluation's objective to assess program design and delivery effectiveness, and describes the methodology, including interviews with the Project Manager and a telephone survey of participants.

Efficiency Nova Scotia Corporation 2011 Evaluation Report > Provide the parameters used to estimate the objectives: After estimating the gross savings from the base case established in the manual, the objectives are then forecast in terms...

AI summary The document discusses the methodology for estimating objectives and tracking pilot savings for ENSC’s Fuel Substitution Pilot. It outlines the use of parameters based on past evaluations and market intelligence, and highlights the utility of a tracking sheet for monitoring applications and energy savings.

vings allocated by the PM to the new measure implemented, especially in situations where values different from the prescriptive value are used. 3.4 PILOT DESIGN AND IMPLEMENTATION Following the analysis of all pilot elements, the Evaluator...

AI summary The Fuel Substitution Pilot is seen as a promising initiative to reduce electricity use for home heating and water heating, lower secondary energy production from coal or oil, and reduce greenhouse gas emissions. However, the pilot lacks an evaluation plan, which Econoler strongly recommends developing in parallel with program design to ensure rigorous evaluation and data collection.

mportant to the PM are covered. The two most important components of the plan are the evaluation methodology as well as the pre- and post-data required to apply the selected methodology. > Provide examples in the program brochure: The coll...

AI summary The evaluation plan for the Fuel Substitution Pilot includes the need for a robust evaluation methodology and data collection, as well as recommendations for publishing real examples of savings and partnering with delivery agents and subcontractors for better program implementation control.

tion 2011 Evaluation Report 4 IMPACT EVALUATION 4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evaluation aims at determining the gross and net savings of the pilot for 2011. Both energy and demand savings were considered i...

AI summary The 2011 impact evaluation assesses the gross and net savings of a pilot program, considering energy and demand savings. It analyzed unitary savings, supplemental heating usage, free-ridership, and spillover. Methods included reviewing pilot tracking sheets, conducting on-site visits, and collecting participant surveys to calculate net total gross savings (NTGR) and net savings.

f new system. The participant surveys provided information to calculate the NTGR for this pilot, including free- ridership and internal spillover. The NTGR was used to calculate pilot net savings. Ref.: 5725 17 Fuel Substitution Pilot Effi...

AI summary The document discusses the calculation of the Net Total Gross Savings (NTGR) for a fuel substitution pilot, using participant survey data to account for free-ridership and internal spillover. A sampling methodology was used based on a pilot tracking sheet provided by ENSC, excluding one participant due to rebate eligibility for a heating equipment accessory rather than the equipment itself.

gned to measure the influence of the pilot on customers’ decisions to substitute electric heating or DHW systems with another source of energy. These questions were included in the participant survey. This section presents the methodology...

AI summary This section discusses the methodology for calculating the Net-to-Gross Ratio (NTGR) by assessing distortion effects such as free-ridership and spillover. It outlines how free-ridership is measured through survey questions that determine whether participants would have made the same energy substitution decisions without the pilot program.

t the Fuel Substitution Pilot at the store where they purchased their new equipment. This is an indication that they were already strongly considering a retrofit even before knowing about the program. The sample size for each category, exc...

AI summary The Fuel Substitution Pilot program showed high free-ridership levels for wood and pellet stoves, suggesting eligibility criteria could be improved. Natural gas systems had lower free-ridership. Internal spillover effects were identified for participants who switched from electricity to natural gas, potentially leading to additional electricity savings.

whether positive or negative. These parameters are usually based on past evaluation results, market intelligence, secondary research and other sources. The pilot manual should document these parameters so that the PM and the Evaluator can...

AI summary The text discusses the need for clear documentation of parameters in a pilot manual, the importance of defining project status in a tracking sheet, and the collection of details on heating and domestic hot water system capacity to justify savings allocations in the Fuel Substitution Pilot Program.

7. Develop an evaluation plan in parallel with program design and Pilot Design and Implementation development: This pilot has no evaluation plan. Econoler strongly recommends that for each new pilot or program, an evaluation plan be prepar...

AI summary The text emphasizes the importance of developing an evaluation plan alongside program design, providing real examples in program materials, and considering partnerships with delivery agents and subcontractors to ensure effective program implementation and control.

2011 Sample Size 28 Male 57% Female 43 Ref.: 5725 33 Fuel Substitution Pilot Efficiency Nova Scotia Corporation 2011 Evaluation Report APPENDIX IV - INTERVIEW GUIDE WITH PROGRAM MANAGER Process Evaluation Program Name: Fuel Substitution Pi...

AI summary This document contains an interview guide for the Fuel Substitution Pilot Program managed by Efficiency Nova Scotia Corporation (ENSC). It includes questions and comments related to the program's implementation, such as equipment disposal, incentive calculations, and the clarity of program materials.

notice that natural gas equipment have no capacity specified. Care to comment? Q: The incentives have been calculated based on what exactly: uninstalling, acquisition, installation and inspection? Ref.: 5725 34 Fuel Substitution Pilot Effi...

AI summary The text contains a series of questions and comments regarding the Fuel Substitution Pilot program managed by Efficiency Nova Scotia Corporation (ENSC). Topics include program incentives, participant responsibilities, form requirements, and verification processes for eligibility and cost calculations.

ility) Q: 10th point: about receiving more incentives than the total cost. How do you verify this? And what happens if you have such a case? Rebate Application form: This form needs a revision date. C: The logic model was developed by the...

AI summary The text includes questions about program evaluation, incentive verification, and cost-effectiveness testing. It references a 2011 evaluation report by Efficiency Nova Scotia Corporation and discusses program partners, assumptions about distortion effects, and the use of social cost tests for emission reduction.

base? (1 is very difficult 10 is very easy) Q: Do you have any other subject you wish us to investigate with the program partners who will be part of the process evaluation? Thank you very much. Ref.: 5725 36 Fuel Substitution Pilot Effici...

AI summary The document includes a survey questionnaire from the Fuel Substitution Pilot Program by Efficiency Nova Scotia Corporation (ENSC), aimed at participants who substituted electric heating with alternative sources in 2011. It outlines screening and introduction steps for surveying participants.

d) 5. (The process would take too long) 6. (My insurance would increase) 96. (Other) [SPECIFY _]) 98. Don’t know 99. Refused Ref.: 5725 39 Fuel Substitution Pilot Efficiency Nova Scotia Corporation 2011 Evaluation Report Program Satisfacti...

AI summary The text includes survey questions from the Fuel Substitution Pilot program evaluation report by Efficiency Nova Scotia Corporation, focusing on participant satisfaction and reasons for dissatisfaction with the program.

2. No 98. (Don’t know) 99. (Refused) B2. [If B1 = 1 “Yes”] What was the SINGLE most important challenge or barrier? (DO NOT READ - ACCEPT ONE RESPONSE) 1. (Concern that actual bill savings would be less than estimated) 2. (Lack of informat...

AI summary The text includes survey questions about barriers to participation in a program and customer recommendations, with references to the Fuel Substitution Pilot and an evaluation report by Efficiency Nova Scotia Corporation.

ship level for the program corresponded to the weighted average of the final adjusted free-ridership levels calculated for each participant with the energy savings associated with each participant. Ref.: 5725 54 160, rue Saint-Paul, bureau...

AI summary The document discusses the evaluation of a low-income program by Efficiency Nova Scotia Corporation in 2011, focusing on the impact and process of the program, including the calculation of free-ridership levels and energy savings associated with participants.

VIEW GUIDE WITH OUTREACH AGENT ..................................................... 77 APPENDIX VII - PARTICIPANT SURVEY QUESTIONNAIRE .......................................................... 84 Ref.: 5725 iii Low Income Program Efficie...

AI summary This document is an evaluation report from Efficiency Nova Scotia Corporation on the Low Income Program from 2011. It provides an analysis of the program's performance and outcomes.

rate under the program to conduct the initial energy audit that assesses the measures to be implemented as well the final audit that confirms the measures implemented and provides an EnerGuide rating. The Low Income program aimed at achiev...

AI summary The 2011 evaluation of the Low Income program showed significant success with 5,103 participants and 7.636 GWh of net energy savings. However, program partners noted confusion caused by the program's name changes, including the use of 'Residential Energy Affordability Program (REAP)' and 'Low Income Program.' Marketing research suggested that 'Low Income Program' is the most appropriate name.

rch conducted by Nova Scotia Power Inc. (NSPI) indicated that the “Low Income Program” name was best suited for the program, efforts will have to be put forth to eliminate all confusion in the market. Program partners identified the main b...

AI summary The Low Income Program's name is deemed appropriate, though efforts are needed to eliminate market confusion. Program partners identified participant enrolment as a main barrier, but a new delivery model implemented in 2011 aims to address this by offering direct installs and conducting initial audits. Participant satisfaction is high, and program partners are also satisfied with the program and their collaboration with ENSC. Energy savings are calculated using EnerGuide points and prescriptive measures.

tion with the implementation of a series of prescriptive measures. An initial methodology using a billing analysis was planned, but after a preliminary analysis of the participant database, Econoler Ref.: 5725 vi Low Income Program Efficie...

AI summary The evaluation of the Low Income Program by Efficiency Nova Scotia Corporation in 2011 showed net energy savings of 7.636 GWh and demand savings of 1.632 MW. The program's net-to-gross ratio (NTGR) was assumed to be 1 due to minimal distortion effects.

acked Savings from ENSC 1.513 MW 1.513 MW 1.00 1.513 MW Evaluation Results 1.744 MW 1.632 MW 1.00 1.632 MW These net evaluated savings were slightly higher than those tracked by ENSC by approximately 8 percent for the net energy and demand...

AI summary The evaluation of energy savings from the Efficiency Nova Scotia Corporation (ENSC) program found that net evaluated savings were slightly higher than those tracked by ENSC. Adjustments to unitary savings of lighting products, programmable thermostats, and low-flow fittings were the main factors contributing to this difference.

1,274 Faucet Aerators 86 176.3 Low-Flow Showerheads 157 377 Hot Water Heater Pipe Insulation 74 74 Hot Water Heater Tank Wraps 399 270 Ref.: 5725 viii Low Income Program Efficiency Nova Scotia Corporation 2011 Evaluation Report RECOMMENDAT...

AI summary The 2011 evaluation report for the Low Income Program by Efficiency Nova Scotia Corporation recommends assessing the installation rate of prescriptive measures, noting that only 13% of total energy savings came from EnerGuide points, with the rest from on-site installations.

s the collection tools used. Copies of the interview guide and the survey questionnaire are included in Appendices IV, V, VI and VII. Figure 2: Methodological Model 2.2 METHODOLOGY DESCRIPTION 2.2.1 Analyzing Existing Program Information T...

AI summary This section outlines the methodology used in evaluating the Low Income program. It includes analyzing existing program information, conducting an interview with the Program Manager, and performing in-depth interviews with program partners to gather insights on program implementation and effectiveness.

esults of the PM interview, the list of questions and topics to include in the program partner interviews for the process evaluation was finalized. 2.2.3 In-Depth Interviews with Program Partners In September, in-depth interviews were cond...

AI summary The document outlines the evaluation process for a low-income energy efficiency program, including interviews with program partners, on-site visits to validate compliance with EnerGuide guidelines, and a telephone survey of 70 participants conducted by CRA in Halifax.

Resources Canada. For additional information: http://198.103.48.154/eng/software_tools/hot2000.html. 3 The population for the 2011 survey was 594 participants at the time of conducting the survey. Ref.: 5725 6 Low Income Program Efficiency...

AI summary This section discusses the process evaluation of the Low Income program conducted by Efficiency Nova Scotia Corporation in 2011, focusing on program design and delivery effectiveness. The evaluation involved interviews with program managers, partners, and a telephone survey of participants. A program manual is described as an essential tool for staff and evaluators, containing customized components tailored to the organization's needs.

nuals intended for internal use. The table below presents such information as well as that found in the Low Income program manual. Table 4: Program Manual Content Low Income Program Manual Content Program Manual Document revisions Program...

AI summary The document outlines the content of program manuals, specifically focusing on the Low Income Program, including sections such as program description, eligibility criteria, budget, and evaluation plans. It references an evaluation report from Efficiency Nova Scotia Corporation in 2011.

ons Marketing plan Evaluation plan Program theory Logic model Program process flow chart Partner or participant process flow chart Program forms Information included in the program manual Information partially included in the program manua...

AI summary Econoler evaluated the Low Income program manual and found it useful but recommended revisions to the process flow chart, inclusion of EnerGuide audit and trainer activities, and monitoring of outreach activities with performance indicators.

vities: The Evaluator recommends that outreach activities be monitored with performance indicators to evaluate the effectiveness of each activity in terms of enrolment in the program. Ref.: 5725 8 Low Income Program Efficiency Nova Scotia...

AI summary The Evaluator recommends monitoring outreach activities with performance indicators to assess program effectiveness. The program manual lacks a 'base case' for calculating gross savings and does not document parameters used to estimate program objectives, which should be based on past evaluations and adjusted annually.

and the Evaluator can keep track of the assumptions used to estimate the program objectives. The parameters should then be adjusted annually based on the most recent evaluation results. > Complete the program manual to keep track of change...

AI summary The text discusses the need to improve the program manual for tracking changes and standardizing content, as well as the structure of the Low Income program tracking sheet. It highlights the importance of annual adjustments based on evaluation results and the need for better association between project and client information for easier tracking and evaluation.

ate them with the energy consumption data of HOT2000. Econoler proposes adding fields for building energy consumption per year in kWh for D and E audits. 3.4 PROGRAM DESIGN AND IMPLEMENTATION Following the analysis of all program elements,...

AI summary The text discusses the importance of developing an evaluation plan in parallel with program design for ENSC’s program portfolio, emphasizing the need for rigorous evaluation and data collection to ensure effective program delivery and impact assessment.

sociated with this expression. However, marketing research done by NSPI when the program was initiated found that the present program name (Low Income) was preferred because it was clear and explicit. Several complaints were received from...

AI summary The Low Income Program faced complaints about insufficient measures and timelines, but participant satisfaction was high at 91%. Program partners suggest improving eligibility processes to increase enrolment, with recommendations including open applications and expanding income eligibility. The new delivery model is expected to address these barriers.

source used, while another DA recommends increasing the eligible income range. However, the new delivery model implemented by ENSC should improve program enrolment and address this important barrier. In order to improve the program, progra...

AI summary The document discusses recommendations to improve the low-income program, including adjusting the eligible income range, reducing the number of organizations involved, and enhancing communication between the Delivery Agent (DA) and the Organization (OA). It also mentions a telephone survey of 70 participants, though results are noted to be cautious due to challenges in surveying the low-income housing market.

1 power bars To save energy 16 17 6 11 Overall good 2 2 5 2 idea/needed it To know home’s energy efficiency 3 level Older home 2 To improve resale 2 value Other 2 4 3 2 9 10 None 4 Don’t know 5 35 10 52 13 Refused 4 5 27 Multiple responses...

AI summary The 2011 Evaluation Report on the Low Income Program by Efficiency Nova Scotia Corporation indicates that only 4% of respondents had concerns about participating, with some worried about potential costs despite the program being marketed as free.

ponses Seven in 10 respondents have noticed improvements in their interest in energy efficiency (70%) while six in 10 respondents have seen improvements in their energy efficiency knowledge (58%). Table 11: Impact of Measures Impact of Mea...

AI summary The evaluation report indicates that 70% of respondents noticed improved interest in energy efficiency, and 58% reported improved knowledge. Over 60% of participants believed the information from the energy evaluation changed their home energy behavior, such as turning off lights and adjusting thermostats.

Other 1 1 All respondents would recommend the program to a family member or friend. This result is a strong indicator of satisfaction. Table 16: Value of the Program Would Recommend the Program to a Family 2009 2010 2011 Member or Friend S...

AI summary Respondents highly recommend the program, with 96% to 100% indicating they would recommend it to a family member or friend. Recommendations for improvement include adding more products like window and door replacements, improving communication, and enhancing the quality of work.

This result indicates that the participation process flow chart developed by ENSC in late 2011 was a good initiative as it will potentially simplify the participation of future program participants. Table 18: Provision of a Diagram Illustr...

AI summary The evaluation report discusses the impact of the Low Income Program in 2011, focusing on energy and demand savings. It references a participation process flow chart developed by ENSC in late 2011, which was intended to simplify program participation for future participants.

a using outcomes from the participant survey conducted with Low Income program participants. Finally, the program net savings were evaluated by applying the interactive effects factors and the NTGR. Ref.: 5725 26 Low Income Program Efficie...

AI summary The 2011 evaluation of the Low Income Program's gross savings is based on the EEH program analysis, using unitary savings estimates from various studies, including a 2011 Ontario Power Authority report, to calculate savings for prescriptive measures implemented through different programs.

it performed. For the other 203 participants, the measures were implemented before the end of the year but since the emphasis was put on reaching new customers, many E audits were postponed to 2012. Ref.: 5725 27 Low Income Program Efficie...

AI summary The 2011 Low Income Program evaluation report by Efficiency Nova Scotia Corporation (ENSC) used energy savings coefficients from the 2010 EEH program evaluation. ENS used 1,047 kWh per EnerGuide point, calculated based on the percentage of space heating load delivered by electricity. Econoler confirmed these figures through various analyses detailed in the EEH report.

nalyses to confirm the savings per EnerGuide point figure of ENSC. The details of these analyses are included in the EEH program evaluation report. The main features of this work are summarized below: > First, Econoler established a repres...

AI summary Econoler evaluated the energy savings of the EEH program by analyzing 23 projects. Using HOT2000 simulations and regression analysis, they found an average savings of 1,089 kWh per EnerGuide point. However, after calibrating simulations with billing data, they adjusted the savings estimate to 817 kWh per EnerGuide point due to overestimation by HOT2000.

energy savings were calculated from the 14 National Research Council Canada, Sunrise/Sunset Calculator, Standard times of solar rise for Halifax, Nova Scotia, 2011, http://www.nrc-cnrc.gc.ca. Ref.: 5725 33 Low Income Program Efficiency Nov...

AI summary The document discusses energy savings from programmable thermostats, referencing a study by Hydro-Québec and the Ontario Power Authority's consideration of a 1 percent savings value per degree setback. It also references an evaluation report on a low-income program by Efficiency Nova Scotia Corporation.

alues from the OPA were already deemed acceptable for most products promoted through ENSC programs. Therefore, the unitary savings value that was used in the current evaluation was 176.3 kWh per year. The OPA calculated an average unitary...

AI summary The document discusses the unitary savings values for faucet aerators and low-flow showerheads used in Efficiency Nova Scotia Corporation (ENSC) programs. The savings values are based on data from the Ontario Power Authority (OPA) and other sources, with specific assumptions made about installation locations and energy use.

2011 Evaluation Report Table 27: Evaluation Results – Gross Energy and Demand Savings

AI summary The 2011 Evaluation Report includes Table 27, which presents evaluation results related to gross energy and demand savings. This table likely contains data on the effectiveness of energy efficiency programs and their impact on energy consumption and demand.

Demand Savings 0.202 0.808 0.145 0.003 0.001 0.001 0.003 0.052 0.068 0.017 0.012 – at the Generator (MW) In the "Savings per EnerGuide Point" column, the number of units is in fact the number of participants where a D audit was conducted a...

AI summary The document discusses demand savings data and references a 2011 evaluation report by Efficiency Nova Scotia Corporation on a low-income program. It includes details on savings per EnerGuide point and mentions the EEH program impact evaluation.

et energy savings resulting from this evaluation were compared to the energy savings estimations from the 2011 tracking sheet. The next table details the final evaluated and tracked impacts for 2011. Table 31: Comparison of Tracked and Eva...

AI summary The evaluated net energy and demand savings were higher than those calculated by ENSC. The difference is attributed to the revision or addition of certain parameters in the evaluation process.

is that only a limited number of participants (319) had their houses improved through the EcoENERGY program when compared to the total program population (more than 5,000 participants). > Interactive effects factors: Interactive effects we...

AI summary The evaluation of the Low Income Program in 2011 by Efficiency Nova Scotia Corporation (ENSC) and Econoler found that interactive effects factors significantly reduced net energy and demand savings. The line loss factor was updated from 1.1188 to 1.105. Adjustments to unitary savings values increased gross savings by approximately 15%, but net savings were only 8% higher due to the use of interactive effects factors.

ergy and demand savings evaluated by Econoler were only 8 percent higher than those tracked by ENSC since the Evaluator used interactive effects factors for the calculation of the net program impacts. Upon completion of the impact evaluati...

AI summary Econoler evaluated energy and demand savings and found that their results were only 8% higher than those tracked by ENSC. They recommend assessing the installation rate of prescriptive measures and reviewing HOT2000 models to improve future impact calculations.

sure that the DAs have sufficient staff and a protocol in place that would allow ensuring that all final audits are completed within a short period after the measures are implemented. Ref.: 5725 53 Low Income Program Efficiency Nova Scotia...

AI summary The text emphasizes the need for Delivery Agents (DAs) to have sufficient staff and protocols to ensure timely completion of final audits after energy efficiency measures are implemented. It references an evaluation report on the Low Income Program by Efficiency Nova Scotia Corporation from 2011.

and documented for validation and updating purposes. 5. Provide the parameters used to estimate the program objectives: After estimating the gross savings from the base case established in the program manual, the objectives are then foreca...

AI summary The text discusses the methodology for estimating program objectives in energy efficiency programs, emphasizing the use of parameters based on past evaluations, market intelligence, and other sources. It also highlights the importance of documenting these parameters to ensure transparency and annual adjustments based on the latest evaluation results.

inconsistencies. In a few cases, the tracking sheet indicated that the house was not using any electricity for space heating (0 percent for electric heating) while other fields indicated that the primary or secondary source for space heati...

AI summary The text highlights inconsistencies in tracking sheets related to building energy consumption data and recommends developing an evaluation plan for programs in parallel with their design and implementation. It suggests using HOT2000 energy consumption data instead of EnerGuide ratings for more accurate calculations and emphasizes the importance of collecting key variables early in the process.

ered. The two most important components of the plan are the evaluation methodology as well as the pre- and post-data required to apply the selected methodology. Ref.: 5725 55 Low Income Program Efficiency Nova Scotia Corporation 2011 Evalu...

AI summary The document discusses the evaluation methodology and data requirements for the Low Income Program under Efficiency Nova Scotia Corporation's 2011 Evaluation Report.

oving the program with better communication with the DA so that the OA can roughly inform people on when they could expect their work to be done. If the DA had a scheduling database and the OA had online access to it, it could be possible...

AI summary The document highlights the need for better communication between the Delivery Agent (DA) and the Office of the Auditor (OA) to improve participant experience and transparency. It also discusses the low installation rate of prescriptive measures and the limited impact of on-site visits in evaluating program effectiveness, with Econoler suggesting more focused evaluations on Direct Install products.

le window for electricity savings measures as well as other energy-saving measures. The first is funded by ratepayers and the second by taxpayers. 8 Implementing the EE measure will Each measure has its own deemed savings along with reduce...

AI summary The text discusses the implementation of energy efficiency (EE) measures and their funding sources, the impact of increasing participant numbers on program confidence, the role of specialized contractors in market transformation, and the evaluation of a low-income energy efficiency program.

2011 Sample size 55 62 70 1 56% 56% 43% 2 33 27 26 3 6 6 23 4 or more 6 10 9 Year round or Seasonal Home 2009 2010 2011 Sample size 70 Year round residence 100% Ref.: 5725 62 Low Income Program Efficiency Nova Scotia Corporation 2011 Evalu...

AI summary The 2011 Evaluation Report for the Low Income Program by Efficiency Nova Scotia Corporation highlights demographic data of respondents, showing that 84% are aged 45 or older, with a majority being female (67%). The report includes a table (Table 33) summarizing age and gender distribution.

Pay Electric Bills 2011 Sample size 70 Yes 100% Ref.: 5725 64 Low Income Program Efficiency Nova Scotia Corporation 2011 Evaluation Report APPENDIX IV - INTERVIEW GUIDE WITH PROGRAM MANAGER Process Evaluation Program Name: Low Income House...

AI summary This document is an evaluation report from 2011 focusing on the Low Income Household program managed by Efficiency Nova Scotia Corporation. It includes an interview guide with the program manager to assess the status of various recommendations and changes to the program, such as the name change from REAP and the inclusion of appliances like refrigerators and freezers.

program manual they are if they are of a certain age. If they are not included anymore, what is the reason? Q: Scope I are mainly envelope measure and Scope II are prescriptive measures. Correct? Ref.: 5725 65 Low Income Program Efficiency...

AI summary The text includes questions and references related to a low-income program evaluation report by Efficiency Nova Scotia Corporation. Topics include program scope, funding responsibilities, and the status of recommendations. There are also inquiries about energy audit processes and program modifications.

elivery agent who trains the energy auditors or NRCan? Q: IN the program objectives, the reduction of arrears on their electricity bill is one of them? Page 7 The logic model needs to be modified: 1. In the program activity line- there sho...

AI summary The text discusses modifications to a logic model for a low-income energy program, including training of delivery agents, audit processes, and referrals. It also references program name changes and qualifying measure updates over time.

e Household Program 4. And now, Low Income Homeowner Care to comment? Q: We understand that the qualifying measures have changed from last year, correct? Source Program Manual Page 3 C: It is not easy to read who does what in the introduct...

AI summary The text discusses feedback on the Low Income Homeowner Program, including suggestions for improving clarity in the program manual, concerns about budget management, and questions about protocols for replacing and disposing of CFLs. It also references an evaluation report and mentions the need for performance indicators and process evaluations.

formation? Is this for saturation purposes? Q: Do you have a protocol for disposal of CFLs? Page 16 C: All the protocols that have been added to the program manual are considered as good practice. Q: Refrigerators and Freezers: These two i...

AI summary The text contains a series of questions and comments related to program protocols, audit procedures, and program evaluation, including topics such as CFL disposal, appliance eligibility, audit naming conventions, and the shutdown of Conserve Nova Scotia in 2011. There are also references to program manuals, participation forms, and evaluation reports.

re the program partners how many are they and their roles so we can ask the proper questions when we interview them for the process evaluation. Q: Do you do a cost-effectiveness test post evaluation? Q: When the program was initially desig...

AI summary The text outlines a set of questions for a process evaluation of the Low-Income Households energy efficiency program, including inquiries about program partners, cost-effectiveness testing, evaluation plans, marketing strategies, and database usability. It also references an evaluation report and provides instructions for completing a questionnaire.

a score? Reason(s): Q3 – Did you receive any complaints from participants in the program? Yes What was (were) the complaint(s) about? No Don’t Know Refused Not applicable Ref.: 5725 71 Low Income Program Efficiency Nova Scotia Corporation...

AI summary The text presents a series of survey questions from an evaluation report on the Low Income Program by Efficiency Nova Scotia Corporation in 2011. Questions focus on participant complaints, ease of participation, program satisfaction, and suggestions for improvement. The report includes placeholders for responses and does not provide specific answers.

rtner: Score: Name of partner: Score: Name of partner: Score: Q10a – If any of your answers to Q8 was equal to or less than 8, would you care to share the reason or reasons for such a score? Q11 – Who provides you with leads for potential...

AI summary The document contains a series of questions aimed at gathering feedback on the Low Income Program and other related initiatives managed by Efficiency Nova Scotia Corporation. It explores issues such as program name changes, implementation challenges, complaints from partners, and barriers to program execution.

tion of the partner.) No Don’t know Q15a- What was the complaint about? Q16 – In your opinion, what are the main barriers to the implementation of that program by order of importance? Ref.: 5725 75 Low Income Program Efficiency Nova Scotia...

AI summary The document is an evaluation report and interview guide related to the Low Income Program by Efficiency Nova Scotia Corporation from 2011. It includes questions about program implementation barriers and participant expectations, emphasizing confidentiality and outreach processes.

applicable It was the same Program Administrator I had to deal with a new PA The transition went smoothly The transition caused some delays or adjustments Other, please comment Q2 - On a scale from 1 to 10 (where 1 is very bad and 10 is ex...

AI summary The text consists of survey questions and response options related to the Low Income Program under the Efficiency Nova Scotia Corporation's 2011 Evaluation Report. It asks about the Program Administrator's performance, participant satisfaction, complaints, and suggestions for improvement.

regard to the marketing and outreach activities to implement the program? Q 7a - If your answer to Q7 was equal to or less than 8, would you care to share the reason or reasons for such a score? Ref.: 5725 79 Low Income Program Efficiency...

AI summary The text consists of a series of questions from an evaluation report on the Low-Income Program by Efficiency Nova Scotia Corporation. It focuses on program implementation, including marketing, outreach, partner involvement, and evaluation frequency.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Q9b1- If you answered Too Few or Too Many, please comment: Q10- On a scale from 1 to 10 (where 1 is very bad and 10 is excellent), how would you rate your relationship with the othe...

AI summary The text contains survey questions from the 2011 Efficiency Nova Scotia Corporation Evaluation Report, focusing on program partner relationships, program name changes, and program modifications. It includes questions about leads, confusion in the market, and complaints from partners.

luation of your home and then installed or given you a variety of energy-saving measures such as light bulbs, appliances, insulation, or weather stripping. Do you recall participating in this program? 1. Yes [CONTINUE] No, I don’t remember...

AI summary This text outlines a survey process related to the Low Income Homeowners Program by Efficiency Nova Scotia Corporation. It includes prompts for respondents to recall participation in the program and asks about their experience and satisfaction with it.

3. (Trades certificate or diploma) 4. (College certificate or diploma) 5. (University certificate or diploma) 98. (Don’t know) 99. (Refused) D9. Which of the following income categories best describes your total annual household income bef...

AI summary The text includes survey questions about education levels and household income from 2010, followed by a reference to an evaluation report on the Low Income Program by Efficiency Nova Scotia Corporation and a report on the Performance Plus Program Impact and Process Evaluation 2011.

+1 (418) 692-4899 www.econoler.com PERFORMANCE PLUS PROGRAM IMPACT AND PROCESS EVALUATION 2011 EFFICIENCY NOVA SCOTIA CORPORATION Final Report February 20, 2012 Performance Plus Program Efficiency Nova Scotia Corporation 2011 Evaluation Re...

AI summary This document is the final evaluation report for the Performance Plus Program conducted by Efficiency Nova Scotia Corporation in 2011. It assesses the program's impact and processes, providing insights into its performance and effectiveness.

19 Table 15: Results of the EnerGuide Baseline Studies .......................................................................... 22 Table 16: Annual Energy Savings of the Prescriptive Measures ................................................

AI summary This report evaluates the Performance Plus program in 2011, based on interviews with the Program Manager and builders, on-site visits, and a survey of 70 participants, providing insights into the program's process and impact.

ore (93%). Suggestions for improving the program from homeowner participants included offering more information on the measures recommended and increasing program advertising. Program Energy Savings To calculate the net savings of the Perf...

AI summary The Performance Plus program's energy savings in 2011 were evaluated by Econoler, who adjusted the baseline EnerGuide rating and the savings per EnerGuide point based on simulation analyses and national DSM studies. Suggestions from homeowners included improving information and increasing program advertising.

ings evaluation, Econoler finally modified a number of energy savings per prescriptive measure used by ENSC, on the basis of national demand-side management (DSM) studies carried out in 2010 and 2011. In its net savings calculations, Econo...

AI summary The evaluation of the Performance Plus program found that free-ridership levels decreased from 79% in 2010 to 32% in 2011, while spillover effects were not significant. Market effects were estimated at 5%, leading to a net-to-gross ratio of 0.73. The program achieved net energy savings of 2.454 GWh and demand savings of 0.861 MW in 2011.

tio 0.73 The evaluation revealed that the Performance Plus program had generated net energy savings of 2.454 GWh and demand savings of 0.861 MW in 2011, as shown in the next table. Ref.: 5725 vii Performance Plus Program Efficiency Nova Sc...

AI summary The evaluation of the Performance Plus program in 2011 showed that it generated net energy savings of 2.454 GWh and demand savings of 0.861 MW. The results are based on gross savings adjusted for interactive effects.

acked Savings from ENSC 1.560 MW 1.560 MW 0.46 0.717 MW Evaluation Results 1.324 MW 1.180 MW 0.73 0.861 MW As per the last table, the evaluated net energy savings exceeded those tracked by ENSC by more than 80 percent. This is mainly due t...

AI summary The evaluated net energy savings exceeded those tracked by ENSC by more than 80 percent, largely due to an adjustment in the house rating baseline value and a higher net-to-gross ratio. Econoler recommends optimizing specific aspects of the program, finding that it works well overall.

for all ENSC programs in the overall executive summary of the 2011 DSM programs, the Evaluator has the following specific recommendations that are aimed at optimizing specific aspects of the program: PP-R1. Increase the number of in-depth...

AI summary The Evaluator recommends increasing the number of in-depth interviews with home builders to better assess the impact of ENSC programs on market effects, as the current sample size was too small to draw definitive conclusions.

he program aimed to achieve net electricity savings of 2.60 GWh and demand savings of 0.79 MW. For reference purposes, the Performance Plus program generated net energy savings of 0.68 GWh in 2010. Ref.: 5725 2 Performance Plus Program Eff...

AI summary The Performance Plus program aimed to achieve electricity savings of 2.60 GWh and demand savings of 0.79 MW. A 2011 evaluation report outlines the program's logic model and methodology, including the analysis of program documentation and the use of research tools like interviews and surveys.

m Information The first task in the process evaluation of the Performance Plus program was the analysis of the program documentation. At this stage, all available program information was reviewed. Ref.: 5725 4 Performance Plus Program Effi...

AI summary The evaluation of the Performance Plus program began with a review of program documentation and an in-depth interview with the Program Manager, covering topics such as program justification, savings calculations, and marketing strategies. Additional interviews with program partners, including builders, were conducted as part of the evaluation process.

rence purposes, the protocol used by the Evaluator during the in-depth interviews with PMs is presented in Appendix III. 2.2.3 In-Depth Interviews with Program Partners Interviews with Builders In November, 10 in-depth interviews were cond...

AI summary The evaluation of the Performance Plus Program involved in-depth interviews with program partners, including builders, to assess free-ridership and market effects. Interviews were conducted with both participant and non-participant builders to understand the influence of the program on the implementation of high-efficiency measures.

Efficiency Nova Scotia Corporation 2011 Evaluation Report 2.2.4 On-Site Visits In October, two on-site visits were conducted at new houses in which measures from the Performance Plus program had been implemented. The visits were conducted...

AI summary This section of the 2011 Evaluation Report discusses on-site visits conducted to validate the Performance Plus program's implementation and a participant survey to assess program features such as participant awareness, involvement, motivations, and satisfaction. These activities were carried out by Econoler's subcontractors.

the building decisions; > participant motivations, concerns and barriers; > satisfaction with the program; > spillover and free-ridership; and > impact of program measures. The demographic profile of survey respondents is shown in Appendix...

AI summary The document discusses the evaluation of the Performance Plus Program by Efficiency Nova Scotia Corporation, focusing on survey data from 2009 to 2011. It outlines demographic profiles of participants, sample sizes, and sampling errors at a 90% confidence level. The evaluation includes participant satisfaction, motivations, and program impacts.

7013 70 ±9.3% 3 The program population for the 2011 survey was 195 participants at the time of establishing the sample for the survey. Ref.: 5725 7 Performance Plus Program Efficiency Nova Scotia Corporation 2011 Evaluation Report 3 PROCES...

AI summary The 2011 evaluation report for the Performance Plus program conducted by Efficiency Nova Scotia Corporation includes a participant survey and analysis of the program tracking sheet. The report notes that no major changes occurred since the 2010 evaluation, but a survey was conducted to assess program awareness, barriers, and participant satisfaction.

the Demand Side Management Data System (DSMDS). At the time of writing this report, ENSC was working on the DSMDS to make it more accessible and ensure that the information contained was up to date. Ref.: 5725 8 Performance Plus Program Ef...

AI summary The report discusses the Demand Side Management Data System (DSMDS) and its development by ENSC. It also addresses the Performance Plus Program evaluation, highlighting the need for improvements in the tracking sheet for consistency and efficiency in program evaluation.

nspecified source) 1 Nova Scotia government website 1 Conserve Nova Scotia website 1 Previous experience building with EnerGuide 1 1 Other (unspecified) 16 Don’t know/refused 1 5 1 Multiple responses Ref.: 5725 12 Performance Plus Program...

AI summary The Performance Plus Program evaluation report indicates that 76% of respondents personally participated in the decision to join the program, and 74% were involved in choosing energy efficiency measures. This highlights strong homeowner involvement, though builders also play a significant role in decision making.

revious findings, while just over one in 10 were not involved or bought their home after it was completed (13%). Table 6: Stage of Owner Involvement in Home Energy Efficiency Decision When Owner Became Involved 2009 (#) 2010 (%) 2011 (%) S...

AI summary The table outlines the stage at which homeowners became involved in home energy efficiency decisions, showing that most became involved during the initial planning/design stage. The report discusses participation motivations and barriers in the Performance Plus Program.

14 4 4 To help save energy (not specified whether 5 19 4 for cost, environment) I was generally interested in energy efficiency 5 4 and renewable energy To get expert advice on what measures to implement/how to make home more energy 2 effi...

AI summary The Performance Plus Program evaluation report indicates that very few participants (6%) had concerns prior to participation, with issues related to eligibility, familiarity with measures, and perceived complexity of the process.

7 4 Don’t know / refused 3 28 16 3.4.6 Satisfaction with Program There is a high level of satisfaction with the program, with nearly all respondents rating their overall experience as very satisfied or satisfied (91%). Respondents were hig...

AI summary The Performance Plus Program has a high level of satisfaction, with 91% of respondents reporting very satisfied or satisfied. Satisfaction was particularly high with the final energy audit, house plan reviews, and scheduling. Lower satisfaction was noted with rebates and energy efficiency recommendations, though still positive. A few respondents expressed dissatisfaction with rebate amounts and the duration of the final audit.

ut also that it had had a positive influence on homeowners and on their energy efficiency behaviors. The participating builders were delighted to be part of the program and wished for it to continue. 3.4.7 Participant Recommendations for I...

AI summary The majority of participants in the Performance Plus Program did not offer recommendations for improvement, but those who did suggested better communication and faster delivery of review results. Participants emphasized the need for more information on rebates and better advertising of the program.

tion is aimed at determining the gross and net savings of the program for 2011. Both energy and demand savings were considered in this evaluation. To do so, Econoler analyzed the following parameters: > outcomes from HOT2000 simulations pe...

AI summary The evaluation of the Performance Plus program in 2011 considered both energy and demand savings, using data from HOT2000 simulations and the EEH program. Due to complications with obtaining simulation files from NRCan, EEH program savings data was used instead. A participant survey and builder interviews were used to calculate the net-to-gross ratio, including free-ridership, internal spillover, and market effects.

ulate the net-to-gross ratio for this program, including free-ridership, internal spillover and market effects. The NTGR established was used to calculate program net savings. 4.2 GROSS SAVINGS As mentioned previously, the 2011 evaluation...

AI summary The document discusses the calculation of net-to-gross ratio for the Performance Plus program, including free-ridership, internal spillover, and market effects. Gross savings are calculated using parameters such as incremental energy savings per EnerGuide point and energy-to-demand ratio for demand savings.

code, which was put into force in January 2010. 8 ACH50: air changes per hour at a pressure difference of 50 Pascals. This is the standard SI unit for reporting the blower- door test results. Ref.: 5725 22 Performance Plus Program Efficien...

AI summary The evaluation report highlights a shortcoming in the Sustainable Housing study due to a low sample size and notes that ENSC used a higher baseline EnerGuide rating of 78. ENSC calculates energy savings based on EnerGuide points, using a coefficient of 1,032 kWh per point, but only for homes with electricity as the main heat source.

a result, this last percentage was used to lower the evaluated average savings per EnerGuide point (1,089 kWh) previously defined. This yielded a final value of 817 kWh of savings per EnerGuide point. With regard to the fact that ENSC clai...

AI summary ENSC's assumption of 100% savings for houses with electric heating and no savings for others may overestimate program impacts. Econoler evaluated this using tracking data, finding that only a small number of non-electric-heated homes had secondary electric heating systems. ENSC also calculated prescriptive measure savings from the 2010 Performance Plus program evaluation.

rescriptive measures that are not taken into account in HOT2000 simulations. The savings values used by ENSC for this calculation are taken from the 2010 Performance Plus program evaluation report. 9 Econoler conducted a billing analysis o...

AI summary The evaluation of the Performance Plus program by Econoler identified that five prescriptive measures were not accounted for in HOT2000 simulations. These measures include drain water heat recovery systems, electric hot water heater pipe insulation, and programmable thermostats. Additionally, billing data from six projects was found to be unreliable or unusable.

ghts the seven prescriptive measures for which Econoler took into account additional savings per measure. The savings values of ENSC along with those of Econoler are also included in the table below. Table 16: Annual Energy Savings of the...

AI summary The text discusses the annual energy savings of various prescriptive measures, comparing the savings values calculated by ENSC and Econoler. It mentions the evaluation process conducted by Econoler as part of the EEH program and refers to a detailed evaluation report.

l of the above annual savings values as part of the EEH program evaluation process. The corresponding evaluation report presents all details of this analysis. 4.2.2 Demand Savings Calculation The demand savings of the Performance Plus prog...

AI summary The Performance Plus program's demand savings are calculated using an energy-to-demand ratio of 3.77 GWh/MW, confirmed by ENSC, and additional savings from ETS units installed in residential buildings. ETS systems reduce demand by storing heat during off-peak hours and releasing it during on-peak hours. Different ETS systems provide varying levels of demand savings.

Efficiency Nova Scotia Corporation 2011 Evaluation Report In the 2011 EEH program evaluation report, Econoler assessed the validity of these two demand savings values (10 kW and 45 kW). Upon completion of this evaluation, Econoler calculat...

AI summary The 2011 EEH program evaluation report by Econoler assessed demand savings values for ETS systems and revised gross savings calculations using a line loss factor provided by Nova Scotia Power. The report outlines energy and demand savings based on EnerGuide ratings and prescriptive measures.

2011 Evaluation Report Table 17: Evaluation Results – Gross Energy and Demand Savings

AI summary The 2011 Evaluation Report includes Table 17, which presents evaluation results related to gross energy and demand savings. The table likely provides data on the effectiveness of energy efficiency programs or initiatives in reducing energy consumption and demand.

questions designed to measure the influence of the program on participants’ decision to implement program-eligible energy efficiency measures. These questions were included in the participant survey. This section presents the methodology u...

AI summary This section discusses the methodology for calculating the Net-to-Gross Ratio (NTGR) for the Performance Plus Program, focusing on free-ridership, internal spillover, and market effects. It describes how survey responses are used to assess these distortion effects.

level of efficiency if they had not participated in the program; and > the influence of the program on builders’ decision to build houses reaching an EnerGuide rating of 83 or higher. Each group of questions was transposed into a level of...

AI summary The text discusses the methodology used to estimate free-ridership levels in the Performance Plus Program, including the use of a 0 to 10 scoring system and the consideration of multiple factors influencing energy efficiency decisions, rather than focusing only on program importance.

1) between both evaluations. This difference in builder free- ridership level could be due in part to the enhancements made to the approach to evaluating free- ridership. 4.4.2 Internal Spillover The participant survey was also used for as...

AI summary The document discusses the evaluation of internal spillover in the Performance Plus program, noting that only six participants implemented additional energy-efficient products after previous participation, indicating a very low level of internal spillover.

plemented (or are currently implementing) additional energy-efficient products (CFLs) in their house, following their previous participation in the program. These additional energy-efficient products Ref.: 5725 34 Performance Plus Program...

AI summary The Performance Plus Program by Efficiency Nova Scotia Corporation is evaluated for its energy savings and market effects. The program's energy savings are reported as 7.8 MWh, or 0.2% of total gross savings, with no spillover effects considered. Market effects may occur when builders implement energy efficiency measures independently of the program.

on various energy efficiency measures. Consequently, market effects can occur when a builder decides to implement energy efficiency measures in new constructions without participating in the program. Ten in-depth builder interviews were co...

AI summary The document discusses a study on market effects of energy efficiency programs, based on interviews with builders. It found that 5% of market effects were attributed to the program, with participating builders showing lower effects (1.7%) compared to non-participating ones (8%).

g equivalent weight to both market effect percentages found; i.e., from participating and non-participating builder interviews. The final market effects were therefore evaluated at 5 percent for 2011. In light of the above, Econoler recomm...

AI summary The evaluation of the Performance Plus program in 2011 found that market effects were estimated at 5%, based on interviews with participating and non-participating builders. Econoler recommended increasing the number of interviews in future evaluations to better capture market effects. Net savings were calculated using the interactive effects factors and the Net-to-Gross Ratio (NTGR).

7 0.001 0.026 0.002 0 0.036 0 0.122 N/A N/A N/A (GWh) – at Meter Line Loss Factor 1.105 1.105 1.105 1.105 1.105 1.105 1.105 1.105 N/A N/A N/A Total Net Energy Savings 2.505 0.001 0.029 0.002 0 0.040 0 0.134 N/A N/A N/A (GWh) – at Generator...

AI summary The document presents data on energy savings and demand reductions related to the Performance Plus Program by Efficiency Nova Scotia Corporation, including line loss factors and net-to-gross ratios, and references an evaluation report from 2011.

Efficiency Nova Scotia Corporation 2011 Evaluation Report The Evaluator compared the net energy savings values calculated in the previous table with the Performance Plus program tracked net savings for 2011. The next table details the fina...

AI summary The 2011 Evaluation Report compares tracked and evaluated savings from the Performance Plus program. Tracked energy savings were 2.948 GWh, while evaluated savings were 3.791 GWh. Tracked demand savings were 1.560 MW, compared to evaluated demand savings of 1.324 MW. The report highlights differences in gross and net savings with interactive effects and NTGR considerations.

acked Savings from ENSC 1.560 MW 1.560 MW 0.46 0.717 MW Evaluation Results 1.324 MW 1.180 MW 0.73 0.861 MW As per the last table, the evaluated net energy savings exceeded those tracked by ENSC by more than 80 percent. This is mainly due t...

AI summary The evaluation of the Performance Plus Program by ENSC shows that net energy savings exceeded initial tracking by over 80%, primarily due to adjustments in the house rating baseline and the inclusion of energy and demand savings from efficient lighting. The Net-to-Gross Ratio (NTGR) increased from 0.46 to 0.73, reflecting changes in free-rider evaluation approaches. Demand savings realization was lower at 120% due to adjustments in peak demand savings calculations.

cy concepts and potential measures for reducing energy consumption (such as the free guide “Keeping the Heat In”). Since residential participants often have a low understanding of the proposed energy efficiency measures, such informational...

AI summary The document discusses the importance of improving communication in energy efficiency programs, emphasizing the need for better information on recommended measures and increasing program advertising. It highlights that participants often have a low understanding of energy efficiency measures and that program marketing should focus on energy bill savings and rebates as key motivators for participation.

reasing the number of interviews with participating builders in future evaluations to have a better chance of capturing potentially more significant market effects. Ref.: 5725 Performance Plus Program Efficiency Nova Scotia Corporation 201...

AI summary The document discusses the demographics of respondents in the Performance Plus Program evaluation, noting that most reside in detached single-family homes, with a smaller percentage in mobile homes or house trailers.

43 70 Male 8 63% 69% Female 2 37 31 Ref.: 5725 Performance Plus Program Efficiency Nova Scotia Corporation 2011 Evaluation Report APPENDIX III - INTERVIEW GUIDE WITH PROGRAM MANAGER Process Evaluation Program Name: Performance Plus (New Ho...

AI summary The text discusses the Performance Plus Program evaluation report from 2011, including interview questions with the program manager regarding the program's status, free-ridership, baseline standards for new construction, and the status of various recommendations.

e Guide Q: On the Web site we see only incentives to electricity measures. In the program manual we have both incentives coming from rate-payer funds and coming from provincial funds, Why is that? Ref.: 5725 Performance Plus Program Effici...

AI summary The document contains questions and clarifications regarding the Performance Plus Program, including the source of funding, program name changes, and the involvement of multiple stakeholders. Questions focus on incentives, program implementation, and data collection practices.

collect performance indicators (PI) for all those activities? Page 11 – table 4.3.1 Q: Do you use deemed savings for the measures described in pages 5 to 8? Or do you calculate them individually? Q: If they are deemed savings do you have a...

AI summary The text discusses questions and comments regarding the Performance Plus Program, including the use of deemed savings, the need for updated variables, and the adequacy of program procedures. It also highlights issues with the participant form, such as the need for clarity, revision dates, and the inclusion of utility names.

who signs the form, we need to have a box check to identify who is signing this form, the builder or the owner in case we need some clarification or contact that person for evaluation purposes. Assignment of rebate to builder Insert a form...

AI summary The document outlines questions related to the Performance Plus Program by Efficiency Nova Scotia Corporation, including delivery agents, free-ridership, barriers, evaluation processes, and database usability. It seeks insights for process interviews and program evaluation.

Efficiency Nova Scotia Corporation 2011 Evaluation Report APPENDIX IV - INTERVIEW GUIDES WITH BUILDERS PARTICIPATING BUILDER INTERVIEW GUIDE ENSC PERFORMANCE PLUS PROGRAM October 27, 2011 Hello, may I please speak with _? 1. Yes [GO TO INT...

AI summary This document is an interview guide used by Efficiency Nova Scotia Corporation (ENSC) for evaluating the Performance Plus program. It outlines the process for contacting participating builders and gathering information about their involvement in the program during 2011.

e of 2011. Would that person be you? _Person responsible available [CONTINUE TO I2] _Person responsible currently unavailable [ARRANGE CALL BACK WITH THE RIGHT PERSON] Ref.: 5725 Performance Plus Program Efficiency Nova Scotia Corporation...

AI summary The text outlines an interview process for gathering information about a firm's residential construction activities in Nova Scotia in 2011, including the number of units built and their types. The process includes confidentiality and recording notices, as well as instructions for handling unavailability or refusal to participate.

u built so far in 2011 in Nova Scotia? (or try to get a percentage per type) [IF RESPONDENT FINDS IT DIFFICULT TO GIVE AN EXACT NUMBER, ASK FOR A PERCENTAGE OF ANSWER TO A1] Ref.: 5725 Performance Plus Program Efficiency Nova Scotia Corpor...

AI summary The text is part of an evaluation report for the Performance Plus Program by Efficiency Nova Scotia Corporation in 2011. It includes questions about the number of residential units built under the program and the measures implemented. It also addresses free-ridership by asking whether the same number of energy-efficient homes would have been built without the program's rebate.

es built under the program, how many houses with an EnerGuide rating of 83 would you have built if you had not participated in the Performance Plus program? Enter number: Ref.: 5725 Performance Plus Program Efficiency Nova Scotia Corporati...

AI summary The text asks participants in the Performance Plus program to estimate how many houses with an EnerGuide rating of 83 they would have built without the program, and whether they would have installed efficient HVAC, lighting, and windows/doors to achieve the same rating.

th the exact same level of efficiency in the houses that you built, reaching the same EnerGuide rating of 83 or higher? Scale: Don’t Know Refused Ref.: 5725 Performance Plus Program Efficiency Nova Scotia Corporation 2011 Evaluation Report...

AI summary The text asks builders about their use of the Performance Plus program and its impact on achieving high EnerGuide ratings in homes. It includes questions on whether they would have installed the same level of insulation without the program and the importance of the program and other factors in their decision-making.

Scale Don’t Know Refused information c. Feedback received from the Scale Don’t Know Refused review of home plans d. The EnerGuide label and Scale Don’t Know Refused designation itself e. Previous experience with the Performance Plus progra...

AI summary The text outlines a series of questions from an evaluation report on the Performance Plus program, focusing on market effects and participant behavior. It asks about energy-efficient home construction, implementation of program measures, rebate decisions, and the likelihood of building without the program. The report also seeks additional feedback from participants.

. Do you have anything to add regarding the program, your participation in the program or this interview? Thank you very much for your collaboration and the time you took to answer our questions. Ref.: 5725 Performance Plus Program Efficie...

AI summary This document outlines an interview guide used by Efficiency Nova Scotia Corporation to evaluate the Performance Plus program, also known as the 'New Houses' program. It includes questions for non-participating builders to gather their knowledge and perceptions of the program.

s Canada Website) 8. (Nova Scotia Home Builders Association’s member list) 9. (The Internet) 10. (Radio Ad) 11. (Newspaper/Renovation Guide Ad or Story) Ref.: 5725 Performance Plus Program Efficiency Nova Scotia Corporation 2011 Evaluation...

AI summary The text outlines various channels through which participants learned about the Performance Plus Program, including online resources, media, and word of mouth. It also asks participants to identify the most important reason they joined the program.

g part in the program? 1. Yes 2. No 98. (Don’t know) 99. (Refused) [IF P4 = 1] P5. What were those concerns? [DO NOT READ. ACCEPT ALL RESPONSES] 1. (That my “bottom line” would suffer/I wouldn’t recover the cost of installing energy effici...

AI summary The text includes survey questions about participation and satisfaction with the Performance Plus program, focusing on concerns about costs, effectiveness, and overall experience. It also references a report from Efficiency Nova Scotia Corporation on the 2011 evaluation of the program.

1 2 3 4 5 98/99 c. The report you received about the house plan’s current energy efficiency 1 2 3 4 5 98/99 Ref.: 5725 Performance Plus Program Efficiency Nova Scotia Corporation 2011 Evaluation Report d. Recommendations for energy efficie...

AI summary This document is an evaluation report for the Performance Plus Program by Efficiency Nova Scotia Corporation from 2011. It outlines the process for reviewing house plans, including energy efficiency measures, final audits, and rebate provisions. It also includes a survey question about dissatisfaction with the initial review of house plans.

4. (Not enough items covered by first review of the house plans) 5. (Didn’t like the recommendations) 96. (Other) [SPECIFY _]) 98. (Don’t know) S6. Were there any other reasons you were dissatisfied with the energy efficiency review of the...

AI summary The text includes survey questions related to dissatisfaction with energy efficiency reviews and final energy audits, as well as a question about homeowners' decisions to build or buy energy-efficient homes before participating in the Performance Plus program.

80. Did you decide to build or buy a house with a high level of energy efficiency, reaching an EnerGuide rating of 83 or higher, before participating in the Performance Plus program? 1. Yes 2. No 98. (Don’t know) 99. (Refused) [IF FR1=YES]...

AI summary The text includes survey questions about participation in the Performance Plus program, specifically whether respondents had already decided to build or buy a highly energy-efficient home before joining the program. It also asks about the likelihood of taking similar actions without the program. The document references an evaluation report from Efficiency Nova Scotia Corporation from 2011.

y Would Have Paid.” PROBE FOR SPECIFIC RESPONSE – DO NOT ACCEPT A RANGE _ Response 97. (Did not receive that rebate) 98. (Don’t Know) 99. (Refused) FR4. Next, I’m going to ask you to rate the importance of the Performance Plus program as w...

AI summary The text refers to the Performance Plus program by Efficiency Nova Scotia Corporation and asks respondents to rate the importance of various factors in their decision to build or buy a house with an EnerGuide rating of 83 or higher. The evaluation is part of a 2011 report.

1. Yes 2. No 98. (Don’t know) SO4c. Lighting equipment? 1. Yes 2. No 98. (Don’t know) SO4d. Other energy-efficient measures? 1. Yes [Please specify _] 2. No 98. (Don’t know) [IF SO3 = 2] Ref.: 5725 Performance Plus Program Efficiency Nova...

AI summary The text includes survey questions from an evaluation report of the Performance Plus Program by Efficiency Nova Scotia Corporation, asking participants about the influence of the program on their decision to implement energy-efficient measures and the impact of these measures on comfort and energy bills.

f you had not installed the energy efficiency measures, do you think the energy efficiency measures installed through the program have resulted in a significantly lower energy bills? 1. Yes 2. No 98. (Don’t know) 99. (Refused) Section RU -...

AI summary The text includes survey questions about the impact of energy efficiency measures on energy bills and homeowner receptivity to upgrades not covered by the Performance Plus Program. It also asks for recommendations to improve the program.

6. (Advertise the program more or in a better way) 7. (No recommendation) 96. (Other [SPECIFY _]) 97. (Don’t know) 98. (Refused) R2. Would a figure illustrating the various steps to follow in order to participate in the Performance Plus Pr...

AI summary The text includes survey questions related to program participation, specifically the Performance Plus Program, and demographic characteristics of home buyers. It focuses on gathering feedback on program advertising, participation facilitation, and home occupancy.

. (Refused) D2. How many bedrooms are in your home? [98=DK; Enter zero for a studio apartment with no bedrooms] D5. Is your home occupied year round, or is it a seasonal home? 1. Year round residence 2. Seasonal / vacation home 96. (Other...

AI summary The text includes survey questions about household characteristics, such as the number of bedrooms, occupancy status, number of residents, age group, and education level of the head of household, as well as income categories. These questions are part of a data collection process likely for program evaluation.

h of the following income categories best describes your total annual household income before taxes in 2010? Stop me when I reach the right category. [READ LIST; SELECT ONE RESPONSE] 1. Less than $15,000 2. $15,000 - $24,999 3. $25,000 - $...

AI summary The text includes a survey question about household income and gender, followed by a section from an evaluation report on the Performance Plus Program by Efficiency Nova Scotia Corporation, discussing an algorithm for free-ridership calculation and inconsistency tests.

2011 Evaluation Report Subsequently, the final free-ridership level calculated for each participant was submitted to two inconsistency tests: > The first inconsistency test consisted in verifying if (FR2a - FR2b) ≥ 30%. In that case, the p...

AI summary The 2011 Evaluation Report discusses the process of calculating free-ridership levels for participants in the Business Energy Rebates Program. It outlines two inconsistency tests applied to ensure consistency in responses and adjusts free-ridership levels accordingly. The final free-ridership level is determined as a weighted average of adjusted values.

ally, a participant process flow chart was developed by ENSC in order to make the program participation procedures clearer. The program aimed to achieve net electricity savings of 21.80 GWh in 2011. KEY FINDINGS The 2011 evaluation of the...

AI summary The 2011 evaluation of the Business Energy Rebates (BER) program showed it is well designed with good potential for success. Participant numbers increased significantly from 13 to 106, and net energy savings rose from 0.503 GWh to 7.002 GWh. Contractors were a key source of program awareness, and the ENSC website was effective in promoting the program.

lent communication tool for the program. Word of mouth was also mentioned as an important source of awareness, which should be considered as a strong indicator of program satisfaction. Satisfaction Satisfaction towards the program is high...

AI summary The Business Energy Rebates (BER) program has high participant satisfaction, with many expressing contentment with the program's communication and effectiveness. Recommendations for improvement include better marketing and increased customer interaction. Program energy savings were calculated by Econoler, accounting for free-ridership and internal spillover effects, resulting in a 17.6% free-ridership rate and 0.2% spillover rate.

and internal spillover measured as part of the participant survey. Through this approach, a free-ridership level of 17.6 percent was captured, while a spillover level of 0.2 percent was identified. Ref.: 5725 vi Business Energy Rebates Pro...

AI summary The Business Energy Rebates (BER) program evaluation found a free-ridership level of 17.6% and a spillover level of 0.2%. The program achieved net energy savings of 7.002 GWh and demand savings of 1.419 MW at the generator in 2011, with a net-to-gross ratio of 0.83.

, information on the heating source and the use of air conditioning should be collected during the surveys with C&I customers to better estimate the interactive effects. Ref.: 5725 viii Business Energy Rebates Program Efficiency Nova Scoti...

AI summary The document discusses the need to collect information on heating sources and air conditioning use during customer surveys to better estimate interactive effects. It also mentions the need to increase on-site visits for the Business Energy Rebates Program to ensure sufficient data collection for all equipment categories.

L The program logic model below shows the causal links between program activities and the changes expected in the market. Figure 1: Business Energy Rebates Program Logic Model Ref.: 5725 2 Business Energy Rebates Program Efficiency Nova Sc...

AI summary The document outlines the methodology used in the 2011 evaluation of the Business Energy Rebates (BER) program, including the analysis of program documentation and an in-depth interview with the program manager. It references the Efficiency Nova Scotia Corporation (ENSC) and the program logic model.

ned primarily from the following four sources: > ENSC website; > 2010 evaluation report; > program manual; > tracking sheet. 2.2.2 In-Depth Interview with Program Manager Econoler staff conducted one interview in September with the Program...

AI summary The evaluation of the Business Energy Rebates program involved reviewing documentation, conducting interviews with the Program Manager, on-site visits to verify implemented measures, and surveying 43 participants. The process aimed to assess program effectiveness, barriers, and participant experiences.

ates, Inc. (CRA), from its offices in Halifax, NS. The interviews were conducted in October utilizing computer-assisted telephone interviewing (CATI). The average length of the survey was 18 minutes. Ref.: 5725 4 Business Energy Rebates Pr...

AI summary The Business Energy Rebates Program evaluation report discusses a participant survey conducted in 2010 and 2011 to assess program participation, awareness, motivations, and satisfaction. The survey used computer-assisted telephone interviews and included a sample size and sampling error analysis.

on 2011 Evaluation Report 3 PROCESS EVALUATION 3.1 OBJECTIVE AND APPROACH OF THE PROCESS EVALUATION The process evaluation conducted on the BER program focuses on ENSC’s objective, which is “assessing the effectiveness of the program desig...

AI summary The 2011 Evaluation Report discusses the process evaluation of the Business Energy Rebates (BER) program, focusing on assessing the effectiveness of program design and delivery. The evaluation was conducted through interviews with the Program Manager and telephone surveys with participants. The report also examines the content of the BER program manual, which serves as an essential tool for staff and evaluators.

inspected. - The scoring mechanism to calculate the free-ridership percentage from the three questions included in the application form should be documented in the program manual. Ref.: 5725 7 Business Energy Rebates Program Efficiency Nov...

AI summary The document discusses the need to document the scoring mechanism for calculating free-ridership percentage in the Business Energy Rebates Program and the importance of refining and disseminating marketing plans. It emphasizes the need for program manuals to include parameters for estimating program objectives and performance indicators for monitoring and evaluation.

year of activities and be included in the program manual. For each activity, the plans should identify the performance indicators to be collected for monitoring and evaluation purposes. > Complete the program manual to keep track of change...

AI summary The document discusses the need to update and standardize the program manual for the Business Energy Rebates (BER) program, including performance indicators for monitoring and evaluation. It also mentions the review of the BER program tracking sheet and the use of online documents to validate project details.

ne database). However, for certain projects, online documents were consulted to obtain and validate details on the measures installed, such as the number or type of product and the hours of operation. In general, the tracking sheet is usef...

AI summary The tracking sheet used for the Business Energy Rebates Program provides essential program administration data but lacks sufficient detail to fully evaluate energy savings or validate calculations. Improvements are recommended to enhance its usefulness for program monitoring and evaluation.

Efficiency Nova Scotia Corporation 2011 Evaluation Report The tracking sheet presents information in two separate sheets: one lists participant information and the other lists measure details. Each project has a unique identification numbe...

AI summary The 2011 Evaluation Report discusses the structure and limitations of the tracking sheet used for Efficiency Nova Scotia Corporation's program. It highlights issues with incomplete data in the measure detail sheet, which hinder the validation of savings calculations due to missing information and the combination of values into a single cell.

required for savings calculations. As it is featured now, the information in that cell does not allow the Evaluator to systematically validate the savings calculations by reproducing that calculation. The number of products, their characte...

AI summary The document highlights issues with the current tracking sheet used for savings calculations in energy efficiency programs, noting that it lacks systematic validation capabilities. It mentions that product details and standard values are used by program managers, and that some methodologies are based on Efficiency Vermont and US-EPA studies. Recommendations are made for adjustments to improve validation and consistency.

tors and Drives category is identified in three different ways. This will facilitate the site sampling process and the savings validation once a systematic validation can be conducted. Ref.: 5725 10 Business Energy Rebates Program Efficien...

AI summary The Business Energy Rebates Program, managed by Efficiency Nova Scotia Corporation, has seen significant growth in participation, with 106 participants in 2011 compared to 13 in the first year. The program was upgraded with streamlined application processes, market push strategies, and free-rider screening. Econoler provided recommendations for further improvements.

process flow chart was also developed by ENSC in order to make the program participation procedures clearer. However, Econoler has the following recommendations regarding program design and delivery: > Develop an evaluation plan in paralle...

AI summary Econoler recommends developing an evaluation plan alongside program design, monitoring application processing delays, and informing participants about expected savings from the Business Energy Rebates Program. These measures aim to improve program rigor and customer satisfaction.

re negatively by participants from similar programs. Be that as it may, the results obtained by ENSC are rather positive. Table 14: Satisfaction with BER Program Aspect of Program n 2010 (#) n 2011 (%) Program overall 11 8 42 91% Interacti...

AI summary The evaluation report highlights high satisfaction levels with the Business Energy Rebates (BER) program, with over 80% of participants expressing satisfaction with various aspects such as program overall, interactions with staff, and eligibility confirmation. Suggestions for improvement include more information sessions, better marketing, and improved communication between customers and program staff.

rporation 2011 Evaluation Report 4 IMPACT EVALUATION 4.1 OBJECTIVE AND APPROACH OF THE IMPACT EVALUATION The impact evaluation is aimed at determining the gross and net savings of the program for 2011. Both energy and demand savings were c...

AI summary The impact evaluation for 2011 assesses the program's energy and demand savings by analyzing factors such as savings methodology, installation rates, and free-ridership. It involved on-site visits, participant surveys, and interviews to verify data and establish adjustment ratios for energy savings calculations.

n and interactive effects affecting program demand and energy savings. All of these activities were used to establish an adjustment ratio for the gross energy savings calculated in the tracking sheet. The participant surveys provided infor...

AI summary The document discusses the calculation of the net-to-gross ratio (NTGR) for the Business Energy Rebates Program, incorporating factors like free-ridership and internal spillover. It also outlines the sampling methodology used for on-site visits based on the tracking sheet project list from 2011.

site visits conducted represented a total reduction of 19.33 kW, or 1.9 percent of the total demand savings for lighting products. This reduction was applied to the total tracked demand savings value. The hours of operation collected for e...

AI summary The evaluation of the Business Energy Rebates Program found that eight on-site visits for lighting products resulted in a 1.9% reduction in demand savings and a 0.9% reduction in energy savings. The evaluator recommends increasing the number of on-site visits to improve the accuracy of savings adjustments for this category of measures.

o be noted that since only one on-site visit was conducted for this category, and considering the unexpected nature of the findings, no further adjustment was applied to savings for the HVAC category. The Evaluator recommends that the PM c...

AI summary The evaluation report highlights the need for the Program Manager (PM) to confirm equipment usage with participants before using default full load hours to avoid overestimating savings. It also recommends increasing on-site visits for HVAC and motor/drives measures to improve accuracy in savings calculations. A commissioning factor was not applied due to lack of evidence that commissioning occurred.

Efficiency Nova Scotia Corporation 2011 Evaluation Report conducted, savings were calculated using a load profile approach and were compared with the savings in the tracking sheet. Such an approach allows considering unique site conditions...

AI summary The report discusses adjustments to energy and demand savings calculations for motor and drives measures, resulting in a 0.9% increase in demand savings and an 11.9% decrease in energy savings. It also highlights the need for more on-site visits for these measures.

nd at 1.710 MW, respectively. 8 ADS ASSOCIÉS, “Évaluations des effets énergétiques combinés des mesures d’économies d’énergie – résidence unifamiliale,” report presented to Hydro-Québec, 1992. Ref.: 5725 32 Business Energy Rebates Efficien...

AI summary This section discusses the methodology used to evaluate the Net-to-Gross Ratio (NTGR) for the Business Energy Rebates (BER) program. It focuses on identifying free-ridership and internal spillover effects, which are used to calculate the NTGR using a specific formula. ENSC began screening participants for free-ridership in 2011.

the complex nature of real-world decision making and helps ensure that all non-program influences are considered in the free-ridership assessment in addition to program influences. Ref.: 5725 33 Business Energy Rebates Efficiency Nova Scot...

AI summary The document discusses the evaluation of the Business Energy Rebates program, highlighting a reduction in free-ridership from 46% in 2010 to 17.6% in 2011, potentially due to stricter screening processes. It also mentions internal spillover effects measured through participant surveys.

nd installed additional energy-efficient products following their previous participation in the program. Additional questions were used to verify the eligibility of the additional purchases by asking: > the date of the purchase to ensure t...

AI summary The Business Energy Rebates program conducted follow-up calls to verify participant eligibility and assess the program's influence on additional purchases. Product specifications were collected to estimate energy savings, and internal spillover was calculated using a specific equation.

Efficiency Nova Scotia Corporation 2011 Evaluation Report The 2010 program evaluation revealed no internal spillover. This year, a new approach using in-depth interviews with participants was used to capture potential internal spillover. N...

AI summary The 2011 evaluation of Efficiency Nova Scotia Corporation's program found minimal internal spillover, with only one participant purchasing additional energy-efficient products. Spillover accounted for 0.2% of total energy savings. The net-to-gross ratio (NTGR) was estimated at 0.83, used to calculate net savings for the program.

1.977 MW 1.977 MW 1.977 MW 0.75 1.483 MW from ENSC Evaluation Results 1.963 MW 1.895 MW 1.710 MW 0.83 1.419 MW The net energy values calculated were compared to the program tracked savings for 2011. The values calculated were slightly lowe...

AI summary The evaluation of the Business Energy Rebates program in 2011 found that calculated net energy values were slightly lower than tracked savings due to adjustments from on-site visits and an interactive effects factor. The NTGR used in the evaluation was higher than the one used for tracked savings, but this did not offset the reduction in energy savings.

Program Manual 1. Document important program assumptions or practices: Content – The Evaluator understands that the measures included in the program as well as the gross savings they generate are based on a similar program run by EVT. Rega...

AI summary The document discusses the need for a comprehensive program manual that includes assumptions, practices, and parameters for estimating program objectives. It emphasizes documenting savings calculations, incentive structures, project selection criteria, and free-ridership scoring mechanisms for accuracy and transparency in program evaluation.

rms of net savings. To that effect, the program objectives include any distortion effects, whether positive or negative. They also include interactive effects, when not taken into account in the base case. These parameters are usually base...

AI summary The text discusses the importance of documenting program parameters and refining marketing plans for the Business Energy Rebates program. It emphasizes the need to account for distortion and interactive effects in program objectives and to use performance indicators for monitoring and evaluation.

Program Manual 4. Complete the program manual to keep track of changes and standardize Content the content: The program manual is well written but important information that would serve as “program memory” in case of modifications or staff...

AI summary The document outlines improvements needed for the program manual and tracking sheet, including standardizing content, breaking down savings calculation values into separate cells, and including measure sub-categories for better organization and validation of energy efficiency programs.

asures include several sub-categories. This is the case for Compressed Air, HVAC, Lighting, Motors and Drives and Refrigeration. The savings calculation approach is often very different from one sub-category to the other. Moreover, baselin...

AI summary The document discusses the need to improve data management practices in energy efficiency programs. It highlights the importance of breaking down measure sub-categories and address information for better data analysis and field activity planning. It also emphasizes the need for systematic data entry to ensure completeness in tracking sheets.

nt of the records. However, that information is available in the online database for each project and should also be in each project paper file. The tracking should then be updated to reflect that fact. Ref.: 5725 38 Business Energy Rebate...

AI summary The text discusses the availability of information in an online database for each project and the need to update tracking to reflect this. It references a 2011 evaluation report on Business Energy Rebates by Efficiency Nova Scotia Corporation.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Program 9. Standardize the entries: To prevent the same information from being entered Tracking Sheet in different ways in the tracking sheet, ENSC should integrate a drop-down list...

AI summary The 2011 Evaluation Report for Efficiency Nova Scotia Corporation (ENSC) outlines recommendations to improve program tracking and evaluation. It suggests standardizing data entry, developing evaluation plans in parallel with program design, and monitoring application processing delays to ensure timely incentive disbursement.

15. Provide information to participants on program portfolio: The results show Participant Perspectives a very positive attitude and a high level of motivation toward energy efficiency among participants. However, survey results indicate t...

AI summary The BER program has received positive participant feedback, but there is limited spillover effect as most participants did not engage in other programs or purchase energy-efficient products. Suggestions include increasing program promotion and conducting more on-site visits for compressed air, laundry, and lighting measures to improve evaluation accuracy.

es Efficiency Nova Scotia Corporation 2011 Evaluation Report Impact 21. Increase the number of on-site visits for the occupancy sensors category: Evaluation In order to be able to consider the impact of occupancy sensors on peak demand, th...

AI summary The Efficiency Nova Scotia Corporation (ENSC) evaluation report recommends increasing on-site visits for occupancy sensors and refrigeration measures to better assess energy savings and collect additional data such as temperature, usage hours, and heating sources during C&I telephone surveys to improve evaluation accuracy.

an you comment on that recommendation? BER-R1 What is the status of this recommendation about the free-riders (46%) is it the 3 questions you ask in the application form available from your web site? BER-R2 Are you using more contractors a...

AI summary The document discusses the Business Energy Rebates program, including questions about free-ridership, application processes, data collection, and the handling of non-admissible incentive requests. It also references an evaluation report and application forms.

s that are not qualified for the incentive? Q: If yes what is the percentage of these requests that are not admissible? Q: Do you keep a record of these non-admissible requests per type of measure? FAQ C: It’s a good practice to confirm pr...

AI summary The text discusses questions and comments regarding the Business Energy Rebates program, including eligibility criteria, application processing times, inspection practices, and the clarity of the program manual. Concerns are raised about the admissibility of incentives, communication with participants, and the accessibility of the program documentation.

calculations are done with the algorithms imbedded in the database, but our question is: Will the participant eventually know what will be the savings that he should expect from each measure? Page 8 Q: The table of incentives for each meas...

AI summary The document discusses concerns about the clarity and usability of the Business Energy Rebates program manual, including repeated sections, missing form elements, and the need for simplification. Questions are raised about who fills out the worksheets and where the data comes from.

he worksheets that are available from the Web site and filled by the participant? Q: General comment: This program manual really needs to be simplified; there are too many repetitions. CGI Document Q: We understand that this document is to...

AI summary The text discusses concerns about the complexity and clarity of a program manual for the Business Energy Rebates program, including questions about savings calculations, worksheet usage, and participant understanding of incentives. It also references an evaluation report from 2011.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Q: Please describe who are the program partners and what are their roles. This should guide us in asking the appropriate questions in the process evaluation. (Sales leads, marketing...

AI summary The document contains a series of questions for evaluating the Efficiency Nova Scotia Corporation (ENSC) Business Energy Rebates (BER) program, including inquiries about program partners, design considerations, barriers, evaluation plans, marketing strategies, and database usability. It also includes an interview guide for participants in the program evaluation.

ny or organization to purchase energy-efficient products when installing or replacing energy-using products for your business in the future? [98 = Don’t know/Don’t recall, 99 = Refused] S3. Did you experience any specific challenge or face...

AI summary The text contains survey questions related to the Business Energy Rebates (BER) program administered by Efficiency Nova Scotia Corporation (ENSC), focusing on participant experiences, challenges, and suggestions for improvement. The survey aims to gather feedback on program barriers, issues encountered, and potential enhancements.

PA1 Score: (FR2a ; FR2b) IF PRE-SCREENING: 0% FR3. If your company had not received the rebateoffered by the program, would you have paid for the full cost of the energy-efficient measures, FR3 = Answer x 10% including the portion covered...

AI summary The text outlines a scoring methodology for evaluating the impact of energy efficiency programs, focusing on factors such as rebate influence, customer behavior, and program effectiveness, using a series of questions and formulas to calculate scores.

MEAN VALUE OF: Final Free -Ridership (PA1 ; PA2 ; PA3 ; PA4) Ref.:5725 86 Business Energy Rebates Program Efficiency Nova Scotia Corporation 2011 Evaluation Report Subsequently, the final free-ridership level calculated for each participan...

AI summary The document discusses the evaluation of the Business Energy Rebates Program and the Smart Lighting Choices Program by Efficiency Nova Scotia Corporation in 2011. It outlines the methodology for calculating free-ridership levels and the inconsistency test applied to ensure accurate results.

a Corporation 2011 Evaluation Report The SLC program aimed at achieving net electricity savings of 8.04 GWh in 2011. KEY FINDINGS The 2011 evaluation of the SLC program demonstrated that the latter is well designed and has a good potential...

AI summary The SLC program achieved significant energy and demand savings in 2011, with net energy savings of 7.954 GWh and demand savings of 2.050 MW. The program's success was supported by increased product sales and a 19% free-ridership level, leading to a net-to-gross ratio of 0.81.

Net-to-Gross Ratio 0.81 The evaluation revealed that the SLC program had generated net energy savings of 7.954 GWh and demand savings of 2.050 MW at the generator in 2011. Ref.: 5725 v Smart Lighting Choices Program Efficiency Nova Scotia...

AI summary The evaluation of the Smart Lighting Choices Program (SLC) by Efficiency Nova Scotia Corporation (ENSC) found that the program generated 7.954 GWh of net energy savings and 2.050 MW of demand savings at the generator in 2011. The net-to-gross ratio (NTGR) for the SLC program was 0.81, indicating the proportion of gross savings that were net savings after accounting for interactive effects.

NSC programs in the overall executive summary of the 2011 demand-side management (DSM) programs, the Evaluator has the following recommendations that aim at optimizing specific aspects of the program: SLC-R1. Improve the quality of distrib...

AI summary The evaluation report recommends improving the quality of distributors' invoices and developing a tracking sheet to monitor program savings for the Smart Lighting Choices Program. It suggests using a standardized template and establishing a 100% approval threshold for invoice fill rates to improve data consistency and accuracy.

d. Lastly, the PM should develop a tracking sheet that allows monitoring savings for the whole year instead of completing individual monthly reports as is currently the case. SLC-R2. Collect additional information through telephone surveys...

AI summary The document recommends developing a tracking sheet to monitor annual savings rather than monthly reports and suggests collecting additional data through telephone surveys with commercial and industrial customers to better understand retrofit activities and their impact on energy savings.

Efficiency Nova Scotia Corporation 2011 Evaluation Report 2 METHODOLOGY 2.1 METHODOLOGICAL MODEL The 2011 evaluation of the SLC program included an impact evaluation through which program energy savings were assessed. For 2011, the SLC pro...

AI summary The 2011 evaluation of the Smart Lighting Choices (SLC) program by Efficiency Nova Scotia Corporation focused on assessing energy savings through an impact evaluation. A process evaluation was not conducted in 2011 as no major changes had occurred since the 2010 evaluation. The methodology included analyzing program documentation and conducting in-depth interviews with the program manager.

obtained from the following four sources: > ENSC website; > 2010 evaluation report; > program manual; > distributor invoices. 2.2.2 In-Depth Interview with Program Manager Econoler staff conducted one interview in September with the Progra...

AI summary The evaluation of the Smart Lighting Choices Program involves data from multiple sources, including interviews with the Program Manager and distributors, as well as on-site visits. The interviews aimed to understand program justification, savings calculations, barriers, marketing strategies, and free-ridership.

Efficiency Nova Scotia Corporation 2011 Evaluation Report 2.2.4 On-Site Visits In November, ten on-site visits were conducted at facilities in which SLC products had been installed. They were conducted by Econoler’s subcontractor, Equilibr...

AI summary The 2011 Evaluation Report discusses on-site visits conducted in November to validate the installation of SLC products. These visits were carried out by Equilibrium Engineering and used data from tracking sheets and interviews with site energy managers to verify installations and hours of operation.

lues for the fields listed above. Nevertheless, these invoices were approved by the PM. The missing information might not be essential for program administration but is useful for evaluation purposes. For each sale, the information in the...

AI summary The evaluation of the Smart Lighting Choices Program highlights that while invoices contain necessary information for rebate administration, additional details such as product specifications are missing. The Program Manager uses product numbers to determine lamp wattage and ballast types for tracking savings. The Evaluator suggests improvements to invoice consistency and program evaluation.

e quality control process on the tracking sheets to ensure that the required data is submitted. Finally, it would make the transfer of information into the general tracking sheet easier. > Make sure that all fields are filled in systematic...

AI summary The text discusses the need for improved data submission processes and invoice completion to ensure program evaluation accuracy. It highlights the importance of systematic data entry and the need for distributors to provide more detailed product information on invoices.

ency Nova Scotia Corporation 2011 Evaluation Report 4 IMPACT EVALUATION 4.1 OBJECTIVE AND APPROACH The impact evaluation is aimed at determining the gross and net savings of the program for 2011. Both energy and demand savings were conside...

AI summary The 2011 impact evaluation assesses the energy and demand savings of the Efficiency Nova Scotia Corporation's program. It considers factors like savings calculation methods, installation rates, and on-site visits to verify technology installations and collect operational data.

blish installation rates, hours of operation and interactive effects on program demand and energy savings. The gross energy savings evaluation is the result of data collection and savings adjustments. The distributor interviews provided in...

AI summary The document discusses the evaluation of the Smart Lighting Choices Program, including the calculation of net-to-gross ratio based on free-ridership and sampling methodology for on-site visits. Data on lamp and ballast sales from distributors is used to assess program effectiveness.

ucts. The final free-ridership value for the program was obtained by calculating the weighted average of the free- ridership with the corresponding total energy savings, for each category of products. Using this approach, in-depth intervie...

AI summary The evaluation report discusses the Smart Lighting Choices (SLC) program, calculating a free-ridership level of 19% and a Net-to-Gross Ratio (NTGR) of 0.81. The SLC program significantly influenced the sale of high-performance lighting products, while the UBER sub-program had a NTGR of 1 due to the recent introduction of expensive lighting products.

84 for the SLC program and of 0.75 for the UBER sub-program were used for tracked savings while NTGRs of 0.81 for the SLC program and of 1 for the UBER sub-program were used for program evaluation. Ref.: 5725 22 Smart Lighting Choices Prog...

AI summary The evaluation report compares net energy savings with tracked savings for the Smart Lighting Choices (SLC) program in 2011. The net savings were slightly higher due to increased hours of operation for SLC products, which offset reductions caused by an interactive effects factor and differences in NTGR values used for tracking and evaluation.

s on the tracking sheets to ensure that the required data is submitted. Finally, it would make the transfer of information into the general tracking sheet easier. 3. Make sure that all fields are filled in systematically: Once an invoice t...

AI summary The text discusses the need for systematic data submission and invoice completion in the Smart Lighting Choices Program, emphasizing that 80% of fields must be filled for approval, but suggests a 100% threshold for program evaluation purposes.

Program 4. Facilitate the tracking of products by requesting that distributors include Tracking the type of product purchased for each category: Currently, the only Sheet information available on a product is the category of product (lamp...

AI summary The document outlines recommendations for improving program tracking and evaluation, including enhancing product tracking by distributors, investigating de-lamping retrofit activities, using telephone surveys to assess T8 to T8 lamp replacements, and collecting data on heating sources and air conditioning usage during C&I surveys.

ns, the Evaluator recommends that information on the heating source and on the use of air conditioning equipment at participants’ facilities be collected during the C&I telephone survey campaigns conducted by ENSC. This would provide for a...

AI summary The evaluator suggests collecting information on heating sources and air conditioning use during C&I telephone surveys by ENSC to better assess interactive effects. The document also includes a 2011 evaluation report on the Smart Lighting Choices Program and a discussion about legislation, cost savings, and market impacts.

consumer)? C: Since the end users are unknown (beside large customers) sales records of a previous year from retailer could give an identification of the program impact in the market. Source: Web Q: When referring to the CEE Web Site, whic...

AI summary The text discusses the Smart Lighting Choices Program managed by Efficiency Nova Scotia Corporation, including questions about program participation, reporting forms, and the need for clearer separation of sections in the program manual for participants, retailers, and ENSC. It also references an interview guide for distributors.

n available, do you think that your sales of HPT8 ballasts in 2011 would have been about the same or lower? 1. Same [GO TO E3] 2. Lower [GO TO E2a] Ref.: 5725 31 Smart Lighting Choices Program Efficiency Nova Scotia Corporation 2011 Evalua...

AI summary The text is a series of questions from an evaluation report on the Smart Lighting Choices Program in 2011. It seeks to determine the impact of the program on sales of HPT8 ballasts and high-performance T8 lamps, including whether other rebates were available and their sources.

propriate amount? E8. Do you promote HPT8 ballasts as part of the Smart Lighting Choices Program? Is part of the ¢25 incentive used for marketing purposes? GENERAL IMPACT OF PROGRAM G1. Overall, do you think that the Smart Lighting Choices...

AI summary The text includes interview questions regarding the Smart Lighting Choices Program, its impact on businesses, and the use of incentives. It also includes an on-site visit protocol for evaluating the program's effectiveness.

www.econoler.com COMMERCIAL & INDUSTRIAL CUSTOM AND NEW CONSTRUCTION PROGRAM IMPACT AND PROCESS EVALUATION 2011 EFFICIENCY NOVA SCOTIA CORPORATION Final Report February 22, 2012 Commercial & Industrial Custom and New Construction Program E...

AI summary This document is a final evaluation report for the Commercial & Industrial Custom and New Construction Program by Efficiency Nova Scotia Corporation, published in February 2012. It assesses the program's impact and process.

................................................... 7 Figure 3: Methodological Model .............................................................................................................. 8 Ref.: 5725 v Commercial & Industrial Cust...

AI summary The 2011 evaluation report assesses the Commercial and Industrial Custom Retrofit and New Construction programs managed by Efficiency Nova Scotia Corporation. The evaluation involved interviews, on-site visits, and surveys to analyze program performance and impact.

med 25 on-site visits as well as a telephone survey of 27 program participants. The analysis and program evaluation results are presented separately for each of the two C&I Custom program components. PROGRAM OVERVIEW The C&I Custom program...

AI summary The C&I Custom programs offer technical assistance, financial incentives, and project financing to medium and large C&I customers to reduce energy consumption and demand. The C&IC program component, launched in 2008, was upgraded in 2011 with improved staffing, focus on larger projects, and enhanced sales outreach to improve peak demand savings.

930 GWh in 2011, which represents a considerable increase in comparison to 2010 net savings (total of 19.413 GWh). It also realized generated 3.764 MW peak demand savings compared to 2.406 MW in 2010. Ref.: 5725 vii Commercial & Industrial...

AI summary The Commercial & Industrial Custom and New Construction Program (C&IC) saw increased participation and awareness in 2011, with ENSC's marketing efforts playing a key role. Participants also came from prior engagement with NSPI or ENSC programs, and the addition of sales leads contributed to the growth.

m a participation point of view, these are indications that program marketing efforts are improving from past years, which means that the program clearly evolved in the right direction. Satisfaction Satisfaction towards the C&IC program ha...

AI summary The C&IC program has seen improved satisfaction, particularly in staff interaction and communication, following a transition from NSPI to ENSC. Despite some concerns about the M&V process, overall satisfaction remains high. Energy savings were calculated through on-site visits and interviews, with adjustment factors used to estimate overall program savings.

gs for all sample projects, in accordance with the specifics of each project type. This calculation resulted in adjustment factors that are used to estimate the overall gross savings of both programs. Afterwards, the Evaluator determined t...

AI summary The evaluation determined a free-ridership level of 7% and no spillover effects for the C&IC and CINC programs in 2011, leading to a net-to-gross ratio of 0.93. This ratio was used to calculate net energy and peak demand savings.

aluation. This difference in the free-ridership level is due in part to the enhanced screening process put in place by ENSC. This process was improved with all participants who signed the PDA in 2011. In regard to the C&IC program impact e...

AI summary The evaluation of the C&IC program indicates it works well overall, but the CINC program has significant potential for improvement. Econoler adjusted energy savings calculations and diversity factors, noting that ENSC's factors were sometimes too conservative, particularly for lighting retrofits.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Recommendations for the CINC Program: CINC-R1. Conduct a separate complete evaluation for the CINC program: In 2010, only one new construction project was included in the C&IC progr...

AI summary The 2011 Evaluation Report recommends conducting a separate evaluation for the CINC program due to its increasing impact and the need to address uncertainties in savings calculations. It also suggests comparing actual building consumption with design simulations to improve accuracy.

Figure 2: CINC Program Logic Model3 3 The numbers 1 through 12 contained in this logic model explain the relationship between the different levels involved. They are presented in Appendix II. Ref.: 5725 7 Commercial & Industrial Custom and...

AI summary This section outlines the methodology used in the 2011 evaluation of the Commercial & Industrial Custom and New Construction Program. It includes the analysis of program documentation, interviews with program administrators, on-site visits, surveys, and interviews with participants and verification partners.

Corporation 2011 Evaluation Report 3.2 METHODOLOGY DESCRIPTION 3.2.1 Analyzing Existing Program Information The first task in the process evaluation of the C&I Custom program was an analysis of the program documentation. At that stage, the...

AI summary The evaluation of the C&I Custom program involved analyzing program documentation and conducting in-depth interviews with Program Managers to assess program justification, savings calculations, barriers, marketing strategies, and prior evaluation recommendations.

program partners’ interviews for process evaluation was finalized. For reference purposes, the protocol used by the Evaluator during their in-depth interviews with PMs is presented in Appendix IV. Ref.: 5725 9 Commercial & Industrial Custo...

AI summary The evaluation report outlines the methods used to assess the Commercial & Industrial Custom and New Construction Program. It includes interviews with program managers, on-site visits conducted by Equilibrium Engineering, and a telephone survey by Corporate Research Associates, Inc. These activities were aimed at validating technical specifications and understanding program features.

g computer-assisted telephone interviewing (CATI). The average length of the survey was 17.5 minutes. The participant survey was used to gain a better understanding of the following program features: > previous program participation; > how...

AI summary The participant survey, conducted via computer-assisted telephone interviewing (CATI), aimed to understand program features such as previous participation, learning sources, spillover effects, motivations, and satisfaction. The survey lasted 17.5 minutes on average. Appendix III and VII provide demographic data and the questionnaire, respectively. Table 3 outlines sample sizes and sampling errors for 2010 and 2011.

13 ±19.6% 2011 Participants4 159 27 ±14.4% 3.2.5 In-Depth Interviews with Partners In September, two in-depth interviews were conducted with program verification partners. They are external consultants who assist ENSC in reviewing submitte...

AI summary In September and November, in-depth interviews were conducted with program verification partners and 2011 program participants to assess their involvement, satisfaction, and potential spillover effects of the C&I Custom Program. The interviews aimed to understand program perceptions, process satisfaction, and identify energy efficiency projects influenced by program participation.

participants is presented in Appendix VI. 4 The sampling population for the 2011 survey was 68 participants, which was the number of program participants at the time of conducting the survey. Ref.: 5725 11 Commercial & Industrial Custom an...

AI summary The process evaluation of the Commercial & Industrial Custom and New Construction (C&IC) program focuses on assessing the effectiveness of program design and delivery. The evaluation involves examining the program manual, which serves as an essential reference tool for program staff and was widely used by the evaluator during the process and impact evaluation.

program manuals intended for internal use. More specifically for the C&IC program, the table below presents such typical program manual contents along with what was found in the C&IC program manual. Table 4: C&IC Program Manual Content Eva...

AI summary The document evaluates the content of the C&IC program manual, highlighting typical sections such as program description, objectives, eligibility criteria, and program partners. It notes that certain sections, such as total savings objectives and market studies, are either missing or partially included in the manual.

ocess flow chart Program forms Information included in the program manual Information partially included in the program manual No information The Evaluator analyzed the C&IC program manual and found that it contains relevant information us...

AI summary The Evaluator found that the C&IC program manual contains useful information but recommends adding details on M&V aspects and explaining the 'Custom Client Response Process' form. These improvements would enhance clarity and support program management and evaluation.

s multiple purposes such as determining project eligibility, establishing the level of incentive, estimating free-ridership levels, etc. This should be explained in the program manual. > Clarify the use of the terms “preliminary energy aud...

AI summary The text discusses the need for clarity in terminology related to energy audits and scoping studies, and the importance of documenting parameters used for estimating program objectives. It emphasizes avoiding confusion between terms and ensuring transparency in assumptions for future evaluations.

ck of the assumptions used to estimate the program targets. After each evaluation, these parameters are adjusted accordingly for estimating the program objectives of the years to come. > Complete the program manual to keep track of changes...

AI summary The evaluation of the program manual and tracking sheet highlights the need for more comprehensive documentation and standardization. The program manual lacks key details such as program justifications and savings objectives, and the tracking sheet requires improvements for better use by the Program Manager and Evaluator. The Demand Side Management Data System (DSMDS) is available but less effective for data extraction.

o program impact calculations, this tracking tool has, however, not been used much by the Evaluator since it was more challenging to extract data from this system than directly using the PM’s tracking Ref.: 5725 14 Commercial & Industrial...

AI summary The program impact evaluation for the Commercial & Industrial Custom and New Construction Program relied primarily on the program tracking sheet and electronic folders provided by ENSC, as data extraction from the DSMDS system was found to be more challenging. However, the PM confirmed that DSMDS data are kept up to date and frequently used by program staff.

d electronic folders provided by ENSC for program impact evaluation. That being said, the PM confirmed that the program data on the DSMDS are kept up to date and are used frequently by program staff. In detail, the program tracking sheet s...

AI summary The document discusses the data management practices of ENSC, including the use of the DSMDS spreadsheet and electronic folders for tracking program impacts. The PM confirmed that the data are kept up to date and are used frequently by program staff. The 'Projects' sheet in the spreadsheet is highlighted as a key tool for evaluation, containing project details and forecast energy and demand savings.

Furthermore, many “Superseded” subfolders could be found in the project folders. Such subfolders are used for storing old versions of electronic files, which could be useful to track project history. Prior to January 1, 2011, each project...

AI summary The document discusses the management of project folders and the evolution of project numbering systems used by NSPI and ENSC. It highlights the need for standardized nomenclature for electronic files and project names to improve consistency and program monitoring.

Efficiency Nova Scotia Corporation 2011 Evaluation Report number, the document type (form 2, form 7, etc.) and the revision of the file. Many documents have the same name even though they do not pertain to the same project. This situation...

AI summary The 2011 Evaluation Report highlights inconsistencies in data entry within the DSMDS, such as misspelled project details and incorrect percentage installations. It recommends standardizing entries using drop-down lists to improve data accuracy and facilitate evaluation.

2011, the C&IC program was significantly upgraded with regard to several aspects. During the interview with the PM, the Evaluator noted the following key improvements from the 2010 program evaluation: > Program staffing has been improved t...

AI summary In 2011, the C&IC program was upgraded with improved staffing, a focus on larger projects with high demand savings potential, and the inclusion of sales lead activities. ENSC is advised to use a weighted average of line loss factors for projects involving multiple rate codes.

mportant to the PM are covered. The two most important components of the plan are the evaluation methodology as well as the pre- and post-data required to apply the selected methodology. > Track the number of energy audits that are not acc...

AI summary The document discusses the importance of tracking energy audits not accepted under the C&IC program by ENSC. It highlights that a high rate of rejected audits may indicate unclear eligibility criteria or issues with consultants. ENSC has already begun developing a system to track these audits.

s with the consultants who conducted the energy audits. At the end of 2011, ENSC mentioned that they had already started working on a system to track energy audits that are not accepted. > Standardize the internal screening process: Free-r...

AI summary The document discusses the need for ENSC to standardize its internal screening process for the C&IC program, particularly regarding free-ridership. Econoler recommends developing tracking mechanisms to collect and analyze responses from potential participants who are screened out, to improve the program's efficiency and effectiveness.

Efficiency Nova Scotia Corporation 2011 Evaluation Report 4.2.4 Section of ENSC Website Commercial, institutional and industrial customers can easily consult the ENSC website to seek information on the programs offered. More specifically,...

AI summary The 2011 Evaluation Report discusses the ENSC website's C&IC section, highlighting its usefulness for commercial, institutional, and industrial customers. It praises the comprehensive program materials and standardized forms but recommends expanding the 'Who Is Eligible' section to include industrial companies and large institutional customers.

Efficiency Nova Scotia Corporation 2011 Evaluation Report 4.2.5 Interview with a Verification Partner Under the C&IC program the key role of the verification partner, who is an external consultant, is to help clients access the ENSC progra...

AI summary The evaluation report discusses the C&IC program and highlights the verification partner's high satisfaction with the program's operations, participation process, and relationships with program staff. The verification partner suggests improving client awareness through enhanced marketing activities to overcome the main barrier to participation.

e marketing activities should be enhanced even if the verification partner expressed a high level of satisfaction with the marketing and outreach activities. 4.3 CINC PROGRAM PROCESS EVALUATION This section presents the key outcomes from t...

AI summary The document discusses the evaluation of the Commercial & Industrial Custom and New Construction (CINC) program, focusing on the process evaluation conducted by the Evaluator. It highlights the program manual content and compares it with typical details found in program manuals. The evaluation involved interviews with the Program Manager and partners, as well as a participant.

11 Evaluation Report Table 5: CINC Program Manual Content Evaluation Program Manual Content CINC Program Manual Document revisions Program description (including nature or type of program) Program justification Program objectives Incentive...

AI summary The document evaluates the CINC program manual, identifying areas for improvement. It highlights missing sections such as total savings objectives, savings calculations, and market studies. The evaluation report recommends enhancing the manual's structure and content for better clarity and completeness.

rack of the assumptions used to estimate the program targets. After each evaluation, these parameters are adjusted accordingly for estimating the program objectives of the years to come. > Standardize the use of terms in Section 4.3.3: In...

AI summary The evaluation report discusses the need for standardizing terminology in the program manual and providing a printable version of the CPG for participants. It also highlights the need for additional information to serve as 'program memory' and standardization of program manuals based on a common template.

Efficiency Nova Scotia Corporation 2011 Evaluation Report 4.3.2 Program Tracking Sheet Under the program process evaluation, Econoler reviewed the structure and contents of ENSC’s CINC program tracking sheet. All in all, the tracking sheet...

AI summary The 2011 Evaluation Report reviewed ENSC’s CINC program tracking sheet, noting its usefulness for program monitoring and administration. While essential fields are present, improvements are recommended to enhance efficiency. The sheet includes project details, energy savings estimates, and financial incentive calculations under the NCCP path.

eview, the Evaluator identified a number of adjustments that could be made to improve its consistency and help program monitoring and evaluation. With this in mind, the Evaluator recommends that ENSC: > Create automatic formulas for calcul...

AI summary The Evaluator recommends creating automatic formulas in the CINC tracking database to calculate financial incentives based on the program path taken (NCCP or NCWB), reducing data entry errors and improving program monitoring and evaluation.

igible for the CINC program. As the CPG is built as a package, ENSC also mentioned that it was already exploring options for another tool that would perform comparable house simulations. > Develop an evaluation plan in parallel with progra...

AI summary The document discusses the need for an evaluation plan for the CINC program, emphasizing the importance of collecting key variables during program design. It also highlights the comparison of actual building consumption with design simulations to ensure accuracy and make necessary software adjustments.

arison could help identify which one is closest to reality. It was mentioned that ABI would do this comparison for the projects undertaken under the NCCP path when data are available. Ref.: 5725 26 Commercial & Industrial Custom and New Co...

AI summary The document discusses the need for Efficiency Nova Scotia Corporation (ENSC) to establish performance indicators to evaluate the efficiency of the project delivery process under the Commercial & Industrial Custom and New Construction Program (C&I C&NC Program). It references time limits outlined in the program manual and suggests using these to monitor task completion.

s, seven report participating in the Small Business Lighting Solutions program (now named Small Business Energy Solutions). Table 6: Participated in other Programs7 Participated in Other NSPI or ENSC Programs 2008 2009 2010 2011 Sample Siz...

AI summary The text discusses participation in the Small Business Energy Solutions program and the Commercial & Industrial Custom and New Construction Program, highlighting program awareness and participation rates over several years. It also outlines how participants learned about the C&IC program.

4% project Reduce 1 1 maintenance costs Reduce carbon 2 footprint Ease of program 2 1 participation Other 11% Refused 4% Don’t know 1 1 2 2 7% Ref.: 5725 30 Commercial & Industrial Custom and New Construction Program Efficiency Nova Scotia...

AI summary The majority of participants in the Commercial & Industrial Custom and New Construction Program did not identify barriers to participation (74%). Among those who did, issues included long approval times, equipment not meeting payback requirements, and required measurement as barriers.

of forecast energy savings of the two C&I Custom programs (C&IC and CINC) accounted for approximately 30 percent of the total expected savings to be generated by all ENSC programs for the same period. This section presents the work complet...

AI summary The document discusses the evaluation of the impact of the C&IC and CINC programs in 2011, including on-site visits and calculations of energy and peak demand savings. The evaluation involved determining adjustment factors and net-to-gross ratios to estimate overall savings.

or the energy and demand savings calculations. Considering the respective size of each program component, the Evaluator made 23 on-site visits to C&IC projects and two on-site visits to CINC projects. The sampling methodologies applied to...

AI summary The Evaluator conducted 23 on-site visits to C&IC projects and two to CINC projects to assess energy and demand savings. Different sampling methodologies were used for C&IC and CINC programs due to project-specific differences and data collection requirements. The report outlines sampling methods, on-site protocols, and in-depth interviews for evaluating program effects.

Efficiency Nova Scotia Corporation 2011 Evaluation Report projects for which savings had already been verified and adjusted through measurement and verification (M&V). On the other hand, this list also included projects which were only at...

AI summary The 2011 Evaluation Report discusses the selection of 40 energy efficiency projects for on-site visits, focusing on those with verified savings through the C&IC program, including projects completed in 2011 and those partially completed in 2012.

dditional details on savings claim status along with a breakdown of energy and peak demand savings at the generator for the 40 completed projects used for on-site visit sampling (as of October 2011). Table 16: Claimed Savings at the Genera...

AI summary This section provides details on the status of savings claims for 40 completed projects, including energy and peak demand savings tracked at the generator as of October 2011. It outlines the sampling criteria used to select 23 sites for on-site visits, prioritizing factors such as project size, source of savings claims, type of project, participant sector, and location.

lation and air conditioning (HVAC) systems, electrical motors and VSDs, etc.; > participant’s market sector (commercial, municipal or industrial sector); and > project location. Ref.: 5725 37 Commercial & Industrial Custom and New Construc...

AI summary The document discusses the sampling criteria used to select 23 projects for evaluation under the Commercial & Industrial Custom and New Construction Program (C&IC) in 2011, comparing them to the total population of 159 projects. It also references the detailed sampling plan in Appendix IX.

report, ENSC tracking sheet or PDA). In addition, this document defined the facility operation schedules, which included daily time of use (8 a.m. to 5 p.m.) and the number of operating hours per day. During the site visits, the Evaluator...

AI summary The document outlines procedures for on-site visits to evaluate compliance with energy efficiency programs. It describes the use of ENSC tracking sheets, M&V reporting files, and tailored questionnaires based on CPG criteria to validate technical information and ensure adherence to program requirements.

uirement tables (taken from the CPG) were attached for reference purposes. This questionnaire and its appendices were the main documents that the auditor consulted when conducting the on-site visits. Ref.: 5725 40 Commercial & Industrial C...

AI summary The auditor used compliance documents from the CPG and technical data from ENSC to assess new construction compliance before on-site visits. All sampled CINC projects met CPG requirements, eliminating the need for additional on-site protocols. Five program participants were randomly selected for in-depth interviews.

interviews with C&IC program participants and another with one CINC program participant). The five program participants that the Evaluator met for in-depth interviews were selected on a random basis. The in-depth interview outcomes were us...

AI summary The document discusses an evaluation of the C&IC and CINC programs, including in-depth interviews with participants to assess internal spillover, participant experience, and program improvements. Gross savings were estimated using data from program tracking sheets, on-site visits, and savings reviews, with analyses varying by program component and energy efficiency measures.

ed in accordance with project specificities, such as the program component in which the customer participated (C&IC or CINC), or the type of energy efficiency measures implemented through the project. The Evaluator conducted the 25 on-site...

AI summary The Evaluator conducted on-site visits to assess energy savings from efficiency measures, calculating adjustment ratios to refine program savings estimates. Lighting retrofits were the primary source of energy savings in the C&IC program, contributing to 70% of the projected savings in 2011.

the UPS systems are located in mechanical rooms where the temperature control scheme allows wide margins of air temperatures. The Evaluator thus estimated that the interactive effects of the energy Ref.: 5725 46 Commercial & Industrial Cus...

AI summary The evaluation of the Commercial & Industrial Custom and New Construction Program (CINC) under the New Construction Core Performance Path is discussed. Two new construction buildings were assessed in 2011 under the NCCP path, with the Evaluator confirming compliance with CPG requirements and identifying key queries for on-site verification.

Adjustments to “Lighting Retrofit Only” projects: Due to its predominance in the 2011 population of C&IC projects9, the “Lighting Retrofit Only” project type has its own adjustment factors for the energy and demand savings. These factors w...

AI summary The document discusses adjustments to energy and demand savings for different project types under the C&IC and CINC programs. Lighting Retrofit Only projects have specific adjustment factors based on on-site visits, while other C&IC projects use average factors. CINC projects face challenges in verifying demand savings due to data limitations and simulation issues.

ng simulations that were not verifiable. These figures were different for each CPG measure, and varied depending on the HVAC systems installed as well as on regional considerations (climate). It was 9 As per Appendix IX of this report, the...

AI summary The evaluation report discusses challenges in estimating demand savings from the C&IC program, including unverifiable simulation data, variability in HVAC systems and regional climate, lack of diversity factors in demand calculations, and insufficient on-site visits to confirm compliance levels.

Code Compliance, p. 43. 13 On page 11 of the CPG, the text refers to savings from 25 percent to 35 percent over beyond the performance of a building that meets the requirements of the MNECB 1997. Ref.: 5725 53 Commercial & Industrial Custo...

AI summary The text discusses the use of Performance and Design Agreement (PDA) savings figures for estimating project savings under the Nova Scotia Clean Work Building Program (NCWB) and mentions the Net-to-Gross Ratio (NTGR) evaluation approach for the Compliance and Incentive Program (C&IC). It emphasizes the importance of using PDA data instead of placeholder savings factors for more accurate forecasting.

ence of the program on participants’ decision to purchase eligible energy-efficient products. These questions were included in the participant survey and in five in-depth interviews conducted on site. This section presents the methodology...

AI summary This section discusses the methodology used to calculate the Net-to-Gross Ratio (NTGR) for the C&IC program, considering distortion effects such as free-ridership and internal spillover. It also notes that the CINC program has a minimal spillover effect and uses the same NTGR as the C&IC program due to similar characteristics.

at found for the C&IC program. 14 For the year 2011, the target energy and demand savings of the CINC component of the C&I Custom program accounts for only 10 percent of total forecast savings. Ref.: 5725 54 Commercial & Industrial Custom...

AI summary The 2011 evaluation report discusses free-ridership in the Commercial & Industrial Custom and New Construction Program, noting that ENSC improved screening processes to identify participants who would have implemented energy efficiency measures without the program. The report outlines survey questions used to assess the impact of the program on customer decisions.

eworthy is that the Evaluator’s approach is consistent with evaluation, measurement and verification methods used in other jurisdictions such as California, New York State, Oregon and Pennsylvania. Ref.: 5725 55 Commercial & Industrial Cus...

AI summary The 2011 evaluation of the Commercial & Industrial Custom and New Construction Program found a 7% free-ridership level, a decrease from 10% in 2010. This improvement is attributed to an enhanced screening process implemented by ENSC, particularly with participants who signed the PDA in 2011.

in 2011. A lower level of free-ridership was observed with these participants than with participants who signed the PDA in 2010 but finalized their project implementation in 2011. 5.3.2 Spillover Within typical programs, the internal spill...

AI summary The text discusses free-ridership and spillover effects within the C&IC program. It notes lower free-ridership in 2011 compared to 2010. Spillover effects refer to energy savings resulting from program influence without direct support, and internal spillover is assessed for the C&IC program but considered negligible for the CINC program.

a CINC program participant did not show any relevant sign of internal spillover, the Evaluator decided to consider CINC program internal spillover as negligible. Evaluation of C&IC Program Spillover For the year 2011, the Evaluator assesse...

AI summary The evaluation of the C&IC Program's internal spillover in 2011 found negligible effects based on a telephone survey and interviews. Participants were asked about energy efficiency measures they decided not to implement through the program and whether they implemented them elsewhere.

Efficiency Nova Scotia Corporation 2011 Evaluation Report With the aim of refining the spillover evaluation, the Evaluator also carried out four in-depth interviews with C&IC program participants in November 2011.15 Through these interview...

AI summary The 2011 evaluation report for Efficiency Nova Scotia Corporation's C&IC program found no internal spillover, despite using a new approach combining phone surveys and in-depth interviews. Net savings for the C&IC and CINC programs were calculated using the net-to-gross ratio.

s 15 As previously mentioned, one in-depth interview was also carried out with a CINC program participant. This interview did not reveal significant internal spillover effects for this program. Ref.: 5725 57 Commercial & Industrial Custom...

AI summary An interview with a CINC program participant did not reveal significant internal spillover effects. The evaluation report compares tracked and evaluated savings for the C&IC and CINC programs in 2011, showing slight differences in energy and demand savings.

vings Tracked Savings from ENSC 3.949 MW 0.90 3.554 MW Evaluation Results 4.047 MW 0.93 3.764 MW As per the last table, the evaluated net energy savings of the C&IC and CINC programs are higher than those tracked by ENSC by approximately 1...

AI summary The evaluated net energy savings from the C&IC and CINC programs are slightly higher than those tracked by ENSC, primarily due to improvements in the free-ridership level. Adjustments were made to some C&IC projects based on sample project evaluations, while CINC program savings were not adjusted due to data gaps and inaccuracies in assessing NCCP and NCWB projects.

ts, which were initially forecast to represent a small percentage of CINC program savings. In reality, the two NCWB projects of 2011 accounted for more than 40 percent of total program energy savings. For the C&IC program, the evaluated ne...

AI summary The CINC program's energy savings were higher than initially forecast, with two NCWB projects contributing over 40% of total savings. The C&IC program's net demand savings were higher than those tracked by ENSC, partly due to an increase in the NTGR and adjustments to diversity factors by Econoler.

Program 1. Add more information on M&V aspects: In the M&V section of the program Manual manual (Section 5.7), there should be additional information describing who pays Content for M&V activities, who selects the Option (A, B or C) of the...

AI summary The text outlines three recommendations for improving the program manual: adding details on M&V activities, explaining the 'Custom Client Response Process' form, and clarifying the use of terms like 'preliminary energy audit' and 'scoping study'. These changes aim to increase clarity and consistency for participants.

literature should clearly state that the term “scoping study” encompasses typical preliminary energy audits and then stop using the other one. Noteworthy is that this recommendation is also applicable to the ENSC website. 4. Provide the pa...

AI summary The text discusses the need for consistency in terminology, recommending that the term 'scoping study' be used exclusively for preliminary energy audits. It also emphasizes the importance of documenting parameters used for estimating program objectives, including net savings and interactive effects, to ensure accurate tracking and future adjustments.

ram participant. The addition of this new “Project Name” column along with the standardization of “Customer Name” column entries would help address this issue. Ref.: 5725 60 Commercial & Industrial Custom and New Construction Program Effic...

AI summary The document discusses the addition of a new 'Project Name' column and the standardization of the 'Customer Name' column to improve clarity and address issues in the Commercial & Industrial Custom and New Construction Program evaluation report.

Program 11. Develop an evaluation plan in parallel with program design and Design and development: This program has no evaluation plan. The Evaluator strongly Implementation recommends that for each new program, an evaluation plan be prepa...

AI summary The text emphasizes the need for an evaluation plan for new programs, tracking rejected energy audits, and standardizing the free-ridership screening process. These measures aim to improve program performance, ensure clarity in eligibility criteria, and reduce potential issues with audit quality.

Section of 15. Supplement the ENSC website with information taken from Appendix H of ENSC Website the C&IC program manual: Appendix H of the program manual, intended to facilitate staff training, is a very good initiative in case there are...

AI summary The text discusses suggestions for improving the ENSC website and program awareness, including using Appendix H for staff training and FAQs, changing section titles to avoid confusion, and enhancing marketing to increase participation by emphasizing financial benefits.

outreach activities. Participant 18. .Focus on the financial benefits of the program: ENSC should continue to Perspectives focus on the financial benefits of the program since savings on energy cost and program incentives are still the mai...

AI summary The document emphasizes the importance of focusing on the financial benefits of the energy efficiency program to motivate participants, as well as the continued use of contractors and design professionals to promote the program, given their significant role in specifying implemented measures.

e for the C&IC program but are not simple to extract from the M&V results. In addition, giving the sole responsibility of M&V to the firm that also implements the project may be risky. For instance, the M&V of the largest project of the 20...

AI summary The evaluation report highlights concerns about the reliability of measurement and verification (M&V) results when conducted by the same firm implementing energy efficiency projects, especially for large projects. It recommends third-party M&V for projects with energy savings above 500 MWh/year to reduce bias and improve accuracy.

easibility Study Incentive – Whole Building & Custom Paths), the Evaluator recommends always using the same terminology to designate a product or activity. In this case, the program manual uses alternatively the terms energy audit and feas...

AI summary The Evaluator recommends standardizing terminology in the program manual to avoid confusion and suggests providing a printable version of Appendix H (CPG) to program participants for easier reference.

evelop their project under a custom approach. Consequently, the Evaluator recommends adding a column in the tracking sheet to follow these peak demand savings. Ref.: 5725 67 Commercial & Industrial Custom and New Construction Program Effic...

AI summary The Evaluator suggests adding a column to the tracking sheet to monitor peak demand savings under the Commercial & Industrial Custom and New Construction Program managed by Efficiency Nova Scotia Corporation in the 2011 Evaluation Report.

Program 13. Develop an evaluation plan in parallel with program design and Design and development: This program has no evaluation plan. The Evaluator strongly Implementation recommends that for each new program, an evaluation plan be prepa...

AI summary The text emphasizes the importance of developing an evaluation plan alongside program design, comparing actual building consumption with simulations for accuracy, and setting performance indicators for project delivery. These steps aim to improve program effectiveness and ensure accurate monitoring and verification.

h when data are available. 15. Set performance indicators on project delivery process: In different sections of the program manual there are references to time limits to perform a given task. With the aim of evaluating project delivery pro...

AI summary The document recommends establishing performance indicators for project delivery efficiency and clarifying minimum requirements for CINC projects to improve compliance and reduce issues during the M&V step. It also suggests providing standardized documentation and examples to assist participants in meeting CPG requirements.

Program 17. Consider adding a commissioning component to the program: The Design and Evaluator believes that ENSC should consider promoting building Implementation commissioning in the program since it has been proven that an effective com...

AI summary The document suggests adding a commissioning component to the ENSC program, revising the description of the CPG, offering commissioning and calibrating modeling tools, and conducting a separate evaluation for the CINC program to improve performance and accuracy of savings predictions.

the source of awareness in order to establish which ones were the most effective. 2 The program offers three types of technical Selecting the right path will be captured in assistance: modeling validation by an each project file. As for ed...

AI summary The program provides technical assistance and incentives for energy efficiency measures. It includes modeling validation, educational activities, and incentives based on the chosen path. Tracking of activities and incentives is emphasized to evaluate effectiveness and measure savings.

epending on the path chosen. date of payment. This ratio will establish the level of distortion of forecasted savings. Ref.: 5725 73 Commercial & Industrial Custom and New Construction Program Efficiency Nova Scotia Corporation 2011 Evalua...

AI summary The document discusses the Commercial & Industrial Custom and New Construction Program, highlighting three paths available to participants based on building type and size. It emphasizes the importance of tracking program performance indicators to determine the popularity of different paths for future development.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Page 2 Q: If you use required internal standard as a base line for some cases, would it still be that level even if its lower than the (MNECB) 97 requirements? Page 3 (M& V) Q: If y...

AI summary The document contains questions and comments regarding the Evaluation Report of Efficiency Nova Scotia Corporation from 2011. Issues raised include baseline standards, data validation, program structure, financial calculations, and participant support materials. The discussion focuses on improving data collection, program clarity, and participant engagement.

interested in internal procedures. Q: Do you have a participation flow chart that illustrates the different steps for the participants that could be a good support for the program manual writing? Ref.: 5725 80 Commercial & Industrial Custo...

AI summary The text includes questions and comments related to program eligibility, internal procedures, terminology consistency, time limits, and program funding caps in the Commercial & Industrial Custom and New Construction Program. Concerns are raised about free-ridership, clarity of documentation, and potential barriers caused by funding limitations.

cts because of that limitation? Section 4.4.2.2 C: The 85% ratio for incentive of the total program budget seems a very good ratio for a new program. I have to congratulate you if this is the case. Q: I understand that you do not allow red...

AI summary The text includes questions and comments regarding program design, payback periods, commissioning plans, legal reviews, training materials, marketing strategies, program logic models, and potential distortion effects such as free-riders and spillovers. These discussions pertain to the evaluation and structure of the Commercial & Industrial Custom and New Construction Program.

eral Q: is there a program logic model? Q: When the program was initially designed did it include some distortion effects (free-riders, spillover) and were they quantified to establish net savings? Q: Do you perform the cost effectiveness...

AI summary The text contains a series of questions related to the evaluation of the Commercial & Industrial Custom and New Construction Program, including program logic models, distortion effects, cost-effectiveness tests, program partners, evaluation plans, and database usability. It also references an evaluation report and recommendations.

e design of the program to increase demand savings? Q: Are the “Sales Leads” part of ENSC team? C&I –R2 What is the status of this recommendation? C&I –R3 What is the status of this recommendation? C&I – R6 What is the status of this recom...

AI summary The document includes questions about the design of a program to increase demand savings, the role of 'Sales Leads' in ENSC, the status of various recommendations, and the methodology for measuring free ridership. It also raises concerns about the clarity of incentive levels and the tracking of Sales Leads activities.

e? Q: What is the percentage of leads that ended up in participation? Q: In table 3-2 , the contractor role has fallen down dramatically in 2010 (8%) compared to 46% in 2009. Was that investigated? Page 19 C: In table 3-3, past participati...

AI summary The text discusses questions and responses related to program participation rates, data analysis, and terminology consistency in energy efficiency programs. Topics include past participation influencing future engagement, spillover effects, and the need for consistent terminology in program documentation.

pment still functioning: If there is a level of standard practice, do you calculate savings based on the early replacement principle (a stair approach)? Page 4 6.2 Q: Are all the projects measured? Q: Who decides what protocol to use in ea...

AI summary The text includes questions and comments regarding program protocols, eligibility for financing, and the structure of the program manual. Concerns are raised about the complexity of the manual, the number of forms, and the eligibility of municipality clients for on-bill financing.

Care to comment? Q: In the appendix A, we count eleven (11) forms for that program. Could that be a reason for any bottleneck in tracking the program data and entering them in a centralized database? C: Custom Client Response Process (afte...

AI summary The text discusses questions raised during a regulatory proceeding regarding program data tracking, methodology appendices, marketing strategies, and program evaluation. It highlights concerns about bottlenecks, missing appendices, and the need for evaluation plans and cost-effectiveness testing.

it for participants or non-participants or both? Q: Do you do cost effectiveness test post evaluation? Q: When the program was initially designed, was there an evaluation plan designed concurrently? Q: How would you rate the facility or di...

AI summary The document contains a questionnaire for ENSC energy efficiency program partners, focusing on their role, experience, and evaluation of the program. It includes questions about cost effectiveness, evaluation plans, and ease of use of a centralized database.

stions Please indicate your company name: Q1 - How would you define your role as an ENSC energy efficiency program partner? Q1a – How long have you had that role (specify months or years)? Q2 - On a scale from 1 to 10 (where 1 is very bad...

AI summary The document contains a series of questions directed at program partners of the Energy Efficiency Nova Scotia (ENSC) Commercial & Industrial Custom and New Construction Program. It asks about their role, relationship with ENSC, participation process, complaints received, and overall satisfaction with the program.

t), how would you rate your satisfaction in regard to the overall program? Q5a- If your answer to Q5 was equal to or less than 8, would you care to share the reason or reasons for such a score? Ref.: 5725 90 Commercial & Industrial Custom...

AI summary The text includes survey questions from an evaluation report on the Commercial & Industrial Custom and New Construction Program by Efficiency Nova Scotia Corporation in 2011. It asks participants about their satisfaction with the program, reasons for low satisfaction scores, suggestions for improvement, and involvement in program components such as feasibility studies and site inspections.

that use the Whole Building Path Participant in the kick-off meeting with ENSC and the client Site inspections Measurement & Verification (M&V) Design assistance, if needed Other Ref.: 5725 91 Commercial & Industrial Custom and New Constru...

AI summary The text outlines various stages and processes involved in a commercial and industrial energy efficiency program, including kick-off meetings, site inspections, measurement and verification, and design assistance. It also includes a series of questions regarding program verification, commissioning, and relationships with stakeholders such as clients, consultants, and contractors.

e confusion about? No Don’t know Q14- What is your opinion in regard to program on-course modifications? Easy to adjust to the way you work Requires minor changes to the way you work Requires major changes to the way you work No opinion No...

AI summary The text includes survey questions about program modifications, interruptions, and barriers to implementation, as well as a request for feedback on the Commercial & Industrial Custom and New Construction Program. It also mentions confidentiality and data collection for an evaluation report.

tion report) and we hope that they will contribute to improving program performance. If we need to clarify some of your answers, we might call you back. Your name Date Phone number E-mail Ref.: 5725 95 Commercial & Industrial Custom and Ne...

AI summary This document is a process evaluation questionnaire for the Custom Program (Existing Commercial and Industrial) under the ENSC Energy Efficiency Program. It asks participants to provide feedback on their role, relationship with the Program Administrator and Project Coordinator, and other general questions.

ou characterize your relationship with the ENSC Program Administrator and/or the Project Coordinator? Program Administrator Score: Not applicable Project Coordinator Score: Not applicable Ref.: 5725 96 Commercial & Industrial Custom and Ne...

AI summary The evaluation report discusses the Commercial & Industrial Custom and New Construction Program administered by Efficiency Nova Scotia Corporation. It includes questions about participant satisfaction, complaints, and suggestions for improvement. The report indicates that some participants had complaints, and there are opportunities for program enhancement.

2011 Evaluation Report Q6 – Do you have any suggestion to improve the program? No Yes Q6a- If you answered Yes, please explain the nature of the improvement(s): Q7 – On a scale from 1 to 10 (where 1 is very unsatisfied and 10 is very satis...

AI summary The text presents a series of evaluation questions related to a program, including inquiries about program improvements, satisfaction with marketing efforts, and the involvement of consultants in various program components such as energy audits and measurement and verification. It also includes references to the Commercial & Industrial Custom and New Construction Program and Efficiency Nova Scotia Corporation.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Q15- What is your opinion in regard to program on-course modifications? Easy to adjust to the way you work Requires minor changes to the way you work Requires major changes to the w...

AI summary The text contains survey questions from an evaluation report on Efficiency Nova Scotia Corporation's programs, focusing on program modifications, interruptions, complaints, and barriers to implementation. It also references a financial option evaluation related to the Commercial & Industrial Custom and New Construction Program.

Q19 – We would like to have your opinion on program performance regarding the two possible financial options which the program is offering (Energy Savings Account and C&I Custom Direct Enrollment). Thank you very much for your time and coo...

AI summary The text is an interview guide used in the 2011 evaluation of the Commercial & Industrial Custom and New Construction Program by Efficiency Nova Scotia Corporation. It aims to gather insights on program performance and potential spillover effects from participants.

r questions). In addition, this questionnaire should help shed light on the participant’s satisfaction in the program process and outcomes. Questions on other Potential Energy Efficiency Initiatives A1. Why did your company or organization...

AI summary The document contains a questionnaire aimed at gathering feedback from participants in the Commercial & Industrial Custom and New Construction Program regarding their reasons for participation, implementation of energy efficiency measures, and financial support received.

_ List of typical significant barriers, for reference purposes only: 1. (concern that actual bill savings would be less than estimated) 2. (lack of information to make an informed decision) 3. (rebate/incentive was too little) 4. (paperwor...

AI summary The document lists common barriers to program participation, including concerns about bill savings, lack of information, and paperwork challenges. It also references an evaluation report for the Commercial & Industrial Custom and New Construction Program by Efficiency Nova Scotia Corporation in 2011 and asks for suggestions to improve the program.

A Utility account manager 5. Someone within your company or organization 96. (Other, please specify: ) 98. (Don’t know/Don’t recall) 99. (Refused) Ref.: 5725 112 Commercial & Industrial Custom and New Construction Program Efficiency Nova S...

AI summary The text is part of an evaluation report for the Commercial & Industrial Custom and New Construction Program, focusing on free-ridership by asking participants whether they had plans to implement energy efficiency measures before joining the program.

2. No 98. (Don’t know) 99. (Refused) [READ FIRST TIME THROUGH ONLY] Now I would like to ask you to consider what actions you would have taken in the absence of the Custom Program. If your company or organization had not participated in the...

AI summary The text presents a survey question asking respondents to consider what actions they would have taken in the absence of the Custom Program, focusing on energy efficiency measures. It includes response options and instructions for administering the survey.

ame energy efficiency measures that you implemented through the program, but at a later date? _ Response _98 Don’t Know _99 Refused IF FR2c > 5, then ask: FR2cc. DO NOT POSE FR2cc IF DON’T KNOW OR REFUSED IN Q.FR2c You indicated in your re...

AI summary The text outlines a survey question regarding the likelihood of implementing energy efficiency measures at a later date if a program had not been available, followed by a series of response options. It also references an evaluation report for the Commercial & Industrial Custom and New Construction Program by Efficiency Nova Scotia Corporation in 2011.

ergy bills) 6. (Did not trust in energy professionals installing new measures) 96. (Other [SPECIFY: _]) 98. (Don’t know) 99. (Refused) You mentioned in a previous answer that there were some recommended measures in the feasibility study th...

AI summary The text includes survey questions about program participation, specifically whether participants implemented recommended energy efficiency measures after a feasibility study. It also references an evaluation report for the Commercial & Industrial Custom and New Construction Program by Efficiency Nova Scotia Corporation in 2011.

ere 1= ‘not at all important’ and 5 = ‘very important’, how important is reducing energy usage to your company or organization? [98 = Don’t know, 99 = Refused] do not accept a range B5. On a scale of 1 to 5, where 1= ‘not at all important’...

AI summary The text includes survey questions about the importance of reducing energy usage and managing energy costs for companies, as well as inquiries about the percentage of annual operating budgets attributed to energy costs and suggestions for improving the Custom Program. It also asks if a visual guide would have helped with program participation.

Program have facilitated your participation in the program? Would you say it would have facilitated your participation in the program significantly, somewhat, slightly or not at all? 1. Significantly 2. Somewhat 3. Slightly 4. Not at all 9...

AI summary The document includes survey questions related to program participation and firmographics, and references an evaluation report for the Commercial & Industrial Custom and New Construction Program by Efficiency Nova Scotia Corporation from 2011.

2011 Evaluation Report APPENDIX VIII – ON-SITE VISIT PROTOCOLS The on-site visit protocols for the C&IC and CINC programs are attached in PDF format to this report. Ref.: 5725 122 Commercial & Industrial Custom and New Construction Program...

AI summary This section of the 2011 Evaluation Report outlines the sampling plan for the C&IC program, emphasizing the importance of project size in selecting a representative sample. Larger projects, which have a greater impact on overall energy savings, are prioritized in the sampling process.

out of the 146 projects of 2011. After having applied the project size criterion, the Evaluator looked at the source of claimed energy and demand savings to guide project selection in stratum 1 to 3. In the list of 40 projects, only two pr...

AI summary In the 2011 evaluation report, 40 projects were analyzed under the Commercial & Industrial Custom and New Construction Program. Projects using M&V for savings verification were prioritized over those relying on PDA. The program includes a wide range of energy efficiency measures, which introduces challenges in impact evaluation due to varying verification efforts.

a The “Various” category of energy efficiency measures includes the following types of projects: HVAC improvements, uninterruptible power supply (UPS) upgrades and projects described as “Various.” After having automatically selected the fi...

AI summary The document discusses the distribution of energy efficiency measures, highlighting overrepresentation of certain categories like 'Street Lighting' and 'Lighting Retrofit and Other' and underrepresentation of 'Lighting Retrofit Only' and 'Various' in project selection. It also addresses the influence of market sectors (commercial, industrial, municipal) on project feasibility and sampling.

a 1 to 3 (refer to the Project Size criterion). The following figure compares the final sample distribution of total energy savings per market sector with that of the total population of 40 projects. Ref.: 5725 126 Commercial & Industrial...

AI summary The document discusses the sampling criteria for the Commercial & Industrial Custom and New Construction Program, including project size and location. Projects located more than 200 km from major urban centers were excluded, resulting in the removal of three projects from the sample.

= Program factors FR4_NP = SUM(f; g) Factors f and g = Non Program factors 100% - PA3 Score: [FR4_P/(FR4_P+FR4_NP)] FR2c. In the absence of the program, what is the likelihood that you would IF FR2c > 5 : ASK FR2cc have implemented exactly...

AI summary This text outlines a program evaluation framework that assesses the likelihood of implementing energy efficiency measures without the program, using a scoring system based on time delays and their impact on the program's effectiveness.

in order to enhance energy savings by lowering the hours of operation. Finally, ENSC developed a participant process flow chart in 2011 in order to make the program participation procedures clearer. Ref.: 5725 v Small Business Energy Solut...

AI summary The 2011 evaluation of the Small Business Energy Solutions Program showed significant growth in participation and energy savings, with 1,468 participants and 23.176 GWh of net electricity savings. Participant satisfaction is high, though paperwork and application assistance received lower ratings and require monitoring.

sfaction ratings compared with 2010 findings and should therefore be closely monitored: the paperwork and procedures required to receive incentives and the assistance provided for program application. Participants were also asked to expres...

AI summary The document highlights participant feedback on a lighting program, noting high satisfaction but a slight decline from the previous year. Changes in 2011, such as allowing delivery agents to choose vendors, may have influenced this. Participants recommend improving communication, marketing, and information dissemination. ENSC plans to expand the program beyond lighting in 2012.

munication need to be observed closely considering the fact that more changes will be made to the program in 2012. Indeed, ENSC is planning on including measures other than lighting to the program. Ref.: 5725 vi Small Business Energy Solut...

AI summary The evaluation of the Small Business Energy Solutions (SBES) program in 2011 found net energy savings of 23.176 GWh and demand savings of 6.820 MW. Free-ridership was estimated at 12.8%, and internal spillover at 0.8%, resulting in a net-to-gross ratio of 0.88.

Net-to-Gross Ratio 0.88 The evaluation revealed that the SBES program had generated net energy savings of 23.176 GWh and demand savings of 6.820 MW at the generator in 2011. Table 2: Comparison of Tracked and Evaluated Savings at the Gener...

AI summary The evaluation of the Small Business Energy Solutions (SBES) program in 2011 found that it generated 23.176 GWh of net energy savings and 6.820 MW of demand savings at the generator. The net-to-gross ratio (NTGR) was 0.88, indicating that tracked savings were slightly higher than evaluated savings.

valuation should be modified in the Demand Side Management Data System. Correcting these values will ensure that uniform wattage values are used for savings calculations. SBES-R2. Enhance marketing and advertising to increase program aware...

AI summary The text discusses the need to correct wattage values in the Demand Side Management Data System to ensure uniformity in savings calculations. It also highlights the need for improved marketing and advertising efforts for the SBES-R2 program to increase awareness and participation, particularly among landlords and property management companies in urban areas.

arger non- residential buildings. Overall, participants as well as program partners agree that broader marketing efforts should be deployed to increase program awareness. SBES-R3. Require additional information during survey campaigns with...

AI summary The evaluation report for the Small Business Energy Solutions (SBES) program suggests that broader marketing efforts are needed to increase awareness. It also recommends collecting more detailed information from participants and increasing the number of on-site visits to improve the accuracy of program evaluations and installation ratios.

Efficiency Nova Scotia Corporation 2011 Evaluation Report 2 METHODOLOGY 2.1 METHODOLOGICAL MODEL Figure 2 below illustrates the research strategy used for the 2011 evaluation and features the collection tools used. Copies of the interview...

AI summary This section of the 2011 Evaluation Report outlines the methodology used to evaluate the Small Business Energy Solutions (SBES) program. It includes the analysis of program documentation, an interview with the Program Manager, and the use of various sources such as the ENSC website, previous evaluation reports, and program manuals.

program barriers; > program marketing and outreach strategy; > participation forms and flow charts; > role of the program partners; and > prior evaluation recommendations. Based on the results of the PM interview, the list of questions and...

AI summary The evaluation of the Small Business Energy Solutions (SBES) program involved interviews with program partners and on-site visits to validate the implementation of energy efficiency measures. These activities aimed to assess program barriers, marketing strategies, and participant satisfaction.

Efficiency Nova Scotia Corporation 2011 Evaluation Report The methodology used for the on-site visits for the SBES program is further explained in the program impact evaluation section of this report. A copy of the site visit protocol is i...

AI summary The 2011 Evaluation Report discusses the methodology used for on-site visits in the SBES program and mentions a participant survey conducted by Econoler’s subcontractor, CRA, involving 61 participants. The survey aimed to understand program features such as participant motivations, satisfaction, and future intentions.

as well as the associated sampling error at the 90 percent confidence level for the 2008, 2009, 2010 and 2011 telephone surveys. Table 3: Sample Size and Sampling Error Sampling Error at 90% Survey Population Sample Size (n) Confidence Int...

AI summary The process evaluation of the Small Business Energy Solutions Program focuses on assessing the effectiveness of the program's design and delivery. It was conducted through interviews with the Program Manager and Delivery Agents, as well as a telephone survey of program participants.

am performance. This process evaluation was performed through interviews with the PM and with the DAs, as well as through a telephone survey of program participants. 3.2 PROGRAM MANUAL CONTENT The SBES program features a manual that contai...

AI summary The evaluation of the SBES program involved interviews with the PM and DAs, as well as a telephone survey of participants. The program manual includes components such as program description, objectives, incentives, eligibility criteria, and cost-effectiveness test results, tailored for internal use by program staff and evaluators.

Efficiency Nova Scotia Corporation 2011 Evaluation Report SBES Program Program Manual Content Manual Market study or technical study that supports program elements or assumptions Marketing plan Evaluation plan Program theory Logic model Pr...

AI summary Econoler evaluated the SBES program manual and found it contains useful information on responsibilities, eligibility criteria, and administrative forms. However, it lacks critical information that makes understanding the program design and delivery difficult, with some issues being minor and others more significant.

to be inspected should be explained in the program manual. Also a standard inspection report could be designed and used as a performance indicator for management and evaluation purposes. > Complete the program manual to keep track of chang...

AI summary The text emphasizes the need for a standardized program manual to track changes and serve as a reference for program management and evaluation. It highlights the importance of updating program manuals, providing two examples related to the SBES program, including a name change and modifications to vendor selection processes.

everal adjustments must be made in the future to allow the validation of savings calculations, improve tracking sheet consistency and facilitate program evaluation. The Evaluator recommends that ENSC: > Present the detailed characteristics...

AI summary The Evaluator recommends several improvements to the tracking sheet used for program evaluation, including detailing measure characteristics, identifying lighting controls, and streamlining data fields to improve accuracy and efficiency in savings calculations.

nsure that the information is systematically entered in these fields. Conversely, the fields that are not used should be removed from the tracking sheet in order to focus on useful data. > Make sure that all fields are systematically fille...

AI summary The document emphasizes the importance of systematically filling in all fields on the tracking sheet to ensure accurate data collection. It highlights that certain fields, such as building type and proposed hours of operation, had significant missing data in the 2011 tracking sheet, which could impact future evaluations and savings validation.

Efficiency Nova Scotia Corporation 2011 Evaluation Report > Set limitations for entries and develop a validation process: To ensure that incorrect values are not entered in the tracking sheet, a validation process should be developed by EN...

AI summary The 2011 Evaluation Report discusses modifications to the SBES program, including the introduction of multiple material vendors, new lighting controls, and a participant process flow chart to improve program implementation and energy savings.

ogram without affecting other programs will generate additional savings. Finally, ENSC developed a participant process flow chart in 2011 in order to make the program participation procedures clearer. ENSC is planning to change the program...

AI summary ENSC is planning to update the SBES program in 2012 by expanding beyond lighting measures. The Evaluator recommends replacing current DAs with more versatile organizations and developing an evaluation plan in parallel with program design to ensure rigorous evaluation and better program outcomes.

programs, three reported participating in one NSPI lighting program (without providing more detail as to the specific program). Table 5: Previous Program Participation Other Program Participation 2011 Sample Size 61 Yes 11% No 87% Don’t kn...

AI summary The document discusses the SBES program's participant awareness, noting that 51% learned about it through word of mouth, 34% through ENSC staff, and 30% through other or previous participants, indicating strong program satisfaction and momentum.

Satisfaction with SBES Program 2008 2009 2010 2011 Sample Size 50 50 65 61 Overall program 100% 94% 97% 87% Capabilities of installers or 96% contractors doing installation work Audit technician 93% 99% 90% 93% Rebate/Incentive amount 96%...

AI summary The text presents satisfaction survey results for the SBES Program from 2008 to 2011, including feedback on various aspects such as installer capabilities, audit quality, rebate amounts, and customer interactions. Satisfaction levels vary across different categories and years.

86% to receive incentives Assistance with program application 98% 98% 94% 85% Completion of the project on 87% 90% 84% 84% schedule % very satisfied / satisfied Don’t know/refused removed from calculations Ref.: 5725 21 Small Business Ener...

AI summary The evaluation report highlights that while most participants in the Small Business Energy Solutions Program were satisfied with the lighting equipment installed, there was a notable drop in satisfaction with aspects such as flickering, lifespan, light quality, and energy savings. This decline coincides with a change in the material vendor in 2011, prompting a recommendation to closely monitor the program's product quality.

t suggested improvements to the SBES program. Accelerating the process was also suggested by five percent of respondents. Over half of the 2011 respondents could not provide an improvement suggestion. The following are participant comments...

AI summary The 2011 evaluation report of the Small Business Energy Solutions Program highlights the need for improvements in marketing, communication, and program clarity. Participants emphasized the lack of awareness and difficulties in understanding audit results and the slow approval process.

ts needed to be made to program marketing and advertising as a number of customers who could be aware of the program were not. Table 16: Suggested Improvements to the SBES Program Suggestions 2011 Sample Size 61 Increase advertising/market...

AI summary The SBES program faced challenges with customer awareness and understanding, as over half of the respondents in 2011 indicated they would have found a diagram illustrating the program steps helpful. The development of a participation process flow chart in late 2011 was seen as a positive step to improve clarity and engagement.

. This result indicates that the participation process flow chart developed by ENSC in late 2011 was a good initiative as it will potentially simplify the involvement of future program participants. Table 17: Provision of a Diagram Illustr...

AI summary The participation process flow chart developed by ENSC in late 2011 was considered a good initiative as it could simplify future program participation. Table 17 shows survey responses on how the diagram would have facilitated participation in the SBES Program.

aimed at determining the gross and net savings of the program for 2011. Both energy and demand savings were considered in this evaluation. To do so, the following parameters were analyzed by Econoler: > unitary wattage of the lighting prod...

AI summary The evaluation of the program's energy and demand savings for 2011 considered various parameters such as unitary wattage, hours of operation, and free-ridership. Data was collected through on-site visits, program tracking sheets, and participant surveys to assess gross and net savings, including interactive effects and diversity factors.

rovided information to calculate the net-to-gross ratio (NTGR) for this program, including free-ridership and internal spillover. The NTGR established was used to calculate the program net savings. Ref.: 5725 24 Small Business Energy Solut...

AI summary The document discusses the calculation of the net-to-gross ratio (NTGR) for the Small Business Energy Solutions Program, including free-ridership and internal spillover. It also outlines the sampling methodology used in the 2011 evaluation report, focusing on project categorization and data retrieval.

allowing for duplication in case on-site visits could not be scheduled for some sites in the first sample. For large duplicate sites, the selection included sites located outside of the desired zones. Finally, it is to be noted that the 15...

AI summary The document outlines the methodology used for on-site visits and data collection during a program evaluation, including the installation of time-of-use loggers and the collection of information on product installations and facility usage. It also mentions the calculation of gross savings based on program tracking data and on-site visits.

1, a total of 17,378 closed measures were identified, based on the information in the tracking sheet and collected for most of the “Rise” jobs. The allocation of gross savings to different categories Ref.: 5725 26 Small Business Energy Sol...

AI summary The document discusses the evaluation of the Small Business Energy Solutions Program, including the allocation of energy savings from the 'Rise' project and the review of unitary wattage values for different types of energy efficiency measures. Savings were allocated based on available data and proportions from other measures.

in future evaluations. The Evaluator recommends increasing the number of sites where data loggers are installed in order to obtain a more reliable self-declaration ratio. 4.2.3 Installation Rate The installation rate of the program was ass...

AI summary The evaluation of the Small Business Energy Solutions Program highlights the need for more data loggers and on-site visits to improve the reliability of installation and self-declaration ratios. Discrepancies between on-site data and tracking sheets suggest potential issues with reporting and updates.

2011 Evaluation Report Table 20: Evaluation Results – Gross Energy and Demand Savings

AI summary The 2011 Evaluation Report presents Table 20, which outlines the results of an evaluation focusing on gross energy and demand savings. The table likely contains data related to energy efficiency programs and their impact on energy consumption and demand.

on of industrial customers, rendering the information collected difficult to use for other C&IC programs. Sites with electric heating systems were over-represented in the sample used for EP-DI on-site visits. Information for a total of 34...

AI summary The evaluation of the interactive effects factor for lighting products in commercial buildings indicates that electric heating with air conditioning leads to a significant reduction in energy savings, while no electric heating with air conditioning shows a slight increase. The report recommends collecting more detailed data on heating sources and air conditioning usage in future evaluations.

hting measures for regular spaces, the total gross energy and demand savings at the meter for the SBES program are estimated at 24.449 GWh and at 7.209 MW, respectively. 4.4 NET-TO-GROSS RATIO The NTGR evaluation of the program is based on...

AI summary The evaluation report discusses the Net-to-Gross Ratio (NTGR) for the Small Business Energy Solutions (SBES) program, focusing on free-ridership and internal spillover effects. The NTGR is calculated using a self-report approach based on participant survey responses.

ition to program influences. Econoler’s approach is consistent with evaluation, measurement and verification methods used in other jurisdictions such as California, New York, Oregon and Pennsylvania. Using this approach, the survey results...

AI summary The evaluation of the Small Business Energy Solutions (SBES) program found a free-ridership level of 12.8 percent, close to the 13.6 percent from 2010. The report suggests revising rebate-eligible products to high-end items to reduce free-ridership. Internal spillover effects were also measured through participant surveys.

installed additional efficient lighting products following their previous participation in the program. Additional questions were used to verify the eligibility of the additional purchases by asking: > The date of the purchase to ensure it...

AI summary The evaluation of a program found low internal spillover, with only four out of 61 participants confirming additional energy-efficient lighting purchases after initial participation. These purchases contributed 4.71 MWh in energy savings, representing 0.8% of total savings. Follow-up calls were used to verify purchases and collect product details.

rchases correspond to energy savings attributable to the program totalling 4.71 MWh for these participants. Spillover represented 0.8 percent of total energy savings for all the participants surveyed. Using the free-ridership level establi...

AI summary The evaluation report estimates the net savings for the Small Business Energy Solutions Program in 2011, using the NTGR value and accounting for interactive effects. Total net energy savings at the generator are estimated at 23.176 GWh, while net demand savings are estimated at 6.820 MW.

Effects Energy Savings Tracked Savings 28.978 GWh 28.978 GWh 28.978 GWh 0.90 26.080 GWh from ENSC Evaluation Results 28.426 GWh 28.426 GWh 26.336 GWh 0.88 23.176 GWh Demand Savings Tracked Savings 8.536 MW 8.536 MW 8.536 MW 0.90 7.682 MW f...

AI summary The evaluation report for the Small Business Energy Solutions Program highlights energy and demand savings tracked and evaluated by Efficiency Nova Scotia Corporation in 2011. The results show slightly lower net savings due to an interactive effects factor from lighting products in non-refrigerated spaces.

of variables such as operating time, wattage or base consumption. The identification and value of each of these variables should be available and documented for validation and updating purposes. 5. Provide the parameters used to estimate t...

AI summary The text discusses the documentation and validation of variables such as operating time and wattage in energy efficiency programs, as well as the parameters used to estimate program objectives, including distortion and interactive effects. The program manual should document these parameters for tracking assumptions and annual adjustments based on evaluation results.

Program 6. Make explicit plans for post-installation inspections: The criteria or basis for Manual selecting projects to be inspected should be explained in the program manual. Content Also a standard inspection report could be designed an...

AI summary The document outlines recommendations for improving program manuals, including post-installation inspections, standardization of content, and updating program names and vendor policies. It emphasizes the need for a standardized template and continuous updates to ensure clarity and effective program management.

ual relationships in the program manual (section 8) should be modified in accordance with these changes. Program 8. Present the detailed characteristics of each measure and the Tracking corresponding unitary savings to allow for savings ca...

AI summary The document highlights issues with the Program Tracking Sheet in the Small Business Energy Solutions Program, noting that it lacks detailed information on measure components and lighting controls, which hinders the Evaluator's ability to validate savings calculations.

Program 10. Determine the required fields and remove the unnecessary ones: The PM Tracking together with the Evaluator should determine which fields are necessary for Sheet administration and evaluation purposes and ensure that the informa...

AI summary The text discusses the need to refine a program tracking sheet by removing unnecessary fields, ensuring systematic data entry, and implementing validation processes. It highlights issues with missing and inconsistent data in the 2011 tracking sheet, particularly in fields like building type, bill account number, and proposed hours of operation.

such as hours of operation will not exceed a defined range or that inconsistent postal codes are not entered in the database. Occurrences of these two inconsistencies were encountered in the database. The validation process could also be u...

AI summary The document discusses the need for improving data validation processes in energy efficiency programs and recommends replacing current DAs with more versatile organizations. It also emphasizes the importance of developing evaluation plans in parallel with program design and development.

y of products. There is no saying that the change caused such drop in satisfaction; however, Econoler still recommends closely monitoring this program aspect. Ref.: 5725 40 Small Business Energy Solutions Program Efficiency Nova Scotia Cor...

AI summary The text discusses the Small Business Energy Solutions Program operated by Efficiency Nova Scotia Corporation, noting a potential drop in satisfaction without attributing it to a specific cause, while recommending continued monitoring of the program.

74% 74% 69% Lease 22 26 25 31 Don’t know 2 Ref.: 5725 42 Small Business Energy Solutions Program Efficiency Nova Scotia Corporation 2011 Evaluation Report Respondents in the 2008, 2009, 2010 and 2011 samples represented a diverse variety o...

AI summary The text references an evaluation report for the Small Business Energy Solutions Program by Efficiency Nova Scotia Corporation, highlighting the diversity of business types represented in the 2008 to 2011 samples.

n Report Over eight out of 10 2011 respondents (84%) reported that their businesses were independent and not part of a larger company. Table 29: Type of Company Type of Company 2008 2009 2010 2011 Sample Size 50 49 62 61 Independent 84% 70...

AI summary The 2011 evaluation report for the Small Business Energy Solutions Program discusses survey data indicating that 84% of respondents were independent businesses, and 64% had only one business location in Nova Scotia. The report includes an interview guide for the program manager as part of the process evaluation.

- INTERVIEW GUIDE WITH PROGRAM MANAGER Process Evaluation Program Name: Small Business Energy Solutions Telephone Interview with the Program Manager Date: List of questions (Q) and comments (C) discussed Source: Evaluation Report 2010 Page...

AI summary This text discusses the evaluation of the Small Business Energy Solutions (SBES) program, including questions about the program's theory, incentives, structure, and eligibility criteria. It also mentions the program's name change from Small Business Direct Install and considerations for improving the program manual.

ng a minimum number of installations? Page 7 Q: If the main objective of ENSC is to save electricity, why are municipal utilities not eligible for the bill financing of 20% like the clients of NSP? Q: What is the proportion (%) of particip...

AI summary The text contains a series of questions raised during a regulatory proceeding regarding the Small Business Energy Solutions Program operated by Efficiency Nova Scotia Corporation. The questions focus on program eligibility, incentive levels, verification processes, and administrative procedures.

e participant) to only one organization? Attachment A (Program Flow Chart) Q: You are using the term labor vendor instead of material vendor. Is it the same? If yes why do you call them differently? C: This flow chart is for the internal u...

AI summary The text discusses various attachments and comments related to the Small Business Energy Solutions (SBES) program, including requests for clarification on terminology, document formatting, and program evaluation methods. Comments focus on improving clarity, participant engagement, and the structure of evaluation tools.

satisfaction (say from 1 to 10) for most of the questions instead of a straight yes or no or not sure. C: Replace question # 3, by if the score is under .8, ask for the reason(s). Source: General Q: Could you please describe who the progra...

AI summary The text outlines a process evaluation questionnaire for Efficiency Nova Scotia Corporation's Small Business Energy Solutions Program, aimed at gathering feedback from program partners regarding their roles, program design, barriers, cost-effectiveness testing, marketing strategies, and database usability.

t applicable It was the same Program Administrator I had to deal with a new PA The transition went smoothly The transition caused some delays or adjustments Other, please comment Q2 - On a scale from 1 to 10 (where 1 is very bad and 10 is...

AI summary The text is a survey related to the Small Business Energy Solutions Program administered by Efficiency Nova Scotia Corporation. It asks participants about their experience with the Program Administrator, satisfaction with the program, complaints received, and suggestions for improvement.

: Q7 – On a scale from 1 to 10 (where 1 is very unsatisfied and 10 is very satisfied), what is your satisfaction level in regard to the marketing and outreach activities to implement the program? Q 7a - If your answer to Q7 was equal to or...

AI summary The text includes survey questions about satisfaction with marketing and outreach activities for the Small Business Energy Solutions Program, relationship with partners, and lead generation. It also references an evaluation report and includes a reference number.

9b- The fact that now you chose your material vendor to get better prices has been a: Positive experience Negative experience Q10 – Who provides you with leads for potential participants? Ref.: 5725 53 Small Business Energy Solutions Progr...

AI summary The text contains survey questions related to the Small Business Energy Solutions Program delivered by Efficiency Nova Scotia Corporation. It asks about experiences with vendor selection, lead generation, market confusion, program name changes, modifications to the program, and complaints received during program delivery.

lved in the delivery of that program? Yes: If yes, from which party? (Please do not mention names, just the position of the party.) No Don’t know Q14a- What was the complaint about? Ref.: 5725 54 Small Business Energy Solutions Program Eff...

AI summary The text is part of an evaluation report for the Small Business Energy Solutions Program by Efficiency Nova Scotia Corporation. It includes a questionnaire for electricians and program partners to identify barriers to program implementation and gather feedback for improving performance.

Q7 – On a scale from 1 to 10 (where 1 is very unsatisfied and 10 is very satisfied), what is your satisfaction level in regard to the marketing and outreach activities to implement the program? Q 7a - If your answer to Q7 was equal to or l...

AI summary The text contains survey questions evaluating the Small Business Energy Solutions Program, focusing on participant satisfaction with marketing and outreach, relationship with partners, and market confusion. It references an evaluation report from Efficiency Nova Scotia Corporation in 2011.

rogram, did you experience or witness any confusion in the market among the parties, including yours and/or the participants? Yes: which ones? What was the confusion about? No Don’t know Ref.: 5725 59 Small Business Energy Solutions Progra...

AI summary The text is from an evaluation report of the Small Business Energy Solutions Program by Efficiency Nova Scotia Corporation. It includes questions about program name changes, modifications, complaints, and barriers to implementation. The report seeks feedback on the program's operation and effectiveness.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Thank you very much for your time and cooperation. Your answers will be treated in total confidentiality (no names will ever be mentioned in the evaluation report) and we hope that...

AI summary The document is an evaluation report for the Small Business Energy Solutions Program by Efficiency Nova Scotia Corporation, including an interview guide for contractors. It outlines procedures for completing a questionnaire and emphasizes confidentiality.

ions Please indicate your company name: Q1 - How would you define your role(s) as an ENSC energy efficiency program partner? Q1a – How long have you had that role (specify months or years)? Q1b - If you were a program partner before it cha...

AI summary The text is a set of questions directed at ENSC energy efficiency program partners, asking about their roles, the transition from Nova Scotia Power to ENSC, and their relationship with the ENSC Program Administrator. It also inquires about complaints received from program participants.

a score? Reason(s): Q3 – Did you receive any complaints from participants in the program? Yes What was (were) the complaint(s) about? No Don’t Know Refused Not applicable Ref.: 5725 63 Small Business Energy Solutions Program Efficiency Nov...

AI summary The text is a portion of a 2011 evaluation report for the Small Business Energy Solutions Program by Efficiency Nova Scotia Corporation. It includes survey questions about program participation, complaints, satisfaction levels, and suggestions for improvement.

Efficiency Nova Scotia Corporation 2011 Evaluation Report Q8 – Last year, have you been interviewed by another evaluator about the same program? Yes No Not applicable Q8a – If you answered Yes to Q8, we would like your opinion on the frequ...

AI summary This document is part of an evaluation report for the Small Business Energy Solutions Program conducted by Efficiency Nova Scotia Corporation in 2011. It includes questions about program evaluation, partnerships, market confusion, and program modifications.

Program)? Q13- What is your opinion in regard to program on-course modifications other than the change of program name (e.g., more products to install, expand territory or any other modification)? Easy to adjust to the way you work Require...

AI summary The text includes survey questions about program modifications, complaints, and barriers to implementation related to the Small Business Energy Solutions Program. It also references an evaluation report from 2011 by Efficiency Nova Scotia Corporation.

, or utility account manager]. Name: _ Telephone #: (Note: Thank and terminate call. Schedule interview with best contact regarding experience with the program.) V5. According to our information, through its participation in the Small Busi...

AI summary This text outlines a survey related to the Small Business Energy Solutions Program, asking participants about their prior involvement in other energy efficiency programs. It includes instructions for interviewers and questions about program participation and previous purchases.

Efficiency Nova Scotia Corporation 2011 Evaluation Report P8. What purchases of energy-efficient lighting products had your company or organization made before participating in the Small Business Energy Solutions Program? (Record all that...

AI summary The text includes survey questions from an evaluation report on the Small Business Energy Solutions Program, focusing on prior energy-efficient lighting purchases and potential free-ridership. It asks participants if they had plans to install energy-efficient lighting before joining the program.

4. 2 to less than 3 years later? 5. 3 to less than 4 years later? 6. 4 or more years later? 7. (Never) 98. (Don’t Know) 99. (Refused) FR3. Efficiency Nova Scotia paid up to 80% of the $[TOTAL PROJECT COST] total project cost. If your compa...

AI summary The text presents survey questions related to the impact of Efficiency Nova Scotia's incentives on project decisions and the importance of various factors in implementing energy-efficient lighting products. The survey includes response scales and is part of an evaluation report for the Small Business Energy Solutions Program.

-D exit signs? 1. Yes 2. No 98. (Don’t know) SP4h. Other energy-efficient lighting products? 1. Yes 2. No 98. (Don’t know) SP5. [IF SP3 = 2 ‘NO’] Did your experience with the energy-efficient lighting products installed through the Small B...

AI summary The text includes survey questions related to the Small Business Energy Solutions Program, focusing on the use of energy-efficient lighting products and customer satisfaction with the program. It also references an evaluation report from Efficiency Nova Scotia Corporation from 2011.

Visual check of spare baseline parts if still in stock, for example: magnetic, electronic, etc.): Type – Fluorescent lamp ballasts installed (From database for example: magnetic, electronic, etc.): Ref.: 5725 86 Small Business Energy Solut...

AI summary The text provides a template for evaluating the Small Business Energy Solutions Program, focusing on the verification of fluorescent lamp ballasts, baseline lamps, and new fluorescent lamps installed. It includes data collection methods such as database checks, on-site validation, and contact declarations to ensure accuracy and compliance.

/Visual check of spare baseline parts if still in stock): Number – Baseline lamps (From database): Number – Baseline lamps (Contact declaration): Number – CFL Hardwire installed (From database): Ref.: 5725 88 Small Business Energy Solution...

AI summary The document contains data collection forms for evaluating the Small Business Energy Solutions Program, including metrics on baseline lamps, CFL installations, power usage, and facility usage patterns. This information is used for program evaluation and energy efficiency assessment.

MEAN VALUE OF : Final Free-Ridership (PA1 ; PA2 ; PA3 ; PA4) Ref.: 5725 99 Small Business Energy Solutions Program Efficiency Nova Scotia Corporation 2011 Evaluation Report Subsequently, the final free-ridership level calculated for each p...

AI summary The text discusses the methodology used to calculate the final free-ridership level for the Small Business Energy Solutions Program, including two inconsistency tests applied to participant responses and the calculation of the program's average free-ridership level using weighted averages.

hieved............................................ 8 3 CONCLUSION............................................................................................................................ 10 List of Tables Table 1 : Summary of Results .....

AI summary This document outlines an evaluation of energy efficiency projects at New Page's Port Hawkesbury paper mill, conducted by Econoler based on a measurement and verification report by EPS. The evaluation is part of the 2011 Efficiency Nova Scotia Corporation program review.

eliminary report. Mr. Frith estimates that this element is likely the element responsible for the significant increase in performance observed in the whole plant energy usage analysis. Measure No. 5 Another possibility for the additional s...

AI summary The evaluator concludes that the energy savings reported for the New Page, Port Hawkesbury plant are a fair representation of actual savings. However, some factors like feedstock and product characteristics were not sufficiently discussed in the report, though their impact on energy usage is considered minimal.

8a. Claims of electrical energy savings may not reflect the true costs of high salaries and instituting and administering the various programs via the Efficiency Nova Scotia Corporation. Close review of section 5:3 of (Ref. #4 NSUARB‐E‐ENS...

AI summary The text critiques claims of electrical energy savings by Efficiency Nova Scotia Corporation (ENSC), arguing they omit true costs like salaries, administration, and NSURB involvement. It highlights rate hikes tied to shareholder obligations of Nova Scotia Power Inc. (NSPI) and Emera, questioning NSURB's role in prioritizing consumer interests over corporate profits. Dismantling ENSC is suggested to redirect savings toward staff expenses.

I. Executive Summary This report is a savings verification review conducted by H. Gil Peach & Associates, LLC for the Nova Scotia Utility and Review Board (Board). It reports on verification of savings estimated by Econoler, the Independen...

AI summary The report by H. Gil Peach & Associates, LLC for the Nova Scotia Utility and Review Board verifies savings estimates from Econoler for the DSM Administrator's 2011 programs. It reviews evaluation methods, data tracking, and QA/QC processes to recommend adjustments to savings data.

Demand-Side Management In understanding how DSM works, probably the most important thing is to see it not as a single activity but as a cycle of repeated activities subject to continuous process improvement . Figure 1 emphasizes the DSM cy...

AI summary Demand-Side Management (DSM) is described as a cyclical process involving planning, implementation, evaluation, and savings verification, with continuous improvement. Nova Scotia Power, Inc. initially administered DSM programs, transitioning to Efficiency Nova Scotia Corporation in 2010. The 2011 program year marked the first full cycle under Efficiency Nova Scotia, emphasizing iterative feedback loops and maturing programs after five years.

The 2011 program evaluation was carried out by Econoler. This is the first year Econoler has served as the independent evaluator. Econoler's full evaluation report is a document of 1,474 pages consisting of an impact evaluation for each of...

AI summary In 2011, Econoler conducted the first independent evaluation of the programs, producing a 1,474-page report. The evaluation included impact and process assessments for multiple programs, as well as the development of a Net-to-Gross methodology. ENSC also commissioned a socket study and an independent review of energy impacts at the New Page paper mill.

The 2011 Savings Verification Study The focus of the Savings Verification study is on energy savings and demand reduction impacts. We also reviewed the process evaluations and were observant over the year regarding organization and procedu...

AI summary The 2011 Savings Verification Study evaluates energy savings and demand reduction impacts of programs managed by the DSM Administrator. Key focus areas include Econoler's methodological updates (interaction effects, Net-to-Gross estimation), program tracking system usage, and evaluation of free-ridership/spillover methods. The study highlights the need for improved adoption of the Program Tracking System and confirms the clarity of Econoler's adjustments.

Primary Findings and Recommendation There are two primary findings and one primary recommendation in this 2011 Savings Verification study. Finding SV1 We find that Efficiency Nova Scotia Corporation's implementation and ongoing administrat...

AI summary The 2011 Savings Verification study found Efficiency Nova Scotia Corporation's programs were well executed, with no major issues. Econoler's evaluations were deemed methodologically sound, using industry-standard frameworks and Canadian data sources. The recommendation is to accept Econoler's energy savings results without adjustment.

Specific Action Items Improvements in evaluation methods to improve validity (balanced by reasonable cost) as well as some improvements in related areas are listed below as action items. Response to each of the following recommendations sh...

AI summary The document emphasizes improving DSM program evaluation through direct measurement and passive monitoring over modeling and social science methods. It recommends increased use of Nova Scotia Power's customer data and physical measurements to enhance validity and transparency of energy efficiency impact evaluations.

Recommendation SV9 [Related to Evaluation Recommendation ARet-R3] Econoler recommends metering refrigerators and freezers at the recycling facility. We support the metering recommendation but recommend the metering be conducted or be overs...

AI summary Econoler recommends metering refrigerators/freezers at recycling facilities, advocating for oversight by Efficiency Nova Scotia or Econoler to avoid conflicts of interest. They oppose implementing M&V standardization for the Commercial & Industrial Custom Program in 2012 due to practical challenges.

ENSC Evaluation ENSC Evaluation Free Rider (%) Spillover (%) Interactive Effects (Melded) Net Savings (GWh) Gross Savings w/ Interactive Effects (GWh) Net-to Gross Net Savings (GWh) ENSC Net Savings (MW) Gross Savings w/ Interactive Effect...

AI summary The recommendation suggests that the 2012 Evaluation report should include a section with citations to studies supporting adjustment factors, linked to the relevant programs. This would enhance transparency and understanding of the adjustments made.

II. The Individual Program Evaluations The developments of the Econoler estimates of energy savings and demand reduction attributable to each DSM program were carefully reviewed. As indicated above (Recommendation SV1), our opinion is that...

AI summary The document reviews Econoler's estimates of energy savings and demand reduction from DSM programs, finding them reasonable. It supports evaluator recommendations on impact assessment methods and results, excluding others like program marketing. Key focus is on validating energy savings estimates and endorsing specific evaluation approaches.

(1) Residential Appliance Retirement Program (ARet) This Appliance Retirement Program involves the pickup and disassembly of old refrigerators, freezers, room air conditioners and dehumidifiers for all of Nova Scotia. This program provides...

AI summary The Residential Appliance Retirement Program (ARet) recycles old appliances in Nova Scotia, offering rebates for eligible items. A 2011 metering study informed energy savings calculations, with Econoler's methods deemed reasonable. Net savings exceeded ENSC estimates by 71%, and two Econoler recommendations—collecting capacity data and on-site metering—are supported to improve accuracy.

(2) Residential Appliance Replacement Program (ARep) Appliance replacement serves multi-unit residential apartment buildings and is a resource acquisition program. It combines provision of new energy efficient refrigerators and freezers at...

AI summary The Residential Appliance Replacement Program (ARep) replaces inefficient refrigerators/freezers in multi-unit buildings with Energy Star appliances, offering rebates and removing old units. Econoler evaluated savings using data from the ARet program and Energy Star metrics, assuming zero electric interactive effects and no free ridership due to low participation. Net savings estimates were 200% of ENSC-tracked values, with a recommendation to validate Energy Star qualifications in tracking sheets.

(3) Retail Markdown Program (RMP) The Retail Markdown Program is a resource acquisition and market transformation program cooperative with retail stores and combines promotion with a buy down of price of energy efficient products which ran...

AI summary The Retail Markdown Program (RMP) promotes energy-efficient products through retail partnerships and price reductions. Evaluation highlights interactive effects reducing savings by 18.5%, with recommendations to improve measurement via exit surveys (RMP-R2) and expanded retailer interviews (RMP-R3) to capture program impacts on retail practices.

(4) LED Holiday Light Exchange Program The lighting exchange is a seasonal program. One set of LED bulbs is exchanged for the trade in of two sets of older energy wasting bulbs. The addition of an interactive effects factor and adjustment...

AI summary The LED Holiday Light Exchange Program exchanges one set of LED bulbs for two sets of older, energy-inefficient bulbs. Adjustments for interactive effects, diversity, and line loss reduced evaluated savings below tracking levels, but the methods used for these adjustments are deemed appropriate.

(5) Low Income Renter Program (LIR) The Low Income Renter pilot program was started in 2011 in cooperation with municipal and provincial housing authorities in different locations in Nova Scotia. To be eligible to participate, a household...

AI summary The Low Income Renter (LIR) program, initiated in 2011, provides energy efficiency measures to eligible low-income renters in Nova Scotia. Measures include CFLs, LED lights, and insulation. Interactive effects were deemed negligible except for lighting, insulation, and hot water tank wraps. Econoler's recommendations to increase on-site validation and collect more data for precise savings evaluation are supported.

(6) Multi-Unit Residential Renter Program (MURR) This direct install pilot program was started in 2011. Measures installed through the program are the same set of low-cost measures as installed through the Low Income Renters Program (aerat...

AI summary The MURR program, initiated in 2011, uses low-cost measures like aerators and CFLs. Power bars were misused in some cases, prompting a recommendation to improve their proper use through better information. The program's effectiveness is evaluated, with a focus on sustainability and energy savings.

(7) Efficient Products – Direct Install Program (EP-DI) The Efficient Products – Direct Install Program provides business and multi-unit residential buildings with free installation of energy-efficient products. Measures include CFLs, LED...

AI summary The EP-DI program offers free energy-efficient product installations for businesses and multi-unit residential buildings, including LED lights, thermostats, and insulation. A pilot program (Retail LED Direct Install) was launched in 2011. Evaluation metrics like Net-to-Gross effect (0.95) and free ridership (15.4%) are discussed. Econoler recommends improving data collection through enhanced tracking sheets, site visits, and detailed technical information gathering for better savings accuracy.

(8) EnerGuide for Existing Houses Program The EnerGuide for Existing Houses program provides support to homeowners to reduce use of electrical energy and fuel consumption. Financial assistance for fuels other than electricity is provided b...

AI summary The EnerGuide for Existing Houses Program, managed by Efficiency Nova Scotia Corporation, supports homeowners in reducing energy use through measures like programmable thermostats and insulation. Due to data limitations, a 'true-up' analysis adjusted savings estimates by 25%. Econoler recommended improving data collection, refining HOT2000 models, and enhancing billing analysis to improve accuracy. The Province supports these recommendations.

(9) Fuel Substitution Pilot (Fuel) The Fuel Substitution Pilot was started in 2011. This program allows participants to substitute a non-electrical heat system or domestic hot water system for all or a portion of their current electric hea...

AI summary The Fuel Substitution Pilot, launched in 2011, allows participants to replace non-electrical heating systems with electric ones. Free-ridership was 42%, attributed to early pilot status and dealer-driven awareness (50% of clients). Econoler noted this, and the text supports two Evaluation recommendations.

Evaluation - Fuel-R3 Improve the tracking sheet with additional information. Econoler recommends including capacities of the old and new system and clear project status information. This kind of information will improve ability to evaluate...

AI summary Econoler recommends enhancing the tracking sheet for the Fuel Substitution Pilot by adding system capacities and project status details to improve energy savings evaluation. A billing analysis using direct measurement from utility data is also suggested to assess heating energy consumption with a full baseline and post-measurement.

(10) Low Income Program The Low Income Program serves low-income homeowner households with two categories of energy efficiency measures. Scope 1 measures concern the building envelope. Scope 2 measures are everything else including the usu...

AI summary The Low Income Program (LI) provides energy efficiency measures for low-income homeowners in Nova Scotia, divided into Scope 1 (building envelope) and Scope 2 (other measures, including appliances and water heating). Funding combines electricity and provincial sources. Efficiency Nova Scotia manages the program, collaborating with multiple departments. Evaluation recommendations include verifying prescriptive measure installations and reviewing HOT2000 models for accuracy.

(11) Performance Plus Program (PP) The Performance Plus Program is the residential new houses program. It provides financial incentives to homeowners and builders to exceed the energy efficiency requirements of the building code. Modeling...

AI summary The Performance Plus Program (PP) incentivizes residential new homes to exceed building code energy efficiency. Econoler adjusted EnerGuide baselines and savings estimates, citing studies. Free-ridership was 42%, with 5% market effect. Four recommendations include expanding builder interviews, integrating HOT2000 data, random model revisions, and tracking electric heating percentages for accurate EnerGuide calculations.

(12) Business Energy Rebates Program (BER) The Business Energy Rebates Program provides financial incentives, through prescriptive rebates, to businesses throughout Nova Scotia for the purchase of a wide range of qualified energy efficient...

AI summary The Business Energy Rebates Program (BER) offers prescriptive rebates to Nova Scotia businesses for energy-efficient equipment, aiming to drive market transformation. Evaluation highlights 17.6% freeridership and a 0.83 Net-to-Gross ratio. Three recommendations are supported: improving tracking sheets, collecting detailed participant data, and increasing on-site visits for accurate savings estimation.

(13) Smart Lighting Choices Program (SLC) Smart Lighting Choices is an upstream lighting program that is designed to produce market transformation in the non-residential lighting sector by working through lighting distributors to buy down...

AI summary The Smart Lighting Choices Program (SLC) is an upstream initiative reducing non-residential lighting costs via distributor incentives. It includes the Upstream Business Energy Rebates (BER) subprogram. Evaluation highlights 19% free-ridership, 0.81 Net-to-Gross, and -7.7% interactive effect. Recommendations include standardizing distributor invoices and conducting customer surveys to improve evaluation accuracy.

(15) Small Business Energy Solutions Program – SBES The Small Business Energy Solutions Program provides direct installation of energyefficient lighting retrofits to small businesses and includes small government, institutional and health...

AI summary The SBES program offers energy-efficient lighting retrofits to small businesses, with clients covering 20% of costs. Efficiency Nova Scotia funds 80%, and financing options are available. Evaluations recommend improving tracking sheets for better savings validation and collecting more data on heat sources and air conditioning use to enhance impact estimation accuracy.

III. Discussion of Process Evaluation This Savings Verification study does not focus on the process evaluation. However, we provide the following definition: Process Evaluation – A systematic assessment of an energy efficiency program for...

AI summary The document defines process evaluation for energy efficiency programs and highlights Econoler's thorough evaluation methods, including interviews, surveys, and document reviews. It notes Econoler's focus on field processes and tracking sheets, though they omitted office process reviews. The evaluation aimed to improve program efficiency and participant satisfaction.

INTRODUCTION On May 19, 2010, a workshop was held by Nova Scotia Power's Demand Side Management team and a group of evaluation experts 1 to discuss a Nova-Scotia-based protocol for the assessment of free ridership, spillover and net-to-gro...

AI summary In 2010, Nova Scotia Power and experts discussed protocols for assessing free ridership, spillover, and net-to-gross (NTG) calculations. A 2011 order required Efficiency Nova Scotia Corporation (ENSC) to submit a methodology document for free ridership and spillover calculations. This report, titled Net-to-Gross Evaluation Methodology , outlines ENSC's approach, aligning with workshop suggestions and addressing the board's order.

Selected Approach The methodology selected for assessing net-to-gross ratios (NTGRs) for Efficiency Nova Scotia's programs relies on the self-report approach (SRA). The SRA involves the analysis of responses to survey questions that are de...

AI summary The self-report approach (SRA) is selected to assess net-to-gross ratios (NTGRs) for Efficiency Nova Scotia's energy efficiency programs. SRA uses survey data to estimate program impacts and energy savings. It was chosen for its feasibility and cost-effectiveness over other methods like econometric and cross-sectional approaches discussed in a 2010 workshop. Organizations such as ScanAmerica and Navigant Consulting were involved in the workshop.

2011 DSM Program Evaluation Efficiency Nova Scotia Corporation Net-to-Gross Evaluation Methodology timely manner and at a level of validity and reliability that is acceptable to key stakeholders in Nova Scotia. In particular, it provides a...

AI summary The 2011 DSM Program Evaluation by Efficiency Nova Scotia Corporation outlines improvements to the Net-to-Gross Ratio (NTGR) methodology, including a 0-10 scoring system and joint consideration of decision-making factors. The approach aligns with practices in California, New York, Oregon, and Pennsylvania, and emphasizes balancing cost, credibility, and error reduction. It also discusses periodic NTGR recalculation and the use of surveys to assess free-ridership.

NTG methodology The SRA methodology chosen for the evaluation of ENSC's programs includes the assessment of three distortion effects: - Free-ridership; - Internal spillover; and - Market effects. Free-ridership occurs when participants wou...

AI summary The SRA methodology evaluates ENSC's programs by assessing three distortion effects: free-ridership, internal spillover, and market effects. Free-ridership assessment requires careful timing of surveys to accurately measure program influence, as noted by the workshop group.

Free-Ridership The evaluation of free-ridership is based on responses from participant surveys. For each appliance retired, participants are asked a series of questions to determine what they would have done if the program had not been in...

AI summary Free-ridership is assessed via participant surveys in the Appliance Retirement program. Participants are classified as free-riders if they indicate they would have taken the same action (e.g., disposing of the appliance, unplugging it, or removing it within a year) without program participation. Specific free-ridership levels are assigned based on responses, with an average calculated per appliance.

1.2 Efficient Products – Appliance Replacement The Appliance Replacement program offers an incentive to multi-unit residential building owners for replacing old refrigerators with new ENERGY STAR qualified units. For the 2011 evaluation ye...

AI summary The Appliance Replacement program provides incentives for replacing old refrigerators with ENERGY STAR units in multi-unit residential buildings. Due to insufficient 2011 participants, no telephone survey was conducted to assess free-ridership or internal spillover effects, leading to unmeasured distortion impacts.

Free-Ridership For CFLs, a telephone survey with the general population is being used to measure the level of freeridership of each participant. Participants are considered to be free-riders when they declare they would still have bought t...

AI summary The document outlines methods to measure free-ridership for CFLs via telephone surveys and for refrigerators/washers through retailer interviews. Free-riders are those who would have purchased products without program rebates. Validation involves comparing retailer estimates with program influence.

Market Effects Retail Markdown program discounts are offered during two distinct periods: in the spring and in the fall. Between these periods, eligible product sales may take place due to the program's intervention. The general population...

AI summary The Retail Markdown program offers discounts in spring and fall, assessing market penetration of three products (CFLs, ENERGY STAR refrigerators, and ENERGY STAR clothes washers) via surveys and retailer interviews to evaluate long-term market effects.

Internal Spillover The participant survey is used to assess spillover. Participants are considered as contributing to spillover when they declare that they implemented eligible energy efficient measures on their own following their previou...

AI summary The participant survey assesses internal spillover by identifying if participants implemented energy-efficient measures independently after previous program participation. Additional questions gather details on the measure, implementation date, and program influence to quantify spillover.

1.6 Efficient Products – LED Holiday Light Exchange Program Each fall since 2005, the LED Holiday Light Exchange program has given the opportunity for Nova Scotians to exchange two sets of old holiday lights for one new set of LED holiday...

AI summary The LED Holiday Light Exchange Program, active since 2005, allows Nova Scotians to exchange old holiday lights for LED sets. Due to its small scale and lack of participant tracking, no distortion effects are measured for this program.

1.7 Existing Houses – EnerGuide for Existing Houses The EnerGuide for Existing Houses program fosters energy efficiency improvements in existing houses. A certified energy advisor performs a comprehensive examination of the house and provi...

AI summary The EnerGuide for Existing Houses program promotes energy efficiency improvements in existing homes through certified energy advisors who conduct comprehensive house examinations. The program aims to enhance residential energy performance and reduce consumption.

Free-Ridership The free-ridership level for this program is measured through questions included in a participant survey. Participants are considered to be free-riders when they declare they would have replaced their heating equipment if th...

AI summary Free-ridership is measured via participant surveys assessing whether replacements would have occurred without the program. Criteria include prior replacement plans, contractor contact, and timing. The Net-to-Gross Evaluation Methodology evaluates the program's influence on replacement decisions.

1.9 Low-Income Homeowner The Low-Income Homeowner program offers various energy efficiency measures to low-income homeowners. The measures targeted are building envelope upgrades as well as the installation of programmable thermostats, CFL...

AI summary The Low-Income Homeowner program provides energy efficiency measures such as building envelope upgrades and programmable thermostats. It assumes no significant distortion effects, leading to a net-to-gross ratio (NTGR) of 100%.

Free-Ridership The free-ridership level for this program is measured through questions included in a participant survey and in-depth builder interviews. A question is included in the participant survey that determines whether the decision...

AI summary The free-ridership level for the program is assessed via participant surveys and builder interviews. Homeowners are classified as free-riders if they indicate they would have achieved similar energy efficiency without the program. Criteria include building timelines, energy efficiency levels, and program influence on decisions.

Internal Spillover As is the case with the EnerGuide for Existing Houses program, the internal spillover associated with the Performance Plus program is assessed through a participant survey. Participants are considered as contributing to...

AI summary The document describes how internal spillover from the Performance Plus program is measured via participant surveys. Spillover occurs when participants adopt additional energy efficiency measures post-program, with follow-up questions assessing implemented measures, dates, and program influence. This mirrors the methodology used for the EnerGuide for Existing Houses program.

2 COMMERCIAL & INDUSTRIAL PROGRAMS

AI summary The section outlines regulatory considerations for commercial and industrial programs, including demand-side management (DSM) and net-to-gross (NTG) metrics. Key focus areas involve program design, efficiency targets, and compliance with NTGR benchmarks for energy usage.

Internal Spillover As the program promotes prescriptive measures associated with specific products including CFLs, LED exit signs and programmable thermostats, the spillover level of the program is assessed through a telephone survey. Part...

AI summary The program's internal spillover is evaluated via telephone surveys, identifying participants who independently installed eligible energy-efficient products post-participation. Spillover levels are quantified by assessing product type, purchase date, and program influence on the purchase decision.

2.4 Custom – Retrofit and New Construction The Custom program offers incentives and financing for energy efficient equipment including compressed air, industrial processes, refrigeration, motors, lighting and other electrical end-uses. The...

AI summary The Custom program provides incentives and financing for energy-efficient equipment in sectors like industrial processes and lighting. Participation requires a feasibility study and a measurement and verification (M&V) plan. Free-ridership is anticipated to be low due to these process requirements.

Free-Ridership A telephone survey is used to evaluate the potential free-ridership level. Participants are considered to be free-riders when they declare they would have implemented the efficiency measures without the incentive offered thr...

AI summary A telephone survey assesses free-ridership by identifying participants who would have implemented energy efficiency measures without program incentives. Key questions focus on whether measures would have been taken independently and if the program influenced decisions.

EP – APPLIANCE RETIREMENT - › Spillover will be measured through participant surveys for each appliance. - › Although SO is expected to be insignificant, participants will be asked whether they retired other appliances following their prev...

AI summary The appliance retirement program will measure spillover effects through participant surveys, asking if participants retired other appliances post-program and collecting data on appliance type, disposal methods, and program influence. Additional questions aim to quantify spillover by validating disposal details and assessing program impact.

EP – APPLIANCE REPLACEMENT - › No free-ridership or spillover effects will be measured for this program in 2011. - › The number of participants is insufficient to launch a telephone survey and evaluate a representative level of such effect...

AI summary The program assumes a 100% net-to-gross ratio for appliance replacement in 2011 due to insufficient participants for measuring free-ridership and spillover effects through a telephone survey.

EP – RETAIL MARKDOWN - › Free-ridership will be measured for three products using two different approaches. - › For CFLs, FR will be measured through participant surveys. - › Participants will be considered as FR when they declare that the...

AI summary The document outlines methods to measure free-ridership for three products, focusing on CFLs via participant surveys. Free-riders are those who would have purchased the product without the program rebate, assessed through questions on purchase intent, quantity, timing, and discount influence.

EP – LOW-INCOME DIRECT INSTALL - › No free-ridership or spillover effects will be measured for this program in 2011. - › This program offers free energy-efficient upgrades to lowincome households. - › Due to the nature of the projects and...

AI summary The Low-Income Direct Install program provides free energy-efficient upgrades to low-income households in Nova Scotia. It assumes no free-ridership or spillover effects in 2011 and deems distortion effects insignificant. The program's net-to-gross ratio (NTGR) is set at 100%, indicating all program costs are fully offset by energy savings.

EP – MULTI-UNIT RESIDENTIAL RENTER - › Free-ridership will be measured through participant surveys. - › Participants will be considered as FR when they declare that they would still have implemented the energy-efficient measures if the pro...

AI summary The document outlines a methodology to measure free-ridership (FR) in the EP – MULTI-UNIT RESIDENTIAL RENTER program. FR is defined as participants who would have implemented energy-efficient measures regardless of the program. Criteria include pre-program planning, number of measures, timing, and influence of the discount.

EP – DIRECT INSTALL (PART OF THE SOLUTION) - › Spillover will be measured through participant surveys. - › Participants will be considered as SO when they declare that their company installed eligible products on their own, following their...

AI summary The document discusses measuring spillover effects through participant surveys, defining participants as self-installers (SO) if they installed eligible products after previous program participation, and quantifying SO by product type, purchase date, and program influence.

EXISTING HOUSES – ENERGUIDE - › Free-ridership will be measured through participant surveys. - › Participants will be considered as FR when they declare that they would have implemented the energy efficiency upgrades anyway. - › The level...

AI summary The document outlines methods to measure free-ridership (FR) in energy efficiency programs through participant surveys. FR is identified if participants claim they would have implemented upgrades independently, using criteria like prior planning, number of upgrades, timing, and program influence on decisions.

EXISTING HOUSES – FUEL SUBSTITUTION - › Spillover will be measured through participant surveys. - › SO will occur when participants who have converted their system to gas declare that they also converted their kitchen ranges or their laund...

AI summary The text outlines methods to measure spillover (SO) in fuel substitution programs for existing houses. SO occurs when participants converting to gas also replace kitchen ranges or laundry equipment. Surveys will identify SO through targeted questions about converted equipment, conversion dates, and the program's influence on decisions.

LOW-INCOME HOUSEHOLDS - › No free-ridership or spillover effects will be measured for this program in 2011. - › This program offers financial incentives for building envelope upgrades as well as for the installation of programmable thermos...

AI summary The program targets low-income households with financial incentives for energy efficiency upgrades. It assumes no significant distortion effects and uses surveys/interviews to measure free-ridership (FR), spillover (SO), and market effects. FR is calculated based on decision-makers (homeowners vs. builders), while SO is assessed through post-participation energy measures. The net-to-gross ratio (NTGR) is set at 100%.

BUSINESS ENERGY REBATE - › Free-ridership will be measured through participant surveys. - › Participants will be considered as FR when they declare that they would have bought the efficient equipment without the rebate offered through the...

AI summary The Business Energy Rebate program measures free-ridership (FR) via participant surveys. FR occurs when participants claim they would have purchased efficient equipment without the rebate. FR levels are assessed based on equipment efficiency, purchase timing, and program influence on purchasing decisions.

SMART LIGHTING CHOICES - › Free-ridership will be measured through vendor interviews. - › As this program offers rebates at the retail level, only FR will be taken into account as distortion effect. - › In this case, FR corresponds to what...

AI summary The proceeding discusses measuring free-ridership (FR) via vendor interviews for the SMART LIGHTING CHOICES program. Only FR is considered a distortion effect due to retail-level rebates. FR is defined as potential market sales of T8 lamps and electronic ballasts without program implementation.

CUSTOM - › Free-ridership will be measured through participant surveys. - › FR for this program is expected to be low, considering the process requirement. - › Participants will be considered as FR when they declare that they would have im...

AI summary The program measures free-ridership (FR) via participant surveys, expecting low FR due to process requirements. Participants are classified as FR if they would have implemented energy efficiency measures without the rebate. FR determination involves three criteria: implementation intent, timing, and program influence.

SMALL BUSINESS ENERGY SOLUTIONS - › Free-ridership will be measured through participant surveys. - › Participants will be considered as FR when they declare that they would have bought the efficient lighting products without the financial...

AI summary The document outlines the method for measuring free-ridership (FR) in the Small Business Energy Solutions program through participant surveys. FR is defined as participants who would have purchased efficient lighting products without the program's financial incentives and free installation. Criteria include purchase intent, product efficiency, timing, and program influence.

5 Response IR-1: Acronym Definition RUL Remaining Useful Life SBES Small Business Energy Solutions SEP Superior Energy Performance SLC Smart Lighting Choices TRC Total Resource Cost UARB Nova Scotia Utility and Review Board WETT Wood Energ...

AI summary The response to IR-2 discusses variances in spending and savings for DSM programs. The Low Income Households program exceeded its budget and energy target due to increased participation, while the Small Business Direct Install program exceeded its energy target due to program improvements. EnerGuide for Existing Houses had a significant spending variance below budget.

21 With DSM Case No DSM Case Corporate Communicat ons and Outreach Website Update (architecture) $100,000 0.5 0.5 Development of web-based customer resources, i.e. How to Videos $120,000 0.9 0.1 Website/extranet development $60,000 0.5 0.5...

AI summary The text presents a comparison of costs between scenarios with and without a Demand Side Management (DSM) case, focusing on corporate communications, outreach, education, and research activities. The table includes various expenditures such as website development, advertising, community outreach, and research initiatives.

21 With DSM Case No DSM Case Website Update (architecture) $100,000 0.5 0.5 Development of web-based customer resources, i.e. How to Videos $120,000 0.9 0.1 Website/extranet development $60,000 0.5 0.5 General corporate information materia...

AI summary The text outlines various costs and allocations related to corporate communication, outreach, education, and research activities, including website development, advertising, community outreach, and research on energy efficiency programs and market penetration.

27 o Building Energy Estimation Business Sector 28 o Refrigeration Compressors Business Sector 29 o Air Compressor Systems Business Sector 30 o Refrigerators/Freezers Residential Sector 1 o Clothes Washers Residential Sector 2 o Small Netw...

AI summary The document outlines various sectors and categories of energy-related equipment and discusses the allocation of expenditures for Enabling Strategies, noting that ENSC will adjust cost assignments based on program needs. It also references a request and response related to the funding of DSM programs outside the Electricity DSM Fund.

10 2010 2011 2012 2013 2014 2015 31 30 30 30 30 30 11 1 Request IR-24: 2 3 a) Does ENSC have a "program manager" (or similarly otherwise titled individual) 4 responsible to liaise with each Large Industrial customer with respect to its DSM...

AI summary The document contains requests and responses related to Efficiency Nova Scotia Corporation's (ENSC) DSM programs, specifically regarding program management, customer surveys, and tracking of program measures by customer class. ENSC explains that account managers, rather than program managers, work with Large Industrial customers and that no surveys were conducted for DSM programs in 2013-2015. ENSC also discusses how it tracks program measures by customer class and how costs are allocated for certain programs.

1 Request IR-1: 2 3 Reference: ENSC Evidence, page 15, lines 5-9. "Dunsky recommends, and ENSC 4 concurs, that the UARB consider adopting a trigger mechanism whereby, if reported 5 results fall below 75 percent of the original plan's forec...

AI summary The text outlines a request and response regarding the adoption of a trigger mechanism for corrective action plans if energy savings fall below 75% of the original forecast. ENSC agrees to allow intervenors to comment on such plans and states that the plans would be included in annual progress reports, subject to stakeholder input and UARB direction.

Request IR-3: Please provide a breakdown, including investment, targets, TRCs and PACS for each sub- program within each of the major program area such as the Green Heating Program and Low Income Program within the Existing Residential Pro...

AI summary The response to Request IR-3 provides a breakdown of investment, targets, TRCs, and PACS for sub-programs within the Existing Residential Program, including the Green Heating Program and Low Income Program. It notes that TRCs for some sub-programs are below 1.0 due to projected lifetime benefits and program structure.

- 5 ample opportunity for the UARB and stakeholders to ensure oversight and accountability. 1 Request IR-5: 2 3 Please provide ENSC's views of the impact of a three year program versus a one year 4 program on projected Total Resource Cost...

AI summary ENSC discusses the impact of a three-year versus a one-year program on TRC and PAC tests, suggesting that a longer program cycle may reduce costs and improve ratios. Load forecasts from 2006 to 2011 are provided and compared with earlier IRP forecasts.

Energy Forecast Details 13 14 15 16 For forecasting, modeling and sales reporting, Nova Scotia electric load is divided into three sector requirements: residential, commercial and industrial. The relative sizes of sector sales are shown in...

AI summary The document outlines the division of Nova Scotia's electric load into residential, commercial, and industrial sectors for forecasting and reporting purposes, with Figure 4 illustrating the relative sizes of sector sales.

Commercial Sector Model Fit using historical data Industrial Econometric Model Details 1 2 3 4 Small and Medium Industrial class models are shown below. 5 6 7 8 SM_{IND} = 0.01885 GDP_{Man} + 0.01278 NonRes_{Inv} + 0.7220 SM_{IND_{-1}} 9 1...

AI summary The document presents econometric models for Small and Medium Industrial sectors in Nova Scotia, using GDP, employment, and lagged variables. Models show high R-square values (0.98 and 0.95), low forecast errors (5.74 and 17.40), and statistical significance (p-values <0.01). These models aim to predict energy demand based on economic and employment indicators.

- 10 numbers refer to the numbers as listed in Appendix I of each evaluation report. Efficient Products – Appliance Retirement LI 17: Assess the installation rate of certain prescriptive measures. ENSC will have its third-party evaluator c...

AI summary The document outlines actions taken by ENSC to address installation rates of prescriptive measures and improve data collection for the Performance Plus program. It includes efforts to ensure final audits are completed and to collect building energy consumption data.

Yes, as part of ongoing mid-course corrections, ENSC would adjust program targets to reflect experience gained in the previous year. Date Filed: March 30, 2012 ENSC CA IR-17 Page 1 of 1 1 Request IR-18: 2 3 Please provide ENSC"s evaluation...

AI summary ENSC is adjusting program targets based on mid-course corrections and is in the process of developing an evaluation plan for Enabling Strategies, specifically Codes and Standards, for 2012. Additional Enabling Strategies will require evaluation plans before launch.

1 Request IR-19: 2 3 Is ENSC planning to include evaluation of Enabling Strategies in future third part 4 program evaluations and, if not, why not? 5 6 Response IR-19: 7 8 ENSC plans to include third-party evaluation of Enabling Strategies...

AI summary ENSC plans to include third-party evaluations for Enabling Strategies that claim energy savings, such as Codes and Standards, but not for those that do not claim savings, as their purpose is to encourage energy-efficient behaviors and increase participation in existing programs already evaluated.

- 3 Please provide an update on the implementation Econoler's recommendation that - 4 evaluation plans be prepared for each program as part of program design phase. 5 6 Response IR-20: 7 - 8 ENSC will develop evaluation plans during the de...

AI summary The document requests an update on the implementation of Econoler's recommendation to prepare evaluation plans during the program design phase. ENSC responds that it will develop such plans and refers to CA IR-14 for updates on current programs.

ratio comparing lifetime benefits to the sum of ENSC's and participants' costs. & lt;sup>c PAC is a benefit/cost ratio comparing lifetime benefits to ENSC's costs. Request IR-4: - Please provide specific examples of program design and deli...

AI summary ENSC discusses the benefits of a multi-year planning framework for program design and delivery, citing examples such as the transition from a fuel switching pilot to a comprehensive Green Heating Systems initiative, which took four years to implement. The rationale includes better contracting, capacity building, and responding to market changes.

- 5 ample opportunity for the UARB and stakeholders to ensure oversight and accountability. 1 Request IR-5: 2 3 Please provide ENSC's views of the impact of a three year program versus a one year 4 program on projected Total Resource Cost...

AI summary The text discusses ENSC's response to requests regarding the impact of a three-year program versus a one-year program on Total Resource Cost (TRC) and Program Administration Cost (PAC) tests for 2013-15. ENSC suggests that a three-year program would reduce costs and improve TRC and PAC ratios. Additionally, it references load forecasts from 2006 to 2011 and compares them with those from earlier Integrated Resource Plans (IRPs).

Commercial Sector Model Fit using historical data Industrial Econometric Model Details 1 2 3 4 Small and Medium Industrial class models are shown below. 5 6 7 8 SM_{IND} = 0.01885 GDP_{Man} + 0.01278 NonRes_{Inv} + 0.7220 SM_{IND_{-1}} 9 1...

AI summary The document presents econometric models for small and medium industrial sectors, incorporating GDP, employment, and prior consumption. Models demonstrate high adjusted R-square values (0.98 and 0.95) and low forecast errors (5.74 and 17.40), with statistical tests (Ljung-Box) indicating no significant autocorrelation.

Industrial Model Input Variables and Contributions

AI summary The document examines input variables and their contributions in an industrial energy model, focusing on pricing structures (e.g., ELI 2P-RTP, RQTOS), consumption metrics (DOMENG, COMENG), and statistical methods (Ljung-Box, BIC). Key factors include demand-side management (DSM), income indicators (RPDI), and climate variables (HDD, CHDD).

Commercial Sector Econometric Model Detail 1 23 4 5 $COMENG = 0.02531 RQTOS + 0.01268 RPDI + 0.2806 DOMENG + 0.3676 COMENG._{I}$ 6 7 Forecast Model for ComEng 8 Regression(4 regressors, 0 lagged errors) 9 10 Coefficient Std. Error t-Statis...

AI summary The document presents a regression model for forecasting commercial energy consumption (COMENG) using variables like RQTOS, RPDI, DOMENG, and lagged COMENG. The model shows high statistical significance (t-statistics >5) and a strong fit (R-square 0.9977). Forecast accuracy metrics include MAPE 0.76% and RMSE 24.28.

Request IR-8: Please provide ENSC's views on whether experience with DSM in Nova Scotia since the 2007 indicates that the forecast level of savings in the 2007 IRP cannot be can be achieved at the projected costs in the 2007 IRP. Response...

AI summary The document contains responses to various requests regarding the 2007 Integrated Resource Plan (IRP), the 2013-2015 DSM Plan, and the evaluation of energy savings actions. ENSC refers to Synapse IR-12 for views on DSM savings, suggests updating the IRP by 2013, and explains that solar domestic water heating was included in the Green Heating Program under solar thermal. ENSC also outlines a process for evaluating energy savings actions.

- 10 numbers refer to the numbers as listed in Appendix I of each evaluation report. Efficient Products – Appliance Retirement All tracking sheet recommendations have been implemented through a migration of all projects to the DMS. ENSC is...

AI summary The document discusses the implementation of tracking sheet recommendations by ENSC through migration to the DMS, planning for energy savings indices, and the use of PDA figures for NCWB project savings. It also outlines actions to monitor participant satisfaction, increase data logger installations, and conduct more on-site visits as part of program improvements.

Yes, as part of ongoing mid-course corrections, ENSC would adjust program targets to reflect experience gained in the previous year. Date Filed: March 30, 2012 ENSC CA IR-17 Page 1 of 1 1 Request IR-18: 2 3 Please provide ENSC"s evaluation...

AI summary ENSC is adjusting program targets based on previous year experience and is in the process of developing its evaluation plan for Enabling Strategies, specifically Codes and Standards, which is the only Enabling Strategy for which energy savings will be claimed in 2012.

1 Request IR-19: 2 3 Is ENSC planning to include evaluation of Enabling Strategies in future third part 4 program evaluations and, if not, why not? 5 6 Response IR-19: 7 8 ENSC plans to include third-party evaluation of Enabling Strategies...

AI summary ENSC plans to include third-party evaluation of Enabling Strategies that claim energy savings, such as Codes and Standards, but not for strategies that do not claim savings, as their purpose is to encourage energy-efficient behaviors and increase participation in existing programs already evaluated by third parties.

- 3 Please provide an update on the implementation Econoler's recommendation that - 4 evaluation plans be prepared for each program as part of program design phase. 5 6 Response IR-20: 7 - 8 ENSC will develop evaluation plans during the de...

AI summary The document requests an update on the implementation of Econoler's recommendation to prepare evaluation plans for each program during the design phase. ENSC responds that it will develop such plans during the design phase of new programs and refers to CA IR-14 for an update on current programs.

upgrades, in the Low Income program. 1 Request IR-2: 16  the level of satisfaction of program participants such as energy users and partners 17 (e.g. trade allies, energy auditors , retailers) 18  the scope of issues raised in past impac...

AI summary The text discusses requests and responses related to the evaluation of the Low Income program, including participant satisfaction, free ridership, and the process for developing Figure 4.2. It also references the Efficient Products program and the derivation of TRC values.

upgrades, in the Low Income program. 1 Request IR-2: 16  the level of satisfaction of program participants such as energy users and partners 17 (e.g. trade allies, energy auditors , retailers) 18  the scope of issues raised in past impac...

AI summary The text discusses requests and responses related to program evaluations, including participant satisfaction, free ridership, and the derivation of TRC for components of the Efficient Products program. It also references the process used to develop Figure 4.2 and the significance of TRC values.

2 - With regard to Figures 4.3, 4.4 and 4.5 of the Evidence, please provide the results for the - 4 TRC test in terms of costs, benefits, and net benefits in cumulative present value dollars for - 5 each year, for each program, for each se...

AI summary The request asks for the results of the 4 TRC test in terms of costs, benefits, and net benefits for each program, sector, and the total portfolio of programs, as presented in Figures 4.3, 4.4, and 4.5 of the Evidence.

Request IR-7: 2 1 - With regard to Figures 4.3, 4.4 and 4.5 of the Evidence, please provide the results for the - 4 PAC test in terms of costs, benefits, and net benefits in cumulative present value dollars for - 5 each year, for each prog...

AI summary The request asks for the results of the 4 PAC test in terms of costs, benefits, and net benefits for each program, sector, and the total portfolio of programs, as presented in Figures 4.3, 4.4, and 4.5 of the Evidence.

& lt;sup>a Lifetime benefits are expressed as the net present value of the avoided costs, including energy and capacity, over the life of the program measures. & lt;sup>b Lifetime costs are expressed as the net present value of ENSC progra...

AI summary The text explains how lifetime benefits and costs are calculated for energy efficiency programs, including net present value of avoided energy and capacity costs, administrative and incentive costs, and a benefit/cost ratio (PAC). It also notes that low-income household participation is included in the analysis.

& lt;sup>a Lifetime benefits are expressed as the net present value of the avoided costs, including energy and capacity, over the life of the program & lt;sup>b Lifetime costs are expressed as the net present value of ENSC program administ...

AI summary The text defines key financial metrics used in evaluating energy efficiency programs, including lifetime benefits, lifetime costs, lifetime net benefits, and the Program Administrator Cost (PAC) test, which compares benefits to program costs. It also notes the inclusion of low-income household participation.

Figure 4.4 2015 Lifetime Benefits ($ million) a PAC Lifetime Costs ($ million) b PAC Lifetime Net Benefits ($ million) c Program Administrator Cost Test (PAC) d RESIDENTIAL DSM PROGRA RESIDENTIAL DSM PROGRAMS Efficient Product Rebates e 10...

AI summary Figure 4.4 presents a summary of the lifetime benefits, costs, and net benefits of various demand-side management (DSM) programs in Nova Scotia, including residential, business, and enabling strategies. The data shows the Program Administrator Cost Test (PAC) results for each category, with residential programs yielding the highest net benefits.

& lt;sup>a Lifetime benefits are expressed as the net present value of the avoided costs, including energy and capacity, over the life of the program measures. & lt;sup>b Lifetime costs are expressed as the net present value of ENSC progra...

AI summary The text discusses the calculation of lifetime benefits, costs, and net benefits for energy efficiency programs, emphasizing net present value and the Program Administrator Cost (PAC) test as a benefit/cost ratio.

Request IR-7: 2 1 - With regard to Figures 4.3, 4.4 and 4.5 of the Evidence, please provide the results for the - 4 PAC test in terms of costs, benefits, and net benefits in cumulative present value dollars for - 5 each year, for each prog...

AI summary Request IR-7 asks for the results of the 4 PAC test in terms of costs, benefits, and net benefits for each program, sector, and total portfolio of programs, based on Figures 4.3, 4.4, and 4.5 of the Evidence.

Figure 4.2 2013 Lifetime Benefits ($ millions) a PAC Lifetime Costs ($ millions) b PAC Lifetime Net Benefits ($ millions) c Program Administrator Cost Test (PAC) d RESIDENTIAL DSM PROGRAMS Efficient Product Rebates e 8.4 4.0 4.4 2.1 Existi...

AI summary Figure 4.2 presents the lifetime benefits, costs, and net benefits of various demand-side management (DSM) programs in Nova Scotia, including residential and business initiatives, along with enabling strategies. The data is expressed in 2013 dollars, and the table highlights the Program Administrator Cost Test (PAC) for each program.

2 Nature of the Error The systemic error relates to the erroneous application of the Net-to-Gross (NTG) factor, which is essentially equal to 1 - Free Rider %, in the determination of measure-specific incentive costs and energy savings. Es...

AI summary The error in the regulatory proceeding involves the incorrect application of the Net-to-Gross (NTG) factor in calculating measure-specific incentive costs and energy savings. The NTG factor was applied twice instead of once, leading to inaccuracies in parameters such as Net Avoided Cost Benefits and Technology Costs. The error also affected the ENSC Investment and Program Administrator Cost (PAC) Test, which was based on net instead of gross incentives.

he equation for TRC costs, which included at that time a "participant cost" (PCt) term, 3 and then "suggest[s] 1 D.06-06-063, mimeo ., p. 67. 2 D.92-12-050, 47 CPUC 2d, p. 73. 3 Standard Practice Manual: Economic Analysis of Demand-Side Ma...

AI summary The 2007 SPM Clarification Memo discusses the evolution of TRC cost equations, clarifying that the NTG ratio applies to participants' out-of-pocket costs and rebate incentives but excludes administrative costs. It contrasts rebate programs (removing revenue requirements for free riders) with direct install programs (including incentives in costs). Key references include the 1987 SPM and prior memos.

customer financial incentive, program administration costs and the NTG ratio are the same under the two delivery approaches. 9 This can be seen from the numerical 7 See D.06-06-063, p. 72. 8 As we note in Section 10, the SPM defines the "p...

AI summary The text discusses the comparison of two delivery approaches for customer financial incentives, program administration costs, and the NTG ratio. It references the SPM and PG&E's comments on the TRC test, highlighting differences in perspectives on cost-effectiveness and rebate definitions.

Process EDR Group conducted the following activities: - Initial familiarization with model structure/function/concepts through a Navigant-led webinar on April 18th, and a review of Navigant's model documentation, quality control policies,...

AI summary EDR Group reviewed Navigant's model for ENSC's DSM plan, verifying net-to-gross ratio application and TRC test consistency. Activities included model comparisons, error detection, webinars, and email communication with Navigant to address discrepancies and clarify model structure.

Statement of Qualifications: Energy, Evaluation and Software Tools Economic Development Research Group, Inc. 2 Oliver Street, 9th Floor, Boston, MA 02109 USA April 2012

AI summary The Economic Development Research Group, Inc. submits its qualifications related to energy, evaluation, and software tools in a regulatory proceeding in Nova Scotia.

Economic Development Research Group, Inc. (EDR Group) is a consulting firm focusing specifically on applying state-of-the-art tools and techniques for evaluating public investments and policies. The firm was started in 1996 by a core group...

AI summary The Economic Development Research Group, Inc. (EDR Group) is a Boston-based consulting firm established in 1996, specializing in impact analysis, market/strategy analysis, and benefit/cost analysis for public policies and private investments. They focus on energy, environment, transportation, and economic development, with expertise in energy efficiency, renewable energy, and utility pricing studies.

Energy and Infrastructure Analysis Tools REEM: Renewables & Energy Efficiency Impact Model. REEM is a spreadsheetbased framework for conducting economic impact and benefit-cost analysis for renewable energy and energy efficiency programs....

AI summary The document describes two analysis tools: REEM, a spreadsheet-based model for evaluating economic impacts of renewable energy and efficiency programs in multiple U.S. states, and an Infrastructure Planning Spreadsheet developed for the U.S. Department of Defense to assess infrastructure needs post-disruption. Both tools analyze energy, transportation, and utility sectors.

Energy Efficiency Evaluation Economic Impacts to the Eastern CN Provinces of Energy Efficiency Programs. EDRG recently completed an analysis (under subcontract to Environment Northeast) of economic impacts from proposed energy-efficiency p...

AI summary EDR Group conducted economic impact analyses for energy efficiency programs in Nova Scotia, New England, Texas, Wisconsin, and Iowa. Evaluations focused on residential, commercial, and industrial markets, assessing impacts on customer investments, energy savings, job growth, business competitiveness, and policy implications. Models measured economic effects across fuel sources and program scenarios.

STAFF For analysis of spreadsheet or other tools pertaining to energy efficiency, the applicable senior staff are Lisa Petraglia and Glen Weisbrod. Both are highly experienced in energy program evaluation. Working under their direction are...

AI summary Staff members Lisa Petraglia, Glen Weisbrod, Adam Winston, and Derek Cutler are highlighted for their expertise in energy program evaluation and spreadsheet tool analysis. They have prior experience reconciling inconsistencies in job impact databases, transportation benefit-cost systems, and economic impact models for government agencies.

6 Q: What is your recommendation regarding avoided costs? 7 A: I recommend that the Board direct NSPI to work with the parties to document 8 and improve the determination of avoided cost, leading to a filing with the 9 Board in 2013. At th...

AI summary The respondent recommends the NSUARB direct NSPI to collaborate with parties to improve avoided cost determination, with a 2013 filing. ENSC should assess if avoided cost changes necessitate mid-course program design adjustments while ensuring continuity.

10 Strategies"? - 11 A: The Enabling Strategies are a set of activities education, outreach, research, - 12 development, financing, capacity building, and coordination with governmental - 13 bodies that support the direct delivery programs...

AI summary Efficiency Nova Scotia (ENSC) proposes allocating 75% of Enabling Strategy costs to participating classes and 25% to system benefits. For activities with broad reach, costs are allocated proportionally based on spending or savings. ENSC's method is deemed reasonable, particularly for multi-class technologies where allocation follows potential benefits, though data limitations necessitate simplification.

Q. Have you testified before other utility regulatory Boards? A. Yes. I testified on behalf of the Nova Scotia Department of Energy at the joint National - Energy Board/Canada-Nova Scotia Offshore Petroleum Board hearing of an application...

AI summary The witness testified on behalf of the Nova Scotia Department of Energy regarding EnCana's Deep Panuke Natural Gas Project and DSM topics including budget, energy savings targets, approval process changes, low-income programs, Enabling Strategies, free ridership, and ENSC program administration.

Q. What are your views on the low income programs proposed by ENSC? - A. Access to ENSC programs is important to ensure fairness to ratepayers who are paying - for the DSM initiative. It is recognized that some groups face higher barriers...

AI summary The respondent supports ENSC's low-income programs, highlighting their importance in ensuring fairness and addressing barriers faced by low-income ratepayers. The 2013-2015 DSM Plan includes significant investment in low-income programs, and past performance, such as exceeding energy savings targets in 2011, suggests the program's effectiveness. Recommendations include monitoring barriers and adjusting targets based on experience.

Q. Do you have any concerns regarding evaluation of ENSC programs? A. Yes, I am somewhat concerned about the evaluation of some elements of Enabling Strategies. - The stated purpose of Enabling Strategies is to encourage the adoption of en...

AI summary The responder expresses concern about the evaluation of Enabling Strategies, noting that ENSC plans third-party evaluation only for certain elements (like Codes and Standards) but not others. The significant budget allocation for education and outreach initiatives requires independent evaluation to assess effectiveness beyond participation rates and claimed savings.

Q. Do you have any concerns about free ridership? - A. Yes. There are a small number of programs that account for the majority of the increase - in investment between the initial filing on February 27 and the March 30 revision. As noted in...

AI summary The witness expresses concerns about free ridership in certain programs, noting significant cost increases in energy efficiency initiatives. ENSC acknowledges an error in its Energy Efficiency Resource Assessment Model that led to understated costs, particularly for free riders. The testimony also addresses ENSC's budget administration, suggesting a management audit and improved budget transparency.

June 1995 to May 1996 Sustainable Housing and Education Consultants, Wolfville, NS Developed project concepts, prepared written proposals, and completed final reports for research on energy and environmental issues related to housing Perfo...

AI summary Sustainable Housing and Education Consultants conducted energy and environmental research on housing, including computer-based analysis of housing stock energy performance in New Brunswick, Nova Scotia, and Newfoundland. Work involved indoor air quality testing for pollutants like formaldehyde, radon, and VOCs, commissioned by Natural Resources Canada.

Direct Testimony of Tim Woolf On Behalf of Counsel to Nova Scotia Utility and Review Board On the Topics of Rate Impacts, Bill Impacts, Participation Rates and Multi-Year Planning Cycles May 22, 2012

AI summary Tim Woolf testified on behalf of the Nova Scotia Utility and Review Board regarding rate impacts, bill impacts, participation rates, and multi-year planning cycles in a regulatory proceeding on May 22, 2012. The testimony focused on analyzing the implications of these factors within the energy sector regulatory framework.

Q. You mentioned that ENSC should look at program participation levels. Why? A. After reviewing the rate and bill impact analysis, it is important to analyze program participation to discern the extent of customers experiencing bill increa...

AI summary Analyzing program participation levels helps assess how rate changes affect customer bills. High participation in energy efficiency programs can offset DSM rate increases, reducing long-term bills. The 2012 DSM Plan testimony highlights participation's critical role in evaluating acceptable rate impacts.

Q. Please summarize your analysis of program participation levels. A. Figure 4 presents a summary of program participation rates for some of ENSC's key DSM programs, based on information provided by ENSC in response to information requests...

AI summary The analysis calculates participation rates for ENSC's DSM programs by comparing participants to eligible customers, noting challenges in participant identification and double-counting. Rates are illustrative, with a need for better data collection to address these issues.

Q. Why have you not included all of ENSC's DSM programs in Figure 4? I did not include the Efficient Product Rebate programs for Residential and BNI customers in Figure 4 because participation for these programs is measured in units, or th...

AI summary The exclusion of ENSC's Efficient Product Rebate programs from Figure 4 is due to their participation metrics exceeding 100% because of multiple incentives per participant, making them unsuitable for the analysis. The responder recommends tracking rebates per participant for better analysis.

Q. What is the value of investigating the participation rates? A. Any analysis of rate and bill impacts should include some investigation of participation rates, in order to indicate the extent of customers that are likely to see lower bil...

AI summary Investigating participation rates helps assess how many customers benefit from DSM programs, informing rate and bill impact analyses. It aids in evaluating program success and balancing rate increases with bill reductions. Future DSM filings should include such analysis to guide stakeholders and improve efficiency program outreach.

Q. Please summarize your analysis of the participation rates for the Existing Residential Program. A. Figure 5, below, presents the annual and cumulative participation rates of customers in the Existing Residential program since 2008 (Avon...

AI summary The Existing Residential Program's participation rates, as shown in Figure 5, propose over 16% engagement by 2015 but a post-2012 decline due to a direct install pilot not included in the 2013 DSM Plan. ENSC emphasizes balancing participation goals with avoiding cream-skimming. The analysis of rate/bill impacts using a no-DSM scenario is deemed conceptually useful but not practically meaningful.

Q. What is the impact on Residential bills from the 20 percent increase in program budgets? A. The impact on bills from this incremental increase in program budgets are presented in Figure 8. This figure mirrors the information presented i...

AI summary A 20% increase in program budgets leads to a 0.5-1.0% initial increase in non-participant residential bills, followed by a 0.1-0.3% decrease. Participants see ~14% bill reductions. ENSC could enroll 12,000 participants, saving 17.2 GWh annually. The average rate impact over the study period is less than 0.1%.

Q. How do you recommend the results of your incremental analysis be used? - A. Again, I present the incremental rate and bill impact analysis to illustrate how such an analysis could be used in the future to assist with a decision about DS...

AI summary The response recommends using incremental rate and bill impact analyses to inform DSM program funding decisions, improve participation tracking methods, and conduct parallel analyses for BNI sector programs. It emphasizes balancing cost reductions and rate increases, enhancing data accuracy, and targeting under-participating customers.

4. MULTI-YEAR PLANNING CYCLE - Q. Please describe ENSC's proposed multi-year planning cycle. - A. In its 2012 DSM Plan filing, ENSC indicated its intent to engage stakeholders in consultation and dialogue to further assess the available op...

AI summary ENSC proposes a three-year multi-year planning cycle for its DSM plan, including annual budgets, energy savings forecasts, and a rolling outlook for directional information. The plan includes annual progress reports and a trigger mechanism requiring corrective action if energy savings fall below 75% of forecasted targets. This approach aims to improve flexibility and capacity in DSM programming.

the performance incentives resulting from an energy efficiency program are changed by 20 percent. 2 1 ENSC recommends that it continue to meet quarterly with the Board. Regular 22 mechanism must be carefully crafted and clearly understood...

AI summary ENSC recommends regular quarterly meetings with the Board. The discussion highlights challenges in balancing flexibility and oversight in energy efficiency programs, referencing experiences from Massachusetts where frequent filings occurred shortly after three-year plans were approved.

Direct Testimony of Tim Woolf Page 30 1 Q. Please explain why you believe these prospective triggers are important. 2 A. ENSC may want to add a new program or terminate an existing program during 3 the course of the three-year plan, and th...

AI summary Tim Woolf emphasizes the importance of prospective triggers for energy efficiency programs, recommending triggers for efficiency budgets and savings at the sector level to ensure equity and regulatory oversight. He suggests a 25% trigger level and outlines how the Board should respond to notifications in Annual Progress Reports.

- other hand, ENSC were to propose terminating a cost-effective program that was - serving hard-to-reach small business customers, then the Board may want to - investigate that proposal. At that time, the Board would establish a streamline...

AI summary The testimony concludes with the suggestion that if ENSC proposes to terminate a cost-effective program serving hard-to-reach small business customers, the Board should investigate and establish a streamlined review process.

impact on rates of the DSM programs,2 not just the surcharges. Until that information is available for review, any multi-year3 approval should apply only to the measures that are most cost-effective.4 Avoided costs: ENSC and the Board shou...

AI summary The evidence highlights concerns about overstated avoided costs in DSM programs, urging the Board to scrutinize NSPI's data and limit multi-year approvals to cost-effective measures. It notes discrepancies in avoided cost estimates and recommends transparency in assumptions used for DSM evaluations.

7 Q WHAT IS THE DUAL BASELINE EFFECT? - A Current "single baseline" calculations assume that the total energy savings from8 replacing equipment is the annual saving times the life of the new equipment. Dual9 baseline calculations recognize...

AI summary The dual baseline effect refers to a method of calculating energy savings that accounts for premature replacement of equipment, leading to lower savings estimates compared to the single baseline approach. ENSC's example highlights that assuming a 10-year life for CFLs versus one year for incandescent bulbs implies users would replace incandescent bulbs nine times without incentives.

19 2013 – 2015 - In its current filing, ENSC included a November 3, 2011, analysis of the Fuel20 - Switching/Substitution Pilot Program (Appendix G) launched in April 2011. There have been21 - 350 pre-approved applications of which 25% hav...

AI summary ENSC's 2013-2015 Plan includes the Fuel20 Switching/Substitution Pilot Program, which achieved 25% completion of 350 pre-approved applications, with 93% using wood/pellet stoves. The Plan also promotes 'Green Heating Systems' for residential renewable energy heating. Data from ENSC's 2010 Pilot Program report is cited.

nted by this new product line. BNL has analyzed fuel delivery records obtained from a major fuel oil marketer located in Hampton, Virginia for both condensing and non-condensing furnace replacements. In all, there were nineteen condensing...

AI summary BNL analyzed fuel delivery records from Hampton, Virginia, comparing condensing and non-condensing furnaces. Of 19 condensing furnace installations, only 4 met data criteria, showing 35% average annual fuel savings via degree-day normalization and K-factor correction. Insufficient data for most homes limited reliable conclusions.

Multi-Year Regulatory Process (Appendix B) - 2. The Parties recommend the Board adopt the following process beginning in 2013: - (a) Annual Progress Report in the first quarter of the calendar year of each intervening year between multi-ye...

AI summary The document outlines a multi-year regulatory process for ENSC, including annual progress reports, significant changes to DSM plans, evaluation activities, quarterly meetings with UARB, and a 2013 management audit. ENSC must report on program performance, discrepancies, and corrective actions if savings fall below 75% of forecasts.

Evaluation & Verification of 2011 Programs 6. The Parties do not object to approval of the Econoler Evaluation Reports and UARB Savings Verification Report with respect to 2011 DSM Programs.

AI summary The Parties agree to approve the Econoler Evaluation Reports and UARB Savings Verification Report for 2011 DSM Programs without objection. This indicates consensus on the validity of the evaluation and verification processes for those programs.

Dual Baseline for Savings Evaluation 8. The Parties agree that ENSC will conduct further consultation and analysis regarding dual baseline analysis and include this issue in its first Annual Progress Report to be filed with the UARB and St...

AI summary The Parties agree that ENSC will conduct further consultation and analysis on dual baseline analysis for savings evaluation. This issue will be included in ENSC's first Annual Progress Report submitted to the UARB and Stakeholders.

DSM Advisory Group - 11. The Parties support the transition from the Program Development Working Group (PDWG) to the DSM Advisory Group generally to provide strategic or directional advice and Stakeholder perspectives on current or emergin...

AI summary Parties support transitioning from the Program Development Working Group (PDWG) to the DSM Advisory Group for strategic advice and stakeholder input. ENSC agrees to collaborate with stakeholders on evaluating Enabling Strategies, refining rate impact methodologies, and improving customer participation tracking to prevent double-counting and enhance program targeting.

Canadian Oil Heat Association - 14. Whereas ENSC carried out a residential Fuel Switching/Substitution Pilot Program, beginning April 2011 and concluding December 2012 which did not include high efficiency condensing oil heating furnaces;...

AI summary The Canadian Oil Heat Association references ENSC's past residential Fuel Switching/Substitution Pilot Program (2011-2012), which excluded high-efficiency condensing oil heating furnaces. ENSC now proposes a Green Heating Systems promotion incentivizing renewable energy sources for heating but explicitly excludes fuel switching from electricity to other fuels post-pilot.

r business, continue to develop their skills and capacity, and deliver better service to customers. No question, there is rising frustration over the rising cost of energy. People want to fight back. Efficiency Nova Scotia is your best way...

AI summary The text highlights Efficiency Nova Scotia's role in combating rising energy costs through energy efficiency initiatives. It emphasizes savings achieved, including $100 million in future electricity cost reductions and 141.8 million kWh saved. The program's success in engaging businesses, low-income residents, renters, and First Nations communities is noted, along with plans to expand a pilot project.

to reach according to other efficiency organizations. A successful pilot project in two First Nations communities reached 170 homes and is being expanded to more First Nations communities this year. Two other pilot projects took on efficie...

AI summary Efficiency Nova Scotia highlights successful energy efficiency initiatives, including pilot projects in First Nations communities, demonstration homes with the Nova Scotia Homebuilders' Association, and the Green Schools program with Clean Nova Scotia. The proposed plan emphasizes customer-focused approaches, multi-year planning, and improved regulatory engagement to enhance energy savings and program effectiveness.

oversight will remain as strong and productive as ever. We will continue meeting regularly with the Board as well as stakeholders, providing regular, detailed reports, and responding to any concerns. The strength and productivity of our re...

AI summary The company emphasizes strong stakeholder relationships, 97% customer satisfaction from a survey, and the importance of promoting energy efficiency to lower power bills and improve economic outcomes in Nova Scotia. Energy efficiency is framed as a cost-effective solution with broader societal benefits.

Opening Statement of Consumer Advocate DSM Plan 2013-2015 (M04819) Residential ratepayers are experiencing continued upward pressure on electricity rates. Reducing energy use is the only controllable means a residential ratepayer has to lo...

AI summary The Consumer Advocate highlights rising residential electricity rates and advocates for improvements to Efficiency Nova Scotia's DSM Plan 2013-2015, including enhanced oversight, program effectiveness, transparency, and fair cost allocation. The proposed settlement aims to approve a two-year plan with ratepayer protections and stakeholder input.

IT IS FURTHER ORDERED that: - 1. The Board accepts the recommendations made in the Minutes of Settlement. - 2. The Board accepts the Econoler Evaluation Reports and UARB Savings Verification Report with respect to 2011 DSM Programs. - 3. T...

AI summary The Board accepts the Minutes of Settlement, including the Econoler Evaluation Reports and UARB Savings Verification Report for 2011 DSM Programs. ENSC is directed to continue filing evaluation reports and to submit the Terms of Reference for the DSM Advisory Group. The Settlement was reached with the support of DARB and the Parties, and it aims to ensure open and transparent DSM programs.

Multi-Year Regulatory Process (Appendix B) - Board - Annual Progress Report - r"1","\¥"t-L-"'¥ of of each 1n+,ar-':7'an1Inn publically file an Annual Progress Report, cornments, consisting of: - prior year· - multi-year budget. - (b) Signi...

AI summary The document outlines the Multi-Year Regulatory Process, including requirements for ENSC to submit Annual Progress Reports, handle Significant Changes to the DSM Plan, conduct Evaluation Activities, hold Quarterly Meetings, and perform a Management Audit in 2013, with results reported to DARB.

Evaluation & Verification of2011 Programs 6. do not to of ...aC!.,.,a~1" to 2011 Programs.

AI summary The text is corrupted and unclear, with fragmented content that does not provide specific details about the evaluation or verification of 2011 programs. Key arguments, entities, or references are not discernible from the provided text.

Dual Baseline for Savings Evaluation 8. The Parties that will conduct further consultation and analysis regarding dual baseline analysis and include this issue in first Annual Progress Report to be filed with the DARB and Stakeholders.

AI summary The Parties agree to conduct further consultation and analysis on dual baseline analysis for savings evaluation, with findings included in the first Annual Progress Report to be submitted to the DARB and stakeholders.

DSM Advisory Group - matters Group ~-rr,.'tr1r1a Cl1"-r"l1"t::llrc11' or directional advice Minutes of Settlement. (PDWG) to the DSM and Stakeholder -na~'C'-nC~I't"1-'(raC' on current or ...... ...... ¥£"rll_£"r issues or concerns includin...

AI summary The DSM Advisory Group recommends developing Terms of Reference, electing a Chair, and collaborating with ENSC to refine evaluation methods for Enabling Strategies, improve rate impact analysis using Synapse's recommendations, and enhance customer participation tracking to avoid double-counting and maximize program engagement.

Canadian Oil Heat Association - 14. Whereas ENSC carried out a residential Fuel Switching/Substitution Pilot Program, beginning April 2011 and concluding December 2012 which did not include high efficiency condensing oil heating furnaces;...

AI summary ENSC conducted a residential Fuel Switching/Substitution Pilot Program (2011-2012) excluding high-efficiency condensing oil furnaces. They now propose a Green Heating Systems promotion incentivizing renewable energy-based heating (solar, heat pumps, biomass) but not fuel switching from electricity to other fuels post-pilot program expiry.

PRELIMINARY ISSUES LIST The following issues will be dealt with in the public hearing on Efficiency Nova Scotia's ("ENS") Application for approval of its electricity Demand Side Management (HDSM") Plan for 2013-15: - 1. Proposed 2013-15 DS...

AI summary The document outlines preliminary issues for a public hearing on Efficiency Nova Scotia's (ENS) 2013-15 Demand Side Management (DSM) Plan. Key topics include the DSM Plan's appendices, cost allocation methods, evaluation of past programs, CFL disposal, financing strategies, savings evaluation baselines, cost recovery riders, and the structure of a new DSM Advisory Group.

FINAL ISSUES LIST The following issues will be dealt with in the public hearing on Efficiency Nova Scotia's ("ENS") Application for approval of its electricity Demand Side Management ("DSM") Plan for 2013-15: - 1. Proposed 2013-15 DSM Plan...

AI summary The document outlines 11 issues for public hearing regarding Efficiency Nova Scotia's (ENS) 2013-15 Demand Side Management (DSM) Plan. Key topics include cost allocation, evaluation of past programs, avoided cost values, CFL disposal, financing strategies, and the structure of a new DSM Advisory Group.

1 2012 NSUARB-E-ENSC-R-12 5 NOVA SCOTIA UTILITY AND REVIEW BOARD IN THE MATTER OF: THE PUBLIC UTILITIES ACT and - MATTER OF: IN APPLICATION AN Corporation, To: Efficiency Nova Scotia Corporation c/o Sean Foreman Wickwire Holm 2100-1801 Hol...

AI summary This document contains a series of requests submitted in a regulatory proceeding under the Public Utilities Act, asking for detailed information on avoided costs, expenditure adjustments, assumptions, and program proposals. The proceeding involves Efficiency Nova Scotia Corporation and Multeese Consulting Inc. as key entities.

1 Request IR-1: 2 3 Please provide details of how ENSC plans to obtain the stakeholder views on program design and implementation that was formerly provided by the Program Development Working Group. 4 5 Request IR-2: 6 7 Please describe th...

AI summary The document outlines several requests related to energy efficiency programs, including stakeholder engagement, program design, program breakdowns, load forecasts, and the impact of multi-year versus one-year programs on cost tests.

1 Request IR-7: 2 3 Please provide a copy of NSPI's preliminary review that confirms that ENSC's five-year DSM target projection is within range of the load sensitivities evaluated in the 2009 IRP. 4 5 Request IR-8: 6 7 8 Please provide EN...

AI summary The document contains a series of requests directed to ENSC regarding the evaluation of DSM targets, investment levels, and program considerations. These include inquiries about the feasibility of DSM targets, the need for a review of the 2007 IRP, alternative investment levels, the exclusion of solar domestic water heating, and the evaluation of energy savings actions.

1 Request IR-13: 2 3 Please provide specific examples from each program area where recommendations made by Econoler have or will be implemented. 4 5 Request IR-14: 6 7 Please provide an update on the status of progress regarding developmen...

AI summary The document contains a series of requests directed at Energy Nova Scotia Corporation (ENSC) regarding the implementation of recommendations, progress on evaluation plans, free ridership in the Green Heating Program, program changes to meet energy savings targets, re-evaluation of the Low Income Home target, and the evaluation plan for Enabling Strategies.

1 Request IR-19: 2 Is ENSC planning to include evaluation of Enabling Strategies in future third part program 3 evaluations and, if not, why not? 4 5 Request IR-20: 6 7 Please provide an update on the implementation Econoler's recommendati...

AI summary The document contains a series of requests directed at ENSC regarding the evaluation of Enabling Strategies, implementation of Econoler's recommendations, cost-allocation methods, and the allocation of costs for enabling strategies, as well as requests for detailed financial information and attachments.

3 Request IR-2 - Reference: Econoler Report, February 23, 2012, E-03, p.3, Table 24 - Please include columns to show $ budget, $ actual and TRC tests for each DSM program.5 - (a) Please provide an explanation for any variance of 20% or mor...

AI summary Request IR-2 seeks clarification on DSM program reporting, including budget/actual/TRC test columns, explanations for spending/savings variances exceeding 20%, and actions taken by ENSC. The NSUARB references the Econoler Report (2012) and demands transparency on program adjustments.

16 Request IR-6 - The benefits of the programs are shown in terms of energy savings (GWh) and demand savings17 - (MW), but the dollar Lifetime Benefits are shown as a single number ($million, second column).18 - Please provide ENSC Evidenc...

AI summary The request asks ENSC to provide evidence tables (4.1-4.4) that separate Lifetime Benefits into demand and energy savings, as currently aggregated as a single figure.

22 Request IR-14 - Reference: ENSC Evidence, p.32, Recommendation #2, lines 11 14,23 - (a) Please provide details of the specific measures to be undertaken, the target24 market and budgets for each measure in 2013 (from Figure 4.2):25 - (i...

AI summary The document contains a series of requests related to the Efficiency Nova Scotia Corporation (ENSC) and its programs, including details on budgets, cost allocation, enabling strategies, and the impact of industrial shutdowns on DSM plans. It also requests information on training programs, government collaboration, and funding sources for studies and evaluations.

22 Request IR-24 - (a) Does ENSC have a "program manager" (or similarly otherwise titled individual)23 - responsible to liaise with each Large Industrial customer with respect to its DSM24 - programs?25 - (b) What, if any, surveys were don...

AI summary The document contains questions directed to ENSC regarding DSM program management, including the existence of a program manager for Large Industrial customers, survey practices for 2013-2015 DSM planning, tracking of BNI program measures by customer class, cost allocation methodologies, and requests for variance analysis of DSM expenditures from 2010-2012. ENSC is also asked about the value of customer engagement in DSM planning.

David S. MacDougall Direct +1 (902) 444 8561 [email protected] Purdy's Wharf Tower II 1300-1969 Upper Water Street PO Box 730 Halifax NS Canada B3J 2V1 Tel +1 (902) 425 6500 I Fax +1 (902) 425 6350 Our File: DM-448 January...

AI summary Bowater Mersey Paper Company Ltd. challenges Efficiency Nova Scotia's proposed use of telephone surveys to assess free-ridership in the Custom-Retrofit and New Construction programs. They argue this method is unlikely to accurately identify free-riders, as participants may not admit to implementing energy efficiency measures without program incentives, contrary to DSM funding principles.

mented the same energy efficiency measures without the program" or have "implemented the energy efficiency measures at the same time without the program," which are the questions proposed to be asked. Asking participants if they would have...

AI summary Bowater Mersey criticizes Efficiency Nova Scotia's proposed method for identifying free-riders in an energy efficiency program, arguing that the questions may be self-defeating as participants would likely claim they wouldn't have implemented the programs without incentives. Bowater suggests an alternative question to assess whether DSM incentives divert funds from other projects or encourage new improvements.

ould otherwise have been invested in an energy efficiency improvement project in any event; and - 2. Whether entities are undertaking improvements they would not have considered in the absence of DSM. Bowater Mersey believes there should b...

AI summary Bowater Mersey criticizes Efficiency Nova Scotia's approach to assessing free-ridership in the Demand Side Management (DSM) program, arguing for a more sophisticated protocol and tailored questions rather than formulaic methods. They contend current questions, such as whether participants would have acted without the program, lack probative value and suggest similar approaches are used in other programs.

Re: Comments on Econoler Report The Consumer Advocate makes two suggestions in response to the Econoler report on Net-to-Gross Evaluation Methodology. (a) ENSC should consider more frequent updates of the surveys, and occasional calibratio...

AI summary The Consumer Advocate proposes improving the reliability of Net-to-Gross Evaluation Methodology by updating surveys more frequently and calibrating them with social service studies. They criticize the SRA method's unreliability due to social desirability bias and suggest using double-blind studies as a check. They also argue that NTGRs should be updated promptly when data becomes available, especially for new programs.

IT IS FURTHER ORDERED that: - 1. The Board accepts the recommendations made in the Minutes of Settlement. - 2. The Board accepts the Econoler Evaluation Reports and UARB Savings Verification Report with respect to 2011 DSM Programs. - 3. T...

AI summary The Board accepts the Minutes of Settlement, including evaluation reports and directions for ENSC to continue filing reports and developing the DSM Advisory Group Terms of Reference. The agreement was reached with intervenors to resolve aspects of the Application before DARB.

Multi-Year Regulatory Process (Appendix B) - Board - Annual Progress Report - r"1","\¥"t-L-"'¥ of of each 1n+,ar-':7'an1Inn publically file an Annual Progress Report, cornments, consisting of: - prior year· - multi-year budget. - (b) Signi...

AI summary The document outlines procedural requirements for the Annual Progress Report, Significant Changes to the DSM Plan, Evaluation Activities, Quarterly Meetings, and a 2013 Management Audit by ENSC. Key entities include ENSC, DARB, and DSM. Topics focus on regulatory compliance, program adjustments, and stakeholder reporting.

Evaluation & Verification of2011 Programs 6. do not to of ...aC!.,.,a~1" to 2011 Programs.

AI summary The text is incomplete and contains corrupted or illegible content, making it impossible to extract meaningful information about the evaluation and verification of 2011 programs in the regulatory proceeding.

Dual Baseline for Savings Evaluation 8. The Parties that will conduct further consultation and analysis regarding dual baseline analysis and include this issue in first Annual Progress Report to be filed with the DARB and Stakeholders.

AI summary The Parties will conduct further consultation and analysis on dual baseline methods for savings evaluation and include this in the first Annual Progress Report to DARB and Stakeholders.

DSM Advisory Group - matters Group ~-rr,.'tr1r1a Cl1"-r"l1"t::llrc11' or directional advice Minutes of Settlement. (PDWG) to the DSM and Stakeholder -na~'C'-nC~I't"1-'(raC' on current or ...... ...... ¥£"rll_£"r issues or concerns includin...

AI summary The DSM Advisory Group is tasked with developing Terms of Reference, electing a Chair, and collaborating with ENSC to refine evaluation methods for demand-side management programs. Key actions include improving customer participation tracking to prevent double-counting and refining rate impact analysis using Synapse's recommendations.

Canadian Oil Heat Association - 14. Whereas ENSC carried out a residential Fuel Switching/Substitution Pilot Program, beginning April 2011 and concluding December 2012 which did not include high efficiency condensing oil heating furnaces;...

AI summary The Canadian Oil Heat Association highlights that ENSC's 2011-2012 Fuel Switching Pilot Program excluded high-efficiency condensing oil furnaces. ENSC's proposed Green Heating Systems promotion incentivizes renewable energy systems but explicitly avoids incentivizing fuel switching from electricity to other fuels post-pilot.

Mandate The DSM Advisory Group is a forum to provide strategic or directional advice and stakeholder perspectives on current or emerging DSM issues including, but not limited to, the following items as identified in the UARB Order noted ab...

AI summary The DSM Advisory Group provides strategic advice on DSM issues, including evaluating Enabling Strategies, refining rate impact methodologies, improving customer participation tracking, and developing communication strategies. ENSC manages the group and maintains a list of DSM issues on its SharePoint site, with stakeholder input encouraged.

Efficiency Nova Scotia Corporation IN THE MATTER OF The Public Utilities Act, R.S.N.S. 1989, c.380, as amended. - and – IN THE MATTER OF Efficiency Nova Scotia Corporation's 2013 Annual Progress Report.

AI summary Regulatory proceeding under the Public Utilities Act, R.S.N.S. 1989, c.380, regarding Efficiency Nova Scotia Corporation's 2013 Annual Progress Report. The matter involves compliance and review of the corporation's performance under the Act.

1.1 2012 DSM Programs ENSC programs and services exceeded savings target in 2012. Savings from all demand-side management programs were 158.9 GWh in 2012, compared to the 2012 target of 124.2 GWh. These savings included contributions from...

AI summary ENSC exceeded 2012 DSM savings targets (158.9 GWh vs. 124.2 GWh), driven by Residential and BNI sector contributions. Marketing efforts boosted participation, social media engagement, and customer satisfaction (89% overall, 96% recommendation rate). Success attributed to new programs like Residential Direct Install.

1.2 Residential Sector Results The Existing Houses program achieved energy savings of 50.4 GWh in 2012 compared to its target of 29.5 GWh, largely due to contributions from the Residential Direct Install service, which achieved savings of...

AI summary The Residential Sector Results highlight significant energy savings from programs like Existing Houses and Residential Direct Install, achieving 50.4 GWh in 2012. Energy efficiency upgrades were completed in 28,397 homes, with low-income initiatives expanding. Efficient Products saved 17.9 GWh, including 6.8 GWh from Appliance Retirement. LED campaigns and the Home Energy Assessment contributed to savings, while New Houses achieved 4.9 GWh of savings. The Home Energy Report service is set to launch in 2013.

1.4 Codes and Standards ENSC's evaluator reported on the energy savings associated with new Codes and Standards in the Nova Scotia market. Eight new standards were considered: - Electric motors - General service incandescent reflector lamp...

AI summary ENSC evaluated eight new energy codes and standards in Nova Scotia, reporting 16.4 GWh savings for five standards but unable to assess others due to data gaps. ENSC leads national energy efficiency initiatives, including the Building Energy Estimation Methodology (BEEM) project and the National Market Study on fenestration products, supported by organizations like the Strategic Resource Task Group (SRTG) and the Steering Committee on Performance Energy Efficiency and Renewables (SCOPEER).

4.1.1 Efficient Product Rebates Efficient Product Rebates consists of both instant-rebate services and rebates provided for the retirement of old, inefficient appliances. In 2013, a number of strategies will be tested in the instant-rebate...

AI summary Efficient Product Rebates includes instant rebates and appliance retirement incentives. In 2013, ENSC will test expanded in-store rebate strategies and longer campaign periods, and explore CFL recycling. The program will focus on LED lamps to drive market transformation, building on 2012 rebate success.

4.1.2 Existing Residential ENSC's Existing Residential program consists of services focused on building envelope retrofits, direct installation of low-cost energy-efficient technologies, and rebates for installation of larger energy-effici...

AI summary ENSC's Existing Residential program offers building retrofits, direct installations, and rebates. In 2013, ENSC will enhance services with zero-interest financing and marketing. The Green Heat program shifts focus to renewable energy (wood/pellets) and excludes natural gas/propane. Low-income and medium-income assistance continues with targeted outreach.

4.2 Business, Non-Profit and Institutional Programs and Services In 2013 and 2014, ENSC will continue its work in building energy efficiency considerations into Business, Non-profit and Institutional (BNI) customers' decision-making proces...

AI summary ENSC aims to enhance energy efficiency among BNI customers in 2013-2014 by promoting customer ownership, energy monitoring systems, and long-term energy management planning. The organization will adapt to federal lighting standards and invest in emerging technologies to drive cultural change in energy efficiency.

4.2.3 Direct Installation In its continuing evolution to meet the needs of customers, the Small Business Direct Install program has become more comprehensive and is now referred to as "Direct Installations" or "Business Energy Solutions" i...

AI summary The Small Business Direct Install program has evolved into 'Direct Installations' or 'Business Energy Solutions' to broaden customer reach. ENSC plans to expand non-lighting measures, explore zero-interest financing for municipal utility customers, and adapt to 2014 federal lighting standards.

5. ADVANCEMENT OF DSM CONCEPTS AND DSM POTENTIAL STUDY In 2013, research and development work designed to advance DSM analysis will continue. ENSC has retained Dunsky Energy Consulting to review the organization's existing framework and me...

AI summary In 2013, ENSC continued R&D to advance DSM analysis by engaging Dunsky Energy Consulting to review methodologies. Navigant Consulting was retained to conduct a 25-year DSM potential study for Nova Scotia's Integrated Resource Plan, aiming to update achievable DSM projections using current baseline data, with completion expected by Q2 2013.

6.1 Evaluation Activities As identified in the 2013-2014 DSM Plan Stakeholder Agreement approved in the June 4, 2012 UARB Order, ENSC will move toward a layered evaluation process approach in 2013. This approach involves ongoing savings tr...

AI summary ENSC will implement a layered evaluation approach for DSM programs in 2013-2014, including ongoing savings tracking, free-ridership surveys, and a rolling evaluation schedule. This follows the 2012 UARB Order approving the DSM Plan Stakeholder Agreement. Evaluations will prioritize programs based on energy savings, maturity, and participant feedback, with Econoler and Dunsky Energy Consulting consulted in developing the schedule.

12 6.3 Traditional Process Evaluation 13 14 The 2013 and 2014 Evaluation will contain a traditional process evaluation. This includes some elements of 15 a management audit, as outlined in the UARB Savings Verification Study, March 2011, p...

AI summary The 2013 and 2014 evaluations include a traditional process evaluation, akin to a management audit but not a full review. Dr. Gil Peach emphasized it focuses on suggesting process improvements and documenting organizational workflows. Key areas assessed include program design, staffing, data tracking, and interdepartmental communication.

6.6 2013-2014 Rate and Bill Impact Analysis A rate and bill impact analysis is being provided as Appendix B and incorporates revisions requested by Synapse Energy Economics and referenced in the Stakeholder Agreement. The methodology templ...

AI summary The 2013-2014 rate and bill impact analysis, included as Appendix B, incorporates revisions from Synapse Energy Economics and the Stakeholder Agreement. The methodology template was reviewed by the DSM Advisory Group.

APPROACH - A dual baseline approach requires time and resources that must be used in addition to existing - resources to deliver programs. Because of this, Efficiency Nova Scotia's dual baseline practice is - based on a feasible, as oppose...

AI summary Efficiency Nova Scotia (ENSC) employs a dual baseline approach for energy efficiency programs only when specific criteria are met, such as significant incentives, early equipment replacement, and available baseline data. This approach excludes industrial processes and focuses on measures like HVAC and lighting, ensuring feasibility and resource efficiency.

2014: - o Dual baseline will be implemented for the Custom Retrofit and Business Energy Solutions programs. - o If additional measures are determined to meet the criteria for dual baseline, processes and tracking mechanisms will be develop...

AI summary In 2014, a dual baseline approach was introduced for the Custom Retrofit and Business Energy Solutions programs. Additional measures meeting criteria would trigger the development of processes and tracking mechanisms to support the dual baseline framework.

2012 DSM EVALUATION REPORTS

AI summary The 2012 DSM Evaluation Reports assess the effectiveness and outcomes of demand-side management programs, focusing on their cost, performance, and alignment with regulatory objectives. The reports likely include analyses of program metrics, participant engagement, and cost-benefit evaluations.

Table 1: Type(s) of Evaluation Conducted per Program Type(s) of Evaluation Program or Initiative Process Impact Appliance Retirement (ARet) x x Instant Savings x x Home Energy Assessment (HEA) x x Fuel Substitution x x Low Income Homeowner...

AI summary This report evaluates the impact and process of 15 program components offered by ENSC in 2012, detailing evaluation methodology, DSM portfolio performance, and recommendations for improvement. It includes an in-depth analysis of individual program performance.

1 EVALUATION OBJECTIVES & METHODOLOGY

AI summary The section outlines the evaluation objectives and methodology for assessing energy efficiency programs and initiatives. It sets the framework for analyzing program effectiveness, cost recovery, and compliance with regulatory standards.

1.2.1 Process Evaluation The 2012 process evaluation of ENSC's DSM programs relied on the analysis of program documentation, which included the ENSC website, the 2011 evaluation report (when applicable), the program manual and the tracking...

AI summary The 2012 process evaluation of ENSC's DSM programs involved analyzing documentation, conducting interviews with the Program Manager and partners, and surveying participants and builders for Performance Plus.

1.2.2 In-Depth Interviews The 2012 evaluation methodology included in-depth interviews with program staff as well as with different program partners. Between August and November 2012, Econoler conducted 111 in-depth interviews with various...

AI summary In 2012, Econoler conducted 111 in-depth interviews with stakeholders including program managers, delivery agents, energy advisors, distributors, manufacturers, consultants, and retailers to evaluate program effectiveness. The interviews were part of a broader evaluation methodology.

For the 2012 evaluations, Econoler visited a total of 325 participant sites, 20 retail stores and one recycling facility. These visits were conducted between October and December 2012 for all programs. The objective of the participant site...

AI summary Econoler conducted site visits in 2012 to evaluate program effectiveness, including 325 participant sites, 20 retail stores, and one recycling facility. The visits aimed to validate parameters like installation rates, free-ridership, and recycling processes, and assess in-store experiences and employee knowledge.

A total of 1,042 interviews with participants and 57 interviews with builders (Table 4) were completed for this evaluation. Although the content of the surveys varied from one program to another, the survey instruments were used to capture...

AI summary The evaluation involved 1,042 participant interviews and 57 builder interviews conducted between October and November 2012. The surveys captured data on spillover, free-ridership, program awareness, participant motivations, satisfaction, and recommendations. In-store intercept surveys and CATI technology were used for different programs.

The impact evaluations integrated findings from the literature review, tracking sheets, interviews with program partners, on-site visits and/or surveys, depending on the type of data collection activities considered necessary. Moreover, th...

AI summary The impact evaluations used various methods, including literature reviews, tracking sheets, interviews, on-site visits, and surveys. The HEA, LIHS, and Performance Plus evaluations used HOT2000 simulation calibration analyses with billing data. On-site visits were conducted for all programs, with some used to validate parameters like installation rates and hours of operation. More sites were visited in 2012 to ensure reliable data collection.

y the participant, the number of sites to be visited was increased for the 2012 evaluations to allow for establishing reliable installation rates and self-declaration ratios on the hours of operation. The 2011 verification study suggested...

AI summary The evaluation enhanced data collection methods by increasing site visits and using billing analysis to improve savings estimates. Direct measurement and expanded samples improved accuracy for programs like HEA and BES, while other programs relied on file reviews and literature. Net savings adjustments incorporated free-ridership and spillover factors via NTGR calculations.

2 DSM PORTFOLIO PERFORMANCE

AI summary The section discusses the performance of the Demand-Side Management (DSM) portfolio, likely covering program outcomes, efficiency initiatives, and related metrics under Nova Scotia's regulatory framework.

Custom Retrofit The adjusted gross energy savings of Custom Retrofit were higher than those tracked by ENSC by approximately 0.05 percent. The Evaluator made some minor adjustments to ENSC's energy savings, due to issues found in interacti...

AI summary The Custom Retrofit program's adjusted gross energy savings were slightly higher than ENSC's, with minor adjustments due to issues in interactive effect calculations and discrepancies in equipment counts. The net energy savings were 2.1% lower due to a higher free-ridership level in 2012. Gross demand savings were 13% higher, attributed to updated diversity factors used by Econoler, which led to an 11% difference in net demand savings.

Custom New Construction The net energy savings at the generator calculated by Econoler are approximately 22 percent lower than those tracked by ENSC. This difference is mainly due to the NTGR ratio established as part of this year's evalua...

AI summary The net energy savings calculated by Econoler are 22% lower than those tracked by ENSC, mainly due to the NTGR ratio. The peak demand savings difference is 33%, influenced by adjustments in diversity factors and discrepancies in project claims. Free-ridership is also noted, with participants implementing energy efficiency measures for reasons beyond the program.

3.1 PROGRAM MANUAL Program manuals feature key information on program process and tracking for internal use and are an essential reference tool for all program staff. In addition, program manuals are widely used by the Evaluator throughout...

AI summary The program manual is a critical tool for internal program staff and evaluators, capturing key program information. The 2012 version improved upon the 2011 format and followed a major evaluator recommendation, with a standardized template across all ENSC programs. Econoler recommends further improvements to supplement the tool.

Table 11: General Recommendations on ENSC Program Manuals No. Recommendations OV-R1. Continue to document key elements of the programs: With the new standardized format, the program manuals now include most of the information about the pro...

AI summary The table outlines recommendations for improving the documentation of ENSC program manuals. It emphasizes the need to continue documenting key program elements, including major changes, program characteristics, incentive calculations, and free-ridership approaches.

3.2 DATA TRACKING Data tracking and reporting are crucial for program management as well as for evaluation purposes. In 2010, ENSC implemented an online Demand-Side Management Data System (DSMDS), and has been working on its improvement si...

AI summary Data tracking and reporting are critical for program management and evaluation. ENSC implemented the DSMDS in 2010 but it had limitations, particularly in generating comprehensive reports. Econoler used tracking sheets for the 2012 evaluation and noted improvements since 2011, though challenges remain in validating savings calculations. Recommendations were made to improve data consistency and support the DSMDS development.