E-22010 DSM Evaluation Reports - Final Report - February 28, 2011 2/28/2011
182 passages
NOVA SCOTIA’S 2010 ELECTRICITY DEMAND SIDE MANAGEMENT PLAN EVALUATION REPORTS FINAL REPORT FEBRUARY 28, 2011 Submitted to: NOVA SCOTIA UTILITY AND REVIEW BOARD Submitted by: EFFICIENCY NOVA SCOTIA CORPORATION Prepared by: NMR GROUP INC. Ev...
AI summary This final report evaluates Nova Scotia’s 2010 Electricity Demand Side Management (DSM) Plan, submitted to the Nova Scotia Utility and Review Board by Efficiency Nova Scotia Corporation. The evaluation was conducted by NMR Group Inc. and focuses on assessing the effectiveness of DSM programs implemented in 2010.
Contents 1 DSM PORTFOLIO PERFORMANCE ............................................................................................................1 1.1 OVERVIEW ..................................................................................
AI summary The document outlines a review of Demand Side Management (DSM) portfolio performance, focusing on data quality, access/delivery challenges, and recommendations. It includes sections on evaluation objectives, impact assessments, and on-site evaluations, with subsections addressing data tracking issues and forward-looking considerations for 2011.
................................................... 8 2.2.1 On-site Evaluations ..................................................................................................................................8 2.2.2 Net-to-Gross Ratio an...
AI summary The text outlines a structured evaluation framework for energy efficiency programs, including on-site evaluations, net-to-gross ratio analysis, process evaluations via interviews and surveys, and performance assessments of specific initiatives like the C&I Custom Program, Business Energy Rebates, and Smart Lighting Choices. It emphasizes methodological approaches to program effectiveness.
ENT PRODUCTS – RETAIL PROGRAM (POWER DOWN - PD) ............................................................... 14 3.4.1 CFL Component ...........................................................................................................
AI summary The document outlines energy efficiency programs including retail and direct installation initiatives, home energy assessments, new housing programs, appliance retirement/replacement, and support for low-income households. It also references an executive summary evaluating program impacts and processes.
...................................................... 18 NMR NSPI Impact and Process Evaluation Executive Summary Tables TABLE 1-1: 2010 UARB APPROVED SAVINGS TARGETS AND NMR RESULTS (NET INSTALLED ANNUAL ENERGY AND DEMAND SAVINGS AT THE...
AI summary The document evaluates the 2010 DSM program performance, including savings targets, portfolio composition, and process evaluation methods. It references tables analyzing energy/demand savings, program effectiveness, and stakeholder feedback through interviews and surveys.
NMR Evaluation 2010 DSM Programs Executive Summary Page 1 Executive Summary 1 DSM Portfolio Performance 1.1 Overview This document provides a summary of the evaluation of 2010 electric Demand Side Management programs in Nova Scotia. NMR co...
AI summary This document evaluates Nova Scotia's 2010 Demand Side Management (DSM) programs, concluding they met targets despite challenges. NMR assessed programs like Efficient Products Retail and Low Income Households, noting efficient execution during transition to Efficiency Nova Scotia Corporation. The 2010 DSM plan was approved by the Utility and Review Board (UARB) on August 4, 2009.
results for the 2010 program year. NMR Evaluation 2010 DSM Programs Executive Summary Page 2 Table 1-1: 2010 UARB Approved Savings Targets and NMR Results (Net Installed Annual Energy and Demand Savings at the Generator) 2010 Targets 2010...
AI summary The 2010 DSM program evaluation shows actual energy and demand savings exceeded UARB-approved targets, with residential and C&I programs achieving higher results than projected. Key programs include Efficient Products, EnerGuide, and Business Energy Rebates, with NMR reporting outcomes for the year.
m Development Working Group (PDWG) NMR Evaluation 2010 DSM Programs Executive Summary Page 3
AI summary The document references an evaluation of 2010 Demand Side Management (DSM) programs, involving the Program Development Working Group (PDWG). It appears to be part of a regulatory proceeding analyzing past DSM initiatives.
In 2010, the CFL component of the Efficient Products – Retail program accounted for 88% of the program‘s energy savings from retail product sales. As a result of the upcoming phase-out of incandescent bulbs starting in January 2012, the...
AI summary The Efficient Products programs face challenges as CFLs near their energy-saving limits due to incandescent bulb phase-outs, while the Direct Install program may have peaked. The EnerGuide program exceeded targets despite federal rebate changes, but other programs like Low Income Households and Business Energy Rebates underperformed significantly.
simply by installing a heat pump. NMR Evaluation 2010 DSM Programs Executive Summary Page 4 1.3 Program Data Tracking It is important to note that the 2010 evaluation encountered significant bottlenecks stemming from data issues in several...
AI summary The 2010 evaluation of DSM programs identified significant data tracking challenges, including inconsistent data quality and delays in generating participation reports. These issues raised concerns about Efficiency Nova Scotia's ability to scale programs effectively as savings targets increase.
1.3.1 Data Quality Issues The NMR team encountered several issues involving inconsistent, inaccurate, or missing data in 2010. These issues were experienced particularly in the SBLS, DI, and C&I Custom programs. Inconsistent and Inaccurate...
AI summary The NMR team identified data quality issues in 2010 within SBLS, DI, and C&I Custom programs, including human errors and discrepancies between recorded and actual installations. Corrective actions were taken, and the need for spot audits in DSM programs was highlighted to prevent similar errors.
dditional spot audits or site inspections by program staff for a sample of participants: SBLS, LIH, and DI.2 The DSM Administrator should consider devoting resources to conduct spot audits or site inspections, on a quarterly basis, on a sa...
AI summary The DSM Administrator is recommended to conduct quarterly spot audits/inspections for SBLS, LIH, and DI participants, increasing frequency if issues are found. Missing data in billing records for SBLS participants (multiple meters not included) complicates analysis, requiring improved tracking methods.
ject. While this does not affect the tracking of equipment installed, it makes conducting a billing analysis problematic. We recommend that this be taken into consideration when tracking participants. 1.3.2 Data Access / Delivery Issues Th...
AI summary The evaluation of Conserve Nova Scotia programs faces challenges due to delayed and inconsistent data reporting, lack of standardized formats, and absence of unique identifiers. These issues hinder accurate participation tracking, particularly for low-income households, and complicate program evaluation and data sharing.
ome cases requiring several days before requests could be fulfilled.3 These delays were especially problematic for generating monthly participation lists required by NMR to complete telephone surveys. 1.3.3 Recommendations Data tracking an...
AI summary The 2010 DSM program evaluation highlighted delays in data fulfillment due to resource allocation during the transition to Efficiency Nova Scotia Corporation. While a centralized data system was implemented, improvements in data entry, reporting, and tracking remain critical for effective program management and evaluation.
oncurrent with this evaluation. NMR Evaluation 2010 DSM Programs Executive Summary Page 6 The DSM Administrator should examine their data tracking processes and procedures for each program and consider the following recommendations regardi...
AI summary The evaluation recommends improving data tracking protocols for DSM programs, including standardizing data entry, automating reports, enhancing audit processes for specific programs, and ensuring systems capture historical billing data to support program evaluation and management.
ns (e.g. monthly portfolio and program reports). If possible, incorporate data likely to be needed for project assessments (such as historical billing data) into the data tracking system. 1.4 Looking Ahead to 2011 As Efficiency Nova Scot...
AI summary Efficiency Nova Scotia evaluated program performance from 2008-2010, finding that commercial/industrial sectors contributed over two-thirds of total energy and demand savings annually, while residential programs accounted for less than one-third. Key reliance on Efficient Products Direct Install and CFL programs faced challenges due to the 2012 incandescent bulb phase-out.
n of implementing electric DSM programs in the province, Efficiency Nova Scotia has an opportunity to create relationships anew, not only with customers, but with stakeholders and interest groups.6 5 The Appliance Retirement and Replacemen...
AI summary Efficiency Nova Scotia aims to rebuild stakeholder relationships post-DSM program transitions. The 2010 DSM program evaluation focused on documenting objectives, estimating energy savings, and identifying performance improvements. The Appliance Retirement and Replacement program differed from other efficiency initiatives. Evaluations used surveys, on-site data, and net-to-gross ratios to account for free ridership.
d that incorporated impacts of free ridership and, in some cases, spillover. The net-to-gross ratio was applied to the gross savings impacts in order to estimate net savings impacts for each program.7 2.2.1 On-site Evaluations In total, th...
AI summary The NMR team conducted on-site evaluations for 11 programs, calculating net-to-gross ratios to account for free ridership and spillover effects. Five programs showed low free ridership, while methods for determining net impacts are detailed in program reports.
and Appliance Retirement & Replacement), NMR evaluated a total of 11 programs. Five of these eleven programs showed relatively low levels of free ridership— Efficient Products –Retail: CFLs, LIH, C&I 7 Free ridership and spillover were not...
AI summary NMR evaluated 11 DSM programs in 2010, finding five with low free ridership. The LIH program lacked free ridership/spillover data, while the SLC program had over 5,000 completed projects. Verification calls were made to refine savings estimates.
athered over the phone. NMR Evaluation 2010 DSM Programs Executive Summary Page 9
AI summary The text references an evaluation of 2010 Demand Side Management (DSM) programs, with a focus on the Nova Scotia Utility and Review Board (NMR). The document appears to be part of a regulatory proceeding analyzing program effectiveness and compliance.
f 2010. However, even the new minimum requirement of EnerGuide 83 did not set significant stretch goals for participants, who could exceed this rating simply by installing a heat pump. The Business Energy Rebates program was a new program...
AI summary The Business Energy Rebates program's prescriptive measures led to higher free-ridership due to high transaction volumes. Table 2-1 shows net-to-gross ratios for various programs, with the LIH program exempt from free-ridership calculations as it offers free participation. The Efficient Products –Retail: CFLs program used a difference-of-differences approach to estimate its net-to-gross ratio.
a net-to-gross ratio using a difference-of-differences approach and was presumed to have had spillover. Free ridership was not calculated for the LIH program which is free to low income participants. NMR Evaluation 2010 DSM Programs Execut...
AI summary The evaluation of 2010 DSM programs used a net-to-gross ratio with a difference-of-differences approach, acknowledging spillover effects. Free ridership was not calculated for the LIH program due to its free access for low-income participants. Process evaluations included interviews, surveys, and site visits to assess program implementation.
iew with a Delivery Agents, eight interviews with Contractors, and four in-depth interviews with program participants. A summary of the interviews completed for each program is presented in Table 2-2. Table 2-2: 2010 Process Evaluation In-...
AI summary The 2010 DSM program evaluation involved 12 staff interviews, 15 delivery agent interviews, 8 contractor interviews, and 4 participant interviews across programs like C&I Custom, SBLS, DI, and LIH, with results summarized in Table 2-2. The evaluation focused on stakeholder perspectives and program implementation details.
12 15 8 4 NMR Evaluation 2010 DSM Programs Executive Summary Page 11 2.3.2 Telephone Surveys NMR completed a total of 548 interviews with 2010 program participants and 70 interviews with non- participants (Table 2-3). Although the content...
AI summary NMR conducted telephone surveys with 548 DSM program participants and 70 non-participants in 2010-2011 to evaluate program effectiveness, including satisfaction, installed measures, free-ridership, and spillover effects. Surveys were administered by Interviewing Service of America via CATI, with RDD samples for some programs and DSM Administrator-provided contact data for others.
ing Houses Program utilized random digit dial (RDD) samples of residential telephone numbers in Nova Scotia and the remaining programs utilized contact information provided by the DSM Administrator.11 Table 2-3: 2010 Process Evaluation Tel...
AI summary The 2010 DSM program evaluation used RDD sampling for residential surveys and direct contact information for other programs. Surveys covered C&I Custom, SBLS, EP RM/PD, and others, with varying participant and non-participant counts. The NH program used RDD for non-participant surveys.
for the non-participant survey. NMR Evaluation 2010 DSM Programs Executive Summary Page 12 3 Individual Program Performance Based on the evaluation activities described above, it is the opinion of the NMR team, that the portfolio of progra...
AI summary The NMR evaluated 2010 DSM programs, finding them generally well-run and efficient. To meet 2011 energy savings goals, the DSM Administrator must increase participation rates, enhance savings per participant, and introduce new programs as existing ones reach their life cycles.
grams reach the end of their program life-cycles. Brief overviews of NMR‘s evaluation for each program are presented below, complete evaluation findings can be found in the individual program reports.
AI summary The text notes that programs are reaching the end of their life cycles, with brief evaluations by NMR provided. Full findings are detailed in individual program reports, indicating a focus on assessing program outcomes and effectiveness.
3.1 C&I Custom Program (C&I) The C&I Custom program is a well run program with a well-documented and detailed data tracking process, rigorous policies and procedures to screen out free-riders, and a rigorous monitoring and verification (M&...
AI summary The C&I Custom program demonstrated strong energy savings in 2010 but missed demand targets. NMR recommends adapting incentives to include demand response. Program success was driven by expanded outreach via Sales Leads, though long implementation timelines may delay impact realization. The program's rigorous M&V and free-rider screening were noted as strengths.
ce any effort to improve the program through a process evaluation would have been of limited value as the SLC program will be terminated once the expected legislation mandating T8 lighting is enacted. 3.3 Small Business Direct Install Ligh...
AI summary The SLC program will terminate with T8 lighting legislation enactment. The SBLS program showed increased energy impacts and customer satisfaction but faced material delivery issues, leading to a 2011 redesign allowing Delivery Agents to source materials independently.
will become increasingly important for the DSM Administrator to monitor the performance of Delivery Agents in order to achieve 2011 targets and to ensure continued high levels of customer service. NMR Evaluation 2010 DSM Programs Executive...
AI summary The DSM Administrator must monitor Delivery Agents to meet 2011 targets and maintain service quality. The Power Down (PD) program's CFL component faces challenges due to the 2012 incandescent bulb phase-out, necessitating diversification into other efficiency measures. However, other retail products under PD are unlikely to match CFLs' energy savings contribution.
One possible approach might be to require customers to pay for a portion of the cost for the energy efficiency measures offered by the program and to continue to offer installation services for free. 3.6 EnerGuide for Existing Houses Progr...
AI summary The EnerGuide for Existing Houses (EEH) program faced challenges due to the withdrawal of federal rebates by NRCan and the transition of administration from Nova Scotia Power to Efficiency Nova Scotia Corporation, leading to staff layoffs and uncertainty about the program's future. Despite these issues, the program exceeded its energy savings goals, and there is a need to rebuild trust with Delivery Agents and re-establish the program's infrastructure.
p levels continue to rise, consider adjusting the if it continues to increase it may become an area of concern. screening procedures used to identify free-riders. C&I-F2. C&I-R2. Due to the compressed time frame between the end of the prog...
AI summary The text discusses challenges in the C&I Custom program's evaluation process, including compressed timelines, data entry errors, and the need for improved screening procedures and evaluation schedules to ensure accurate and rigorous impact assessments.
Program Finding Recommendation Business BER-F1. BER-R1. Energy Unlike the C&I Custom program, the BER program did not While higher levels of free-ridership may be acceptable for a new Rebate incorporate any checks to ensure that participan...
AI summary The BER program lacks checks to ensure participants have funding from the DSM Administrator before proceeding with implementation. Free-ridership was high at 46% in 2010, compared to low levels for the C&I Custom program. As the BER program matures, it is recommended to introduce a free-ridership screening process, particularly for larger projects over $2,000. Awareness and outreach efforts should also be intensified in 2011.
Program Finding Recommendation EnerGuide EEH-F6. EEH-R6. Existing The EEH program has both resource acquisition and market In order to achieve its market transformation goals, any future transformation goals. A pool of well trained contrac...
AI summary The EEH program aims to achieve market transformation goals through contractor training. Proper training ensures correct installation of energy efficiency measures and increases the likelihood of contractors recommending energy-efficient products. The withdrawal of federal rebates in 2010 and the transition of DSM program administration are also discussed.
Program Finding Recommendation Low LIH-F4. LIH-R4. Income Customers were motivated to participate in the program primarily Continue to promote the savings benefits of the program with an Households because of energy savings and the associa...
AI summary The Low Income Households Program was found to motivate participation through energy savings and financial benefits. Participants reported significant reductions in energy bills and improved comfort. The program was successfully promoting savings, but there was some skepticism about it being free. The recommendation is to emphasize the program's cost-free nature and the comfort benefits of the installed measures.
consumers on continued energy efficient information from the energy audit, there was a change in their behavior practices offers a payback in energy savings long after a customer with regard to their use of energy at home: 51% now turn off...
AI summary The program has achieved high overall satisfaction (90%) with participants reporting increased energy efficiency interest and knowledge. However, satisfaction with specific aspects like energy conservation measures, presentations, and work quality declined between 2009 and 2010. The top recommendation for improvement is enhancing the quality of work.
n-depth interviews with DSM Administrator staff and implementation contractors as well as telephone surveys with 16 store managers, including nine with chain retailers and seven with independent retailers. All the interview guides and surv...
AI summary The evaluation of the 2010 Power Down Program involved interviews and surveys to estimate energy savings, using data from previous studies and databases like CALMAC and CEE. The findings include first-year energy and demand savings estimates, accounting for line losses and interactive effects of heating.
es washers 114.2 548 15% 17.1 82 Total Program 2,078.0 9,678 107% 2,234.8 10,361 Findings and Recommendations3 The CFL component of the PD program is faced with the upcoming phase-out of incandescent bulbs starting in January 2012.4 The fi...
AI summary The CFL component of the PD program is reaching the limits of its energy-saving value due to the phase-out of incandescent bulbs starting in 2012. The program diversified in 2010 in anticipation of this change. Free-ridership and net-to-gross ratios were estimated based on surveys and interviews, with programmable thermostats and dimmer switches excluded due to low projected energy savings.
-dec08.cfm?attr=4 NMR Evaluation of 2010 Power Down Program Page III
AI summary This document evaluates the 2010 Power Down Program, focusing on its effectiveness in reducing energy consumption and achieving program goals. It discusses program design, implementation, and outcomes, providing insights into its impact on energy efficiency and customer participation.
chase the products anyway. NMR Evaluation of 2010 Power Down Program Page IV
AI summary The text refers to an evaluation of the 2010 Power Down Program, which is likely related to energy efficiency or demand-side management initiatives. However, the content is incomplete and lacks detailed discussion or analysis.
etailers look for more opportunities to leverage energy efficiency programs and promote energy efficiency. Long-Term Outcomes Improved availability of energy efficient appliances. Increased understanding of the benefits of energy efficie...
AI summary The document discusses long-term outcomes of energy efficiency programs, including increased availability of efficient appliances, standard practices among residential customers, and sustained energy savings. It also mentions the evaluation of the 2010 Power Down Program, specifically the CFL component, and the use of a logic model and difference-in-differences approach to estimate energy savings.
e effects of free-ridership and spillover. Using the difference of differences approach based on establishing a counterfactual, the formula for computing the net energy savings is as follows: And Where, NTGR = Net-to-Gross-Ratio A = Partic...
AI summary The text discusses the calculation of net energy savings using a difference of differences approach, focusing on CFL purchases by participants and non-participants in a program. It highlights the impact of free-ridership and spillover effects, and provides data on average monthly purchases before and during the program period.
d 7,383 programmable thermostats between October and November of 2010, resulting in savings of 466,236 kWh—we believe these savings estimates are accurate and do not recommend any changes. (Table 3-2) Table 3-2: Tracked and Evaluated Savin...
AI summary The document evaluates the savings from 7,383 programmable thermostats installed between October and November 2010, reporting total savings of 466,236 kWh. It also discusses the savings estimates for indoor light timers, citing the OPA report and confirming their reasonableness based on the 2007 Every KiloWatt Counts Program.
Number of units 524 Savings per unit (kWh) 219 Total savings (kWh) 114,756 3.2.3 Outdoor/Heavy Duty Timers The NMR team reviewed two reports to determine whether or not the program‘s current savings estimate for heavy duty timers (for pool...
AI summary The NMR team evaluated the savings estimate for heavy duty timers used in pool pumps, reviewing reports from ADM (2002) and OPA (2010). The OPA report assumed a reduction in pool pump operation from ten to six hours per day, leading to an estimated savings of 383.65 kWh per unit. NMR concluded that the assumptions were reasonable and that the tracked savings estimates should remain unchanged.
3.4.1 Retail Survey Questions In order to determine the magnitude of free-ridership and spillover, retailers were asked a series of questions related to their sales of fixtures and controls before, during and after the Power Down program p...
AI summary The Nova Scotia Utility Board (NMR) designed a retail survey to estimate free-ridership and spillover effects from the Power Down program. Only measures with higher projected savings were included in the survey, while lower-saving measures like dimmer switches and thermostats were excluded from free-ridership estimation. Retailers were asked about sales trends and rebate impact to evaluate program effectiveness.
gy and demand savings for the APP component of the PD program in 2010. For the 2010 program year, the generator-level impacts were estimated at 160 MWh of energy savings and 31.5 kW of demand savings. Table 4-9: Appliance Energy Savings Es...
AI summary The 2010 Power Down Program's appliance energy savings were estimated at 160 MWh of energy and 31.5 kW of demand savings. The evaluation included interviews with program staff and contractors, as well as residential customer surveys to assess the program's impact and process.
r and one interview in December with the implementation contractor‘s project manager. The interviews covered a variety of program- related topics, including program goals, program theory and delivery. 5.1.2 Residential Survey Seventy progr...
AI summary The report details a residential survey conducted in December 2010 to assess the impact of the CFL program. It identified 31% of participants, higher than previous years, and used telephone interviews to estimate spillover effects and in-service rates. The survey was conducted by NMR's subcontractor, Interviewing Services of America, using a random digit dial sample.
h the current level of communication. Per its contract, the implementation contractor was responsible for the following program development, implementation and tracking activities: Program Development Developing a detailed project plan ...
AI summary The 2010 Power Down Program involved the implementation contractor handling program development, implementation, and tracking. Activities included developing a project plan, evaluating products, executing marketing plans, and tracking sales and energy savings. Outreach efforts included direct mail, radio ads, and in-store promotions, which contributed to increased sales compared to previous years.
NMR Evaluation of 2010 Power Down Program Page 72 6 Process Evaluation: Fixtures and Controls 6.1 Program Description The Light Fixtures and Controls (F&C) portion of the 2010 Nova Scotia Power Down (PD) program began on October 1st 2010 a...
AI summary The 2010 Power Down Program's Light Fixtures and Controls portion exceeded energy savings projections, with significant rebate redemptions for various energy-efficient products. A telephone survey of 47 chain store managers was conducted to evaluate the program's implementation and effectiveness.
ot important 22% 5% 9% Not at all important 17% 9% 6.5 Retailer Satisfaction Overall satisfaction with the program was high among the retailers interviewed with more than three out of five saying they were very satisfied and an additional...
AI summary Retailer satisfaction with the program was high, with over 60% of chain retailers reporting they were very satisfied and an additional one-third satisfied. Dissatisfaction was low, with only two retailers citing reasons such as customer unawareness and insufficient program items.
NMR Evaluation of 2010 Power Down Program Page 82 7 Process Evaluation: Appliances 7.1 Methodology According to the work plan, NMR had planned to conduct a survey of customers who had purchased a rebated ENERGY STAR refrigerator or clothes...
AI summary The evaluation of the 2010 Power Down Program's appliance rebate component was impacted by retailers' refusal to provide customer names due to confidentiality concerns. NMR adjusted the evaluation method by piggybacking appliance rebate questions onto a survey of retail store managers. Interviews were conducted with store managers and program staff to assess program administration and delivery.
Table 7-22: Satisfaction with Specific Aspects of Program – Chain and Independent Retailers Chain Independent Retailers Retailers Total Sample size 9 6 15 Very satisfied 4 4 Program Marketing and Satisfied 3 2 5 Advertising Neither satisfi...
AI summary The table presents survey results on customer satisfaction with various aspects of a program among chain and independent retailers. It includes metrics on satisfaction with program marketing, support, items covered by the program, and rebates, with varying sample sizes and responses across categories.
150 50 118 5,900 33 150 101 117 11,817 40 150 146 110 16,060 Unknown na 61,389 na na Total na 179,591 na na NMR Evaluation of 2010 NSPI Power Down Program Page B1 Appendix B - Questionnaire and Interview Guides NOVA SCOTIA POWER RESIDENTIA...
AI summary This document outlines a questionnaire used by the Nova Scotia Utility Regulator (NMR) to evaluate the Nova Scotia Power residential lighting program. The survey aims to gather customer feedback to improve energy efficiency initiatives, with assurances of confidentiality.
please tell me if you are very satisfied, satisfied, neither satisfied nor dissatisfied, dissatisfied, or very dissatisfied with your experience with that specific aspect of the program. VS S Neither Dissat V.Dissat DK/Ref a. Program marke...
AI summary The text presents a survey format asking participants to rate their satisfaction with various aspects of the Power Down program, followed by questions about barriers to participation and recommendations for improvement. It includes rating scales and open-ended questions for feedback.
rier affecting customer participation? Any others? 25. Do you have any recommendations for improving the Power Down program? NMR Evaluation of 2010 NSPI Power Down Program Page B63 26. Approximately how many full-time equivalent workers ar...
AI summary The document includes questions about the Power Down program and its impact on customer participation, as well as evaluations of the 2010 NSPI Power Down Program and appliance retirement and replacement programs conducted by NMR Group, Inc. for Efficiency Nova Scotia Corporation.
ent Refrigerators 31.2 149.8 100% 31.2 149.8 Total 639.8 3,070.5 74% 476.4 2,285.9 Program NMR Evaluation of 2010 Appliance Retirement & Replacement Programs Page iii Findings and Recommendations The process evaluation drew upon in-depth i...
AI summary The evaluation of the 2010 Appliance Retirement & Replacement Programs in Nova Scotia found substantial demand for such programs despite high free ridership. The program achieved its savings goals and was extended into a second phase. Future programs should address free ridership, incentive structures, promotion timing, and planning and communications.
Transfer of understanding. Multi-residential unit owners will remember the energy and bill savings they realized from participating in the program and consider energy efficient options when making decisions to purchase other energy using...
AI summary The text discusses a program aimed at replacing inefficient refrigerators in multi-residential units, highlighting barriers such as program timing and inadequate staff, as well as outcomes like energy savings, bill reductions, and environmental benefits from appliance recycling.
ts for the secondary replaced refrigerator UEC is shown below: Similar calculations were applied to the other UECs. Table 3-10 shows the adjusted gross savings using each of the NMR methodologies. Table 3-10: Adjusted Gross Savings per Uni...
AI summary The document evaluates the 2010 Appliance Retirement & Replacement Programs by comparing adjusted gross savings estimates with tracking database estimates, showing a 42% decrease for refrigerators and 37% for freezers.
27% 7% NFR (non-free-riders) 57 93 PFR (possible free-riders) 14 0 3.5.2 Appliance Replacement Component NMR was able to conduct only one in-depth interview with a participant in the Appliance Replacement program component. NMR determined...
AI summary The document discusses the evaluation of the 2010 Appliance Retirement & Replacement (ARR) program, noting that free ridership could not be estimated due to limited data. Net savings were calculated based on original population tracking and participant survey data, resulting in 2,286 MWh of energy savings and 476.4 kW of demand savings.
ngs and do not account for any potential program free ridership. For the 2010 program year, the generator-level impacts were estimated at 2,286 MWh of energy savings and 476.4 kW of demand savings. Table 3-27: 2010 Final Energy and Demand...
AI summary The 2010 Appliance Retirement & Replacement Programs resulted in estimated energy and demand savings, with generator-level impacts of 2,286 MWh of energy savings and 476.4 kW of demand savings. Table 3-27 summarizes the gross and net savings across various appliance categories.
476.4 2,285.9 NMR Evaluation of 2010 Appliance Retirement & Replacement Programs Page 30 4 Process Evaluation 4.1 Methodology The 2010 process evaluation of the Appliance Retirement and Replacement program drew upon in-depth interviews con...
AI summary This section outlines the methodology used in the 2010 process evaluation of the Appliance Retirement and Replacement program, which included in-depth interviews with program staff, contractors, and participants, as well as a survey of participants.
rily to the expanded of hours of operation. NMR Evaluation of 2010 Appliance Retirement & Replacement Programs Page 34 4.3.2 Administrative Structure and Processes Out of necessity, many pilot programs are designed operate for a limited ti...
AI summary The document discusses the administrative structure and processes of the 2010 Appliance Retirement & Replacement (ARR) program. It notes that pilot programs are often limited in time and geography, which can hinder performance but also allow for quick evaluation. The ARR program faced challenges related to staffing and free-ridership, with suggestions for improving future programs.
Theory and Logic Model Review: 10. In general, how would you characterize the overall goals of the program—would you say that the program is primarily a Resource Acquisition program, where the focus is on delaying or displacing new power p...
AI summary The text outlines a series of questions for reviewing a program's goals, motivations, barriers to participation, and market impacts across short-, intermediate-, and long-term timelines. It also inquires about measurement indicators for program effectiveness.
program effectiveness and success in short-, intermediate-, and long-term? Marketing, Participating Retailers, and Verification: 17. Please explain the various marketing activities utilized by each program. What do you think is particularl...
AI summary The text includes a series of questions about program marketing, delivery, effectiveness, and gaps in coverage related to the 2010 Appliance Retirement & Replacement Program. It also asks about program strengths, weaknesses, and potential improvements, as well as about individuals or groups to interview for further evaluation.
s it provided? How frequently is it provided? Approximately how much of your organization‘s effort for the Appliance Retirement Program is spent on fulfilling data tracking requirements? 17. In general, how well do you think the program tr...
AI summary The text includes questions about data tracking requirements for the Appliance Retirement Program, the efficiency of the program tracking and reporting process, and the program delivery process. It asks about data capture, communication, and improvements. NMR is mentioned as the entity involved.
20. Are there any factors inhibit your ability to effectively perform any part of the program delivery process? IF YES: What are they? How can these be addressed? What impact do you think addressing them will have on your effectiveness and...
AI summary The text outlines a series of questions aimed at assessing the effectiveness of a program delivery process, including challenges, successful aspects, and opportunities for improvement. It also explores customer awareness, participation rates, and satisfaction with the Appliance Retirement program.
MWh of energy savings and 2,174 kW of demand savings. These evaluated program savings substantially exceeded the program‘s goal of 4,930 MWh of energy savings and 1,410 kW of demand savings (Table 1). Table 1: 2010 Program Energy Savings P...
AI summary The 2010 Existing Houses Program achieved significant energy and demand savings, exceeding its goals. The evaluation highlights potential double counting of savings due to funding from multiple agencies, including Natural Resources Canada.
Findings and Recommendations The EnerGuide for Existing Homes program has been somewhat confusing for potential participants since the withdrawal of the rebates from NRCan in March 2010. In March, 2010 NRCan announced that new participants...
AI summary The EnerGuide for Existing Homes program exceeded its energy and demand savings goals despite confusion caused by the withdrawal of federal rebates and administrative changes. The program faces uncertainty about its continuation past March 31, 2011, which has affected delivery infrastructure and prompted NMR to emphasize the importance of maintaining relationships with Delivery Agents.
which would aid in program evaluations. EEH-F5. EEH-R5. The 2009 evaluation had found that the EEH program puts the full Any future program should consider creating a list of contractors burden of contractor selection on the customer and d...
AI summary The 2009 evaluation of the EEH program highlighted issues with contractor selection and lack of training. It recommended pre-approved, certified contractors to improve program effectiveness and reduce liability for the DSM Administrator.
Skills and equipment. Delivery Agents have the equipment, tools and skills required to complete evaluations of participating homes or they can contract for such services. Understanding of savings. Homeowners will understand the energy...
AI summary The document outlines the requirements and barriers related to the Energy Efficiency for Homes (EEH) program. It emphasizes the importance of skills, equipment, and awareness in achieving energy savings, while also identifying challenges such as lack of awareness, cost concerns, and the need for proper training.
. NMR Evaluation of 2010 Existing Houses Program Page 9
AI summary This chunk discusses the evaluation of the 2010 Existing Houses Program, likely focusing on its effectiveness, outcomes, and any associated performance metrics or feedback.
5 0% Don‘t know 25% Program Influence Score = maximum of FR5a, FR5b, or FR5c. NMR Evaluation of 2010 Existing Houses Program Page 15
AI summary The document evaluates the 2010 Existing Houses Program, with a focus on its influence score calculated as the maximum of FR5a, FR5b, or FR5c. A significant portion of respondents indicated they do not know the program's influence.
NMR Evaluation of 2010 EnerGuide for Existing Houses Program Page 19 3 Process Evaluation 3.1 Methodology The 2010 process evaluation of the EnerGuide Existing Houses (EEH) program drew upon in-depth interviews conducted with program staff...
AI summary The 2010 process evaluation of the EnerGuide Existing Houses (EEH) program involved in-depth interviews with program staff, contractors, and delivery agents, as well as surveys of participants. The evaluation focused on program delivery, tracking, reporting, and suggestions for improvement.
e EEH program. Thus, to the extent feasible, interviews with staff or delivery agents who worked on both programs were combined to avoid having to conduct multiple interviews with the same person. 3.1.2 Participant Survey NMR completed a t...
AI summary The document discusses the evaluation of the 2010 EnerGuide for Existing Houses program, including the integration of interviews with staff involved in both the EnerGuide and EEH programs, and a participant survey conducted with 2010 program participants. The survey aimed to assess satisfaction, motivations, and program value, with sampling errors provided for both 2009 and 2010.
t I installed) 7. (The process would take too long) 8. (Other) [SPECIFY _]) 9. Don‘t know 10. Refused Section 2 – Satisfaction with program 7. Thinking of your OVERALL experience with the EnerGuide for Existing Houses Program up to this po...
AI summary The text outlines survey questions related to customer satisfaction with the EnerGuide for Existing Houses Program, including overall satisfaction, reasons for dissatisfaction, and satisfaction with specific aspects of the program.
Staff Interview Guide for EnerGuide Existing Houses Date: Name: Programs responsible for: Introduction: [This interview should take about an hour] Your comments are confidential. By the way, if I ask you about areas you don‘t know about, p...
AI summary This document outlines an interview guide for the EnerGuide Existing Houses program, focusing on program responsibilities, stakeholder interactions, communication challenges, program timelines, and energy savings goals. It aims to gather insights on program implementation and performance.
of specific areas later in the interview, but from an overall perspective, what would you say are the successes you were able to achieve in planning and implementing the program(s) this year? a. Again at the broadest level, what were the a...
AI summary The text discusses an evaluation of the 2010 EnerGuide for Existing Houses Program, focusing on its successes, challenges, and theoretical framework. It explores whether the program's primary goal is resource acquisition, market transformation, or a combination of both.
9. What are the major components and activities of the program, and what are they intended to accomplish? a. In the short term? b. Intermediate term? c. Long term? 10. What are the key outputs from each activity? 11. Is there any sequence...
AI summary The text outlines a set of questions regarding the major components, activities, and goals of a program, including its short-term, intermediate, and long-term objectives, key outputs, sequencing of activities, measurement of success, and assumptions underpinning the program's effectiveness.
Marketing and Verification: 16. Please explain the various marketing activities utilized by each program. What do you think is particularly good about program marketing? How could program marketing be improved? 17. Overall, how successful...
AI summary The document outlines a series of questions related to program marketing, delivery, success, free-ridership safeguards, coverage gaps, and the adoption of 2009 recommendations. It also asks about program strengths, weaknesses, and potential improvements.
Scotia Power? If not, what data should be captured? Do you think the data is being captured and communicated in the most efficient possible way? IF NO: How could the data capture and communication be improved? 16. [IF NOT MENTIONED ABOVE]...
AI summary The text outlines a series of questions related to data collection and program delivery processes for energy efficiency initiatives. It focuses on data capture, communication, and program implementation, including audit timelines, customer follow-up, and challenges in program delivery.
that can be done to encourage these customers to implement recommended measures? 22. For customers who go on to do the final audit, typically, how soon after the first audit do they implement the measures and how much time after the first...
AI summary The text outlines a series of questions aimed at evaluating the 2010 EnerGuide for Existing Houses Program, focusing on customer behavior, program effectiveness, vendor practices, and areas for improvement.
ng the program delivery process? NMR Evaluation of 2010 EnerGuide for Existing Houses Program Page B7
AI summary The document discusses the evaluation of the 2010 EnerGuide for Existing Houses Program, focusing on the program delivery process and its effectiveness.
additional electric measure rebates from Nova Scotia Power? 34. How does the pre-retrofit evaluation serve the customers‘ needs? How often does the information provided confirm what they already know about their homes? How often does it le...
AI summary The text includes a series of questions about the effectiveness of energy efficiency programs, including customer satisfaction, program barriers, and program improvements. It also references an evaluation report on the Low Income Households Program from 2010, submitted to Efficiency Nova Scotia Corporation.
NMR Evaluation of 2010 Low Income Households Program Page I Executive Summary This report presents the results of the 2010 process and impact evaluation of the residential Low Income Households program (LIH) conducted by NMR Group, Inc. (N...
AI summary This report evaluates the 2010 Low Income Households (LIH) program, also known as the Residential Energy Affordability Program (REAP), administered by Conserve Nova Scotia (CNS). The evaluation was conducted by NMR Group, Inc. for Nova Scotia Power and Efficiency Nova Scotia Corporation, and included interviews with staff and contractors, as well as a telephone survey with 62 participants.
h Agent Integrate Outreach and Delivery Agents as full partners in and the participants they recruited, but not between the participants program delivery. Establish a feedback loop for Outreach and CNS. Both of the Outreach Agents reported...
AI summary The document highlights issues with communication and data tracking in the DSM program, including lack of resolution for customer complaints, inconsistent data formats, and discrepancies between installed measures and records. It recommends integrating outreach and delivery agents, providing online data tracking, and standardizing data entry.
Delivery Agent to walk measures that were recorded as having been installed and what they participants around their homes after installation is thought actually was installed. In particular, verification of building complete and attest to...
AI summary The evaluation of the 2010 Low Income Households Program found that verification of installed energy efficiency measures decreased from 95% in 2009 to 77% in 2010, possibly due to poor recall or incomplete installation. Quality control activities were increased in 2010, including third-party inspections and participant sign-off on installed measures.
icipants. The participant and nonparticipant billing data used in the analysis extended from January of 2008 through present. This data was analyzed in a systematic way to estimate program impacts. Specifically, the initial analysis determ...
AI summary The document outlines the methodology used to analyze billing data for program participants and nonparticipants from January 2008 to the present. The analysis includes developing participant billing information, creating a control group, temperature normalizing data, and quantifying energy impacts using various statistical methods.
e-participation and post-participation period to be accurately analyzed. At the end of the editing of the participant billing data a total of 210 participants were available for the billing analysis. 2.4 Develop Representative Control Grou...
AI summary The analysis involved 210 participants in the LIH program and the creation of a control group of 1,860 customers to assess the program's impact on electricity consumption. The control group was selected based on similar temperature, rate class, and heating source. Matching criteria included annualized usage and rate code, with four control group customers selected for each participant. The distribution of annualized usage showed similar consumption patterns between the groups.
se in the mean and median consumption for the pre to post period. The comparison of the NAC between groups for each period demonstrates that the control group is well matched to the participant group. Table 2-3: Distribution of Electric NA...
AI summary The text discusses the analysis of energy consumption data for participants and control groups before and after program installation, using statistical methods to quantify energy impacts. The analysis involved stratification based on pre-participation NAC to ensure accurate projections of program savings.
-5000 -4000 -3000 -2000 -1000 0 1000 2000 3000 4000 5000 Net Savings 2.6.2 The Regression Approach To try to obtain a more precise estimate of savings, the regression approach was implemented.11 Only a subset of the participants had tracki...
AI summary The regression approach was used to estimate savings from the 2010 Low Income Households Program. It assumed expected savings correlated with pre-participation consumption, using pre-NAC as a proxy. The analysis showed that participants with tracking data were not representative of the broader population, leading to higher variability in savings estimates.
AP%20Evaluation%20Report.pdf NMR Evaluation of 2010 Low Income Households Program Page 19 Table 2-10 presents the final estimates of savings for the LIH program based upon the billing analysis results described above. This table utilizes t...
AI summary The 2010 Low Income Households (LIH) Program achieved 800.3 MWh in energy savings at the meter and 895.4 MWh at the generator. The program had a 30% realization rate compared to the tracking estimate. Demand savings were estimated at 178 kW at the meter and 199.2 kW at the generator.
A lot of it is the outreach agents don‘t know exactly what we‘re looking for.‖ The lack of regularity in the provision of prospective participant names was identified as a significant weakness of the 2009 REAP program year. The 2010 in- de...
AI summary The evaluation of the 2010 Low Income Households Program highlights issues with outreach agents' lack of clarity on program goals and irregular provision of participant names, identified as significant weaknesses. Improper screening of participant homes was also noted as an ongoing issue.
3.7 Program Tracking and Reporting The REAP program collects data from customers regarding their energy usage before and after participation in the program. This is done by asking the homeowners to sign a waiver that allows CNS and the DSM...
AI summary The REAP program collects energy usage data from participants before and after upgrades, using waivers to access information from fuel providers and NSPI. Delivery Agents maintain a database and submit monthly tracking sheets. While tracking has improved, feedback mechanisms and data integration are areas for improvement.
or rural inhabitance, was difficult for some participants and could potentially represent a barrier to participation. However, outreach agents focus on explaining the chart to potential participants. 4.3 Verification of Measures Installed...
AI summary The document discusses verification rates of energy efficiency measures installed in homes under the REAP program. Verification rates varied across different measures, with some showing improvement from 2009 to 2010, while others, like building envelope measures, saw a decline. Lower verification rates may be attributed to respondents' difficulty recalling installations due to the time elapsed since installation.
valuation of 2010 Low Income Households program Page A6 Equation 7 - The Augmented Comparison Approach, Determination of Net Savings NACPost Pr ogram (Ci ) S adjusted NAC pre program ( Pi ) NAC post Pr ogram ( Pi ) NACPre Pr ogram (...
AI summary The document discusses two methods for evaluating the 2010 Low Income Households program: the Augmented Comparison Approach and the Regression Approach. The Augmented Comparison Approach adjusts savings based on control group averages, while the Regression Approach uses a systematic four-step process to quantify program impact.
Yes 4 NMR Evaluation of 2010 Low Income Households program Page B2 Table B-5: Impact of Measures 2009 2010 Rating: 5= ‘considerable Rating: 5= ‘considerable improvement’ improvement’ and 1 = ‘no improvement’ and 1 = ‘no improvement’ n 5 4...
AI summary The document evaluates the impact of the 2010 Low Income Households program by analyzing survey responses on comfort, value of the house, energy bill reduction, and energy efficiency knowledge. It includes a questionnaire used during interviews with participants.
a. Again at the broadest level, what were the areas that were not so successful? b. To what do you trace the difficulties you encountered? How might they be addressed in future programs? Marketing and Verification: 8. Please explain the va...
AI summary The text outlines a series of questions posed to evaluate the success, challenges, and improvements needed for energy efficiency and conservation programs. It covers marketing, delivery, free rider safeguards, program gaps, and a review of past recommendations.
16. In general, how well do you think the program tracking and reporting process is working? Do you believe all the necessary data is being captured and passed on to Conserve Nova Scotia? To Nova Scotia Power? If not, what data should be c...
AI summary The text asks about the effectiveness of the program tracking and reporting process, data capture, program delivery timing, vendor selection, and factors affecting program delivery. It seeks improvements and insights into the delivery process and vendor relationships.
c. Again at the broadest level, what were the areas that were not so successful? d. To what do you trace the difficulties you encountered? How might they be addressed in future programs? PROGRAM OUTREACH 11. Do you have any goals for the p...
AI summary The text focuses on evaluating the success and challenges of the Low-Income Residential Energy Assistance Program (LI REAP), including outreach efforts, awareness levels, participation barriers, and opportunities for improvement, particularly in reaching low-income consumers and renters.
ularly good about program outreach? How could program outreach be improved? STRENGTHS AND WEAKNESSES / WRAP-UP 18. What would you say are the greatest strengths of the LI REAP program? And what would you say are the greatest weaknesses? Wh...
AI summary The document includes questions about the Low-Income Residential Energy Assistance Program (LIREAP), focusing on its outreach strengths and weaknesses, and potential improvements. It also references an evaluation report on the 2010 New Houses Program conducted by NMR Group, Inc. for Efficiency Nova Scotia Corporation.
................................ 13 NMR Evaluation—2010 New Houses Program Page 1 1 Executive Summary This report presents the results of the process and impact evaluation of the 2010 New Houses (NH) program conducted by NMR Group, Inc. (N...
AI summary This report evaluates the 2010 New Houses program, focusing on its process and impact. Key changes included a new building code requiring EnerGuide ratings and a transition to the PerformancePlus program. The evaluation involved surveys and interviews to assess program administration, satisfaction, and barriers to participation.
tion explored issues that included program administration, satisfaction, motivation, barriers to participation and how the rebates incentivized participants to implement energy efficiency measures. NMR Evaluation—2010 New Houses Program Pa...
AI summary The impact evaluation of the 2010 New Houses Program found that it achieved 680 MWh of energy savings and 810 kW of demand savings, falling short of the energy savings target of 2,000 MWh but exceeding the demand savings target of 640 kW. Net savings were calculated using a 46% net-to-gross ratio.
NMR Evaluation—2010 New Houses Program Page 14 3 Impact Evaluation 3.1 Methodology The NMR team‘s approach to evaluating the 2010 impacts of the NH program was based on a review of the program records to assess the approach taken by the DS...
AI summary The NMR team evaluated the 2010 New Houses Program by reviewing program records and tracking data to assess savings calculations and adjust estimates. A sample of homes was used to update baseline characteristics and calculate savings using HOT2000 and REM/Rate software. Free-ridership rates were determined via a survey of 47 participants. Total tracked savings for 2010 were 1,700 MWh at the meter and 1,900 MWh at the generator.
e one meant the program had ‗had no influence at all‘ on their decision and five meant that the program had been ‗extremely influential‘ to their decision to improve the energy efficiency of the home. 3.7.3.3 Impact of Budget For responden...
AI summary The evaluation of the 2010 New Houses Program found that the program had varying levels of influence on respondents' decisions to improve home energy efficiency, with some stating it had no influence and others saying it was extremely influential. A cross-check was performed for respondents with a 50% free-ridership rate based on their budget's ability to accommodate the project without the program.
core was reduced to 25%. NMR Evaluation—2010 New Houses Program Page 31 3.7.4 Combining Scores and Weighting Finally, to compute the overall free-ridership rate for each participant, their free-rider stated intent score was averaged with t...
AI summary This section discusses the evaluation of the 2010 New Houses Program, focusing on free-ridership rates calculated using different methods in 2009 and 2010. The overall free-ridership rate in 2010 was 54%, similar to 2009, with a net-to-gross ratio of 0.46.
2. Nova Scotia Home Builders‘ Association – 50% c. Low Income REAP i. Kate McDonald at Conserve Nova Scotia ii. Delivery agents 1. MJM Energy 2. Clean NS 3. Trinity Maintenance Solutions 4. ACAP Cape Breton iii. Low income outreach agent [...
AI summary The document discusses the implementation and evaluation of energy efficiency programs, including interactions with various stakeholders such as the Nova Scotia Home Builders‘ Association and low-income outreach agents. It explores program goals, communication challenges, and the effectiveness of initiatives like the EnerGuide New and Existing Homes Programs.
g Now, turning to the EnerGuide New Homes Program / Now, turning to the EnerGuide Existing Homes Program 8. Does the program have an explicit program theory and logic model? 9. In general, how would you characterize the overall goals of th...
AI summary The discussion focuses on the EnerGuide New Homes Program and its program theory, logic model, and overall goals. It asks whether the program is primarily a Resource Acquisition program, a Market Transformation program, or a combination of both, and why.
10. What are the major components and activities of the program, and what are they intended to accomplish? a. In the short term? b. Intermediate term? c. Long term? 11. What are the key outputs from each activity? 12. Is there any sequence...
AI summary The questions focus on the structure, sequence, and measurement of program activities, outputs, and outcomes over short, intermediate, and long-term periods. They also explore assumptions related to resource availability, customer motivation, and program effectiveness.
Marketing and Verification: 17. Please explain the various marketing activities utilized by each program. What do you think is particularly good about program marketing? How could program marketing be improved? 18. Overall, how successful...
AI summary The text outlines a series of questions related to program marketing, delivery, success, free-ridership safeguards, coverage gaps, and evaluation of past recommendations. It also asks about program strengths, weaknesses, and needed improvements.
fic barriers to communication or collaboration with others involved in the program, such as turf issues or bureaucratic red tape? Are there any other overall issues with communication, or opportunities for improvement? 12. Describe how you...
AI summary The document asks about communication barriers, payment processes, and data tracking and reporting for the EnerGuide for New Houses Program. It seeks insights into challenges, opportunities for improvement, and the frequency and form of data submission.
h of your organization‘s effort for the EnerGuide for NMR Evaluation—2010 EnerGuide for New Houses Program Page A34 New Homes Program is spent on fulfilling data tracking requirements specifically for electric measures rebated by Nova Scot...
AI summary The text includes a series of questions directed at the Nova Scotia Home Builders' Association (NSHBA) regarding the EnerGuide for New Houses Program, focusing on data tracking, program management, and program delivery processes. It explores concerns about the lack of a dedicated program manager and the efficiency of data collection and communication.
al customers to the program? Who is targeted in your marketing (i.e Home buyers, Builders)? How do you market to them specifically? Do you have access to adequate materials and information for customer presentations and meetings?] 31. Are...
AI summary The text contains a series of questions about customer participation in a program, focusing on target segments, marketing strategies, and barriers to participation. It also references an evaluation of the 2010 EnerGuide for New Houses Program.
LED Exit Lights 1,957 410 83% 1,624 341 Total program 32,617 6,839 77% 25,233 5,291 Findings and Recommendations Despite changes to the free-ridership calculations from year to year, both the CFL and LED free-ridership rates remained stati...
AI summary The evaluation of the 2010 Efficient Lighting Products Direct Install Program found that free-ridership rates for CFLs remained stable, with many businesses already installing CFLs before the program. In contrast, LED exit light adoption was lower, suggesting a need to reconsider program incentives and design.
Table 3-5 shows the installed annual energy and demand savings for the 2010 Efficient Products Direct Install Program. This table is comprised of the original population tracking savings followed by the expanded savings estimates from the...
AI summary The document discusses the evaluation of the 2010 Efficient Products Direct Install Program, highlighting discrepancies in installation rates identified by the NMR team. These discrepancies led to an overestimation of program savings by 2,294 MWh, and the implementation contractor conducted audits to address the issue.
lize this information to inform an alternative savings estimate, we can assume that the reduction in savings of 2,294 MWh (or 5.5% of tracking) can also be considered an estimate of the installation rate, albeit a rate that is determined t...
AI summary The document evaluates the 2010 Efficient Lighting Products Direct Install Program, adjusting initial savings estimates based on installation rates. The initial estimate was 26,401 MWh, but after applying an adjusted installation rate of 72.2%, the final estimate becomes 29,853 MWh. This adjustment accounts for discrepancies in the implementation process.
FR4. installing the LED exit lights? Not including installation costs, the LED exit lights would have cost approximately [read: cost from program records]. Based on their responses to these questions, NMR divided respondents into three dis...
AI summary The text discusses the categorization of respondents in the 2010 Efficient Lighting Products Direct Install Program into full free-riders, non-free-riders, and partial free-riders based on their pre-existing plans, budget capabilities, and installation intentions.
he implementation contractor‘s project manager and the subcontractor‘s project manager. The interviews covered a variety of program-related topics including program goals, program theory and delivery. 4.1.2 Participant Survey & Sample Desi...
AI summary The document discusses the evaluation of the 2010 Efficient Lighting Products Direct Install Program, including interviews with project managers and participants, sample design changes, and the number of CFLs and LEDs installed by participants.
names and over-stated the NMR Evaluation of 2010 Efficient Lighting Products Direct Install Program Page 26 number of measures they installed was removed from the program. In addition, the implementation vendors sought to determine the sco...
AI summary The 2010 Efficient Lighting Products Direct Install Program faced issues with overstated savings due to inaccuracies in the tracking system. The implementation vendor conducted audits and site visits to estimate the overstatement and implemented new checks to prevent future errors. The program's awareness sources included phone calls, email, and word of mouth.
will be terminated once the legislation is enacted. The impact evaluation was based on visits to nine sites with installed lighting and visits with four of the six major distributors for the program. Impact Evaluation Findings For the BER...
AI summary The impact evaluation of the BER and SLC programs found that combined net generator-level impacts were 6,748.3 MWh of energy savings and 1,267.3 kW of demand savings, falling short of the combined program targets of 10,000 MWh and 2,420.0 kW. The evaluation used site visits, program records, and telephone surveys to estimate free-ridership and spillover effects.
0% FR4e. NSPI funded feasibility study Don‘t know 25% Program Influence Score = maximum of FR4a, FR4b, FR4c, FR4d and FR4e. NMR Evaluation of 2010 Prescriptive Rebate Programs Page 21 Table 3-10: Free-ridership Screening and Cross-check Qu...
AI summary The text discusses the evaluation of 2010 prescriptive rebate programs, focusing on free-ridership screening through questions such as whether organizations had prior plans to pursue specific measures and whether they could have afforded projects without incentives.
Demand Energy Sample size 6 6 Free-ridership rate 46% 46% 3.6 Net-to-Gross Ratio For the BER program, the net-to-gross ratio was calculated based on spillover and free-ridership. For the 2010 program year, the net-to-gross ratio for the BE...
AI summary The document evaluates the 2010 BER program, calculating the net-to-gross ratio at 54% for both energy and demand savings. It also estimates net annual energy savings at 503.3 MWh and demand savings at 0.72 MW, based on participant surveys and on-site observations.
rmation to further inform our analysis. Included in the analysis was an examination of the 2009 evaluation, which included a total of 41 telephone surveys (30 electrical contractors and 11 end users). 4.2.1 Transaction Paper Audit As part...
AI summary This section discusses the 2010 impact evaluation of the SLC program, including a transaction paper audit conducted by the NMR team. The audit involved verifying sales records from four major distributors against the DSM Administrator's tracking system, confirming consistency in the data.
for their recently-installed HP T8 lighting systems. Based on these responses, we estimated a free-ridership value of 16%. In 2009, NMR estimated that the SLC program had resulted in no spillover. NMR Evaluation of 2010 Prescriptive Rebate...
AI summary The document discusses the evaluation of the 2010 SLC program, estimating a free-ridership value of 16% and net energy and demand savings. It also outlines the process evaluation methodology for the 2010 BER program, including interviews and surveys conducted.
2 NMR Evaluation of 2010 Prescriptive Rebate Programs Page 38 Nearly all of the respondents (ten out of eleven) reported that they had experienced no barriers to participating in the BER program. The one respondent who had reported facing...
AI summary Nearly all respondents (10 out of 11) reported no barriers to participating in the BER program, with one respondent citing delays in eligibility determination. The section also discusses free-ridership and spillover effects, examining participants' energy efficiency intentions and actions before and after program participation.
n influenced to take additional actions including installing HVAC upgrades, energy efficient lighting, and occupancy sensors.12 Table 5-13: Influence of Program on Additional Energy Efficiency Actions Program Influenced Additional Actions...
AI summary The 2010 Prescriptive Rebate Programs influenced some participants to take additional energy efficiency actions, such as installing HVAC upgrades, energy-efficient lighting, and occupancy sensors. However, these actions were not completed by 2010 and were included in the process evaluation but excluded from the impact evaluation.
A Interview Guides Participant Survey 2009-10 NSPI Business Energy Rebate Program DRAFT 8-6-10 Could I speak with [INSERT NAME]? 1. Yes [GO TO INTRODUCTION] 2. No [SAY ―Perhaps you can help me anyway.‖ GO TO INTRODUCTION] [INTRODUCTION] He...
AI summary This document outlines an interview guide for evaluating the 2009-10 NSPI Business Energy Rebate Program. It includes a participant survey to gather feedback on the program's effectiveness, targeting individuals or firms that participated in the rebate initiative.
cility open? [998 = Don’t know, 999 = Refused] NMR Evaluation of 2010 Business Energy Rebate Program Page A14 F5. Is your company independent, or part of a larger company? 1. Independent 2. Part of a larger company 98. (Don‘t know) 99. (Re...
AI summary This document is part of an evaluation of the 2010 Business Energy Rebate Program, focusing on free-ridership and spillover effects. It includes a participant interview guide used by NMR Group, Inc. to gather information from respondents regarding their interactions with Nova Scotia Power's energy efficiency programs and any additional upgrades they have implemented.
cipate in the NSPI rebate programs? [Probe: Save energy, rebates offered, reduce maintenance costs, protect environment, recommended by utility, concerns with carbon, etc.] 12. Were there any challenges or barriers that you faced in making...
AI summary The document includes questions about participation in NSPI rebate programs, challenges faced, barriers to participation, and satisfaction with program implementation and communication. It also asks about gaps in energy efficiency programs and overall satisfaction with various NSPI programs.
Introduction: [This interview should take about an hour] Your comments are confidential. By the way, if I ask you about areas you don‘t know about, please feel free to tell me and we will move on. For transcription purposes we will be reco...
AI summary The text outlines a series of questions for an interview regarding the status and implementation of a program, including legislative status, program launch delays, energy savings goals, and stakeholder interactions. It focuses on program evaluation, coordination, and challenges in communication and collaboration.
b. To what do you trace the difficulties you encountered? How might they be addressed in future programs? 10. Do you have a plan in place for transitioning the program over to the new administrator? If yes: what does that plan involve? Do...
AI summary The text outlines a series of questions related to program challenges, transition planning, and the theoretical underpinnings of a program. It explores the program's goals, components, activities, and expected outcomes, as well as the assumptions behind its success indicators.
there any key indicators or metrics to gauge program effectiveness and success in short-, intermediate-, and long-term? 18. What are the assumptions behind the expectations that the program activities will yield the outputs and outcomes, w...
AI summary The text outlines key questions related to program effectiveness, assumptions behind program outcomes, and barriers to participation. It emphasizes the importance of resource availability, customer motivation, and program design in achieving program goals.
primary motivations for participating in the program? What are the major barriers to their participation in the program? 20. What has changed about the program since the beginning, and why? Marketing and Verification: 21. Please explain th...
AI summary The text outlines a set of questions related to energy efficiency programs, focusing on participant motivations, barriers, program changes, marketing strategies, program success, delivery improvements, free-ridership safeguards, and coverage gaps. It also mentions an evaluation of a specific program, the Commercial and Industrial Custom Program 2010, from February 25, 2011.
about the program? Thank You NMR Impact and Process Evaluation: Commercial and Industrial Custom Program 2010 February 25, 2011 Final Report Submitted to: Efficiency Nova Scotia Corporation Submitted by: NMR Group, Inc. Principal Investiga...
AI summary This document is the final report of an impact and process evaluation of the 2010 Commercial and Industrial Custom Program conducted by NMR Group, Inc. and submitted to Efficiency Nova Scotia Corporation. The report was prepared by a team of principal investigators.
......... 1 NMR Evaluation of 2010 C&I Custom Program Page I Executive Summary This report presents the results of the process and impact evaluations of the Commercial and Industrial Custom Program (C&I) conducted by NMR Group, Inc. (NMR)....
AI summary This report evaluates the 2010 Commercial and Industrial Custom Program (C&I) by NMR Group, Inc., finding energy savings of 19,413 MWh and demand savings of 2,405.5 kW, which fell short of targets but showed significant improvement over 2008 and 2009 combined.
avings goal of 3,410 kW. However, the 2010 savings exceed the evaluated savings for 2008 and 2009 combined (16,311 MWh and 2,403 kW), which shows significant growth for the C&I Custom program in 2010. Table 1: 2010 Program Energy and Deman...
AI summary The C&I Custom program achieved significant energy and demand savings in 2010, exceeding the combined savings of 2008 and 2009. The program is well-run with robust data tracking and free-rider screening, though staff constraints and data entry errors impacted NMR's evaluation process.
Program Design and Delivery Finding Recommendation C&I-F1. C&I-R1. The C&I Custom program incorporated checks to ensure that The DSM Administrator should continue to include free- participants would not proceed with project implementation...
AI summary The C&I Custom program had low but increasing free-ridership levels, which may become a concern if they continue to rise. The program also faced challenges with a compressed timeframe for evaluation and M&V activities, affecting the timely incorporation of results into the tracking system.
cient time to complete their M&V results into their tracking system. This was also the case in the activities and enter the results into the tracking system. After 2009 evaluation. that, a more rigorous impact evaluation effort can be unde...
AI summary The 2010 C&I Custom Program evaluation faced bottlenecks due to time required for report generation and data entry errors. The Program Administrator is advised to improve data entry protocols and conduct more rigorous impact evaluations.
rmance in: o Building envelopes; o Lighting; o HVAC; o Power systems; o Controls; o Design guidance; o Verification. This document reports the results of the evaluation of the C&I Custom program. Although the C&I New Construction program l...
AI summary This document evaluates the performance of the C&I Custom program in areas such as building envelopes, lighting, HVAC, and power systems. The C&I New Construction program launched in 2010 but had no completed projects that year, so the evaluation focused on two projects enrolled in the C&I Custom program prior to the launch.
Other3 10 3,469 409 Total 102 22,758 2,805 2.2 Sample Methodology At the time of sampling for this study, the program year was only 80% complete. At that point in time, the C&I Custom program manager provided a best-estimate population of...
AI summary The 2010 C&I Custom Program's evaluation used a sample methodology based on an 80% complete program year. The C&I Custom program manager estimated 93 sites would be completed, with 29,488 MWh of energy savings and 3,691 kW of demand savings. The NMR team applied Model-Based Statistical Sampling (MBSS) to stratify the population based on estimated annual kWh savings.
improvements, and solar. NMR Evaluation of 2010 C&I Custom Program Page 3 larger impacts, MBSS provides an excellent framework for conducting the analysis and the subsequent stratified ratio estimation analyses. Targeting a ±10% relative p...
AI summary The document evaluates the 2010 C&I Custom Program, discussing the use of MBSS for stratified ratio estimation analyses and the sampling methodology employed, including the removal of one site due to being credited to the 2009 program year.
le was designed and drawn from a projected status of sites at year end. Overall, the final sample design remained fairly optimal in capturing greater savings at the larger sites than the smaller ones. Table 2-2: Final Sample Design Max Sav...
AI summary The text discusses the final sample design for evaluating the 2010 C&I Custom Program, highlighting how the sample was optimized to capture greater savings at larger sites. Table 2-2 shows strata based on maximum savings, and Table 2-3 indicates the diversity of measure types in the sample, with lighting measures being the most common.
0% FR4e. NSPI funded feasibility study Don‘t know 25% Program Influence Score = maximum of FR4a, FR4b, FR4c, FR4d and FR4e. NMR Evaluation of 2010 C&I Custom Program Page 10 Table 2-8: Free-ridership Screening and Cross-check Questions Fre...
AI summary The text discusses the evaluation of the 2010 C&I Custom Program, including a table on free-ridership screening and cross-check questions. It includes responses to questions about whether the organization had plans to pursue specific measures prior to the program and whether the company could have accommodated the full cost of the project without the incentive.
es FR3. Power, could your budget have accommodated the full cost of the No N/A project including the incentive? Don‘t know Based on their responses to these questions NMR divided respondents into three distinct groups: Full free-riders –...
AI summary The document evaluates the 2010 C&I Custom Program by classifying respondents into free-riders based on their pre-existing plans, budget capacity, and installation intentions. None of the 13 respondents were classified as full free-riders.
(0%) FR2b = No (50%) FR2c = Yes; FR2ci = Somewhat (25%) FR2d = Yes (50%) 2.6.3.2 Program Influence In order to determine the influence of the program on respondents, they were asked to rate the influence of five program elements on t...
AI summary Respondents were asked to rate the influence of program elements on their decision to install energy efficient lighting, with ratings ranging from 1 to 5. A cross-check was performed to assess the impact of budget on project accommodation, adjusting free-rider stated intent scores based on whether the budget could accommodate the project without the program.
t-to-gross ratio 90% 90% Net savings 19,413 2,405.5 7 Note that these include the savings goals for the C&I Custom and New Construction programs combined. NMR Evaluation of 2010 C&I Custom Program Page 15 3 Process Evaluation 3.1 Methodolo...
AI summary The process evaluation of the 2010 C&I Custom Program involved in-depth interviews with program staff and a participant, as well as telephone surveys of 13 participants. Topics included program awareness, communication, and free-ridership. The evaluation aimed to assess the program's effectiveness and identify barriers and motivations.
additional work remains to be done to fine-tune the system. NMR understands that implementing a centralized data tracking system takes time and that DSM Administrator staff will fine-tune the system over time. The 2010 evaluation shows the...
AI summary The 2010 evaluation of the C&I Custom Program highlights the need for improved data tracking and more rigorous data entry protocols. Outreach efforts included public speaking, emails, the NSPI website, and the addition of a Sales Lead position. Program awareness was primarily through NSPI and contractors.
Table 3-5: Participant Barriers 2008 Participants (n=11) 2009 Participants (n=13) 2010 Participants (n=13) Most Second Most Most Second Most Most Second Most Barriers Faced During Program Important Important Important Important Important I...
AI summary The table presents participant barriers to program participation across three years (2008, 2009, 2010). It highlights that the majority of participants did not face barriers, but issues such as communication, remote location, and voltage change were noted as challenges.
building envelope measures responded to the 2010 survey. (Table 3-6) 10 Note that the program makes no distinction between non-profit and for profit companies. NMR Evaluation of 2010 C&I Custom Program Page 22
AI summary The 2010 C&I Custom Program's building envelope measures were evaluated, with responses noted in Table 3-6. The program does not differentiate between non-profit and for-profit companies.
Table 3-8: Participant Satisfaction with Program 2008 2009 2010 Program Aspect n % Satisfied n % Satisfied n % Satisfied Program overall 11 91% 13 100% 13 77% Interaction and communication with 11 82% 12 100% 13 47% program staff Availabil...
AI summary The table presents participant satisfaction levels with various aspects of a program from 2008 to 2010. Satisfaction rates vary across different program aspects, with some areas showing high satisfaction and others showing a decline over time.
90% 12 66% Project rebate amount 10 90% 10 100% 13 77% Verification 7 86% 9 78% 12 75% Those giving a rating of 5 or 4 on a scale where Rating: 5= ‗very satisfied‘ and 1 = ‗not at all satisfied‘ 11 The detailed responses are provided in Ap...
AI summary The 2010 C&I Custom Program evaluation found that 85% of respondents indicated that someone outside their organizations, primarily design professionals (46%) and contractors (23%), was most responsible for specifying the measures installed through the program, similar to findings in 2008 and 2009.
39 Government 8 Non-profit 8 8 NMR Evaluation of 2010 C&I Custom Program Page A1 Appendix A Individual On-Site Reports Technical Note on Stratified Ratio Estimation The on-site engineering assessment used engineering analysis and surveys t...
AI summary This document discusses the evaluation of a 2010 C&I Custom Program, focusing on the use of stratified ratio estimation to calculate energy savings. It outlines the methodology for combining on-site engineering assessments with statistical analysis to estimate program impacts and net savings.
king analysis. The primary culprit NMR Evaluation of 2010 C&I Custom Program Page A26 was likely the use of lower wall and roofing R-values in the tracking baseline model than those proposed in the feasibility study. As documented previous...
AI summary The evaluation of the 2010 C&I Custom Program found that lower insulation R-values in the baseline model led to overestimation of heating and cooling loads, reducing insulation savings. Lighting controls savings could not be assessed due to an unknown calculation method. Evaluated peak demand savings were only 13% of projections, as buildings were unoccupied during peak hours.
that the controller was in override or that the fans would not shut off in the future. The evaluator was not able to compare box temperatures with fan control set points to further verify fan control. 7.0 Conclusions Annual energy savings...
AI summary The evaluation of the 2010 C&I Custom Program found that annual energy savings were 100% of the tracking savings, with no variances in equipment types or operational parameters. Controls were functional, but calculations relied on fixed default values without verification of equipment operation.
120-volt MR16 19 20 PAR20 3 50 LED Retro Kit 1 1 Incandescent Exit 1 30 The fixture quantities listing in Table 2 reflect changes to the counts made during the evaluation. Note that line items do not match along rows in Table 2. Fixtures i...
AI summary The document discusses fixture quantities and their organization in Table 2, noting changes in counts during the evaluation. It also mentions the installation of additional lighting measures after program participation, which may be considered spillover but are not credited to the program under gross savings work.
areas. Since the Metrix analysis was not available for review at the time of the evaluation, savings were calculated relative to the feasibility study savings values available in the tracking system. 5.0 On-Site Methodology The on-site met...
AI summary The evaluation of the 2010 C&I Custom Program involved verifying the installation of retrofit fixtures and reviewing lighting operating schedules. Of 655 retrofit fixtures, 582 were verified, accounting for a significant portion of the connected load reduction and energy savings. Adjustments to lighting schedules were made based on discussions with the hotel’s maintenance manager.
od. Equation 3 was applied to all retrofitted areas of the building served by HVAC systems (100% in this case). Savings from all areas were summed to arrive at interactive effects peak demand savings. 7.0 Conclusions Annual energy savings...
AI summary The evaluation of the 2010 C&I Custom Program found that annual energy savings were 82.9% of the tracking savings, with reductions partly due to removing double-counted savings and adjusting operating hours. Peak demand savings exceeded tracking projections by 1.9% due to higher coincidence factors used in the evaluation.
NMR Evaluation of 2010 C&I Custom Program Page C1 Appendix C Interview Guides PARTICIPANT QUESTIONNAIRE: C&I Custom Program Final: July 22, 2010 Hello, my name is from NMR Group. I am calling on behalf of Nova Scotia Power, as part of an e...
AI summary This document is a participant questionnaire for Nova Scotia Power's Commercial and Industrial Custom Program, used to evaluate and improve the program through feedback from participants. It includes questions about program participation and knowledge of the program.
contractor) 11. (Past participation in utility programs) 12. (Other (Please explain )) 99. (Don‘t know/Don‘t recall) 10. What was the second most important reason your company / organization chose to participate in the program? (Do not rea...
AI summary The text outlines survey questions related to participation in utility programs, including reasons for participation and verification of actions taken through the program. It also includes questions about feasibility studies and implementation of energy efficiency measures.
(To take advantage of program incentives) NMR Evaluation of 2010 C&I Custom Program Page C5 2. (To see what else I should be doing as part of a planned project) 3. (To save on energy costs/bills) 4. (To reduce maintenance costs) 5. (To imp...
AI summary The text outlines participant motivations for energy efficiency measures, including cost savings, environmental benefits, and recommendations from utility representatives. It also includes instructions for evaluating multiple measures and addressing free-ridership in a program evaluation context.
rganization had not participated in the NMR Evaluation of 2010 C&I Custom Program Page C6 Commercial and Industrial Custom Program, which of the following actions do you think you would have taken? Please select all that apply. Would you h...
AI summary The document evaluates the 2010 Commercial and Industrial Custom Program, asking participants about their behavior if the program had not existed, including potential delays in installation, budget impacts, and the program's influence on their participation decision.
Theory and Logic Model Review: 9. Is the program theory and logic model included in the C&I program manual still valid? 10. Has the program been expanded to include participants other than larger commercial, industrial and municipal custom...
AI summary The document contains a series of questions about the Commercial & Industrial (C&I) program, focusing on its theory, logic model, outreach activities, program goals, and market impact. It explores whether the program is primarily a Resource Acquisition or Market Transformation initiative, and seeks clarification on short-term and intermediate goals.
or outcomes that are not included in the C&I logic model?] d. How do you think this program will affect the overall market in the intermediate term? What is the mechanism by which this impact on the market will be achieved? NMR Evaluation...
AI summary The text asks about the long-term goals of the C&I Custom Program, its impact on the market, and how program success will be measured. It also probes whether the logic model includes all relevant goals and outcomes.
ve? Short-term? Intermediate? Long-term? a. Are there any key indicators or metrics to gauge program effectiveness and success in short-, intermediate-, and long-term? Marketing, Participating Retailers, and Verification: 17. Please explai...
AI summary The document outlines questions related to the evaluation of the 2010 C&I Custom Program, focusing on program effectiveness, marketing strategies, trade ally involvement, and program delivery. It includes recommendations for improving marketing and delivery, such as training energy efficiency contractors.
rogram delivery be improved? NMR Evaluation of 2010 C&I Custom Program Page C20
AI summary The document discusses the evaluation of the 2010 C&I Custom Program, focusing on improvements in program delivery. It highlights the need for better implementation and effectiveness of the program.
21. For the C&I program, how has the involvement of contractors changed since last year? [Probe: Have contractors taken a more active role in program marketing?] [Probe: in the program logic model NSPI has identified that trade allies and...
AI summary The text outlines a series of questions posed to NSPI regarding the Commercial and Industrial (C&I) program, including contractor involvement, barriers to participation, program impacts, customer targeting, program interactions, coverage gaps, and program strengths and weaknesses.
what would you say are the programs greatest weaknesses? What could be done to address these weaknesses? 29. Based on your experience with the program so far, what are the most important improvements that still need to be made to the progr...
AI summary The text includes a set of questions for an interview with a participant in Nova Scotia Power's Commercial and Industrial Custom and Business Energy Rebate programs, focusing on program weaknesses, improvements, and other issues. It also includes an interview guide and a request for permission to record the interview.
cipate in the NSPI rebate programs? [Probe: Save energy, rebates offered, reduce maintenance costs, protect environment, recommended by utility, concerns with carbon, etc.] 12. Were there any challenges or barriers that you faced in making...
AI summary The text outlines a series of questions aimed at understanding participants' experiences with NSPI rebate programs, including barriers to participation, challenges in implementation, satisfaction levels, and gaps in program coverage. It focuses on feedback from customers regarding the effectiveness and accessibility of these programs.
50-2 Howard Street, Somerville, MA 02144 Phone: (617) 284-6230 Fax: (617) 284-6239 www.nmrgroupinc.com Contents EXECUTIVE SUMMARY ................................................................................................................
AI summary The document outlines a program description and impact evaluation, including program theory, logic models, and evaluation methodology. It discusses the 2010 SBLS savings and research design, indicating a focus on assessing program effectiveness and outcomes.
ation was based on in-depth interviews with the DSM Administrator‘s staff, Delivery Agents, the Materials Vendor and the Recycling Contractor as well as a telephone survey of 65 program participants. Impact Evaluation Findings The impact e...
AI summary The impact evaluation of the 2010 SBLS program found that the program achieved 11,210 MWh of energy savings and 1,529.5 kW of demand savings, falling short of the energy and demand savings goals. The evaluation used interviews, surveys, and program records to estimate free-ridership and spillover effects.
nerator 1,758.5 12,944 Net-to-Gross Ratio (%) 87.0% 86.6% Net annual savings at generator 1,529.9 11,210 Key Findings The net energy impacts of the SBLS program have increased steadily since 2008. They have more than tripled from 1,522 MWh...
AI summary The SBLS program's net energy impacts have increased significantly since 2008, with customer satisfaction remaining high. NMR recommended monitoring Delivery Agents and Contractors to maintain quality and satisfaction. In 2010, customer satisfaction remained strong despite program expansion.
uirements. SBLS-F5. SBLS-R5. Some respondents cited barriers to implementing additional energy At the time of participant contact, the DSM Administrator efficiency measures (beyond those covered by the program) including should continue to...
AI summary Respondents identified barriers to implementing additional energy efficiency measures, including lack of financing and information. The SBLS program was found to be a crucial source of assistance for small businesses, with low free-ridership indicating its effectiveness in encouraging energy efficiency improvements.
NMR Evaluation of 2010 Small Business Lighting Solutions Program Page IV Findings and Recommendations Finding Recommendation SBLS-F7. SBLS-R7. While nearly all of the 2010 respondents (63 out of 65) said they would Despite the importance o...
AI summary The evaluation of the 2010 Small Business Lighting Solutions Program found that while most respondents were likely to purchase energy-efficient equipment in the future, few took additional energy efficiency actions after participating in the program. The report recommends expanding program offerings to help small businesses identify and pursue other energy efficiency measures.
2.1 Research Design Consistent with the free ridership summit recommendation, The NMR Team performed a billing analysis to determine the impacts of the SBLS Program. This evaluation methodology encountered two critical issues that resulted...
AI summary The evaluation of the SBLS Program faced challenges due to incomplete billing data and the inability to form a representative control group. As a result, the performance of the 2010 program was based on site work from 2008, and the 2011 evaluation is recommended to use time-of-use metering for better accuracy.
8, and Table 2-9) NMR Evaluation of 2010 Small Business Lighting Solutions Program Page 11
AI summary The document evaluates the 2010 Small Business Lighting Solutions Program, focusing on its implementation and outcomes. It includes data and analysis from Table 2-9 and is associated with Nova Scotia Power.
5 0% Don‘t know 25% Program Influence Score = maximum of FR4a, FR4b, or FR4c. NMR Evaluation of 2010 Small Business Lighting Solutions Program Page 12 Table 2-9: CFL Free-ridership Screening and Cross-check Questions Free- Question Questio...
AI summary The document evaluates the 2010 Small Business Lighting Solutions Program, focusing on free-ridership screening through a series of questions. It assesses whether businesses would have pursued lighting improvements without the program's incentives and considers the financial impact of the program on participants.
el impacts were estimated to be 11,210 MWh of energy savings and 1,529.5kW of demand savings. These savings fell short of the energy savings goal of 13,980 MWh and the demand savings goal of 3,300 kW. Table 2-11: Program Energy Savings Est...
AI summary The 2010 Small Business Lighting Solutions Program achieved energy savings of 11,210 MWh and demand savings of 1,529.5 kW, falling short of the energy savings goal of 13,980 MWh and the demand savings goal of 3,300 kW. A process evaluation was conducted using interviews and surveys.
Agent and Recycling Contractor. NMR Evaluation of 2010 Small Business Lighting Solutions Program Page 17 Table 3-1: Final Sample Population Sample Region N = 418 n= 65 Cape Breton 8% 8% Central 28% 32% Dartmouth 30% 25% Halifax 8% 6% South...
AI summary The document evaluates the 2010 Small Business Lighting Solutions (SBLS) program through a participant survey, focusing on spillover effects, free-ridership, participant motivations, and energy attitudes. It also discusses sampling error in the telephone surveys conducted as part of the evaluation.
Table 3-7: Influence of Program on Additional Energy Efficiency Actions Program Influenced Additional Actions 2008 2009 2010 Sample size 50 50 65 No 62% 76% 66% Yes 34 22 29 Don‘t Know 2 2 5 Type of Action Taken 2008 2009 2010 Sample size...
AI summary The table shows the influence of energy efficiency programs on additional energy efficiency actions taken by participants from 2008 to 2010. The data indicates that a majority of participants did not take additional actions, while a smaller percentage did, with various types of actions being taken.
Evaluation of 2010 Small Business Lighting Solutions Program Page B1 Appendix A Interview Guides Draft participant QUESTIONNAIRE: NSPI SBLS PROGRAM Final: July 22, 2010 Hello, I am with NMR Group, and we are performing an evaluation of ene...
AI summary This document is a draft participant questionnaire for evaluating Nova Scotia Power's Small Business Lighting Solutions (SBLS) program. It aims to gather feedback from participants about their experience with the program, previous participation in energy efficiency initiatives, and their reasons for involvement.
ding – have to work through owner) NMR Evaluation of 2010 Small Business Lighting Solutions Program Page B9 l. (Other (Specify: _)) 99. (Don‘t know/Don‘t recall) 38. On a scale of 1 to 5, where 1=‗not at all important‘ and 5=‗very importan...
AI summary The text includes survey questions related to the importance of energy usage reduction and cost management for small businesses, as well as feedback on improving the Small Business Lighting Solutions Program. It focuses on customer perspectives and program evaluation.
9. Don‘t know/Don‘t recall NMR Evaluation of 2010 Small Business Lighting Solutions Program Page B16 Materials Vendor Interview Guide: NSPI SBLS Program Interviewer: Date of Interview: Time Begun: Time Ended: Respondent Name: Respondent Ti...
AI summary The document outlines an interview guide used by Nexus Market Research (NMR) to evaluate the Small Business Lighting Solutions (SBLS) Program provided by Nova Scotia Power. The guide includes questions to assess the vendor’s role, experience, and satisfaction with the program.
f 17. Incentive level provided NMR Evaluation of 2010 Small Business Lighting Solutions Program Page B18 18. Program paperwork 19. Program delivery process and procedures 20. Availability of information about the program 21. The program ov...
AI summary The text discusses the evaluation of the 2010 Small Business Lighting Solutions (SBLS) program, focusing on data tracking, contractor perceptions, and firmographics. It includes questions on how data is tracked, contractor motivations and barriers, and suggestions for program improvement.