E-3ENSC 2011 DSM Evaluation Report prepared by Econoler
101 passages
In-Depth Interviews Completed in 2011 Program Delivery Program Managers Agents Contractors Distributors Builders Retailers Participants ARet 1 1 2 ARep 1 1 RMP 1 1 5 LIR 1 1 1 MURR 1 1 EP-DI 1 1 EEH 1 2 2 Fuel Substitution 1 Low Income 1 3...
AI summary The text presents a table summarizing the number of program managers, agents, contractors, and other stakeholders involved in various energy efficiency and demand-side management programs in Nova Scotia as of 2011. It highlights the distribution of roles across initiatives like Low Income, Performance Plus, and SBES.
for each of the programs. Note that the numbering of the recommendations corresponds to the numbering presented in the individual reports. 4.1 RESIDENTIAL 4.1.1 Appliance Retirement Program The 2011 evaluation of the ARet program demonstra...
AI summary The 2011 evaluation of the Appliance Retirement (ARet) program showed high participation and significant energy savings. However, participants and the DA suggested improvements in marketing and outreach, citing challenges with the third-party marketing agency's lack of expertise and understanding of program goals.
ERGY STAR criterion and to identify the energy consumption of the appliance would ensure that savings are calculated correctly. 4.1.3 Retail Markdown Program The 2011 evaluation of the RMP demonstrated that the program used the right appro...
AI summary The 2011 evaluation of the Retail Markdown Program (RMP) showed increased participation and significant energy and demand savings. However, awareness of the program and its promotions decreased, with issues like disorganized displays and inadequate marketing materials identified as barriers to effectiveness.
tia Corporation ECONOL:R Overall Executive Summary 4.2 COMMERCIAL & INDUSTRIAL 4.2.1 Business Energy Rebates Program The 2011 evaluation of the BER program demonstrated that the program is well designed and has a good potential for success...
AI summary The Business Energy Rebates (BER) program saw significant growth in 2011, with 106 participants and substantial energy and demand savings. Evaluation highlighted the program's success but noted areas for improvement, including communication and marketing. The ENSC website was effective, but further engagement with participants is recommended to enhance program effectiveness.
they could raise the overall impact of the program with future increases in the number of program participants. 4.2.4 Small Business Energy Solutions Program The 2011 evaluation of the SBES program demonstrated that the program is well des...
AI summary The Small Business Energy Solutions Program (SBES) has shown positive results with increasing participation and energy savings. The 2011 evaluation noted 1,468 participants and energy savings of 23.180 GWh. Recommendations focus on improving communication and marketing to increase awareness and participation.
s found in the ARet program manual. Table 4: Program Manual Content Program Manual Content ARet Program Manual Document revisions Program description (including nature or type of program) Program justification Program objectives Incentives...
AI summary The document outlines the content of the ARet Program Manual, which includes sections on program description, incentives, eligibility criteria, cost-effectiveness tests, marketing and evaluation plans, and program theory. It also references a 2011 evaluation report by Efficiency Nova Scotia Corporation.
ram asset by Econoler. The online booking may contribute to the positive evaluation of survey respondents as to the ease of participation in the program (see Section 3.7.1 for additional information). As part of the evaluation, Econoler no...
AI summary The evaluation of the ARET program highlights high satisfaction among program partners with ENSC’s team and overall program. While the delivery agent found the participation process simple, the transport contractor noted some complexity due to logistics. Complaints included missed pick-ups and lost cheques. The program name change was viewed differently by partners, with some preferring the old name for its user-friendliness.
This result indicates that the participation process flow chart developed by ENSC in late 2011 was a good initiative as it will potentially simplify the participation of future program participants. Table 30: Diagram Illustrating Steps of...
AI summary The 2011 evaluation report for the Appliance Retirement Program (ARet) by Efficiency Nova Scotia Corporation (ENSC) assesses the program's impact on energy and demand savings. The report includes a flowchart developed in 2011 to improve future participant engagement and evaluates factors such as adjusted unitary savings, energy-to-demand ratio, and free-ridership.
evaluation? And if not why? Q: was there an evaluation plan when this program was first designed? Q: Is there a written marketing and outreach strategy for that program with performance indicators? Q: How would you rate the facility or dif...
AI summary The document includes a series of evaluation questions for the Appliance Retirement Program operated by Efficiency Nova Scotia Corporation (ENSC), as well as an interview guide for program partners. The questions focus on program evaluation, marketing strategy, and ease of use of a centralized database.
2011 Evaluation Report Q4 – How would you qualify your participation process in this program? Simple or easy Complex Q4a - If you checked the Complex box, please elaborate. No comment / no opinion Q5- On a scale from 1 to 10 (where 1 is ve...
AI summary The text contains a series of survey questions from a 2011 evaluation report on the Appliance Retirement Program by Efficiency Nova Scotia Corporation. The questions aim to assess participant satisfaction, program complexity, and suggestions for improvement, including views on marketing, outreach, and third-party involvement.
m name (new territory, additional equipment, etc.)? Easy to adjust to the way you work Requires minor changes to the way you work Requires major changes to the way you work No opinion Ref.: 5725 76 Efficient Products – Appliance Retirement...
AI summary This document contains a survey questionnaire from the 2011 Evaluation Report of the Appliance Retirement Program by Efficiency Nova Scotia Corporation. It includes questions about program implementation barriers, complaints from partners, and participant feedback.
obtained from the following four sources: > ENSC website; > 2010 evaluation report; > program manual; > tracking sheet. 2.2.2 In-Depth Interview with Program Manager Econoler staff conducted one interview in September with the Program Mana...
AI summary The document outlines the data sources and interview processes used in evaluating the Appliance Replacement Program by Efficiency Nova Scotia Corporation. It includes interviews with the Program Manager and a Retailer Partner, as well as on-site visits, to gather information on program justification, savings calculations, barriers, marketing strategies, and participation processes.
mportant to the PM are covered. The two most important components of the plan are the evaluation methodology as well as the pre- and post-data required to apply the selected methodology. > Focus on a resource acquisition objective: Having...
AI summary The evaluation of the Appliance Replacement Program emphasizes the importance of the evaluation methodology and data collection. The program is focused on resource acquisition rather than market transformation due to its rebate structure and limited advertising. There were challenges with the transition from Nova Scotia Power to Efficiency Nova Scotia Corporation, causing confusion and delays.
as the analysis of the program documentation. At that stage, key program information was reviewed. The information used to conduct this analysis was obtained primarily from the following four sources: > ENSC website; > 2010 evaluation repo...
AI summary The evaluation of the Retail Markdown Program involved reviewing program documentation, conducting interviews with the Program Manager, and engaging with the delivery agent and retailers. Key areas discussed included program justification, savings calculations, barriers, marketing strategies, and stakeholder involvement.
er things, to understand the delivery agent’s involvement in the program, their participation process in the program and their perception and satisfaction with the program. Interviews with Retailers In November, six in-depth interviews wer...
AI summary The document discusses interviews with retailers and on-site visits to evaluate the Retail Markdown Program (RMP) and its impact on product promotion and customer experience. It includes assessments of free-ridership, spillover effects, and retailer satisfaction with the program.
nducted a literature review to find studies that had analyzed the savings resulting from their installation. For CFLs, the participant survey was used to establish the replacement ratio of CFL to CFL. The participant survey as well as reta...
AI summary The document discusses the methodology used to estimate energy savings from the RMP, including the use of a participant survey and retailer interviews to determine free ridership and market spillover effects. Unitary savings values for products like CFLs are based on the OPA's 2010 Prescriptive Measures and Assumptions report.
address: [email protected]. Thank you! Part I: General Questions Please indicate your company name: Q1 - How would you define your role(s) as an ENSC energy efficiency program partner? Q1a – How long have you had that role (specify mon...
AI summary The document includes general questions directed at ENSC energy efficiency program partners, focusing on their role, the transition from Conserve Nova Scotia to ENSC, their relationship with the Program Administrator, and any complaints received from program participants.
pies of the interview guides and the survey questionnaire are included in Appendices IV, V and VI. Figure 2: Methodological Model 2.2 METHODOLOGY DESCRIPTION 2.2.1 Analyzing Existing Program Information The first task in the process evalua...
AI summary The evaluation of the Low Income Renter (LIR) program involved analyzing program documentation, conducting interviews with the Program Manager, and planning interviews with program partners. The evaluation focused on program justification, savings calculations, barriers, marketing strategies, and the roles of partners.
list of questions and topics to include in the program partner interviews for the process evaluation was finalized. 2.2.3 In-Depth Interviews with Program Partners Interview with Delivery Agent In September, one in-depth interview was cond...
AI summary The document outlines the methodology used in evaluating the Efficient Products – Low Income Renter Program, including in-depth interviews with the program delivery agent and its subcontractor, as well as on-site visits to validate product installations and savings assumptions.
Efficiency Nova Scotia Corporation 2011 Evaluation Report The methodology used for the on-site visits under the LIR program is further explained in the program impact evaluation section of this report. A copy of the site visit protocol is...
AI summary This section of the 2011 Evaluation Report discusses the methodology used for on-site visits and telephone surveys conducted under the Low Income Renter (LIR) program. A survey of 70 participants was conducted to assess program impact, satisfaction, and recommendations for improvement.
ually included in program manuals intended for internal use. The table below lists the information found in the LIR program manual. Table 4: Program Manual Content LIR Program Program Manual Content Manual Document revisions N/A Program de...
AI summary This document outlines the content of the LIR Program manual, including program description, objectives, eligibility criteria, program partners, savings calculations, budget, cost-effectiveness tests, market studies, marketing plans, and evaluation plans. It is part of an evaluation report from 2011 by Efficiency Nova Scotia Corporation.
11 Too soon to tell 7 Don’t know 14 Participants were asked a series of questions to assess improvements that had occurred since participating in the program. Using a 5-point scale, where 1 meant no improvement experienced and 5 meant cons...
AI summary A survey of participants in the LIR program found that a small majority reported improvements in energy efficiency interest, knowledge, and home comfort since joining the program. Specific impacts included improved indoor lighting, longer-lasting hot water, and fewer drafts, with most participants reporting noticeable benefits.
Efficiency Nova Scotia Corporation 2011 Evaluation Report C: It would be useful to know what kind of arrangement there is between the building administration and the low-income renter (for each building) in regards to the method of sharing...
AI summary The text discusses questions and comments related to the evaluation of a program by Efficiency Nova Scotia Corporation, focusing on cost-sharing arrangements between building administrations and low-income renters, process evaluation, program theory, and barriers addressed by the program. It also asks about evaluation plans, marketing strategies, and data management challenges.
ifficult 10 is very easy) Q: Any other subject the PM wishes to include in the process examination of the program partners and or participants. Thank you very much for your time and cooperation. Ref.: 5725 50 Efficient Products – Low Incom...
AI summary This document is an evaluation report and questionnaire for Efficiency Nova Scotia Corporation's Low-Income Renter Program, focusing on gathering feedback from program partners and participants. It includes instructions for completing the form and questions about the partner's role and experience with the program.
On a scale from 1 to 10 (where 1 is very bad and 10 is excellent), how would you rate your relationship with the other program partners or subcontractors (Clean Nova Scotia) in this program? Score: Q9a - If your answer to Q9 was equal to o...
AI summary The document contains survey questions related to the Efficient Products – Low Income Renter Program delivered by Efficiency Nova Scotia Corporation. It asks about program partner relationships, lead sources, market confusion, barriers to implementation, program name changes, and complaints received.
onnaire are included in Appendices IV, V and VI. Figure 2: Methodological Model 2.2 METHODOLOGY DESCRIPTION 2.2.1 Analyzing Existing Program Information The first task in the process evaluation of the MURR program was the analysis of the p...
AI summary The evaluation of the MURR program involved analyzing program documentation, conducting interviews with the Program Manager and Delivery Agent, and examining topics such as program justification, savings calculations, barriers, marketing strategies, and partner roles.
bles such as operating time, wattage or base consumption. The identification and value of each of these variables should be available and documented for validation and updating purposes. > Provide the parameters used to estimate program ob...
AI summary The text discusses the importance of documenting program variables and parameters for validation and updating, as well as the need to refine and disseminate marketing plans for program tracking. It references the Efficient Products – Multi-Unit Residential Renter Program and its 2011 Evaluation Report.
ons Please indicate your company name: Q1 - How would you define your role(s) as an ENSC energy efficiency program partner? Q1a – How long have you had that role (specify months or years)? Q1b - If you were a program partner before it chan...
AI summary The text contains a series of questions directed at ENSC energy efficiency program partners regarding their roles, the transition from Conserve Nova Scotia to ENSC, their relationship with the Program Administrator, and any complaints received from program participants.
riers Total savings objectives (with details of gross savings and hypothesis for free-ridership and other effects) Details about the savings calculations and type of products Ref.: 5725 8 Efficient Products – Direct Install Program Efficie...
AI summary The document discusses the Efficient Products – Direct Install (EP-DI) Program, highlighting the content of its program manual, including budget, cost-effectiveness, marketing plans, and evaluation strategies. Econoler's analysis notes that the manual provides useful information for program monitoring, though it lacks specific indicators for measuring marketing success.
eover, mid-course modifications require major changes to the way the DA operates and there have been complaints from the sub-contractor related to resource constraints due to additional scope changes. Satisfaction with the relationship bet...
AI summary The document discusses mid-course modifications to a program, highlighting complaints from sub-contractors about resource constraints due to scope changes. It also notes high satisfaction with the relationship between ENSC and sub-contractors, but emphasizes the need for better-defined program scope and improved advertising to enhance promotion.
This result indicates that the participation process flow chart developed by ENSC in late 2011 was a good initiative as it will potentially simplify the participation of future program participants. Table 17: Provision of a Diagram Illustr...
AI summary The document highlights the development of a participation process flow chart by ENSC in 2011, which was seen as a beneficial initiative for future program participants. It also outlines the objective of an impact evaluation conducted in 2011 to assess the program's energy and demand savings, including parameters such as savings calculation methodology, installation rates, and free-ridership.
usion between representative and delivery agent. Page 7 C: Make sure that replaced lamps where functional before replacing them (they were not burned) to get an accurate calculation of the savings. C: Interactive effects will have to be ca...
AI summary The text discusses the Efficient Products – Direct Install Program by Efficiency Nova Scotia Corporation, focusing on program evaluation, delivery agents, quality assurance, and process documentation. It includes questions about program structure, participant forms, barriers addressed, and evaluation plans.
0 to 10) FR4_P = MAX(a; b; c) Factors a, b and c = Program factors PA2 Score: (10 - FR4_P) x 10% FR2c. In the absence of the program, what is the likelihood that you would IF FR2c > 5 : ASK FR2cc have installed exactly the same energy-effi...
AI summary The text outlines a scoring mechanism (PA2 Score) based on responses to questions about the likelihood of installing energy-efficient products without a program and the timing of such installations. The scoring depends on responses to FR2c and FR2cc, with different weightings based on the time delay.
all or some of the measures recommended in the audit, knowing that there will be incentives to cover some of these measures from different sources. 7 Depending on the nature of the Track record of payments for electricity measures paid mea...
AI summary The text discusses the implementation of energy efficiency (EE) measures and the various incentives available from different organizations. It highlights that ENSC provides incentives for electric heating measures, while the provincial government and NRCan offer incentives for envelope and pre-approved measures, respectively. The text also emphasizes the importance of monitoring double counting of savings and using participant statistics as performance indicators.
Efficiency Nova Scotia Corporation 2011 Evaluation Report The logic model We proposed a modification for the logic model to include other parties beside ENSC. We sent the modification to the PM for comments. Source: General Q: Please indic...
AI summary The document outlines a process evaluation questionnaire for Efficiency Nova Scotia Corporation's EnerGuide for Existing Houses program, focusing on program partners, evaluation plans, marketing strategies, and data management challenges. It also includes questions about program barriers and cost-effectiveness testing.
W GUIDE WITH DELIVERY AGENTS PROCESS EVALUATION QUESTIONNAIRE FOR ENSC ENERGY EFFICIENCY PROGRAM PARTNERS Program Name: EnerGuide for Existing Houses & Multi-Units How to fill this form: This is a word document that integrates some form fe...
AI summary This document is a process evaluation questionnaire for ENSC energy efficiency program partners, focusing on their role, experience with the transition from Conserve Nova Scotia to ENSC, and their relationship with the Program Administrator. It is part of an evaluation report from 2011.
re it changed status and name from Conserve Nova Scotia to ENSC, how was this transition perceived in the market? Not applicable Unnoticed Some confusion A lot of confusion Don’t know Ref.: 5725 91 EnerGuide for Existing Houses Program Eff...
AI summary The text discusses the transition of the program from Conserve Nova Scotia to ENSC and its impact on program partners, including changes in perception, relationship with the Program Administrator, and participant complaints. It also includes questions about the ease of participation in the EnerGuide for Existing Houses Program.
We would like your opinion on the number of parties involved in this program. Q9a- Other program partners like you (delivery agents and contractors). Are they? Too few Adequate Too many No opinion Q9a1- If you answered Too Few or Too Many,...
AI summary The document contains survey questions about the number of program partners, the adequacy of their involvement, and the quality of relationships among partners in the EnerGuide for Existing Houses Program. It also asks about lead sources and confusion in the market.
ed to validate the new measures implemented, collect information on the previous heating and hot water system as well as gather data on the usage of the different energy sources available at the site. The methodology used for the on-site v...
AI summary The Fuel Substitution Pilot involved on-site visits and a participant survey to evaluate the pilot's impact. The survey, conducted by CRA, aimed to understand participant experiences, motivations, and the pilot's effectiveness. Sampling error data is provided for the 2011 telephone survey.
NO, ASK TO SPEAK TO THE APPROPRIATE PERSON AND RESTART AT INTRODUCTION. IF PERSISTS AS NO, THANK, TERMINATE AND RECORD.] Program Notoriety and Participation [P series] P1. How did you learn about the Fuel Substitution Program? PROBE: Anyth...
AI summary The text outlines how respondents learned about the Fuel Substitution Program through various channels, including mail, email, websites, homeshows, and word of mouth. It also references an evaluation report from 2011 by Efficiency Nova Scotia Corporation on the Fuel Substitution Pilot.
rch conducted by Nova Scotia Power Inc. (NSPI) indicated that the “Low Income Program” name was best suited for the program, efforts will have to be put forth to eliminate all confusion in the market. Program partners identified the main b...
AI summary The Low Income Program's name is deemed appropriate, though efforts are needed to eliminate market confusion. Program partners identified participant enrolment as a main barrier, but a new delivery model implemented in 2011 aims to address this by offering direct installs and conducting initial audits. Participant satisfaction is high, and program partners are also satisfied with the program and their collaboration with ENSC. Energy savings are calculated using EnerGuide points and prescriptive measures.
s the collection tools used. Copies of the interview guide and the survey questionnaire are included in Appendices IV, V, VI and VII. Figure 2: Methodological Model 2.2 METHODOLOGY DESCRIPTION 2.2.1 Analyzing Existing Program Information T...
AI summary This section outlines the methodology used in evaluating the Low Income program. It includes analyzing existing program information, conducting an interview with the Program Manager, and performing in-depth interviews with program partners to gather insights on program implementation and effectiveness.
esults of the PM interview, the list of questions and topics to include in the program partner interviews for the process evaluation was finalized. 2.2.3 In-Depth Interviews with Program Partners In September, in-depth interviews were cond...
AI summary The document outlines the evaluation process for a low-income energy efficiency program, including interviews with program partners, on-site visits to validate compliance with EnerGuide guidelines, and a telephone survey of 70 participants conducted by CRA in Halifax.
and the Evaluator can keep track of the assumptions used to estimate the program objectives. The parameters should then be adjusted annually based on the most recent evaluation results. > Complete the program manual to keep track of change...
AI summary The text discusses the need to improve the program manual for tracking changes and standardizing content, as well as the structure of the Low Income program tracking sheet. It highlights the importance of annual adjustments based on evaluation results and the need for better association between project and client information for easier tracking and evaluation.
sociated with this expression. However, marketing research done by NSPI when the program was initiated found that the present program name (Low Income) was preferred because it was clear and explicit. Several complaints were received from...
AI summary The Low Income Program faced complaints about insufficient measures and timelines, but participant satisfaction was high at 91%. Program partners suggest improving eligibility processes to increase enrolment, with recommendations including open applications and expanding income eligibility. The new delivery model is expected to address these barriers.
source used, while another DA recommends increasing the eligible income range. However, the new delivery model implemented by ENSC should improve program enrolment and address this important barrier. In order to improve the program, progra...
AI summary The document discusses recommendations to improve the low-income program, including adjusting the eligible income range, reducing the number of organizations involved, and enhancing communication between the Delivery Agent (DA) and the Organization (OA). It also mentions a telephone survey of 70 participants, though results are noted to be cautious due to challenges in surveying the low-income housing market.
his form within the next 48 hours, save the file and send it back at the following email address: [email protected]. Thank you! Part I: General Questions Please indicate your company name: Q1 - How would you define your role(s) as an E...
AI summary This document contains general questions directed to ENSC energy efficiency program partners, focusing on their role, experience with the transition from Conserve Nova Scotia to ENSC, and their relationship with the Program Administrator. It also asks about complaints received from program participants.
a score? Reason(s): Q3 – Did you receive any complaints from participants in the program? Yes What was (were) the complaint(s) about? No Don’t Know Refused Not applicable Ref.: 5725 71 Low Income Program Efficiency Nova Scotia Corporation...
AI summary The text presents a series of survey questions from an evaluation report on the Low Income Program by Efficiency Nova Scotia Corporation in 2011. Questions focus on participant complaints, ease of participation, program satisfaction, and suggestions for improvement. The report includes placeholders for responses and does not provide specific answers.
rtner: Score: Name of partner: Score: Name of partner: Score: Q10a – If any of your answers to Q8 was equal to or less than 8, would you care to share the reason or reasons for such a score? Q11 – Who provides you with leads for potential...
AI summary The document contains a series of questions aimed at gathering feedback on the Low Income Program and other related initiatives managed by Efficiency Nova Scotia Corporation. It explores issues such as program name changes, implementation challenges, complaints from partners, and barriers to program execution.
tion of the partner.) No Don’t know Q15a- What was the complaint about? Q16 – In your opinion, what are the main barriers to the implementation of that program by order of importance? Ref.: 5725 75 Low Income Program Efficiency Nova Scotia...
AI summary The document is an evaluation report and interview guide related to the Low Income Program by Efficiency Nova Scotia Corporation from 2011. It includes questions about program implementation barriers and participant expectations, emphasizing confidentiality and outreach processes.
applicable It was the same Program Administrator I had to deal with a new PA The transition went smoothly The transition caused some delays or adjustments Other, please comment Q2 - On a scale from 1 to 10 (where 1 is very bad and 10 is ex...
AI summary The text consists of survey questions and response options related to the Low Income Program under the Efficiency Nova Scotia Corporation's 2011 Evaluation Report. It asks about the Program Administrator's performance, participant satisfaction, complaints, and suggestions for improvement.
regard to the marketing and outreach activities to implement the program? Q 7a - If your answer to Q7 was equal to or less than 8, would you care to share the reason or reasons for such a score? Ref.: 5725 79 Low Income Program Efficiency...
AI summary The text consists of a series of questions from an evaluation report on the Low-Income Program by Efficiency Nova Scotia Corporation. It focuses on program implementation, including marketing, outreach, partner involvement, and evaluation frequency.
Efficiency Nova Scotia Corporation 2011 Evaluation Report Q9b1- If you answered Too Few or Too Many, please comment: Q10- On a scale from 1 to 10 (where 1 is very bad and 10 is excellent), how would you rate your relationship with the othe...
AI summary The text contains survey questions from the 2011 Efficiency Nova Scotia Corporation Evaluation Report, focusing on program partner relationships, program name changes, and program modifications. It includes questions about leads, confusion in the market, and complaints from partners.
m Information The first task in the process evaluation of the Performance Plus program was the analysis of the program documentation. At this stage, all available program information was reviewed. Ref.: 5725 4 Performance Plus Program Effi...
AI summary The evaluation of the Performance Plus program began with a review of program documentation and an in-depth interview with the Program Manager, covering topics such as program justification, savings calculations, and marketing strategies. Additional interviews with program partners, including builders, were conducted as part of the evaluation process.
rence purposes, the protocol used by the Evaluator during the in-depth interviews with PMs is presented in Appendix III. 2.2.3 In-Depth Interviews with Program Partners Interviews with Builders In November, 10 in-depth interviews were cond...
AI summary The evaluation of the Performance Plus Program involved in-depth interviews with program partners, including builders, to assess free-ridership and market effects. Interviews were conducted with both participant and non-participant builders to understand the influence of the program on the implementation of high-efficiency measures.
the building decisions; > participant motivations, concerns and barriers; > satisfaction with the program; > spillover and free-ridership; and > impact of program measures. The demographic profile of survey respondents is shown in Appendix...
AI summary The document discusses the evaluation of the Performance Plus Program by Efficiency Nova Scotia Corporation, focusing on survey data from 2009 to 2011. It outlines demographic profiles of participants, sample sizes, and sampling errors at a 90% confidence level. The evaluation includes participant satisfaction, motivations, and program impacts.
7 4 Don’t know / refused 3 28 16 3.4.6 Satisfaction with Program There is a high level of satisfaction with the program, with nearly all respondents rating their overall experience as very satisfied or satisfied (91%). Respondents were hig...
AI summary The Performance Plus Program has a high level of satisfaction, with 91% of respondents reporting very satisfied or satisfied. Satisfaction was particularly high with the final energy audit, house plan reviews, and scheduling. Lower satisfaction was noted with rebates and energy efficiency recommendations, though still positive. A few respondents expressed dissatisfaction with rebate amounts and the duration of the final audit.
1) between both evaluations. This difference in builder free- ridership level could be due in part to the enhancements made to the approach to evaluating free- ridership. 4.4.2 Internal Spillover The participant survey was also used for as...
AI summary The document discusses the evaluation of internal spillover in the Performance Plus program, noting that only six participants implemented additional energy-efficient products after previous participation, indicating a very low level of internal spillover.
on various energy efficiency measures. Consequently, market effects can occur when a builder decides to implement energy efficiency measures in new constructions without participating in the program. Ten in-depth builder interviews were co...
AI summary The document discusses a study on market effects of energy efficiency programs, based on interviews with builders. It found that 5% of market effects were attributed to the program, with participating builders showing lower effects (1.7%) compared to non-participating ones (8%).
collect performance indicators (PI) for all those activities? Page 11 – table 4.3.1 Q: Do you use deemed savings for the measures described in pages 5 to 8? Or do you calculate them individually? Q: If they are deemed savings do you have a...
AI summary The text discusses questions and comments regarding the Performance Plus Program, including the use of deemed savings, the need for updated variables, and the adequacy of program procedures. It also highlights issues with the participant form, such as the need for clarity, revision dates, and the inclusion of utility names.
who signs the form, we need to have a box check to identify who is signing this form, the builder or the owner in case we need some clarification or contact that person for evaluation purposes. Assignment of rebate to builder Insert a form...
AI summary The document outlines questions related to the Performance Plus Program by Efficiency Nova Scotia Corporation, including delivery agents, free-ridership, barriers, evaluation processes, and database usability. It seeks insights for process interviews and program evaluation.
ally, a participant process flow chart was developed by ENSC in order to make the program participation procedures clearer. The program aimed to achieve net electricity savings of 21.80 GWh in 2011. KEY FINDINGS The 2011 evaluation of the...
AI summary The 2011 evaluation of the Business Energy Rebates (BER) program showed it is well designed with good potential for success. Participant numbers increased significantly from 13 to 106, and net energy savings rose from 0.503 GWh to 7.002 GWh. Contractors were a key source of program awareness, and the ENSC website was effective in promoting the program.
and internal spillover measured as part of the participant survey. Through this approach, a free-ridership level of 17.6 percent was captured, while a spillover level of 0.2 percent was identified. Ref.: 5725 vi Business Energy Rebates Pro...
AI summary The Business Energy Rebates (BER) program evaluation found a free-ridership level of 17.6% and a spillover level of 0.2%. The program achieved net energy savings of 7.002 GWh and demand savings of 1.419 MW at the generator in 2011, with a net-to-gross ratio of 0.83.
ned primarily from the following four sources: > ENSC website; > 2010 evaluation report; > program manual; > tracking sheet. 2.2.2 In-Depth Interview with Program Manager Econoler staff conducted one interview in September with the Program...
AI summary The evaluation of the Business Energy Rebates program involved reviewing documentation, conducting interviews with the Program Manager, on-site visits to verify implemented measures, and surveying 43 participants. The process aimed to assess program effectiveness, barriers, and participant experiences.
n and interactive effects affecting program demand and energy savings. All of these activities were used to establish an adjustment ratio for the gross energy savings calculated in the tracking sheet. The participant surveys provided infor...
AI summary The document discusses the calculation of the net-to-gross ratio (NTGR) for the Business Energy Rebates Program, incorporating factors like free-ridership and internal spillover. It also outlines the sampling methodology used for on-site visits based on the tracking sheet project list from 2011.
ny or organization to purchase energy-efficient products when installing or replacing energy-using products for your business in the future? [98 = Don’t know/Don’t recall, 99 = Refused] S3. Did you experience any specific challenge or face...
AI summary The text contains survey questions related to the Business Energy Rebates (BER) program administered by Efficiency Nova Scotia Corporation (ENSC), focusing on participant experiences, challenges, and suggestions for improvement. The survey aims to gather feedback on program barriers, issues encountered, and potential enhancements.
PA1 Score: (FR2a ; FR2b) IF PRE-SCREENING: 0% FR3. If your company had not received the rebateoffered by the program, would you have paid for the full cost of the energy-efficient measures, FR3 = Answer x 10% including the portion covered...
AI summary The text outlines a scoring methodology for evaluating the impact of energy efficiency programs, focusing on factors such as rebate influence, customer behavior, and program effectiveness, using a series of questions and formulas to calculate scores.
obtained from the following four sources: > ENSC website; > 2010 evaluation report; > program manual; > distributor invoices. 2.2.2 In-Depth Interview with Program Manager Econoler staff conducted one interview in September with the Progra...
AI summary The evaluation of the Smart Lighting Choices Program involves data from multiple sources, including interviews with the Program Manager and distributors, as well as on-site visits. The interviews aimed to understand program justification, savings calculations, barriers, marketing strategies, and free-ridership.
consumer)? C: Since the end users are unknown (beside large customers) sales records of a previous year from retailer could give an identification of the program impact in the market. Source: Web Q: When referring to the CEE Web Site, whic...
AI summary The text discusses the Smart Lighting Choices Program managed by Efficiency Nova Scotia Corporation, including questions about program participation, reporting forms, and the need for clearer separation of sections in the program manual for participants, retailers, and ENSC. It also references an interview guide for distributors.
Corporation 2011 Evaluation Report 3.2 METHODOLOGY DESCRIPTION 3.2.1 Analyzing Existing Program Information The first task in the process evaluation of the C&I Custom program was an analysis of the program documentation. At that stage, the...
AI summary The evaluation of the C&I Custom program involved analyzing program documentation and conducting in-depth interviews with Program Managers to assess program justification, savings calculations, barriers, marketing strategies, and prior evaluation recommendations.
program partners’ interviews for process evaluation was finalized. For reference purposes, the protocol used by the Evaluator during their in-depth interviews with PMs is presented in Appendix IV. Ref.: 5725 9 Commercial & Industrial Custo...
AI summary The evaluation report outlines the methods used to assess the Commercial & Industrial Custom and New Construction Program. It includes interviews with program managers, on-site visits conducted by Equilibrium Engineering, and a telephone survey by Corporate Research Associates, Inc. These activities were aimed at validating technical specifications and understanding program features.
g computer-assisted telephone interviewing (CATI). The average length of the survey was 17.5 minutes. The participant survey was used to gain a better understanding of the following program features: > previous program participation; > how...
AI summary The participant survey, conducted via computer-assisted telephone interviewing (CATI), aimed to understand program features such as previous participation, learning sources, spillover effects, motivations, and satisfaction. The survey lasted 17.5 minutes on average. Appendix III and VII provide demographic data and the questionnaire, respectively. Table 3 outlines sample sizes and sampling errors for 2010 and 2011.
13 ±19.6% 2011 Participants4 159 27 ±14.4% 3.2.5 In-Depth Interviews with Partners In September, two in-depth interviews were conducted with program verification partners. They are external consultants who assist ENSC in reviewing submitte...
AI summary In September and November, in-depth interviews were conducted with program verification partners and 2011 program participants to assess their involvement, satisfaction, and potential spillover effects of the C&I Custom Program. The interviews aimed to understand program perceptions, process satisfaction, and identify energy efficiency projects influenced by program participation.
s, seven report participating in the Small Business Lighting Solutions program (now named Small Business Energy Solutions). Table 6: Participated in other Programs7 Participated in Other NSPI or ENSC Programs 2008 2009 2010 2011 Sample Siz...
AI summary The text discusses participation in the Small Business Energy Solutions program and the Commercial & Industrial Custom and New Construction Program, highlighting program awareness and participation rates over several years. It also outlines how participants learned about the C&IC program.
12 12 100% Those giving a rating of 5 or 4 on a scale where 5= ‘very important’ and 1 = ‘not at all important.’ 4.4.5 Organizational Decision Making Seventy-five percent of respondents reported that someone outside their organization took...
AI summary Seventy-five percent of respondents indicated that external parties, primarily design professionals and contractors, were most responsible for specifying measures implemented through the program. This trend has remained consistent since 2009 and 2010, highlighting the role of these external stakeholders in program implementation.
interested in internal procedures. Q: Do you have a participation flow chart that illustrates the different steps for the participants that could be a good support for the program manual writing? Ref.: 5725 80 Commercial & Industrial Custo...
AI summary The text includes questions and comments related to program eligibility, internal procedures, terminology consistency, time limits, and program funding caps in the Commercial & Industrial Custom and New Construction Program. Concerns are raised about free-ridership, clarity of documentation, and potential barriers caused by funding limitations.
eral Q: is there a program logic model? Q: When the program was initially designed did it include some distortion effects (free-riders, spillover) and were they quantified to establish net savings? Q: Do you perform the cost effectiveness...
AI summary The text contains a series of questions related to the evaluation of the Commercial & Industrial Custom and New Construction Program, including program logic models, distortion effects, cost-effectiveness tests, program partners, evaluation plans, and database usability. It also references an evaluation report and recommendations.
e? Q: What is the percentage of leads that ended up in participation? Q: In table 3-2 , the contractor role has fallen down dramatically in 2010 (8%) compared to 46% in 2009. Was that investigated? Page 19 C: In table 3-3, past participati...
AI summary The text discusses questions and responses related to program participation rates, data analysis, and terminology consistency in energy efficiency programs. Topics include past participation influencing future engagement, spillover effects, and the need for consistent terminology in program documentation.
t), how would you rate your satisfaction in regard to the overall program? Q5a- If your answer to Q5 was equal to or less than 8, would you care to share the reason or reasons for such a score? Ref.: 5725 90 Commercial & Industrial Custom...
AI summary The text includes survey questions from an evaluation report on the Commercial & Industrial Custom and New Construction Program by Efficiency Nova Scotia Corporation in 2011. It asks participants about their satisfaction with the program, reasons for low satisfaction scores, suggestions for improvement, and involvement in program components such as feasibility studies and site inspections.
e confusion about? No Don’t know Q14- What is your opinion in regard to program on-course modifications? Easy to adjust to the way you work Requires minor changes to the way you work Requires major changes to the way you work No opinion No...
AI summary The text includes survey questions about program modifications, interruptions, and barriers to implementation, as well as a request for feedback on the Commercial & Industrial Custom and New Construction Program. It also mentions confidentiality and data collection for an evaluation report.
involved? 0a Q12- Is your involvement in projects of each participant mandatory? Yes No Some Q12a- If you answered Some, please explain on what basis your involvement is required. Q13- As an outside Consultant, do you discuss or consult wi...
AI summary The document contains a series of questions regarding involvement in the Commercial & Industrial Custom and New Construction Program, including the number of parties involved, mandatory participation, and potential confusion in the market about roles of program parties and other organizations.
Efficiency Nova Scotia Corporation 2011 Evaluation Report Q15- What is your opinion in regard to program on-course modifications? Easy to adjust to the way you work Requires minor changes to the way you work Requires major changes to the w...
AI summary The text contains survey questions from an evaluation report on Efficiency Nova Scotia Corporation's programs, focusing on program modifications, interruptions, complaints, and barriers to implementation. It also references a financial option evaluation related to the Commercial & Industrial Custom and New Construction Program.
Q19 – We would like to have your opinion on program performance regarding the two possible financial options which the program is offering (Energy Savings Account and C&I Custom Direct Enrollment). Thank you very much for your time and coo...
AI summary The text is an interview guide used in the 2011 evaluation of the Commercial & Industrial Custom and New Construction Program by Efficiency Nova Scotia Corporation. It aims to gather insights on program performance and potential spillover effects from participants.
A Utility account manager 5. Someone within your company or organization 96. (Other, please specify: ) 98. (Don’t know/Don’t recall) 99. (Refused) Ref.: 5725 112 Commercial & Industrial Custom and New Construction Program Efficiency Nova S...
AI summary The text is part of an evaluation report for the Commercial & Industrial Custom and New Construction Program, focusing on free-ridership by asking participants whether they had plans to implement energy efficiency measures before joining the program.
a 1 to 3 (refer to the Project Size criterion). The following figure compares the final sample distribution of total energy savings per market sector with that of the total population of 40 projects. Ref.: 5725 126 Commercial & Industrial...
AI summary The document discusses the sampling criteria for the Commercial & Industrial Custom and New Construction Program, including project size and location. Projects located more than 200 km from major urban centers were excluded, resulting in the removal of three projects from the sample.
in order to enhance energy savings by lowering the hours of operation. Finally, ENSC developed a participant process flow chart in 2011 in order to make the program participation procedures clearer. Ref.: 5725 v Small Business Energy Solut...
AI summary The 2011 evaluation of the Small Business Energy Solutions Program showed significant growth in participation and energy savings, with 1,468 participants and 23.176 GWh of net electricity savings. Participant satisfaction is high, though paperwork and application assistance received lower ratings and require monitoring.
sfaction ratings compared with 2010 findings and should therefore be closely monitored: the paperwork and procedures required to receive incentives and the assistance provided for program application. Participants were also asked to expres...
AI summary The document highlights participant feedback on a lighting program, noting high satisfaction but a slight decline from the previous year. Changes in 2011, such as allowing delivery agents to choose vendors, may have influenced this. Participants recommend improving communication, marketing, and information dissemination. ENSC plans to expand the program beyond lighting in 2012.
valuation should be modified in the Demand Side Management Data System. Correcting these values will ensure that uniform wattage values are used for savings calculations. SBES-R2. Enhance marketing and advertising to increase program aware...
AI summary The text discusses the need to correct wattage values in the Demand Side Management Data System to ensure uniformity in savings calculations. It also highlights the need for improved marketing and advertising efforts for the SBES-R2 program to increase awareness and participation, particularly among landlords and property management companies in urban areas.
program barriers; > program marketing and outreach strategy; > participation forms and flow charts; > role of the program partners; and > prior evaluation recommendations. Based on the results of the PM interview, the list of questions and...
AI summary The evaluation of the Small Business Energy Solutions (SBES) program involved interviews with program partners and on-site visits to validate the implementation of energy efficiency measures. These activities aimed to assess program barriers, marketing strategies, and participant satisfaction.
am performance. This process evaluation was performed through interviews with the PM and with the DAs, as well as through a telephone survey of program participants. 3.2 PROGRAM MANUAL CONTENT The SBES program features a manual that contai...
AI summary The evaluation of the SBES program involved interviews with the PM and DAs, as well as a telephone survey of participants. The program manual includes components such as program description, objectives, incentives, eligibility criteria, and cost-effectiveness test results, tailored for internal use by program staff and evaluators.
Accept faxed contracts: One DA suggests accepting faxed contracts as opposed to originals to improve performance. ENSC could also develop a web-based contract as opposed to paperwork. Ref.: 5725 14 Small Business Energy Solutions Program E...
AI summary A DA suggests accepting faxed contracts to improve performance and streamline eligibility and financing procedures for the SBES program. The program's eligibility criteria and potential for scaling through franchise participation are discussed.
Satisfaction with SBES Program 2008 2009 2010 2011 Sample Size 50 50 65 61 Overall program 100% 94% 97% 87% Capabilities of installers or 96% contractors doing installation work Audit technician 93% 99% 90% 93% Rebate/Incentive amount 96%...
AI summary The text presents satisfaction survey results for the SBES Program from 2008 to 2011, including feedback on various aspects such as installer capabilities, audit quality, rebate amounts, and customer interactions. Satisfaction levels vary across different categories and years.
ts needed to be made to program marketing and advertising as a number of customers who could be aware of the program were not. Table 16: Suggested Improvements to the SBES Program Suggestions 2011 Sample Size 61 Increase advertising/market...
AI summary The SBES program faced challenges with customer awareness and understanding, as over half of the respondents in 2011 indicated they would have found a diagram illustrating the program steps helpful. The development of a participation process flow chart in late 2011 was seen as a positive step to improve clarity and engagement.
. This result indicates that the participation process flow chart developed by ENSC in late 2011 was a good initiative as it will potentially simplify the involvement of future program participants. Table 17: Provision of a Diagram Illustr...
AI summary The participation process flow chart developed by ENSC in late 2011 was considered a good initiative as it could simplify future program participation. Table 17 shows survey responses on how the diagram would have facilitated participation in the SBES Program.
rovided information to calculate the net-to-gross ratio (NTGR) for this program, including free-ridership and internal spillover. The NTGR established was used to calculate the program net savings. Ref.: 5725 24 Small Business Energy Solut...
AI summary The document discusses the calculation of the net-to-gross ratio (NTGR) for the Small Business Energy Solutions Program, including free-ridership and internal spillover. It also outlines the sampling methodology used in the 2011 evaluation report, focusing on project categorization and data retrieval.
- INTERVIEW GUIDE WITH PROGRAM MANAGER Process Evaluation Program Name: Small Business Energy Solutions Telephone Interview with the Program Manager Date: List of questions (Q) and comments (C) discussed Source: Evaluation Report 2010 Page...
AI summary This text discusses the evaluation of the Small Business Energy Solutions (SBES) program, including questions about the program's theory, incentives, structure, and eligibility criteria. It also mentions the program's name change from Small Business Direct Install and considerations for improving the program manual.
satisfaction (say from 1 to 10) for most of the questions instead of a straight yes or no or not sure. C: Replace question # 3, by if the score is under .8, ask for the reason(s). Source: General Q: Could you please describe who the progra...
AI summary The text outlines a process evaluation questionnaire for Efficiency Nova Scotia Corporation's Small Business Energy Solutions Program, aimed at gathering feedback from program partners regarding their roles, program design, barriers, cost-effectiveness testing, marketing strategies, and database usability.
t applicable It was the same Program Administrator I had to deal with a new PA The transition went smoothly The transition caused some delays or adjustments Other, please comment Q2 - On a scale from 1 to 10 (where 1 is very bad and 10 is...
AI summary The text is a survey related to the Small Business Energy Solutions Program administered by Efficiency Nova Scotia Corporation. It asks participants about their experience with the Program Administrator, satisfaction with the program, complaints received, and suggestions for improvement.
ions Please indicate your company name: Q1 - How would you define your role(s) as an ENSC energy efficiency program partner? Q1a – How long have you had that role (specify months or years)? Q1b - If you were a program partner before it cha...
AI summary The text is a set of questions directed at ENSC energy efficiency program partners, asking about their roles, the transition from Nova Scotia Power to ENSC, and their relationship with the ENSC Program Administrator. It also inquires about complaints received from program participants.
a score? Reason(s): Q3 – Did you receive any complaints from participants in the program? Yes What was (were) the complaint(s) about? No Don’t Know Refused Not applicable Ref.: 5725 63 Small Business Energy Solutions Program Efficiency Nov...
AI summary The text is a portion of a 2011 evaluation report for the Small Business Energy Solutions Program by Efficiency Nova Scotia Corporation. It includes survey questions about program participation, complaints, satisfaction levels, and suggestions for improvement.
Efficiency Nova Scotia Corporation 2011 Evaluation Report P8. What purchases of energy-efficient lighting products had your company or organization made before participating in the Small Business Energy Solutions Program? (Record all that...
AI summary The text includes survey questions from an evaluation report on the Small Business Energy Solutions Program, focusing on prior energy-efficient lighting purchases and potential free-ridership. It asks participants if they had plans to install energy-efficient lighting before joining the program.
120102012 DSM Evaluation Reports
54 passages
1.2.2 In-Depth Interviews The 2012 evaluation methodology included in-depth interviews with program staff as well as with different program partners. Between August and November 2012, Econoler conducted 111 in-depth interviews with various...
AI summary In 2012, Econoler conducted 111 in-depth interviews with stakeholders including program managers, delivery agents, energy advisors, distributors, manufacturers, consultants, and retailers to evaluate program effectiveness. The interviews were part of a broader evaluation methodology.
A total of 1,042 interviews with participants and 57 interviews with builders (Table 4) were completed for this evaluation. Although the content of the surveys varied from one program to another, the survey instruments were used to capture...
AI summary The evaluation involved 1,042 participant interviews and 57 builder interviews conducted between October and November 2012. The surveys captured data on spillover, free-ridership, program awareness, participant motivations, satisfaction, and recommendations. In-store intercept surveys and CATI technology were used for different programs.
th customers regarding the program and the discount. Retailers also provided positive feedback regarding the program marketing as they indicated being satisfied with the look of the promotional tools. The DA and the retailers interviewed p...
AI summary The Instant Savings program received positive feedback from retailers and the DA regarding its marketing and overall satisfaction. However, challenges remain in involving store personnel and expanding the range of eligible products, particularly refrigerators and LED products. The program achieved significant energy and demand savings in 2012, with recommendations from Econoler focusing on improving retailer engagement and product eligibility.
The evaluation of RDI revealed that the transition from a pilot to a component of the Existing Houses program in July 2012 was successful. Indeed, participants expressed a high level of satisfaction with this component, as well as with its...
AI summary The evaluation of the Residential Direct Install (RDI) program found that its transition to the Existing Houses program was successful, with high participant satisfaction. However, marketing challenges, such as regional and demographic restrictions, were identified as barriers. DAs expressed satisfaction with ENSC staff but found program participation complex due to short timelines and operational demands.
4.2.1 Business Energy Rebates The 2012 evaluation of BER demonstrated that the program had undergone a series of changes, creating an intensified impact on the market. In fact, BER has grown in both range and scale, expanding from offering...
AI summary The Business Energy Rebates (BER) program has expanded significantly since 2011, offering instant rebates through distributors and incorporating new eligible measures. It has improved program promotion, communication, and management tools, leading to increased awareness and satisfaction. The program achieved notable energy and demand savings in 2012. However, some distributors noted that other programs offered higher incentives for certain products, which may have limited BER's impact.
easures in their facilities. Participants offered recommendations to improve the program that went from increasing advertising and improving communication to providing a quicker participation process. The program totalled 4,208 participant...
AI summary The program had 4,208 participants in 2012, with significant contributions from SBES and CDI. Impact evaluation showed energy and demand savings, and Econoler provided recommendations to improve the program, including better communication and a quicker participation process.
Awareness To ensure program continuity in the years to come, program awareness constitutes an important aspect of the overall strategy. Similar to the survey results of 2011, this year's evaluation revealed that the main source of awarenes...
AI summary The evaluation highlights the effectiveness of ENSC's advertising in raising awareness of the Appliance Retirement (ARet) program, with word of mouth also playing a key role. DAs expressed satisfaction with outreach efforts but suggested targeting rural areas and increasing retailer and municipality participation. Awareness of recycling services has improved, which is a key factor in customer participation.
2.2.5 Participant Survey A telephone survey with a total of 201 program participants was conducted by Econoler's subcontractor, Corporate Research Associates, Inc. (CRA), from its offices in Halifax. The interviews were conducted in Octobe...
AI summary A telephone survey of 201 program participants was conducted by CRA in 2012 to gather feedback on the ARET program, covering aspects like spillover, free-ridership, program awareness, participant motivations, and satisfaction. The survey included questions about refrigerators, freezers, and air conditioners, with demographic data and questionnaires detailed in appendices.
CONCLUSION The 2012 evaluation of ARet demonstrated that the program is well designed and that it underwent a series of positive changes aimed at improving its design and implementation. Notably, the program has excluded dehumidifiers from...
AI summary The 2012 evaluation of the Appliance Retirement (ARET) program highlighted its improved design and implementation, including the exclusion of dehumidifiers for cost-effectiveness and the inclusion of AIR MILES® reward points. The program's reorganization into two delivery agents increased participant satisfaction. ENSC's efforts in advertising, communication, and program promotion led to high participation and satisfaction levels, with 7,976 units retired in 2012 and significant energy and demand savings achieved.
Program Satisfaction [S Series] S1. Using a scale from 1 to 5 where 1 is "extremely dissatisfied" and 5 is "extremely satisfied" how would you rate your satisfaction with the program overall? [RECORD NUMBER, 98=Don't know, 99 Refused] [DO...
AI summary The text outlines a survey related to program satisfaction, specifically focusing on the Appliance Retirement Program. It includes questions on overall satisfaction, reasons for dissatisfaction, sign-up methods, and recommendations for improvement. The survey aims to gather feedback on program accessibility, eligibility, and customer experience.
Interview with Delivery Agent In October 2012, one interview was conducted with the program DA in order to understand, among other things, their involvement in the program, their participation process, as well as their perception of and sa...
AI summary An interview was conducted in October 2012 with the program Delivery Agent (DA) to understand their involvement, participation process, and perception of and satisfaction with the program. The interview protocol is detailed in Appendix II.
Interviews with Retailers In October and November 2012, a total of 17 in-depth interviews were conducted with program retailers. Of the 17 retailers, eight were corporate retailers and nine were independent retailers. These interviews focu...
AI summary In 2012, 17 interviews with retailers were conducted to assess their experiences with efficiency programs, focusing on ENERGY STAR® CFLs, LED lamps, and CEE Tier 3 clothes washers. The study measured free-ridership for LED lamps and clothes washers and spillover effects for all three products, while CFL free-ridership was measured through intercept surveys.
2.2.5 Participant Survey An intercept survey with a total of 164 program participants who purchased qualifying CFL or LED lamps during the fall campaign was conducted by Econoler's subcontractor, Corporate Research Associates, Inc. (CRA)....
AI summary A participant survey conducted in October 2012 with 164 respondents who purchased CFL or LED lamps during the fall campaign aimed to gather feedback on Instant Savings, including CFL and LED purchases, free-ridership, program awareness, and discount awareness. The survey was conducted in-store at five retail banners and had a sampling error of ±6.5% at a 90% confidence level.
Table 4: Program Manual Content – Instant Savings Program Manual Content 2011 2012 Document revisions 4 4 Program description (including nature or type of program) 4 4 Program justification Δ 4 Program objectives 1 1 Incentives 4 4 Eligibi...
AI summary Table 4 outlines the content of the Instant Savings program manual across different years, detailing sections such as program description, incentives, eligibility, and evaluation plans. It shows the inclusion or absence of various elements in the manual for 2011 and 2012.
3.2.5 Marketing and Outreach Activities Instant Savings is a difficult program to evaluate by nature, since the identity of the participants is unknown. Hence, the marketing strategy must be comprehensive and be comprised of two vectors: T...
AI summary The Instant Savings program faces challenges in evaluation due to unknown participant identities. To address this, a comprehensive marketing strategy is implemented, including POP displays, social media engagement, customer events, and performance indicators. The Evaluator recommends making performance indicators more quantitative and revising the marketing plan periodically.
CONCLUSION The 2012 evaluation of Instant Savings demonstrated that the program works well overall and constitutes the right approach in a market transformation and resource acquisition perspective. Additions were made to the program to he...
AI summary The 2012 evaluation of the Instant Savings program found that it works well overall and was improved with increased discounts, more eligible products, and better marketing. ENSC implemented key recommendations from the 2011 evaluation, including new tools for program management. Retailers reported high satisfaction but noted challenges in involving store staff and expanding eligible product categories, especially for refrigerators. The program achieved energy savings of 10.767 GWh and demand savings of 1.895 MW in 2012.
Satisfaction Satisfaction with the program is high among participants. Indeed, nearly all participants expressed a high level of satisfaction with the program overall and with the impact of the measures implemented. Very high levels of sat...
AI summary Participants in the program express high satisfaction with the program and its impact, particularly with energy assessments and the courtesy of Energy Advisors. However, program partners are divided in their satisfaction, with some expressing dissatisfaction due to frequent program changes and lack of government support. Partners also note a lack of collaboration from Natural Resources Canada (NRCan) and issues with the HOT2000 software.
2.2.6 Participant Survey A telephone survey with a total of 80 program participants was conducted by Econoler's subcontractor, Corporate Research Associates, Inc. (CRA), from its offices in Halifax. The interviews were conducted in October...
AI summary A telephone survey of 80 program participants was conducted in 2012 to gather feedback on the Home Energy Assistance (HEA) program, focusing on spillover effects, free-ridership, program awareness, participant motivations, satisfaction, and recommendations for improvement.
3.6.1 Perceptions Related to Program Changes A total of five DAs and two EAs were interviewed for the evaluation of HEA. The program partners were questioned about the recent changes made to the program and their impact on their work. Opin...
AI summary The evaluation of the Heat Energy Assistance (HEA) program reveals mixed satisfaction among partners, with dissatisfaction linked to frequent changes, lack of financial commitment, and unclear messaging. Key concerns include rebate amounts, the 12-month timeline, and the removal of incentives for heating equipment, which has decreased program activities. Improved communication between ENSC and DAs is recommended.
Table 16: Satisfaction with the Program Satisfaction with the Program 2011 2012 Sample Size 70 80 Very satisfied 61% 60% Satisfied 29% 35% Neither satisfied nor dissatisfied 6% 1% Dissatisfied 3% 3% Very dissatisfied 1% Don't know 1%
AI summary Table 16 presents customer satisfaction data for a program in 2011 and 2012. The majority of participants were very satisfied (61% in 2011 and 60% in 2012), with a slight increase in satisfaction in 2012. A small percentage of participants were dissatisfied or very dissatisfied, and a minimal number were unsure of their satisfaction level.
100% -[FR4_P/(FR4_P+FR4_NP)] FR2c. If you had not participated in the program, what is the likelihood that you would have implemented the energy efficiency upgrades that you implemented through the program but at a later date? (Scale 0 to...
AI summary The text presents a survey question (FR2c) asking participants about the likelihood they would have implemented energy efficiency upgrades at a later date without the program. If the response exceeds 5, a follow-up question (FR2cc) asks how many months later the upgrades would have been implemented, with specific response options and corresponding percentages.
Table 13: Satisfaction with Overall Experience Satisfaction with Overall Experience 2011 2012 Sample Size 28 75 5 - Very satisfied 89% 77% 4 7% 15% 3 4% 7% 2 1% 1 – Not at all satisfied Don't know removed from calculations Among the small...
AI summary Table 13 shows a decrease in satisfaction levels from 2011 to 2012, with fewer respondents reporting being very satisfied. Dissatisfaction was attributed to poor communication, delays in receiving incentives, and the amount of incentives being too low.
The process to participate in the program was considered easy by the majority of participants. Indeed, nearly all participants found the participation process easy (91% offering a rating of '5' or '4' where 5 is very easy).
AI summary The majority of participants found the process to participate in the program easy, with 91% rating it as '5' or '4' on a scale where '5' is very easy.
This Appendix presents all recommendations made by the Evaluator throughout the report as well as the sections where the recommendations originated. Sections Recommendations Program Charts 7. Post a simplified participant process chart on...
AI summary The Evaluator recommends developing and posting a simplified participant process chart on the program website, emphasizing clarity, comprehensiveness, and wide distribution to ensure maximum exposure for participants.
Program Awareness and Participation [P Series] - P1. How did you learn about the Fuel Substitution Program? PROBE: Anything else? [DON'T READ; ALLOW MULTIPLE RESPONSES] - 1. (Mailing/Email from Heritage Gas) - 2. (On the Heritage Gas websi...
AI summary The text outlines survey questions related to customer awareness and participation in the Fuel Substitution Program, including how participants learned about the program, reasons for participation, influences on their decision, and concerns they had before joining.
NSC would allow reaching more homeowners and builders across Nova Scotia. This recommendation would address one of the main Ref.: 5790 xi dissatisfactions identified by the program partners, which refers to the lack of support from ENSC in...
AI summary The text discusses a recommendation to improve program delivery by collaborating with DAs to better inform homeowners and builders about energy efficiency programs, addressing dissatisfaction with ENSC's lack of support in marketing activities.
Participant Survey The participant survey was conducted with a total of 70 homeowner participants. The average length of the survey was 14 minutes. The participant survey was meant to generate feedback on the following aspects of the progr...
AI summary A participant survey was conducted with 70 homeowner participants to gather feedback on program aspects such as free-ridership, awareness, motivations, satisfaction, and recommendations for improvement. The survey took an average of 14 minutes to complete, and demographic data and sampling errors are detailed in appendices.
The builder survey was conducted with a total of 57 builders across Nova Scotia. The average length of the builder survey was 11 minutes. Of the 57 builders, 50 were participant builders and 7 were nonparticipant builders. Builders were as...
AI summary A survey of 57 builders in Nova Scotia was conducted, with 50 participants and 7 non-participants. Participant builders were asked about their experiences with the Performance Plus program, including free-ridership, satisfaction, and recommendations. Non-participants were surveyed on market effects. Sampling error for participant builders is ±11.6% at a 90% confidence level. Results are detailed in the report's Builder Perspectives and Impact Evaluation sections.
3.1 OBJECTIVE AND APPROACH OF THE PROCESS EVALUATION In 2011, Performance Plus did not require a complete process evaluation as no significant changes had occurred since the 2010 process evaluation. Only a few process indicators were obtai...
AI summary The 2012 process evaluation of the Performance Plus program examined program documentation, tracking sheets, and perspectives from partners and participants. No significant changes occurred in 2011, so no recommendations were made. The evaluation included interviews with the Program Manager, DAs, EAs, and participants.
Table 6: Program Manual Content – Performance Plus Program Manual Content 2012 Document revisions Program description (including nature or type of program) Program justification Program objectives Incentives Eligibility criteria Program pa...
AI summary Table 6 outlines the content of the Program Manual for the Performance Plus initiative, detailing sections such as program description, objectives, incentives, eligibility, and evaluation plans. It includes a list of program manual content items for the year 2012, indicating what information is included, partially included, or missing.
SECTION PM – PROGRAM AND MEASURES The next questions will concern the measures promoted by the Performance Plus program. PM1a. Regarding program on-course modifications, (change in total cost of the assessment, change in incentives for pre...
AI summary The text outlines a series of questions related to the Performance Plus program, focusing on program modifications, barriers to implementation, participant complaints, and suggestions for improvement. It includes inquiries about the program's effectiveness, participant challenges, and areas for enhancement.
Satisfaction with Program (S Series) - S1. Thinking of your OVERALL experience with the Performance Plus program up to this point, including any services received or energy efficient upgrades installed, how satisfied are you overall with t...
AI summary The text outlines survey questions related to customer satisfaction with the Performance Plus program. It includes questions about overall satisfaction and reasons for dissatisfaction, such as delays in rebate processing, installation, and service quality.
Free-Ridership (FR Series) Now, I would like to examine the influence of the Performance Plus program on your decision to build houses with a high level of efficiency. - FR1. Without the Performance Plus program and its rebate, would you h...
AI summary The Free-Ridership (FR Series) section investigates the impact of the Performance Plus program on the construction of highly energy-efficient homes in Nova Scotia in 2012. It asks respondents whether they would have built the same number of homes with an EnerGuide rating of 83 or higher without the program's incentives and assesses the program's importance in their decision-making.
Awareness In order for the number of participants to keep increasing and to ensure program continuity in the years to come, program awareness constitutes an important aspect of the program strategy. This year's evaluation revealed that the...
AI summary The evaluation highlights that RDI program awareness has been effectively driven by ENSC advertising, staff, DAs, and word of mouth. However, non-low-income participants and DAs suggest that improved advertising and outreach are needed to overcome marketing barriers, particularly due to regional and demographic restrictions.
2.2.3 Interviews with Delivery Agents In October 2012, two interviews were conducted with the program DAs in order to understand, among other things, their involvement in the program, their participation process, as well as their perceptio...
AI summary In October 2012, two interviews were conducted with Delivery Agents (DAs) to understand their involvement, participation process, and perception of and satisfaction with the program. The interview protocol is detailed in Appendix II.
2.2.5 Participant Survey A telephone survey with a total of 181 program participants was conducted by Econoler's subcontractor, Corporate Research Associates, Inc. (CRA), from its offices in Halifax. The interviews were conducted in Octobe...
AI summary A telephone survey of 181 RDI program participants was conducted in October 2012 by CRA using CATI technology. The survey aimed to gather feedback on spillover, free-ridership, program awareness, participant motivations, satisfaction, and recommendations for improvement. Only non-low-income participants who joined the program since July 2012 were surveyed.
3.3 TRACKING SHEET Econoler reviewed the structure and content of the RDI tracking sheet, which presents information about both the customer and the products installed in one main sheet. In general, the tracking sheet contains the essentia...
AI summary Econoler reviewed the RDI tracking sheet, noting that while it contains essential information for monitoring participants and energy savings, only 87% of records have unique participant identification numbers. Most contact details are complete, though some data is missing due to installations in vacant units. The sheet also collects critical data for impact evaluation and geographic planning.
Among the small number of participants with the perception that the program application process was difficult (n=14), six mentioned a lack of adequate advertising or program awareness, while four felt there was a lack of information in gen...
AI summary Among 14 participants who found the program application process difficult, six cited insufficient advertising or awareness, and four mentioned a lack of general information or proper communication about the application process.
4.4 NET-TO-GROSS RATIO RDI offers free installation of energy efficiency products for low-income residents as well as participants of other ENSC residential programs. The net-to-gross ratio (NTGR) calculations took into consideration both...
AI summary The net-to-gross ratio (NTGR) for the RDI program is calculated differently for low-income and non-low-income customers. For low-income customers, the NTGR is set at 1 due to minimal distortion effects. For non-low-income customers, the NTGR accounts for free-ridership and internal spillover effects using a self-report approach and a specific formula.
- Q8. What suggestions do you have to improve program performance? - Q9. More precisely, what suggestions do you have concerning program marketing and outreach activities? Thank you very much for your time and co-operation. Your answers wi...
AI summary The text presents two questions regarding suggestions for improving program performance and specifically marketing and outreach activities. It emphasizes confidentiality and the intent to use responses to enhance program effectiveness.
3.2.4 Program Charts The program now has two process charts: one for the partner and the participants and the other for the PM. These charts were recommended in the 2011 evaluation and are very informative for any new staff responsible for...
AI summary The program now includes two process charts for partners, participants, and the PM. Econoler recommends a simplified version of the chart be posted on the program website and distributed to partners and participants for clarity and accessibility.
3.4 RELATIONSHIP WITH PARTNER As part of the process evaluation, the DA involved in MURB was interviewed. The latter indicated strong satisfaction with the program and their relationship with ENSC's team. When asked about the transition fr...
AI summary The DA involved in the MURB program reports satisfaction with ENSC's team and the transition from pilot to full program, despite initial challenges with installation booking and overestimation of savings. The DA plans to implement a 'pulse' strategy to improve efficiency and customer experience. Complaints were noted, but represent a small percentage of installations. The DA recommends improvements such as LED upgrade packages and better engagement events.
Table 6: Characteristics of Participation Participation 2012 Sample Size 37 Did not have products installed in common area 76% Did have products installed in common area 24% Saving on energy and energy costs was mentioned as the single mos...
AI summary Table 6 outlines participation characteristics in the MURB program in 2012, including sample size and reasons for participation. Energy savings was the primary motivation, with other reasons including program cost, pre-existing upgrade plans, and curiosity about energy efficiency. A minority noted that building management made the decision to participate.
Table 18: Participation Process Participation Process 2012 Sample Size 37 5 - Very easy 62% 4 24% 3 11% 2 3% 1 - Very difficult Don't know removed from calculations
AI summary Table 18 presents data on the participation process in 2012, including a sample size of 37 and responses to a question about ease of participation, with 62% rating it as 'Very easy' and lower percentages for other ratings.
3 Participation questions (Free-ridership) This section is an interview with the on-site contact. S1. Thinking of your OVERALL experience with the Multi-Unit Residential Buildings program, including any services or energy efficient product...
AI summary This section of the document presents a survey conducted with participants of the Multi-Unit Residential Buildings program, focusing on their satisfaction and whether they would have installed energy-efficient lighting products without the program's involvement.
Table 10: Individual Responsible for Specifying Measures to Be Implemented Main Responsible 2011 (%) 2012 (%) Sample Size 43 56 Someone within company/organization 35% 27% Contractor 28% 25% Outside design professional (architect, engineer...
AI summary The text discusses the distribution of responsibility for specifying measures to be implemented in energy efficiency programs and highlights that most participants did not face barriers during program participation, although some cited issues such as lack of information, excessive paperwork, and slow approval processes.
CONCLUSION The 2012 evaluation of BER demonstrated that the program had undergone a series of changes, creating an intensified impact on the market. In fact, BER has grown in both range and scale, expanding from offering only mail-in rebat...
AI summary The 2012 evaluation of the Building Energy Rebate (BER) program showed significant improvements in its range, scale, and impact since the 2011 evaluation. The program expanded to include instant rebates and new equipment categories, and ENSC implemented key recommendations. Net energy savings and demand savings increased substantially in 2012, though some distributors noted competition from other BNI programs.
2.2.2 Interviews with Program Manager Econoler staff conducted two interviews respectively in July and August 2012 with the Program Manager (PM). Among other things, these interviews were intended to follow up on the 2011 evaluation recomm...
AI summary Econoler staff conducted interviews with the Program Manager in July and August 2012 to follow up on 2011 evaluation recommendations and understand changes in program delivery in 2012. These interviews informed the preparation of questions and topics for data collection tools used in the process evaluation.
Q3. On a scale from 1 to 10, where 1 is very poor and 10 is excellent, please rate your satisfaction in regard to the: Aspects of the program Score 1 = very poor 10 = excellent NA = Not Applicable Reason If you answered 8 or less, please s...
AI summary The document presents a survey with questions about satisfaction levels regarding various aspects of a program, including technical support, processing delays, marketing, and relationships with staff and clients. It also asks about the program's impact on business and barriers to its delivery, along with complaints received.
APPENDIX I - RECOMMENDATIONS Sections Recommendations 2. Improve tracking and monitoring of project status and savings: The Evaluator ran into a number of difficulties when investigating the status of each project as part of the 2012 in-de...
AI summary Econoler recommends that ENSC improve tracking and monitoring of NC projects' status and develop tools such as status reports to help internal and external users better understand project progress. Issues were identified with limited information on project details and status, and discrepancies between claimed and actual savings.
In-Depth Interviews In general, this in-depth questionnaire aims to discuss with the participants their decision to participate in the program. More specifically, it would help validate the influence of the New Construction Program on the...
AI summary This in-depth questionnaire seeks to understand participants' motivations for joining the New Construction Program and assess their satisfaction with the program's process and outcomes, particularly regarding the influence of the program on their decision to implement energy efficiency measures.
3.3.4 Satisfaction with the Program Both CDI and SBES achieved a high level of participant satisfaction with a higher satisfaction level among SBES participants. Actually, 95 percent of SBES participants and 85 percent of CDI participants...
AI summary The document highlights that the SBES program achieved a higher level of participant satisfaction compared to the CDI program, with 95% of SBES participants and 85% of CDI participants reporting satisfaction.
Table 9: Satisfaction with Program Overall 2011 2012 Satisfaction with Program SBES (%) SBES (%) CDI (%) Sample Size 61 76 74 Overall program 87% 95% 85% Base: Percentage of respondents who were very satisfied / satisfied \ Base: Percentag...
AI summary Table 9 presents satisfaction rates with the SBES and CDI programs in 2011 and 2012, showing high levels of satisfaction among respondents. The sample sizes and percentages of very satisfied/satisfied respondents are provided for each year.
Table 11: Satisfaction with Time Interval between Program Application and Implementation 2012 Satisfaction with Time Interval SBES (%) CDI (%) Sample Size 76 71 5 "Very satisfied" 62% 68% 4 24% 18% 3 7% 8% 2 4% 1% 1 "Not at all satisfied"...
AI summary Table 11 presents customer satisfaction levels with the time interval between program application and implementation for the SBES and CDI programs in 2012. The data indicates a high level of satisfaction, with most respondents rating their experience as 'very satisfied' or 'satisfied'. The section '3.3.5 Recommendations for Improvements' suggests areas for enhancement based on this feedback.