Skip to main content
Tag

evaluation

Image shows a graphic of stacked books with "Energy Rant" on the spine. Next to graphic is text displaying: "The Book of Energy Program Evaluation - Tssssss"

The Book on Energy Program Evaluation – Tssssss

By Energy Rant No Comments
Although, or maybe because Michaels Energy has provided research and evaluation services for about 25 years, I’ve been a consistent critic of evaluation, measurement, and verification (EMV), and I’ll tell you why in several chapters. Chapter 1 Resource Acquisition Evaluation methodologies are predominately based on widget programs, also known as resource acquisition programs. The hypothesis is this: efficient equipment costs more, and that extra cost is the barrier. How to mitigate or remove the barrier? Pay down the incremental cost with a rebate after the purchase or incentive before the purchase. It’s that simple and dumb. The simpleton approach to…
Read More
impact evaluation - yoga

Impact Evaluation, Bull Riding, Cookies

By Energy Rant No Comments
I've been doing a lot of program impact evaluation for the last few months. That comes with pluses and minuses. One of the minuses is that I needed to suspend writing this blog for a while. Pluses include problem-solving, working with staff throughout our company, and forensics engineering. Impact Evaluation But first, what is impact evaluation? I have a broad audience, and I get great feedback, some of which is, "I don't know what you're talking about sometimes." Entities delivering efficiency programs (implementers) are responsible for delivering savings or impacts. For custom efficiency portfolios, which entail a wide variety of…
Read More
impact

Inch or Mile? Indispensable Thumbs Guide Impact Evaluation

By Energy Rant No Comments
Hi. How’re you? Jeff Ihnen here. I’m back and almost live. I’ve been away on several temporary assignments that are starting to wind down. We are thrusting forth into the 11th year of the Energy Rant! Indispensable Thumbs Unless you have broken one, lost one, or had one immobilized, you probably have no idea of the value of your thumb and its equivalent, the big toe. I’m sitting on an airplane as I bang this out, munching a bag of almonds. Thumb and a finger. Thumb and a finger? That’s how you and I and anyone with a fully functioning…
Read More

Stifling Impacts of Jurassic Evaluation Dogma

By Energy Rant One Comment
If efficiency programs were telephones, the evaluation community would still be using wall-mounted analog dial-ups rather than the iPhone. Yes, I’m going to tell you why programs are designed to be evaluated and not to be effective, part 2, herein. The following is the list of flaws in demand-side management theory, as presented last week. Efficiency must cost more than inefficiency Building energy codes are sacrosanct Efficiency has to be the primary factor in customer decision making Customers must “get their money back” The unfamiliar get fifty cents on the dollar Immortality is fantasy Last week we covered the first…
Read More

Energy Program Evaluation Tales from the Dark Side

By Energy Rant No Comments
The Energy Rant is not for the weak-kneed who prefer to live in the land of unicorns, fairy dust, and lollipops. This week is no exception.This Rant is brought to you by the recent ACEEE paper, Recent Developments in Energy Efficiency Evaluation, Measurement and Verification. Burned on the Alter of 90/10 A major objective of most evaluation contracts is to punch the 90/10 ticket. To recap, 90/10 simply means there is a 90% chance that the results of the population, if evaluated in full, will be within plus or minus 10% of the results for the sampled, studied projects. As…
Read More

Driving Ms. Free Rider Daisy

By Energy Rant 3 Comments
Sitting on high levels of energy efficiency program design and evaluation provides a wonderful perspective and results in some astonishing epiphanies. Warning – data-backed bluster straight ahead. New Construction Programs We study the performance of new buildings all the time, whether it is for evaluation or looking for great retro-commissioning opportunities. Nothing provides a better opportunity for retro-commissioning than a stock of new buildings, whether they filtered through a new construction program or not. The chart below features energy performance of new buildings that went through a new construction program. We implement, and we evaluate projects nationwide (don’t bother guessing…
Read More

Drive-By Evaluation – Buffalo Bill at Large

By Energy Rant 3 Comments
Thank you to Mike Frischmann (our Director of Evaluation Engineering) for contributing to this week’s Rant. Eight hundred pound gorilla alert! Energy efficiency program evaluation “best practices” need a big overhaul. I am not talking about best practices for doing impact evaluation like the Uniform Methods Project. It’s disgusting that so much money is spent on standards like that and others, while ulterior motives drive program evaluation in entirely different directions. Purpose of Program Evaluation The State and Local Energy Efficiency Action Network, aka SEE Action’s Energy Efficiency Program Impact Evaluation Guide, states the following are objectives of program evaluation.…
Read More
Lily

Evaluating Custom Efficiency – The 4D Dysfunction Report

By Energy Rant One Comment
A disturbing trend with custom efficiency is sweeping the industry, and guess what, I’m going to rant all over it like black on my little spazoid Labrador, Lily, aka, Blacky. Michaels is packed to the rafters with engineers who know a thing or two about energy, thermodynamics, heat transfer, and fluids – all the building blocks of being an expert in custom efficiency. We know this because our job candidates get an eclectic, off-the-wall quiz when we interview them. Candidates have to leave their props and crutches on the table or in their pockets, exposing only their brain and how…
Read More

Evaluation, Measurement and Verification 2.0; A Whale Bus or an Airbus?

By Energy Rant 2 Comments
Evaluation, Measurement and Verification 2.0, or EM&V 2.0, is a nerdy term coined in 2014, according to this blog by Northeast Energy Efficiency Partnerships (NEEP). The hype of EM&V 2.0, which I will explain later, is that it will automate measurement and verification, putting us engineers out of business. This is not going to happen anytime soon. Definition 2.0 The definition of EM&V 2.0 boils down to using utility meter interval data, typically hourly or sometimes every 15 minutes, or maybe even 5 minutes, to disaggregate and measure impacts from energy efficiency measures. One could consider that EM&V 2.0 is…
Read More
evaluation

Real Time Evaluation for Real – Excuses Stay Home

By Energy Rant One Comment
People and firms talk about integrating evaluation findings into programs and portfolios closer to real time than the conventional methods.  But what is really being done about it other than talk? This post features some concrete ideas to put in the bank - money. First, what is the conventional evaluation process? Approaches and plans vary all over the place because different clients see different general approaches. For example, some clients evaluate every program every year. Some evaluate every program only once per EE plan cycle and within this subset, some evaluate them all in one shot over the course of…
Read More