I think that somewhere, we are getting off track with these dyno numbers and it's causing some confusion. The horsepower readings that you get off of a dyno (actually, the dyno is measuing torque, and a computer then extrapolates a HP number) is an accurate representation of the HP on that day, with that car, under the conditions relative to the test (temp, humidity, etc.). There is no such thing as "real world" numbers. There are only "dyno numbers", and to some extent, that is where the problem (or interpretations) may lie. There is no measurement for HP while you are driving down the street (other than seat of the pants). The other thing to remember about a dyno number is that it is really only relevent if you are doing an A - B comparison. Other than that, it won't tell you much, other than your total HP.
One of the things that we see fairly frequently, are enthusiasts that do their dyno comparisons many weeks (or even months) apart. This will greatly skew the data. There are too many potential variables that can get in the way of achieving any truly accurate comparisons. Things like engine wear, spark plug wear, lubricants, etc. etc., even tire wear will effect the HP numbers. Testing your car in February, making some changes and testing it again in July is pretty meaningless. The best way to do an A - B test (and very few do it this way) is to put the car up on the rollers, do the first test (the A test), pull off the old parts (like the throttle body, exhaust, etc.), install the new parts, and do the B test. The car never leaves the rollers. Be prepared to spend some cash if you attempt to do this since you will tie up the dyno all day, and time is money. When Accufab goes down the street to Westech (just a couple of blocks from our shop), we tie up the dyno all day long, from the time they open the doors until midnight if we have to. Whether we have an engine on one of the engine dynos (they have two) or on the chassis dyno, we don't leave until everything is done right, meaning we have good A - B data.
Let's talk about dynos for a second too, while we are at it. We use the Westech dynos exclusively, because they are convenient and because they are willing to work with us on our projects. We have a car or an engine on one of their dynos at least once a week. We have a GT there now, for some kind of a magazine test. If you want, check out
www.westechperformance.com and you will see their facility. They have two engine dyno cells with Superflow engine dynos (a 901 and a 902). Both can handle 5000 HP engines (alky burning funny car engines for instance). Their chassis dyno is a Supeflow AutoDyn unit, capable of handling 1000+ at the rear wheels. This is a conservative number, I have seen NHRA Pro Stocks on the rollers putting out 1350 HP.
Accufab supplies headers for the dyno when needed. They also use our throttle bodies when they can. Who relys on the Westech dynos? Oh, Hot Rod magazine, Popular Hot Rodding, Car Craft magazine, Muscle Mustang & Fast Ford, yada, yada. Westech has also been home for the Engine Masters Challenge. In short, they know their sh!t over there.
Now, itf I were on the east coast or in the New Jersey area, I would beat a path over to Bob Ida's shop, or JDM, or Kinetics (if I were in the Atlanta area). These places all have good reputations and I would trust them. But we are here on the Left Coast and Westech is our home away from home.
Accufab is VERY conservative when it comes to releasing dyno numbers. If we can get a 20 HP increase out of a new throttle body, we will most likely advertise it at 15-18 more HP. I have seen people on other websites list horsepower increases of 10 to 20 more HP than what we can get out of the same unit. I know that these folks must be smoking rope. If they want to believe those phony numbers, fine with us I guess, but we know it's BS. We take the dyno tests very seriously and wish that eveyone else did too, but I know that there are alot of goofy numbers out there and I hope that folks on this site use their heads when reading these numbers.
Find a shop that you can trust, with people that you can work with, and you won't go very much wrong. Unless you just want a "HP number" that will impress your friends, use the dyno for what it does best, which is to make comparisons between A and B.
There is a neat sign over the dyno at Westech. It reads "Welcome to the polygraph room". That is real world.