Toyota GR86, 86, FR-S and Subaru BRZ Forum & Owners Community - FT86CLUB

Toyota GR86, 86, FR-S and Subaru BRZ Forum & Owners Community - FT86CLUB (https://www.ft86club.com/forums/index.php)
-   BRZ First-Gen (2012+) — General Topics (https://www.ft86club.com/forums/forumdisplay.php?f=23)
-   -   BRZ MPG Data Analysis (https://www.ft86club.com/forums/showthread.php?t=87742)

housecat 05-03-2015 01:26 AM

BRZ MPG Data Analysis
 
1 Attachment(s)
For the past 4000 miles, I've been tracking my MPG and comparing it with the dash reading. Once I've collected enough data, I plan to do some sort of statistical analysis. I hope some of you might find this interesting.

Introduction

This experiment will measure the average amount of fuel consumed by the BRZ and compare it with the vehicles's measurement. The goal is to determine if the BRZ's mpg reading on the dash is within reasonable error. Later, the effects of different tires on fuel consumption may be tested.

Procedure for Measuring MPG

To measure the average mpg, first the trip odometer is reset to zero miles after the fuel tank is completely filled. During the next gas-station trip, the gas tank is refilled again completely. The amount of gallons displaced since the last fuel-up is measured by how many gallons it takes to fill the entire gas tank. The miles on the trip odometer keeps track of how many miles were driven with the consumed gasoline. By dividing the miles driven by the gallons of gasoline consumed, an average MPG measurement is obtained. The trip odometer is reset after refueling so another measurement can be made during the next gas station visit.

About the Vehicle Tested

The car driven is a 2014 Subaru BRZ Limited with a manual transmission. The vehicle is completely stock except for a K&N drop-in air filter. All MPG measurements made so far have been with the factory Michelin Primacy HP tires and 0W-20 synthetic motor oil. Only 91 octane fuel is to be used. Transmission and differential oils have been changed midway through the testing, and the date of the change is noted.

Sources of Error

Driving conditions such as wind, temperature, air oxygen content, incline, speed, traffic, and gasoline quality vary between measurements. However, these factors can be considered random. Thus, provided a sufficient amount of data (more than 20 measurements), the results are normalized and valid.

Furthermore, there may be error when refueling the vehicle. It is unknown if all gas station pumps fill the gasoline tank to the exact same amount every time. This error is small compared the the error from driving conditions.

While the vehicle is not being driven, it is possible that fuel in the gas tank evaporates away. This increases fuel consumption without gaining any miles on the odometer, meaning that an experimentally measured mpg would be lower than the vehicle's calculated mpg.

Preliminary Results

On average, the BRZ's dash reads a MPG measurement of 1.3 higher than the experimentally measured MPG. More data is required to verify this result. Later when I have time, I will determine the confidence of the result.


2-11-16 Update

I decided to start modding my car, so the experiment sorta went off on a tangent.

What I want to do here is provide the community with some data and give an idea of how certain mods might affect mpg. I'm doing this for fun and curiosity; I'm not trying to make statements like "this mod is bad because it decreases mpg". I couldn't care less if I had lower mpg, I want the power and handling from my mods! This isn't a published research paper or evidence for some court case. There are many factors that may affect mpg (temperature, altitude, humidity, road, incline, tire wear, oil wear, fuel quality, etc). I can't control them all or include every possible condition in my sample. Your results will vary.

Here's my updated data table:
https://docs.google.com/spreadsheets...P78/edit#gid=0


Please disregard the attached image, it's outdated but it seems I can't remove it.

extrashaky 05-03-2015 01:35 AM

Quote:

Originally Posted by housecat (Post 2235491)
About the Vehicle Tested

The car driven is a 2014 Subaru BRZ Limited. The vehicle is completely stock except for a K&N drop-in air filter. All MPG measurements made so far have been with the factory Michelin Primacy HP tires and 0W-20 synthetic motor oil. Only 91 octane fuel is to be used. Transmission and differential oils have been changed midway through the testing, and the date of the change is noted.

All this tells you is how your car responds. Results from a sample size of one can't be extrapolated to a population, regardless of how many readings you take. I'm guessing your confidence interval is somewhere around 0%.

Taimaishuuyo 05-03-2015 05:19 AM

Pretty interesting. I wish I get this much. I usually average 19mpg :(

BRZnut 05-03-2015 08:38 AM

I do the same thing and have found the MPG reported by my BRZ runs ~1MPG over what I calculate. On average 28 around town and 40 on long trips.




I am surprise you are not higher with interstate driving. I usually get 39-42 MPG but that is when I drive 600 miles one on day.

Stang70Fastback 05-03-2015 09:15 AM

Quote:

Originally Posted by extrashaky (Post 2235493)
All this tells you is how your car responds. Results from a sample size of one can't be extrapolated to a population, regardless of how many readings you take. I'm guessing your confidence interval is somewhere around 0%.

Well considering I've done the same thing with my car, and after each tank my car also had read exactly 1.5 MPG higher that what I had actually gotten, I think we can confidently say that the on-board computer is slightly on the optimistic side...

gravitylover 05-03-2015 09:49 AM

I've been tracking since I got the car (~15k) and it reads anywhere from 1 - 2.3 over calculated. I use the dash indicated avg just to get a feel for how well I'm doing but certainly don't/can't count on it.

burdickjp 05-03-2015 10:09 AM

I've been using fuelly since I bought my car. Every on board trip computer I've ever compared to has been more optimistic than what fully reports at each fill up.

Quentin 05-03-2015 11:05 AM

BRZ MPG Data Analysis
 
There are a ton of variables that impact this study. How worn are your tires? How accurate is the gas pump? How repeatable is the mechanism that causes the pump to stop from station to station? My read outs are all within 5% or so. That isn't big enough to get wrapped around the axle.

http://i624.photobucket.com/albums/t...psarjjfwzj.png

Sent from Tandy 400

extrashaky 05-03-2015 11:12 AM

Quote:

Originally Posted by Stang70Fastback (Post 2235620)
Well considering I've done the same thing with my car, and after each tank my car also had read exactly 1.5 MPG higher that what I had actually gotten, I think we can confidently say that the on-board computer is slightly on the optimistic side...

Oh, I agree that the computer isn't accurate. I track my mileage using an app on my phone, and what's on the dash is usually about 2.5 to 3 mpg better than what the app calculates. It's very easy to prove the computer's calculation is unreliable.

What I'm saying is that he can't conclude that the computers in BRZs generally record 1.5 mpg higher than reality based on one car and one driver. He can only conclude that that outcome holds for him. If he wants to extrapolate to the entire population, he needs to select a desired confidence interval, calculate an appropriate sample size and test a sample large enough to generalize to the entire population.

How do we know from his experience that other people are not getting a 5 mpg difference? How do we know that some people aren't getting better mileage than the computer suggests?

The biggest concern I would have about relying on his numbers is that some people here have reported some rather low mpg readings from the dash without actually doing the math. I suspect that in at least some of those cases, the error is going the other direction, and they're actually getting better gas mileage than the car is telling them. But if they rely on his analysis, they'll think they're even worse off than they really are, because his analysis is only for his car and isn't applicable to their cars or driving habits.

Despite the quasi-scientific approach, this is still just anecdotal evidence at this point.

travisb 05-03-2015 11:21 AM

I have 14,617.1 miles on my 14 BRZ at the last fill up and 62 tanks of gas. 58 of those were at the same station and the vast majority at the same pump around 6:30am.

The dash indicates 1.17 higher on average than calculating how much it takes to "fill" the tank.

here's a quick summary
miles - 14617.1
gallons - 567.05
avg mpg - 25.78
$/g - $3.1805196
cost- $1,803.52

housecat 05-03-2015 03:56 PM

Thanks everyone for your input so far.

Quote:

Originally Posted by extrashaky (Post 2235493)
All this tells you is how your car responds. Results from a sample size of one can't be extrapolated to a population, regardless of how many readings you take. I'm guessing your confidence interval is somewhere around 0%.

You're right, this is a problem. I was assuming that all 2014 model BRZs mpg calculating system are exactly the same, a reasonable assumption but not necessarily true. How about we just call this thread a case study? The results can be generalized until we find someone who does not share the same result.

Quote:

Originally Posted by Quentin (Post 2235650)
There are a ton of variables that impact this study. How worn are your tires? How accurate is the gas pump? How repeatable is the mechanism that causes the pump to stop from station to station? My read outs are all within 5% or so. That isn't big enough to get wrapped around the axle.

Sent from Tandy 400

That's why I need a large sample size. Error in measurements and change in driving conditions is accounted for as stated in the post. The question I must answer is how much error is acceptable, 5%, 10%?

Quote:

Originally Posted by BRZnut (Post 2235610)
I do the same thing and have found the MPG reported by my BRZ runs ~1MPG over what I calculate. On average 28 around town and 40 on long trips.

I am surprise you are not higher with interstate driving. I usually get 39-42 MPG but that is when I drive 600 miles one on day.

I forgot to include some information about this in the post. The speed on the interstate road I often drive on is 75mph and the road is mostly flat the entire way. The distance is about 175mi one direction. I also have a habit of going WOT on the entrance ramps :) The "mostly interstate driving" measurements may include 10 to 20 city miles.

extrashaky 05-03-2015 05:39 PM

Quote:

Originally Posted by housecat (Post 2235809)
You're right, this is a problem. I was assuming that all 2014 model BRZs mpg calculating system are exactly the same, a reasonable assumption but not necessarily true.

That's not the only assumption you're making. You are also assuming that the error doesn't change with the driver or the type of driving. It could be that these things are exactly accurate for certain drivers and way off for others.

There is also a geographical element. People in different parts of the country are using different fuels. For example, it could be that the computer was calibrated using fuels available in California during the summer months, and during all other times of the year and in different locations the additive package throws off the calculation. You also have the problem that some people live in relatively flat places (like me), while others live in mountainous areas. Altitude will also make a difference, since 91 octane at 5000 feet behaves like 93 octane at sea level.

To do this right, you'd have to control for as many of these variables as possible. Or control for the big ones and then try to explain the outliers.

Quote:

Originally Posted by housecat (Post 2235809)
How about we just call this thread a case study?

That's okay, but...

Quote:

Originally Posted by housecat (Post 2235809)
The results can be generalized until we find someone who does not share the same result.

You already have people in this thread who haven't gotten the same result. Mine consistently says I'm getting 33-34 mpg on the highway, yet my phone app that's doing actual math and not estimating from fuel flow calculates it around 30.3 mpg.

So I still think the only generalization you can make at this point is that we can't rely on the mpg calculation from the car's computer.

Stang70Fastback 05-03-2015 06:47 PM

Quote:

Originally Posted by extrashaky (Post 2235652)
Oh, I agree that the computer isn't accurate. I track my mileage using an app on my phone, and what's on the dash is usually about 2.5 to 3 mpg better than what the app calculates. It's very easy to prove the computer's calculation is unreliable.

What I'm saying is that he can't conclude that the computers in BRZs generally record 1.5 mpg higher than reality based on one car and one driver. He can only conclude that that outcome holds for him. If he wants to extrapolate to the entire population, he needs to select a desired confidence interval, calculate an appropriate sample size and test a sample large enough to generalize to the entire population.

How do we know from his experience that other people are not getting a 5 mpg difference? How do we know that some people aren't getting better mileage than the computer suggests?

The biggest concern I would have about relying on his numbers is that some people here have reported some rather low mpg readings from the dash without actually doing the math. I suspect that in at least some of those cases, the error is going the other direction, and they're actually getting better gas mileage than the car is telling them. But if they rely on his analysis, they'll think they're even worse off than they really are, because his analysis is only for his car and isn't applicable to their cars or driving habits.

Despite the quasi-scientific approach, this is still just anecdotal evidence at this point.

I think you're being unnecessarily anal about this... and this is coming from someone who is very anal about stuff. I'm an Aerospace Engineer. I know all about proper testing and data collection and assumptions and errors, etc... I don't think anyone here was suggesting that their number was a concrete indicator of how every single BRZ on the planet behaves. He was simply stating his numbers that he was collecting for himself as scientifically as possible. I added my numbers. Some people have added theirs. If enough people measure the difference and report back, then we will be able to get an overall idea. That's all we need.

We don't need everyone to go to the same stretch of the same road where we will install a dummy robot which will drive each car the exact same way, but only when the temperature is the exact same, and the wind is exactly the same, and the ground is the exact same temperature, and only after mounting the exact same tires, and taking out all of the extra custom modifications people have made, and re-installed OEM lighting so that the parasitic drag on the engine is the exact same...

...I could continue, but I think we all know that none of our cars is the same, and that none of these tests, no matter how detailed we try to be, are going to account for anywhere NEAR the proper amount of variables that might come into play. However, if enough people do the test over several tanks of gas, we will eventually get a pretty good idea of a general tendency of the on-board computer to over/underestimate fuel consumption.

housecat 05-03-2015 07:36 PM

Quote:

Originally Posted by extrashaky (Post 2235877)
You already have people in this thread who haven't gotten the same result. Mine consistently says I'm getting 33-34 mpg on the highway, yet my phone app that's doing actual math and not estimating from fuel flow calculates it around 30.3 mpg.

So I still think the only generalization you can make at this point is that we can't rely on the mpg calculation from the car's computer.

That's the point. Maybe I wasn't speaking clear enough before and I apologize for that. I'm not testing the mpg and saying this is the mpg every BRZ should get (if that's what it sounded like I said). I'm finding the error between the dash's mpg and the experimentally measured mpg. I believe this error will be consistent regardless whether someone got 25mpg or 40 mpg. Obviously driving conditions will affect both the dash mpg and measured mpg, but I don't think driving conditions will affect the difference between the dash mpg and the measured mpg. The question I am answering is if all BRZ dash mpg readings are always overestimated (except for some outliers), and how much they are overestimated (seemingly about 4%). That answer seems to be obvious given the general consensus in this thread, but here's my experiment with data to prove it. Then my next question would be "is the BRZ wrong or are my measurements wrong?" Maybe the BRZ computer is right but some gasoline in the tank evaporates away while the car is parked.

To make this more interesting I will later use this average mpg data and compare it to my average mpg after changing tires, because I am interested in how tires can affect mpg. I will use a large sample data in attempt to normalize the data so that it can be compared without worrying about all of the variables. There may be issues such as "the new tires received more city driving than the Primacy tires did," or "the new tires were driven during a different season," and that's why I record dates and often take notes about my data. I could sift through the data and pick out only mpg measurements made from mostly interstate driving trips and compare those.

@Stang70Fastback extrashaky's criticism is constructive and good, it will help me perform a better experiment. However, I think there just may have been some miscommunication in what I'm trying to accomplish here.

housecat 05-03-2015 08:10 PM

Quote:

Originally Posted by extrashaky (Post 2235877)
That's not the only assumption you're making. You are also assuming that the error doesn't change with the driver or the type of driving. It could be that these things are exactly accurate for certain drivers and way off for others.

There is also a geographical element. People in different parts of the country are using different fuels. For example, it could be that the computer was calibrated using fuels available in California during the summer months, and during all other times of the year and in different locations the additive package throws off the calculation. You also have the problem that some people live in relatively flat places (like me), while others live in mountainous areas. Altitude will also make a difference, since 91 octane at 5000 feet behaves like 93 octane at sea level.

To do this right, you'd have to control for as many of these variables as possible. Or control for the big ones and then try to explain the outliers.

Ok, disregard my previous reply. I see where we disagree now. I am assuming that the error doesn't change from driver to driver, type of driving to another, fuel type to fuel type, or location to location, and you think this is a bad assumption. However, I think that this is a fair assumption. No one here has falsified this assumption; so far everyone has reported that their dash reads too high for mpg. I'm not saying there doesn't exist a person who's dash reads perfect or actually underestimates, but I don't know of one yet. It would help if I could find some information about how the BRZ calculates its mpg. Fuel type and driving conditions might not make a difference, maybe the computer just polls how much fuel is currently being consumed and how fast the vehicle is moving.

It will take a bigger experiment to figure out why the dash is reading higher than expected. Maybe the source of error is that the mpg measurements are made discretely and not often enough, resulting in an overestimated approximation. Sort of like approximating the area under a curve numerically and not using a small enough dx (change in x). The experiment I am performing now is to conclude with evidence that the dash reads higher than expected.

superleggera 05-04-2015 10:11 PM

that is pretty similar as to my results. Out of 42 fillups, my brz is reading on average 1.73 mpg higher than actual. the highest was 3.1 higher, lowest was 0.68 higher.

ArgentoAtl 05-21-2015 03:54 PM

5% optimistic
 
I have been recording my fuel usage since I got my 2013 FRS and have not reset my avg mpg indicator yet, afaik. For about 70 fill ups I have averaged 5% lower real mileage than the average mpg readout on the car, with about 2/3 of my driving on highways.

Thanks for suggesting this comparison, OP.

Brian in Atlanta

housecat 02-11-2016 07:26 PM

I've uploaded a lot more mpg data here https://docs.google.com/spreadsheets...P78/edit#gid=0

I started taking notes about what kind of driving I was doing, where I refilled with fuel, what kind of fuel I filled with.

The avg OEM mpg is the average mpg I got on petrol, stock tires, stock everything except air filter. The avg e85 stg2 mpg is the average mpg I got on e85, stock tires, stock everything except air filter, OFH and OFT stg2 tune. The avg stg2 mpg is the same thing but on a 91oct tune.

swarb 02-11-2016 07:49 PM

Too many variables.
Transmission.
Type of driving.
Air pressure in tires.
Driver.
Location.
Fuel matters.
Here is my fuelly http://www.fuelly.com/driver/swarbrz
I gave up after a few tanks of e85 as the website uses current fill up to calculate costs, and previous fuel to calculate mpg, which throws some metrics off.
I was right around 28mpg 90% highway at 80mph on 91octane manual transmission.

boxerfan 02-12-2016 01:18 AM

BRZ MPG Data Analysis
 
Am guessing the car computer excludes stationary idling fuel consumption; therefore the average will read better overall.


Sent from my iPhone using Tapatalk

WillTL 02-12-2016 07:57 AM

Hi all, UK owner here and from my experience, I can confirm that the dash always shows a higher figure than the actual mpg. This isn't just the BRZ that does this, but pretty much all cars. If you have a sat nav that shows your actual speed, you will see that you are also driving slower than the car reports.

As an example, a display from the car of 70mph is actually only 66mph.

As for fueling, a UK gallon is slightly bigger than a US gallon (something like 1 UK gallon = 1.2 US gallons) so my mpg figure is going to show slightly higher than what you can achieve in your cars.

The BRZ manufacturer's figures show that an extra urban figure of 44.1mpg is achievable and in most cases, you can never achieve what the manufacturer's figures show because the test is carried out in perfect conditions (e.g. exactly one gallon of fuel, no extra passengers or weight). In a recent 440 miles journey which I completed on one tank of fuel, the car reported a 47.3mpg return, but the actual was only 45.4 meaning that the car's figures are 4.2% out.

This is slightly disappointing, but I was very pleased I was able to beat the manufacturer's figures. :thumbup:

Dadhawk 02-12-2016 09:06 AM

I've been tracking mine in my Owner's Journal Post 1 since I purchased the car (6AT) in 05/2012.

Results so far:

77,057 miles. 198 Fuel Stops.
Average Mileage Overall (Calculated): 32.72MPG
Average Mileage Overall (Computer): 33.80MPG
Average Fuel Cost $0.10 per mile.
Best Average: 36.6MPG (All Highway)
Worst Average: 27.6MPG (About 50% stop and go city)

Most of my travels is commuting which sees an average speed of around 45MPH.

With the original Primacy tires I averaged 32.65MPG (around 62,000 miles). Surprisingly, once I switched to Bridgestone Ecopia all-season tires (@15,000 miles) I've average 33.40MPG.

I've also "saved" $5,184 and 1,655 gallons of fuel over my previous daily driver that averaged around 18MPG even when adjusting for the difference in regular vs premium fuel.

Mim 02-12-2016 09:24 AM

Quote:

Originally Posted by boxerfan (Post 2544957)
Am guessing the car computer excludes stationary idling fuel consumption; therefore the average will read better overall.


Sent from my iPhone using Tapatalk

I only live 11km from work and used to let the car warm right up when I first started driving it a year back. My fuel economy back then was pretty terrible vs now when I simply wait for the rpms to settle down to around the 700rpm mark then drive off.

Pretty sure the lengthy idling during warm up was / is being calculated by the onboard average fuel consumption metrics.

Tcoat 02-12-2016 09:37 AM

Quote:

Originally Posted by Mim (Post 2545144)
I only live 11km from work and used to let the car warm right up when I first started driving it a year back. My fuel economy back then was pretty terrible vs now when I simply wait for the rpms to settle down to around the 700rpm mark then drive off.

Pretty sure the lengthy idling during warm up was / is being calculated by the onboard average fuel consumption metrics.

Same here.
Last winter was cold and snowy so mine sat long enough for the defroster to melt some ice. I averaged (by computer) 7.3 liters per 100 kilometers (32 mpg). This year it has bee almost ice and snow free so I jump in let it drop from high idle and drive off and have averaged 6.8 L/100Kms (34 mpg) . My driving is very regular and my average MPG does not waver one little bit so the only difference between the two is how long the car sat idling last winter.
The 6.8 figure is also my summer average when the car never idled past high and has not moved from that number since last April.

Dadhawk 02-12-2016 10:44 AM

Quote:

Originally Posted by Mim (Post 2545144)
..Pretty sure the lengthy idling during warm up was / is being calculated by the onboard average fuel consumption metrics.

Idling would definitely impact your mileage, but that would be the case regardless of whether the computer is doing it or you do it manually.

Tcoat 02-12-2016 10:51 AM

Quote:

Originally Posted by Dadhawk (Post 2545196)
Idling would definitely impact your mileage, but that would be the case regardless of whether the computer is doing it or you do it manually.

Imagine the mileage if you filled up, drove one mile and then let it run until empty! Wouldn't matter if the computer calculated it or you did, it would be atrocious.

Dadhawk 02-12-2016 11:20 AM

Quote:

Originally Posted by Tcoat (Post 2545204)
Imagine the mileage if you filled up, drove one mile and then let it run until empty! Wouldn't matter if the computer calculated it or you did, it would be atrocious.

Assuming you filled the tank to exact capacity (13 GAL), then drive exactly one mile, it would be 0.076923...MPG

Practically though, you would most likely be marginally worse than that because fuel capacity does not normally take into account the fuel filler so you would burn slightly more that 13GAL. Also, I'm not sure if capacity is listed in USABLE fuel or overall capacity when talking cars.

Tcoat 02-12-2016 11:27 AM

Quote:

Originally Posted by Dadhawk (Post 2545231)
Assuming you filled the tank to exact capacity (13 GAL), then drive exactly one mile, it would be 0.076923...MPG

Practically though, you would most likely be marginally worse than that because fuel capacity does not normally take into account the fuel filler so you would burn slightly more that 13GAL. Also, I'm not sure if capacity is listed in USABLE fuel or overall capacity when talking cars.

I was too lazy to do the math so at this point you are 100% more ambitious than I.

Stang70Fastback 02-14-2016 07:42 PM

If you are doing rolling measurements strung along several back-to-back fill-ups, the errors resulting from discrepancies in the exact amount of fuel you put in pretty much approach zero, though. So luckily you don't have to worry about those errors in your calculations.

extrashaky 02-14-2016 09:19 PM

Quote:

Originally Posted by Dadhawk (Post 2545231)
Assuming you filled the tank to exact capacity (13 GAL), then drive exactly one mile, it would be 0.076923...MPG

Practically though, you would most likely be marginally worse than that because fuel capacity does not normally take into account the fuel filler so you would burn slightly more that 13GAL. Also, I'm not sure if capacity is listed in USABLE fuel or overall capacity when talking cars.

The tank is 13 gallons. Only 12.5 is usable fuel. The tank has a 1/2 gallon area that is not accessible so that sediment and water will not be taken up into the fuel line.

Just FYI.

Stang70Fastback 02-14-2016 09:32 PM

I've filled up with 12.3 gallons on a road trip. That was without forcing any fuel in after it clicked, lol. If what you say is true, then that was a close call, lol (I was looking for NOT Sunoco and that was all they had along the highway, lol.)


All times are GMT -4. The time now is 12:13 PM.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
User Alert System provided by Advanced User Tagging v3.3.0 (Lite) - vBulletin Mods & Addons Copyright © 2026 DragonByte Technologies Ltd.


Garage vBulletin Plugins by Drive Thru Online, Inc.