Toyota GR86, 86, FR-S and Subaru BRZ Forum & Owners Community - FT86CLUB

Toyota GR86, 86, FR-S and Subaru BRZ Forum & Owners Community - FT86CLUB (https://www.ft86club.com/forums/index.php)
-   Software Tuning (https://www.ft86club.com/forums/forumdisplay.php?f=88)
-   -   Now Available: OpenFlash Datalog Viewer and DataZap! (https://www.ft86club.com/forums/showthread.php?t=51903)

Shiv@Openflash 11-21-2013 08:42 PM

Now Available: OpenFlash Datalog Viewer and DataZap!
 
OpenFlash Datalog Viewer
http://i85.photobucket.com/albums/k4...alogviewer.jpg
As of this morning, the OpenFlash Tablet is now capable of storing datalog files in it's on-board memory (just plug your OFT into your laptop and run the OpenFlash Manager application with WIFI available and let it auto update). This means that you can record data (up to an hour) and then connect to your laptop (through OpenFlash Manager) and download the data file in .CSV format. The nice thing about .CSV format is that it an be viewed in many popular applications such as Excel, Numbers, etc,. While recording data, you can also view it realtime on the OFT screen in numerical or scrolling graphical format.

But now, the datalog file can also be viewed in our own Datalog Viewing software which is (now available for download from our website)

This is a very useful tool when it comes to confirming that the tune you are running is properly matched to your car's hardware. It also is a valuable tuning tool when it comes to squeezing every last hp out of your car safety. Here's a video tutorial we made a few months back show how easy this is to use:

[ame]http://youtu.be/wlEfyKIlWdg[/ame]

Please Note: This video was created primarily for our BMW OFT customers but it applies equally to our GT86 OFT customers. The only difference is that the GT86 doesn't have the in-dash boost gauge feature so you can ignore that part (for now) :)

DataZap
http://i85.photobucket.com/albums/k4...azap-chart.png
Another extremely popular and very user-friendly datalog analyzing tool was made by one of our long time customers (who will soon join in in this discussion after his account is active). It is called datazap and you can use it by going to www.datazap.me. It's used extensively by BMW customers and now it can be used by our FRS/BRZ customers. It accepts OFT datalog files and allows you to create and share interactive datalog graphs. It's quite spectacular and free (although I hope anyone who likes it will donate something to him considering the amount of work he continues to pour into this online application).

I hope you guys enjoy the direction we are going with OFT functionality. We still have a lot more to do and will have some more exciting news over the next few days!

Cheers,
Shiv

jamesm 11-21-2013 09:19 PM

that datazap site is awesome :).

jpsimon 11-21-2013 09:51 PM

Quote:

Originally Posted by jamesm (Post 1345902)
that datazap site is awesome :).

Thanks! :cheers:

What's up guys! I'm the one who made datazap. I hope you guys like it, I tried to make it as easy as possible to use.

There's a help screen that documents some of the features, but since I've found that no one likes to read those things, I'll explain a few of the things here:

Here's an example data log to play with: http://datazap.me/u/jpsimon/3rd-4th-gear-pull

- Click + drag to zoom in on a portion of the chart

- As you turn on/off sets of data, you'll notice the URL changes. If you want to link someone to your datalog with specific data showing, just copy the full URL once you have whatever data you want to share visible. When the person goes to the link those bits of data will load by default.


- Once uploaded, your datalogs are saved on your main profile page for reference.
- You can re-download the raw .csv from there (or on the chart page itself)
- You can search/filter the data logs list
- You can favorite datalogs and users. Those favorites are seen only by you on your profile page

Coming soon: multi-log upload

Let me know if you guys have any questions/feature requests.

jeebus 11-21-2013 10:21 PM

Every day I am further impressed by the quality of work that Vishnu puts out

3essess 11-21-2013 11:51 PM

Thanks to Shiv and Company - I bought the OFT over 2 months ago in September based on the promise of data logging "coming soon" along with the basic tunes that were available at that time. I can say that as of today, I'm 100% satisfied with the OFT, its capabilities, the free tunes, and for support through programs like TunerPro, OF DataLogger and now DataZap! For the price and the flexibility OFT offers, I say 2 thumbs up!

Oh yeah...all that above...not to even mention the upcoming UEL header that will be available soon too!

SloS14 11-22-2013 07:33 AM

That's enough .js to kill a horse. Nice!

jeebus 11-22-2013 11:35 AM

I can confirm to all users like me...did a nice long log this morning (45 mins or so). Connected to PC, ran OpenFlash, read and exported log all fine and dandy.

Excellent work!

krulux 11-22-2013 12:42 PM

Ditto jeebus... not 45min but 20min...

OFT data logging works fantastic!!!

Great job :D Vishnu team!

jpsimon 11-22-2013 01:28 PM

btw, if you try to upload a 45 minute long log to my site it probably won't work. It's designed for more reasonable logs. The library used to parse and convert the data will timeout on a super massive log.

jeebus 11-22-2013 01:36 PM

Quote:

Originally Posted by jpsimon (Post 1347159)
btw, if you try to upload a 45 minute long log to my site it probably won't work. It's designed for more reasonable logs. The library used to parse and convert the data will timeout on a super massive log.

Yeah, I wouldn't even try something this big for graphing purposes. If your site can't handle logs that big, you might want to incorporate a row count into your program routine that maxes lower so you don't spike your host's cpu and get the ban.

SloS14 11-22-2013 01:46 PM

Quote:

Originally Posted by jeebus (Post 1347181)
Yeah, I wouldn't even try something this big for graphing purposes. If your site can't handle logs that big, you might want to incorporate a row count into your program routine that maxes lower so you don't spike your host's cpu and get the ban.

or the ability to load specific portions

45 minute log file
-load 1-5
-load 5-10
-load 10-15
. . . . . . . . .

SpeedyJay 11-22-2013 03:56 PM

This is what I was waiting for, well done.

jamesm 11-22-2013 04:25 PM

we use highstock (same library used here, i believe) to render datasets much, much larger than any log file could ever possibly be. the issue must be in your csv parser, probably not well optimized and just tries to parse a whole csv in memory at once, which is quite common. is this an open source project you accept pr's on?

jpsimon 11-25-2013 10:24 AM

Quote:

Originally Posted by jamesm (Post 1347601)
we use highstock (same library used here, i believe) to render datasets much, much larger than any log file could ever possibly be. the issue must be in your csv parser, probably not well optimized and just tries to parse a whole csv in memory at once, which is quite common. is this an open source project you accept pr's on?

yeah, I've done larger datasets before but not in crappy CSV format that requires extra processing. I'm doing some processing/conversion when you first upload the CSV using a php library to help normalize the different types of CSV's. Then there's some more processing that gets done on the javascript side at runtime. It could definitely be optimized, but it works as well as I initially was hoping for.

This started off as a random project to use for myself, then I said "might as well make it for everyone". I'm going to keep on adding in the little features like multi-log upload and stuff like that in the short term. I'm working on another much bigger project that you guys will love that is taking up a bunch of my time so a complete full optimization-rewrite won't be happening just yet.

jamesm 11-25-2013 10:46 AM

Quote:

Originally Posted by jpsimon (Post 1351477)
yeah, I've done larger datasets before but not in crappy CSV format that requires extra processing. I'm doing some processing/conversion when you first upload the CSV using a php library to help normalize the different types of CSV's. Then there's some more processing that gets done on the javascript side at runtime. It could definitely be optimized, but it works as well as I initially was hoping for.

This started off as a random project to use for myself, then I said "might as well make it for everyone". I'm going to keep on adding in the little features like multi-log upload and stuff like that in the short term. I'm working on another much bigger project that you guys will love that is taking up a bunch of my time so a complete full optimization-rewrite won't be happening just yet.

awesome.. if you ever open it up to contributions let me know i'd love to help. i'm working on some kinda-sort-of related stuff for ruby (parser for all common 86 log formats, abstraction layer for parsing/modifying roms, tuning tools, etc). i don't do php though :).

jpsimon 11-25-2013 02:08 PM

i'll keep you updated!

Td-d 11-25-2013 02:23 PM

Slightly OT, but if you really want to crunch huge logs, nothing beats Matlab. What takes Excel literally hours, it can do in seconds.

zc06_kisstherain 11-25-2013 02:42 PM

great to have data logging capability now.

hmong337 11-25-2013 02:56 PM

This product gets sweeter with every passing moment. I want one so bad but with Christmas around the corner, I can't swing it. I will have one of these before I track the FRS next season though. Too scared to run the stock tune at the track for fear of DI seals melting up.

Any more developements you guys at Vishnu plan on adding?

tonylop33 11-26-2013 12:54 AM

4 Attachment(s)
Quote:

Originally Posted by shiv@vishnu (Post 1345822)

http://youtu.be/wlEfyKIlWdg

Please Note: This video was created primarily for our BMW OFT customers but it applies equally to our GT86 OFT customers. The only difference is that the GT86 doesn't have the in-dash boost gauge feature so you can ignore that part (for now) :)

Cheers,
Shiv

@Shiv,
When I open up the OpenFlash Data Viewer, I do not have anything displayed on the area where you show the graphs and data. If I select "load data" I get the info on the left half of the screen. Then I can select a field (say Engine Speed) it gives me options to display that field in View 1-6. Maybe the pictures explain this better.

How do I get it to display like your view in the video?

solidONE 11-26-2013 12:20 PM

Hi Shiv,

I just updated the OFT before trying to record a log with the new parameters added. When I go to data logging to read the new log OFT manager program freezes. Please advise.

Shiv@Openflash 11-26-2013 12:23 PM

Quote:

Originally Posted by solidONE (Post 1354175)
Hi Shiv,

I just updated the OFT before trying to record a log with the new parameters added. When I go to data logging to read the new log OFT manager program freezes. Please advise.

Yes I just found this issue last night on the dyno. Looks like the programmers introduced a bug when adding MAF v logging. The OFT logs to on-board memory correctly but the user software locks up when trying to download the data. We should have this fixed within 24hrs. Sorry I didn't catch this earlier when we made the last update public :/

tonylop33 11-26-2013 01:30 PM

Shiv,
did you get a chance to look at my Data Logger question/issue (three posts back)?

tonylop33 11-27-2013 01:45 AM

Sunday when I did some logging for the first time the Adv Multiplier ranged from 1 to .76. I am stock running stage 1 (1.34b). Today the Adv Multiplier started at .58 during a short drive did not change. Then on the drive back started at .58 and ended at .74. Shouldn't it be closer to 1?

I can't download the most recent log...I think that is the problem you described a couple of posts back.

Shiv@Openflash 11-27-2013 05:08 AM

Quote:

Originally Posted by tonylop33 (Post 1355884)
Sunday when I did some logging for the first time the Adv Multiplier ranged from 1 to .76. I am stock running stage 1 (1.34b). Today the Adv Multiplier started at .58 during a short drive did not change. Then on the drive back started at .58 and ended at .74. Shouldn't it be closer to 1?

I can't download the most recent log...I think that is the problem you described a couple of posts back.

It's perfectly normal for the ignition advance multiplier to move around. Especially when running the 91oct we get in CA. So I wouldn't expect it to say at 1.0 by any means. Also, we are still in the process of fixing a bug with downloading the data file from the OFT to the laptop. It was accidentally introduced with yesterday morning's auto update and slipped past me.

Kodename47 11-27-2013 05:44 AM

Quote:

Originally Posted by tonylop33 (Post 1355884)
Sunday when I did some logging for the first time the Adv Multiplier ranged from 1 to .76. I am stock running stage 1 (1.34b). Today the Adv Multiplier started at .58 during a short drive did not change. Then on the drive back started at .58 and ended at .74. Shouldn't it be closer to 1?

I can't download the most recent log...I think that is the problem you described a couple of posts back.

The AM will only start to increase under certain circumstances. Normal part throttle driving wont do much to help it, I believe it's a load calculation but I can't remember on the top of my head what it is. Some good info:

http://www.scoobypedia.co.uk/index.p...ategyExplained

http://www.scoobypedia.co.uk/index.p...tLearningTrick

Shad0ez 12-07-2013 05:31 PM

Hi all, gotta say I am in LOVE with what the OFT has transformed my FR-S into :)

Just got back @Cross 's house and got my E85 tune, Injen intake and Perrin LCP all set up. Thanks Cross for the support :)

All I can say is coming from just a cat back exhaust is OMG :thumbup::thanks:

After about 15 miles of letting the E85 work its way in, I got some nice WOT pulls on the onramp to the 10 and wow! I was already up to about 90 before even getting on the 10 so I had to let off due to merging into traffic.

I took 87 on the way back to San Tan which is a good 10 miles or so of straight away. I was able to get about 4 or 5 good WOT pulls in on 3rd and 4th gear and just love the way it feels.

I'll be posting my day 1 log to see if there are any issues (I don't fully understand how to interpret everything yet) but damn the pull on WOT feels sooo damn good. :burnrubber:

Hopefully the log shows that everything is where it should be since it's technically a stage 2 E85 tune (header back exhaust) and I'm only running an intake and a cat back. At the end of the day though, completely happy with the OFT and would highly recommend it to anyone looking at tuning options :thumbup:

With that said, can someone advise how to upload a prolog file on datazap?

Rombinhood@OpenFlash 12-07-2013 06:20 PM

Quote:

Originally Posted by Shad0ez (Post 1375369)
Hi all, gotta say I am in LOVE with what the OFT has transformed my FR-S into :)

Just got back @Cross 's house and got my E85 tune, Injen intake and Perrin LCP all set up. Thanks Cross for the support :)

All I can say is coming from just a cat back exhaust is OMG :thumbup::thanks:

After about 15 miles of letting the E85 work its way in, I got some nice WOT pulls on the onramp to the 10 and wow! I was already up to about 90 before even getting on the 10 so I had to let off due to merging into traffic.

I took 87 on the way back to San Tan which is a good 10 miles or so of straight away. I was able to get about 4 or 5 good WOT pulls in on 3rd and 4th gear and just love the way it feels.

I'll be posting my day 1 log to see if there are any issues (I don't fully understand how to interpret everything yet) but damn the pull on WOT feels sooo damn good. :burnrubber:

Hopefully the log shows that everything is where it should be since it's technically a stage 2 E85 tune (header back exhaust) and I'm only running an intake and a cat back. At the end of the day though, completely happy with the OFT and would highly recommend it to anyone looking at tuning options :thumbup:

With that said, can someone advise how to upload a prolog file on datazap?

Great to hear more success stories. Thanks for the recommendation :)

TM 12-07-2013 08:04 PM

Quote:

Originally Posted by shiv@vishnu (Post 1356004)
Also, we are still in the process of fixing a bug with downloading the data file from the OFT to the laptop. It was accidentally introduced with yesterday morning's auto update and slipped past me.

Has this issue been addressed yet? I just tried to read my data log from the open flash manager and it always freeze up.

Edit: Nevermind, I was on 1.03. Just updated to 1.04 and it worked perfectly.

Rombinhood@OpenFlash 12-07-2013 08:22 PM

Quote:

Originally Posted by TM (Post 1375553)
Has this issue been addressed yet? I just tried to read my data log from the open flash manager and it always freeze up.

Edit: Nevermind, I was on 1.03. Just updated to 1.04 and it worked perfectly.

:thumbsup:

eddieflyinv 10-19-2014 12:38 AM

any way to convert prolog to csv ?
i know if you read a log in openflash manager you can export and save as csv, but i failed to do that on one of my logs, rather than relogging that data, can i convert my prolog to csv somehow ? the log has been overwritten on the OFT so i cant read it from there to save as csv anymore..

steve99 10-19-2014 02:29 AM

Quote:

Originally Posted by eddieflyinv (Post 1989571)
any way to convert prolog to csv ?
i know if you read a log in openflash manager you can export and save as csv, but i failed to do that on one of my logs, rather than relogging that data, can i convert my prolog to csv somehow ? the log has been overwritten on the OFT so i cant read it from there to save as csv anymore..

open the log in ecxel then "save as" and select csv as file type

Wayno 10-20-2014 04:14 AM

That's the device system log, not the data log.

eddieflyinv 10-29-2014 07:46 PM

i ended up just relogging everything, nbd lol gave me an excuse to drive around late at night in a loud and obnoxious fashion

BadHabit 12-30-2014 11:09 PM

Attempting to open the .prolog file in excel and no dice. Coming through as unreadable characters. Am I missing something? Thanks.

steve99 12-31-2014 07:26 AM

Quote:

Originally Posted by BadHabit (Post 2073122)
Attempting to open the .prolog file in excel and no dice. Coming through as unreadable characters. Am I missing something? Thanks.

your looking at the wrong file , prolog file is the propriety log file for the openflash tablet not the datalog for your car.

go to data log file option.

BadHabit 12-31-2014 05:59 PM

Got it. Was just figuring it was under Download LOG in OFM main menu before looking under Data Logging. Thank you!


All times are GMT -4. The time now is 11:58 AM.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
User Alert System provided by Advanced User Tagging v3.3.0 (Lite) - vBulletin Mods & Addons Copyright © 2026 DragonByte Technologies Ltd.


Garage vBulletin Plugins by Drive Thru Online, Inc.