Importing Historical Data Issue

[NinjaTrader_JoshP]

adamus,

The trace files are located at Documents\NinjaTrader 7\trace. Log files are different.

For the HDM, the data is not stored in the database so it should not be an issue. If you have gigabytes of data it may be an overload of nodes it needs to create that is why it is taking so long. Each tick would be a row and that is many many many rows to show in many many nodes.

[adamus]

Uh-huh. Makes sense.

Well, there was nothing in the trace file either, so the cause of that blue-screen-of-death will remain a mystery.

[adamus]

Josh, in the HDM on the Edit tab, I thought it showed an overview of what dates there were for the data, on the right-hand side. I can't see that anymore.

[NinjaTrader_Austin]

adamus, it does show the dates, but on the left side.

[adamus]

Thanks for the info but that way of checking the content of a symbol's history is extremely slow

Is there any place where I can check what tick data dates are in the database without going down into that Tick node, which takes such a long time to display?

Secondly I'd like to know how to determine what timezone the ticks' timestamps use. I couldn't see it when I looked.

Thanks v much

[NinjaTrader_Bertrand]

adamus, unfortunately you would need to lock into the specific nodes. The data would be stored in your local setup PC timezone.

[adamus]

The data would be stored in your local setup PC timezone.

OK - but (and you're probably thinking I'm turning into a difficult character here) I am planning on moving to Berlin next year (different timezone from London). How would I deal with that?

[NinjaTrader_JoshP]

adamus,

Unfortunately the data you have is all stored with your current timezone. When you move you will need to convert all of it to your new timezone. This would likely require you to export all the data and open it in Excel to modify everything to reflect your new timezone times, then reimport it. Alternatively, you could just redownload the data from your data provider and that will provide it to you in your new timezone.

If you want all the data to just be stored in your Berlin timezone now, you could switch your PC clock to Berlin time to make that adjustment for data going forward from this date. Old data would still require the options provided above.

[adamus]

I see. Thanks for the explanation.

To facilitate the whole operation of changing all data, it would be fantastic if I could access the data in NinjaTrader via a database driver such as ODBC or JDBC, and that would make the whole process a lot faster.

If that is not already in the pipeline, could you put it on the Feature Requests list?

Thanks

[NinjaTrader_JoshP]

Thank you for the suggestion. I have added it to our list.

[Style]

I'm having an issue where the data I import shows up in the charts one day off. For example, I import the following five rows:

20100405;0.91220000;0.91550000;0.91180000;0.913800 00;29262
20100406;0.91410000;0.92170000;0.90950000;0.920300 00;97294
20100407;0.92050000;0.92280000;0.91790000;0.921200 00;78128
20100408;0.91980000;0.92240000;0.91560000;0.922200 00;67562
20100409;0.92210000;0.92800000;0.92000000;0.925400 00;68647

When I bring up the chart, the above 5 days are listed under 4/4/2010 through 4/8/2010. With NT 6.5, the dates are correct. What gives?

Thanks,
Style

I installed beta 16, and now this issue has returned.

In addition, it's not just imported historical data with wacky dates. I tried connecting to yahoo and IB. For both data providers, and for a variety of different instruments, when I bring up a daily chart, last weeks bars are listed with the dates 5/25 through 5/29, instead of 5/24 through 5/28.

Please advise.

Thanks!

[Style]

It looks like the instruments I create in instrument manager are having this issue. The price data they get from the data providers is accurate, but the dates are shifted one day forward. I do not experience this same anomaly with the default instruments that come with NT7.

Note I do not have this same issue in NT6. I've not actually created new instruments in NT7. These instruments were created in NT6, and made their way to NT7 when I upgraded.

Any help you can give will be greatly appreciated. Please advise.

EDIT:

I created a new instrument in NT7, to test if this was a relic from instruments created in NT6. No dice. I'm still seeing the issue with instruments created in NT7. What am I doing wrong?

[NinjaTrader_Bertrand]

Style, I'll try to reproduce this here but so far have not seen similiar issues - did you change anything in your timezone setup on this PC where it occurs? Would the issue persist if you delete downloaded data, clear the cache under the DB folder and then redownload a complete fresh set of data for the symbols in question?

Thanks

[Style]

Style, I'll try to reproduce this here but so far have not seen similiar issues - did you change anything in your timezone setup on this PC where it occurs? Would the issue persist if you delete downloaded data, clear the cache under the DB folder and then redownload a complete fresh set of data for the symbols in question?

Thanks

I've not touched the timezone on my PC in 6 weeks.

I've deleted the historical data with no success. I'm unsure how to clear cache. Where is the DB folder? Regardless, I've created new instruments that have no historical data stored in the database or cache, and still see the issue.

[NinjaTrader_Jason]

Hello Style,

Please see my response to the email you sent us to provide us screenshots of one of these instruments.