Opening charts often fails to load all data, showing gaps

[NinjaTrader_Bertrand]

adamus, current we have this not logged and I'm not aware of similiar consistent reports that see it happen. What I would need to do this step is a setup that would reproduce the cache corruption so I could forward to my developers for review of the scenario.

[adamus]

How about I forward you my whole workspace and indicator setup? You'd be able to see overnight if it happens on your machine too.

[NinjaTrader_Bertrand]

Sure adamus that would be great - to be sure in understanding, the gap was seen visually on your charts today?

[adamus]

No it was a gap in the secondary data series.

[NinjaTrader_Bertrand]

Sorry, then you lost me - as per our prior communications on the topic - this would be actually expected, since it would not be reloaded per NT's data loading rules. There will be improvement in this regard in our next major update.

[adamus]

Thanks adamus - correct the reload should update all windows where the symbol is used. The loading will happen according the loading rules specified in the helpguide under 'when does NT load data' - this is for your primary / charted series though not for the programmatically added series, if you wish to trigger a reload for those as well either use the Historical Data Manager to Reload All active charts, or work off one true MultiSeries chart where the series is visually present as you trigger the Reload. My comment dones via email still stands in the sense that our next major upgrade will have an enhanced handling here and will allow for more options geared to developers.

OK I re-read what you said and I see why I misunderstood you. What is a bit frustrating is that I have the instrument with the same time-frame loaded as the primary series in a different chart window, and in another chart window for the same instrument that uses the same indicator, so I know the bars are present, but Ninja can't access it in the indicator on the other chart where the same instrument & time-frame is the secondary series!

[adamus]

Hi Bertrand,
I think this is a valid example.

This morning I deleted the cache and started Ninja but I got a gap on both the secondary 60min bars in my indicator on my 3-min chart, and also the gap appeared on the 60min chart, i.e. the primary bars.

Strangely the gap did not appear in the 60-min tertiary bars in either of the indicators on the 3-min and 1-min charts. By 'tertiary' , I mean the bars I loaded programmatically using the GetBars() API call.

here's the smoking gun:

[NinjaTrader_Bertrand]

adamus, thanks for posting this scenario - how did you clear out the gap then, by triggering a manual reload of the data? If see this happen without any custom indicator or the GetBars call added please let me know and forward me the exact setup used to our support email (support at ninjatrader dot com) so we can attempt to 'hit' it and include as testing scenario for our next major upgrade of the platform.

[adamus]

Hi Bertrand,

I connected to Interactive Brokers and the automated load of all charts and indicators filled the gap.

Is there a specific scenario you want me to test without my indicator? I use it otherwise 100% of the time.

[adamus]

I've just been trying out the market replay and when I start it for Friday, it always starts up with a gap of about 3 hours.

I recorded it all on Friday from 6:45 or so until the close. I have all the data in the HDM too.

When I start up the market replay connection, the chart stops at 4:00, and the next tick is the first of the market replay data at 6:48.

I deleted the cache beforehand.

I'm not using my indicator for this, so it's just one naked 3-min chart.

[NinjaTrader_Bertrand]

adamus, can you please send me your files from the documents folder that would let me chase this replay setup you have witnessed?

Namely I would need the workspace, HDM files, MR data recorded and your exact cache for the session template used.

Thanks for the assist chasing this hopefully down and arriving at a clean setup to forward to development for testing in our next major version.

[adamus]

Are you just telling me which tick boxes on the 'email to support' dialog to choose, or do you want me to zip up some other stuff too?

I deleted the cache before I started Ninja to run the MR when I got that gap. Does that change anything?

[NinjaTrader_Bertrand]

Either way to send in would be fine adamus, as long as I have the exact MR / HDM data and workpaces to use and see if we can reproduce it.

[adamus]

OK, you'll have to tell me where to find the MR data.

Also, will an export of the $EURUSD data be alright? My database directory is about 8Gb so not easy to send.

[NinjaTrader_Bertrand]

MR data is stored under Documents\NinjaTrader 7\db\data for each day you recorded / downloaded.

If the EURUSD chart is the one with the gap issue, yes then that's what I would need.