Historical Data Manager

[Harry]

And the culprit is.......

I now have loaded a default chart (5 min, 65 days lookback) for USDCAD.
No indicators. Nothing connected. Just a single simple default chart with instrument settings.

Editing via historical data manager shows that all data is correctly loaded.

All curencies show the same behaviour. Maybe related to the session manager. Could well be that the bug is depending on loading time.

See chart below.

Problem is not linked to loading of daily bars or connected charts.

[NinjaTrader_Dierk]

Could you please try this:
- close all charts etc.. only have control center opened
- shut down NT
- start NT
- open again chart on USDCAD 5min, no template, all default

Problem still there?

If this is the case:
- close all charts etc.
- shut down NT
- manually delete the directory <my documents>/NinjaTrader7/db/cache
- start NT
- open again chart on USDCAD 5min, no template, all default

Problem still there?

Please try to follow directions as close as possible. Thanks in advance

[Harry]

Hi Dierk,

thanks for answering. The problem only occurs, when a chart is open at the same time that data is loaded.

(1) If opening a second or third identical chart -> Chart is correct.

(2) When loading other chart templates for the false chart -> Chart remains false.

(3) When toggling to another instrument and then back to the instrument that created the problem -> False chart becomes correct.

(4) When shutting down NinjaTrader and restarting it -> Chart is correct.

[NinjaTrader_Dierk]

I really would appreciate if you could go through steps below and let me know if the issue persists. Thanks

[Harry]

Dierk, went exactly through the steps.

CC connected, opened one chart, all default, no template. Toggled through different instruments to find a data gap. All instruments correctly displayed. Exception EURGBP, see screenshot below.

Deleting the cache did not change anything.

However, this time the situation was different, as there was no data, when editing the data base via Historical Data Manager.

Problem solved via reloading of historical chart data.

[NinjaTrader_Dierk]

Thanks. So we know it's not the cached data and we're still in the hunt for a reproducible scenario.

[Harry]

Exactly, this was a different case.

Thanks. So we know it's not the cached data and we're still in the hunt for a reproducible scenario.

[Harry]

Again data gaps

So here comes a new case. Shut down NinjaTrader earlier today at 17:38 and then connected again at 22:42.

When connecting I had a workspace loaded with 5 charts (1min, 5 min, 30 min, daily of ES and a 1 min tick chart). The 4 ES charts were all connected to the DOM.

While 1 min, 30 min and daily chart were correclty loaded, the 5 min chart showed a gap. Changing the template of the chart did not remove the gap. The gap exactly covers the period during which I was not connected.

To reproduce I then toggled the 5 min chart (1 min, 30 min and daily be connected via color code) to YM and YM also showed the gap. Again I could change the chart template, and the gap remained.

Toggling to ES and YM back a second time removed the gaps. Toggling to 6E did not produce any gap, so it is not always, but only sometimes that the data loading is too slow and NT takes the data from the cache to build the chart before it can catch the new data.

I also had pivots on all my charts, maybe this had an impact on the result.

[NinjaTrader_JoshP]

Please find attached.

Using European time zone and your session template I loaded up earlier in the day, disconnected, waited 3-4 hours, reconnected, all data showed up perfectly.

[Harry]

It mostly shows up perfectly, but somtimes it does not. This is not reproducible, but we know that every now and then data is missing. The problem is that often you do not realize that data is missing -> false conclusions and false trading decisions. So it is a big problem.

Something going on internally prevents Ninjatrader displaying the data that has been loaded into the data base. The data is always there (verified by editing data base) but not displayed.

How shall I know why this happens? Trace and log files do not show any problems. I documented the problem through various charts, and there I am.

Why does the chart not display the data loaded? Synchronizing (chart is displayed before data is loaded) ?

[NinjaTrader_JoshP]

Harry,

Unfortunately it baffles me at this point in time as I have never seen your issue. Having gapped data across all charts is a different story. That has been reported and we are still working to nail down the exact cause. But this particular case, 5min chart showing different data than a 1min chart, I would need to be able to reproduce to be able to analyze.

[Harry]

Hi Josh,

fully understand your comment. When I am updating historical data for my 15 or so instruments, most of them will update correctly, but sometimes one or two will not. And each time the missing data can be edited, no gap will be in the historical data. So I toggle the chart to another instrument and back to the first and the gap disappears. This is no problem, if I notice the gap, but sometimes it slips into the chart unnoticed, as yesterday evening on the other thread.

I cannot so far give any hint (session times, indicators, number of connected charts) what might cause this behaviour. From my point of view it is unpredictable.

Harry,

Unfortunately it baffles me at this point in time as I have never seen your issue. Having gapped data across all charts is a different story. That has been reported and we are still working to nail down the exact cause. But this particular case, 5min chart showing different data than a 1min chart, I would need to be able to reproduce to be able to analyze.

[dror100]

you are right its hppand to me

False Data -> False Trading Signals -> Losing Trades