Data Download

[astrolobe]

When using the HDM to only download the last few days of minute data, it takes a long time because it also tries to download data from 2008.
While it is supposed to be downloading 5 days of data, I see in the bottom right hand side of the Control Center a message saying "...loading data...$EURGBP(9/16/2008 - 06/23/2010).

It does this even though I do not have any minute charts open that require data that far back (2008). If I look in the Edit Tab of the HDM for that instrument, I only have data going back to December 2009.

Why is it trying to load this extra data when it was not requested?

Also, is it possble to just re-download the last week of minute data, if I already have one year of minute data for that instrument?

P.S. I am using MB Trading for forex.

[NinjaTrader_Jason]

Hello astrolobe,

Could it be the Start date was set to 9/16/2008?

Can you please delete the downloaded historical data via the Edit-tab and peform the download once more. Make sure the Start date reflects 2010.

If the issue remains, could you please send me your log and trace files. You can find log and trace files at the following locations.

Start Menu--> My Documents--> NinjaTrader 7--> Log--> log.20100624 for today. (log.yyyymmdd for any other date)

Start Menu--> My Documents--> NinjaTrader 7--> Trace--> trace.20100624 for today. (trace.yyyymmdd for any other date)

Yes, you can re-download the last week of minute data. Please delete the present historical data first via the Edit-tab. Subsequently download the data via the Download tab.

[astrolobe]

Hi Jason,


The entries in the log and trace are based on the following steps:

1. Delete all minute data from $AUDJPY and $AUDUSD instruments.
2. Open the following $AUDJPY charts; Weeky (1000 bars), Daily (1000 bars), H8 (200 bars), H4 (200 bars), and H1 (200 bars).
3. While it was loading the minute charts, the Control Center displayed that it was loading from 2009-09-17, which is reflected in the trace file. This date is earlier than any data required for the H8 minute chart which goes back the furthest, i.e., H8 for 200 bars (only goes back to 3/24/2010).
4. After the minute charts have loaded, looking at the HDM for $AUDJPY minute data, it has minute data back to January 2010. Which is more than 200 H8 bars, but less then 2009-09-17 reflected in the trace file request.
5. I then changed instruments in the existing minute charts to $AUSUSD...it pretty much did the same as steps 2 and 3.
6. Then I switched the existing $AUDUSD minute charts back to $AUDJPY, hoping that the chart would load instantaneously, because all the data required is already in the database. However, this took a few seconds to load, as it looked like it was retrieving the data all over again. (I have a dual quad core machine with 16G of memory, and nothing else running on it besides NT, so there should be no delay in loading data.)

EDIT: Another strange observation:

1. If I delete the data that was loaded using MBT, and reload the charts using IB, then an extra 6 months of minute data is loaded into the db, instead of only 3 extra months (MBT).
2. If I disconnect IB, and reconnect MBT, then load an instrument ($AUDJPY) whose data is in the db from IB loading it, then those charts load instantly, without ANY delay.
3. While still connected to MBT, if I switch to a different instrument, that has data in the db from MBT, that chart takes 10 or more seconds to reload the data, and says ..."loading data" on the chart.
4. I can keep switching back to the instrument that was load by IB, and it is always instant, and does not reload (which is good).

This behaviour does not make any sense.

[NinjaTrader_Jason]

Hello astrolobe,

I am able to reproduce the issue on my end when I create an 640 minute chart (I assume you refer to 8 hours with H8). It requests historical data starting 9/17/2009. Unfortunately I do not have access to a MBTrading connection that supports forex data, so I tested using the Gain demo connection.

However when I check the HDM, it does list all historical data was requested. I will forward your findings to Development. Thank you for reporting.

Regarding the other observation, perhaps the requested historical data is not entirely available at MBTrading, thus it did not reflect all historical data in the HDM.

As per #3, did it load any data (did you see data loading in the lower left corner of the Control Center) or could it be it had to load indicator data?

I did not see this behavior reflected in the trace file. Do you recall at what time you switched to a different instrument as per #3? Please send me the trace file that contains this behavior as well.

[NinjaTrader_Jason]

Hello astrolobe,

Unfortunately the behavior you experience is as expected. When you load historical data based on 'Bars', it will not load data for the exact From date.

If you like NinjaTrader to load historical data for specific dates, I suggest to utilize 'Days' or 'CustomRange' for 'Load data based on'.