Historical data deletes itself when it shouldn't

[Delve]

I had over a year's worth of Bid and Ask 1 minute data for a forex pair ($GBPUSD) clearly visible in Historical Data Manager's "Edit" tab. (I had grabbed this using the External Data Feed.)

I decided to grab the "Last" data for the same forex pair over a similar period by:
- connecting to "External Data Feed";
- clicking on the "Download" tab of the Historical Data Manager;
- selecting the $GBPUSD symbol and the start and end dates;
- selecting only "Minute" (in Intervals), and only "Last" in Data Types. (i.e., I left the Ask and Bid options unchecked).
- clicking on Download.

The "Last" data downloaded as requested. But when I went to look at what I had in the Edit tab, the "Ask" and "Bid" data had all completely disappeared!

By leaving the Ask and Bid options unchecked in the Download tab, a user is surely not asking for any such data to be deleted? This is surely a bug?

Thanks.

[NinjaTrader_Jason]

Hello Delve,

I am not sure why you connect to the External Data Feed - it does not provide any historical data on my end. Please see the link below for more information regarding the External Data Feed.

http://www.ninjatrader.com/support/helpGuides/nt7/external_data_feed_connection.htm

However I tested using the free Gain demo connection and I was able to reproduce the issue as well. I have forwarded these findings to Development as well. Thank you again for reporting.

[Delve]

Thanks Jason.

The External Data Feed is a curiosity: I connected to it just to find out what it was a few days ago, and I found that I get data coming in from it somehow, or at least it appears that way.

I just tried it again with the YM 06-10:
If I delete the last 5 days' historical data for that contract, and try to open a chart whilst NT is not connected to anything, I (of course) get no data in the chart for those days. But if I then connect to External Data Feed, and re-open the YM chart, I get 5 days' data appearing in it from somewhere. I've no idea how or why though!

It's the same with forex historical data: I can somehow grab data when I'm connected to External Data Feed. (I do not run Tradestation or have any other connections open in NT at the time...)

[NinjaTrader_Jason]

I suspect you have a live license entered and you retrieve historical data from the NinjaTrader historical data server this way.

[Harry]

NT autodeletes data, happened many times

I have repeatedly lost historical data, because the historical data manager autodeletes data. This is what happened today.

I wanted to check whether Gain supplies daily data and therefore added the instrument GBPJPY, which I do not trade or need otherwise. After the check (which was positive), I deleted the data in the historical data manager by editing the data, opening GBPJPY -> Last -> Day. I the right-clicked with the mouse on Day -> delete. After this the daily data was gone for GBPJPY and !!!! all data for AUDUSD had disappeared, which was the first instrument in the list. I then right clicked on Min, and the Min data was gone. Then I right clicked on Last to delete the empty folder and !!!!! all data for EURGBP was gone (which was now the first instrument of the default list, after AUDUSD had been deleted).

So NinjaTrader autodeletes the first instrument of the default list, if you delete a folder of one of the instruments below. I can't tell you how often I already have restored the data for AUDUSD and EURGBP, because it has disappeared over ten times so far....

[NinjaTrader_JoshP]

Harry,

NT does not auto delete. What is likely happening is you are right clicking on the node, but not actually selecting the node. You need to actually select the node you want to delete and ensure it is blue. Otherwise it will delete the "soft selected" node on the very top which happens to be your AUDUSD.

[Harry]

Exactly. And that is what happened to other users as well.

It would be best, if "Delete" is only displayed, after the node has been selected. Otherwise you right-click on a non-selected node and delete - and it deletes elsewhere. Happened to me at least 10 times. Already used to restore the deleted data.

[Delve]

It shouldn't be that easy to delete the wrong data, even if the user is, technically, 'doing it wrong'. It should always be quite hard to delete stuff, and there should ideally be some kind of "You are about to delete xxxxx. Are you sure?" type of message.

[Delve]

"NT does not auto delete"

Well I definitely selected a $GBPUSD node and ensured it was blue before deleting, and I noticed that the top-level $EURUSD node disappeared. It seems NT does auto delete...

[NinjaTrader_Jason]

I will forward the suggestions to display "Delete" only when a node has been selected or support a confirmation window to our development team and ask them if they can add this to the list of future considerations of the software.

Delve, as per your latest post, are you able to reproduce this behavior? I tested a few scenario's on my end, however NinjaTrader did not delete historical data this way. It only deleted the node I had selected.

[Delve]

Sorry, but I won't be trying to reproduce the behaviour. It's too much hassle. (NT7 is rapidly becoming WAY too much hassle. Sigh)

But I just re-read this thread quickly, and I noticed Harry said, "NinjaTrader autodeletes the first instrument of the [default] list"
Come to think of it, the $EURUSD which auto-deleted in my case was also the instrument at the top of my list in the Edit tab...

[NinjaTrader_Jason]

Most likely the GBPUSD instrument was not selected anymore more when you clicked "Delete". Instead the first instrument listed was "soft selected" and its historical data was deleted subsequently. See post #6.