Historical Data Missing From Charts

[kmpc1]

Missing Minutely Data for 6-14 ES for Monday April 11

my minutely charts go from 4/10 directly to 4/14.

my weekend research is being affected.

is there any way I can get back the data from 4/11?

I am using CQG.

Interestingly I can make tick charts and other types of charts, just not minutely charts???

Many thanks for your help.

[NinjaTrader_James]

Hello tderrick,

No worries, your frustration was understood.

When we recommend a back up data feed, we actually mean a data feed only and not another brokerage technology like Rithmic to use your example. The difference being that a data feed only provides data and a brokerage technology provides both data and order routing services. So, if you had a backup data feed, data would come from your data provider and your CQG connection would route your trades to your broker, this of course would ensure that you would be unaffected by historical data items like these referenced in this thread. Also, standalone data feeds often times have more historical data then what is offered with a brokerage technology.

With that said, many of our users have opted to have two brokers (one using Rithmic and one using Continuum, for example) or two brokerage technologies on two different accounts but with one broker (Rithmic and Continnuum at AMP) to mitigate risks even further. What this would accomplish is that if one technology completely failed, meaning no data and no order routing capabilities (if you remember ZenFire) you could still continue trading. This set-up would require a Multi Broker License to be able to use more than one brokerage technology simultaneously. You can upgrade your single broker license key to a multi broker by sending a note to sales[at]ninjatrader[dot]com and paying the difference between the two keys.

• http://www.ninjatrader.com/purchase-own.php

We always recommend Kinetick as our preferred market data feed as it has been optimized for NinjaTrader, but there are others out there like DTN's IQ Feed. You will find Kinetick is one of, if not the best when it comes to price, not to mention it is fast and reliable. Most Kinetick subscribers spend ~$55 per month for their service which provides excellent data, redundancy, and peace of mind.

• http://www.kinetick.com/

If you would like, you can send a note to sales[at]ninjatrader[dot]com referencing this thread and asking for James and I will be more than happy to discuss these options in greater detail.

[tderrick]

Brother James,

I would like to apologize to you and anyone else I may have irritated with my
partial meltdown Monday.

Indeed, a back up data feed seems to be the best option.

I am a bit confused on the subject however.
I'm with AMP. What is the process to acquire an additional feed? I assume it has
to be one AMP supports with Ninja and I think that only leaves Rithmic.

When I have requested a feed change in the past, the previous feed is terminated. So
would I just pay a bit more to have both? ... I am quite ignorant an the subject.

I will send an inquiry to AMP. also...

Sorry again,

While this particular outage was limited to CQG/Continuum users, it was not a CQG/Continuum issue directly. What happened is that a data server stopped recording some data that theoretically could have also happened on a server providing historical data for Rithmic customers. So I do not want to say switching brokerage technologies will do anything.

I recommend using a back up data feed but we also have many users choosing to be redundant by having two broker data feeds with two funded accounts. For example, if you are at AMP, it may be possible to have a CQG and Rithmic based account. If one has downtime for whatever reason, you can still trade and not be affected.

This of course isn't a feasible option for all, and that is why I recommend a back up data feed.

[NinjaTrader_James]

FYI: After market closed, I once again restarted NT and then reloaded historical data. For some reason it is now working and all charts reloaded correctly.

Hello,

At this time, you are the only member that has reported such behavior. If you have not yet, please send a note to support[at]ninjatrader[dot]com

[pev11]

FYI: After market closed, I once again restarted NT and then reloaded historical data. For some reason it is now working and all charts reloaded correctly.

[mic.o8o]

Hello All,

All historical data should be restored. Please restart NinjaTrader and try reloading your data.

If you are missing any data after doing so, please send a note to support[at]ninjatrader[dot]com with details on the missing data.

Thanks guys for being on it. I appreciate the free historical data, please keep it that way.

[Joseph Connors]

Brother James,

I'm afraid that's not very comforting. Now, instead of just a single problem, it
appears we have a myriad of pit falls lurking in the data universe.

I see why it is so hard to repair. It may be out of your hands.

I see one workaround.

New platform
New data
New Broker

I'm starting over

A FAR simpler solution is just get a backup data provider. Your just reacting emotionally right now. Cool off and think about it.

[NinjaTrader_James]

I think the issue most folks have is that "fixing it quickly" translated into 16 hours (minimum) from the time of it being reported by users.

I agree absolutely with this, and I addressed this in post 297.

Proper call outs were made and the staff responsible were available, the thread was unfortunately not updated to reflect that it was being worked on and I am sorry for that; we will absolutely do our best to continue offering the high level of support our users have come to experience.

[Beljevina]

... we fix them as quickly as possible.

... It would be like if your car kept breaking down for different reasons, each time it would result in the same thing, you can't drive, ...

I think the issue most folks have is that "fixing it quickly" translated into 16 hours (minimum) from the time of it being reported by users. The optics of NT support folks answering other queries in the meantime, with zero updates or acknowledgement on this arguably more important item, I think is what we're also having trouble with.

In the meantime, the Asian session had finished; and the majority of London had completed; surely you can understand that these are legitimate sessions for traders, regardless of where on the globe they be located.

All the while, the "car remained broken" until the shop seemingly opened for business well after 9am EST. My sense is that the technical/IT folks who could have made the server switchover or resolved the issue earlier, simply weren't available or "on call" Sunday night, hence there was 'radio silence' for 16 hours. I am guessing on that latter point and I may indeed be wrong.

But, I based it on having built and run IT help desks as a career, and knowing the severity of this issue, with no communication or acknowledgement of the problem, it leads me/us to believe there was no personnel to handle it, no callout process and no severity level ascribed to the matter(s). Not trying to be difficult, just drawing reasonable conclusions on the facts & events as they unfolded, with a genuine hope that it be resolved reasonably sooner, when/if it occurs again. If I recall past similar incidents, my sense is that it has been resolved sooner, on occasions.

[NinjaTrader_James]

Correct, I did not mention that I did reload historical data multiple times as well. Unfortunately it did not work. I'm still missing RTH data for Friday's session on time based ES and CL charts.

Please send a note to support[at]ninjatrader[dot]com and we will further assist, as this data should be available as confirmed by others in this thread.

[NinjaTrader_James]

Put yourself in the shoes of your customers: we don't care why it doesn't work. We just need to be able to trust our platform, no matter what.

I assure you that we want you trading just as much as you want to be trading. That is why the data issues are resoved and you are currently up and running and able to trade.

The reason it is important to "split hairs" here is because the fact is that things come up and we fix them as quickly as possible. These were all different items that could have happened to any data service and we fixed them; we found out what the issue was in each situation and we have addressed it. It would be like if your car kept breaking down for different reasons, each time it would result in the same thing, you can't drive, but you couldn't say to your mechanic, "I just had you replace my battery and now my tires are flat. I expect that once you have fixed one thing, nothing else can occur."

[pev11]

Correct, I did not mention that I did reload historical data multiple times as well. Unfortunately it did not work. I'm still missing RTH data for Friday's session on time based ES and CL charts.

[laocoon]

This is what I think you may be missing. It is not the same thing that has caused the missing data, they are different items all addressed separately. The timing was unfortunate, but they were unrelated.

Please, let's not split hairs here. I very well understand that the new problem is unrelated to the prior ones but frankly, I don't care: this issue has been going on for months now and this is simply bad for your reputation. There's a finite number of potential bottlenecks and each and every one of them needs to be addressed with a redundant solution.

Put yourself in the shoes of your customers: we don't care why it doesn't work. We just need to be able to trust our platform, no matter what.

[NinjaTrader_James]

I am missing all of Friday's RTH (time based) data for CL and ES. Tick data seems to be fine. I have repaired db and have restarted multiple times. Wondering why this happening if I recorded the data during Friday's session? Is this related to the historical data server problems?

You do not mention if you have manually reloaded the data on the chart. Please try Right clicking your chart and then selecting Reload Historical Data.

If this does not restore the data, please send an email to support[at]ninjatrader[dot]com.

[NinjaTrader_James]

I see there are a few AMP users here...

Would we be justified in switching over to the Rithmic feed if, as you guys say, this
is narrowed down to a CQG issue?

While this particular outage was limited to CQG/Continuum users, it was not a CQG/Continuum issue directly. What happened is that a data server stopped recording some data that theoretically could have also happened on a server providing historical data for Rithmic customers. So I do not want to say switching brokerage technologies will do anything.

I recommend using a back up data feed but we also have many users choosing to be redundant by having two broker data feeds with two funded accounts. For example, if you are at AMP, it may be possible to have a CQG and Rithmic based account. If one has downtime for whatever reason, you can still trade and not be affected.

This of course isn't a feasible option for all, and that is why I recommend a back up data feed.