Loading data ...

[zweistein]

Here a strange error:

I use NT7b5.

I have the same workspace for more than 2 weeks.
Workspace consists of 5 chart windows with ES,FDAX,FGBL,6E
Connection is IB.
All working fine for the last 2 weeks.

Today I open NT7 and on the chart with ES 12-09 I get "loading data..."

and the loading data will not go away.

Playing around with new charts etc. it is not posible to open a chart for ES 12-09. I checked and repaired the database, I deleted todays data for ES 12-09, but no change.
NT7 crashed once while playing around with new chart...


Please give me a hint how to restore ES 12-09 data access (possibly without deleting the whole database!)

regards
Andreas


Here the extract from the trace:

2009-12-10 08:24:08:480 in OnUnhandledApplicationException
2009-12-10 08:24:08:542 ********* exception trapped *********
2009-12-10 08:24:08:542 Object reference not set to an instance of an object.
2009-12-10 08:24:08:542 System.NullReferenceException: Object reference not set to an instance of an object.
at System.Windows.Forms.Control.MarshaledInvoke(Contr ol caller, Delegate method, Object[] args, Boolean synchronous)
at System.Windows.Forms.Control.Invoke(Delegate method, Object[] args)
at NinjaTrader.Cbi.SynchronizeInvoke.Invoke(Delegate method, Object[] args)
at NinjaTrader.Gui.Chart.ChartControl.AddBarsInWorker ThreadBarsData(Object state)
at System.Threading._ThreadPoolWaitCallback.WaitCallb ack_Context(Object state)
at System.Threading.ExecutionContext.runTryCode(Objec t userData)
at System.Runtime.CompilerServices.RuntimeHelpers.Exe cuteCodeWithGuaranteedCleanup(TryCode code, CleanupCode backoutCode, Object userData)
at System.Threading.ExecutionContext.RunInternal(Exec utionContext executionContext, ContextCallback callback, Object state)
at System.Threading.ExecutionContext.Run(ExecutionCon text executionContext, ContextCallback callback, Object state)
at System.Threading._ThreadPoolWaitCallback.PerformWa itCallbackInternal(_ThreadPoolWaitCallback tpWaitCallBack)
at System.Threading._ThreadPoolWaitCallback.PerformWa itCallback(Object state)

[spinalwiz]

I have the same problem - all symbols worked fine until today when YM and ES started showing 'loading . . . '

Perhaps cooincidence that it is contract rollver day?

[zweistein]

spinalwiz,

good point.

Expiry is 18dic2009

Rollover date is defined by who ? By Ninja internal routines?

where can I find this rollover date?

Regards

andreas

[spinalwiz]

They are defined in Instrument Manager. In 6.5 there was an option to manually merge the outgoing contracts data with the new one. I seem to remember something about 7 doing it automatically?

[NinjaTrader_Dierk]

Please read here: http://www.ninjatrader-support2.com/...442#post132442

[zweistein]

OK
thank you,

I will have a coffee before I tackle the indicated procedure.


andreas

[DavidHP]

I'm getting the Loading Data... error also.

The link provided by the support person does not work.

Anyone have any ideas?

Thanks

[NinjaTrader_Dierk]

Please make sure you are on NT7B7. If the errors persists: could you please provide steps to reproduce? Thanks

[DavidHP]

The error still persists.

I've had to recreate the charts that were affected to solve the issue.

I've tried to email support from NT 7.0.0.7 but that is another issue.
Each time I try to send email, it fails which means I need to send
it outside of NT7 and attach log/trace files.

I usually forget about doing it after I exit NT.
Next time it happens I will try to send it.

[NinjaTrader_Dierk]

On the "Loading data..." issue: It would be great to have a reproducible step by step scenario in to order to analyze. Thanks

[jdfagan]

I also just got the Loading Data... hang with NT7 Beta 8. I'm not sure these are reproducible, but here was the context of my environment before the hang:

* 2 5 tick Renko charts on FDAX going back 60 days
* 1 2 tick chart on FDAX going back 60 days
* Live connection with Zen-Fire is active
* 2 SampleMA crossover strats run on the renko charts using Sim101 account
* All was fine as of last night. I then sleeped my computer overnight - since this is my development computer and don't need it on 24/7.
* After awaking from sleep, charts re-awakened after connection re-established and strats are still live and running - all seems fine except for gap in data generated overnight.
* I right click chart and choose reload all historical data
* Loading Data seems stuck on several charts (note: cpu is still active however with NinjaTrader executable - perhaps I'm not waiting long enough?)
* After 15 minutes, I kill Ninja as it is unresponsive to closing normally
* No apparent exceptions in logs or trace files

* After killing Ninja, upon startup of next session, Loading data... seems hung again across all chartns now but I still see the CPU is still active. This time I'll let it crank for much longer and see if this eventually resolves.
* Again no apparent exceptions in logs or trace files. I did notice the following in Zen-Fire20100209.000 file though:

"1265726762.467000 [6892] [5180] : R | API 2.7.0.0 : AlertInfo : |||Market Data Connection - Heartbeat has been quiet for 73.116 seconds.|8|1|0|"

JD

[jdfagan]

* After killing Ninja, upon startup of next session, Loading data... seems hung again across all chartns now but I still see the CPU is still active. This time I'll let it crank for much longer and see if this eventually resolves.

Ok, I patiently waited for NT7B8 to finish its CPU cranking - 1.5 hours later, I finally got a message pop-up (see attachment). However, I must admit that I got impatient and both attempted to disconnect the live feed and clicked on the abort loading button in lower right corner of NT Control Center after more than a 1 hour wait. It took quite some time (~20 - 30 mins) after these actions before the message popped up.

Relevant section in trace.20100209.txt file:

2010-02-09 06:39:50:080 ApplicationStart done, took 15.7 secs
2010-02-09 06:47:23:616 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=1 alertType=8 code=0 msg='Market Data Connection - Heartbeat has been quiet for 73.116 seconds.'
2010-02-09 06:56:24:775 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert.reconnect: connection=1
2010-02-09 06:57:07:899 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=1 alertType=2 code=0 msg='Market Data Connection Closed'
2010-02-09 07:04:49:099 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=2 alertType=8 code=0 msg='Trading System Connection - Heartbeat has been quiet for 870.586 seconds.'
2010-02-09 07:05:58:064 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert.reconnect: connection=2
2010-02-09 07:05:58:065 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=2 alertType=2 code=0 msg='Trading System Connection Closed'
2010-02-09 07:05:58:074 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=1 alertType=8 code=0 msg='Market Data Connection - Heartbeat has been quiet for 1268.723 seconds.'
2010-02-09 07:05:58:074 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=2 alertType=8 code=0 msg='Trading System Connection - Heartbeat has been quiet for 1293.541 seconds.'
2010-02-09 07:05:58:303 (Zen-Fire Demo 1) Hosted.Adapter.OnConnectionStatusChangedNow: status=Connected priceStatus=ConnectionLost error='' forced=False
2010-02-09 07:05:58:304 (Zen-Fire Demo 1) Cbi.Connection.ProcessEventArgs.ConnectionStatusEventArgs Connected ConnectionLost NoError 
2010-02-09 07:05:58:304 (Zen-Fire Demo 1) Hosted.Adapter.OnConnectionStatusChangedNow: status=ConnectionLost priceStatus=ConnectionLost error='' forced=False
2010-02-09 07:05:58:304 (Zen-Fire Demo 1) Cbi.Connection.ProcessEventArgs.ConnectionStatusEventArgs ConnectionLost ConnectionLost NoError 
2010-02-09 07:05:58:305 (Zen-Fire Demo 1) Cbi.ConnectionStatusEventArgs.Process: Connected ConnectionLost
2010-02-09 07:05:58:309 (Zen-Fire Demo 1) Cbi.ConnectionStatusEventArgs.Process: ConnectionLost ConnectionLost
2010-02-09 07:05:58:680 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=1 alertType=1 code=0 msg='Market Data Connection Opened'
2010-02-09 07:05:58:797 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=1 alertType=4 code=0 msg='Market Data Connection Login Complete'
2010-02-09 07:05:58:963 (Zen-Fire Demo 1) Hosted.Adapter.OnConnectionStatusChangedNow: status=ConnectionLost priceStatus=Connected error='' forced=False
2010-02-09 07:05:58:963 (Zen-Fire Demo 1) Cbi.Connection.ProcessEventArgs.ConnectionStatusEventArgs ConnectionLost Connected NoError 
2010-02-09 07:05:59:137 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=2 alertType=1 code=0 msg='Trading System Connection Opened'
2010-02-09 07:05:59:285 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=2 alertType=4 code=0 msg='Trading System Connection Login Complete'
2010-02-09 07:06:01:075 (Zen-Fire Demo 1) Cbi.ConnectionStatusEventArgs.Process: ConnectionLost Connected
2010-02-09 07:06:01:076 (Zen-Fire Demo 1) Hosted.Adapter.OnConnectionStatusChangedNow: status=Connected priceStatus=Connected error='' forced=False
2010-02-09 07:06:01:076 (Zen-Fire Demo 1) Cbi.Connection.ProcessEventArgs.ConnectionStatusEventArgs Connected Connected NoError 
2010-02-09 07:06:01:083 (Zen-Fire Demo 1) Hosted.Adapter.OnAccountNow: account='X-disabled-X' fcm='Dorman' ib='Sim'
2010-02-09 07:06:01:085 (Zen-Fire Demo 1) Hosted.Adapter.OnAccountItemNow: account='X-disabled-X' fcm='Dorman' ib='Sim' itemType=CashValue value=*****
2010-02-09 07:06:01:085 (Zen-Fire Demo 1) Hosted.Adapter.OnConnectionStatusChangedNow: status=Connected priceStatus=Connected error='' forced=False
2010-02-09 07:06:01:185 (Zen-Fire Demo 1) Cbi.ConnectionStatusEventArgs.Process: Connected Connected
2010-02-09 07:17:12:374 WARNING: ExecutionUpdateJob.Run: execution not being tracked, retrying update Execution='a3470f482f1945a3a06b62bf0bfe2214' Instrument='FDAX 03-10' Account='Sim101' Name='Buy' Exchange=Default Price=5487 Quantity=1 Market position=Long Commission=0 Order='0d43224a2e7348168b513860c65e3bfd' Time='2/9/2010 3:29:01 AM'
2010-02-09 07:17:14:949 WARNING: ExecutionUpdateJob.Run: execution not being tracked, retrying update Execution='8ec09f74e30b4381a6a7a42deaf812ae' Instrument='FDAX 03-10' Account='Sim101' Name='Buy' Exchange=Default Price=5481 Quantity=1 Market position=Long Commission=0 Order='53e918f6a3bd4d08a9c9f14ddeb88919' Time='2/9/2010 3:19:52 AM'
2010-02-09 07:31:52:450 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=2 alertType=8 code=0 msg='Trading System Connection - Heartbeat has been quiet for 40.525 seconds.'
2010-02-09 07:31:52:452 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert.reconnect: connection=2
2010-02-09 07:31:52:452 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=2 alertType=2 code=0 msg='Trading System Connection Closed'
2010-02-09 07:31:52:453 (Zen-Fire Demo 1) Hosted.Adapter.OnConnectionStatusChangedNow: status=ConnectionLost priceStatus=Connected error='' forced=False
2010-02-09 07:31:52:454 (Zen-Fire Demo 1) Cbi.Connection.ProcessEventArgs.ConnectionStatusEventArgs ConnectionLost Connected NoError 
2010-02-09 07:31:52:454 (Zen-Fire Demo 1) Cbi.ConnectionStatusEventArgs.Process: ConnectionLost Connected
2010-02-09 07:32:00:087 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=2 alertType=1 code=0 msg='Trading System Connection Opened'
2010-02-09 07:32:00:087 (Zen-Fire Demo 1) Hosted.Adapter.OnConnectionStatusChangedNow: status=Connected priceStatus=Connected error='' forced=False
2010-02-09 07:32:00:088 (Zen-Fire Demo 1) Cbi.Connection.ProcessEventArgs.ConnectionStatusEventArgs Connected Connected NoError 
2010-02-09 07:32:00:088 (Zen-Fire Demo 1) Cbi.ConnectionStatusEventArgs.Process: Connected Connected
2010-02-09 07:32:00:270 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=2 alertType=4 code=0 msg='Trading System Connection Login Complete'
2010-02-09 07:32:00:433 (Zen-Fire Demo 1) Hosted.Adapter.OnAccountNow: account='X-disabled-X' fcm='Dorman' ib='Sim'
2010-02-09 07:32:02:431 (Zen-Fire Demo 1) Hosted.Adapter.OnAccountItemNow: account='X-disabled-X' fcm='Dorman' ib='Sim' itemType=CashValue value=*****
2010-02-09 07:32:02:431 (Zen-Fire Demo 1) Hosted.Adapter.OnConnectionStatusChangedNow: status=Connected priceStatus=Connected error='' forced=False
2010-02-09 07:42:01:188 (Zen-Fire Demo 1) Cbi.Connection.Close1
2010-02-09 07:42:01:188 (Zen-Fire Demo 1) Cbi.Connection.Close2
2010-02-09 07:42:01:189 (Zen-Fire Demo 1) Cbi.Connection.Close3
2010-02-09 07:42:01:189 (Zen-Fire Demo 1) Cbi.Connection.Close4
2010-02-09 07:42:06:114 (Zen-Fire Demo 1) Cbi.Connection.Close5
2010-02-09 07:42:06:114 (Zen-Fire Demo 1) Cbi.Connection.Close6
2010-02-09 08:03:56:201 ERROR: Failed to call 'Add' method for period type 'Renko': Exception of type 'System.OutOfMemoryException' was thrown.
2010-02-09 08:03:56:206 Server.Client.Close
2010-02-09 08:03:56:206 (Zen-Fire Demo 1) Cbi.Connection.Close8
2010-02-09 08:03:56:207 (Zen-Fire Demo 1) Hosted.Adapter.Disconnect
2010-02-09 08:03:56:208 (Zen-Fire Demo 1) Hosted.Adapter.Cleanup0
2010-02-09 08:03:56:208 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=2 alertType=2 code=0 msg='Trading System Connection Closed'
2010-02-09 08:03:56:210 (Zen-Fire Demo 1) Hosted.Unmanaged.Callbacks.Alert: connection=1 alertType=2 code=0 msg='Market Data Connection Closed'
2010-02-09 08:03:56:288 (Zen-Fire Demo 1) Hosted.Adapter.Cleanup1
2010-02-09 08:03:56:297 (Zen-Fire Demo 1) Hosted.Adapter.Cleanup2
2010-02-09 08:03:56:297 (Zen-Fire Demo 1) Hosted.Adapter.Cleanup9
2010-02-09 08:03:56:297 (Zen-Fire Demo 1) Cbi.Connection.ProcessEventArgs.ConnectionStatusEventArgs Disconnected Disconnected NoError 
2010-02-09 08:03:56:299 (Zen-Fire Demo 1) Cbi.Connection.Close9
2010-02-09 08:03:56:309 (Zen-Fire Demo 1) Cbi.ConnectionStatusEventArgs.Process: Disconnected Disconnected

Now, I just attempted to re-connect the live data and Loading Data... is re-appearing. This time however, I grabbed a snapshot of NinjaTrader.exe's performance graph via System Internals tool - it looks headed for another memory problem from the looks of this ever increasing memory history since just flipping on the live connection. See 2nd attachment for this graph.

[jdfagan]

Now, I just attempted to re-connect the live data and Loading Data... is re-appearing. This time however, I grabbed a snapshot of NinjaTrader.exe's performance graph via System Internals tool - it looks headed for another memory problem from the looks of this ever increasing memory history since just flipping on the live connection. See 2nd attachment for this graph.

Several minutes later and memory is plateaued at 2.3 GB with one of my cores on my dual core machine pegged for the NinjaTrader process..

Hope this info helps.

[NinjaTrader_JoshP]

jdfagan,

Those charts hold considerable amounts of data. 60 days on a 2 tick series is extremely taxing on the system. I strongly suggest you significantly decrease the lookback days when trying to use tick based intervals.

[jdfagan]

Several minutes later and memory is plateaued at 2.3 GB with one of my cores on my dual core machine pegged for the NinjaTrader process..

Final screenshot after again trying to get Ninja to recover. Again had to abort and kill the live connection. Screenshot attached.

Josh, I will remove the 2 tick charts and try to reproduce only with the Renko charts. Its important to be able to load several months of 5 tick brick sized Renko data or I cannot do proper backtesting.

However, I'm not convinced that 2-tick chart is source of this problem - it was working fine yesterday. I'm thinking more of issue of computer waking up from sleep and Ninja not handling that scenario well - which is fine if I can narrow it down to that - I can live with this and I would just shutdown Ninja before sleeping if this is the case.

JD