Optimization using Dual Processor Multiple Core Xeon Workstation

[CobrasMarketView]

Hi, I know this question has been raised and answered, but before I invest $10,000+ on Dual Intel® Xeon® Processor E5-2670 v3 workstation, I want to be double confirmed that NT7 optimizing does support multiple processors with multiple cores.

The workstation I'm considering is 2 processors each with 12 physical core, so total 2*12*2 = 48 logical core. Accordingly, NT7 when doing optimization should run on those 48 cores. Please confirm it is true that NT7 can run on 48 cores.

I'm now running on 12 logical cores machine, I do notice when doing daily data optimization, NT7 does run on those 12 cores (each CPU run time up to 80%+). But when I'm running on intra-day optimization, it seems it only runs on 6 cores instead of 12 cores. So I'm a little worried if NYT can run on those total 48 cores.

Thank you!

[NinjaTrader_PatrickH]

Hello CobrasMarketView,

Thank you for your post.

NinjaTrader 7 is multi-threaded but not multi-core. This means it will not take advantage of all cores on your PC.

We look to improve this with NinjaTrader 8. You can find the list of major enhancements at the following link: http://www.ninjatrader.com/downloads...njaTrader8.pdf

[CobrasMarketView]

Hello CobrasMarketView,

Thank you for your post.

NinjaTrader 7 is multi-threaded but not multi-core. This means it will take advantage of all cores on your PC.

We look to improve this with NinjaTrader 8. You can find the list of major enhancements at the following link: http://www.ninjatrader.com/downloads...njaTrader8.pdf

So you mean it doesn't care about how many processors, it cares only how many cores available in total? Take my original question for example, according to your answer, NT7 should run on all 48 cores, right? Thanks.

[CobrasMarketView]

The screenshot is from bigmiketrading.com. Big mike tested with 4 processors AMD each with 6 cores, so total 48 logical cores, NT7 seems running on all those cores, so this should confirmed my questions.

[NinjaTrader_PatrickH]

Hello CobraMarketView,

Thank you for your response.

NinjaTrader 7 is multi-threaded but not multi-core. This means it will not take advantage of all cores on your PC.

My apologizes but I had a miss-leading typo there stating that NinjaTrader 7 is multi-core, which it IS NOT. I have corrected my previous post.

[CobrasMarketView]

Hello CobraMarketView,

Thank you for your response.

My apologizes but I had a miss-leading typo there stating that NinjaTrader 7 is multi-core, which it IS NOT. I have corrected my previous post.

So you mean when doing optimization, NT7 won't use all the cores. But how come the screenshot I showed earlier does use all 48 cores?

My guess is NT7 doesn't care about how many cores or processors. When doing optimization, it's multi-threaded, the operating system takes care of how to allocate those threads into different cores. My concern actually is when doing optimization how many threads NT7 create? Say if it creates only 5 threads, then it can only use 5 cores in the most. If it creates 100 threads, then it can use 100 cores.

[sledge]

So you mean when doing optimization, NT7 won't use all the cores. But how come the screenshot I showed earlier does use all 48 cores?
.

I don't see NT running in the screenshot you posted? Confused here

[CobrasMarketView]

So you mean when doing optimization, NT7 won't use all the cores. But how come the screenshot I showed earlier does use all 48 cores?

My guess is NT7 doesn't care about how many cores or processors. When doing optimization, it's multi-threaded, the operating system takes care of how to allocate those threads into different cores. My concern actually is when doing optimization how many threads NT7 create? Say if it creates only 5 threads, then it can only use 5 cores in the most. If it creates 100 threads, then it can use 100 cores.

attached again.

[NinjaTrader_PatrickH]

Hello CobrasMarketView,

Thank you for your response.

Please take a look at the information at the following link for Multi-Threading in NinjaTrader: http://www.ninjatrader.com/support/h..._threading.htm

[CobrasMarketView]

Thank you, although still didn't answer my question. We all know NT7 can use multicores, but if those multicores are offered by multiprocessors, can NT7 use all those cores or it limits to one processor's cores only. For my original questions, 2 processors, total 24 cores. We now know it can sure use 1 processor's 12 cores. We're not sure yet (based on your answer and NT7 official document) if NT7 can use 2 processors' total 24 cores.

Anyway, guess I'll have to spend thousands before finding out...

[sledge]

There are previous threads here which contain this discussion.

[CobrasMarketView]

There are previous threads here which contain this discussion.

yes, I found thread here: http://www.ninjatrader.com/support/f...ad.php?t=34109

Basically it says

NinjaTrader 7 comes with optimized multi core/multi-processor support. This would allow you to make full usage of multi-core/ multi-processor hardware. However, due to the nature of the Window OS, NinjaTrader 7 would not be able to fully use all available multi-cores/multi-processors at any given time.

[CobrasMarketView]

There are previous threads here which contain this discussion.

anyway, I'm 80% sure about NT7 will use all cores available when doing optimization as long as the optimization takes long enough times, say, 7 parameters, 20 years of data, because Windows should hide multiprocessors details (which is purely H/W) to the application, all application sees are total logical cores (well, actually application doesn't care about cores either, it just creates lots of threads while windows will assign logical cores to those threads). So it doesn't matter multiprocessors or not as long as Windows makes all the logical cores available to the application.

I just want that 20% sure, after all invest thousands on a new machine is not a small amount.

[sledge]

yes, I found thread here: http://www.ninjatrader.com/support/f...ad.php?t=34109

Basically it says

I was thinking more like this one:

http://www.ninjatrader.com/support/forum/showthread.php?t=46672&highlight=multicore+optimization

[CobrasMarketView]

I was thinking more like this one:

http://www.ninjatrader.com/support/f...e+optimization

Thank you! I know multicore does help. I'm just not sure if the multicore is provided by multiprocessor then will NT7 still be able to use all cores. If multicore is provided by a single processor, then I have no doubt, the more cores, the faster, in general.