Announcement

Collapse
No announcement yet.

Partner 728x90

Collapse

Can't repeat previous backtest results

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    Can't repeat previous backtest results

    Sometines, when I run a backtest, and then run it again with exactly the same parameters, I get different results between the runs.

    Is this a memory caching problem, or the result of not clearing/resetting the database in some way between backtests?

    #2
    Are you sure you're running then on exactly the same data set?

    Please see if you get the same result when running consecutive same parameter backtests in disconnected state.

    Thanks,

    Comment


      #3
      Yes, I am disconnected, and it's the same data as far as I am able to judge.

      The only way to get the same results that I have found is to restart NT after rebooting the computer. Then the same parameters give the same results. Otherwise, the results will differ, in my experience.

      I wondered whether there was some stack that wasn't getting re-set, or database temporary table that wasn't getting flushed, etc ...?

      Comment


        #4
        AnotherTrader, I was not able to reproduce it on my end here in testing - the same parameters for example on the SampleMACrossOver produced exactly the same results on consecutive runs for me in the SA. Are you using any custom resources in your code that are not properly released perhaps? Would you see the same outcome using the default SampleMACrossOver strategy in your testing?

        Thanks,

        Comment

        Latest Posts

        Collapse

        Topics Statistics Last Post
        Started by CarlTrading, 03-31-2026, 09:41 PM
        1 response
        71 views
        0 likes
        Last Post NinjaTrader_ChelseaB  
        Started by CarlTrading, 04-01-2026, 02:41 AM
        0 responses
        39 views
        0 likes
        Last Post CarlTrading  
        Started by CaptainJack, 03-31-2026, 11:44 PM
        0 responses
        63 views
        2 likes
        Last Post CaptainJack  
        Started by CarlTrading, 03-30-2026, 11:51 AM
        0 responses
        63 views
        0 likes
        Last Post CarlTrading  
        Started by CarlTrading, 03-30-2026, 11:48 AM
        0 responses
        53 views
        0 likes
        Last Post CarlTrading  
        Working...
        X