Announcement

Collapse
No announcement yet.

Partner 728x90

Collapse

Tick data import - handling of errors and existing data

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    Tick data import - handling of errors and existing data

    Hi,

    I'm currently in the process of importing 10+ years of historical tick data for multiple futures instruments.
    Occasionally, there are some corrupted records in the dataset, like invalid bid/ask values or incorrect timestamps.

    I want to make sure the data is as clean as possible, so I'm going over the import error messages I get in NT and then adjust the repsective records in the dataset.
    To ensure data integrity when reimporting the dataset I have a couple of questions:

    1. How does NT handle corrupted ticks on import? So, for example, when I get an error message "... Illegal bid value in line ...", does NT just not import the tick and continue with the next row in the import file?

    2. How does NT handle existing tick data? When importing tick data that's already (at least partially) existing in my db, what's NTs policy to deal with that?

    A good part of the dataset has been imported successfully already. Now I want to deal with the part that's missing due to errors. However, importing that amount of data takes a while on my machine, so I'm wondering how I should go about the corrpted ticks:
    - adjust the corrupted records in the dataset, reimport it and let NT deal with the part that's already present in my db from the prior attempt
    - or delete all previously imported data and do a full new import
    What's the better option?

    Thanks!

Latest Posts

Collapse

Topics Statistics Last Post
Started by argusthome, 03-08-2026, 10:06 AM
0 responses
60 views
0 likes
Last Post argusthome  
Started by NabilKhattabi, 03-06-2026, 11:18 AM
0 responses
39 views
0 likes
Last Post NabilKhattabi  
Started by Deep42, 03-06-2026, 12:28 AM
0 responses
21 views
0 likes
Last Post Deep42
by Deep42
 
Started by TheRealMorford, 03-05-2026, 06:15 PM
0 responses
23 views
0 likes
Last Post TheRealMorford  
Started by Mindset, 02-28-2026, 06:16 AM
0 responses
51 views
0 likes
Last Post Mindset
by Mindset
 
Working...
X