The ntd database files rapidly become a problem if you have lots of data. They takes ages to backup because there are so mnay files, and they take up a lot of space, partly because they don't seem to use much compression.
It would be nice if the data was in a proper database, then backup would be easier and quicker. I'm sure it wouldn't impact on performance, since reading so many files is also not very efficient.
I had thought the ntd files were a compressed format? I did a quick standard gzip on a random 201k ES tick file and it went down to 55k. That's a massive saving.

Comment