Using 3rd party Tools With NinjaScripts

[Jim W.]

Search & Replace for Workspace query facility

I am adding to this old thread to explain another use for Search & Replace http://ninjatrader.com/support/forum/showpost.php?p=302261&postcount=7 . New NinjaTrader users should understand that it is likely that everything mentioned in this thread is unsupported by NinjaTrader support.

When I have a question like whitch Workspaces have the eMini Instrument ES or which Workspaces have a particular Indicator, I use file editor from FUNDUC Software, "Replace Studio Pro" or "Search and Replace" as a query facility. To use Search & Replace first download and install it.

There are Shareware, Classic, Replace Studio Pro and Replace Studio Business Edition versions.
Free: Basic version is Shareware at http://www.funduc.com/srshareware.htm
Advanced versions are very reasonably priced at http://www.funduc.com/search_replace.htm
Website: http://www.funduc.com/

Caution: This software has very powerful Replace capabilities. Learn to use the Replace functions with files in a temp folder before using it with valuable files. Never make changes to NT files while NT is running. They may be overwritten when NT exits.

Some query examples:
1) Start SR. By default SR installs to "C:\Program Files\Tools\SR\SR32.exe". Which you should find with Start | All Programs | Tools folder.
2) Enter the Search for text, File Mask and Path (Win 7 path shown). To Find all ES contracts:
Search for: <Instrument>ES (There is a blank following the S.)
File Mask: *.xml
Path: C:\Users\Jim\Documents\NinjaTrader 7\workspaces (Replace Jim with your user id)
then click the left most Blue Binocular icon. It is the Search icon the Purple Binocular icon is Replace.
See first attachment.
Left clicking shown text line displays text above and below text.
Left clicking file name shows whole file.
3) To see all Instruments, use Search for: <Instrument>
4) To see all Workspaces with JigSaw Trading Indicators, use Search for: Indicator.JT_
See second attachment.
5) To see all Indicators in Workspaces use Search for: Indicator.
The SR Help link provides detailed information about Search & Replace.

[Jim W.]

Search &amp; Replace for very quick Futures Workspace rollovers

I am adding to this old thread to explain another use for Search & Replace http://ninjatrader.com/support/forum/showpost.php?p=302261&postcount=7 . New NinjaTrader users should understand that it is likely that everything mentioned in this thread is unsupported by NinjaTrader support.

Futures Instruments must be rolledover to chart and trade the current month. NT provides a video, Futures Contract Rollover - NinjaTrader Tips, which describes the rollover process. The video does not mention updating all the Workspaces with the new contracts. Nor does NT provide a method for updating all the Workspaces after a rollover.

I use file editor from FUNDUC Software, "Replace Studio Pro" or "Search and Replace" to make all rollover changes to my charts and DOMs in a few seconds. To use Search & Replace first download and install it.

There are Shareware, Classic, Replace Studio Pro and Replace Studio Business Edition versions.
Free: Basic version is Shareware at http://www.funduc.com/srshareware.htm
Advanced versions are very reasonably priced at http://www.funduc.com/search_replace.htm
Website: http://www.funduc.com/

Caution: This software has very powerful Replace capabilities. Learn to use the Replace functions with files in a temp folder before using it with valuable files. Never make changes to NT files while NT is running. They may be overwritten when NT exits.

I follow the steps below after rollingover all my Futures Instruments with the NT Instrument Manager:

1) Verify that I have no open Futures orders and positions. DOMs will be changed to a new expiration month.
2) Exit NT, taking a backup which includes Workspaces. Murphy's Law always applies.
See http://ninjatrader.com/support/forum...2&postcount=14 should you need to restore a Workspace.
Changes made to NT's open Workspaces may be overwritten when NT exits.
3) Start SR. By default SR installs to "C:\Program Files\Tools\SR\SR32.exe". Which you should find with Start | All Programs | Tools folder.
4) Enter the Search for text, File Mask and Path (Win 7 path shown). To Find all ES September 2015 contracts:
Search for: ES 09-15
File Mask: *.xml
Path: C:\Users\Jim\Documents\NinjaTrader 7\workspaces (Replace Jim with your user id)then click the left most Blue Binocular icon. It is the Search icon the Purple Binocular icon is Replace.
See first attachment.
Left click shown text line for text above and below.
Left click file name to view whole file.
5) Verify that only Instrument will be changed then enter the field Replace with: ES 12-15
6 Click the Purple Binocular icon. See second attachment. You will see the replacement that will be make when you click one of the Replace buttons.
7) Change the Search for and Replace for each of your Futures contracts and repeat steps 4 - 6.
Don't be tempted to only enter the month-year as a shortcut. It is asking for trouble, especially if you trade both crude and e-Mini.
The SR Help link provides detailed information about Search & Replace.
8) Start NT, connect to your data source, and open your Workspaces to verify they are displaying the correct contracts.
9) Do another backup, changing the file name to identify that backup taken after rollover (e.g.,<My Documents>\NinjaTrader Backup\2015-08-22 After Rollover.ntbk ).

[pranas]

Re: Integration with VS 20XX

Added:

<StartAction>Program</StartAction>
<StartProgram>
C:\Program Files (x86)\NinjaTrader 7\bin64\NinjaTrader.exe
</StartProgram>

inside

<Configuration> ...

tag in NinjaTraderDebug.csproj, but getting error after F5 (see attachement).



Do you have thoughts how to work with Ninja x64?

[Jim W.]

Recent Revisions

I have no more items on my To Do List for this thread, but will continue to make updates. I appreciate:

* The two Thread Rating 5.0 votes
* Thanks from: bradkop, koganam, NinjaTrader_Bertrand, NinjaTrader_Brett, Prov1322, and ymScalper
* Feedback from koganam

Feel free to private message me with your comments, questions, and feedback.

Start reading this thread at post entitled Summary in Display Mode of Hybrid. Individual software posts follow Summary in alphabetical order.

Recent Revisions:

11-17-2012 Updated VMWARE Workstation text beginning "One problem, when I tried to create a DVD from the ISO file, the DVD install failed with error:" with:

I have successfuly tested the ISO file by installing a Win 8 Pro VM with Workstation 9.0.1 and a DVD created from the ISO file to do a physical install. Attempts to install a VM from the DVD install fail with error:

"Windows cannot install the required files. ... Error code 0x80070714" .

Comparision of the genuine Win 8 Pro DVD and the DVDs created from the ISO file differ only in the modified EI.CFG file. I have tried different methods of creating the DVD from the ISO file but all DVDs gave the same result including one created with the Win 8 built-in ISO to DVD burner.

11-15-2012 Added below to VMWARE Workstation

Windows 8 License Relating to Virtual Machines

The License for Windows 8 reads:

"e. Use in a virtualized environment. If you use virtualization software to create one or more virtual computers on a single computer hardware system, each virtual computer, and the physical computer, is considered a separate computer for purposes of this agreement. This license allows you to install only one copy of the software for use on one computer, whether that computer is physical or virtual. If you want to use the software on more than one virtual computer, you must obtain separate copies of the software and a separate license for each copy. Content protected by digital rights management technology or other full-volume disk drive encryption technology may be less secure in a virtualized environment."

And the related section reads:

"Can I transfer the software to another computer or user?
You may transfer the software to another computer that belongs to you. You may also transfer the software (together with the license) to a computer owned by someone else if a) you are the first licensed user of the software and b) the new user agrees to the terms of this agreement. To make that transfer, you must transfer the original media, the certificate of authenticity, the product key and the proof of purchase directly to that other person, without retaining any copies of the software. You may use the backup copy we allow you to make or the media that the software came on to transfer the software. Anytime you transfer the software to a new computer, you must remove the software from the prior computer. You may not transfer the software to share licenses between computers. You may transfer Get Genuine Windows software, Pro Pack or Media Center Pack software only together with the licensed computer."

The above makes the use of Win 8 Ttrial installations, without a Product Key, even more valuable.

[koganam]

I have successfully tested NT 7.0.1000.11 (Current) with Visual Studio Full and Express 2010 and 2012 versions on 32-bit Windows XP, Vista, and Windows 7 Ultra. On all the VS supported combinations, VS Express worked when a modified .csproj file was used.

The "Attach to Process" Debug option has been added to VS 2012 Express, which means that the same procedure used with the VS Full version can now be used with Express. A modified .csproj file is not required.

VS 2012 Ultra and VS Express 2012 for Windows 8 installations are blocked on the Release Preview Windows 8 Ultra because of a .Net Framework 4.5.50709 conflict.

I will be posting the VS Express modified .csproj files soon.

Just a quick reminder to all. VS2012 does not install, let alone run on Windez XP.

[Jim W.]

This is the last post of detailed program information. Switch to Display Mode of Hybrid and start at the post titled Summary if you are in another Display Mode.

[Jim W.]

Program Template

Below is a cut and paste template to get you started. Font is Arial 2. Make the post's title Program_Name.

It doesn't take long to knock one out. Start with a draft then make revisions until you like it, then post it to this thread.

Program_Name

NinjaScript Use: Brief description of how you use Program_name with NinjaScript.

Program_Name general description. Adapt info from its website.
Free: Yes or no. Explain if needed.
Website: Program_Name_Website_Link
Details: Useful information about how to use Program_Name with NinjaScript. Add image attachments if you can. Numbered checklists always help someone get started. Point out any sharp edges to save time and frustration.

[Jim W.]

WinZip

WinZip

NinjaScript Use: Selectively restore NinjaScripts from .ntbk files.

WinZip is the most popular file compression software with an innovative and easy-to-use feature set.
Free: No, but full function trialware is available
Website:http://www.winzip.com

Caution: The .ntbk file extension is associated with NinjTrader during installation. These files contain backups created by the NT Backup Utility. Left clicking or opening a .ntbk file starts NT in Restore mode. You have one chance to stop the restore of ALL files that were backedup into the file.

Details: To safely restore one or more NinjaScript files:
1) Right click on the .ntbk file and rename it adding .zip after the .ntbk extension. The new file's name will then end in .ntbk.zip and when opened will be associated with your compression utility instead of NinjaTrader.
2) Left click on the .zip file to start Winzip or your compression utility.
3) Extract the NinjaScript file(s) to a temporary folder.
4) Open the file(s) in the temp folder and verify that they are the ones that you want.
5) Rename the files to be replaced, changing their extension from .cs to .cs.old in
My Documents\NinjaTrader x\bin\Custom\Indicator or
My Documents\NinjaTrader x\bin\Custom\Strategy.
Note: The renamed file must NOT end in .cs to prevent future compilation errors.
6) Copy the temp file(s) to the NT Indicator or Strategy folders.
Note: The restored source will NOT be used until the next NinjaScript compile or NT startup. It is best to recompile immediately after restore to ensure that NT is functional on the next startup.
7) You can leave the .zip extension on the backup file. You only need to remove it should you want to restore all files that it holds with NinjaTrader.

[koganam]

Koganam,

Have taken your feedback and reorganized the program information under a Summary post.
It is best viewed in Hybrid Display Mode.

Thanks,

Jim

Jim, this is beautifully organized now, and easy to reference. Thanks a million. One day, I may write some replies pointing out free alternatives to the commercial programs that you have listed.

[Jim W.]

WinMerge

WinMerge

NinjaScript Use: Compare source versions. NotePad++ has a good Compare Plugin but WinMerge is better.

WinMerge is an Open Source differencing and merging tool for Windows. WinMerge can compare both folders and files, presenting differences in a visual text format that is easy to understand and handle. WinMerge is highly useful for determining what has changed between project versions, and then merging changes between versions.
Free: Yes Website: http://winmerge.org/
Details: Lets start by creating NinjaScript source to demonstrate WinMerge.
1) In the Indicators folder create a copy of @CustomPlotSample.cs with copy and paste.
2) Rename the copy to @CustomPlotSample.cs.201209121028.bak
3) Paste again and rename this copy to MyCustomPlotSample.cs
4) Paste again and rename this copy to MyCustomPlotSample.cs.201209121028.bak
5) Edit MyCustomPlotSample.cs and change the NinjaScript Line 24 to
publicclass MyCustomPlotSample : Indicator
Also change some source statements.
6) Compile the NinjaScript
7) Run a NT Backup of NinjaScripts
8) Rename the back file to c:\temp\2012-09-12.ntbk.zip
9) Left click on the zip file.
10) Expand the tree to see the Indicator folder
See first attachment

There are only two NinjaScripts. Why? NT Backup does NOT backup any NinjaScript folder files that begin with @. If you create new or make changes to files whose names begin with @ they will not be included in the backup. I have never seen this information in NT documentation. It is left for each NT user to discover for themselves.

Back to WinMerge example. The second attachment shows the differences between MyCustomPlotSample.cs.201209121028.bak and MyCustomPlotSample.cs. I have found that it is a good practice to alway put the older file on the left with WinMerge. In that way the added and remove indications make chronological sense.

See second attachment for WinMerge output

[Jim W.]

VMWARE Workstation

VMWARE Workstation

NinjaScript Use: Create a complete NinjaScripts development and testing environment in a Virtual Machine. The VM can be located on a SSD, so it is portable and can fit into a shirt pocket (antistatic bag or protective case recommended to prevent static damage).

Instead of carrying around just NinjaScript source you can have all your applications (NinjaTrader, VisualStudio, data source, 3rd party tools, etc.) ready to run on any computer that has WMWARE Workstation installed.
Free: No, but full function trialware is available
Website: http://www.vmware.com/products/workstation/overview.html
Details: Virtual Machines can be created from existing physical computers or from a new OS installation.

VMWARE Workstation allows new Vitrual Machines to be created directly from ISO files. Most OS ISO files on the Internet have malware installed. You can download safe Windows 7 SP1 ISO files from the links at http://www.w7forums.com/official-windows-7-sp1-iso-image-downloads-t12325.html . These are official, genuine ISO files from Microsoft. Thеѕе аrе NOT illegal – Thеѕе аrе јυѕt thе download links fοr Windows 7 SP1 ISO whісh іѕ a retail wrap thаt offers a 30-day trial period (extendable to 120 days with instructions here http://www.howtogeek.com/howto/windo...0-to-120-days/). Yου need tο activate уουr Windows afterwards wіth a genuine license activation key tο continue using іt after the 120 trial days. Downloading thеѕе files frοm Digital River іѕ absolutely legal аnԁ completely free οf charge.

Will Digital River remove the Windows 7 ISO files when Windows 7 is no longer sold? I don't know, you can still download Windows Vista Ultimate SP1. See http://answers.yahoo.com/question/index?qid=20120426200252AAmPoKe for links and instructions for turning the downloadable Vista Ultimate .exe files into an ISO file. The Vista trial is also extendable with the same instructions above.

I am still looking for links to safe Window 8 ISO files. I did find this information:

How to Install Windows 8 without a Product Key

http://tweaks.com/windows/65179/how-...a-product-key/

"For the first time since Windows XP, Microsoft is forcing users to enter a product key before Windows can be installed. This can be very annoying for legitimate users that simply want to install Windows 8 for testing. "

Note: The free MicrosoftWindows® Assessment and Deployment Kit is required to create the ISO file. To install the Windows ADK, your computer must be running one of the following operating systems:

• Windows® 8
• Windows® 7
• Windows Server® 2012
• Windows Server® 2008 R2
• Windows Vista®
• Windows Server® 2008

The steps described work. I have used the ISO file created to install a VM Windows 8 Pro without a product key. Starting with a Win 8 Pro upgrade ($40 until 1/31/2013) DVD instead of an ISO file, I copied the DVD to C:\Win8ISO folder in step 1 of "Once all the prerequisites are completed" section of the instructions. Following the remaining instructions created a good Windows 8 installation ISO file.

I have successfuly tested the ISO file by installing a Win 8 Pro VM with Workstation 9.0.1 and a DVD created from the ISO file to do a physical install. Attempts to install a VM from the DVD install fail with error:

"Windows cannot install the required files. ... Error code 0x80070714" .

Comparision of the genuine Win 8 Pro DVD and the DVDs created from the ISO file differ only in the modified EI.CFG file. I have tried different methods of creating the DVD from the ISO file but all DVDs gave the same result including one created with the Win 8 built-in ISO to DVD burner.

Windows 8 License Relating to Virtual Machines

The License for Windows 8 reads:

"e. Use in a virtualized environment. If you use virtualization software to create one or more virtual computers on a single computer hardware system, each virtual computer, and the physical computer, is considered a separate computer for purposes of this agreement. This license allows you to install only one copy of the software for use on one computer, whether that computer is physical or virtual. If you want to use the software on more than one virtual computer, you must obtain separate copies of the software and a separate license for each copy. Content protected by digital rights management technology or other full-volume disk drive encryption technology may be less secure in a virtualized environment."

And the related section reads:

"Can I transfer the software to another computer or user?
You may transfer the software to another computer that belongs to you. You may also transfer the software (together with the license) to a computer owned by someone else if a) you are the first licensed user of the software and b) the new user agrees to the terms of this agreement. To make that transfer, you must transfer the original media, the certificate of authenticity, the product key and the proof of purchase directly to that other person, without retaining any copies of the software. You may use the backup copy we allow you to make or the media that the software came on to transfer the software. Anytime you transfer the software to a new computer, you must remove the software from the prior computer. You may not transfer the software to share licenses between computers. You may transfer Get Genuine Windows software, Pro Pack or Media Center Pack software only together with the licensed computer."

The above makes the use of Win 8 Trial installations, without a Product Key, even more valuable.

Attachments:
1) VM desktop, installed software, and computer's properties.
2) SSD containing the VM.
3) All of the files that together make up the VM. Notice that I have chosen to create a 30 GB virtual hard drive stored in multiple 2 GB files.

[Jim W.]

Visual Studio

Visual Studio

NinjaScript Use: Debugging NinjaScripts

Free: Express Version is Free. Full Version has full function 90 day trialware.

Microsoft has released Visual Studio 2012 and 2012 Express. I have successfully tested NT 7.0.1000.11 (Current) with Visual Studio Full and Express 2010 and 2012 versions on 32-bit Windows XP, Vista, and Windows 7 Ultra. On all the VS supported combinations, VS Express worked when a modified .csproj file was used.

The "Attach to Process" Debug option has been added to VS 2012 Express, which means that the same procedure used with the VS Full version can now be used with Express. A modified .csproj file is not required.

VS 2012 Ultra and VS Express 2012 for Windows 8 installations are blocked on the Release Preview Windows 8 Ultra because of a .Net Framework 4.5.50709 conflict.

Visual Studio Supported Operating Systems

VS 2010

• Windows XP (x86) with Service Pack 3 – all editions except Starter Edition
• Windows XP (x64) with Service Pack 2 – all editions except Starter Edition
• Windows Vista (x86 & x64) with Service Pack 1 – all editions except Starter Edition
• Windows 7 (x86 & x64)
• Windows Server 2003 (x86 & x64) with Service Pack 2
• Windows Server 2003 R2 (x86 & x64)
• Windows Server 2008 (x86 & x64) with Service Pack 2
• Windows Server 2008 R2 (x64)

VS 2012 for Windows Desktop

• Windows 7 (x86 and x64)
• Windows 8 (x86 and x64)
• Windows Server 2008 R2 (x64)
• Windows Server 2012 (x64)

Website:http://www.microsoft.com/visualstudio/11/en-us/downloads?CR_CC=200115956&WT.mc_id=MSCOM_EN_US_SEA RCH_MSSUGGESTS_131V1ENUS26853

Details: The best place to start is searching NT Help for "visual studio debugging". There are many post in the NinjaTrader Support Forum regarding Visual Studio sometimes abbreviated as just VS followed by the year version number or combined into VisualStudio. They refer to various version of NT and Visual Studio.

The instructions that yuvalw posted for debugging NT with VS Express are below. His instructions revised for VS 2010 Express and for NT7 are:

1) Open Visual Studio.
2) Create new project (I created regular console application), let's call it NinjaTraderDebug.
3) Save the project and close Visual Studio 2010 Express.
4) Go to the My Document / Visual Studio 2010 / Project / NinjaTraderDebug / NinjaTraderDebug / directory and open with notepad the NinjaTraderDebug.csproj file. Caution there are two files, one ends in .csproj and the other csproj.user. If you do not show extensions then it is easy to select the wrong one ending in .user.
5) Insert the lines below in the three locations shown in the attachment. Of course you need to use your path to NinjaTrader.exe.

<StartAction>Program</StartAction>
<StartProgram>
C:\Program Files\NinjaTrader 7\bin\NinjaTrader.exe
</StartProgram>

6) Close NinjaTrader if it is opened.
7) Open the ninjatraderDebug project in VisualStudio.
8) Hit "Play" (F5), this will launch NinjaTrader and will attach to it.

These last three steps are very important when debugging with either Visual Studio or Visual Studio Express. Debug Mode will remain enabled until you disable it and recompile a NinjaScript.

9) In the NinjaScript Editor enable "Debug Mode" by right clicking on the script source and clicking the option.
10) Be sure to compile the NinjaScript assembly afterwards by pressing "F5" on your keyboard.
11) Open the NinjaScript source file within Microsoft Visual Studio and set your break point(s).

In subsequent NT debugging sessions with VS 2010 Express:

1) Close NinjaTrader if it is running.
2) Start VS 2010 Express
3) Open the NinjaTraderDebug VS project.

Note: Any breakpoints previously set in NinjaScripts will be displayed as hollow circles until you compile a NinjaScript with NT Debug Mode enabled.

4) Select from the Toolbar: Debug | Start Debugging or F5
5) Edit any NinjaScript with NT Edit.
6) Compile the NinjaScript with NT.
7) Now that VS has the needed symbol information from NT Debug Mode, VS breakpoints will be displayed as solid red circles.
8) Use the VS F5 key to continue between breakpoints.

[Jim W.]

Talking Alarm Clock &amp; Talking Desktop Clock

Talking Alarm Clock
NinjaScript Use: Maintain Temporal Awareness

Talking Alarm Clock set reminders for important dates and events.
Free: Freeware. Donate if you find useful.
Website: http://www.cinnamonsoftware.com/alarm_clock.htm
Details: Manually set alerts to fire at the specified date/time. See first four attachments for options. I have not tried to programatically set alerts with C# but I suspect that it is possible.


Talking Desktop Clock
NinjaScript Use: Maintain Temporal Awareness

Talking Desktop Clock says time or plays chime at specified intervals.
Free: Freeware. Donate if you find useful.
Website: http://www.cinnamonsoftware.com/desktop_clock.htm
Details: It is easy to lose track of time while coding or testing NinjaScripts. I set Talking Desktop Clock to display a custom desktop analog clock and announce the time at ten minute intervals during the trading day. See fifth attachment.

Note: If you do not work in private, these programs may become an annoyance to those who work near you.

[Jim W.]

Snagit

Snagit

NinjaScript Use:
* Document your NinjaScript output and parameters.
* Capture error messages during debugging.
* Create examples for support or suggestion submission.

With Snagit’s full list of features you can capture anything, enhance your images, work more efficiently, and share your work with just a click.
Free: No but full function trialware available
Website: http://www.techsmith.com/snagit.html
Details: So powerful and easy to capture anything on your screen. The Snagit Editor then allows you to do anything that you want to and with the image.

All of the attachments to my posts are created with Snagit.

There are two Snagit Editor features that I find unique and very useful:

Color Substitution - Replaces a color with one other color. All black pixels can be replaced with white pixels and white with black.

Invert Colors - Inverts the RGB color values.

I submitted a suggestion to add these features to NT in 2008:
Printing/displaying charts with black backgrounds
http://www.ninjatrader.com/support/forum/showthread.php?t=6062

If you would like to have these features in NT please add your vote to the suggestion thread above. That would make a difference.

[Jim W.]

Search &amp; Replace

Search & Replace

NinjaScript Use: Search NinjaScript folders for working examples of NinjaScripts facilities that you want to use.

Search & Replace is a very powerful utility for searching and optionally replacing text within files. There are Shareware, Classic, Replace Studio Pro and Replace Studio Business Edition versions.
Free: Basic version is Shareware at http://www.funduc.com/srshareware.htm . Advanced versions are very reasonably priced at http://www.funduc.com/search_replace.htm
Website: http://www.funduc.com/

Caution: This software has very powerful Replace capabilities. Learn to use the Replace functions with files in a temp folder.

Details: To search the Indicators for examples of the unsupported ChartControl:
1) Download and install Shareware version http://www.funduc.com/srshareware.htm .
2) By default SR installs to "C:\Program Files\SR\SR32.exe"
3) Start SR
4) Enter the Search for text, File Mask and Path (Win 7 path shown) then click the left most Blue Binocular icon. It is the Search icon the Purple Binocular icon is Replace.
5) Click the BLUE Binocular icon to search all the files in the folder. There is a Subfolder icon that allows subfolder search.
See first attachment
6) Scroll down to find a file of interest
7) Right clicking on the file name brings up the available action. Select Open with … then select Notepad++
See second attachment
8) Scroll NotePad++ to see lines of interest. Lines can be copied to the clipboard among other things.
See third attachment