Reply

[How To] Tune SQ for max performance and reduce memory usage by 4 to 5 times

99 replies

geektrader

Customer, bbp_participant, community, 542 replies.

Visit profile

6 years ago #130207

If you want to make a shortcut to it, you have to use:

 

“F:\Program Files (x86)\StrategyQuant\StrategyQuant64.exe” -J-server -J-Xmx13g -J-XX:+UseParallelGC -J-XX:+UseParallelOldGC -J-XX:+DisableExplicitGC -J-XX:+AggressiveOpts

0

Threshold

Customer, bbp_participant, community, 725 replies.

Visit profile

6 years ago #130208

Cool, that works! Thanks.

Wow, its incredibly faster!

You use these settings always now in SQ? Any disadvantages? Leak become more of an issue?

0

geektrader

Customer, bbp_participant, community, 542 replies.

Visit profile

6 years ago #130210

No, all good and even less leaks. Additionally to this launch-line, I´d also recommend to replace the JVM from Oracle to the one from Zulu, you will get even more speed and less RAM usage with this one as it is a straight build of the OpenJDK sources (the original Java) without Oracles branding and other things added to it. You can get it here: http://www.azulsystems.com/products/zulu/downloads  Just install it and afterwards rename the directory “j64” in your StrategyQuant directory to “j64.old”. Create a new “j64” directory and copy the complete Zulu installation into the newly created “j64” directory. All done, time to build strategies:)

0

Threshold

Customer, bbp_participant, community, 725 replies.

Visit profile

6 years ago #130219

Leaks way down. 250k gen would put me ~ 3.5-4gigs.
Now 2.

I’ll check out Zulu as well.

0

geektrader

Customer, bbp_participant, community, 542 replies.

Visit profile

6 years ago #130236

Yes, you will get even less leaks with Zulu, that´s the great thing about it.

0

matka

Customer, bbp_participant, community, 189 replies.

Visit profile

6 years ago #130403

Geektrader you are the man. Mark please pin this topic.

0

geektrader

Customer, bbp_participant, community, 542 replies.

Visit profile

6 years ago #130428

Did it help for you too? Did you also replace the JVM with Zulu or just used the command line?

0

matka

Customer, bbp_participant, community, 189 replies.

Visit profile

6 years ago #130436

I have just started 2 instances on my intel with command line from the first post, both with max cores set. I dont know how much it will speed up my proces, I do random for weeks so lets wait and see. I cant do proper compare test at the moment, sorry. Have not installed alternative lib yet.

Have you been thinking about optimized OS for SQ in form of kickstarter? Some people here have been working on unix version with limited support from Mark. Imagine what we can achieve with lets say OpenBSD as base.

Best regards

M

0

Mark Fric

Administrator, sq-ultimate, 3 replies.

Visit profile

6 years ago #130440

I’m watching this topic, we will use this setting in the new SQ and EAA release. I’m also investigating using Zulu JVM, maybe we’ll include it in the next release instead of standard Java JVM.

 

Anyway, thank you for the good work, Geektrader.

Mark
StrategyQuant architect

0

geektrader

Customer, bbp_participant, community, 542 replies.

Visit profile

6 years ago #130487

You are welcome. I´ve adjusted post #1 further and did cut the command line down a bit as the Zulu JVM already auto-selects the best garbage collector and it´s best to not specify it in this case because of compatibility with future JVM versions.

0

daveM

Subscriber, bbp_participant, community, customer, 111 replies.

Visit profile

6 years ago #130641

WOW, thanks for sharing your research!

0

eastpeace

Customer, bbp_participant, community, 296 replies.

Visit profile

6 years ago #130659

Add the command line  (with 13GB, and I have 16G ) , and replace jre with Zulu.

 

Building strategy become more faster.

 

Geektrader, your sudy is very valuable. Thank you.

 

But when I do “Retest strategies”, It’s not very obvious.

 

And I have a question, SQ just only use 6-8G memory (cpu 50-80% used), even I  allocate 13GB in command line.

0

geektrader

Customer, bbp_participant, community, 542 replies.

Visit profile

6 years ago #130660

Yes, speed gain is mostly during building and optimizing, retesting is not that affected, not sure why, but at least it also uses less memory:)

 

SQ will only use as much RAM as it currently requires. The 13GB are just the maximum it is allowed to take. So it´s normal….

0

geektrader

Customer, bbp_participant, community, 542 replies.

Visit profile

6 years ago #130685

I am currently total swamped with work, not sure when and if I can do it. But someone else might be able to help as well though…

0

patriciadugan_

Subscriber, bbp_participant, community, 1 replies.

Visit profile

6 years ago #130748

Hello there. 

 

I am Patricia, Director of Community at Azul Systems. Thank you very much for this dialogue and info share. If there is anything our team may be of help with in regards to using Zulu or our technologies, please do get in touch with me. 

 

Please check out the following resources:

 

http://zulu.org 

http://azulsystems.com

 

Twitter:

 

Our CTO, Gil Tene:     @giltene   https://twitter.com/giltene

Me:      @patricia_dugan  https://twitter.com/patricia_dugan 

Azul Systems:  @azulsystems https://twitter.com/AzulSystems 

 

We welcome all feedback! Please let me know how we may be of service.

 

Many thanks,

 

Patricia Dugan

pdugan at azulsystems.com 

0

Viewing 15 posts - 16 through 30 (of 100 total)

1 2 3 5 6 7