Forums / Cotonti / Support / Tips for better performance with Siena ?

12>>>

Upgraded to Siena from Genoa, using much more resources than before

singh336
#1 2014-01-16 17:34

Hey, 

 

A couple months ago I upgraded to Siena from Genoa 6.15 or something like that. I since noticed a huge decrease in overall website performance, load times etc.

 

Before the upgrade our usage was around

30-60% CPU load hourly average / daily average

200k Hits daily

I'll post some screenshot stats here so you get an idea. 

I'm wondering what actions can I take to increase the performance? I am not saying this is all due to Siena, but I just plainly have not had an issue until the upgrade. Maybe its all by chance.

What I did so far:

  • I've minified and combined CSS and JS via the control panel
  • I've disabled all hit / refferrer statistics that I could plugin wise (I miss having the latest weeks activity on the admin home page though)
  • I've optmized all images that I could within the sites design.
  • I went through the top 10 KB File Usage list to see what files were / are using the most bandwidth, I fixed some serious problems that way but that was more to do with bandwidth which is not a HUGE concern, but still something I want to control and I'm happy at the level I am at now, about 200-500GB per month, it fluctuates a lot for whatever reason.
  • I checked the top list of most used files and rc.php which handles the css and js etc is pretty heavy, didn't know what to do there.

I understand I can't fix everything and even though I can make some more additional changes, it may not be worth what I give up in order to do so.

 

I just moved to a slightly better server, I want to see what I can do without spending too much more on hosting because my budget for hosting isn't very much at this time.

 

Any help is appreciated

 

Added 11 minutes later:

plz delete this is a duplicate, my mistake.

<a href="http://www.streetlegalmods.com/">http://www.streetlegalmods.com/</a>
This post was edited by singh336 (2014-01-17 05:44, 10 years ago)
Trustmaster
#2 2014-01-16 19:15

Please edit the post instead of duplicating it.

Siena is slower than Genoa out of the box simply because it has lots more in it. Here is what you should check first of all in config.php:

  • $cfg['cache'] = TRUE;
  • $cfg['xtpl_cache'] = TRUE;

If you have APC or Xcache or Memcached, you can also try enabling its variable cache:

  • $cfg['cache_drv'] = 'Xcache'; // APC or Memcache

Then go to Administration / Configuration.

  • In News plugin configuration set Cache TTL to 300 or above.
  • In Recent items plugin configuration set Cache TTL to 60 or above.

If it doesn't help, then further SQL query statistics analysis is required.

 

May the Source be with you!
singh336
#3 2014-01-17 05:43

Thank you, I will try this now, this is good to know.

 

 

And also, I did not purposely duplicate these threads, what happened was I posted the topic, then realized BBcode wasn't working, tried to hit back and edit the post (no idea why i did that) and when saving changes i have no idea i was posting a topic three times.

 

Posting images on here is a little funky but i understand now.

Added 6 minutes later:

Both of those config settings are already enabled, the template cache as well as the normal cache.

 

These were false, im assuming they must be since the content changes so often ?

 

$cfg['cache'] = TRUE;
$cfg['cache_drv'] = '';
$cfg['cache_index'] = FALSE;
$cfg['cache_page'] = FALSE;
$cfg['cache_forums'] = FALSE;

Added 3 minutes later:

News and recent items cache was both set off, so i changed them to 600 for news and 180 for recent items.

 

The site is somewhat active daily, so recent items especially forums and pages do change hourly, and news changes/ updates a few times a week or sometimes daily. Will this affect the new info showing up for returning visitors? How does enablding cache affect this?

 

Thank you

<a href="http://www.streetlegalmods.com/">http://www.streetlegalmods.com/</a>
This post was edited by singh336 (2014-01-17 05:53, 10 years ago)
Trustmaster
#4 2014-01-17 07:39

$cfg['cache'] and $cfg['cache_drv'] don't depend on content change frequency, they simply speed things up and are highly recommended. Your site might be 30-50% slower if you have cache disabled (btw, it's enabled by default in Genoa too).

Just these 3 are experimental and moreover they won't work properly on your site because they are not compatible with URLeditor plugin yet:

$cfg['cache_index'] = FALSE;
$cfg['cache_page'] = FALSE;
$cfg['cache_forums'] = FALSE;
May the Source be with you!
Macik
#5 2014-01-17 16:13

singh336, if you speak about increasing CPU usage then SQL usage is first that shoulb be checked (after enabling CMS cache).

First of all check Hosting statistics for MySQL if aviable or at least through debug mode on site.  

By the way what size of graphic files (site design and user personal files) do you had on site? I can help to optimize (minify) it.

https://github.com/macik
правильный хостинг — https://goo.gl/fjCa1F
singh336
#6 2014-01-18 04:24

@trustmaster - Okay thanks for the info, then should i put "TRUE" for cacghe_drv variable also? Right now you see its blank, not even false ...

 

@Macik - okay , well I think the graphics are not BAD, they aren't the best I could lighten the design up more, probably more so in CSS and JS than actual image files. However, the bandwidth is in an example range, my real issues was with cpu usage.

 

I posted screenshots above of MYSQL stats as well as all other stats I can find, including bandwidth and most used files etc Stats above in the screens also show everything I can find right now.

 

Does it make a difference if I enabled or disable the recent activity plugin for the admin home page showing me last 7 days hits / new members etc ? I would like to have it enabled but disabled it for now.

<a href="http://www.streetlegalmods.com/">http://www.streetlegalmods.com/</a>
Macik
#7 2014-01-18 06:50
#39012 singh336:

Does it make a difference if I enabled or disable the recent activity plugin for the admin home page showing me last 7 days hits / new members etc ? I would like to have it enabled but disabled it for now.

Think it would not sensible. You can view list of SQL queries for certain page with DEBUG mode and {FOOTER_DEVMODE} tag. So you can compare both variants for end SQLs.

https://github.com/macik
правильный хостинг — https://goo.gl/fjCa1F
singh336
#8 2014-01-22 03:14

You are saying it would not be sensible to disable it for performance or it would not be sensible to keep it enabled ?

 

 

Also, I wanted to ask is there a way to use memcached with cotonti ? I have that option but I am not using it..

<a href="http://www.streetlegalmods.com/">http://www.streetlegalmods.com/</a>
Macik
#9 2014-01-22 16:33
#39042 singh336:

You are saying it would not be sensible to disable it for performance or it would not be sensible to keep it enabled ?

I speak about sensible for perfomance.

Also, I wanted to ask is there a way to use memcached with cotonti ? I have that option but I am not using it..

As manuall says for `$cfg['cache_drv']` — possible values: APC, eAccelerator, Memcache, Xcache. But I'm not tested it for perfomance on production.

https://github.com/macik
правильный хостинг — https://goo.gl/fjCa1F
singh336
#10 2014-01-27 00:11
 

Also, I wanted to ask is there a way to use memcached with cotonti ? I have that option but I am not using it..

As manuall says for `$cfg['cache_drv']` — possible values: APC, eAccelerator, Memcache, Xcache. But I'm not tested it for perfomance on production.

 

I would like to know more information on this, So far the adjustments I have made might of helped a bit.. but nothing too good yet.

 

How can I take advantage of this , how to use memcache?

 

Thank you

<a href="http://www.streetlegalmods.com/">http://www.streetlegalmods.com/</a>
Twiebie
#11 2014-01-27 01:03

As Trustmaster and Macik pointed out, you can simply tell Cotonti which cache driver to use in ./datas/config.php.

The extension obviously has to be installed and enabled on your server, so you should check this with for example: phpinfo(); or if you have CLI access you can simply do php -m

Installing the earlier mentioned extensions is well documented and easy to find on Google.

You have a couple images linked on your site that are hosted externally.
These take a lot of time to load, and some simply just result in a 404.

Host and cache as much as you can on your own server so the browser doesn't have to constantly look up external sources.

http://wehateie.co.uk/images/button.gif
http://cheapghdflatiron.gitix.org/images/button.gif
http://cheapghdoutlet.marvellousmable.com/images/button.gif
http://hairgifts.marvellousmable.com/images/button.gif
http://ghdoutletaustraliacheap.info/images/button.gif

http://tools.pingdom.com/fpt/#!/zASEu/http://streetlegalmods.com/

This post was edited by Twiebie (2014-01-27 01:19, 10 years ago)
singh336
#12 2014-01-27 22:02

Okay, i have memcached instaled on my server so i'll ask for help on how to get that setup with my server admins. I'll enable it with the config first.

 

 

 had no idea about the above links button.gif.. wtf.

 

I can't always control what is hosted on my site and what isn't because a lot of the content is user submitted

<a href="http://www.streetlegalmods.com/">http://www.streetlegalmods.com/</a>
Twiebie
#13 2014-01-27 22:20
#39101 singh336:

I can't always control what is hosted on my site and what isn't because a lot of the content is user submitted

That is definitely something to think about.

singh336
#14 2014-01-27 23:27

Yeah since posting I been thinking about ways to work with that... I'll ask everyone submitting pages to upload the files to our server and also optimize them,they dont have to be 3000 pixels and 4mb... ridiculous.

 

Anyways I deleted those dead images and it helped a bit. but with that tool you linked me to, there is always a HUGE wait time for the site its self.. :(

Added 36 minutes later:

I'm looking into using expire headers for the skin files now

Added 18 minutes later:

Using some tools to check the websites performance I see this:

 

Resources with a "?" in the URL are not cached by some proxy caching servers. Remove the query string and encode the parameters into the URL for the following resources:

 

What can or should I do about that?

Added 5 minutes later:

I also see i have the option of using zend_optimizer and APC, what should I do, which one to use, or will that conflict with memcache or just not do anything?

Added 37 minutes later:

Screen_Shot_2014-01-27_at_80210_PM.png

 

So i made some changes to htaccess to cache images and stuff etc , it looks like the score is better and the tool shows improvements, but its still complaining about the CSS and JS

Added 6 minutes later:

Screen_Shot_2014-01-27_at_80716_PM.png

 

here is a shot from another tool also showing an issue with the CSS and JS links using "?" 

 

Also it complains about image dimensions , some of them are within the content but some seem to be in the CMF side, which of course I can still fix but maybe you guys would consider doing something with that for future releases? idk if thats a big deal or not

Added 60 minutes later:

Also have an option to use this

 

Varnish

Varnish Cache is a web application accelerator also known as a caching HTTP reverse proxy. You install it in front of any server that speaks HTTP and configure it to cache the contents. Varnish Cache is really, really fast. It typically speeds up delivery with a factor of 300 - 1000x, depending on your architecture. One of the key features of Varnish Cache, in addition to its performance, is the flexibility of its configuration language, VCL. VCL enables you to write policies on how incoming requests should be handled. In such a policy you can decide what content you want to serve, from where you want to get the content and how the request or response should be altered.

 

Any thoughts?

<a href="http://www.streetlegalmods.com/">http://www.streetlegalmods.com/</a>
This post was edited by singh336 (2014-01-28 02:08, 10 years ago)
Trustmaster
#15 2014-01-28 06:44

Page created in 1.864 secondsSQL total time: 1.585 seconds - SQL queries: 38 - Average SQL time: 0.04171 seconds

Page created in 0.785 secondsSQL total time: 0.625 seconds - SQL queries: 37 - Average SQL time: 0.01689 seconds

Your actual problem is SQL performance. We need to analyze queries in {FOOTER_DEVMODE}.

 

May the Source be with you!

12>>>