Welcome! Log In Create A New Profile

Advanced

stats help

Posted by Spike 
Spike
stats help
July 25, 2010 08:20AM
hi, i am newbie to memcached. I need help in finding how to get
throughput stat.

I want to see how much throughput memcache is getting. "stats" command
does not list any stat for through put (requests per sec). Any idea on
how to go about getting that info? Does memcache keep track of this
information?

Thanks for help!
Dustin
Re: stats help
July 25, 2010 09:40AM
On Jul 24, 10:39 pm, Spike <[email protected]> wrote:
> hi, i am newbie to memcached. I need help in finding how to get
> throughput stat.
>
> I want to see how much throughput memcache is getting. "stats" command
> does not list any stat for through put (requests per sec). Any idea on
> how to go about getting that info? Does memcache keep track of this
> information?

It's rare to keep derived stats like that in general. It's usually
not interesting. Do you want average requests per second over the
lifetime of the process? Over the last second?, 60 seconds? 300, 900,
3600, etc...

Most of the time, this is easily observable from the outside.
Collect counters -- wait a bit, collect them again, then do your own
math. That'll give you exactly what you want.
Olga Khenkin
Re: stats help
July 25, 2010 09:40AM
Hi,

Take stats every minute, calculate the delta - and you have throughput per
minute.

On Sun, Jul 25, 2010 at 8:39 AM, Spike <[email protected]> wrote:

> hi, i am newbie to memcached. I need help in finding how to get
> throughput stat.
>
> I want to see how much throughput memcache is getting. "stats" command
> does not list any stat for through put (requests per sec). Any idea on
> how to go about getting that info? Does memcache keep track of this
> information?
>
> Thanks for help!
>
>
Les Mikesell
Re: stats help
July 25, 2010 06:30PM
Dustin wrote:
> On Jul 24, 10:39 pm, Spike <[email protected]> wrote:
>> hi, i am newbie to memcached. I need help in finding how to get
>> throughput stat.
>>
>> I want to see how much throughput memcache is getting. "stats" command
>> does not list any stat for through put (requests per sec). Any idea on
>> how to go about getting that info? Does memcache keep track of this
>> information?
>
> It's rare to keep derived stats like that in general. It's usually
> not interesting. Do you want average requests per second over the
> lifetime of the process? Over the last second?, 60 seconds? 300, 900,
> 3600, etc...
>
> Most of the time, this is easily observable from the outside.
> Collect counters -- wait a bit, collect them again, then do your own
> math. That'll give you exactly what you want.

It's a bit off topic for this list, but does anyone know if there are good
generic tools for that? There are quite a few designed to convert SNMP
'COUNTER' types to rates, check thresholds and keep history to graph the trends,
but usually the SNMP sampling is closely coupled to the rest of the logic. I
think OpenNMS might do it with values it can pick up with http requests but I'm
not sure how well it handles the spikes that would appear from restarts and
value rollovers.

--
Les Mikesell
lesmikesell@gmail.com
Gavin M. Roy
Re: stats help
July 25, 2010 06:40PM
I use RRDTool for this with derive counter types. Collect the data you want
from the stats command and use rrdtool to store the data every minute, graph
it out with rrdtool graph and you'll get your trended stats.

On Sun, Jul 25, 2010 at 12:27 PM, Les Mikesell <[email protected]>wrote:

> Dustin wrote:
>
>> On Jul 24, 10:39 pm, Spike <[email protected]> wrote:
>>
>>> hi, i am newbie to memcached. I need help in finding how to get
>>> throughput stat.
>>>
>>> I want to see how much throughput memcache is getting. "stats" command
>>> does not list any stat for through put (requests per sec). Any idea on
>>> how to go about getting that info? Does memcache keep track of this
>>> information?
>>>
>>
>> It's rare to keep derived stats like that in general. It's usually
>> not interesting. Do you want average requests per second over the
>> lifetime of the process? Over the last second?, 60 seconds? 300, 900,
>> 3600, etc...
>>
>> Most of the time, this is easily observable from the outside.
>> Collect counters -- wait a bit, collect them again, then do your own
>> math. That'll give you exactly what you want.
>>
>
> It's a bit off topic for this list, but does anyone know if there are good
> generic tools for that? There are quite a few designed to convert SNMP
> 'COUNTER' types to rates, check thresholds and keep history to graph the
> trends, but usually the SNMP sampling is closely coupled to the rest of the
> logic. I think OpenNMS might do it with values it can pick up with http
> requests but I'm not sure how well it handles the spikes that would appear
> from restarts and value rollovers.
>
> --
> Les Mikesell
> lesmikesell@gmail.com
>
>
Spike
Re: stats help
July 25, 2010 06:50PM
Okay. Thanks Guys! Appreciate your help. Just wanted to make sure I
wasn't missing any other stats command to get this information.
Les Mikesell
Re: stats help
July 25, 2010 07:00PM
I know rrdtool (and the jrobin equivalent in java) can do it, but that's a
fairly low level tool. I was hoping to find some generic framework that could
accept either counter or gauge type values and do the rest for you including a
web graph display. I'd think this would be a common problem but I haven't found
any high-level tools that aren't married to snmp for the input.

-Les


Gavin M. Roy wrote:
> I use RRDTool for this with derive counter types. Collect the data you
> want from the stats command and use rrdtool to store the data every
> minute, graph it out with rrdtool graph and you'll get your trended stats.
>

> hi, i am newbie to memcached. I need help in finding how to get
> throughput stat.
>
> I want to see how much throughput memcache is getting.
> "stats" command
> does not list any stat for through put (requests per sec).
> Any idea on
> how to go about getting that info? Does memcache keep track
> of this
> information?
>
>
> It's rare to keep derived stats like that in general. It's usually
> not interesting. Do you want average requests per second over the
> lifetime of the process? Over the last second?, 60 seconds?
> 300, 900,
> 3600, etc...
>
> Most of the time, this is easily observable from the outside.
> Collect counters -- wait a bit, collect them again, then do your own
> math. That'll give you exactly what you want.
>
>
> It's a bit off topic for this list, but does anyone know if there
> are good generic tools for that? There are quite a few designed to
> convert SNMP 'COUNTER' types to rates, check thresholds and keep
> history to graph the trends, but usually the SNMP sampling is
> closely coupled to the rest of the logic. I think OpenNMS might do
> it with values it can pick up with http requests but I'm not sure
> how well it handles the spikes that would appear from restarts and
> value rollovers.
>
> --
> Les Mikesell
> lesmikesell@gmail.com <mailto:[email protected]>
>
>
Dustin
Re: stats help
July 25, 2010 08:50PM
On Jul 25, 9:53 am, Les Mikesell <[email protected]> wrote:
> I know rrdtool (and the jrobin equivalent in java) can do it, but that's a
> fairly low level tool.  I was hoping to find some generic framework that could
> accept either counter or gauge type values and do the rest for you including a
> web graph display.  I'd think this would be a common problem but I haven't found
> any high-level tools that aren't married to snmp for the input.

There are tons of tools built on top of rrdtool. I still often end
up writing my own just because I want something slightly different out
of the graphs than the pre-built tools can do. Sort of makes it seem
like rrdtool is the right level.
Matthew West
Re: stats help
July 26, 2010 02:10AM
> hi, i am newbie to memcached. I need help in finding how to get
> throughput stat.
>
> I want to see how much throughput memcache is getting. "stats" command
> does not list any stat for through put (requests per sec). Any idea on
> how to go about getting that info? Does memcache keep track of this
> information?
>
> Thanks for help!
>

Hey Spike,

I've actually put together a plugin for Munin which does this, as well as
graph information on a per slab level. It covers at least 90% of all
information that memcached will give in stats in some manner. This plugin
requires memcached v.1.4.2+ ... If you are running memcached v1.2.x branch
let me know and I can point you to my older plugin.

You can find the memcached plugin for munin I created here at:
http://exchange.munin-monitoring.org/plugins/memcached-multigraph/details

And you can find the latest version of munin at:
http://munin-monitoring.org/

Granted this brings another piece of software into the mix, but you should
be running something similar to this in a production environment so you can
properly track a system / environment's health as it grows.

I haven't had much time to work on expanding the plugin even more, but I
hope to have some time to commit some new changes / expand its abilities
even more in the next few weeks.

Ciao,

--

Matt West
mwest@zynga.com
ntang
Re: stats help
July 26, 2010 07:30AM
Adam Lee
Re: stats help
July 26, 2010 06:50PM
I'm not in love with a lot of its inner workings, but Cacti is built on
rrdtool and very capable in terms of memcached graphing. It has plugins
that let you generate graphs for things like Hits/Misses, Bytes Used, Sets,
Gets, Network Traffic, Items Cached, etc...

http://dealnews.com/developers/cacti/memcached.html
http://dealnews.com/developers/cacti/memcached.html
On Sun, Jul 25, 2010 at 12:53 PM, Les Mikesell <[email protected]>wrote:

> I know rrdtool (and the jrobin equivalent in java) can do it, but that's a
> fairly low level tool. I was hoping to find some generic framework that
> could accept either counter or gauge type values and do the rest for you
> including a web graph display. I'd think this would be a common problem but
> I haven't found any high-level tools that aren't married to snmp for the
> input.
>
> -Les
>
>
>
> Gavin M. Roy wrote:
>
>> I use RRDTool for this with derive counter types. Collect the data you
>> want from the stats command and use rrdtool to store the data every minute,
>> graph it out with rrdtool graph and you'll get your trended stats.
>>
>>
> hi, i am newbie to memcached. I need help in finding how to get
>> throughput stat.
>>
>> I want to see how much throughput memcache is getting.
>> "stats" command
>> does not list any stat for through put (requests per sec).
>> Any idea on
>> how to go about getting that info? Does memcache keep track
>> of this
>> information?
>>
>>
>> It's rare to keep derived stats like that in general. It's
>> usually
>> not interesting. Do you want average requests per second over the
>> lifetime of the process? Over the last second?, 60 seconds?
>> 300, 900,
>> 3600, etc...
>>
>> Most of the time, this is easily observable from the outside.
>> Collect counters -- wait a bit, collect them again, then do your
>> own
>> math. That'll give you exactly what you want.
>>
>>
>> It's a bit off topic for this list, but does anyone know if there
>> are good generic tools for that? There are quite a few designed to
>> convert SNMP 'COUNTER' types to rates, check thresholds and keep
>> history to graph the trends, but usually the SNMP sampling is
>> closely coupled to the rest of the logic. I think OpenNMS might do
>> it with values it can pick up with http requests but I'm not sure
>> how well it handles the spikes that would appear from restarts and
>> value rollovers.
>>
>> -- Les Mikesell
>> lesmikesell@gmail.com <mailto:[email protected]>
>>
>>
>>
>


--
awl
Sorry, only registered users may post in this forum.

Click here to login