Java simple Analytics/Event Stream Processing with front end

My application takes a lot of measurements of it's internal processes. For example I time certain methods, I time external webservice calls and I also have variables which have a changing value, and processes which have a 'state' (e.g. PAUSED, WAITING etc).

The application uses 100 to 200 threads, and each bit of data would be associated with a particular thread.

I am looking for some software that I can channel all this information into that would produce useful metrics and graphs of the data (ideally in real time or close to real time), let me set thresholds to trigger warnings, would allow me to filter the data by thread or thread group, etc etc.

The application is performing time critical tasks so the software/api would need to be very fast and never block.

The application is written in java, and ideally the software/api would be in java as well. I think what I'm looking for is called Event Stream Processing, but I'm really not sure what language to use to describe it.

All I've found so far are Esper and ERMA. Can anyone give me a recommendation? I'm the only one working on this project so I'm hoping for something that is pretty easy to set up and use, and has a workable front end.


In the end I found Graphite which was pretty close to being exactly what I wanted. Not the simplest to set up and configure however, but I got it working in the end.

In my case I send data directly from my application to Statsd (via UDP), which collects the data and does some pre processing before it ends up in the whisper back end, there is a simple example of a java interface here

Alternatively you could send your data directly to graphite, example here

Need Your Help

Making DIV in an IFRAME scrollable

ipad html mobile iframe scrollable

can you guys help me to see this? I need to make a div in an iframe (loads Page A) in Page B to scroll. This is my site, will give you a better picture:

VS Lightswitch and MS Access DB?

.net visual-studio silverlight ms-access visual-studio-lightswitch

Can I use Visual Studio Lightswitch togehter with an MS-Access DB?

About UNIX Resources Network

Original, collect and organize Developers related documents, information and materials, contains jQuery, Html, CSS, MySQL, .NET, ASP.NET, SQL, objective-c, iPhone, Ruby on Rails, C, SQL Server, Ruby, Arrays, Regex, ASP.NET MVC, WPF, XML, Ajax, DataBase, and so on.