Articles tagged DCP

The views expressed in this blog are strictly personal, and do not necessarily represent the views of Evident Software.

By jclark

The folks over at RightScale wrote up a great post on Cluster Monitoring with some new visualizations they’ve been using. The visualizations were certainly interesting (especially to me) but there is a key message in the post. The big takeaway is the importance of having a consolidated time series view of multiple entities so the effect of an anomaly can easily be seen across an environment. In a clustered environment, individual entities are inevitably related and an entity in trouble can, over time, affect other entities. The RightScale folks clearly showed this in their use case. The difficulty becomes when the density of information becomes too great to discern a problem. Imagine 1000 servers represented in a heatmap with 600,000 data points. The amount of information needed to be shown could exceed the number of pixels you have available to show it! But an environment of that size would not likely be in the hands of a developer where detail is critical. Production environments can conceivably reach 100′s or 1000′s of entities and the monitoring needs change along with the change in roles between Developer and Operations (DevOps). Information critical to developers can become “noise” to Operations folks. The detailed information needs to be distilled down to exceptions that are leading to, or clearly indicate, a problem in the environment.

In Evident ClearStone, we bridge to gap between developers and operators by providing exception focused views backed by the detail used to evaluate the exception condition. Furthermore, there is value in showing dissimilar but related entities like the constituent components of a NoSQL or Data Caching Platform (DCP) fabric to see cause and effect of related cascading failures. Below is a summarized view of various Oracle Coherence components showing health indicators for every 30 seconds of the last 15 mins. The color of the health indicator represent severity healthy condition.

Using the exception focused view above, specific details of a particular entity or entities to attempt to determine a root cause.

By Scott Barnett

Our friends at Shopzilla talked about their application environment recently, and particularly around how they measure and visualize metrics from a wide variety of sources. This goes under the general category of DevOps – bringing development and operations closer together, and giving operations engineers the highly configurable, agile tools that developers have been enjoying for some time. To realize the vision of DevOps, an organization must be able to collect metrics and events from a variety of sources, bring that data together in an intelligent way (correlate it), and then present it in the best possible way for each of the various audiences in the organization. And all these steps must occur in near real time–in other words, the application environment must be able to analyze a vast amount of data fast enough for developers, operations staff, and business stake-holders to take whatever action might be necessary to optimize IT operations. No small feat – Juan Paul talked about half a dozen tools they use (including ClearStone) to manage this task.

So, we’ve been thinking here at Evident about an ambitious task – what if ClearStone could manage more of the DevOps problem? It’s clear that we are already in use within the development and operations community when it comes to managing and monitoring Oracle Coherence – but that’s just the first step. What about managing the application tier, other data caching/NoSQL environments, perhaps even database and system level metrics? That is the direction that Evident is moving in – witness our expansion in DCP to support memcached, and others are coming soon. Also, AppServer containers such as WebLogic, jBoss, Tomcat – out of the box capabilites to manage, monitor and instrument these containers in conjunction with the DCP layer. Also, grid technologies such as Hadoop, GridGain, DataSynapse.

Do you have custom code or your own containers? No problem, how about we give you a toolkit to bring those in yourself? And management plug-ins so that operations can leverage their existing tools for managing their environment and providing more automated alerting and control to the production environment.

Ambitious it is, but the feedback we’re getting and progress we’re making has been very encouraging. And we hear more people doing what Juan Paul and Shopzilla are doing, so we’re pleased with that path.

By Scott Barnett

We’re pleased to bring you a new website chock full of great information. Evident ClearStone has evolved over the past 2 years and we’re excited for what the upcoming years will bring us. We’ve gone from management, monitoring and analytics around grid, to caching technologies, and now a broader scope that includes Java and big data.

Read the rest of this entry »