Reporting & Analytics
Evident ClearStone Reporting provides a user view of the enriched data created by the Evident ClearStone Pipeline Server and stored in the Evident ClearStone Data Warehouse. The Evident ClearStone Reporting module has two components:
| |
|
|
| |
1. |
Reporting and Analytics thru a web-based portal. The portal provides access to the available reports including business level reports for end-user or application owners, historical and trend reports for operational staff and IT reports for IT architects and designers. The information used to generate these reports is stored in the Evident ClearStone Data Warehouse |
| |
|
|
| |
2. |
A near real-time component that delivers exception reports to pre-defined SLA’s within the compute and data grids. This information is stored in an Operational Data Cache |
The Evident ClearStone Report Server utilizes web-based reporting technology components for report delivery and user-access control including an embedded reporting engine.
Reporting Model
The Evident ClearStone Report Server comes with a set of 'out-of-the-box' report templates. The report templates are designed to deliver value-added information about the demand and consumption across the Real-Time Infrastructure (RTI), as well as off-grid servers and network resources associated with the virtualized application.
The following describes the available report categories by target audience and some of the key questions answered by the available reports:
| Report Description |
 |
Questions Answered |
| |
|
|
| Target: Business Unit or Application Owners |
| |
|
|
| Resource consumption of the RTI based on requests and/or services that are executed. The reports will show performance metrics of application domains and service requests and are driven by the business processes. These reports are fairly static in nature and are usually produced on a daily, weekly, or monthly basis. |
|
- Was work submitted to the utility completed within the agreed upon service levels?
- When were agreed upon service levels not met?
- What were the events that did not satisfy their SLA?
- How much excess capacity was allocated but not used?
- What is the trend of service delivery performance?
- What are the patterns of consumption and change in behaviors?
- What shared resources did my virtualized application domains consume?
- What were my charges for shared resource usage?
|
| Target: Operation Staff |
| |
|
|
| These reports will be used to visualize the consumption and supply of resources and the activity within the RTI on a day-to-day basis. |
|
- What was the load and activity throughout the day for each service?
- Did each service performed as expected?
- Were there sufficient grid resources available to deliver the service?
- How many and which service requests did not meet the SLAs?
- Were there bottlenecks in the off-grid servers that are associated with the virtual application?
- What non-allocation alerts occurred in my virtual application domain?
- What caused the non-allocation of the resource within the application fabric?
|
| Target: IT Reports - Architects, Designers, Strategists |
| |
|
|
| These reports are focused on RTI capacity, trending, resource optimization, and business and resource characterization including user and application behaviors. |
|
- How many computing resources were consumed by each service?
- How efficiently does the application leverage the grid?
- How much time was consumed by each service?
- How efficient were the resources utilized?
- What is the overall load and activity by each service within the shared grid?
- Is the grid infrastructure improving or worsening?
- What are the key performance metrics for all off-grid servers and engines for a specific grid environment?
|
| |
|
|
Each report template can be used to generate many specific reports based on the report template parameter setting.
Key Performance Indicators (KPIs)
The Evident ClearStone solution provides operational staff with both near real-time and historical reports regarding operations even across multiple grids, grid types, and even other infrastructure components (e.g. off-grid servers and the enterprise network). This is a unique view that addresses the need for application and service visibility, which is not addressed by existing management tools. It is an application/service-oriented perspective of the performance of the RTI that provides transparency to usage and performance.
Evident ClearStone provides an operational dashboard with a service-oriented perspective for grid operation that is driven by a set of Key Performance Indicators (KPI’s). KPI’s are derived or generated (calculated) from the raw usage data collected by the Evident ClearStone Adapters.
KPI’s are performance measurements that may be derived from one or multiple points of information. They can be as simple as running counters of service requests and tasks of a compute grid or as complex as Nth percentile calculations. Each set of KPI’s are specific and fundamental to each service and depending on the service profile, they may be considered more relevant than others to gauge the performance of the service or application.
Listed below are typical KPI’s that would be available for a compute grid, an off-grid server, and a data grid (this is not an exhaustive list and available KPI’s are dependent on the specific Evident ClearStone Adapter implementation).
Compute Grid KPIs
| Infrastructure Metrics: |
| |
- # of active nodes per grid
- Peak busy nodes
- Nodes by platform
- Top N nodes by elapsed time on tasks per grid
- Total job/service request count by grid service/grid
- Total task count by grid service/grid
- Total task duration by grid service/grid
- Peak Busy Engines
- Threshold exception count
|
| Node Metrics (Interval Based): |
| |
- Time spent on running grid services (total task times)
by grid service
- CPU utilization
- Memory consumption for node
- Task counters (success, retry, failure, etc.) per node
- Average task time by grid service
- Threshold exception count
|
| Service Metrics (Interval Based): |
| |
- Service request counter for current day (by request type)
- Service request duration/elapsed times (by request type)
- Average/Min/Max Service request duration/elapsed times
- Service request rate
- Success/failure counters for service requests
- Task execution rate (# tasks/hr)
- Task completion rate (# tasks/hr)
- Task counters for current day
- Average/Min/Max Task times
- Success/failure counters for tasks requests
- Peak service request/hr
- Peak tasks/hr
- Driver origination counters
- Broker job submission counters
- # of service requests in queue
- Active engine counts
- Top long running service request w/ run times, task counts, etc.
- Threshold exception count
|
Off-Grid Server KPIs (EMS)
| |
- CPU Utilization
- Memory Utilization
- Free memory
- Total memory
- Network packets in
- Network packets out
- Network bytes in
- Network bytes out
- Network collisions
- Network errors
- Storage utilization
- Storage free storage
- Storage total storage
|
Data Grid KPIs
| |
| Infrastructure Metrics: |
| |
- # of clusters
- Cluster sizes (# of objects, # of members)
- Role distribution
- Most active clusters
- Least active clusters
- Network statistics
- Storage statistics
|
| Named Cache Metrics: |
| |
- # of members
- # objects
- # of members
- Hit/miss statistics
- Get/put statistics
- Response time statistics
- Storage statistics
|
Benefits
The Evident ClearStone Data Reporting module has many benefits including:
- Web-based report publishing and access control – easy access to system reports via a standard web browser with administered user access control
- Pre-designed basic reports templates – get started quickly using Evident ClearStone base report templates which are designed to meet a variety of different user reporting requirements
- Different report types supported – use of lists, charts, crosstab and compound reports to view data in different ways
- Report scheduling and distribution – schedule reports to be automatically generated (hourly, daily, weekly, or monthly) and notify users via email
- Historical and near real-time reports – deliver reports to different user communities
|