CBAP · Question #469
A very large insurer of General Liability and Property Damage insurance has an upward trend of increased claims over the past 5 years. The Risk Control Area for that company has just completed a 12 mo
The correct answer is B. Benchmarking and market analysis. This question asks which technique is most appropriate for evaluating a pilot program's performance across 25 different industries for a large insurance organization's risk control initiative.
Question
A very large insurer of General Liability and Property Damage insurance has an upward trend of increased claims over the past 5 years. The Risk Control Area for that company has just completed a 12 month Pilot of a new improved Risk Control Site. The purpose of the site is to help their customers manage their exposures and ideally prevent them from having claims There were 100 customers that were part of the Pilot that represented 25 different industries. The business goals were to increase use of the site and provide tools to help customer awareness of their exposures, so that they may reduce existing exposures and ultimately reduce claims. The sites Features were as follows:
- Improvements to the search engine to all customers to search for articles, tools and services on
the site
- A checklist function that allow customer to create their own unique Checklists or utilize a sample
provided by ABC company to use daily, weekly etc for an area of their facility.
- A promotion feature - where Risk preventing Articles, and tools on the site are marketed toward
a customer.
- A profile section allowing for Customer Name, Address and contact Phone number.
Alter the 12 month pilot the business sponsor received an assessment of what was working and what was not. The Assessment of the pilot revealed overall site activity had significantly increased, however only 5% of the time the promotions were viewed. And the most shocking was that total claims increased by nearly 20% for these 100 customers during the pilot period. The business sponsor was perplexed as he had an expectation of reduced claims and at least for 30% viewing of promotions since the project team had spent a lot of careful time and effort on this feature. A BA was assigned to do further analysis regarding the low use of the promotions and why claims were not being reduced. Regarding the use of promotions the BA looked into other similar companies to see what they did differently to get their customer to look at their promotions. The BA found that similar companies had promotions that targeted the industry the customer was in so it was more relevant to them and they were more interested to view the promotion. In addition the BA sent out a survey to all 100 pilot customers asking probing questions about what they thought of the site and if they felt it had decreased their exposure to risk sufficiently. The Survey responses came back with raving positive comments and providing examples of how the site had been helping in the reduction of claims from the customer's perspective. In addition the survey also revealed insight that the customers found the promotion often irrelevant to their industry. The BA asked for a dump of all documentation of the 1000 claims that were filed over the 12 month pilot period. The BA found the nearly 90% of the claim filed were all in one region of the country and were all for property damage related to several severe winter storms in the region and the claims were nearly all unavoidable by the customers. The BA brought all this analysis back to the business sponsor and made the recommendation to the business sponsor to require the customer to select 1 of 25 industries in their profile. This would in turn allow for the ability to show industry specific promotions and promote search results relative to a customer's industry to be sorted at the top giving the customer a more personalized experience. What technique was the BA using to understand why the promotions were not being viewed?
Options
- AUse cases and scenarios
- BBenchmarking and market analysis
- CObservation
- DData mining
How the community answered
(45 responses)- A2% (1)
- B80% (36)
- C13% (6)
- D4% (2)
Why each option
This question asks which technique is most appropriate for evaluating a pilot program's performance across 25 different industries for a large insurance organization's risk control initiative.
Use cases and scenarios are elicitation and modeling tools for defining requirements, not for evaluating a completed pilot's results against external industry standards.
Benchmarking and market analysis is correct because the pilot involved 100 customers spanning 25 different industries, making it essential to compare the site's features and outcomes against industry standards and competitive offerings in each segment. This technique provides an objective external reference point for determining whether the risk control site's capabilities meet or exceed what is standard in the market. Without external benchmarks, the organization cannot accurately assess whether the pilot results represent meaningful improvement relative to industry norms.
Observation involves directly watching stakeholders perform tasks to gather requirements and does not apply to analyzing aggregated pilot performance data across multiple industries.
Data mining involves discovering patterns within existing internal datasets and would not account for the external industry comparison component central to this evaluation.
Concept tested: Benchmarking and market analysis for pilot program evaluation
Topics
Community Discussion
No community discussion yet for this question.