draft pending adoption - naic. · pdf filedraft pending adoption ... a final decision on that...

15
Draft Pending Adoption © 2017 National Association of Insurance Commissioners 1 Date: 4/18/17 Attachment One Market Information Systems (D) Task Force Denver, Colorado April 8, 2017 The Market Information Systems (D) Task Force met in Denver, CO, April 8, 2017. The following Task Force members participated: Mike Kreidler, Chair, and John Haworth (WA); Lori K. Wing-Heier, Vice Chair, and Chris Murray (AK); Dave Jones represented by Pam O’Connell (CA); Marguerite Salazar represented by Damion Hughes (CO); Stephen C. Taylor represented by Sharon Shipp (DC); Trinidad Navarro represented by Frank Pyle (DE); Jennifer Hammer represented by Michael P. Rohan (IL); Ken Selzer represented by Stacy Rinehart (KS); Brian Maynard represented by Russ Hamblen (KY); James J. Donelon represented by Jeff Zewe (LA); Chlora Lindley-Myers represented by Jim Mealer (MO); Roger A. Sevigny represented by John Elias (NH); Richard J. Badolato represented by Gale Simon (NJ); Jillian Froment represented by Angela Dingus (OH); John D. Doak represented by Brian Gabbert (OK); David Mattax represented by Ignatius Wheeler (TX); and Todd E. Kiser represented by Randy Overstreet (UT). 1. Adopted its 2016 Fall National Meeting Minutes Ms. Dingus made a motion, seconded by Mr. Pyle, to adopt the Task Force’s Dec. 10, 2016, minutes (see NAIC Proceedings – Fall 2016, Market Information Systems (D) Task Force). The motion passed unanimously. 2. Adopted the Report of the Market Information Systems Research and Development (D) Working Group Mr. Haworth reported that the Market Information Systems Research and Development (D) Working Group met March 21via conference call in regulator-to-regulator session pursuant to paragraph 3 (specific companies, entities or individuals) and paragraph 6 (consultations with NAIC staff) of the NAIC Policy Statement on Open Meetings. During the call, the Working Group adopted recommendations to move forward to application development for: 1) Uniform System Enhancement Request (USER) form 10059: Market Analysis Review System (MARS) – improve iSite+ navigation; and 2) USER form 10076: Market Conduct Annual Statement (MCAS) Market Analysis Prioritization Tool (MAPT) – add non-standard interrogatory data to auto and homeowners. The Working Group also adopted a recommendation to move forward to detailed analysis for USER form 10075: MAPT – include current year and previous two years of Overall Score, National Score and State Score, as well as main component and sub-component scores. Mr. Haworth said the Working Group also discussed and requested additional detailed analysis for: 1) USER form 10066: MARS – merge Level 1 and Level 2; and 2) USER form 10074: MARS – allow for comments to be added to a Level 1 review after it has been approved. Director Wing-Heier made a motion, seconded by Mr. Hamblen, to adopt the report of the Market Information Systems Research and Development (D) Working Group (Attachment One). The motion passed unanimously. 3. Reviewed Outstanding USER Forms Commissioner Kreidler noted that the Market Information Systems Research and Development (D) Working Group’s charge is to serve as the business partner to review and prioritize submitted USER forms (Attachment Two) to ensure an efficient use of available NAIC staffing and resources. Ginny Ewing (NAIC) said USER Form 10055 was completed and released to production in late February. The request was to isolate major medical data from the health lines of business in the MAPT. She said USER Form 10059 is in application development based on the Market Information Systems Research and Development (D) Working Group recommendation to move forward to application development on March 21. Ms. Ewing said the remaining portion of USER Form 10063 is to complete the analysis of the quality of the Central Registration Depository (CRD) numbers that the NAIC receives with the state producer data. She said the CRD is the Financial Industry Regulatory Agency’s (FINRA) unique identifier for brokers, noting that the initial review indicated that the CRD numbers’ quality is not very good. She said NAIC staff will continue to work with FINRA to make the data-sharing process more efficient.

Upload: phungliem

Post on 20-Mar-2018

217 views

Category:

Documents


1 download

TRANSCRIPT

Draft Pending Adoption

© 2017 National Association of Insurance Commissioners 1

Date: 4/18/17 Attachment One

Market Information Systems (D) Task Force Denver, Colorado

April 8, 2017 The Market Information Systems (D) Task Force met in Denver, CO, April 8, 2017. The following Task Force members participated: Mike Kreidler, Chair, and John Haworth (WA); Lori K. Wing-Heier, Vice Chair, and Chris Murray (AK); Dave Jones represented by Pam O’Connell (CA); Marguerite Salazar represented by Damion Hughes (CO); Stephen C. Taylor represented by Sharon Shipp (DC); Trinidad Navarro represented by Frank Pyle (DE); Jennifer Hammer represented by Michael P. Rohan (IL); Ken Selzer represented by Stacy Rinehart (KS); Brian Maynard represented by Russ Hamblen (KY); James J. Donelon represented by Jeff Zewe (LA); Chlora Lindley-Myers represented by Jim Mealer (MO); Roger A. Sevigny represented by John Elias (NH); Richard J. Badolato represented by Gale Simon (NJ); Jillian Froment represented by Angela Dingus (OH); John D. Doak represented by Brian Gabbert (OK); David Mattax represented by Ignatius Wheeler (TX); and Todd E. Kiser represented by Randy Overstreet (UT). 1. Adopted its 2016 Fall National Meeting Minutes Ms. Dingus made a motion, seconded by Mr. Pyle, to adopt the Task Force’s Dec. 10, 2016, minutes (see NAIC Proceedings – Fall 2016, Market Information Systems (D) Task Force). The motion passed unanimously.

2. Adopted the Report of the Market Information Systems Research and Development (D) Working Group

Mr. Haworth reported that the Market Information Systems Research and Development (D) Working Group met March 21via conference call in regulator-to-regulator session pursuant to paragraph 3 (specific companies, entities or individuals) and paragraph 6 (consultations with NAIC staff) of the NAIC Policy Statement on Open Meetings. During the call, the Working Group adopted recommendations to move forward to application development for: 1) Uniform System Enhancement Request (USER) form 10059: Market Analysis Review System (MARS) – improve iSite+ navigation; and 2) USER form 10076: Market Conduct Annual Statement (MCAS) Market Analysis Prioritization Tool (MAPT) – add non-standard interrogatory data to auto and homeowners. The Working Group also adopted a recommendation to move forward to detailed analysis for USER form 10075: MAPT – include current year and previous two years of Overall Score, National Score and State Score, as well as main component and sub-component scores. Mr. Haworth said the Working Group also discussed and requested additional detailed analysis for: 1) USER form 10066: MARS – merge Level 1 and Level 2; and 2) USER form 10074: MARS – allow for comments to be added to a Level 1 review after it has been approved. Director Wing-Heier made a motion, seconded by Mr. Hamblen, to adopt the report of the Market Information Systems Research and Development (D) Working Group (Attachment One). The motion passed unanimously. 3. Reviewed Outstanding USER Forms Commissioner Kreidler noted that the Market Information Systems Research and Development (D) Working Group’s charge is to serve as the business partner to review and prioritize submitted USER forms (Attachment Two) to ensure an efficient use of available NAIC staffing and resources. Ginny Ewing (NAIC) said USER Form 10055 was completed and released to production in late February. The request was to isolate major medical data from the health lines of business in the MAPT. She said USER Form 10059 is in application development based on the Market Information Systems Research and Development (D) Working Group recommendation to move forward to application development on March 21.

Ms. Ewing said the remaining portion of USER Form 10063 is to complete the analysis of the quality of the Central Registration Depository (CRD) numbers that the NAIC receives with the state producer data. She said the CRD is the Financial Industry Regulatory Agency’s (FINRA) unique identifier for brokers, noting that the initial review indicated that the CRD numbers’ quality is not very good. She said NAIC staff will continue to work with FINRA to make the data-sharing process more efficient.

Draft Pending Adoption

© 2017 National Association of Insurance Commissioners 2

Ms. Ewing said USER form 10065 is to provide functionality for the states to access and download data from NAIC systems. She noted that this has been designated as the No. 1 priority for business analysis. She said NAIC staff have begun interviewing the states on their requirements for accessing and downloading data from the NAIC databases. The requirement gathering will include both Market Information Systems (MIS) data and financial data.

Ms. Ewing said USER form 10071 is to redesign and enhance iSite+ reports by using interactive data visualization and adding data analytics. She said this request was designated as the third priority for business analysis. She said NAIC staff have been working on business intelligence and data analytics for all iSite+ data, noting that some NAIC staff members who work with MIS data are participating in a business intelligence tool pilot project. Ms. Ewing said there are 12 requests pending business analyst availability, which is down from the 15 reported at the 2016 Fall National Meeting. 4. Heard a Presentation on Recommendations for Making Public Data More Meaningful and Widely Available

Commissioner Kreidler reminded the Task Force that one of the funded consumer representatives provided a review of the Consumer Information Source (CIS) during the 2016 Fall National Meeting. He said this is the NAIC’s primary tool for providing consumers access to insurance company information, which is available via the NAIC website. He said that, based on the feedback the Task Force heard, CIS has room for improvement. He asked Ms. Ewing for an update. Ms. Ewing reported that a project has been proposed for the NAIC’s 2018 budget. She said it includes funds for user experience/user interface consulting assistance. She said the NAIC plans to engage subject-matter experts composed of regulators, the industry and consumers to provide input into the design. She said the NAIC is also hoping to leverage a business intelligence tool that is currently being piloted. A final decision on that tool should be made in June. Commissioner Kreidler asked Ms. Ewing to remind the Task Force of what type of information is currently publicly available. Ms. Ewing noted that, through CIS, consumers have access to aggregate closed confirmed consumer complaint data, companies’ key financial statement data in the Financial Profile, receivership data, licensing information and have links to states’ market conduct exams and enforcement action websites. Additionally, other consumer tools are available via the NAIC website, including Insure U, the Life Insurance Policy Locator Service, the Online Fraud Reporting Service and aggregate Market Conduct Annual Statement data. She noted that suggestions from previous Task Force discussions have included group-wide complaint data (in addition to legal entity as currently displayed), unconfirmed complaints, access to the complaint reports (redacted as appropriate), and rate and form data. Brendan Bridgeland (Center for Insurance Research—CIR) said the CIS used to provide the company key pages from their annual financial statements. Those are no longer offered, yet they were helpful for consumers. He said that if the key pages cannot be made available, he suggested that the companies’ Management Discussion and Analysis pages be made available on the CIS. This information is a high-level overview and explanation of the company’s financial reporting and puts the Financial Profile in context. It is especially helpful if the company’s annual report is not publicly available. Director Wing-Heier noted that Commissioner Laura Cali Robison (OR) will be giving a presentation to the Health Insurance and Managed Care (B) Committee regarding the transparency of health insurance company filings. She suggested that the presentation may be useful for the Task Force. Birny Birnbaum (Center for Economic Justice—CEJ) encouraged the Task Force to contact users of the CIS to determine the scope and type of information that would be helpful to them. As an example, he said consumers could use a more readable and understandable way of assessing a company’s financial strength and reliability that could be legible on a mobile device. Dave Snyder (Property Casualty Insurers Association of America—PCI) asked that the industry be included in these discussions to be certain that confidentiality concerns are considered. He noted that some data can be misunderstood without appropriate context and explanation. 5. Discussed Complaint Reconciliation Process Commissioner Kreidler said that attached to the agenda was the Complaint Reconciliation Process adopted by Market Regulation and Consumer Affairs (D) Committee in 2011. Ms. Ewing said that the Complaint Reconciliation Process document was an outcome of a 2006 charge to “…monitor and evaluate the states’ accurate submission of data and full participation in the Complaint Database system. As part of this effort, consider issues related to accuracy of the complaint

Draft Pending Adoption

© 2017 National Association of Insurance Commissioners 3

data which will include the development of uniform standards for the reconciliation of complaint data between companies and state departments…” She said there has been a lot of activity related to the accurate submission of complaint data and full participation by all jurisdictions. She noted that the five-year Complaint Handling and Reporting Standards project, which converted all states to the new Complaint Database System (CDS) code structure, was completed in 2016. She said NAIC staff are currently compiling the third year of MIS Data Analysis Metrics results, which measures the timeliness, completeness and accuracy of CDS and other MIS data. These results reflect that the vast majority of the states submit complaint data to the NAIC at least monthly. In addition, the metrics are identifying potential accuracy issues that regulators can review and correct, as necessary. Ms. Ewing noted that the Complaint Reconciliation Process document outlines minimum reconciliation data point recommendations, including insurance department file number, company name, company code, insured name, type of coverage, complainant name and reason for complaint. Additionally, it offers two implementation options for the states to consider. The first option is a state-specific option, in which each state or their state back-office system vendor would develop the process directly between the state and the insurance company. The second option is an NAIC centralized system that could be used to help facilitate the reconciliation process. Ms. Ewing said the next logical step seems to be to assess the states’ current reconciliation processes. In 2011, as indicated in the document, most states did not have a complaint reconciliation process. She said NAIC staff recommend a state survey to determine what complaint reconciliation processes have been implemented; and, for jurisdictions that have not done so yet, assess the interest in an NAIC centralized or a State Based Systems (SBS) reconciliation process. Commissioner Kreidler said Washington is not an SBS state and has its own complaint reconciliation process. He agreed that a survey is the right first step. Ms. Rinehart also agreed with conducting a survey. She noted that Kansas reconciles complaints, but it is a manual and time-consuming process. She suggested that the industry also be included in the complaint reconciliation discussions. She also indicated that training would be helpful for consumer assistance departments. Mr. Hamblen said that there needs to be greater consistency in what is a confirmed complaint and what is a non-confirmed complaint. Mr. Birnbaum expressed support for the project and survey, noting that consumers, regulators and the industry all have an interest in accurate complaint information. Marty Mitchell (America’s Health Insurance Plans—AHIP) expressed concern that the complaint reconciliation project is moving back to the first step of seven years ago. He noted that it is important to have a complaint reconciliation process and suggested that this may be made a part of the Voluntary Market Regulation Certification Program. 6. Discussed Other Matters Director Wing-Heier said Alaska has become aware that some producers may have had their licenses renewed, even though they had not completed the continuing education (CE) requirements, because SBS erroneously indicated that the producers’ CE requirements had been met. Mr. Murray said that after attempts to reach SBS support staff, Alaska was informed that SBS was not consistently resetting the annual CE requirements for producers. In Alaska, it appeared that 758 licensees had not been reset out of about 4,000 domestic licensees. He said that for those non-reset producers, the National Insurance Producer Registry (NIPR) was indicating that those producers’ CE requirements were met even if they were not, so this has had a multistate impact. He said he did not know if this has happened only in Alaska or for how long it has been happening. Editor’s note: after further investigation, it was determined that this issue was limited to only 60 licensees, rather than 758. The issue seems to be isolated to Alaska and no licensee was able to renew without the required CE. Having no further business, the Market Information Systems (D) Task Force adjourned. W:\National Meetings\2017\Spring\TF\MIS\01-04-08MISTFmin.docx

Attachment Two Market Information Systems (D) Task Force

8/6/17

© 2017 National Association of Insurance Commissioners 1

Conference Calls

MARKET INFORMATION SYSTEMS RESEARCH AND DEVELOPMENT (D) WORKING GROUP July 13, 2017 / April 26, 2017

Summary Report The Market Information Systems Research and Development (D) Working Group met July 13 and April 26. The meeting was held in regulator-to-regulator session pursuant to paragraph 3 (specific companies, entities or individuals) and paragraph 6 (consultation with NAIC staff) of the NAIC Policy Statement on Open Meetings. During this meeting, the Working Group: 1. Reviewed the Market Information Systems (MIS) Data Analysis Metrics results.

2. Considered adoption of recommendations for the following Uniform System Enhancement Request (USER) forms:

• 10066: Market Analysis Review System (MARS) – Merge MARS Level 1 and Level 2. Result: Adopted motion to recommend that the Market Analysis Procedures (D) Working Group consider adding a Merged review that merges Level 1 and Level 2 questions (the analyst would be able to pick and choose which questions to address) and eliminating Level 2.

• 10074: MARS – Allow for comments to be added to a Level 1 review after it has been approved. Result: Adopted motion to move forward to application development.

• 10077: Market Analysis Prioritization Tool (MAPT) – All the user to select ‘all policy’ types instead of running 18 different reports. Result: Adopted recommendation to move forward to detailed analysis.

• 10078: MARS – Add links for reviewer. Result: Adopted recommendation to move forward to detailed analysis.

• 10069B: Complaint Database System (CDS – Enhance complaint codes for lender based insurance and pet insurance. Result: Adopted recommendation to move forward to detailed analysis.

3. Reviewed and prioritized the outstanding Uniform System Enhancement Request (USER) forms. W:\National Meetings\2017\Summer\TF\MIS\MISRD Summary.docx

Attachment Three Market Information Systems (D) Task Force

August 6, 2017

© 2017 National Association of Insurance Commissioners 1

NAIC Market Information Systems Data Analysis Summary

August 6, 2017 Objective It is essential that the systems on which insurance consumers and state insurance regulators depend use reliable data. These systems include, but are not limited to, the Consumer Information Source (CIS), Market Analysis Prioritization Tool (MAPT), Market Analysis Profile (MAP) and Market Analysis Review System (MARS). In addition to these National Association of Insurance Commissioners (NAIC) systems, many state systems and processes use NAIC Market Information System (MIS) data. Therefore, MIS data quality is critical. The MIS data analysis metrics were developed at the direction of the Market Information Systems (D) Task Force to identify potential data quality issues in the NAIC MIS database. For each system, three aspects of data quality are considered: 1) completeness; 2) timeliness; and 3) accuracy. Results Note: These symbols indicate the following changes between periods: improvement (); no significant change (–); and decline (). Complaint Database System (CDS) Completeness: C1. Identify errors that prevent submitted complaints from successfully loading to the MIS database.

2016 Results As of 1/9/2017

Transactions

Processed Errors Error Rate

2016 Total 3,508,376 16,608 0.47% 2015 Total 1,251,785 8,373 0.67% 2014 Total 1,237,887 32,356 2.61% –

Timeliness: T1. Identify jurisdictions that have not submitted closed complaints to the NAIC MIS database at least monthly.

2016 Results As of 1/9/2017

# of States That Did Not

Submit Closed Complaints At Least Monthly

# of States That Did Submit Closed Complaints

At Least Monthly

2016 Total 9 43 2015 Total 14 38 – 2014 Total 14 38 –

2016 Results

As of 1/9/2017

# of States Submitting CDS Data Each Month

12 Months

11 Months

10 Months

9 Months

8 Months

7 Months

<7 Months

2016 Total 43 3 2 2 0 0 2 2015 Total 38 3 2 1 3 3 2 2014 Total 38 5 3 2 0 2 2

Attachment Three Market Information Systems (D) Task Force

August 6, 2017

© 2017 National Association of Insurance Commissioners 2

Accuracy: A1. Identify complaints submitted with a confirmed indicator and only a disposition of “Complaint Withdrawn,” “No Action

Requested/Required,” “Question of Fact/Contract Provision/Legal Issue,” “Company Position Substantiated,” “No Jurisdiction” or “Insufficient Information.”

2016/2017 Results As of 7/5/2017

Number of Confirmed Complaints with Only the Following Disposition Codes

Total

Complaint Withdrawn

(Code 1312)

No Action Requested/ Required

(Code 1235)

Question of Fact/ Contract Provision/

Legal Issue

(Code 1290)

Company Position

Substantiated

(Code 1295)

No Jurisdiction

(Code 1300)

Insufficient Information

(Code 1305) Total

Total Number of

All Complaints

%

2017 Q2 536 3,782 3,024 17,005 1,864 350 26,561 364,605 7.28% 2016 359 2,884 2,070 11,763 1,315 248 18,639 255,000 7.31% N/A 2015 393 N/A N/A 16,764 N/A N/A N/A 218,315 N/A N/A 2014 285 N/A N/A N/A N/A N/A N/A 200,305 – –

*2015 results only evaluated dispositions Complaint Withdrawn and Company Position Substantiated. 2014 results only evaluated Complaint Withdrawn.

A2. Identify complaints submitted for lines of business on companies that have no premium written for those lines of

business on the financial annual statement. 2016/2017 Results

As of 7/5/2017

# of Complaints with No

State Level Premium

# of Complaints with No

National Level Premium

Total Number of Complaints

% of No State Level

Premium Complaints to

Total Complaints

% of No National Level

Premium Complaints to

Total Complaints

2017 Q2 Total 16,866 9,493 364,605 4.63% 2.60% 2016 Total 11,919 6,964 255,000 4.67% 2.73% 2015 Total 10,273 5,816 240,443 4.27% 2.42% –

Market Action Tracking System (MATS) Completeness: C1. Identify jurisdictions that did not close an exam in previous year but reported they completed exams in the NAIC’s

corresponding year’s Insurance Department Resources Report (IDRR). 2016 Results

As of 7/5/2017

Exams Closed

in MATS

Closed Exams

Reported in IDRR

Difference

Entities in Exams Closed

in MATS

Entities in Exams Closed

in IDRR Difference

2016 Total 565 585 -20 670 827 -157 2015 Total 590 880 -290 N/A N/A N/A 2014 Total 490 771 -281 N/A N/A N/A 2013 Total 667 806 -139 – N/A N/A N/A

Attachment Three Market Information Systems (D) Task Force

August 6, 2017

© 2017 National Association of Insurance Commissioners 3

Timeliness: T1. Identify open actions with inactive values in MATS attributes (e.g. status, action type, line of line of business).

2017 Results As of 7/5/2017

Actions with Inactive Values

Action Type Area of Scrutiny Line of Business Status Tier 1 Trigger Total

2017 Q2 Total 46 185 96 55 19 401 2016 Total 90 185 96 55 73 499 2015 Total* N/A N/A N/A 166 N/A N/A 2014 Total* N/A N/A N/A 243 N/A N/A –

*2015 and 2014 data metrics only evaluated inactive statuses. T2. Identify actions with an estimated start date that has passed more than 30 days ago, and the status is “Called Not

Begun.” 2017 Results

As of 7/5/2017

Actions in Called Not Begun Status with

Estimated Start Date > 30 Days

Total Actions in Called Not Begun Status

% Actions in Called Not Begun Status w/

Estimated Start > 30 Days to Total Called Not Begun

Status

2017 Q2 Total 162 200 81.00% 2016 Total 190 251 75.70% 2015 Total 194 270 71.85% 2014 Total 136 282 48.23% –

T3. Identify actions with a status of “In Settlement” for more than 180 days.

2017 Results As of 7/5/2017

Actions in In

Settlement Status > 180 Days

Total Actions in In Settlement Status

% Actions in In Settlement > 180 Days to

Total In Settlement

2017 Q2 Total 19 44 43.18% 2016 Total 18 43 41.86%

2015 Total 15 33 45.45% – 2014 Total 6 N/A N/A –

T4. Identify actions with a status of “In Progress” for more than 18 months.

2017 Results As of 7/5/2017

Actions in In Progress

Status > 18 Months Total Actions in In Progress Status

% In Progress Actions > 18 Months to Total In

Progress

2017 Q2 Total 95 618 15.37%

2016 Total 108 562 19.22%

2015 Total 163 416 39.18% N/A 2014 Total 0 N/A N/A –

Attachment Three Market Information Systems (D) Task Force

August 6, 2017

© 2017 National Association of Insurance Commissioners 4

T5. Identify actions with a status of “Work Concluded” for more than 120 days. 2017 Results

As of 7/5/2017

Actions in Work

Concluded Status > 120 Days

Total Actions in Work Concluded Status

% Actions Work Concluded > 120 Days to Total Work Concluded

2017 Q2 Total 23 73 31.51%

2016 Total 26 55 47.27%

2015 Total 53 74 71.62% – 2014 Total 27 N/A N/A –

T6. Identify actions with a status of “Anticipated” for more than 120 days.

2017 Results As of 7/5/2017

Actions in Anticipated

Status > 120 Days Total Actions in Anticipated Status

% Actions Anticipated > 120 Days to Anticipated

2017 Q2 Total 95 122 77.87%

2016 Total 122 144 84.72% – T7. Identify actions with a status of “Suspended” for more than 120 days.

2017 Results As of 7/5/2017

Actions in Suspended

Status > 120 Days Total Actions in Suspended Status

% Actions Suspended > 120 Days to Suspended

2017 Q2 Total 162 165 98.18% 2016 Total 142 175 81.14% –

Accuracy: Note: No metrics have been defined to measure MATS data accuracy. Market Analysis Review System (MARS) Completeness: C1. Identify jurisdictions that have not completed a Level 1 review in the past year.

2016 Results As of 2/10/2017

# of States That Did Not Complete

a Level 1 Review in Year

2016 Total 7 2015 Total 9 2014 Total 10 –

Attachment Three Market Information Systems (D) Task Force

August 6, 2017

© 2017 National Association of Insurance Commissioners 5

C2. Identify Level 1 reviews with a disposition of “Level 2 analysis scheduled” with no corresponding Level 2 review entered within nine months of the closed date.

2016 Results As of 2/10/2017

Level 1 Reviews with Level 2 Scheduled But

No Level 2 Reviews

Level 1 Reviews with Level 2 Scheduled and

Level 2 Completed

Total Level 1 Reviews with

Level 2 Scheduled

% Level 1 with No Level 2

to Total Level 1

2016 Total 171 266 437 39.13%

2015 Total 107 205 312 34.29%

2014 Total 241 364 605 39.83% – Timeliness: T1. Identify reviews that were started but not completed and deleted after 60 days.

2016 Results As of 2/10/2017

Reviews Created

Reviews Deleted

Total % Reviews Deleted to Reviews Created

2016 Total 1,985 50 2,035 2.46% 2015 Total 1,841 27 1,868 1.45% 2014 Total 1,939 23 1,962 1.17% –

T2. Compare data year to review year for the past year.

2016 Results As of 2/10/2017

Current

Data Year Current

Data Year Total

Reviews % Current

Data Year to Total Reviews

% Not Current Data Year to

Total Reviews

2016 Total 1,928 57 1,985 97.13% 2.87% 2015 Total 1,785 56 1,841 96.96% 3.04% 2014 Total 1,900 39 1,939 97.99% 2.01% –

Accuracy: Note: No metrics have been defined to measure MARS data accuracy.

Market Conduct Annual Statement (MCAS) Completeness: C1. Identify nonparticipating jurisdictions.

2016 Results As of 4/26/2017

# of Nonparticipating

States

2016 Data Year Total 2 2015 Data Year Total 4 – 2014 Data Year Total 4 – 2013 Data Year Total 4 –

Attachment Three Market Information Systems (D) Task Force

August 6, 2017

© 2017 National Association of Insurance Commissioners 6

C2. Identify missing company filings for current MCAS data year. 2016 Data Year Results

As of 7/5/2017

Required to

File Missing Filings

% of Missing Filings to Total Required Filed 45+

Days Late % of 45+ Days Late

Filings to Total Required

2016 Data Year Total 29,645 81 0.27% 7 0.02% 2015 Data Year Total 28,881 97 0.34% 50 0.17% 2014 Data Year Total 28,927 78 0.27% 34 0.12% 2013 Data Year Total 25,433 50 0.20% – 21 0.08% –

Timeliness: T1. Identify filings submitted 45 days after deadline for the current MCAS data year. See C2 results above.

Accuracy: A1. Review validation exceptions for the current MCAS data year.

2016 Data Year Results As of 7/5/2017 Grand Total

All Lines of Business Errors on Original Filings

Current Unresolved

Errors

Total Validations

Run Original Filing Errors/ Total Validations Run

Current Unresolved Errors/

Total Validations Run

2016 Data Year Total 17,626 252 1,719,728 1.02% 0.01% 2015 Data Year Total 13,562 0 1,069,681 1.27% 0.00% 2014 Data Year Total 14,413 640 1,021,478 1.41% 0.06% 2013 Data Year Total 12,904 419 980,237 1.32% – 0.04%

A2. Identify refilings.

2016 Data Year Results As of 7/5/2017 Grand Total

All Lines of Business Amended Filings or Refilings Total Filings % Amended Filings or

Refilings to Total Filings

2016 Data Year Total 5,608 36,676 15.29% 2015 Data Year Total 4,063 34,130 11.90% 2014 Data Year Total 3,543 33,761 10.49% 2013 Data Year Total 6,670 32,592 20.47% –

Regulatory Information Retrieval System (RIRS) Completeness: C1. Identify jurisdictions that have not submitted actions in the past year.

2016 As of 2/19/2017

# of States That Did Not Submit Actions

2016 Total 2 – 2015 Total 2 – 2014 Total 2 –

Attachment Three Market Information Systems (D) Task Force

August 6, 2017

© 2017 National Association of Insurance Commissioners 7

C2. Identify errors that prevent submitted regulatory actions from successfully loading to the NAIC MIS database.

Timeliness: T1. Identify regulatory actions with a date of entry 90 days greater than the date of action.

2016 As of 3/16/2016

Action Entered 90

Days > Action Date Action Entered 90

Days <= Action Date Total Actions

Entered % Actions Entered 90

Days > Action Date

2016 Total 2,616 7,592 10,208 25.63%

2015 Total 6,390 7,182 13,572 47.08%

2014 Total 992 7,765 8,757 11.33% – Accuracy: Note: No metrics have been defined to measure RIRS data accuracy. Conclusions After a thorough review of the analysis results and metrics themselves, the conclusion of the Market Information Systems Research and Development (D) Working Group is that for the most part the metrics are performing as desired. There are caveats associated with most of the metrics. In some cases, the results do not necessarily reflect data quality issues. However, overall the metrics are very helpful identifying potential issues. In addition, the majority of NAIC MIS data is of good quality overall. There are several areas where the results improved from the previous year. However, some areas in need of improvement have been identified. The Working Group will continue to review the metrics and will propose recommended changes to improve their accuracy and usefulness.

2015 As of 5/19/2016

Transactions

Processed Errors Error Rate

2016 Total 91,166 5,466 6.00%

2015 Total 84,412 10,959 12.98%

2014 Total 65,148 3,878 5.95% –

Market Information Systems Research and Development (D) Working Group Status of Outstanding USER (Uniform System Enhancement Request) Forms

As of July 14, 2017

Application Key: CDS – Complaints Database System; CIS – Consumer Information Source; MAMS – Market Analysis Market Share;

MATS – Market Action Tracking System; MAPT – Market Analysis Prioritization Tool; MARS – Market Analysis Review System; MCAS – Market Conduct Annual Statement; RIRS – Regulatory Information Retrieval System

© 2017 National Association of Insurance Commissioners Page 1 of 3

User Form #

Application Requestor Request Summary Documents NAIC Recommendation

Phase Target End Date

Status

10043 MARS MAP (D) WG Randy Helder NAIC

Import the average industry loss ratio and expense ratio.

Request

Detailed Analysis

Application Development

TBD Pending USER form 10066.

10047 MAPT MCAS MAPT

Mark Hooker WV

Add option to display data by group code.

Request

Preliminary Analysis

Detailed Analysis

Pending Business Analysis. #4 in backlog.

10051 MATS MISTF State Survey Project Action Plan

#9

Implement MATS Web Service in SBS: Provide SBS Examination module integration for automated

submission of information to MATS.

Request Pending Defer until after SBS 2016.

10053 RIRS MISTF State Survey Project Action Plan

#22

Review of RIRS Codes: Review of RIRS codes by the RIRS Code Review Working Group to clarify definitions for consistent usage and provide recommendations

for revisions.

Request

Preliminary Analysis

Detailed Analysis

Pending Business Analysis. #1 in backlog.

Note: regulator comments on RIRS coding changes are

posted on StateNet

10054 RIRS MISTF State Survey Project Action Plan

#23

Support for Attachments: Facilitate submission of

supporting documentation. (ex: orders)

USER Form 10021: Allow entry of multiple state regulatory

actions in RIRS. (added 3/20/13)

Request

Preliminary Analysis

Detailed Analysis

Pending Business Analysis. #7 in backlog.

10059 MARS John Haworth WA

Menu bar added to various Market Regulation

pages/applications in I-SITE

Request

Detailed Analysis

Application Development

Scheduling development resources.

10061 MARS John Haworth WA

Ensure company financial statement data file matches company financial statement

PDF.

Request

Detailed Analysis

Detailed Analysis

Pending Business Analysis, as a result of another example where data file and PDF do

not match. #10 in backlog.

Attachment Four

Market Information Systems Research and Development (D) Working Group Status of Outstanding USER (Uniform System Enhancement Request) Forms

As of July 14, 2017

Application Key: CDS – Complaints Database System; CIS – Consumer Information Source; MAMS – Market Analysis Market Share;

MATS – Market Action Tracking System; MAPT – Market Analysis Prioritization Tool; MARS – Market Analysis Review System; MCAS – Market Conduct Annual Statement; RIRS – Regulatory Information Retrieval System

© 2017 National Association of Insurance Commissioners Page 2 of 3

User Form #

Application Requestor Request Summary Documents NAIC Recommendation

Phase Target End Date

Status

10063 RIRS Tim Mullen NAIC

FINRA Request

Detailed Analysis

Application Development

TBD Completed steps 1 – 3; step 4 in progress.

10065 CDS, MAPT, MARS,

MATS, RIRS, SPL

Jo LeDuc WI

Provide functionality to access and download data from NAIC

systems.

Request

Preliminary Analysis

Detailed Analysis

Interviews with states being scheduled. Preliminary work

with Tableau in progress.

10066 MARS MAP (D) WG Teresa Cooper

NAIC

Merge MARS Level 1 and MARS Level 2.

Request

Detailed Analysis

Detailed Analysis

Recommendation referred to MAP Working Group.

10067 MCAS Teresa Cooper NAIC

Creation of an MCAS Company Ratio Trend Report

Request

Preliminary Analysis

Detailed Analysis

Pending Business Analysis. #3 in backlog.

10068 MCAS MAPT Teresa Cooper NAIC

Modifications for all lines of business for “All Coverages” or

“Selected Coverages”

Request

Preliminary Analysis

Detailed Analysis

Pending Business Analysis. #6 in backlog.

10069A CDS Frank Pyle DE

Enhance complaint codes to better meet federal reporting

guidelines and market analysis needs.

Request

Preliminary Analysis

Detailed Analysis

Pending Business Analysis. #9 in backlog.

10069B CDS Jo LeDuc WI

Enhance complaint codes for lender based insurance and pet

insurance

Request Detailed Analysis

Pending prioritization in Business Analysis backlog.

10071 All Apps Jo LeDuc WI

Redesign and enhance I-SITE reports using interactive data

visualization and add data analytics.

Request Detailed Analysis

Pending Business Analysis. #2 in backlog.

10072 MCAS Cheryl Hawley AZ

Allow companies to submit new filings for prior years once MCAS has been closed for submission

of the current year data.

Request Detailed Analysis

Pending Business Analysis. #8 in backlog.

Attachment Four

Market Information Systems Research and Development (D) Working Group Status of Outstanding USER (Uniform System Enhancement Request) Forms

As of July 14, 2017

Application Key: CDS – Complaints Database System; CIS – Consumer Information Source; MAMS – Market Analysis Market Share;

MATS – Market Action Tracking System; MAPT – Market Analysis Prioritization Tool; MARS – Market Analysis Review System; MCAS – Market Conduct Annual Statement; RIRS – Regulatory Information Retrieval System

© 2017 National Association of Insurance Commissioners Page 3 of 3

User Form #

Application Requestor Request Summary Documents NAIC Recommendation

Phase Target End Date

Status

10073 CDS Brent Kabler MO

Change calculation of complaint indices based on MIS Research and Development (D) Working

Group recommendations.

Request

Preliminary Analysis

Application Development

Being addressed to correct index calculations.

10074 MARS John Haworth WA

Allow for comments to be added to a Level 1 review after it has

been approved.

Request

Detailed Analysis

Application Development

Pending scheduling of application development

resources.

10075 MAPT Cheryl Hawley AZ

Include current year and previous two years of Overall

Score, National Score, and State Score, as well as main

component and sub-component scores.

Request

Preliminary Analysis

Detailed Analysis

Pending Business Analysis. #5 in backlog

10077 MAPT Ibrahim Al-Hajiby MN

Allow the user to select ‘all policy’ types instead of running

18 different reports.

Request

Preliminary Analysis

Detailed Analysis

Pending prioritization in Business Analysis backlog.

10078 MARS Mark Hooker WV

Add links for reviewer. Request

Preliminary Analysis

Detailed Analysis

Pending prioritization in Business Analysis backlog.

USER Form Cycle

Preliminary Analysis

1st

Consideration Detailed Analysis

2nd Consideration Development Testing

Withdrawn/Pending/ Complete

Pending Production

Attachment Four