<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE ArticleSet PUBLIC "-//NLM//DTD PubMed 2.7//EN" "https://dtd.nlm.nih.gov/ncbi/pubmed/in/PubMed.dtd">
<ArticleSet>
<Article>
<Journal>
				<PublisherName>Kerman University of Medical Sciences</PublisherName>
				<JournalTitle>International Journal of Health Policy and Management</JournalTitle>
				<Issn>2322-5939</Issn>
				<Volume>14</Volume>
				<Issue>1</Issue>
				<PubDate PubStatus="epublish">
					<Year>2025</Year>
					<Month>12</Month>
					<Day>01</Day>
				</PubDate>
			</Journal>
<ArticleTitle>Comprehensive Evaluation of Quality Indicators: Analyzing the Dutch Breast Cancer Audit</ArticleTitle>
<VernacularTitle></VernacularTitle>
			<FirstPage>1</FirstPage>
			<LastPage>12</LastPage>
			<ELocationID EIdType="pii">4800</ELocationID>
			
<ELocationID EIdType="doi">10.34172/ijhpm.8943</ELocationID>
			
			<Language>EN</Language>
<AuthorList>
<Author>
					<FirstName>Elfi M.</FirstName>
					<LastName>Verheul</LastName>

						<AffiliationInfo>
						<Affiliation>Center for Medical Decision Making, Department of Public Health, Erasmus
University Medical Center, Rotterdam, The Netherlands</Affiliation>
						</AffiliationInfo>

						<AffiliationInfo>
						<Affiliation>Dutch Institute for
Clinical Auditing, Leiden, The Netherlands</Affiliation>
						</AffiliationInfo>
<Identifier Source="ORCID">0000-0001-6163-2579</Identifier>

</Author>
<Author>
					<FirstName>Margrietha</FirstName>
					<LastName>Van Der Linde</LastName>
<Affiliation>Center for Medical Decision Making, Department of Public Health, Erasmus
University Medical Center, Rotterdam, The Netherlands</Affiliation>
<Identifier Source="ORCID">0000-0001-6034-0064</Identifier>

</Author>
<Author>
					<FirstName>Hester F.</FirstName>
					<LastName>Lingsma</LastName>
<Affiliation>Center for Medical Decision Making, Department of Public Health, Erasmus University Medical Center, Rotterdam, The Netherlands</Affiliation>
<Identifier Source="ORCID">0000-0003-2063-9533</Identifier>

</Author>
<Author>
					<FirstName>Elvira</FirstName>
					<LastName>Vos</LastName>
<Affiliation>Department of Surgery, Rhode Island
Hospital, Warren Alpert Medical School of Brown University, Providence, RI, USA</Affiliation>
<Identifier Source="ORCID">0000-0001-8468-4363</Identifier>

</Author>
<Author>
					<FirstName>Sabine</FirstName>
					<LastName>Siesling</LastName>

						<AffiliationInfo>
						<Affiliation>Department of Research, Netherlands Comprehensive Cancer Organization
(IKNL), Utrecht, The Netherlands</Affiliation>
						</AffiliationInfo>

						<AffiliationInfo>
						<Affiliation>Department of Health Technology and Services
Research, Technical Medical Centre, University of Twente, Enschede, The
Netherlands</Affiliation>
						</AffiliationInfo>
<Identifier Source="ORCID">0000-0002-0273-824X</Identifier>

</Author>
<Author>
					<FirstName>Linetta B.</FirstName>
					<LastName>Koppert</LastName>
<Affiliation>Department of Surgery, Erasmus MC Cancer Institute, Rotterdam,
The Netherlands</Affiliation>
<Identifier Source="ORCID">0000-0003-1944-6777</Identifier>

</Author>
<Author>
					<FirstName>NBCA</FirstName>
					<LastName>Consortium#</LastName>
<Affiliation># A full list of the collaborators
of the NBCA Consortium
is provided at the end of the
article</Affiliation>

</Author>
</AuthorList>
				<PublicationType>Journal Article</PublicationType>
			<History>
				<PubDate PubStatus="received">
					<Year>2024</Year>
					<Month>10</Month>
					<Day>21</Day>
				</PubDate>
			</History>
		    <Abstract>Background Quality indicators (QIs) are widely used to benchmark hospital performance and improve quality of care but are often based on expert opinion rather than data-driven assessment. This study aims to evaluate QIs, using a framework that assesses four criteria: Feasibility, discriminative ability, validity, and reliability.Methods We used data from the Dutch breast cancer registry (NABON Breast Cancer Audit, NBCA) and included all surgically treated breast cancer patients in the Netherlands between 2021-2023. Eighteen QIs were evaluated. Feasibility was determined by QI numerator completeness, with &gt;90% data availability considered feasible. Discriminative ability was assessed by between-hospital variation in QI scores, where an interquartile range (IQR) &gt;10% indicated good discrimination. Validity was evaluated by the impact of case-mix adjustment and considered low when (pseudo-) R² &lt;0.10. The (pseudo-)R² reflects the proportion of variance in QI scores explained by all case-mix variables in a regression model. Reliability was assessed by rankability, the proportion of between-hospital variation not due to chance and, therefore, explainable by quality of care. Rankability &gt;75% was considered high. Results After exclusion of one QI with feasibility &lt;1%, feasibility ranged from 80.2%-100%, and 15 QIs were feasible. Overall, the IQR ranged from 1 to 36, with 8 QIs having an IQR higher than 10, indicating good discriminative ability. The (pseudo-)R² ranged from 0.01-0.53, with 11 QIs showing low case-mix impact. Rankability ranged from 0-69%, with none of the QIs having a high rankability. None of the QIs met all preset criteria, but six QIs met at least three out of four criteria. Conclusion The QIs employed by the Dutch breast cancer registry fulfilled most criteria, but rankability is a concern and requires specific attention, especially for public reporting. Our results show the importance of considering feasibility, discriminative ability, validity, and reliability when evaluating QIs, and these should also be taken into account when developing new QIs.</Abstract>
		<ObjectList>
			<Object Type="keyword">
			<Param Name="value">Quality Indicators</Param>
			</Object>
			<Object Type="keyword">
			<Param Name="value">Quality Indicator Evaluation</Param>
			</Object>
			<Object Type="keyword">
			<Param Name="value">Healthcare Quality</Param>
			</Object>
			<Object Type="keyword">
			<Param Name="value">Clinical Registries</Param>
			</Object>
			<Object Type="keyword">
			<Param Name="value">Cancer Care</Param>
			</Object>
		</ObjectList>
<ArchiveCopySource DocType="pdf">https://www.ijhpm.com/article_4800_0c4a4df48a930b56e7d71ec5a34b8257.pdf</ArchiveCopySource>
</Article>
</ArticleSet>
