Prediction of American Society of Anesthesiologists Physical Status Classification from preoperative clinical text narratives using natural language processing

Chung, Philip; Fong, Christine T.; Walters, Andrew M.; Yetisgen, Meliha; O’Reilly-Shah, Vikas N.

doi:10.1186/s12871-023-02248-0

Table 3 Area Under Precision-Recall Curve

From: Prediction of American Society of Anesthesiologists Physical Status Classification from preoperative clinical text narratives using natural language processing

A. Macro-average AUPRC
	Baseline	Diagnosis	Procedure	HPI	PMSH	ROS	Meds	Note	Note512
Random Classifier	0.250	---	---	---	---	---	---	---	---
Age & Meds	0.416	---	---	---	---	---	---	---	---
Random Forest	---	0.457	0.462	0.510	0.392	0.484	0.489	0.567	0.534
Support Vector Machine	---	0.443	0.451	0.525	0.413	0.514	0.490	0.627	0.593
fastText	---	0.478	0.473	0.518	0.421	0.512	0.495	0.642	0.607
BioClinicalBERT	---	0.486	0.473	0.570	0.446	0.536	0.499	0.616	0.619
B. Class-specific AUPRC
	Baseline	Diagnosis	Procedure	HPI	PMSH	ROS	Meds	Note	Note512
Random Classifier
I	0.091	---	---	---	---	---	---	---	---
II	0.316	---	---	---	---	---	---	---	---
III	0.429	---	---	---	---	---	---	---	---
IV-V	0.163	---	---	---	---	---	---	---	---
Age & Meds
I	0.384	---	---	---	---	---	---	---	---
II	0.425	---	---	---	---	---	---	---	---
III	0.568	---	---	---	---	---	---	---	---
IV-V	0.289	---	---	---	---	---	---	---	---
Random Forest
I	---	0.285	0.285	0.394	0.295	0.374	0.327	0.488	0.455
II	---	0.490	0.487	0.518	0.425	0.515	0.498	0.580	0.550
III	---	0.565	0.576	0.614	0.551	0.610	0.621	0.650	0.625
IV-V	---	0.488	0.500	0.514	0.299	0.437	0.510	0.550	0.508
Support Vector Machine
I	---	0.272	0.305	0.436	0.323	0.433	0.345	0.606	0.575
II	---	0.460	0.441	0.519	0.392	0.493	0.477	0.614	0.574
III	---	0.568	0.567	0.618	0.570	0.639	0.618	0.684	0.655
IV-V	---	0.473	0.492	0.527	0.367	0.491	0.519	0.605	0.568
fastText
I	---	0.317	0.308	0.428	0.316	0.429	0.340	0.617	0.575
II	---	0.507	0.491	0.531	0.453	0.559	0.517	0.645	0.605
III	---	0.590	0.583	0.620	0.568	0.617	0.622	0.705	0.675
IV-V	---	0.495	0.510	0.491	0.349	0.444	0.502	0.601	0.575
BioClinicalBERT
I	---	0.330	0.301	0.529	0.354	0.445	0.337	0.582	0.591
II	---	0.499	0.487	0.562	0.454	0.553	0.521	0.616	0.612
III	---	0.599	0.585	0.641	0.588	0.655	0.628	0.679	0.690
IV-V	---	0.517	0.519	0.546	0.388	0.492	0.509	0.588	0.585

A) Macro-average AUPRC and (B) class-specific AUPRC for each model architecture and task on the held-out test set compared to baseline models. Random Classifier serves as a negative control baseline. Age & Meds classifier serves as a simple clinical baseline. Supplemental Table 6 is a copy of this table with all standard errors reported

Back to article page

ISSN: 1471-2253

Contact us

Submission enquiries: bmcanesthesiology@biomedcentral.com
General enquiries: ORSupport@springernature.com

BMC Anesthesiology

Contact us