Evaluating Large Language Models in Nursing Care Decision-Making: A Randomized Controlled Trial
NCT07933107, Not applicable, Completed, Chimei Medical Center
Trial 10
As registered on ClinicalTrials.gov, in the graph's capture of the registry.
| Field | Value | Source |
|---|---|---|
| Title | Evaluating Large Language Models in Nursing Care Decision-Making: A Randomized Controlled Trial | ClinicalTrials.gov |
| NCT number | NCT07933107 | ClinicalTrials.gov |
| Status | Completed | ClinicalTrials.gov |
| Phases | Not applicable | ClinicalTrials.gov |
| Enrollment | 120 participants, actual | ClinicalTrials.gov |
| Lead sponsor | Chimei Medical Center | ClinicalTrials.gov |
| Conditions | Nursing Care Planning | ClinicalTrials.gov |
| Interventions | Independent planning, LLM-assisted planning | ClinicalTrials.gov |
| First posted | 2026-11-12 | ClinicalTrials.gov |
| Last updated | 2026-11-12 | ClinicalTrials.gov |
Registered outcomes 4
Each outcome the trial registered, primary first, in ClinicalTrials.gov's words.
| List | Outcome | Time frame | Description | Source |
|---|---|---|---|---|
| Primary | Expert-rated nursing care decision quality (six-item total score) | Day 1 (at the end of the single simulation session). | The final nursing care plan for a standardized simulated clinical case is independently assessed by three expert nurse raters blinded to group assignment, using a study-specific six-item rating instrument. Five items assess decision-content quality and one item assesses decision-language quality. Each item is scored from 1 to 5. The content subtotal ranges from 5 to 25, and the language score ranges from 1 to 5. For each rater, the six item scores are summed to obtain a total score ranging from 6 to 30. The participant-level score is the arithmetic mean of the three raters' total scores. Higher scores indicate better assessed nursing care decision quality. | ClinicalTrials.gov |
| Primary | Total care-planning task completion time (seconds) | Day 1 (during the single simulation session). | Total elapsed time, in seconds, from the start of the simulated care-planning task to submission of the final care plan, calculated from system-recorded start and submission timestamps. The same timing boundaries apply to both groups. Time includes case review, drafting, review, and revision. In the LLM-assisted planning group, it also includes prompt entry and LLM processing within the task interval. Lower values indicate shorter task completion time. | ClinicalTrials.gov |
| Secondary | Textual overlap with an expert consensus reference (ROUGE-L) | Day 1 (final care plan submitted at the end of the single simulation session; scored offline). | ROUGE-L score comparing each participant's final submitted care plan with the expert consensus reference for the same simulated clinical case. The score quantifies textual overlap based on the longest common subsequence between the submitted text and the reference. Higher scores indicate greater textual overlap. Scores are calculated offline from the final care plans submitted after the assigned workflow. | ClinicalTrials.gov |
| Secondary | Semantic similarity to an expert consensus reference (BERTScore) | Day 1 (final care plan submitted at the end of the single simulation session; scored offline). | BERTScore comparing each participant's final submitted care plan with the expert consensus reference for the same simulated clinical case. The score assesses semantic similarity using contextual text embeddings. Higher scores indicate greater semantic similarity under the specified model and calculation settings. Scores are calculated offline from the final care plans submitted after the assigned workflow. | ClinicalTrials.gov |
Outcomes 0
Each outcome the trial posted results for, in ClinicalTrials.gov's words.
| Type | Outcome | Time frame | Population | Units | Measured as | Source |
|---|
Results by group 0
Each measurement the trial posted, group by group, in the words and numbers it posted.
| Outcome | Group | Category | Value | Spread | Units | Source |
|---|
Participant flow 0
How many started, completed or left each group, period by period.
| Period | Milestone | Group | Participants | Units counted | Source |
|---|
Adverse events 0
Each adverse event the trial posted, group by group: the participants affected out of those at risk.
| Type | Event | Organ system | Group | Affected | At risk | Events | Source |
|---|
Adverse event totals 0
The totals the trial posted for each group.
| Total | Group | Affected | At risk | Source |
|---|
Papers 0
The papers the trial lists on ClinicalTrials.gov.
| PMID | Listed as | Source |
|---|
Grants 0
The grants NIH RePORTER links to the trial, newest funded first: NIH's, and some of AHRQ's, CDC's, FDA's and VA's. Each shows its title, principal investigators, organization and funder in its newest year.
| Project | Title | Principal investigators | Organization | Funder | Fiscal years | Source |
|---|
Trial comparisons 0
Comparisons of the trial's two groups, calculated by ConductScience from the counts it posted.
| Comparison | Source |
|---|
Tests 0
The ConductCognition tests this trial's registered outcomes name, as ScienceGraph matched them in trial-tests-2026-11-12-0.2.1.
| Test | Named as | Source |
|---|
Source 5
| Field | Value | Source |
|---|---|---|
| Release | trials-2026-11-12-0.4.0 | ClinicalTrials.gov |
| Release manifest SHA-256 | 0f4a8d8c48aee2a7573ae0fa94ecbeab70c1adbe449bbc95c424bc7d3e97b9d4 | ClinicalTrials.gov |
| Registry capture | 2026-11-12 | ClinicalTrials.gov |
| Results copy, AACT | 2026-03-23 | ClinicalTrials.gov |
| NIH clinical studies file | 2026-11-13 | ClinicalTrials.gov |
Release trials-2026-11-12-0.4.0
ClinicalTrials.gov's posted results, through CTTI's AACT: ClinicalTrials.gov data via Aggregate Analysis of ClinicalTrials.gov (AACT), CTTI. CTTI makes its materials freely available and requests acknowledgement. https://aact.ctti-clinicaltrials.org/documentation/299 ClinicalTrials.gov's data carry an international copyright outside the United States: https://clinicaltrials.gov/about-site/terms-conditions.
ClinicalTrials.gov: none stated ClinicalTrials.gov's data carry an international copyright outside the United States: https://clinicaltrials.gov/about-site/terms-conditions.
NIH RePORTER's clinical studies and project files: Public domain (NIH RePORTER)