Importance Large language models (LLMs) may facilitate the labor-intensive process of systematic reviews. However, the exact methods and reliability remain uncertain. Objective To explore the feasibility and reliability of using LLMs to assess risk of bias (ROB) in randomized clinical trials (RCTs). Design, Setting, and Participants A survey study was conducted between August 10, 2023, and October 30, 2023. Thirty RCTs were selected from published systematic reviews. Main Outcomes and Measures A structured prompt was developed to guide ChatGPT (LLM 1) and Claude (LLM 2) in assessing the ROB in these RCTs using a modified version of the Cochrane ROB tool developed by the CLARITY group at McMaster University. Each RCT was assessed twice by both models, and the results were documented. The results were compared with an assessment by 3 experts, which was considered a criterion standard. Correct assessment rates, sensitivity, specificity, and F1 scores were calculated to reflect accuracy, both overall and for each domain of the Cochrane ROB tool; consistent assessment rates and Cohen kappa were calculated to gauge consistency; and assessment time was calculated to measure efficiency. Performance between the 2 models was compared using risk differences. Results Both models demonstrated high correct assessment rates. LLM 1 reached a mean correct assessment rate of 84.5% (95% CI, 81.5%-87.3%), and LLM 2 reached a significantly higher rate of 89.5% (95% CI, 87.0%-91.8%). The risk difference between the 2 models was 0.05 (95% CI, 0.01-0.09). In most domains, domain-specific correct rates were around 80% to 90%; however, sensitivity below 0.80 was observed in domains 1 (random sequence generation), 2 (allocation concealment), and 6 (other concerns). Domains 4 (missing outcome data), 5 (selective outcome reporting), and 6 had F1 scores below 0.50. The consistent rates between the 2 assessments were 84.0% for LLM 1 and 87.3% for LLM 2. LLM 1's kappa exceeded 0.80 in 7 and LLM 2's in 8 domains. The mean (SD) time needed for assessment was 77 (16) seconds for LLM 1 and 53 (12) seconds for LLM 2. Conclusions In this survey study of applying LLMs for ROB assessment, LLM 1 and LLM 2 demonstrated substantial accuracy and consistency in evaluating RCTs, suggesting their potential as supportive tools in systematic review processes.

Objective: To summarize the evidence of various exercise modalities on population with insomnia disorders. Method: PubMed, Embase, Cochrane Library, and Web of Science were searched for eligible studies published from inception to October 2022 and updated on September 2023. Systematic reviews with meta -analyses and randomized controlled trials designed to investigate the effect of various exercise modalities on population with insomnia were eligible. Results: A total of 4 SRs with (very) low methodological quality and 1034 participants in 10 network metaanalyses explored the association between different types and intensity exercise modalities with insomnia disorders. Various exercise modalities could significantly improve total sleep time and sleep quality and alleviate insomnia severity. Compared to passive control, moderate aerobic exercise, moderate aerobic exercise combined with light intensity strength and mind -body exercise can improve sleep efficiency and reduce wake after sleep onset by objectively measured. Moderate intensity strength, light intensity strength and mind -body exercise can improve sleep efficiency subjectively measured; mind -body exercise can reduce sleep onset latency and wake time after sleep onset, and increase total sleep time; moderate aerobic exercise can reduce sleep onset latency. Moderate intensity strength, light intensity strength, mind body exercise and moderate aerobic exercise combined with light intensity strength can the severity of insomnia and improv sleep quality. Conclusion: Exercise had a positive effect on relief insomnia and improve sleep quality. Moderate aerobic exercise, mind -body exercise and moderate aerobic exercise combined with light intensity strength play an important role in improving the sleep quality in people with insomnia disorders.

Objective: Clinical Practice Guidelines (CPGs) have an indispensable role in guiding the selection of various treatments for insomnia, however, little is known about the quality of released insomnia CPGs. This study aims to critically appraise the quality of existing insomnia CPGs and identify quality limitations. Methods: PubMed, Web of Science, Embase, China National Knowledge Infrastructure, Wanfang, China Biology Medicine disc, and 6 databases of international guideline developing institutions were systematically searched. CPGs on the diagnosis or treatment of insomnia were included. Reviewers independently extracted basic information and development methods, and assessed methodological quality and reporting quality using the Appraisal of Guidelines for Research and Evaluation (AGREE) II tool and Reporting Items for practice Guidelines in Healthcare (RIGHT) checklist respectively. Intraclass correlation coefficients (ICCs) were used to measure the agreement among reviewers and assess inter-rater reliability. Results: Twenty-six CPGs were identified that focused on adults, children, or children with autistic spectrum disorder, patients in the intensive care unit, patients with cancer and pregnant, lactating or menopausal women. Twenty-two CPGs used nine grading systems to rate the level of evidence and strength of recommendation. 53.85% CPGs were classified as "recommended with modification" according to the AGREE II scores (ICC from 0.64 to 0.90), and 2 CPGs were "recommended". The "clarity of presentation" domain achieved the highest mean score (67.9% +/- 11.04%) but the "applicability" domain (37.1% +/- 12.67%) achieved the lowest. The average reporting rate of RIGHT items in all guidelines was 67.87%. Conclusions: The quality of guidelines varied substantially. Guideline developers should realize the importance of guideline applicability, patients' preferences and values. (c) 2022 Elsevier B.V. All rights reserved.

Objective: The aim of this study was to examine the most effective delivery format of cognitive behavioral therapy for insomnia (CBT-I) on insomnia in cancer patients. Methods: We searched five databases up to February 2021 for randomized clinical trials that compared CBT-I with inactive or active controls for insomnia in cancer patients. Outcomes were insomnia severity, sleep efficiency, sleep onset latency (SOL), wake after sleep onset (WASO), and total sleep time (TST). Pairwise meta-analyses and frequentist network meta-analyses with the random-effects model were applied for data analyses. Results: Sixteen unique trials including 1523 participants met inclusion criteria. Compared with inactive control, CBT-I could significantly reduce insomnia severity (mean differences [MD] = -4.98 points, 95% confidence interval [CI]: -5.82 to -4.14), SOL (MD = -12.29 min, 95%CI: -16.48 to -8.09), and WASO (MD = -16.58 min, 95%CI: -22.00 to -11.15), while increasing sleep efficiency (MD = 7.62%, 95%CI: 5.82% to 9.41%) at postintervention. Compared with active control, CBT-I could significantly reduce insomnia severity (MD = -2.75 points, 95%CI: -4.28 to -1.21), SOL (MD = -13.56 min, 95%CI: -18.93 to -8.18), and WASO (MD = -6.99 min, 95%CI: -11.65 to -2.32) at postintervention. These effects diminished in short-term follow-up and almost disappeared in long-term follow-up. Most of the results were rated as "moderate" to "low" certainty of evidence. Network meta-analysis showed that group CBT-I had an increase in sleep efficiency of 10.61%, an increase in TST of 21.98 min, a reduction in SOL of 14.65 min, and a reduction in WASO of 24.30 min, compared with inactive control at postintervention, with effects sustained at short-term follow-up. Conclusions: CBT-I is effective for the management of insomnia in cancer patients postintervention, with diminished effects in short-term follow-up. Group CBT-I is the preferred choice based on postintervention and short-term effects. The low quality of evidence and limited sample size demonstrate the need for robust evidence from high-quality, large-scale trials providing long-term follow-up data.

Ethnopharmacological relevance: Traditional Chinese Medicine (TCM) represents a rich repository of empirically -developed traditional medicines. The findings call for more rigorous study into the efficacy, safety, and mechanisms of action of TCM remedies to strengthen the evidence base. Aim of the study: To systematically review the quality of insomnia clinical practice guidelines that involve TCM recommendations and to summarize the certainty of evidence supporting the recommendations, strength, and consistency of recommendations, providing valuable research references for the development of future insomnia guidelines. Materials and methods: We systematically searched PubMed, Web of Science, Embase, CNKI, Wanfang, Chinese Biomedical Literature Database, Chinese Medical Association, Chinese Sleep Research Society, Medsci, Medlive, British National Institute of Health and Clinical Excellence (NICE), and the International Guidelines Collaboration Network (GIN) for clinical practice guidelines on insomnia from inception to March 5, 2023. Four evaluators conducted independent assessments of the quality of the guidelines by employing the AGREE II tool. Subsequently, the guideline recommendations were consolidated and presented as evidence maps.Results: Thirteen clinical practice guidelines addressing insomnia, encompassing 211 recommendations (consisting of 127 evidence-based and 84 expert consensus recommendations), were deemed eligible for inclusion in our analysis. The evaluation results revealed an overall suboptimal quality, with the "scope and purpose" domain achieving the highest score (58.1%), while the "applicability" domain garnered the lowest score (13.0%). Specifically, it was observed that 74.8% (n = 95) of the evidence-based recommendations were supported by evidence of either very low or low certainty, in contrast to the expert consensus recommendations, which accounted for 61.9% (n = 52). We subsequently synthesized 44 recommendations into four evidence maps, focusing on proprietary Chinese medicines, Chinese medicine prescriptions, acupuncture, and massage, respectively. Notably, Chinese herbal remedies and acupuncture exhibited robust support, substantiated by high-certainty evidence, exemplified by interventions such as Xuefu Zhuyu decoction, spleen decoction, body acupuncture, and ear acupuncture, resulting in solid recommendations. Conversely, proprietary Chinese medicines needed more high-certainty evidence, predominantly yielding weak recommendations. As for other therapies, the level of certainty was predominantly categorized as low or very low. Recommendations about magnetic therapy, bathing, and fumigation relied primarily on expert consensus, needing more substantive clinical research evidence, consequently forming weak recommendations. Hot ironing and acupoint injection recommendations were weakly endorsed, primarily based on observational studies. Furthermore, interventions like qigong, gua sha, and moxibustion displayed a relatively limited number of clinical studies, necessitating further exploration to ascertain their efficacy.Conclusions: Our analysis revealed a need for substantial improvement in the quality of all the included guidelines related to insomnia. Notably, recommendations for Traditional Chinese Medicine (TCM) treatments predominantly rely on low-certainty evidence. This study represents a pioneering effort in the utilization of recommendation mapping to both present and identify existing gaps in the evidence landscape within TCM therapies, thus setting the stage for future research initiatives. The evidence supporting TCM therapy recommendations must be fortified to achieve a more substantial level of recommendation and higher certainty. Consequently, there exists a critical and pressing demand for high-quality clinical investigations dedicated to TCM, with a specific focus on ascertaining its long-term efficacy, safety, and potential side effects in the context of insomnia treatment. These endeavors are poised to establish a robust scientific foundation to inform the development of TCM therapy recommendations within the insomnia guidelines.

This review compared the efficacy and acceptability of different delivery formats for cognitive behavioral therapy for insomnia (CBT-I) in insomnia. We searched five databases for randomized clinical trials that compared one CBT-I delivery format against another format or control conditions for insomnia in adults. We used pairwise meta-analyses and frequentist network meta-analyses with the random-effects model to synthesize data. A total of 61 unique trials including 11,571 participants compared six CBT-I delivery formats with four control conditions. At post-intervention, with low to high certainty evidence, individual, group, guided self-help, digital assisted, and unguided self-help CBT-I could significantly increase sleep efficiency and total sleep time (TST) and reduce sleep onset latency (SOL), wake after sleep onset (WASO), and insomnia severity compared with treatment as usual (MD range for sleep efficiency: 7.81%-12.45%; MD range for TST: 16.14-33.96 min; MD range for SOL:-22.42 to-13.81 min; MD range for WASO:-40.84 to-19.48 min; MD range for insomnia severity:-6.40 to-3.93) and waitlist (MD range for sleep efficiency: 7.68%-12.32%; MD range for TST: 12.67-30.49 min; MD range for SOL:-19.07 to-10.46 min; MD range for WASO:-47.10 to-19.15 min; MD range for insomnia severity:-7.59 to-5.07). The effects of different CBT-I formats per-sisted at short-term follow-up (4 wk-6 mo). Individual, group, and digital assisted CBT-I delivery formats would be the more appropriate choices for insomnia in adults, based on post-intervention and short-term effects. Further trials are needed to investigate the long-term effects of different CBT-I formats. (c) 2022 Elsevier Ltd. All rights reserved.

Background: Acupuncture has been widely practiced for primary insomnia (PI). However, the relative benefit and harm among acupuncture therapies remain uncertain.Objectives: To compare and evaluate the effect differences of multiple acupuncture therapies for patients with PI.Methods: Systematic literature search for randomized controlled trials (RCTs). Pairs of reviewers independently conducted literature screening, data extraction, and risk of bias assessment. Meta-analysis was conducted using R and Stata software. The Grading of Recommendations Assessment, Development, and Evaluation system (GRADE) was used to assess certainty of evidence and interpret results.Results: Fifty-seven RCTs with 4678 patients were included. Compared with usual treatment, multiple acupuncture therapies showed a better effect for Pittsburgh sleep quality index score. And acupoints catgut embedding (ACE) was proved to be the most effective with a moderate certainty of evidence; auricular acupressure or auricular acupuncture plus manual acupuncture (AP + MA), electroacupuncture plus acupoint application (EA + APA), and intradermal needle (IN) might be also the most effective with low certainty of evidence. ACE, ACE + MA, AP + MA, EA, EA + APA, HPN, MA and PBN + MA showed significantly improvement in effective rate when compared with usual treatment. Insufficient evidence reported on Epworth Sleepiness Scale, Athens Insomnia Scale, and recurrence rate. The most common slight adverse events mainly included hematoma, pain, headache, and bleeding.Conclusions: With moderate to low certainty of evidence, multiple acupuncture therapies showed impressive insomnia improvement, especially ACE, AP + MA, and EA + APA. Differences between therapies were small or insignificant and based-on low or very low certainty of evidence.(c) 2022 Elsevier B.V. All rights reserved.

Growing evidence indicates that insomnia may be associated with mortality. However, these findings have been inconsistent. We systematically searched MEDLINE and EMBASE to identify prospective cohort studies that assessed the association between insomnia disorder/individual insomnia symptoms and the risk of mortality among adults aged ≥18 yrs. We addressed this association using summary hazard ratios (HRs) and 95% confidence intervals (CIs) calculated using random-effects meta-analysis, and the GRADE approach to rate the certainty of evidence. Twenty-nine cohorts including 1,598,628 individuals (55.3% men; mean age 63.7 yrs old) with a median follow-up duration of 10.5 yrs proved eligible. Difficulty falling asleep (DFA) and non-restorative sleep (NRS) were associated with an increased risk of all-cause mortality (DFA: HR = 1.13, 95%CI 1.03 to 1.23, p = 0.009, moderate certainty; NRS: HR = 1.23, 95%CI 1.07 to 1.42, p = 0.003, high certainty) and cardiovascular disease mortality (DFA: 1.20, 95%CI: 1.01, 1.43; p = 0.04, moderate certainty; NRS: HR = 1.48, 95%CI 1.06 to 2.06, p = 0.02, moderate certainty). Convincing associations between DFA and all-cause mortality were restricted to the mid to older-aged population (moderate credibility). Insomnia disorder, difficulty maintaining sleep, and early morning awakening proved to be unassociated with all-cause and cardiovascular disease mortality. No insomnia symptoms proved to be associated with cancer-related mortality.