TAILIEUCHUNG - Báo cáo khoa học: "Using a Randomised Controlled Clinical Trial to Evaluate an NLG System"

The STOP system, which generates personalised smoking-cessation letters, was evaluated by a randomised controlled clinical trial. We believe this is the largest and perhaps most rigorous task effectiveness evaluation ever performed on an NLG system. The detailed results of the clinical trial have been presented elsewhere, in the medical literature. In this paper we discuss the clinical trial itself: its structure and cost, what we did and did not learn from it (especially considering that the trial showed that STOP was not effective), and how it compares to other NLG evaluation techniques. . | Using a Randomised Controlled Clinical Trial to Evaluate an NLG System Ehud Reiterf Roma RobertsonỊ A Scott LennoxỊ Liesl Osman Departments of Computing Scieneef General Practice and Medicine and Therapeutics University of Aberdeen Aberdeen Scotland UK @ Abstract The STOP system which generates personalised smoking-cessation letters was evaluated by a randomised controlled clinical trial. We believe this is the largest and perhaps most rigorous task effectiveness evaluation ever performed on an NLG system. The detailed results of the clinical trial have been presented elsewhere in the medical literature. In this paper we discuss the clinical trial itself its structure and cost what we did and did not learn from it especially considering that the trial showed that STOP was not effective and how it compares to other NLG evaluation techniques. 1 Introduction There is increasing interest in techniques for evaluating Natural Language Generation nlg systems. However we are not aware of any previously reported evaluations of NLG systems which have rigorously compared the task effectiveness of an NLG system to a non-NLG alternative. In this paper we discuss such an evaluation a large scale 2553 subjects randomised controlled clinical trial which evaluated the effectiveness of personalised smoking-cessation letters generated by the STOP system Reiter et al. 1999 . We believe that this is the largest most expensive and perhaps most rigorous evaluation ever done of an NLG system it was also a disappointing evaluation as it showed that STOP letters in general were no more effective than control letters. The detailed results of the STOP evaluation have been presented elsewhere in the medical lit erature Lennox et al. 2001 . The purpose of this paper is to discuss the clinical trial from an NLG evaluation perspective in order to help future researchers decide when a clinical trial or similar large-scale task effectiveness .

• Báo cáo khoa học
• Using a Randomised
• Controlled Clinical Trial
• Evaluate an NLG System
• báo cáo khoa học
• mô hình ngôn ngữ
• xử lý ngôn ngữ tự nhiên
• BMC Pediatrics
• Assessor blinded
• Randomised controlled equivalence trial
• Trans epidermal water loss
• Quality clinical trials
• BMC Pulmonary Medicine
• Exercise training intervention
• Randomised controlled trial
• Home based
• Quality of life
• Functional exercise capacity
• Physical activity
• Eating rate
• Functional Magnetic Resonance Imaging
• Randomised trial
• Self reported appetite
• báo cáo y học
• công trình nghiên cứu về y học
• tài liệu về y học
• cách trình bày báo cáo
• Trình bày báo cáo
• tài liệu báo cáo khoa học
• nghiên cứu y học
• kiến thức y học
• Type 1 diabetes
• Improving glycaemic control
• Health care providers
• Routine paediatric
• Outpatient clinics
• Iron supplementation
• Iron deficiency
• Iron deficiency anaemia
• Sub Saharan Africa
• BMC Cancer
• Socioeconomic inequalities
• Colorectal cancer screening
• Fuzzy trace theory
• Overall uptake
• Colorectal cancer
• General practice
• Faecal occult blood test
• Early diagnosis
• Immunochemical faecal occult blood test
• BMC Musculoskeletal Disorders
• 3D printing
• Distal radius fracture
• Intraoperative fluoroscopy
• Gartland–Werley scores
• Low back pain
• STarTBack tool
• Group exercise
• Education Intervention
• Chronic obstructive pulmonary disease
• Serious errors
• Dry powder inhaler
• Inhaler technique
• Economic evaluation
• Cost effectiveness
• Randomized trial
• Psoriatic arthritis
• Treatment näive
• TNF inhibitor
• Treat to target
• Minimal disease activity
• Clinical trial
• Pilot trial
• Sensor biofeedback
• Musculoskeletal disorders
• Clinical trial protocol
• Clear cell renal cell carcinoma
• Phase II clinical trial
• Bayesian adaptive trial
• BMC Anesthesiology
• Anterior sciatic nerve block
• Posterior sciatic nerve block
• Block quality
• Femoral nerve blocks
• Spinal anesthesia
• SOFT block
• Peripheral nerve block
• Lower extremity surgery
• Randomised controlled trials
• Meta analyses
• Multivariable regression analysis
• Modern technology
• Cancer receive
• Initial treatment
• Psychological distress