92492 Design and Evaluation in Digital Health
Warning: The information on this page is indicative. The subject outline for a
particular session, location and mode of offering is the authoritative source
of all information about the subject for that offering. Required texts, recommended texts and references in particular are likely to change. Students will be provided with a subject outline once they enrol in the subject.
Subject handbook information prior to 2025 is available in the Archives.
Credit points: 6 cp
Result type: Grade and marks
Requisite(s): 92490 Introduction to Digital Health AND 90 credit points of completed study in spk(s): C10360 Bachelor of Public Health
Description
It is well accepted in all industries that technology needs to fit well with human characteristics, however the human–technology interchange in health care is ubiquitous and supports many configurations. As more and more kinds of increasingly complex digital health applications are integrated, interoperability in the health environment is vital. Poorly designed technology can result in errors, lower productivity, user frustration and even removal of the system, while poorly deployed technology systems can lead to unpredictable outcomes and unintended consequences. It is well known in health care that clinicians develop workarounds when technology interferes with their workflow, which are not ideal or a long-term solution. This subject exposes students to the fit between individuals, tasks and technology, starting with the system life cycle and ending with usability evaluation. Firstly, it is recognised that users must be an early and continuous focal point during the design of any digital health application. Secondly, the design process needs to be iterative, allowing for evaluation and modification of recognised problems. Lastly, formal evaluation of all digital health applications in relation to efficiency, effectiveness and satisfaction should occur. Students gain an appreciation of how to obtain user requirements, create an implementation roadmap, devise a benefits realisation framework and facilitate clinician buy-in for any digital health application.
Subject learning objectives (SLOs)
| A. | Distinguish between current Australian and international health data standards initiatives [Analy] |
|---|---|
| B. | Explain the importance of interoperability in the design of digital health [Eval] |
| C. | Discuss the principles of user-centric design [Synth] |
| D. | Determine challenges and relevant solutions for planning and designing digital health applications in complex healthcare systems [Eval] |
| E. | Explain the importance of continuous evaluation in relation to digital health applications [Eval] |
Course intended learning outcomes (CILOs)
This subject also contributes specifically to the following graduate attributes:
- Evaluate the effectiveness and efficiency of health projects and programs (2.1)
- Develop creative and innovative responses to health issues (2.2)
- Demonstrate adaptability to social, political and technological change in public health (2.3)
- Facilitate meaningful collaboration between stakeholders to develop effective public health strategies (3.2)
- Demonstrates critical thinking in the development and practice of public health (5.1)
Contribution to the development of graduate attributes
This subject also contributes specifically to the following graduate attributes:
2. Adaptability: Demonstrate creative and adaptive thinking within a changeable social, political and technological environment
2.1 Demonstrate adaptable and novel thinking within changing environments to maximise outcomes for a range of individuals, communities and stakeholders
2.2 Utilise enquiry based learning to develop innovative approaches to complex issues
2. 3 Manage and adapt to the environment to maximise integration of care and outcomes for a range of individuals, communities and stakeholders
3. Communication, collaboration and leadership: Use an assets -based approach to engender effective communication, collaboration and leadership
3.2 Consider and develop the health literacy of varied population groups and articulate the impact this has on effective communication and health care delivery
5. Critical thinking and practice: Translate research and evaluation into social and professional practice through critical thinking and knowledge integration
5.1 Identify appropriate information resources and apply effective and creative solutions for the improvement of individuals and communities
Teaching and learning strategies
This subject is designed to assist students understand best practice models and guidelines that influence the design and evaluation of health information systems and health information technology in a digital health environment. It is anticipated that the knowledge and skills gained in this subject will allow the graduate to contribute meaningfully to the design and deployment of digital health applications in all health settings, as well as suggesting appropriate solutions to problems identified in evaluation of these applications.
Pre-workshop learning
Students access online learning resources such as podcasts, videos and literature prior to attending face-to-face on-campus workshops to improve their confidence in approaching the proposed content, afford them time to construct questions, and facilitate discussion in class, resulting in shared learning, experiences and reflections. The specific activities will be detailed in this subject outline and all resources will be located on UTSOnline.
Blend of online and face-to-face strategies
This subject benefits from both the real time delivery of content and access to resources via UTSOnline, including podcasts, videos and learning resources. Students attend six(6) face-to-face on-campus workshops. The workshops provide a variety of models and theories for each content area, followed by discussion on which are best suited to likely situations in the health service environment. Several industry representatives provide their experience in health technology design and deployment, and reiterate lessons learnt in enterprise implementation.
Case based scenarios and collaboration
Contemporary Australian and international cases are used to help students explore the approaches to health information systems and technology design and evaluation. Real cases depict situations related to the extent of a technology being easy and pleasurable to use, the determination if the technology is well adapted to users and their tasks, the variety of analysis tools and techniques that assist designers better understand the task and the user environment, as well as methods to minimise the negative outcomes and unintended consequences of these digital health applications. Students will collaborate and use these scenarios to learn concepts, interpret existing processes and procedures related to digital health application design and evaluation within the healthcare environment. Self, peer and teacher feedback is provided during the workshops to develop students’ judgement.
Assessment range
Students will be exposed to a variety of assessment modes, including a position statement, user design analysis, critique of an Australian health information system deployment, and a presentation to health facility executive concerning the utility of an evaluation of an existing digital health technology. Feedback will be provided on assessments to ensure students can identify areas for development and areas of sufficient expertise. Students are encouraged to use contemporary educational technology. Some of the assessment will use a case study approach, with the student asked to assume a designated digital health coordination role in a hypothetical health service.
Early low-stakes feedback will be provided via two methods:
- during interactive sessions, where students discuss material raised, and ask questions of their peers and lecturing staff;
- results for the position statement (Assessment Item 1), worth 15%, will be received prior to the census date.
Continual feedback will be provided.
Content (topics)
- Overview of digital health design
- Information system design
- Information system deployment
- ?Digital health evaluation and research
Assessment
Assessment task 1: Digital technology user design
| Intent: | This assessment is designed to reinforce the principles of user experience in the design of digital health applications. User interface design focuses on anticipating what users might need to perform and ensuring that the application has attributes that are easy to access, understand, and use to facilitate those actions. User design in health is no different, requiring the designers to know their users including their goals, skills, literacy, preferences and tendencies. Poor user design can impact the utility of any digital health application, and this assessment fosters student understanding of the association of user experience with task completion, efficiency and satisfaction. |
|---|---|
| Objective(s): | This assessment task addresses subject learning objective(s): C This assessment task contributes to the development of graduate attribute(s): 3.2 and 5.1 |
| Groupwork: | Individual |
| Weight: | 35% |
| Length: | 1500 words |
| Criteria: |
|
Assessment task 2: Critique of an Australian information system deployment
| Intent: | This assessment is designed to provide the students with an opportunity to appreciate the enormous complexity of any health facility undertaking digital transformation. By undertaking a critique of a recent digital transition, students will be able to explore selected approaches and associated outcomes and difficulties It will ensure they are fully aware of the need to include clinician buy-in, to be familiar with all workflows, and to select an iterative process that is flexible ad can be easily adapted and amended. |
|---|---|
| Objective(s): | This assessment task addresses subject learning objective(s): D This assessment task contributes to the development of graduate attribute(s): 2.1, 2.2, 2.3, 3.2 and 5.1 |
| Groupwork: | Individual |
| Weight: | 35% |
| Length: | 1500 words |
| Criteria: |
|
Assessment task 3: Evaluation of research impact
| Intent: | This assessment requires students to consider the utility of evaluation, and how continuous evaluation and research increases the knowledge about digital health and improves processes when designing and deploying digital transformation within the health environment. Both the Centre for Health Informatics and the Centre for Health Systems and Safety Research are internationally recognised in the digital health arena, and their projects have heavily influenced the Australian context of digital health transformation. This assessment will provide the student with an opportunity to evaluate current digital health research and apply its findings to a range of digital health initiatives, as well as presenting information to a wider audience within a health setting to persuade decision makers of the applicability of the findings to local initiatives. |
|---|---|
| Objective(s): | This assessment task addresses subject learning objective(s): E This assessment task contributes to the development of graduate attribute(s): 2.1, 2.2, 2.3, 3.2 and 5.1 |
| Groupwork: | Individual |
| Weight: | 30% |
| Length: | 20-minute presentation (maximum of 12 slides) |
| Criteria: |
|
Required texts
Coiera, E. 2015, Guide to health informatics, 3rd edn, CRC Press, Boca Raton.
References
Links to references and additional resources are provided on UTSOnline.
Other resources
UTS Student Centre
Building 10
Monday to Friday: 9am - 5pm
Tel: 1300 ASK UTS (1300 275 887)
Details for student centres: www.uts.edu.au/current-students/contacts/general-contacts
For other resources/ information refer to the Faculty of Health website (www.uts.edu.au/about/faculty-health) and UTSOnline at: https://online.uts.edu.au/webapps/login/
UTS Library
The Library has a wide range of resources, facilities and services to support you including textbooks, subject readings, health literature databases, workshops and bookable study rooms. There is also a team of librarians to help you with your questions available via online chat, phone and in person. W: lib.uts.edu.au, Facebook: utslibrary, Twitter: @utslibrary Tel: (02) 9514 3666.
Improve your academic and English language skills
Marks for all assessment tasks such as assignments and examinations are given not only for what you write but also for how you write. If you would like the opportunity to improve your academic and English language skills, make an appointment with the HELPS (Higher Education Language & Presentation Support) Service in Student Services.
HELPS (Higher Education Language & Presentation Support)
HELPS provides assistance with English language proficiency and academic language. Students who need to develop their written and/or spoken English should make use of the free services offered by HELPS, including academic language workshops, vacation intensive courses, drop-in consultations, individual appointments and Conversations@UTS (www.ssu.uts.edu.au/helps). HELPS staff are also available for drop-in consultations at the UTS Library. Phone (02) 9514 9733.
Please see www.uts.edu.au for additional information on other resources provided to students by UTS.