1
|
- Richard C. Rayne and Glenn K. Baggott
- r.rayne@bbk.ac.uk
- http://www.bbk.ac.uk/olaaf/
|
2
|
- adults (aged >20 y), full-time employed
- variety of educational backgrounds
- reflect the cultural diversity typical of London
- classes: evening, once per week
|
3
|
- CBA can play a key role�
- forces author to carefully consider key learning objectives
- formative and summative modes
- web-delivered
- sophisticated question styles permit tests of
higher-order learning
- CBAF is even better
|
4
|
- TRIADS = TRIpartite Assessment and Delivery System
- ��a toolkit for users of Authorware Professional designed to facilitate
rapid and easy production of computer aided assessments. The sign-on,
question sequencing, results calculation and filing are handled
automatically.�
- http://www.derby.ac.uk/assess/webdemo/
|
5
|
- Code templates for around thirty generic question styles
- Multiple-choice/response types
- Move object types (label diagram, classification, sequence)
- Text/Numeric entry
- Graph plotting
- Draw Object
- Combinations
|
6
|
- Authorware packages assessments for either:
- Web/Intranet delivery
- Requires Authorware Web Player Plug-in
- LAN/Local delivery (as an .exe)
- Results are filed either locally or back to FTP server
|
7
|
- OLAAF = OnLine Assessment and Feedback
- The gaps:
- few tools available to guide the author in composing appropriate
questions and feedback
- few resources to guide the author in combining questions in assessments
in a way that enhances student learning
|
8
|
- Develop and disseminate generic guidelines for the construction of CBAF
- through collaborative efforts of the project consortium and other OLAAF
participants
- Major output of this collaboration:
- a �CBAF Author�s Toolkit�
- resources available via the web, on CD, and in print
- will support authors in the design, delivery and evaluation of CBAF
- guidance will, where possible, be evidence-based
|
9
|
- Test �higher order learning�
- i.e. cognitive levels above recall
- ReCAP*
- Recall (= Bloom�s �knowledge�)
- Comprehension
- Application
- Problem solving (= analysis + synthesis + evaluation)
- * Imrie (1995) Assessment & Evaluation in Higher Education 20 (2):
175-189.
|
10
|
- Assessment Construction
- not �question banks�, rather�
- how to most effectively combine question styles to promote and test
higher learning
- High Quality Feedback
- in formative and summative assessment
|
11
|
- Birkbeck College, University of London (Lead Site)
- Biological & Chemical Sciences, Earth Sciences
- University of Plymouth
- Biological Sciences, Environmental Sciences
- London Metropolitan University
- Biological & Applied Sciences
- University of Brighton
- Institute of Nursing & Midwifery
- University of Wales College of Medicine
- University of Birmingham
|
12
|
- Test the subject matter, not �TRIADS skills�
- Provide opportunities for supervised practice
- Provide support materials
- Author questions carefully and consistently
|
13
|
- Year 1, Autumn Term
- a �practice� test and� a �low
stakes� test
- paper-based �tutorial� given
- Year 1, Spring Term
- frequent TRIADS testing a key feature of Molecular Cell Biology unit
|
14
|
- logging in to TRIADS tests
- examples of question styles
- test-taking strategies
- explanation of results output
- obtaining Authorware plug-in
|
15
|
|
16
|
|
17
|
- Clearing incorrect responses
- emphasise click �done�, click �no�
- How to use swap areas
- Cues: colour-coded answer slots and labels
- Paging behaviour
- one-by-one; skip and go back
- Revisiting questions
|
18
|
|
19
|
- Careful commands with consistent usage between questions
- refer to labels and answer slots
- Sequence: ��place labels in order to describe the sequence of events
in��
- Label diagram: ��use the labels to identify��
- Logical coding
- e.g. layout, colour/texture coding
|
20
|
- Year 1:
- 2 of 3 course units
- Foundations of Biology
- Molecular Cell Biology
- Year 2:
- Summer vacation unit
- 1 of 4 units
|
21
|
- Year 3/4:
- Statistics for Biologists
- Animal Physiology & the Environment
- Other?
- MSc Physiology
- Physiology of Respiratory and Circulatory Systems
|
22
|
- Birkbeck College Development Fund
- The TRIADS team
- Dijana Maric
- (Authorware Programming, TRIADS admin)
|