Assessment Rubric: Reflection
Assessment Rubric: Reflection
| Level 1 | Level 2 | Level 3 | Level 4 | |
|---|---|---|---|---|
| Knowledge | ||||
| Knowledge of content (e.g., facts about large language models and training data) | demonstrates limited knowledge of content | demonstrates some knowledge of content | demonstrates considerable knowledge of content | demonstrates thorough knowledge of content |
| Understanding of content (e.g., significance of AI risks like bias or privacy) | demonstrates limited understanding of content | demonstrates some understanding of content | demonstrates considerable understanding of content | demonstrates thorough understanding of content |
|
Thinking |
||||
| Use of planning skills (e.g., gathering ideas from the red-teaming activity for the reflection) | uses planning skills with limited effectiveness | uses planning skills with some effectiveness | uses planning skills with considerable effectiveness | uses planning skills with a high degree of effectiveness |
| Use of processing skills (e.g., analyzing the impact of chatbots on human relationships) | uses processing skills with limited effectiveness | uses processing skills with some effectiveness | uses processing skills with considerable effectiveness | uses processing skills with a high degree of effectiveness |
| Use of critical/creative thinking processes (e.g., proposing original safety designs for a new chatbot) | uses critical/creative thinking processes with limited effectiveness | uses critical/creative thinking processes with some effectiveness | uses critical/creative thinking processes with considerable effectiveness | uses critical/creative thinking processes with a high degree of effectiveness |
|
Communication |
||||
| Expression and organization of ideas and information (e.g., clarity and logic of the exit ticket response) | expresses and organizes ideas with limited effectiveness | expresses and organizes ideas with some effectiveness | expresses and organizes ideas with considerable effectiveness | expresses and organizes ideas with a high degree of effectiveness |
| Communication for different audiences and purposes (e.g., setting a reflective and ethical tone) | communicates for different purposes with limited effectiveness | communicates for different purposes with some effectiveness | communicates for different purposes with considerable effectiveness | communicates for different purposes with a high degree of effectiveness |
| Use of conventions, vocabulary, and terminology (e.g., correct use of “hallucination,” “guardrails,” or “LLM”) | uses conventions and terminology with limited effectiveness | uses conventions and terminology with some effectiveness | uses conventions and terminology with considerable effectiveness | uses conventions and terminology with a high degree of effectiveness |
|
Application |
||||
| Application of knowledge and skills (e.g., applying lessons on data privacy to personal behavior) | applies knowledge and skills with limited effectiveness | applies knowledge and skills with some effectiveness | applies knowledge and skills with considerable effectiveness | applies knowledge and skills with a high degree of effectiveness |
| Transfer of knowledge and skills (e.g., transferring risks identified in the “Psychiatrist” bot to other roles) | transfers knowledge and skills with limited effectiveness | transfers knowledge and skills with some effectiveness | transfers knowledge and skills with considerable effectiveness | transfers knowledge and skills with a high degree of effectiveness |
| Making connections within and between various contexts (e.g., connecting AI behavior to real-world social impact) | makes connections with limited effectiveness | makes connections with some effectiveness | makes connections with considerable effectiveness | makes connections with a high degree of effectiveness |