  The well-known artificial intelligence-based chatbot ChatGPT-4 has become
able to process image data as input in October 2023. We investigated its
performance on the Test of Understanding Graphs in Kinematics to inform the
physics education community of the current potential of using ChatGPT in the
education process, particularly on tasks that involve graphical interpretation.
We found that ChatGPT, on average, performed similarly to students taking a
high-school level physics course, but with important differences in the
distribution of the correctness of its responses, as well as in terms of the
displayed "reasoning" and "visual" abilities. While ChatGPT was very successful
at proposing productive strategies for solving the tasks on the test and
expressed correct "reasoning" in most of its responses, it had difficulties
correctly "seeing" graphs. We suggest that, based on its performance, caution
and a critical approach are needed if one intends to use it in the role of a
tutor, a model of a student, or a tool for assisting vision-impaired persons in
the context of kinematics graphs.
