IntuiGeo takes place within the ACTIF project (Apprentissage et collaboration sur Tablettes, Interactions et Feedback), funded by the French ministry of education (PIA, BPI), in context of the call for projects e-fran. The goal of ACTIF is to experiment pedagogical methods and tools to foster active and collaborative learning with stylus and touch tablets, by giving an important role to the feedback given to each child, to the whole classroom, or to pupils gathered in teams.
IntuiGeo focuses on geometry learning support on tablet for middle-school children. The goal is to propose an e-learning system to help the autonomy of the child with a personalized course. IntuiGéo artificial intelligence engine offers an intuitive digital solution, which allows the child to draw freely geometric figures by simulating the traditional pen and paper approach. The interaction mode is stylus-fingers. The child draws therefore with the pen and is able to use virtual tools such as the ruler, the compass, the protractor, or the set square. The IA engine developed by the IntuiDoc team interprets, on the fly, the child’s sketches, allowing for a real-time user interaction, and visual, corrective or guidance feedback interventions, in order to enhance the child’s learning performance.
The project relies on the design of artificial intelligence engine capable of interpreting the hand-drawn strokes of the child. It is based on a visual grammar allowing the modelling of the geometry knowledge domain. The system is therefore capable of recognizing, in real-time, the geometric objects that are studied in middle school and to model their different interactions (for example the creation of interlinked figures). The system proposes multiple display levels for the sketches as shown in this illustration:
We have three levels :
- Raw display which represent the student’s hand-drawn sketches
- Display with beautification
- Display of geometric figures recognized by application
The sheet of paper is simulated with a grid. The movement of the sheet is done with the fingers. The application allows user to :
- Zoom for change scale
- Add note to sketch
- Undo/redo action
- Show/hide name of figure, measures of segments
Application include virtual tools which simulate the traditional tool used in geometry class like ruler, compass, protractor and try square. These tools are represented by a drawing. The student used them with his fingers. They allow to realize the same action of the traditional tools and more. Indeed, they have a helper for drawing and they can anchor on point of interest which it’s aid their use.
With time, the project aims to integrate all the pedagogical elements associated with solving geometric problems. From a problem statement, the goal is to extract all the possible solutions, I.e action plans, to then be able to guide the student, in real time, in solving his problem.
The tests related to the application as well as the ergonomic analysis are carried out by our LP3C and LOUSTIC partners. The first user tests will evaluate the application and design feedback tailored to the needs of users. Then, tests will be done in classrooms to measure the impact of the system on the student’s learning.