Logo image
Detecting Pen-In-Air States from Video: A Proof-of-Concept Toward Complementary Handwriting Analysis
Acte de colloque

Detecting Pen-In-Air States from Video: A Proof-of-Concept Toward Complementary Handwriting Analysis

Lauren Sismeiro, Rémy Plastre, Binbin Xu, Frédéric Puyjarinet et Gérard Dray
ICCTA 2026 - 12th International Conference on Computer Technology Applications (Vienne, Austria, 17/06/2026–19/06/2026)
2026

Résumé

Video analysis Machine learning Kinematic modeling Pen tracking Computer vision Handwriting analysis
Dynamic aspects of handwriting are critical for assessing developmental disorders such as dysgraphia and are typically captured using digitizing tablets. However, tablet-based sensing restricts analysis of Pen-Up behavior to a short proximity range above the writing surface, potentially missing high-lift inair movements. As a proof of concept, we investigate whether top-view video can provide a complementary source of information for inferring pen-contact states without relying on tablet proximity sensing. We propose an interpretable hybrid pipelinecombining pen-tip tracking using a YOLO-based detector with kinematic feature extraction and machine learning classification.A pilot dataset of diverse handwriting videos was manually annotated at the frame level and evaluation used a Leave-One-Video-Out (LOVO) protocol. The method achieved reliable eventlevel detection of Pen-Up segments, with an F2 score up to 0.805,consistent with the emphasis on recall in a screening-oriented setting. These results support the feasibility of video-based Pen-Up detection as a low-cost and non-intrusive complement to digitizing tablets, and provide a foundation for future large-scale studies.

Fichiers et liens (1)

url
Find in HALAfficher

Indicateurs

1 Consultations de la notice

Détails

Logo image