ICFHR 2020 Competition on Short answer ASsessment and Thai student SIGnature and Name COMponents Recognition and Verification (SASIGCOM 2020)

Das, A; Suwanwiwat, H; Pal, U; Blumenstein, M

ICFHR 2020 Competition on Short answer ASsessment and Thai student SIGnature and Name COMponents Recognition and Verification (SASIGCOM 2020)

Das, A Suwanwiwat, H Pal, U Blumenstein, M

Permalink

Publisher:: IEEE
Publication Type:: Conference Proceeding
Citation:: 2020 17th International Conference on Frontiers in Handwriting Recognition (ICFHR), 2020, 2020-September, pp. 222-227
Issue Date:: 2020-11-25

Open Access

Copyright Clearance Process

Recently Added
In Progress
Open Access

This item is open access.

The embargo period expires on 25 Nov 2022

Adobe PDF

Download Accepted ManuscriptAdobe PDF (499.58 kB)

View on publisher's site

View statistics

Full metadata record

Field	Value	Language
dc.contributor.author	Das, A
dc.contributor.author	Suwanwiwat, H
dc.contributor.author	Pal, U
dc.contributor.author	Blumenstein, M https://orcid.org/0000-0002-9908-3744
dc.date	2020-09-08
dc.date.accessioned	2021-05-27T07:07:59Z
dc.date.available	2021-05-27T07:07:59Z
dc.date.issued	2020-11-25
dc.identifier.citation	2020 17th International Conference on Frontiers in Handwriting Recognition (ICFHR), 2020, 2020-September, pp. 222-227
dc.identifier.isbn	9781728199665
dc.identifier.issn	2167-6445
dc.identifier.issn	2167-6453
dc.identifier.uri	http://hdl.handle.net/10453/149267
dc.description.abstract	This paper describes the results of the competition on Short answer ASsessment and Thai student SIGnature and Name COMponents Recognition and Verification (SASIGCOM 2020) in conjunction with the 17th International Conference on Frontiers in Handwriting Recognition (ICFHR 2020). The competition was aimed to automate the evaluation process short answer-based examination and record the development and gain attention to such system. The proposed competition contains three elements which are short answer assessment (recognition and marking the answers to short-answer questions derived from examination papers), student name components (first and last names) and signature verification and recognition. Signatures and name components data were collected from 100 volunteers. For the Thai signature dataset, there are 30 genuine signatures, 12 skilled and 12 simple forgeries for each writer. With Thai name components dataset, there are 30 genuine and 12 skilfully forged name components for each writer. There are 104 exam papers in the short answer assessment dataset, 52 of which were written with cursive handwriting; the rest of 52 papers were written with printed handwriting. The exam papers contain ten questions, and the answers to the questions were designed to be a few words per question. Three teams from distinguished labs submitted their systems. For short answer assessment, word spotting task was also performed. This paper analysed the results produced by their algorithms using a performance measure and defines a way forward for this subject of research. Both the datasets, along with some of the accompanying ground truth/baseline mask will be made freely available for research purposes via the TC10/TC11.
dc.language	en
dc.publisher	IEEE
dc.relation.ispartof	2020 17th International Conference on Frontiers in Handwriting Recognition (ICFHR)
dc.relation.ispartof	2020 17th International Conference on Frontiers in Handwriting Recognition
dc.relation.isbasedon	10.1109/icfhr2020.2020.00049
dc.rights	info:eu-repo/semantics/embargoedAccess
dc.title	ICFHR 2020 Competition on Short answer ASsessment and Thai student SIGnature and Name COMponents Recognition and Verification (SASIGCOM 2020)
dc.type	Conference Proceeding
utslib.citation.volume	2020-September
utslib.location.activity	Dortmund, Germany
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology
pubs.organisational-group	/University of Technology Sydney/Strength - AAII - Australian Artificial Intelligence Institute
pubs.organisational-group	/University of Technology Sydney/Strength - QSI - Centre for Quantum Software and Information
utslib.copyright.status	open_access	*
utslib.copyright.embargo	2022-11-25T00:00:00+1000Z
dc.date.updated	2021-05-27T07:07:58Z
pubs.finish-date	2020-09-10
pubs.publication-status	Published
pubs.start-date	2020-09-08
pubs.volume	2020-September

Abstract:

This paper describes the results of the competition on Short answer ASsessment and Thai student SIGnature and Name COMponents Recognition and Verification (SASIGCOM 2020) in conjunction with the 17th International Conference on Frontiers in Handwriting Recognition (ICFHR 2020). The competition was aimed to automate the evaluation process short answer-based examination and record the development and gain attention to such system. The proposed competition contains three elements which are short answer assessment (recognition and marking the answers to short-answer questions derived from examination papers), student name components (first and last names) and signature verification and recognition. Signatures and name components data were collected from 100 volunteers. For the Thai signature dataset, there are 30 genuine signatures, 12 skilled and 12 simple forgeries for each writer. With Thai name components dataset, there are 30 genuine and 12 skilfully forged name components for each writer. There are 104 exam papers in the short answer assessment dataset, 52 of which were written with cursive handwriting; the rest of 52 papers were written with printed handwriting. The exam papers contain ten questions, and the answers to the questions were designed to be a few words per question. Three teams from distinguished labs submitted their systems. For short answer assessment, word spotting task was also performed. This paper analysed the results produced by their algorithms using a performance measure and defines a way forward for this subject of research. Both the datasets, along with some of the accompanying ground truth/baseline mask will be made freely available for research purposes via the TC10/TC11.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/149267