Optimization of Transfer Learning for Sign Language Recognition Targeting Mobile Platform
D. Rathi. (May 17, 2018)cite arxiv:1805.06618Comment: 6 Pages, Journal.
Abstract
The target of this research is to experiment, iterate and recommend a system
that is successful in recognition of American Sign Language (ASL). It is a
challenging as well as an interesting problem that if solved will bring a leap
in social and technological aspects alike. In this paper, we propose a
real-time recognizer of ASL based on a mobile platform, so that it will have
more accessibility and provides an ease of use. The technique implemented is
Transfer Learning of new data of Hand gestures for alphabets in ASL to be
modelled on various pre-trained high- end models and optimize the best model to
run on a mobile platform considering the various limitations of the same during
optimization. The data used consists of 27,455 images of 24 alphabets of ASL.
The optimized model when ran over a memory-efficient mobile application,
provides an accuracy of 95.03% of accurate recognition with an average
recognition time of 2.42 seconds. This method ensures considerable
discrimination in accuracy and recognition time than the previous research.
Description
[1805.06618] Optimization of Transfer Learning for Sign Language Recognition Targeting Mobile Platform
%0 Generic
%1 rathi2018optimization
%A Rathi, Dhruv
%D 2018
%I arXiv
%K american-sign-language androi asl inception mobile mobilenet real sign-language transfer-learning
%T Optimization of Transfer Learning for Sign Language Recognition Targeting Mobile Platform
%U http://arxiv.org/abs/1805.06618
%X The target of this research is to experiment, iterate and recommend a system
that is successful in recognition of American Sign Language (ASL). It is a
challenging as well as an interesting problem that if solved will bring a leap
in social and technological aspects alike. In this paper, we propose a
real-time recognizer of ASL based on a mobile platform, so that it will have
more accessibility and provides an ease of use. The technique implemented is
Transfer Learning of new data of Hand gestures for alphabets in ASL to be
modelled on various pre-trained high- end models and optimize the best model to
run on a mobile platform considering the various limitations of the same during
optimization. The data used consists of 27,455 images of 24 alphabets of ASL.
The optimized model when ran over a memory-efficient mobile application,
provides an accuracy of 95.03% of accurate recognition with an average
recognition time of 2.42 seconds. This method ensures considerable
discrimination in accuracy and recognition time than the previous research.
@misc{rathi2018optimization,
abstract = {The target of this research is to experiment, iterate and recommend a system
that is successful in recognition of American Sign Language (ASL). It is a
challenging as well as an interesting problem that if solved will bring a leap
in social and technological aspects alike. In this paper, we propose a
real-time recognizer of ASL based on a mobile platform, so that it will have
more accessibility and provides an ease of use. The technique implemented is
Transfer Learning of new data of Hand gestures for alphabets in ASL to be
modelled on various pre-trained high- end models and optimize the best model to
run on a mobile platform considering the various limitations of the same during
optimization. The data used consists of 27,455 images of 24 alphabets of ASL.
The optimized model when ran over a memory-efficient mobile application,
provides an accuracy of 95.03% of accurate recognition with an average
recognition time of 2.42 seconds. This method ensures considerable
discrimination in accuracy and recognition time than the previous research.},
added-at = {2019-11-14T05:46:58.000+0100},
author = {Rathi, Dhruv},
biburl = {https://www.bibsonomy.org/bibtex/2a9ab4c8694e8cc9b17427aa9a69434ea/jpmor},
day = 17,
description = {[1805.06618] Optimization of Transfer Learning for Sign Language Recognition Targeting Mobile Platform},
interhash = {c17a2e4f5ab5cd6212dec027655ff5dc},
intrahash = {a9ab4c8694e8cc9b17427aa9a69434ea},
keywords = {american-sign-language androi asl inception mobile mobilenet real sign-language transfer-learning},
month = {05},
note = {cite arxiv:1805.06618Comment: 6 Pages, Journal},
publisher = {arXiv},
school = {Cornell University},
timestamp = {2020-10-07T13:36:50.000+0200},
title = {Optimization of Transfer Learning for Sign Language Recognition Targeting Mobile Platform},
url = {http://arxiv.org/abs/1805.06618},
year = 2018
}