Skip to main content

Research Repository

See what's under the surface

Advanced Search

CRNN: a joint neural network for redundancy detection

Fu, Xinyu; Ch’ng, Eugene; Aickelin, Uwe; See, Simon

Authors

Xinyu Fu

Eugene Ch’ng

Uwe Aickelin

Simon See



Abstract

This article proposes a novel framework for detecting redundancy in supervised sentence categorisation. Unlike traditional singleton neural network, our model incorporates character-aware convolutional neural network (Char-CNN) with character-aware recurrent neural network (Char-RNN) to form a convolutional recurrent neural network (CRNN). Our model benefits from Char-CNN in that only salient features are selected and fed into the integrated Char-RNN. Char-RNN effectively learns long sequence semantics via sophisticated update mechanism. We compare our framework against the state-of-the-art text classification algorithms on four popular benchmarking corpus. For instance, our model achieves competing precision rate, recall ratio, and F1 score on the Google-news data-set. For twenty-news-groups data stream, our algorithm obtains the optimum on precision rate, recall ratio, and F1 score. For Brown Corpus, our framework obtains the best F1 score and almost equivalent precision rate and recall ratio over the top competitor. For the question classification collection, CRNN produces the optimal recall rate and F1 score and comparable precision rate. We also analyse three different RNN hidden recurrent cells’ impact on performance and their runtime efficiency. We observe that MGU achieves the optimal runtime and comparable performance against GRU and LSTM. For TFIDF based algorithms, we experiment with word2vec, GloVe, and sent2vec embeddings and report their performance differences.

Publication Date Jun 15, 2017
Peer Reviewed Peer Reviewed
APA6 Citation Fu, X., Ch’ng, E., Aickelin, U., & See, S. (2017). CRNN: a joint neural network for redundancy detection. doi:10.1109/SMARTCOMP.2017.7946996
DOI https://doi.org/10.1109/SMARTCOMP.2017.7946996
Keywords Logic gates, Training, Redundancy, Recurrent neural networks, Benchmark testing, Computational modeling
Publisher URL http://ieeexplore.ieee.org/document/7946996/
Related Public URLs http://www.smart-comp.org/
http://ima.ac.uk/wp-con...RTCOMP_paper_17_rev.pdf
Copyright Statement Copyright information regarding this work can be found at the following address: http://eprints.nottingh.../end_user_agreement.pdf
Additional Information ISBN 978-1-5090-6517-2 © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Files

Dietrich et al post-print.pdf (8.5 Mb)
PDF

Copyright Statement
Copyright information regarding this work can be found at the following address: http://eprints.nottingham.ac.uk/end_user_agreement.pdf





You might also like



Downloadable Citations

;