The joint method of triple attention and novel loss function for entity relation extraction in small data-driven computational social systems

Journal article


Gao, Honghao, Huang, Jiadong, Tao, Yuan, Hussain, Walayat and Huang, Yuzhe. (2022). The joint method of triple attention and novel loss function for entity relation extraction in small data-driven computational social systems. IEEE Transactions on Computational Social Systems. 9(6), pp. 1725-1735. https://doi.org/10.1109/TCSS.2022.3178416
AuthorsGao, Honghao, Huang, Jiadong, Tao, Yuan, Hussain, Walayat and Huang, Yuzhe
Abstract

With the development of the social Internet of Things (IoT) and multimedia communications, our daily lives in computational social systems have become more convenient; for example, we can share shopping experiences and ask questions of people in an ad hoc network. Relation extraction focuses on supervised learning with adequate training data, and it helps to understand the knowledge behind the observed information. However, if only some social data in an unknown area can be used, how to obtain the related knowledge and information is a key topic for supporting social intelligence. This article proposes the joint method of triple attention and novel loss function for entity relation extraction by few-shot learning in computational social systems. We consider using a prototypical network as the base model to acquire support set prototypes and to compare queries with the prototypes for classification. First, triple attention is employed to make the query instances and support set share interactive information in a global and instancewise manner, highlighting the important features. Second, we combine a weighted Euclidean distance function with a multilayer perceptron (MLP) to perform class matching, which maps the generated features to their proper classifications, emphasizing the prominent dimensions in the feature space and relieving data sparsity. Third, triplet loss and uniformity regularization are used to solve the inconsistency problem faced by the support set, where the features of the support set in the same class are often far apart in different characteristic dimensions. Finally, the experimental results demonstrate the improved performance of our model on the FewRel dataset.

Keywordsattention mechanism; few-shot learning; prototypical networks; query instances and support set; relation extraction; social data and intelligence
Year2022
JournalIEEE Transactions on Computational Social Systems
Journal citation9 (6), pp. 1725-1735
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISSN2329-924X
Digital Object Identifier (DOI)https://doi.org/10.1109/TCSS.2022.3178416
Scopus EID2-s2.0-85131750564
Page range1725-1735
Publisher's version
License
All rights reserved
File Access Level
Controlled
Output statusPublished
Publication dates
Online08 Jun 2022
Publication process dates
Accepted18 May 2022
Deposited18 Jul 2023
Permalink -

https://acuresearchbank.acu.edu.au/item/8z529/the-joint-method-of-triple-attention-and-novel-loss-function-for-entity-relation-extraction-in-small-data-driven-computational-social-systems

Restricted files

Publisher's version

  • 43
    total views
  • 0
    total downloads
  • 1
    views this month
  • 0
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

Seventeen Years of the ACM Transactions on Multimedia Computing, Communications and Applications : A Bibliometric Overview
Hussain, Walayat, Gao, Honghao, Karim, Rafiul and El Saddik, Abdulmotaleb. (2024). Seventeen Years of the ACM Transactions on Multimedia Computing, Communications and Applications : A Bibliometric Overview. ACM Transactions on Multimedia Computing, Communications, and Applications. 20(2), pp. 1-21. https://doi.org/10.1145/3660347
Intersection of Machine Learning and Mobile Crowdsourcing : A Systematic Topic-driven Review
Chen, Weisi, Hussain, Walayat, Al-Qudah, Islam, Al-Naymat, Ghazi and Zhang, Xu. (2024). Intersection of Machine Learning and Mobile Crowdsourcing : A Systematic Topic-driven Review. Personal and Ubiquitous Computing. pp. 1-30. https://doi.org/10.1007/s00779-024-01820-w
Revolutionising healthcare with artificial intelligence : A bibliometric analysis of 40 years of progress in health systems
Hussain, Walayat, Mabrok, Mohamed, Gao, Honghao, Rabhi, Fethi A. and Rashed, Essam A.. (2024). Revolutionising healthcare with artificial intelligence : A bibliometric analysis of 40 years of progress in health systems. Digital Health. 10, pp. 1-20. https://doi.org/10.1177/20552076241258757
Deep Learning for Financial Time Series Prediction : A State-of-the-Art Review of Standalone and Hybrid Models
Chen, Weisi, Hussain, Walayat, Cauteruccio, Francesco and Zhang, Xu. (2024). Deep Learning for Financial Time Series Prediction : A State-of-the-Art Review of Standalone and Hybrid Models. Not Listed - Awaiting Journal Creation. 139(1), pp. 187-224. https://doi.org/10.32604/cmes.2023.031388
A Survey of Trendy Financial Sector Applications of Machine and Deep Learning
Lestari, Nur Indah, Hussain, Walayat, Merigo, Jose and Bekhit, Mahmoud. (2023). A Survey of Trendy Financial Sector Applications of Machine and Deep Learning. Second EAI International Conference, BigIoT-EDU 2022. Switzerland: Springer Nature. pp. 619-633 https://doi.org/10.1007/978-3-031-23944-1_68
Towards an API Marketplace for an e-Invoicing Ecosystem
Manchanda, Chinmay, Hussain, Walayat, Rabhi, Latif and Rabhi, Fethi A.. (2023). Towards an API Marketplace for an e-Invoicing Ecosystem. 11th International Workshop, FinanceCom 2022, August 23–24, 2022. Twente, The Netherlands 23 - 24 Aug 2022 Switzerland: Springer Nature. pp. 82 https://doi.org/10.1007/978-3-031-31671-5_6
Towards an API Marketplace for an e-Invoicing Ecosystem
Manchanda, Chinmay, Hussain, Walayat, Rabhi, Latif and Rabhi, Fethi A.. (2023). Towards an API Marketplace for an e-Invoicing Ecosystem. 11th International Workshop, FinanceCom 2022. Twente, The Netherlands 23 - 24 Aug 2022 Switzerland: Springer. pp. 82 https://doi.org/10.1007/978-3-031-31671-5
A Novel GAPG Approach to Automatic Property Generation for Formal Verification : The GAN Perspective
Gao, Honghao, Dai, Baobin, MIAO, HUAIKOU, YANG, XIAOXIAN, Barroso, Ramon J. Duran and Hussain, Walayat. (2023). A Novel GAPG Approach to Automatic Property Generation for Formal Verification : The GAN Perspective. ACM Transactions on Multimedia Computing, Communications, and Applications. 19(1), pp. 16-22. https://doi.org/10.1145/3517154
Analysing trust, security and cost of cloud consumer’s reviews using RNN, LSTM, and GRU
Raza, Raheel, Hussain, Walayat and Rajaeian, Mohammad Mehdi. (2023). Analysing trust, security and cost of cloud consumer’s reviews using RNN, LSTM, and GRU. In In Hussain, Walayat, Gao, Honghao, Rabhi, Fethi and Martinez, Luis (Ed.). Advances in complex decision making: Using machine learning and tools for service-oriented computing pp. 52 - 65 CRC Press. https://doi.org/10.1201/9781003340621-4
A Survey of Trendy Financial Sector Applications of Machine and Deep Learning
Lestari, Nur Indah, Hussain, Walayat, Merigo, Jose and Bekhit, Mahmoud. (2023). A Survey of Trendy Financial Sector Applications of Machine and Deep Learning. Second EAI International Conference, BigIoT-EDU 2022. Virtual Event 29 - 31 Jul 2022 Switzerland: Springer. pp. 619-633 https://doi.org/10.1007/978-3-031-23944-1
Preserving Academic Integrity in Teaching with ChatGPT : Practical Strategies
Raza, Muhammad Raheel and Hussain, Walayat. (2023). Preserving Academic Integrity in Teaching with ChatGPT : Practical Strategies. 2023 IEEE/WIC International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT). 26 - 29 Oct 2023 Italy: IEEE Xplore. pp. 158-162 https://doi.org/10.1109/WI-IAT59888.2023.00027
Guest editorial : Machine learning applied to quality and security in software systems [Editorial]
Gao, Honghao, Hussain, Walayat, Barroso, Ramón J. Durán, Arshad, Junaid and Yin, Yuyu. (2023). Guest editorial : Machine learning applied to quality and security in software systems [Editorial]. IET Software. 17(4), pp. 345-347. https://doi.org/10.1049/sfw2.12141
Evaluating interpretable machine learning predictions for cryptocurrencies
Majzoub, Ahmad El, Rabhi, Fethi A. and Hussain, Walayat. (2023). Evaluating interpretable machine learning predictions for cryptocurrencies. Intelligent Systems in Accounting, Finance and Management. pp. 1-13. https://doi.org/10.1002/isaf.1538
CAMRL : A joint method of channel attention and multidimensional regression loss for 3D object detection in automated vehicles
Gao, Honghao, Fang, Danqing, Xiao, Junsheng, Hussain, Walayat and Kim, Jung Yoon. (2023). CAMRL : A joint method of channel attention and multidimensional regression loss for 3D object detection in automated vehicles. IEEE Transactions on Intelligent Transportation Systems. 24(8), pp. 8831-8845. https://doi.org/10.1109/TITS.2022.3219474
Integrated AHP-IOWA, POWA framework for ideal cloud provider selection and optimum resource management
Hussain, Walayat, Merigó, José M., Gao, Honghao, Alkalbani, Asma Musabah and Rabhi, Fethi A.. (2023). Integrated AHP-IOWA, POWA framework for ideal cloud provider selection and optimum resource management. IEEE Transactions on Services Computing. 16(1), pp. 370-382. https://doi.org/10.1109/TSC.2021.3124885
Complex nonlinear neural network prediction with IOWA layer
Hussain, Walayat, Merigó, Jóse M., Gil-Lafuente, Jaime and Gao, Honghao. (2023). Complex nonlinear neural network prediction with IOWA layer. Soft Computing. 27(8), pp. 4853-4863. https://doi.org/10.1007/s00500-023-07899-2
Real-time virtual machine scheduling in industry IoT network : A reinforcement learning method
Ma, Xiaojin, Xu, Huahu, Gao, Honghao, Bian, Minjie and Hussain, Walayat. (2023). Real-time virtual machine scheduling in industry IoT network : A reinforcement learning method. IEEE Transactions on Industrial Informatics. 19(2), pp. 2129-2139. https://doi.org/10.1109/TII.2022.3211622
Onsite/offsite social commerce adoption for SMEs using fuzzy linguistic decision making in complex framework
Hussain, Walayat and Merigó, Jose M.. (2023). Onsite/offsite social commerce adoption for SMEs using fuzzy linguistic decision making in complex framework. Journal of Ambient Intelligence and Humanized Computing. 14, pp. 12875-12894. https://doi.org/10.1007/s12652-022-04157-5
Challenges and issues of the Internet of Things : Factoring elements from the social, political and information systems
Ali, Arif and Hussain, Walayat. (2022). Challenges and issues of the Internet of Things : Factoring elements from the social, political and information systems. IoT as a service 7th EAI international conference, IoTaas 2021. Sydney Australia 13 - 14 Dec 2021 Switzerland: Springer. pp. 73 - 83 https://doi.org/10.1007/978-3-030-95987-6
Medical photography using mobile devices
Zoltie, Timothy, Blome-Eberwein, Sigrid, Forbes, Sarah, Theaker, Mike and Hussain, Walayat. (2022). Medical photography using mobile devices. The BMJ. pp. 1-6. https://doi.org/10.1136/bmj-2021-067663
Performance Analysis of Deep Approaches on Airbnb Sentiment Reviews
Raza, Muhammad Raheel, Hussain, Walayat and Varol, Asaf. (2022). Performance Analysis of Deep Approaches on Airbnb Sentiment Reviews. 10th International Symposium on Digital Forensics and Security (ISDFS). Istanbul, Turkey 06 - 07 Jun 2022 Turkey: IEEE Xplore. pp. 229-233 https://doi.org/10.1109/ISDFS55398.2022.9800816
Aggregating Fuzzy Sentiments with Customized QoS Parameters for Cloud Provider Selection Using Fuzzy Best Worst and Fuzzy TOPSIS
Hussain, Walayat, Merigó, Jose, Rabhi, Fethi A. and Gao, Honghao. (2022). Aggregating Fuzzy Sentiments with Customized QoS Parameters for Cloud Provider Selection Using Fuzzy Best Worst and Fuzzy TOPSIS. In Soft Computing and Fuzzy Methodologies in Innovation Management and Sustainability pp. 81-92 Springer. https://doi.org/10.1007/978-3-030-96150-3_6
Centralised quality of experience and service framework using PROMETHEE-II for cloud provider selection
Hussain, Walayat and Merigó, Jose. (2022). Centralised quality of experience and service framework using PROMETHEE-II for cloud provider selection. In In Gao, Honghao, Kim, Jung Yoon, Hussain, Walayat, Iqbal, Muddesar and Duan, Yucong (Ed.). Intelligent processing practices and tools for e-commerce data, information, and knowledge pp. 79-94 Springer. https://doi.org/10.1007/978-3-030-78303-7_5
Cloud risk management with OWA-LSTM and fuzzy linguistic decision making
Hussain, Walayat, Raza, Muhammad Raheel, Jan, Mian Ahmad, Merigó, Jose M. and Gao, Honghao. (2022). Cloud risk management with OWA-LSTM and fuzzy linguistic decision making. IEEE Transactions on Fuzzy Systems. 30(11), pp. 4657-4666. https://doi.org/10.1109/TFUZZ.2022.3157951
TSMAE : A novel anomaly detection approach for Internet of Things time series data using memory-augmented autoencoder
Gao, Honghao, Qiu, Binyang, Barroso, Ramón J. Durán, Hussain, Walayat, Xu, Yueshen and Wang, Xinheng. (2022). TSMAE : A novel anomaly detection approach for Internet of Things time series data using memory-augmented autoencoder. IEEE Transactions on Network Science and Engineering. pp. 1-15. https://doi.org/10.1109/TNSE.2022.3163144
Collaborative learning-based industrial IoT API recommendation for software-defined devices : The implicit knowledge discovery perspective
Gao, Honghao, Qin, Xi, Barroso, Ramón J. Durán, Hussain, Walayat, Xu, Yueshen and Yin, Yuyu. (2022). Collaborative learning-based industrial IoT API recommendation for software-defined devices : The implicit knowledge discovery perspective. IEEE Transactions on Emerging Topics in Computational Intelligence. 6(1), pp. 66-76. https://doi.org/10.1109/TETCI.2020.3023155
A new QoS prediction model using hybrid IOWA-ANFIS with fuzzy C-means, subtractive clustering and grid partitioning
Hussain, Walayat, Merigó, J. M., Raza, M. R. and Gao, Honghao. (2022). A new QoS prediction model using hybrid IOWA-ANFIS with fuzzy C-means, subtractive clustering and grid partitioning. Information Sciences. 584, pp. 280-300. https://doi.org/10.1016/j.ins.2021.10.054
Tax revenue measurement using OWA operators
Leon-Castro, Ernesto, Blanco-Mesa, Fabio, Hussain, Walayat, Flores-Sosa, Martha and Perez-Arellano, Luis A.. (2022). Tax revenue measurement using OWA operators. Cybernetics and Systems. pp. 1-15. https://doi.org/10.1080/01969722.2022.2110687
Assessing cloud QoS predictions using OWA in neural network methods
Hussain, Walayat, Gao, Honghao, Raza, Muhammad Raheel, Rabhi, Fethi A. and Merigó, Jose M.. (2022). Assessing cloud QoS predictions using OWA in neural network methods. Neural Computing and Applications. 34(17), pp. 14895-14912. https://doi.org/10.1007/s00521-022-07297-z
Predictive intelligence using ANFIS-induced OWAWA for complex stock market prediction
Hussain, Walayat, Merigó, José M. and Raza, Muhammad Raheel. (2022). Predictive intelligence using ANFIS-induced OWAWA for complex stock market prediction. International Journal of Intelligent Systems. 37(8), pp. 4586-4611. https://doi.org/10.1002/int.22732
Review-Based Recommender System for Hedonic and Utilitarian Products in IoT Framework
Tahira, Anum, Hussain, Walayat and Ali, Arif. (2021). Review-Based Recommender System for Hedonic and Utilitarian Products in IoT Framework. In IoT as a Service pp. 221 - 232 Springer. https://doi.org/10.1007/978-3-030-95987-6_16
Cloud Sentiment Accuracy Comparison using RNN, LSTM and GRU
Raza, Muhammad Raheel, Hussain, Walayat and Merigo, Jose. (2021). Cloud Sentiment Accuracy Comparison using RNN, LSTM and GRU. 2021 Innovations in Intelligent Systems and Applications Conference (ASYU). Elazig, Turkey 06 - 08 Oct 2021 Turkey: IEEE Xplore. pp. 44-48 https://doi.org/10.1109/ASYU52992.2021.9599044
Long short-term memory-based sentiment classification of cloud dataset
Raza, Muhammad Raheel, Hussain, Walayat and Merigo, Jose. (2021). Long short-term memory-based sentiment classification of cloud dataset. 2021 Innovations in Intelligent Systems and Applications Conference . Elazig, Turkey 06 - 08 Oct 2021 Turkey: IEEE Xplore. pp. 1-6 https://doi.org/10.1109/ASYU52992.2021.9598999
Sentiment Analysis using Deep Learning in Cloud
Raza, Muhammad Raheel, Hussain, Walayat, Tanyıldızı, Erkan and Varol, Asaf. (2021). Sentiment Analysis using Deep Learning in Cloud. 9th International Symposium on Digital Forensics and Security (ISDFS). 28 - 29 Jun 2021 Turkey: IEEE Xplore. pp. 1-5 https://doi.org/10.1109/ISDFS52919.2021.9486312
Blockchain-based IoT : An Overview
Raza, Muhammad Raheel, Varol, Asaf and Hussain, Walayat. (2021). Blockchain-based IoT : An Overview. 9th International Symposium on Digital Forensics and Security (ISDFS). 28 - 29 Jun 2021 Turkey: IEEE Xplore. pp. 1-6 https://doi.org/10.1109/ISDFS52919.2021.9486360
Forecasting with machine learning techniques [Editorial]
Hussain, Walayat, Alkalbani, Asma Musabah and Gao, Honghao. (2021). Forecasting with machine learning techniques [Editorial]. Forecasting. 3(4), pp. 868-869. https://doi.org/10.3390/forecast3040052
Cloud service discovery method : A framework for automatic derivation of cloud marketplace and cloud intelligence to assist consumers in finding cloud services
Alkalbani, Asma Musabah and Hussain, Walayat. (2021). Cloud service discovery method : A framework for automatic derivation of cloud marketplace and cloud intelligence to assist consumers in finding cloud services. International Journal of Communication Systems. 34(8), p. Article e4780. https://doi.org/10.1002/dac.4780
SSUR : An approach to optimizing virtual machine allocation strategy based on user requirements for cloud data center
Huang, Yuzhe, Xu, Huahu, Gao, Honghao, Ma, Xiaojin and Hussain, Walayat. (2021). SSUR : An approach to optimizing virtual machine allocation strategy based on user requirements for cloud data center. IEEE Transactions on Green Communications and Networking. 5(2), pp. 670-681. https://doi.org/10.1109/TGCN.2021.3067374
Trends in using IoT with machine learning in health prediction system
Aldahiri, Amani, Alrashed, Bashair and Hussain, Walayat. (2021). Trends in using IoT with machine learning in health prediction system. Forecasting. 3(1), pp. 181-206. https://doi.org/10.3390/forecast3010012
Managing SLA Violation in the cloud using Fuzzy re-SchdNeg Decision Model
Alrashed, Bashair Ali and Hussain, Walayat. (2020). Managing SLA Violation in the cloud using Fuzzy re-SchdNeg Decision Model. 15th IEEE Conference on Industrial Electronics and Applications (ICIEA). Virtual Conference 09 - 13 Nov 2020 Norway: IEEE Xplore. pp. 136-141
Cloud marginal resource allocation : A decision support model
Hussain, Walayat, Sohaib, Osama, Naderpour, Mohsen and Gao, Honghao. (2020). Cloud marginal resource allocation : A decision support model. Mobile Networks and Applications. 25(4), pp. 1418-1433. https://doi.org/10.1007/s11036-019-01457-7
A PLS-SEM neural network approach for understanding cryptocurrency adoption
Sohaib, Osama, Hussain, Walayat, Asif, Muhammad, Ahmad, Muhammad and Mazzara, Manuel. (2020). A PLS-SEM neural network approach for understanding cryptocurrency adoption. IEEE Access. 8, pp. 13138-13150. https://doi.org/10.1109/ACCESS.2019.2960083
A centralised cloud services repository (CCSR) framework for optimal cloud service advertisement discovery from heterogenous web portals
Alkalbani, Asma Musabah, Hussain, Walayat and Kim, Jung Yoon. (2019). A centralised cloud services repository (CCSR) framework for optimal cloud service advertisement discovery from heterogenous web portals. IEEE Access. 7, pp. 128213-128223. https://doi.org/10.1109/ACCESS.2019.2939543
Cloud computing model selection for e-commerce enterprises using a new 2-tuple fuzzy linguistic decision-making method
Sohaib, Osama, Naderpour, Mohsen, Hussain, Walayat and Martinez, Luis. (2019). Cloud computing model selection for e-commerce enterprises using a new 2-tuple fuzzy linguistic decision-making method. Computers and Industrial Engineering. 132, pp. 47-58. https://doi.org/10.1016/j.cie.2019.04.020
Analysing cloud QoS prediction approaches and its control parameters : Considering overall accuracy and freshness of a dataset
Hussain, Walayat and Sohaib, Osama. (2019). Analysing cloud QoS prediction approaches and its control parameters : Considering overall accuracy and freshness of a dataset. IEEE Access. 7, pp. 82649-82671. https://doi.org/10.1109/ACCESS.2019.2923706
Methodological investigation for enhancing the usability of university websites
Manzoor, Mirfa, Hussain, Walayat, Sohaib, Osama, Hussain, Farookh Khadeer and Alkhalaf, Salem. (2019). Methodological investigation for enhancing the usability of university websites. Journal of Ambient Intelligence and Humanized Computing. 10(2), pp. 531-549. https://doi.org/10.1007/s12652-018-0686-6
Integrating design thinking into extreme programming
Sohaib, Osama, Solanki, Hiralkumari, Dhaliwa, Navkiran, Hussain, Walayat and Asif, Muhammad. (2019). Integrating design thinking into extreme programming. Journal of Ambient Intelligence and Humanized Computing. 10(6), pp. 2497-2504. https://doi.org/10.1007/s12652-018-0932-y
SaaS E-Commerce Platforms Web Accessibility Evaluation
Sohaib, Osama, Naderpour, Mohsen and Hussain, Walayat. (2018). SaaS E-Commerce Platforms Web Accessibility Evaluation. 2018 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). 08 - 13 Jul 2018 Brazil: IEEE Xplore. pp. 353-359 https://doi.org/10.1109/FUZZ40674.2018
Comparing time series with machine learning-based prediction approaches for violation management in cloud SLAs
Hussain, Walayat, Hussain, Farookh Khadeer, Saberi, Morteza, Hussain, Omar Khadeer and Chang, Elizabeth. (2018). Comparing time series with machine learning-based prediction approaches for violation management in cloud SLAs. Future Generation Computer Systems. 89, pp. 464-477. https://doi.org/10.1016/j.future.2018.06.041
Risk-based framework for SLA violation abatement from the cloud service provider's perspective
Hussain, Walayat, Hussain, Farookh Khadeer, Hussain, Omar, Bagia, Ravindra and Chang, Elizabeth. (2018). Risk-based framework for SLA violation abatement from the cloud service provider's perspective. The Computer Journal. 61(9), pp. 1306-1322. https://doi.org/10.1093/comjnl/bxx118