Skip to Content

126 Results Found

  • Article
  • Open Access
3 Citations
4,589 Views
15 Pages

23 October 2022

Speaker embeddings represent a means to extract representative vectorial representations from a speech signal such that the representation pertains to the speaker identity alone. The embeddings are commonly used to classify and discriminate between d...

(This article belongs to the Special Issue Artificial Intelligence and Machine Learning Based Methods and Applications)
  • Article
  • Open Access
7 Citations
5,617 Views
17 Pages

10 September 2024

Automatic speech recognition (ASR) aims at understanding naturally spoken human speech to be used as text inputs to machines. In multi-speaker environments, where multiple speakers are talking simultaneously with a large amount of overlap, a signific...

(This article belongs to the Special Issue Speech Recognition and Natural Language Processing)
  • Article
  • Open Access
6 Citations
3,460 Views
16 Pages

17 April 2019

Recently, the increasing demand for voice-based authentication systems has encouraged researchers to investigate methods for verifying users with short randomized pass-phrases with constrained vocabulary. The conventional i-vector framework, which ha...

(This article belongs to the Special Issue Advanced Biometrics with Deep Learning)
  • Feature Paper
  • Article
  • Open Access
1 Citations
471 Views
21 Pages

Speaker verification is an important biometric technology for secure and personalized human–computer interaction in intelligent embedded systems. However, deploying deep speaker verification models on edge devices remains challenging because of...

(This article belongs to the Special Issue Intelligent Embedded Systems: Latest Advances and Applications)
  • Article
  • Open Access
7 Citations
4,937 Views
19 Pages

U-Vectors: Generating Clusterable Speaker Embedding from Unlabeled Data

  • Muhammad Firoz Mridha,
  • Abu Quwsar Ohi,
  • Muhammad Mostafa Monowar,
  • Md. Abdul Hamid and ,
  • Md. Rashedul Islam and
  • Yutaka Watanobe
  • + 1 author+ 0 author

27 October 2021

Speaker recognition deals with recognizing speakers by their speech. Most speaker recognition systems are built upon two stages, the first stage extracts low dimensional correlation embeddings from speech, and the second performs the classification t...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1 Citations
2,443 Views
20 Pages

Utterance-Style-Dependent Speaker Verification Using Emotional Embedding with Pretrained Models

  • Long Pham Hoang,
  • Hibiki Takayama,
  • Masafumi Nishida,
  • Satoru Tsuge and
  • Shingo Kuroiwa

25 August 2025

Biometric authentication using human physiological and behavioral characteristics has been widely adopted, with speaker verification attracting attention due to its convenience and noncontact nature. Conventional speaker verification systems remain v...

(This article belongs to the Special Issue Sensor Technologies and Intelligent Computing for Biometric Signal Analysis and Pattern Recognition)
  • Article
  • Open Access
4 Citations
3,006 Views
17 Pages

30 October 2019

Over the recent years, various research has been conducted to investigate methods for verifying users with a short randomized pass-phrase due to the increasing demand for voice-based authentication systems. In this paper, we propose a novel technique...

(This article belongs to the Special Issue Speech, Acoustics, Audio Signal Processing and Applications in Sensors)
  • Article
  • Open Access
16 Citations
6,620 Views
24 Pages

31 October 2024

Automatic Speech Emotion Recognition (SER) plays a vital role in making human–computer interactions more natural and effective. A significant challenge in SER development is the limited availability of diverse emotional speech datasets, which h...

  • Article
  • Open Access
19 Citations
19,345 Views
12 Pages

Comparison of Modern Deep Learning Models for Speaker Verification

  • Vitalii Brydinskyi,
  • Yuriy Khoma,
  • Dmytro Sabodashko,
  • Michal Podpora and ,
  • Volodymyr Khoma,
  • Alexander Konovalov and
  • Maryna Kostiak
  • + 2 authors+ 0 author

6 February 2024

This research presents an extensive comparative analysis of a selection of popular deep speaker embedding models, namely WavLM, TitaNet, ECAPA, and PyAnnote, applied in speaker verification tasks. The study employs a specially curated dataset, specif...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
823 Views
20 Pages

26 June 2026

Target speaker extraction (TSE) aims to isolate speech spoken by a target speaker out of a mixture using speaker information in an enrollment utterance. Recently, several methods have been proposed that exploit the relationship between the enrollment...

  • Article
  • Open Access
4 Citations
3,236 Views
14 Pages

17 October 2020

One of the most important parts of a text-independent speaker verification system is speaker embedding generation. Previous studies demonstrated that shortcut connections-based multi-layer aggregation improves the representational power of a speaker...

(This article belongs to the Special Issue Human Computer Interaction for Intelligent Systems)
  • Feature Paper
  • Article
  • Open Access
1,511 Views
14 Pages

12 February 2026

Speaker diarization is a key component for multiple downstream speech technologies, including speech transcription, meeting analytics, and conversational understanding; however, Romanian lacks publicly established diarization resources and benchmarks...

(This article belongs to the Special Issue Recent Advances in Audio, Speech and Music Processing and Analysis, 2nd Edition)
  • Article
  • Open Access
591 Views
25 Pages

Personal voice activity detection (PVAD) identifies whether each detected speech frame originates from a designated target speaker. Modern PVAD systems are typically trained offline and then deployed with frozen model parameters and a fixed, pre-enro...

(This article belongs to the Special Issue Advances in Digital Signal and Image Processing, Techniques, and Computations with Multidisciplinary Applications: Third Edition)
  • Article
  • Open Access
4 Citations
4,003 Views
14 Pages

Self Attention Networks in Speaker Recognition

  • Pooyan Safari,
  • Miquel India and
  • Javier Hernando

24 May 2023

Recently, there has been a significant surge of interest in Self-Attention Networks (SANs) based on the Transformer architecture. This can be attributed to their notable ability for parallelization and their impressive performance across various Natu...

  • Article
  • Open Access
4 Citations
3,038 Views
11 Pages

19 April 2024

The development of deep learning greatly promotes the progress of speaker verification (SV). Studies show that both convolutional neural networks (CNNs) and dilated time-delay neural networks (TDNNs) achieve advanced performance in text-independent S...

(This article belongs to the Special Issue Audio, Speech and Language Processing)
  • Article
  • Open Access
2,847 Views
14 Pages

29 September 2025

Speaker verification (SV) is a core technology for security and personalized services, and its importance has been growing with the spread of wearables such as smartwatches, earbuds, and AR/VR headsets, where privacy-preserving on-device operation un...

(This article belongs to the Section Bioelectronics)
  • Article
  • Open Access
1,569 Views
21 Pages

20 September 2025

Text-dependent speaker verification (TD-SV), which verifies speaker identity using predefined phrases, has gained attention as a reliable contactless biometric authentication method for smart devices, internet of things (IoT), and real-time applicati...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
2,323 Views
26 Pages

Comparing Multi-Scale and Pipeline Models for Speaker Change Detection

  • Alymzhan Toleu,
  • Gulmira Tolegen and
  • Bagashar Zhumazhanov

Speaker change detection (SCD) in long, multi-party meetings is essential for diarization, Automatic speech recognition (ASR), and summarization, and is now often performed in the space of pre-trained speech embeddings. However, unsupervised approach...

  • Article
  • Open Access
15 Citations
6,908 Views
17 Pages

26 October 2020

Speaker identification is gaining popularity, with notable applications in security, automation, and authentication. For speaker identification, deep-convolutional-network-based approaches, such as SincNet, are used as an alternative to i-vectors. Co...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
2,475 Views
22 Pages

10 November 2025

Intelligent in-vehicle voice systems face critical challenges in robustness, security, and semantic flexibility under complex acoustic conditions. To address these issues holistically, this paper proposes a novel multimodal and secure voice-control f...

(This article belongs to the Section Electrical and Electronic Engineering)
  • Article
  • Open Access
2 Citations
2,981 Views
19 Pages

Res2Former: Integrating Res2Net and Transformer for a Highly Efficient Speaker Verification System

  • Defu Chen,
  • Yunlong Zhou,
  • Xianbao Wang,
  • Sheng Xiang and ,
  • Xiaohu Liu and
  • Yijian Sang
  • + 1 author+ 0 author

Speaker verification (SV) is an exceptionally effective method of biometric authentication. However, its performance is heavily influenced by the effectiveness of the extracted speaker features and their suitability for use in resource-limited enviro...

(This article belongs to the Special Issue New Advances in Embedded Software and Applications)
  • Article
  • Open Access
3,570 Views
20 Pages

Use of Embedded Clauses in Heritage and Monolingual Russian

  • Maria Martynova,
  • Yulia Zuban,
  • Natalia Gagarina and
  • Luka Szucsich

This study investigates the production of clausal embeddings by 195 Russian speakers (67 monolingually raised speakers, 68 heritage speakers in the US, and 60 heritage speakers in Germany) in different communicative situations varying by formality (f...

(This article belongs to the Special Issue Heritage Russian Bilingualism across the Lifespan)
  • Article
  • Open Access
6 Citations
3,445 Views
11 Pages

21 December 2020

One of the most recent speaker recognition methods that demonstrates outstanding performance in noisy environments involves extracting the speaker embedding using attention mechanism instead of average or statistics pooling. In the attention method,...

(This article belongs to the Section Circuit and Signal Processing)
  • Article
  • Open Access
4 Citations
2,744 Views
14 Pages

Multisensory Fusion for Unsupervised Spatiotemporal Speaker Diarization

  • Paris Xylogiannis,
  • Nikolaos Vryzas,
  • Lazaros Vrysis and
  • Charalampos Dimoulas

29 June 2024

Speaker diarization consists of answering the question of “who spoke when” in audio recordings. In meeting scenarios, the task of labeling audio with the corresponding speaker identities can be further assisted by the exploitation of spat...

(This article belongs to the Special Issue Multimodal Sensing Technologies for IoT and AI-Enabled Systems)
  • Article
  • Open Access
11 Citations
2,925 Views
9 Pages

Integrated Replay Spoofing-Aware Text-Independent Speaker Verification

  • Hye-jin Shim,
  • Jee-weon Jung,
  • Ju-ho Kim and
  • Ha-jin Yu

10 September 2020

A number of studies have successfully developed speaker verification or presentation attack detection systems. However, studies integrating the two tasks remain in the preliminary stages. In this paper, we propose two approaches for building an integ...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
213 Views
18 Pages

Multi-Task Flow Matching Speech Enhancement Method with Dual Guidance of Semantic Understanding and Speaker Perception

  • Bingyu Dai,
  • Xia Zou,
  • Yihao Li,
  • Chong Jia and ,
  • Meng Sun,
  • Yongqiang Xie and
  • Xiongwei Zhang
  • + 2 authors+ 0 author

9 October 2026

Generative speech enhancement models often suffer from the “generative hallucination” issue, where artifacts are introduced or original speech characteristics are distorted during reconstruction due to insufficient prior constraints, seve...

(This article belongs to the Special Issue Feature Papers in Circuit and Signal Processing, 2nd Edition)
  • Article
  • Open Access
394 Views
21 Pages

20 October 2026

Chinese short-form dramas (duanju) drive a growing demand for automated Japanese dubbing that preserves each character’s voice. The decisive component is zero-shot cross-lingual voice cloning: synthesising Japanese speech from a short Chinese r...

  • Article
  • Open Access
2 Citations
3,084 Views
21 Pages

10 March 2025

This study addresses the challenges of complex noise and short speech in civil aviation air-ground communication scenarios and proposes a novel speaker identification model, Chrono-ECAPA-TDNN (CET). The aim of the study is to enhance the accuracy and...

  • Article
  • Open Access
10 Citations
4,231 Views
30 Pages

Comparison of the Ability of Neural Network Model and Humans to Detect a Cloned Voice

  • Krzysztof Milewski,
  • Szymon Zaporowski and
  • Andrzej Czyżewski

30 October 2023

The vulnerability of the speaker identity verification system to attacks using voice cloning was examined. The research project assumed creating a model for verifying the speaker’s identity based on voice biometrics and then testing its resista...

  • Article
  • Open Access
9 Citations
9,365 Views
14 Pages

30 April 2024

Speech is a crucial source of personal information, and the risk of attackers using such information increases day by day. Speaker privacy protection is crucial, and various approaches have been proposed to hide the speaker’s identity. One appr...

(This article belongs to the Special Issue Applications of Image Processing and Pattern Recognition in Biometrics)
  • Article
  • Open Access
19 Citations
14,035 Views
13 Pages

Development of Supervised Speaker Diarization System Based on the PyAnnote Audio Processing Library

  • Volodymyr Khoma,
  • Yuriy Khoma,
  • Vitalii Brydinskyi and
  • Alexander Konovalov

13 February 2023

Diarization is an important task when work with audiodata is executed, as it provides a solution to the problem related to the need of dividing one analyzed call recording into several speech recordings, each of which belongs to one speaker. Diarizat...

(This article belongs to the Special Issue Biomedical Data in Human-Machine Interaction)
  • Article
  • Open Access
3 Citations
2,613 Views
13 Pages

Speaker Recognition Based on the Joint Loss Function

  • Tengteng Feng,
  • Houbin Fan,
  • Fengpei Ge,
  • Shuxin Cao and
  • Chunyan Liang

15 August 2023

The statistical pyramid dense time-delay neural network (SPD-TDNN) model makes it difficult to deal with the imbalance of training data, poses a high risk of overfitting, and has weak generalization ability. To solve these problems, we propose a meth...

(This article belongs to the Special Issue Machine Learning in Music/Audio Signal Processing)
  • Communication
  • Open Access
11 Citations
3,785 Views
10 Pages

10 October 2022

Transformer models are now widely used for speech processing tasks due to their powerful sequence modeling capabilities. Previous work determined an efficient way to model speaker embeddings using the Transformer model by combining transformers with...

(This article belongs to the Special Issue Deep Convolutional Neural Networks)
  • Article
  • Open Access
11 Citations
4,089 Views
12 Pages

11 August 2019

In this paper, we propose a new differentiable neural network with an alignment mechanism for text-dependent speaker verification. Unlike previous works, we do not extract the embedding of an utterance from the global average pooling of the temporal...

(This article belongs to the Special Issue IberSPEECH 2018: Speech and Language Technologies for Iberian Languages)
  • Review
  • Open Access
12 Citations
13,441 Views
19 Pages

14 February 2025

Recorded audio often contains speech from multiple people in conversation. It is useful to label such signals with speaker turns, noting when each speaker is talking and identifying each speaker. This paper discusses how to process speech signals to...

(This article belongs to the Section Electrical, Electronics and Communications Engineering)
  • Article
  • Open Access
3 Citations
5,291 Views
15 Pages

Contrastive Speaker Representation Learning with Hard Negative Sampling for Speaker Recognition

  • Changhwan Go,
  • Young Han Lee,
  • Taewoo Kim,
  • Nam In Park and
  • Chanjun Chun

25 September 2024

Speaker recognition is a technology that identifies the speaker in an input utterance by extracting speaker-distinguishable features from the speech signal. Speaker recognition is used for system security and authentication; therefore, it is crucial...

(This article belongs to the Special Issue Advances in Automatic Speech Recognition, Audio and Underwater Acoustic Signal Analysis)
  • Feature Paper
  • Article
  • Open Access
1,118 Views
22 Pages

Persona-ASR: Bilingual Target-Speaker Speech Recognition for Kazakh–English Overlapping Speech

  • Rakhat Meiramov,
  • Tomiris Rakhimzhanova,
  • Adil Taibassarov,
  • Zhanat Makhataeva and
  • Huseyin Atakan Varol

Target-speaker automatic speech recognition (TS-ASR) enables transcription of a specific speaker in multi-talker environments, yet remains largely unexplored for multilingual, low-resource languages. Existing TS-ASR systems predominantly target monol...

(This article belongs to the Special Issue Advancing Natural Language Processing for Low-Resource Languages and Dialects)
  • Article
  • Open Access
18 Citations
4,805 Views
13 Pages

Hierarchical Transformer Network for Utterance-Level Emotion Recognition

  • Qingbiao Li,
  • Chunhua Wu,
  • Zhe Wang and
  • Kangfeng Zheng

28 June 2020

While there have been significant advances in detecting emotions in text, in the field of utterance-level emotion recognition (ULER), there are still many problems to be solved. In this paper, we address some challenges in ULER in dialog systems. (1)...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
9 Citations
4,517 Views
19 Pages

An Analysis of the Short Utterance Problem for Speaker Characterization

  • Ignacio Viñals,
  • Alfonso Ortega,
  • Antonio Miguel and
  • Eduardo Lleida

5 September 2019

Speaker characterization has always been conditioned by the length of the evaluated utterances. Despite performing well with large amounts of audio, significant degradations in performance are obtained when short utterances are considered. In this wo...

(This article belongs to the Special Issue IberSPEECH 2018: Speech and Language Technologies for Iberian Languages)
  • Article
  • Open Access
2,457 Views
29 Pages

For heritage speakers (HSs), expectations of influence from the community’s dominant language are pervasive. An alternative account for heritage language variability is that HSs are demonstrating sociolinguistic competence: HSs may either initi...

(This article belongs to the Special Issue The Acquisition of L2 Sociolinguistic Competence)
  • Article
  • Open Access
1 Citations
2,575 Views
14 Pages

2 October 2023

At present, a prevalent approach to speaker diarization is clustering based on speaker embeddings. However, this method encounters two primary issues. Firstly, it cannot directly minimize the diarization error during the training process; secondly, t...

  • Article
  • Open Access
8 Citations
3,886 Views
11 Pages

22 December 2021

The majority of recent speaker verification tasks are studied under open-set evaluation scenarios considering real-world conditions. The characteristics of these tasks imply that the generalization towards unseen speakers is a critical capability. Th...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1 Citations
6,263 Views
27 Pages

14 May 2025

Voice conversion (VC) is an advanced technology that enables the transformation of raw speech into high-quality audio resembling the target speaker’s voice while preserving the original linguistic content and prosodic patterns. In this study, w...

(This article belongs to the Special Issue Deep Learning for Speech, Image and Language Processing)
  • Article
  • Open Access
29 Citations
10,418 Views
16 Pages

24 November 2022

It is an objective reality that deaf-mute people have difficulty seeking medical treatment. Due to the lack of sign language interpreters, most hospitals in China currently do not have the ability to interpret sign language. Normal medical treatment...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
1,850 Views
16 Pages

6 December 2024

Two experiments were conducted to examine native and non-native speakers’ recognition of Chinese two-character words (2C-words) in the context of audio sentence comprehension. The recording was played of a sentence, in which a collocation compo...

(This article belongs to the Section Cognition)
  • Article
  • Open Access
4 Citations
4,077 Views
11 Pages

26 January 2021

Recently, researchers have developed text-to-speech models based on deep learning, which have produced results superior to those of previous approaches. However, because those systems only mimic the generic speaking style of reference audio, it is di...

(This article belongs to the Special Issue AI, Machine Learning and Deep Learning in Signal Processing)
  • Article
  • Open Access
19 Citations
5,887 Views
14 Pages

14 June 2020

Recurrent neural networks (RNNs) can model the time-dependency of time-series data. It has also been widely used in text-dependent speaker verification to extract speaker-and-phrase-discriminant embeddings. As with other neural networks, RNNs are tra...

(This article belongs to the Special Issue Intelligent Speech and Acoustic Signal Processing)
  • Article
  • Open Access
486 Views
18 Pages

12 August 2026

In the rapidly evolving landscape of computer and mobile applications, the demand for secure access control has become increasingly pivotal. This paper introduces a speaker verification method aimed at remotely verifying an individual’s claimed...

(This article belongs to the Special Issue AI-Empowered Smart Sensor Networks: Enabling Dynamic Perception and Data Analytics in IoT)
  • Article
  • Open Access
6 Citations
3,790 Views
20 Pages

Attention-Based Temporal-Frequency Aggregation for Speaker Verification

  • Meng Wang,
  • Dazheng Feng,
  • Tingting Su and
  • Mohan Chen

10 March 2022

Convolutional neural networks (CNNs) have significantly promoted the development of speaker verification (SV) systems because of their powerful deep feature learning capability. In CNN-based SV systems, utterance-level aggregation is an important com...

(This article belongs to the Special Issue Biometric Systems for Personal Human Recognition)
  • Article
  • Open Access
2,175 Views
19 Pages

Vox2Face: Speech-Driven Face Generation via Identity-Space Alignment and Diffusion Self-Consistency

  • Qiming Ma,
  • Yizhen Wang,
  • Xiang Sun,
  • Jiadi Liu and ,
  • Gang Cheng,
  • Jia Feng,
  • Rong Wang and
  • Fanliang Bu
  • + 3 authors+ 0 author

14 February 2026

Speech-driven face generation aims to synthesize a face image that matches a speaker’s identity from speech alone. However, existing methods typically trade identity fidelity for visual quality and rely on large end-to-end generators that are d...

(This article belongs to the Section Artificial Intelligence)

of 3