Search results for: Irina Kipyatkova

Items from 1 to 10 out of 10 results

article

Multimodal speech recognition: increasing accuracy using high speed video data

Denis Ivanko, Alexey Karpov, Dmitrii Fedotov, Irina Kipyatkova, more

Journal on Multimodal User Interfaces > 2018 > 12 > 4 > 319-328

To date, multimodal speech recognition systems based on the processing of audio and video signals show significantly better results than their unimodal counterparts. In general, researchers divide the solution of the audio–visual speech recognition problem into two parts. First, in extracting the most informative features from each modality and second, in the most successful way of fusion both modalities...

chapter

An Assistive Bi-modal User Interface Integrating Multi-channel Speech Recognition and Computer Vision

Alexey Karpov, Andrey Ronzhin, Irina Kipyatkova

Lecture Notes in Computer Science > Human-Computer Interaction. Interaction Techniques and Environments > Novel Interaction Techniques and Devices > 454-463

In this paper, we present a bi-modal user interface aimed both for assistance to persons without hands or with physical disabilities of hands/arms, and for contactless HCI with able-bodied users as well. Human being can manipulate a virtual mouse pointer moving his/her head and verbally communicate with a computer, giving speech commands instead of computer input devices. Speech is a very useful modality...

chapter

Client and Speech Detection System for Intelligent Infokiosk

Andrey Ronzhin, Alexey Karpov, Irina Kipyatkova, Miloš Železný

Lecture Notes in Computer Science > Text, Speech and Dialogue > Dialogue > 560-567

Timely attraction of a client and detection of his/her speech message in real noisy conditions are main difficulties at deployment of speech and multimodal interfaces in information kiosks. Combination of sound source localization, voice activity and face detection technologies allowed to determine client mouth coordinates and extract boundaries of speech signal appeared in the kiosk dialogue area...

article

Automatic Technologies for Processing Spoken Sign Languages

Alexey Karpov, Irina Kipyatkova, Milos Zelezny

Procedia Computer Science > 2016 > 81 > C > 201-207

Sign languages are known as a natural means for verbal communication of the deaf and hard of hearing people. There is no universal sign language, and almost each country has its own national sign language and fingerspelling alphabet. Sign languages use visual-kinetic clues for human-to-human communication combining hand gestures with lips articulation and facial mimics. They also possess a special...

chapter

Recurrent neural network-based language modeling for an automatic Russian speech recognition system

Irina Kipyatkova, Alexey Karpov

2015 Artificial Intelligence and Natural Language and Information Extraction, Social Media and Web Search FRUCT Conference (AINL-ISMW FRUCT) > 33 - 38

2015 Artificial Intelligence and Natural Language and Information Extraction, Social Media and Web Search FRUCT Conference (AINL-ISMW FRUCT)

In the paper, we describe a research of recurrent neural network language models for N-best list rescoring for automatic continuous Russian speech recognition. We tried recurrent neural networks with different number of units in the hidden layer. We achieved the relative word error rate reduction of 14% with respect to the baseline 3-gram model.

article

Large vocabulary Russian speech recognition using syntactico-statistical language modeling

Alexey Karpov, Konstantin Markov, Irina Kipyatkova, Daria Vazhenina, more

Speech Communication > 2014 > 56 > Complete > 213-228

Speech is the most natural way of human communication and in order to achieve convenient and efficient human–computer interaction implementation of state-of-the-art spoken language technology is necessary. Research in this area has been traditionally focused on several main languages, such as English, French, Spanish, Chinese or Japanese, but some other languages, particularly Eastern European languages,...

chapter

PARAD-R: Speech analysis software for meeting support

Andrey Ronzhin, Viktor Budkov, Irina Kipyatkova

2013 9th International Conference on Information, Communications & Signal Processing > 1 - 4

2013 9th International Conference on Information, Communications & Signal Processing (ICICS)

The main goal of the development of systems of formal logging activities is to automate the whole process of transcription of the participant speech. In this paper we outline modern methods of audio and video signal processing and personification data analysis for multimodal speaker diarization. The proposed PARAD-R software for Russian speech analysis implemented for audio speaker diarization and...

chapter

Designing a multimodal corpus of audio-visual speech using a high-speed camera

Alexey Karpov, Andrey Ronzhin, Irina Kipyatkova

2012 IEEE 11th International Conference on Signal Processing > 1 > 519 - 522

2012 11th International Conference on Signal Processing (ICSP 2012)

In this paper, we present a research on designing and processing an audio-visual speech database for an automatic Russian speech recognition system using Oktava MK-012 microphone and JAI Pulnix RMC-6740GE high-speed camera (200 frames per second). Developed audio-visual speech recording system is described, it provides synchronization and fusion of audio and video data recorded by the independent...

chapter

Analysis of long-distance word dependencies and pronunciation variability at conversational Russian speech recognition

Irina Kipyatkova, Alexey Karpov, Vasilisa Verkhodanova, Milos Zelezny

2012 Federated Conference on Computer Science and Information Systems (FedCSIS) > 719 - 725

2012 Federated Conference on Computer Science and Information Systems (FedCSIS)

The key issues of conversational Russian speech processing at phonemic and language model levels are considered in the work. The multiple transcriptions for modeling word pronunciation variety and joint application of statistic and syntactic analysis of training text data for modeling long-distance grammatical relations between words in the phrase are proposed. The word error rate of the developed...

chapter

Multimodal Human Computer Interaction with MIDAS Intelligent Infokiosk

Alexey Karpov, Andrey Ronzhin, Irina Kipyatkova, Alexander Ronzhin, more

2010 20th International Conference on Pattern Recognition > 3862 - 3865

2010 20th International Conference on Pattern Recognition (ICPR 2010)

In this paper, we present an intelligent information kiosk called MIDAS (Multimodal Interactive-Dialogue Automaton for Self-service), including its hardware and software architecture, stages of deployment of speech recognition and synthesis technologies. MIDAS uses the methodology Wizard of Oz (WOZ) that allows an expert to correct speech recognition results and control the dialogue flow. User statistics...

Filter options

Publication date

Set your own date range

INFONA - science communication portal

Search results for: Irina Kipyatkova

Add recipient

Sending message cancelled

Are you sure you want to cancel sending this message?

Send message

Filter options

Publication date

Date range setting

Set the date range to filter the displayed results. You can set a starting date, ending date or both. You can enter the dates manually or choose them from the calendar.

Publication type

Keywords

Data set

Journal

Reporting an error / abuse

Sending the report failed

Accessibility options