Lip Reading
A pipeline to read lips and generate speech for the read content, i.e Lip to Speech Synthesis.
2019年“创青春.交子杯”新网银行高校金融科技挑战赛-AI算法赛道比赛_代码分享
ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASSP'20 Lipreading using Temporal Convolutional Networks
DenseNet3D Model In "LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild", https://arxiv.org/abs/1810.06990
👄 Transformer Model for Lip Reading in the Wild (LRW) Benchmark
A speech recognition system using 3D CNNs. The final model achieves 97.4% training accuracy and a 99.2% testing accuracy and the system can accurately recognize spoken words from a set of pre-defin…
This is the PyTorch implementation of CNN-LSTM trained on Ouluvs2 dataset.
数据集中每个样本由唇语序列图片和对应的说话内容文本组成,数据被分为训练集和测试集,分别用于训练模型和测试模型效果。
Project for Online Inference on the Jetson TX2 for the Lip Reading task, inspired by the Lip2Wav research.
A transformer model to generate audio based on the readers lips and face
This project has been performed as part of my final year project.
An app that utilizes an advanced deep learning model capable of deciphering lip movements from silent videos of individuals speaking.
This application tackles the challenge of lip reading for people who want to communicate with muted people. The users can basically communicate with the muted by screening the mouths with our appli…
The Lip Reading Module of the "Unmute The Muted" Application
DenseNet3D & TCN Model In "LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild", https://arxiv.org/abs/1810.06990
Deep Visual Speech Recognition in arabic words
Code and models for evaluating a state-of-the-art lip reading network
Repository for W251 - Summer 2020 Final Project