Hi @agupta54 @soujyo. This is Sujit from Anuvaad. I see two different repos for setting up inference server -- speech-recognition-open-api and inference_service_wrapper. What is the difference between these two, and which one is the preferred repo for setting up inference ?
2 replies
Hello, we are trying to develop ASR for Nepali language. Instead of directly finetuning for ASR, we are thinking to do some more pretraining with Nepali data, by starting with the CLSRIL-23 model. How should we begin on this? We have 4 tesla k80 GPUs. So, how feasible would it be for us in terms of training resources if we decide to train on 100 hours of audio data?
1 reply
What does 1 update in the log file correspond to? Does it refer to update after a pass through a batch?
2 replies
@agupta54
I can see two types of finetuning. One without Hydra and another with it. With branch would you recommend and can you just give a short comment on the key difference between both methods. Also please do recommend an infra to try out the fine-tuning for <50hr.
I can see two types of finetuning. One without Hydra and another with it. With branch would you recommend and can you just give a short comment on the key difference between both methods. Also please do recommend an infra to try out the fine-tuning for <50hr.
1 reply
Hi @agupta54. I was going through the Speaker Clustering work that you guys have done here. A link there points me to the Resemblyzer repo that has the Voice encoder to create the embeddings from audio. But I could not find any link to the repo where you have actually done the clustering and the subsequent steps that you mention in the page. Do you have such a repo ?
3 replies
Hi Team,
I was setting up the Intelligent Data Pipeline (https://open-speech-ekstep.github.io/intelligent_data_pipelines). I have set up the Infra for the same (composer environment) and modified the configs which I could understand. Now my question is how to start running the pipeline on a test audio folder that i have uploaded to my google cloud bucket? How does the process start.
I was setting up the Intelligent Data Pipeline (https://open-speech-ekstep.github.io/intelligent_data_pipelines). I have set up the Infra for the same (composer environment) and modified the configs which I could understand. Now my question is how to start running the pipeline on a test audio folder that i have uploaded to my google cloud bucket? How does the process start.
Also, through the documentation, some parts were unclear for setting up the environment variables. It would be great if someone could help me with it.
1 reply
Hi Team,
We are trying to fine-tune your Hindi pre-trained model for our own use case. Our requirement is to transcribe audio that is slightly code-mixed (majority is in Hindi with some English words in between). We have already tried the APIs of big cloud service providers and they don't do a great job at identifying code mixed audio. My question is that would it be possible to fine-tune the Vakyansh model to better identify code-mixed audio, given that we preparing around 200 hours of data for fine-tuning.
Thanks in advance
We are trying to fine-tune your Hindi pre-trained model for our own use case. Our requirement is to transcribe audio that is slightly code-mixed (majority is in Hindi with some English words in between). We have already tried the APIs of big cloud service providers and they don't do a great job at identifying code mixed audio. My question is that would it be possible to fine-tune the Vakyansh model to better identify code-mixed audio, given that we preparing around 200 hours of data for fine-tuning.
Thanks in advance
Hi @agupta54
I have few queries.
I have few queries.
- I wanted to generate custom model using script provided by vakyansh repo but custom model is not getting generated, Custom_model repo is blank.
please let me know where I am doing something Wrong - How inference is done at real time?
- What all strategies u have used to deploy a model
Thanks
1 reply
Can anyone describe the parameters in the base_10h.yml? because i am getting good transcription results at 26th epoch weights but bad results at 43rd epoch result?
1 reply
Hi @agupta54 What is the difference between 'Single Model for Inference' and 'Finetuned model' ? I see that both are .pt files, and the latter a much bigger file. I have been using the hindi model (hindi_infer.pt, v2-hydra branch) for the last 4 months. Has there been any new release of hi models ?
1 reply
Anyone around right now?
I am going through the docs and the repos to know more. I have a broad question - Is kaldi used in any of Vakyansh's recipes?
2 replies
Hi Vakyansh Team. The download links for the Telugu labelled data (1024.93 hours) are not working. Links are available at https://github.com/Open-Speech-EkStep/ULCA-asr-dataset-corpus#telugu-labelled-total-duration-is-102593-hours. They have probably expired now. Request you to look into this issue and restore access.
Greetings, Vakyansh Team. Could someone address the question at Open-Speech-EkStep/ULCA-asr-dataset-corpus#4 about permissions for this data? Thank you.
Hey Vakyansh team, I was trying out the demo site - https://inference.vakyansh.in/hindi but the mic is stuck in the state "starting". Alternatively I tried uploading a wav file at the bottom and got the message invalid file. Sharing the file below as well - https://github.com/Code4GovTech/curtain-raiser/blob/master/recording.wav?raw=true
Let me know how I can test this. Thanks.
3 replies