audio_preproc_in_bottom and set it to True (default is False). I am currently trying this but it seems to be that there might be something broken? I opened a github issue: tensorflow/tensor2tensor#1743
Hi folks, I'm trying to run an example colab book that shows the librispeech pretrained transformer. The link I've found is here: https://colab.research.google.com/github/tensorflow/tensor2tensor/blob/master/tensor2tensor/notebooks/asr_transformer.ipynb#scrollTo=rRso42LnRDXF
I had struggled to run at it first (had to pip install the newest version which would import models correctly). Now I'm stuck at the decoding part, it seems that the fetched checkpoint does not match the model that is being used. Any suggestions if I can use the checkpoint provided there? Are there any others that have been updated? Am I correct in assuming that this mismatch is indeed the problem? Cheers
This is what the error is : NotFoundError: transformer/symbol_modality_256_384/shared/weights_0 not found in checkpoint
!pip install tensorflow==1.14.0
!pip install tensor2tensor==1.11.0
!pip install tensorflow-probability==0.7.0
Checkpoint works well, I've uploaded a short utterance and it recognized the words perfectly, Cheers!
@zjplab So, I really don't know if that's the best way to do it but I created a train.py script which simply calls t2t_trainer.main(None). In order for this to work you have to make sure that sys.args looks the way t2t expects it to e.g.
import sys
# ..
args = get_args()
t2t_args = [
'--generate_data',
'--data_dir', args.data_dir,
'--tmp_dir', args.tmp_dir,
# ..
]
sys.argv = sys.argv[:1] + t2t_args
t2t_trainer.main(None)There might be better ways but I can live with that.
Now you can run and debug train.py.
t2t_trainer.py using a debugger.
Does anybody know how we can read tf.string fields from shards? E.g.
def example_reading_spec(self):
data_fields = {
# ..
'dataset_name': tf.FixedLenFeature((), tf.string)
}
data_items_to_decoders = None
return data_fields, data_items_to_decodersAs soon as I add this to the desired fields, I am getting ValueError: slice index 0 of dimension 0 out of bounds..
Do I have to provide a decoder for data_items_to_decoders?
Hi, I have an install problem and would appreciate any help:
I'm on a Mac Catalina, installed TensorFlow, and it looks fine. Installed t2t using pip install tensor2tensor, no complaint from the OS.
Trying to run t2t-trainer I get:
AttributeError: module 'tensorflow' has no attribute 'variable_scope'
Anyone can help? Many thanks!
weight_0 not found in checkpoint error that is probably due to a version mismatch
Hi all, I am experimenting with a speech to text model trained using tensor2tensor (not by me). I only have access to saved_model format generated using t2t-export and the vocab for decoding.
Is it possible to change the decoding params of the exported model?
Is there some way to see all the beam outputs instead of the top scoring one?
Any help/suggestions are appreciated. Thank you.
When I train my transformer using t2t-trainer, I see the targets/accuracy go up to around 65% on tensorboard. But then when I try:
t2t-decoder --data_dir=$DATA_DIR --problem=$PROBLEM --model=$MODEL --hparams_set=$HPARAMS --output_dir=$TRAIN_DIR --t2t_usr_dir='.'
It looks like none of the OUTPUTs matches the corresponding TARGETs. Am I missing something obvious?
