[Errno 2] No such file or directory: 'project'
/kaggle/working/project
/opt/conda/lib/python3.10/site-packages/scipy/__init__.py:146: UserWarning: A NumPy version >=1.16.5 and <1.23.0 is required for this version of SciPy (detected version 1.24.3
  warnings.warn(f"A NumPy version >={np_minversion} and <{np_maxversion}"
TTSTrainer start 1133.784967758
Initializing trainer with hparams:
{'attention_dim': 128,
 'attention_location_kernel_size': 31,
 'attention_location_n_filters': 32,
 'attention_rnn_dim': 1024,
 'audio_encoder_dim': 192,
 'audio_encoder_path': None,
 'batch_size': 18,
 'checkpoint_name': 'uberduck_model',
 'checkpoint_path': 'checkpoints',
 'coarse_n_frames_per_step': None,
 'config': 'tacotron2_config.json',
 'cudnn_enabled': True,
 'dataset_path': '.',
 'debug': False,
 'decoder_rnn_dim': 1024,
 'distributed_run': False,
 'encoder_embedding_dim': 512,
 'encoder_kernel_size': 5,
 'encoder_n_convolutions': 3,
 'epochs': 5001,
 'epochs_per_checkpoint': 50,
 'filter_length': 1024,
 'fp16_run': False,
 'gate_threshold': 0.5,
 'get_gst': None,
 'grad_clip_thresh': 1.0,
 'gst_dim': 2304,
 'gst_type': 'torchmoji',
 'has_speaker_embedding': True,
 'hop_length': 256,
 'ignore_layers': ['speaker_embedding.weight'],
 'include_f0': False,
 'is_validate': True,
 'learning_rate': 0.0005,
 'load_f0s': False,
 'load_gsts': False,
 'log_dir': 'runs',
 'lr_decay_min': 1e-05,
 'lr_decay_rate': 216000,
 'lr_decay_start': 15000,
 'mask_padding': True,
 'max_decoder_steps': 1000,
 'max_wav_value': 32768.0,
 'mel_fmax': 8000.0,
 'mel_fmin': 0.0,
 'n_frames_per_step_initial': 1,
 'n_mel_channels': 80,
 'n_speakers': 1,
 'num_heads': 8,
 'num_workers': 1,
 'p_arpabet': 1.0,
 'p_attention_dropout': 0.1,
 'p_decoder_dropout': 0.1,
 'p_teacher_forcing': 1.0,
 'pin_memory': True,
 'pos_weight': None,
 'postnet_embedding_dim': 512,
 'postnet_kernel_size': 5,
 'postnet_n_convolutions': 5,
 'prenet_dim': 256,
 'ref_enc_filters': [32, 32, 64, 64, 128, 128],
 'ref_enc_gru_size': 128,
 'ref_enc_pad': [1, 1],
 'ref_enc_size': [3, 3],
 'ref_enc_strides': [2, 2],
 'sample_inference_speaker_ids': [0],
 'sample_inference_text': 'That quick beige fox jumped in the air loudly over '
                          'the thin dog fence.',
 'sample_rate': 22050,
 'sampling_rate': 22050,
 'seed': 123,
 'speaker_embedding_dim': 128,
 'steps_per_sample': 50,
 'symbol_set': 'nvidia_taco2',
 'symbols_embedding_dim': 512,
 'text_cleaners': ['english_cleaners'],
 'torchmoji_model_file': 'torchmoji_model.bin',
 'torchmoji_vocabulary_file': 'vocabulary.json',
 'training_audiopaths_and_text': 'train_filelist.txt',
 'val_audiopaths_and_text': 'train_filelist.txt',
 'warm_start_name': '/kaggle/input/jarvis-cn/checkpoints/jarves_280.pt',
 'weight_decay': 1e-06,
 'win_length': 1024,
 'with_audio_encoding': False,
 'with_f0s': False,
 'with_gsts': False}
start train 1133.803361436
Initialized Torchmoji GST
Starting warm_start 1137.889409207
WARNING! Attempting to load a model with out the speaker_embedding.weight layer. This could lead to unexpected results during evaluation.
WARNING! Attempting to load a model with out the spkr_lin.weight layer. This could lead to unexpected results during evaluation.
WARNING! Attempting to load a model with out the spkr_lin.bias layer. This could lead to unexpected results during evaluation.
Adjusted global step to 39233
Ending warm_start 1138.159353733
Exception raised while training: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper_CUDA__index_select)
Traceback (most recent call last):
  File "/opt/conda/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/conda/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/opt/conda/lib/python3.10/site-packages/uberduck_ml_dev/exec/train_tacotron2.py", line 46, in <module>
    run(None, None, hparams)
  File "/opt/conda/lib/python3.10/site-packages/uberduck_ml_dev/exec/train_tacotron2.py", line 27, in run
    raise e
  File "/opt/conda/lib/python3.10/site-packages/uberduck_ml_dev/exec/train_tacotron2.py", line 23, in run
    trainer.train()
  File "/opt/conda/lib/python3.10/site-packages/uberduck_ml_dev/trainer/tacotron2.py", line 475, in train
    model_output = model(
  File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/uberduck_ml_dev/models/tacotron2.py", line 229, in forward
    embedded_inputs = self.embedding(input_text).transpose(1, 2)
  File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/sparse.py", line 162, in forward
    return F.embedding(
  File "/opt/conda/lib/python3.10/site-packages/torch/nn/functional.py", line 2210, in embedding
    return torch.embedding(weight, input, padding_idx, scale_grad_by_freq, sparse)
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper_CUDA__index_select)
---------------------------------------
Step 9 completed