Category "pytorch"

Convert AVAudioPCMBuffer into MLMultiArray and get prediction from CoreML model

I try to send AVAudioPCMBuffer into a coreML model and get the output from it. Input of the model is MultiArray (Float32 0 × 64 × 0) and output is M

Replace bidirectional LSTM with GRU in coref?

I am training the coarse-to-fine coreference model (for some other language than English) from Allennlp with template configs from bert_lstm.jsonnet. When I rep

I want to ask you about the structure of "query, key, value" of "transformer"

I'm a beginner at NLP. So I'm trying to reproduce the most basic transformer all you need code. But I got a question while doing it. In the MultiHeadAttention l

RuntimeError: The expanded size of the tensor (1300000) must match the existing size (80) at non-singleton dimension 0

I have following errors in my RBM code and here is the in raw. ipykernel_18388/119274704.py in v_to_h(self, v) 23 24 p_h = F.sigmoid( ---

Using Recurrent Neural Networks for binary values prediction

EDIT: The problems stated have been solved, you'll first find the solution, the initial question is stated below! SOLUTION: Applying the .unsqueeze(0) to my inp

PyTorch - Using {N,H,W,C} format in customized operation

I'm thinking about upgrading some of my customized PyTorch operations to support {N,H,W,C} format. However, I'm still confused about using channel-last-format t

Can you run the Opacus privacy engine with pytorch SequenceTaggingDataset?

I am trying to adapt a pytorch Named Entity Recognition model to incorporate differential privacy with the Opacus library. My model uses torchtext to build the

Import error: 'SimpleExperiment' while running BOTORCH example code

I am trying to work with Bayesian Optimisation for my Numerical model run, Optimising its parameters. For this I am using BoTorch. Its example code is given as

How to use nn.TransTransformerEncoder from pytorch

I am trying to use PyTorch's '''nn.TransformerEncoder''' module for a classification task. I have data points of varying lengths i.e I have sequences of differe

Pytorch's autograd issue with joblib

There seems to be a problem mixing pytorch's autograd with joblib. I need to get gradient in parallel for a lot of samples. Joblib works fine with other aspects

Combination of features of convolutional layers channel-by-channel in a multi-branch model

The convolutional model presented below, has two branches and each branch (for example) has two stages (convolutional layers). My aim is to combine the weighte

spatial domain convolution not equal to frequency domain multiplication using pytorch

I want to verify if 2D convolution in spatial domain is really a multiplication in frequency domain, so I used pytorch to implement convolution of an image with

Torch shape mismatch error while training a GPT2 model

I am trying to train a GPT2 language model for text generation tasks. I am trying to include an additional embedding layer (with POS-tagging) on top of token em

Using a target size (torch.Size([2])) that is different to the input size (torch.Size([2, 5])) is deprecated. Please ensure they have the same size

When I am using criterion = nn.BCELoss() for my binary classification task it creates problem and print "Using a target size (torch.Size([2])) that is different

torch.manual_seed(seed) get RuntimeError: CUDA error: device-side assert triggered

I am using GOOGLE COLAB when I get this error. Here is my code, I didn't find anything wrong, these code were right few hour ago but suddenly went wrong, I don'

Issues with Pytorch and Torchvision on MAC M1 - python / conda

Im trying to run Pytorch and Torchvision on Mac M1. I follow these instructions successfully install pytorch and run it natively on apple - https://betterprogra

How to use multiprocess when input is a torch.tensor with gradient?

import torch.multiprocessing as mp import torch import time class test(): def __init__(self,X,Y): self.X=X #.share_memory_() self.Y=Y

Improve Python (.exe) startup time

I created an exe with the PyInstaller. As soon as I enable the --onefile flag. The exe needs several minutes to start. When I build the application with the --o

IndexError: Target 11 is out of bounds. cross-entropy

How can I change the attached model to fit my dataset for the Bayesian model? my data include 5 variables and 32 results model = nn.Sequential( bnn.BayesLin

GPU out of memory with Pyannote

I'm using Pyannote and when I run the following from pyannote.audio import Pipeline pipeline = Pipeline.from_pretrained("pyannote/speaker-diarization") diariza