Category "machine-learning"

tensorflow 2 use keras.sequence as data generator for training machine learning model with multiprocessing error

I would like to do a test about training a machine learning model on EC2 instance with only CPUs from jupyter notebook. The code is tensorflow 2.8. Based on the

How to predict the y based on past data

I have a data array like this {x: 0, y: 7.9} {x: 1, y: 7.5} {x: 2, y: 7.0} {x: 3, y: 7.4} {x: 4, y: 7.3} {x: 5, y: 7.2} {x: 6, y: 7.5} {x: 7, y: 7.6} {x: 8, y:

TensorFlow warning: Allocation of X exceeds 10% of free system memory

I just wonder what does it means the allocation number value(the X in the title of my question) in the tensorflow warning 2022-05-14 19:03:39.958223: W tensorfl

Multilabel Multiclass image classification with tensorflow

i try to train a model that classified frames from my garden camera to detect different animals. My dataset has 8000 images, 2000 per class of squirrels, pigeon

Building a Random Forest Classifier with equal output probabilities to a Decision Tree Classifier

I have been trying to build a RandomForestClassifier() (RF) model and a DecisionTreeClassifier() (DT) model in order to get the same output (only for learning p

How to skip pycaret data type validation step in docker

While we create a pycaret setup, e.g.: from pycaret.regression import all exp_reg101 = setup(data = data, target = 'Price', session_id=123,preprocess=False) I

OpenCV warpAffine error during image augmentation using Albumentations

I have been trying to do image augmentation using a library called Albumentations. But I got some error from OpenCV while transforming the images. I ran the cod

How to do PCA on multiple images by flattening the tensors?

I have an array of tensors for a single image. I want to flatten the vectors and perform PCA on the same. The below is the code to extract the tensors on a sing

Tensorflow Keras: Dimension/Shape Error when running model.fit

I am trying to use Tensorflow and Keras for a prediction model. I first read in my dataset that has shape (7709, 58), then normalize it: normalizer = tf.keras.l

How to fix the error where the target batch size does not match when I use CrossEntropyLoss function?

I am working on a trainning task with CNN. When I created the loss function with CrossEntropyLoss and trained the dataset, the error reminded me that the batch

ValueError: X has 19 features, but LinearRegression is expecting 20 features as input

I'm trying to do polynomial regression using this code here: x_train,x_test,y_train,y_test = train_test_split(self.X, self.y, test_size=split, random_state=rand

WHY tf.keras.layers.Conv2D gives different results at each run

I am trying to reproduce my code from online Jupyter Notebook (COURSERA) to my own local environment (Anaconda 3 Jupyter with CUDA installed) All Codes a

how to align sliding window to extract features from multi modal timeseries data?

I have two datasets that are collected at different frequencies at the same time. One is recorded at 128Hz and another one is recorded at 512 Hz. I am trying to

DNN model with maxout activation in tensorflow

How can I make this DNN model in tensorflow? 31 neurons in the first, 10 in the second, 5 in the third hidden layer, and 2 neurons in the output layer. The acti

Dummy variables: must I scale* them if I scale all dataset or leave them apart? *(center, scale, normalize...)

When working with scaled data, dummy variables should also be scaled or should be left apart without scaling? Can ML algorithms produce different result and whi

ValueError: Input 0 of layer lstm_14 is incompatible with the layer: expected ndim=3, found ndim=4. Full shape received: [None, 12, 12, 64]

I am using CNN-LSTM network for image classification. My image size is (224, 224, 3) and batch size is 90. I m getting this error when i passing input to LSTM l

How to create an ensemble model by stacking different model?

I want to use ensemble model by stacking Multiple Linear Regression, SVR, Decision Tree Regression and ANN regression. How can I do that?

Feature importance in neural networks with multiple differently shaped inputs in pytorch and captum (classification)

I have developed a model with three inputs types. Image, categorical data and numerical data. For Image data I've used ResNet50 for the other two I develop my o

How do engineered features help when they are not present in the test data

I am trying to classify between drones and birds using machine learning. I have got a big number of samples of feature vectors from a radar which generally con

Wandb line plots only show bar charts after refresh

My weights and biases (wandb) panels (e.g. for loss) shortly show line plots (x: steps, y: loss), then refresh (showing a spinner for some time) and then only s