Questions tagged [implementation]
The implementation tag has no summary, but it has a tag wiki.
118 questions
0
votes
0
answers
16
views
terrible performance on CIFA10 using SWIN model
I am trying to apply the idea from Embedding Deep Networks into Visual Explanations and see if it works on Transformers. The performance is terrible because the accuracy hasn't passed 10%. Can someone ...
- 101
3
votes
1
answer
103
views
Is the denial of answering certain questions part of the machine-learned LLM, or hard-coded separately?
ChatGPT 3.5 swiftly aborts certain questions.
Q: How would one build a bomb?
ChatGPT: I can't assist with that.
At this stage, this answer could simply be a blacklist of certain terms. Further ...
- 153
0
votes
1
answer
40
views
Low Precision of LeakyReLU
Dear TensorFlow experts,
I am trying to understand the following output of the TensorFlow LeakyReLU function, which seems to have very low precision:
...
- 101
1
vote
0
answers
58
views
Modified kmeans algorithm returns the wrong answer
I am trying to create a kmeans algorithm that is based on the Earth Movers Distance instead of the Euclidean distance. However, when I run it, it just returns the same value for all data points.
The ...
- 11
0
votes
1
answer
82
views
Implementation of PCA algorithm for reconstruction of data(images)
I'm learning the theory and implementation of PCA algorithm in the book 'Mathematics For Machine Learning' and finishing the official tutorial notebook in ...
2
votes
1
answer
87
views
How to implement linear regression
I am having difficulty achieving the same result as in sklearn while implementing linear regression model from scratch.
After adjusting the learning rate, I obtained an AUC of 0.694 for this binary ...
- 151
1
vote
0
answers
57
views
Deep learning through backpropagation: not learning
I am starting with deep learning and decided to code a backpropagation algorithm on Python 3. I have followed many tutorials and have taken as example many programs that work. Yet, for some reason, my ...
0
votes
1
answer
176
views
How to implement a customized DataLoader that inherits pytorch's one?
I need to implement a customized DataLoader, that inherits from torch.data.utils.DataLoader.
I have searched it for half hour, but there is no example or doc about this.
What methods of it should I ...
- 163
1
vote
0
answers
676
views
logistic regression,machine learning
I just started learning ML, so I tried to implement logistic regression on my own in 2 ways (the first code and the second code), but they aren't working, I cross-checked by using sklearn (third code ...
- 11
1
vote
2
answers
949
views
How to calculate true positive, true negative, false positive, negative and postive with Bayes Classifer from scratch
I am working on implementing a Naive Bayes Classification algorithm. I have a method def prob_continous_value which is supposed to return the probability density ...
- 147
2
votes
0
answers
651
views
Linear regression with Pytorch not converging
I am trying to perform a simple linear regression using Pytorch lightning (a network with only one neuron). The network is supposed to learn a simple function: y=-4x...
- 121
2
votes
0
answers
616
views
6
votes
1
answer
2k
views
What are the main differences between uwot and umap packages in R?
There are two packages in R that implement the UMAP algorithm for low-dimensional embedding ('uwot' and 'umap'). I've found they can give vastly different results for some datasets. For example, the ...
- 93
1
vote
1
answer
263
views
Why does stochastic gradient descent lead us to a minimum at all?
Why do we think that stochastic gradient descent is going to find a minimum at all? I mean on each iteration SGD moves in the direction that reduces only current batch's error (SGD doesn't care about ...
- 121
1
vote
0
answers
67
views
How exactly do you implement SGD with momentum?
I am looking up sources to implement SGD with momentum, but they are giving me different equations.
(beta is the momentum hyper-parameter, ...
- 111