Error installing sentence transformers for sBERT #1841
-
|
I am starting phase 3 of the SAFE protocol while screening abstracts. I want to use sBERT as the feature extractor. I followed the steps to install the sentence transformers, but I get the following error when training the model in ASReview: ImportError: Install sentence-transformers package to use Sentence BERT. When I try to install the sentence transformers, I get the below warning. Any ideas how I can resolve this? Many thanks. C:\Users\cathalohara>pip install asreview[sentence_transformers] |
Beta Was this translation helpful? Give feedback.
Replies: 6 comments 23 replies
-
|
Hi! I think the installation instructions are a bit off then. Can you point us to where you found these instructions? For sbert we need some special packages in Python. I think running ^JT |
Beta Was this translation helpful? Give feedback.
-
|
Ah OK, I get you. I've pasted in the output from C:\Users\cathalohara>pip list absl-py 2.1.0 C:\Users\cathalohara> |
Beta Was this translation helpful? Give feedback.
-
|
That looks good! Both ASReview and sentence transformers is installed; you should be able to use sbert now! |
Beta Was this translation helpful? Give feedback.
-
|
Unfortunately, I'm still getting the same error: "ImportError: Install sentence-transformers package to use Sentence BERT." even though they are installed. |
Beta Was this translation helpful? Give feedback.
-
|
Well I'm at a loss. This might be something environment related, or maybe administration access rights. @J535D165, do you have an idea? In the mean time, I'm out of simple things to try, but if you're up for it, we can try some more difficult things:
python -m pip install asreview sentence-transformers tf-kerasThen, with the environment active (check if the terminal starts with (env) or something close), run
pip uninstall sentence-transformers
pip install sentence-transformers
from sentence_transformers import SentenceTransformer
model = SentenceTransformer('all-MiniLM-L6-v2')
print("Sentence Transformers is working!")If this fails, then the issue may be with how the package is installed.
where python
where pip |
Beta Was this translation helpful? Give feedback.
-
|
Thanks, I'll give that a try. I don't have administrator rights on the device that I'm using, so, as you say, maybe it's related to that. |
Beta Was this translation helpful? Give feedback.
-
|
I created a virtual environment as you suggested @jteijema, and it's working now. Thanks a million. |
Beta Was this translation helpful? Give feedback.
-
|
Nice! That's good to hear. I think something is up with your regular installation then. Virtual environments are the preferred way to set up python anyway ;). Remember that to run asreview in the future, you will need to activate the environment again. I'm glad it's working. Happy screening! |
Beta Was this translation helpful? Give feedback.
-
|
I too have trouble installing? and using SBert. I used: Python -m pip install asreview[sentence_transformers] to intall it. And that seemed to have been succesfull. However, I get an error message no matter what other classifer and so on I pick in asreview lab. I guess it states I haven't yet installed the package. I tried: python -m pip install sentence-transformers tf-keras, or with capitol P for python, but that just errors. Also tried asreview[all], but same issues. Seems to install a bunch, but cannot utilize SBert in ASReview lab. |
Beta Was this translation helpful? Give feedback.
-
|
Can you copy the error message so that we can take a look at it? |
Beta Was this translation helpful? Give feedback.
-
|
Traceback (most recent call last): During handling of the above exception, another exception occurred: Traceback (most recent call last): |
Beta Was this translation helpful? Give feedback.
-
|
And this is what I get when again using: Python -m pip install asreview[sentence_transformers] C:\Users\riann>Python -m pip install asreview[sentence_transformers] C:\Users\riann> Considering the warming, should I upgrade to the 1.6.3 version first? |
Beta Was this translation helpful? Give feedback.
-
|
Sbert indeed requires the python package To check if it is correctly installed, use |
Beta Was this translation helpful? Give feedback.
-
|
This is what I get when using pip freeze C:\Users\riann>pip freeze Does that mean sBert is installed correctly? It's gibberisch to me... (happy to see I have a waitress in there though...) |
Beta Was this translation helpful? Give feedback.
-
|
Also, I upgraded to asreview1.6.3, and tried installing sBert again. I still get this message: WARNING: asreview 1.6.3 does not provide the extra 'sentence-transformers'. |
Beta Was this translation helpful? Give feedback.
-
|
Hi! Did you use In any case, would you try to run |
Beta Was this translation helpful? Give feedback.
-
|
Tried it. It says that some requirements are already satified, but then it says: Installing collected packages: transformers, sentence-transformers |
Beta Was this translation helpful? Give feedback.
-
|
Ah, but that's good! That's a step in the right direction ;). Windows is complaining that the path is too long. It's a restriction in Windows unrelated to ASReview. Microsoft has documentation on how to solve the issue: https://learn.microsoft.com/en-us/windows/win32/fileio/maximum-file-path-limitation?tabs=powershell#enable-long-paths-in-windows-10-version-1607-and-later Basically, the solution is to open powershell: and run Then try installing again. 👍🏻 Note that you might need administrator rights for this. If you do not have access to those, we can try the environment solution I proposed earlier (#1841 (reply in thread)) |
Beta Was this translation helpful? Give feedback.
-
|
@jteijema: Yes, it worked! I succesfully installed sentence-transformer. Now I will check to see if I can use sBert in ASReview Lab... |
Beta Was this translation helpful? Give feedback.
-
|
Hi! I ran into the same issue as written above. Traceback (most recent call last): During handling of the above exception, another exception occurred: Traceback (most recent call last): |
Beta Was this translation helpful? Give feedback.
-
|
At the end of your output you received this warning: Did you install sentence transformers with |
Beta Was this translation helpful? Give feedback.
-
|
Hi Rens, yes I used that command! |
Beta Was this translation helpful? Give feedback.
-
|
Hi! Are you still having this issue @FloK63? If so, could you run the command |
Beta Was this translation helpful? Give feedback.
-
|
@jteijema and @Rensvandeschoot I came here because of the same issue as the topicstarter in #1841. I encountered these errors on two different office devices on which I've used ASReview before, so I just tried everything again on a fresh personal computer. Unfortunately, no luck yet. Both One of the suggested fixes is to run I tried your first solution: I then tried the next solution: creating a virtual environment (see your comment of 18 sept). After activating and rerunning
pip 24.3.1
Any idea how to fix this? |
Beta Was this translation helpful? Give feedback.
-
|
Hi @Woensvriend, I tried installing on Python 3.11.11 and 3.12.8 using |
Beta Was this translation helpful? Give feedback.
Well I'm at a loss. This might be something environment related, or maybe administration access rights. @J535D165, do you have an idea?
In the mean time, I'm out of simple things to try, but if you're up for it, we can try some more difficult things:
python -m venv env. A virtual environment is a portable python installation. It will be totally independent from your other python installation. If you activate it in the terminal, everything will be run from this portable installation.Activate it: