Machine Learning function not working #13653

NWPU-ZYKerman · 2024-10-21T16:23:02Z

NWPU-ZYKerman
Oct 21, 2024

Hi everyone,
I recently performed a fresh install via docker compose on Ubuntu. Most of the things work fine, except for the machine learning function. It seems that it is not working at all. The count of the photos to be processed remains unchanged forever every time I hit the button to start processing. Here is my docker compose file:

#
# WARNING: Make sure to use the docker-compose.yml of the current release:
#
# https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml
#
# The compose file on main may not be compatible with the latest release.
#

name: immich

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    # extends:
    #   file: hwaccel.transcoding.yml
    #   service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding
    volumes:
      # Do not edit the next line. If you want to change the media storage location on your system, edit the value of UPLOAD_LOCATION in the .env file
      - "${UPLOAD_LOCATION}:/usr/src/app/upload"
      - /etc/localtime:/etc/localtime:ro
      - "/mnt/Data/TANK/Immich Main Library:/app/main-library"
      - "/mnt/Applications/Apps/immich-1/thumbs:/app/thumbnails"
      - "/mnt/Data/AppData/Immich/video:/app/video-folder"
      - "/mnt/Applications/Apps/immich-1/profile:/app/profile"
      - "/mnt/Data/TANK/Creative Work/Photography/Exported:/mnt/photography"
      - "/mnt/Data/TANK/Creative Work/Photography/RAW+Project File:/mnt/raw"
      - "/mnt/Data/TANK/Data/Memories/影像资料:/mnt/archieve"
    env_file:
      - .env
    ports:
      - '30020:2283'
    depends_on:
      - redis
      - database
    restart: always
    healthcheck:
      disable: false

  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration
    #   file: hwaccel.ml.yml
    #   service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always
    healthcheck:
      disable: false

  redis:
    container_name: immich_redis
    image: docker.io/redis:6.2-alpine@sha256:2ba50e1ac3a0ea17b736ce9db2b0a9f6f8b85d4c27d5f5accc6a416d8f42c6d5
    healthcheck:
      test: redis-cli ping || exit 1
    restart: always

  database:
    container_name: immich_postgres
    image: docker.io/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
      POSTGRES_INITDB_ARGS: '--data-checksums'
    volumes:
      # Do not edit the next line. If you want to change the database storage location on your system, edit the value of DB_DATA_LOCATION in the .env file
      - ${DB_DATA_LOCATION}:/var/lib/postgresql/data
    healthcheck:
      test: pg_isready --dbname='${DB_DATABASE_NAME}' --username='${DB_USERNAME}' || exit 1; Chksum="$$(psql --dbname='${DB_DATABASE_NAME}' --username='${DB_USERNAME}' --tuples-only --no-align --command='SELECT COALESCE(SUM(checksum_failures), 0) FROM pg_stat_database')"; echo "checksum failure count is $$Chksum"; [ "$$Chksum" = '0' ] || exit 1
      interval: 5m
      start_interval: 30s
      start_period: 5m
    command:
      [
        'postgres',
        '-c',
        'shared_preload_libraries=vectors.so',
        '-c',
        'search_path="$$user", public, vectors',
        '-c',
        'logging_collector=on',
        '-c',
        'max_wal_size=2GB',
        '-c',
        'shared_buffers=512MB',
        '-c',
        'wal_compression=on',
      ]
    restart: always

  backup:
    container_name: immich_db_dumper
    image: prodrigestivill/postgres-backup-local:14
    restart: always
    env_file:
      - .env
    environment:
      POSTGRES_HOST: database
      POSTGRES_CLUSTER: 'TRUE'
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_DB: ${DB_DATABASE_NAME}
      SCHEDULE: "@daily"
      POSTGRES_EXTRA_OPTS: '--clean --if-exists'
      BACKUP_DIR: /db_dumps
    volumes:
      - /mnt/Applications/Apps/immich-1/pgBackup:/db_dumps
    depends_on:
      - database

volumes:
  model-cache:

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=/mnt/Data/AppData/Immich/uploads
# The location where your database files are stored
DB_DATA_LOCATION=/mnt/Applications/Apps/immich-1/pgData

# To set a timezone, uncomment the next line and change Etc/UTC to a TZ identifier from this list: https://en.wikipedia.org/wiki/List_of_tz_database_time_zones#List
TZ=Asia/Chongqing

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
# Please use only the characters `A-Za-z0-9`, without special characters or spaces
DB_PASSWORD=*************

# The values below this line do not need to be changed
###################################################################################
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

I tried docker exec -it immich_server ping http://immich-machine-learning in the host's shell and it tells me that ping: http://immich-machine-learning: Name or service not known . In the administration panel, the URL for machine is

so it might be an issue with the docker internal network...? I'm not sure. @mertalev

Answered by NWPU-ZYKerman

Oct 23, 2024

The intelligent search is now functioning again. I know of a Huggingface mirror acceleration website. I asked GitHub Copilot how to apply it to a container, and it told me to add the following to the docker-compose.yml file:

environment:
  - HUGGINGFACE_MIRROR=https://mirror-site-url

This worked, and now Immich has successfully downloaded the model and is operating normally.

View full answer

tbelway · 2024-10-22T14:12:31Z

tbelway
Oct 22, 2024

Hey there,

Some problems with the information provided:

No logs. We can't really help you without logs.
You can't ping the http protocol. You would have to ping immich-machine-learning not http://immich-machine-learning
You haven't disclosed what you are using for the system running immich. Is it linux (debian based? redhat? arch?), freebsd, mac, windows (wsl or otherwise)?

0 replies

NWPU-ZYKerman · 2024-10-22T14:37:14Z

NWPU-ZYKerman
Oct 22, 2024
Author

I'm running on Ubuntu 24.04 LTS. Log here:

[10/21/24 21:21:29] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 21:21:29] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 21:21:29] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 21:23:44] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 21:23:44] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 21:23:44] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 21:25:59] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 21:25:59] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 21:25:59] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 21:28:14] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 21:28:14] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 21:28:14] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 21:30:29] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 21:30:29] ERROR    Exception in ASGI application                      
                                                                                
                             ╭─────── Traceback (most recent call last) ───────╮
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ connection.py:203 in _new_conn                  │
                             │                                                 │
                             │   200 │   │   :return: New socket connection.   │
                             │   201 │   │   """                               │
                             │   202 │   │   try:                              │
                             │ ❱ 203 │   │   │   sock = connection.create_conn │
                             │   204 │   │   │   │   (self._dns_host, self.por │
                             │   205 │   │   │   │   self.timeout,             │
                             │   206 │   │   │   │   source_address=self.sourc │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ util/connection.py:85 in create_connection      │
                             │                                                 │
                             │    82 │                                         │
                             │    83 │   if err is not None:                   │
                             │    84 │   │   try:                              │
                             │ ❱  85 │   │   │   raise err                     │
                             │    86 │   │   finally:                          │
                             │    87 │   │   │   # Break explicitly a referenc │
                             │    88 │   │   │   err = None                    │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ util/connection.py:73 in create_connection      │
                             │                                                 │
                             │    70 │   │   │   │   sock.settimeout(timeout)  │
                             │    71 │   │   │   if source_address:            │
                             │    72 │   │   │   │   sock.bind(source_address) │
                             │ ❱  73 │   │   │   sock.connect(sa)              │
                             │    74 │   │   │   # Break explicitly a referenc │
                             │    75 │   │   │   err = None                    │
                             │    76 │   │   │   return sock                   │
                             ╰─────────────────────────────────────────────────╯
                             OSError: [Errno 101] Network is unreachable        
                                                                                
                             The above exception was the direct cause of the    
                             following exception:                               
                                                                                
                             ╭─────── Traceback (most recent call last) ───────╮
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ connectionpool.py:790 in urlopen                │
                             │                                                 │
                             │    787 │   │   │   response_conn = conn if not  │
                             │    788 │   │   │                                │
                             │    789 │   │   │   # Make the request on the HT │
                             │ ❱  790 │   │   │   response = self._make_reques │
                             │    791 │   │   │   │   conn,                    │
                             │    792 │   │   │   │   method,                  │
                             │    793 │   │   │   │   url,                     │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ connectionpool.py:491 in _make_request          │
                             │                                                 │
                             │    488 │   │   │   │   new_e, (OSError, NewConn │
                             │    489 │   │   │   ) and (conn and conn.proxy a │
                             │    490 │   │   │   │   new_e = _wrap_proxy_erro │
                             │ ❱  491 │   │   │   raise new_e                  │
                             │    492 │   │                                    │
                             │    493 │   │   # conn.request() calls http.clie │
                             │    494 │   │   # urllib3.request. It also calls │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ connectionpool.py:467 in _make_request          │
                             │                                                 │
                             │    464 │   │   try:                             │
                             │    465 │   │   │   # Trigger any extra validati │
                             │    466 │   │   │   try:                         │
                             │ ❱  467 │   │   │   │   self._validate_conn(conn │
                             │    468 │   │   │   except (SocketTimeout, BaseS │
                             │    469 │   │   │   │   self._raise_timeout(err= │
                             │    470 │   │   │   │   raise                    │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ connectionpool.py:1096 in _validate_conn        │
                             │                                                 │
                             │   1093 │   │                                    │
                             │   1094 │   │   # Force connect early to allow u │
                             │   1095 │   │   if conn.is_closed:               │
                             │ ❱ 1096 │   │   │   conn.connect()               │
                             │   1097 │   │                                    │
                             │   1098 │   │   if not conn.is_verified:         │
                             │   1099 │   │   │   warnings.warn(               │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ connection.py:611 in connect                    │
                             │                                                 │
                             │   608 │                                         │
                             │   609 │   def connect(self) -> None:            │
                             │   610 │   │   sock: socket.socket | ssl.SSLSock │
                             │ ❱ 611 │   │   self.sock = sock = self._new_conn │
                             │   612 │   │   server_hostname: str = self.host  │
                             │   613 │   │   tls_in_tls = False                │
                             │   614                                           │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ connection.py:218 in _new_conn                  │
                             │                                                 │
                             │   215 │   │   │   ) from e                      │
                             │   216 │   │                                     │
                             │   217 │   │   except OSError as e:              │
                             │ ❱ 218 │   │   │   raise NewConnectionError(     │
                             │   219 │   │   │   │   self, f"Failed to establi │
                             │   220 │   │   │   ) from e                      │
                             │   221                                           │
                             ╰─────────────────────────────────────────────────╯
                             NewConnectionError:                                
                             <urllib3.connection.HTTPSConnection object at      
                             0x7c1905991610>: Failed to establish a new         
                             connection: [Errno 101] Network is unreachable     
                                                                                
                             The above exception was the direct cause of the    
                             following exception:                               
                                                                                
                             ╭─────── Traceback (most recent call last) ───────╮
                             │ /opt/venv/lib/python3.11/site-packages/requests │
                             │ /adapters.py:667 in send                        │
                             │                                                 │
                             │   664 │   │   │   timeout = TimeoutSauce(connec │
                             │   665 │   │                                     │
                             │   666 │   │   try:                              │
                             │ ❱ 667 │   │   │   resp = conn.urlopen(          │
                             │   668 │   │   │   │   method=request.method,    │
                             │   669 │   │   │   │   url=url,                  │
                             │   670 │   │   │   │   body=request.body,        │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ connectionpool.py:844 in urlopen                │
                             │                                                 │
                             │    841 │   │   │   elif isinstance(new_e, (OSEr │
                             │    842 │   │   │   │   new_e = ProtocolError("C │
                             │    843 │   │   │                                │
                             │ ❱  844 │   │   │   retries = retries.increment( │
                             │    845 │   │   │   │   method, url, error=new_e │
                             │    846 │   │   │   )                            │
                             │    847 │   │   │   retries.sleep()              │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/urllib3/ │
                             │ util/retry.py:515 in increment                  │
                             │                                                 │
                             │   512 │   │                                     │
                             │   513 │   │   if new_retry.is_exhausted():      │
                             │   514 │   │   │   reason = error or ResponseErr │
                             │ ❱ 515 │   │   │   raise MaxRetryError(_pool, ur │
                             │       ignore[arg-type]                          │
                             │   516 │   │                                     │
                             │   517 │   │   log.debug("Incremented Retry for  │
                             │   518                                           │
                             ╰─────────────────────────────────────────────────╯
                             MaxRetryError:                                     
                             HTTPSConnectionPool(host='huggingface.co',         
                             port=443): Max retries exceeded with url:          
                             /api/models/immich-app/XLM-Roberta-Large-Vit-B-16Pl
                             us/revision/main (Caused by                        
                             NewConnectionError('<urllib3.connection.HTTPSConnec
                             tion object at 0x7c1905991610>: Failed to establish
                             a new connection: [Errno 101] Network is           
                             unreachable'))                                     
                                                                                
                             During handling of the above exception, another    
                             exception occurred:                                
                                                                                
                             ╭─────── Traceback (most recent call last) ───────╮
                             │ /opt/venv/lib/python3.11/site-packages/huggingf │
                             │ ace_hub/_snapshot_download.py:155 in            │
                             │ snapshot_download                               │
                             │                                                 │
                             │   152 │   │   │   │   endpoint=endpoint,        │
                             │   153 │   │   │   │   headers=headers,          │
                             │   154 │   │   │   )                             │
                             │ ❱ 155 │   │   │   repo_info = api.repo_info(rep │
                             │       revision=revision, token=token)           │
                             │   156 │   │   except (requests.exceptions.SSLEr │
                             │   157 │   │   │   # Actually raise for those su │
                             │   158 │   │   │   raise                         │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/huggingf │
                             │ ace_hub/utils/_validators.py:114 in _inner_fn   │
                             │                                                 │
                             │   111 │   │   if check_use_auth_token:          │
                             │   112 │   │   │   kwargs = smoothly_deprecate_u │
                             │       has_token=has_token, kwargs=kwargs)       │
                             │   113 │   │                                     │
                             │ ❱ 114 │   │   return fn(*args, **kwargs)        │
                             │   115 │                                         │
                             │   116 │   return _inner_fn  # type: ignore      │
                             │   117                                           │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/huggingf │
                             │ ace_hub/hf_api.py:2682 in repo_info             │
                             │                                                 │
                             │   2679 │   │   │   method = self.space_info  #  │
                             │   2680 │   │   else:                            │
                             │   2681 │   │   │   raise ValueError("Unsupporte │
                             │ ❱ 2682 │   │   return method(                   │
                             │   2683 │   │   │   repo_id,                     │
                             │   2684 │   │   │   revision=revision,           │
                             │   2685 │   │   │   token=token,                 │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/huggingf │
                             │ ace_hub/utils/_validators.py:114 in _inner_fn   │
                             │                                                 │
                             │   111 │   │   if check_use_auth_token:          │
                             │   112 │   │   │   kwargs = smoothly_deprecate_u │
                             │       has_token=has_token, kwargs=kwargs)       │
                             │   113 │   │                                     │
                             │ ❱ 114 │   │   return fn(*args, **kwargs)        │
                             │   115 │                                         │
                             │   116 │   return _inner_fn  # type: ignore      │
                             │   117                                           │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/huggingf │
                             │ ace_hub/hf_api.py:2466 in model_info            │
                             │                                                 │
                             │   2463 │   │   │   params["blobs"] = True       │
                             │   2464 │   │   if expand:                       │
                             │   2465 │   │   │   params["expand"] = expand    │
                             │ ❱ 2466 │   │   r = get_session().get(path, head │
                             │   2467 │   │   hf_raise_for_status(r)           │
                             │   2468 │   │   data = r.json()                  │
                             │   2469 │   │   return ModelInfo(**data)         │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/requests │
                             │ /sessions.py:602 in get                         │
                             │                                                 │
                             │   599 │   │   """                               │
                             │   600 │   │                                     │
                             │   601 │   │   kwargs.setdefault("allow_redirect │
                             │ ❱ 602 │   │   return self.request("GET", url, * │
                             │   603 │                                         │
                             │   604 │   def options(self, url, **kwargs):     │
                             │   605 │   │   r"""Sends a OPTIONS request. Retu │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/requests │
                             │ /sessions.py:589 in request                     │
                             │                                                 │
                             │   586 │   │   │   "allow_redirects": allow_redi │
                             │   587 │   │   }                                 │
                             │   588 │   │   send_kwargs.update(settings)      │
                             │ ❱ 589 │   │   resp = self.send(prep, **send_kwa │
                             │   590 │   │                                     │
                             │   591 │   │   return resp                       │
                             │   592                                           │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/requests │
                             │ /sessions.py:703 in send                        │
                             │                                                 │
                             │   700 │   │   start = preferred_clock()         │
                             │   701 │   │                                     │
                             │   702 │   │   # Send the request                │
                             │ ❱ 703 │   │   r = adapter.send(request, **kwarg │
                             │   704 │   │                                     │
                             │   705 │   │   # Total elapsed time of the reque │
                             │   706 │   │   elapsed = preferred_clock() - sta │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/huggingf │
                             │ ace_hub/utils/_http.py:93 in send               │
                             │                                                 │
                             │    90 │   def send(self, request: PreparedReque │
                             │    91 │   │   """Catch any RequestException to  │
                             │       debugging."""                             │
                             │    92 │   │   try:                              │
                             │ ❱  93 │   │   │   return super().send(request,  │
                             │    94 │   │   except requests.RequestException  │
                             │    95 │   │   │   request_id = request.headers. │
                             │    96 │   │   │   if request_id is not None:    │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/requests │
                             │ /adapters.py:700 in send                        │
                             │                                                 │
                             │   697 │   │   │   │   # This branch is for urll │
                             │   698 │   │   │   │   raise SSLError(e, request │
                             │   699 │   │   │                                 │
                             │ ❱ 700 │   │   │   raise ConnectionError(e, requ │
                             │   701 │   │                                     │
                             │   702 │   │   except ClosedPoolError as e:      │
                             │   703 │   │   │   raise ConnectionError(e, requ │
                             ╰─────────────────────────────────────────────────╯
                             ConnectionError:                                   
                             (MaxRetryError("HTTPSConnectionPool(host='huggingfa
                             ce.co', port=443): Max retries exceeded with url:  
                             /api/models/immich-app/XLM-Roberta-Large-Vit-B-16Pl
                             us/revision/main (Caused by                        
                             NewConnectionError('<urllib3.connection.HTTPSConnec
                             tion object at 0x7c1905991610>: Failed to establish
                             a new connection: [Errno 101] Network is           
                             unreachable'))"), '(Request ID:                    
                             43d7e1bd-af98-4013-bc9b-e59aede43015)')            
                                                                                
                             The above exception was the direct cause of the    
                             following exception:                               
                                                                                
                             ╭─────── Traceback (most recent call last) ───────╮
                             │ /usr/src/app/main.py:150 in predict             │
                             │                                                 │
                             │   147 │   │   inputs = text                     │
                             │   148 │   else:                                 │
                             │   149 │   │   raise HTTPException(400, "Either  │
                             │ ❱ 150 │   response = await run_inference(inputs │
                             │   151 │   return ORJSONResponse(response)       │
                             │   152                                           │
                             │   153                                           │
                             │                                                 │
                             │ /usr/src/app/main.py:173 in run_inference       │
                             │                                                 │
                             │   170 │   │   response[entry["task"]] = output  │
                             │   171 │                                         │
                             │   172 │   without_deps, with_deps = entries     │
                             │ ❱ 173 │   await asyncio.gather(*[_run_inference │
                             │   174 │   if with_deps:                         │
                             │   175 │   │   await asyncio.gather(*[_run_infer │
                             │   176 │   if isinstance(payload, Image):        │
                             │                                                 │
                             │ /usr/src/app/main.py:167 in _run_inference      │
                             │                                                 │
                             │   164 │   │   │   except KeyError:              │
                             │   165 │   │   │   │   message = f"Task {entry[' │
                             │       output of {dep}"                          │
                             │   166 │   │   │   │   raise HTTPException(400,  │
                             │ ❱ 167 │   │   model = await load(model)         │
                             │   168 │   │   output = await run(model.predict, │
                             │   169 │   │   outputs[model.identity] = output  │
                             │   170 │   │   response[entry["task"]] = output  │
                             │                                                 │
                             │ /usr/src/app/main.py:215 in load                │
                             │                                                 │
                             │   212 │   except (OSError, InvalidProtobuf, Bad │
                             │   213 │   │   log.warning(f"Failed to load {mod │
                             │       '{model.model_name}'. Clearing cache.")   │
                             │   214 │   │   model.clear_cache()               │
                             │ ❱ 215 │   │   return await run(_load, model)    │
                             │   216                                           │
                             │   217                                           │
                             │   218 async def idle_shutdown_task() -> None:   │
                             │                                                 │
                             │ /usr/local/lib/python3.11/concurrent/futures/th │
                             │ read.py:58 in run                               │
                             │                                                 │
                             │ /usr/src/app/main.py:201 in _load               │
                             │                                                 │
                             │   198 │   │   │   │   model.load()              │
                             │   199 │   │   │   except FileNotFoundError as e │
                             │   200 │   │   │   │   if model.model_format ==  │
                             │ ❱ 201 │   │   │   │   │   raise e               │
                             │   202 │   │   │   │   log.exception(e)          │
                             │   203 │   │   │   │   log.warning(              │
                             │   204 │   │   │   │   │   f"{model.model_format │
                             │       '{model.model_name}' does not support it. │
                             │                                                 │
                             │ /usr/src/app/main.py:198 in _load               │
                             │                                                 │
                             │   195 │   │   │   raise HTTPException(500, f"Fa │
                             │   196 │   │   with lock:                        │
                             │   197 │   │   │   try:                          │
                             │ ❱ 198 │   │   │   │   model.load()              │
                             │   199 │   │   │   except FileNotFoundError as e │
                             │   200 │   │   │   │   if model.model_format ==  │
                             │   201 │   │   │   │   │   raise e               │
                             │                                                 │
                             │ /usr/src/app/models/base.py:50 in load          │
                             │                                                 │
                             │    47 │   │   │   return                        │
                             │    48 │   │   self.load_attempts += 1           │
                             │    49 │   │                                     │
                             │ ❱  50 │   │   self.download()                   │
                             │    51 │   │   attempt = f"Attempt #{self.load_a │
                             │       else "Loading"                            │
                             │    52 │   │   log.info(f"{attempt} {self.model_ │
                             │       '{self.model_name}' to memory")           │
                             │    53 │   │   self.session = self._load()       │
                             │                                                 │
                             │ /usr/src/app/models/base.py:43 in download      │
                             │                                                 │
                             │    40 │   │   │   log.info(                     │
                             │    41 │   │   │   │   f"Downloading {self.model │
                             │       '{self.model_name}'. This may take a whil │
                             │    42 │   │   │   )                             │
                             │ ❱  43 │   │   │   self._download()              │
                             │    44 │                                         │
                             │    45 │   def load(self) -> None:               │
                             │    46 │   │   if self.loaded:                   │
                             │                                                 │
                             │ /usr/src/app/models/base.py:70 in _download     │
                             │                                                 │
                             │    67 │                                         │
                             │    68 │   def _download(self) -> None:          │
                             │    69 │   │   ignore_patterns = [] if self.mode │
                             │ ❱  70 │   │   snapshot_download(                │
                             │    71 │   │   │   f"immich-app/{clean_name(self │
                             │    72 │   │   │   cache_dir=self.cache_dir,     │
                             │    73 │   │   │   local_dir=self.cache_dir,     │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/huggingf │
                             │ ace_hub/utils/_validators.py:114 in _inner_fn   │
                             │                                                 │
                             │   111 │   │   if check_use_auth_token:          │
                             │   112 │   │   │   kwargs = smoothly_deprecate_u │
                             │       has_token=has_token, kwargs=kwargs)       │
                             │   113 │   │                                     │
                             │ ❱ 114 │   │   return fn(*args, **kwargs)        │
                             │   115 │                                         │
                             │   116 │   return _inner_fn  # type: ignore      │
                             │   117                                           │
                             │                                                 │
                             │ /opt/venv/lib/python3.11/site-packages/huggingf │
                             │ ace_hub/_snapshot_download.py:235 in            │
                             │ snapshot_download                               │
                             │                                                 │
                             │   232 │   │   │   raise api_call_error          │
                             │   233 │   │   else:                             │
                             │   234 │   │   │   # Otherwise: most likely a co │
                             │       the user                                  │
                             │ ❱ 235 │   │   │   raise LocalEntryNotFoundError │
                             │   236 │   │   │   │   "An error happened while  │
                             │       cannot find the appropriate"              │
                             │   237 │   │   │   │   " snapshot folder for the │
                             │       check your internet connection"           │
                             │   238 │   │   │   │   " and try again."         │
                             ╰─────────────────────────────────────────────────╯
                             LocalEntryNotFoundError: An error happened while   
                             trying to locate the files on the Hub and we cannot
                             find the appropriate snapshot folder for the       
                             specified revision on the local disk. Please check 
                             your internet connection and try again.            
[10/21/24 21:32:44] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 21:32:44] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 21:32:44] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 21:35:00] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 21:35:00] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 21:35:01] INFO     Shutting down due to inactivity.                   
[10/21/24 21:35:02] INFO     Shutting down                                      
[10/21/24 21:35:02] INFO     Waiting for application shutdown.                  
[10/21/24 21:35:02] INFO     Application shutdown complete.                     
[10/21/24 21:35:02] INFO     Finished server process [4079]                     
[10/21/24 21:35:02] ERROR    Worker (pid:4079) was sent SIGINT!                 
[10/21/24 21:35:02] INFO     Booting worker with pid: 5719                      
[10/21/24 21:35:05] INFO     Started server process [5719]                      
[10/21/24 21:35:05] INFO     Waiting for application startup.                   
[10/21/24 21:35:05] INFO     Created in-memory cache with unloading after 300s  
                             of inactivity.                                     
[10/21/24 21:35:05] INFO     Initialized request thread pool with 4 threads.    
[10/21/24 21:35:05] INFO     Application startup complete.                      
[10/21/24 21:43:01] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 21:45:14] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 21:45:14] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 21:45:14] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 21:47:29] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 21:47:29] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 21:47:29] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 21:49:11] INFO     Starting gunicorn 23.0.0                           
[10/21/24 21:49:11] INFO     Listening at: http://[::]:3003 (8)                 
[10/21/24 21:49:11] INFO     Using worker: app.config.CustomUvicornWorker       
[10/21/24 21:49:11] INFO     Booting worker with pid: 9                         
[10/21/24 21:49:16] INFO     Started server process [9]                         
[10/21/24 21:49:16] INFO     Waiting for application startup.                   
[10/21/24 21:49:16] INFO     Created in-memory cache with unloading after 300s  
                             of inactivity.                                     
[10/21/24 21:49:16] INFO     Initialized request thread pool with 4 threads.    
[10/21/24 21:49:16] INFO     Application startup complete.                      
[10/21/24 21:54:04] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 21:56:19] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 21:56:19] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 21:56:19] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 21:58:34] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 21:58:34] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 21:58:34] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:00:49] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:00:49] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:00:49] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:03:04] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:03:04] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:03:04] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:05:20] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:05:20] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:05:20] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:07:35] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:07:35] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:07:35] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:09:50] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:09:50] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:09:50] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:12:05] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:12:05] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:12:05] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:14:20] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:14:20] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:14:20] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:16:35] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:16:35] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:16:35] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:18:51] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:18:51] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:18:51] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:21:06] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:21:06] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:21:06] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:23:21] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:23:21] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:23:21] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:25:36] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:25:36] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:25:36] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:27:51] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:27:51] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:27:51] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:30:06] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:30:06] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:30:06] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:32:22] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:32:22] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:32:22] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:32:22] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:32:22] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:32:22] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:32:22] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:32:22] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:32:22] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:32:22] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:32:22] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:32:22] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:32:22] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:32:22] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:32:22] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:32:22] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:32:22] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:32:22] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:32:23] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:32:23] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:32:23] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:32:23] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:32:23] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:32:23] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:32:23] INFO     Downloading detection model 'buffalo_l'. This may  
                             take a while.                                      
[10/21/24 22:32:23] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:32:23] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:32:23] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/21/24 22:32:23] WARNING  Failed to load detection model 'buffalo_l'.        
                             Clearing cache.                                    
[10/21/24 22:32:23] WARNING  Attempted to clear cache for model 'buffalo_l', but
                             cache directory does not exist                     
[10/21/24 22:32:23] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/21/24 22:32:23] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/21/24 22:50:06] INFO     Shutting down due to inactivity.                   
[10/21/24 22:50:06] INFO     Shutting down                                      
[10/21/24 22:50:06] INFO     Waiting for application shutdown.                  
[10/21/24 22:50:06] INFO     Application shutdown complete.                     
[10/21/24 22:50:06] INFO     Finished server process [9]                        
[10/21/24 22:50:06] ERROR    Worker (pid:9) was sent SIGINT!                    
[10/21/24 22:50:06] INFO     Booting worker with pid: 900                       
[10/21/24 22:50:10] INFO     Started server process [900]                       
[10/21/24 22:50:10] INFO     Waiting for application startup.                   
[10/21/24 22:50:10] INFO     Created in-memory cache with unloading after 300s  
                             of inactivity.                                     
[10/21/24 22:50:10] INFO     Initialized request thread pool with 4 threads.    
[10/21/24 22:50:10] INFO     Application startup complete.                      
[10/22/24 08:35:12] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/22/24 08:37:29] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/22/24 08:37:29] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/22/24 08:37:29] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/22/24 08:39:44] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/22/24 08:39:44] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/22/24 08:39:44] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/22/24 08:41:59] INFO     Downloading visual model                           
                             'XLM-Roberta-Large-Vit-B-16Plus'. This may take a  
                             while.                                             
[10/22/24 08:41:59] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/22/24 08:41:59] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/22/24 08:44:14] WARNING  Failed to load visual model                        
                             'XLM-Roberta-Large-Vit-B-16Plus'. Clearing cache.  
[10/22/24 08:44:14] WARNING  Attempted to clear cache for model                 
                             'XLM-Roberta-Large-Vit-B-16Plus', but cache        
                             directory does not exist                           
[10/22/24 08:47:31] INFO     Shutting down due to inactivity.                   
[10/22/24 08:47:31] INFO     Shutting down                                      
[10/22/24 08:47:31] INFO     Waiting for application shutdown.                  
[10/22/24 08:47:31] INFO     Application shutdown complete.                     
[10/22/24 08:47:31] INFO     Finished server process [900]                      
[10/22/24 08:47:31] ERROR    Worker (pid:900) was sent SIGINT!                  
[10/22/24 08:47:31] INFO     Booting worker with pid: 8972                      
[10/22/24 08:47:35] INFO     Started server process [8972]                      
[10/22/24 08:47:35] INFO     Waiting for application startup.                   
[10/22/24 08:47:35] INFO     Created in-memory cache with unloading after 300s  
                             of inactivity.                                     
[10/22/24 08:47:35] INFO     Initialized request thread pool with 4 threads.    
[10/22/24 08:47:35] INFO     Application startup complete.                      
[10/22/24 22:26:02] INFO     Starting gunicorn 23.0.0                           
[10/22/24 22:26:02] INFO     Listening at: http://[::]:3003 (9)                 
[10/22/24 22:26:02] INFO     Using worker: app.config.CustomUvicornWorker       
[10/22/24 22:26:02] INFO     Booting worker with pid: 10                        
[10/22/24 22:26:08] INFO     Started server process [10]                        
[10/22/24 22:26:08] INFO     Waiting for application startup.                   
[10/22/24 22:26:08] INFO     Created in-memory cache with unloading after 300s  
                             of inactivity.                                     
[10/22/24 22:26:08] INFO     Initialized request thread pool with 4 threads.    
[10/22/24 22:26:08] INFO     Application startup complete.

It seems that it is attempting to download the model all the time...? But I have followed the instructions here to download the model files already...
Note that this method worked perfectly for TrueNAS which was my system with Immich running by then. Now it refuses to work if I run the command directly in the shell with the following output

root@ZYL-ububtu:~# pip install huggingface_hub[cli]
export MODEL_NAME="XLM-Roberta-Large-Vit-B-16Plus"
huggingface-cli download immich-app/$MODEL_NAME --local-dir $MODEL_NAME --cache-dir $MODEL_NAME
docker cp $MODEL_NAME immich_machine_learning:/cache/clip
error: externally-managed-environment

× This environment is externally managed
╰─> To install Python packages system-wide, try apt install
    python3-xyz, where xyz is the package you are trying to
    install.
    
    If you wish to install a non-Debian-packaged Python package,
    create a virtual environment using python3 -m venv path/to/venv.
    Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
    sure you have python3-full installed.
    
    If you wish to install a non-Debian packaged Python application,
    it may be easiest to use pipx install xyz, which will manage a
    virtual environment for you. Make sure you have pipx installed.
    
    See /usr/share/doc/python3.12/README.venv for more information.

note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
hint: See PEP 668 for the detailed specification.
huggingface-cli：未找到命令
lstat /root/XLM-Roberta-Large-Vit-B-16Plus: no such file or directory

But Microsoft Copilot has taught me to add

python3 -m venv myenv
source myenv/bin/activate

before the prompts and it did worked the other day.

UPDATE: The method above seems to fail to work now due to poor network.

(myenv) root@ZYL-ububtu:~# pip install huggingface_hub[cli]
export MODEL_NAME="XLM-Roberta-Large-Vit-B-16Plus"
huggingface-cli download immich-app/$MODEL_NAME --local-dir $MODEL_NAME --cache-dir $MODEL_NAME
docker cp $MODEL_NAME immich_machine_learning:/cache/clip
Requirement already satisfied: huggingface_hub[cli] in ./myenv/lib/python3.12/site-packages (0.26.1)
Requirement already satisfied: filelock in ./myenv/lib/python3.12/site-packages (from huggingface_hub[cli]) (3.16.1)
Requirement already satisfied: fsspec>=2023.5.0 in ./myenv/lib/python3.12/site-packages (from huggingface_hub[cli]) (2024.10.0)
Requirement already satisfied: packaging>=20.9 in ./myenv/lib/python3.12/site-packages (from huggingface_hub[cli]) (24.1)
Requirement already satisfied: pyyaml>=5.1 in ./myenv/lib/python3.12/site-packages (from huggingface_hub[cli]) (6.0.2)
Requirement already satisfied: requests in ./myenv/lib/python3.12/site-packages (from huggingface_hub[cli]) (2.32.3)
Requirement already satisfied: tqdm>=4.42.1 in ./myenv/lib/python3.12/site-packages (from huggingface_hub[cli]) (4.66.5)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./myenv/lib/python3.12/site-packages (from huggingface_hub[cli]) (4.12.2)
Requirement already satisfied: InquirerPy==0.3.4 in ./myenv/lib/python3.12/site-packages (from huggingface_hub[cli]) (0.3.4)
Requirement already satisfied: pfzy<0.4.0,>=0.3.1 in ./myenv/lib/python3.12/site-packages (from InquirerPy==0.3.4->huggingface_hub[cli]) (0.3.4)
Requirement already satisfied: prompt-toolkit<4.0.0,>=3.0.1 in ./myenv/lib/python3.12/site-packages (from InquirerPy==0.3.4->huggingface_hub[cli]) (3.0.48)
Requirement already satisfied: charset-normalizer<4,>=2 in ./myenv/lib/python3.12/site-packages (from requests->huggingface_hub[cli]) (3.4.0)
Requirement already satisfied: idna<4,>=2.5 in ./myenv/lib/python3.12/site-packages (from requests->huggingface_hub[cli]) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./myenv/lib/python3.12/site-packages (from requests->huggingface_hub[cli]) (2.2.3)
Requirement already satisfied: certifi>=2017.4.17 in ./myenv/lib/python3.12/site-packages (from requests->huggingface_hub[cli]) (2024.8.30)
Requirement already satisfied: wcwidth in ./myenv/lib/python3.12/site-packages (from prompt-toolkit<4.0.0,>=3.0.1->InquirerPy==0.3.4->huggingface_hub[cli]) (0.2.13)
Traceback (most recent call last):
  File "/root/myenv/lib/python3.12/site-packages/urllib3/connection.py", line 199, in _new_conn
    sock = connection.create_connection(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
    raise err
  File "/root/myenv/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
    sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/root/myenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 789, in urlopen
    response = self._make_request(
               ^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 490, in _make_request
    raise new_e
  File "/root/myenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 466, in _make_request
    self._validate_conn(conn)
  File "/root/myenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1095, in _validate_conn
    conn.connect()
  File "/root/myenv/lib/python3.12/site-packages/urllib3/connection.py", line 693, in connect
    self.sock = sock = self._new_conn()
                       ^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/urllib3/connection.py", line 208, in _new_conn
    raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x7f5f92e7daf0>, 'Connection to huggingface.co timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/root/myenv/lib/python3.12/site-packages/requests/adapters.py", line 667, in send
    resp = conn.urlopen(
           ^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 843, in urlopen
    retries = retries.increment(
              ^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
    raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/immich-app/XLM-Roberta-Large-Vit-B-16Plus/revision/main (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7f5f92e7daf0>, 'Connection to huggingface.co timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/_snapshot_download.py", line 155, in snapshot_download
    repo_info = api.repo_info(repo_id=repo_id, repo_type=repo_type, revision=revision, token=token)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/hf_api.py", line 2748, in repo_info
    return method(
           ^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/hf_api.py", line 2532, in model_info
    r = get_session().get(path, headers=headers, timeout=timeout, params=params)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/utils/_http.py", line 93, in send
    return super().send(request, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/requests/adapters.py", line 688, in send
    raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/immich-app/XLM-Roberta-Large-Vit-B-16Plus/revision/main (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7f5f92e7daf0>, 'Connection to huggingface.co timed out. (connect timeout=None)'))"), '(Request ID: 57227b38-eaf3-4fc4-af8f-8064ce20425a)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/root/myenv/bin/huggingface-cli", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/commands/huggingface_cli.py", line 57, in main
    service.run()
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/commands/download.py", line 153, in run
    print(self._download())  # Print path to downloaded files
          ^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/commands/download.py", line 187, in _download
    return snapshot_download(
           ^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/root/myenv/lib/python3.12/site-packages/huggingface_hub/_snapshot_download.py", line 235, in snapshot_download
    raise LocalEntryNotFoundError(
huggingface_hub.errors.LocalEntryNotFoundError: An error happened while trying to locate the files on the Hub and we cannot find the appropriate snapshot folder for the specified revision on the local disk. Please check your internet connection and try again.
lstat /root/XLM-Roberta-Large-Vit-B-16Plus: no such file or directory

0 replies

NWPU-ZYKerman · 2024-10-23T05:04:30Z

NWPU-ZYKerman
Oct 23, 2024
Author

The intelligent search is now functioning again. I know of a Huggingface mirror acceleration website. I asked GitHub Copilot how to apply it to a container, and it told me to add the following to the docker-compose.yml file:

environment:
  - HUGGINGFACE_MIRROR=https://mirror-site-url

This worked, and now Immich has successfully downloaded the model and is operating normally.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Machine Learning function not working #13653

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 3 comments

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

Machine Learning function not working #13653

NWPU-ZYKerman Oct 21, 2024

Replies: 3 comments

tbelway Oct 22, 2024

NWPU-ZYKerman Oct 22, 2024 Author

NWPU-ZYKerman Oct 23, 2024 Author

NWPU-ZYKerman
Oct 21, 2024

tbelway
Oct 22, 2024

NWPU-ZYKerman
Oct 22, 2024
Author

NWPU-ZYKerman
Oct 23, 2024
Author