Search function returns an error
Every time I try to use any search function I get the error:
Please check your network connection, make sure the server is reachable and app/server versions are compatible.
Typesense container seems to be running without error, where should I continue looking?
7 Replies
Can you show the screenshot?
This happens if the machine learning container is down but ML features are enabled, from my experience.
Check if immich_machine_learning is running using
sudo docker ps
If yes, check the logs
sudo docker logs immich_machine_learning
And lastly, check the URL of the ML container on your web interface -> Admin area ->Machine learning.
By default, it should be http://immich-machine-learning:3003
The container is running, and the Url is set correctly. Here are the logs from the machine learning container
[10/05/23 00:04:11] INFO Starting gunicorn 21.2.0
[10/05/23 00:04:11] INFO Listening at: http://0.0.0.0:3003 (9)
[10/05/23 00:04:11] INFO Using worker: uvicorn.workers.UvicornWorker
[10/05/23 00:04:11] INFO Booting worker with pid: 10
[10/05/23 00:05:01] INFO Created in-memory cache with unloading disabled.
[10/05/23 00:05:01] INFO Initialized request thread pool with 2 threads.
[10/05/23 00:05:20] INFO Loading clip model 'ViT-B-32::openai'
[10/05/23 00:05:32] INFO Loading image classification model
'microsoft/resnet-50'
Could not find image processor class in the image processor config or the model config. Loading based on pattern matching with the model's feature extractor configuration. Could not find image processor class in the image processor config or the model config. Loading based on pattern matching with the model's feature extractor configuration. /opt/venv/lib/python3.11/site-packages/transformers/models/convnext/feature_extraction_convnext.py:28: FutureWarning: The class ConvNextFeatureExtractor is deprecated and will be removed in version 5 of Transformers. Please use ConvNextImageProcessor instead. warnings.warn( [10/05/23 00:05:34] INFO Loading facial recognition model 'buffalo_l' I'll paste the logs for typesense here also. E20231004 22:51:35.777837 6 backward.hpp:4199] #5 Object "/usr/lib/x86_64-linux-gnu/libc.so.6", at 0x7fb4129b6b42, in E20231004 22:51:35.777870 6 backward.hpp:4199] #4 Object "/opt/typesense-server", at 0x84d418, in bvar::detail::SamplerCollector::sampling_thread(void*) E20231004 22:51:35.777889 6 backward.hpp:4199] #3 Object "/opt/typesense-server", at 0x84b908, in bvar::detail::SamplerCollector::run() E20231004 22:51:35.777899 6 backward.hpp:4199] #2 | Source "/usr/local/include/bvar/passive_status.h", line 62, in get_value E20231004 22:51:35.777909 6 backward.hpp:4199] Source "/usr/local/include/bvar/passive_status.h", line 140, in take_sample [0x7a4413] E20231004 22:51:35.777920 6 backward.hpp:4199] #1 Source "/opt/braft-80d97b2475b3c0afca79c19b64d46bb665d704f4/src/braft/util.cpp", line 215, in counter_percentile [0x7e18cf] E20231004 22:51:35.777931 6 backward.hpp:4199] #0 Source "/usr/local/include/bvar/detail/percentile.h", line 294, in snprintf [0x7e52d5] Illegal instruction (Illegal operand [0x7e52d5]) E20231004 22:51:35.964385 6 typesense_server.cpp:102] Typesense 0.24.1 is terminating abruptly. W20231004 22:54:27.922528 118 protobuf_file.cpp:91] open file failed, path: /data/state/log/log_meta: FILE_ERROR_NOT_FOUND W20231004 22:54:27.930387 118 log.cpp:685] /data/state/log is empty W20231004 22:54:28.024627 118 protobuf_file.cpp:91] open file failed, path: /data/state/meta/raft_meta: FILE_ERROR_NOT_FOUND W20231004 22:54:28.025213 118 protobuf_file.cpp:91] open file failed, path: /data/state/meta/raft_meta: FILE_ERROR_NOT_FOUND W20231004 22:54:28.207242 118 controller.cpp:1454] SIGINT was installed with 1 W20231004 22:54:28.207350 118 node.cpp:811] [default_group:172.18.0.22:8107:8108 ] Refusing concurrent configuration changing E20231004 22:54:28.207409 118 raft_server.cpp:601] Node not ready yet (known_applied_index is 0).
[10/05/23 00:04:11] INFO Listening at: http://0.0.0.0:3003 (9)
[10/05/23 00:04:11] INFO Using worker: uvicorn.workers.UvicornWorker
[10/05/23 00:04:11] INFO Booting worker with pid: 10
[10/05/23 00:05:01] INFO Created in-memory cache with unloading disabled.
[10/05/23 00:05:01] INFO Initialized request thread pool with 2 threads.
[10/05/23 00:05:20] INFO Loading clip model 'ViT-B-32::openai'
[10/05/23 00:05:32] INFO Loading image classification model
'microsoft/resnet-50'
Could not find image processor class in the image processor config or the model config. Loading based on pattern matching with the model's feature extractor configuration. Could not find image processor class in the image processor config or the model config. Loading based on pattern matching with the model's feature extractor configuration. /opt/venv/lib/python3.11/site-packages/transformers/models/convnext/feature_extraction_convnext.py:28: FutureWarning: The class ConvNextFeatureExtractor is deprecated and will be removed in version 5 of Transformers. Please use ConvNextImageProcessor instead. warnings.warn( [10/05/23 00:05:34] INFO Loading facial recognition model 'buffalo_l' I'll paste the logs for typesense here also. E20231004 22:51:35.777837 6 backward.hpp:4199] #5 Object "/usr/lib/x86_64-linux-gnu/libc.so.6", at 0x7fb4129b6b42, in E20231004 22:51:35.777870 6 backward.hpp:4199] #4 Object "/opt/typesense-server", at 0x84d418, in bvar::detail::SamplerCollector::sampling_thread(void*) E20231004 22:51:35.777889 6 backward.hpp:4199] #3 Object "/opt/typesense-server", at 0x84b908, in bvar::detail::SamplerCollector::run() E20231004 22:51:35.777899 6 backward.hpp:4199] #2 | Source "/usr/local/include/bvar/passive_status.h", line 62, in get_value E20231004 22:51:35.777909 6 backward.hpp:4199] Source "/usr/local/include/bvar/passive_status.h", line 140, in take_sample [0x7a4413] E20231004 22:51:35.777920 6 backward.hpp:4199] #1 Source "/opt/braft-80d97b2475b3c0afca79c19b64d46bb665d704f4/src/braft/util.cpp", line 215, in counter_percentile [0x7e18cf] E20231004 22:51:35.777931 6 backward.hpp:4199] #0 Source "/usr/local/include/bvar/detail/percentile.h", line 294, in snprintf [0x7e52d5] Illegal instruction (Illegal operand [0x7e52d5]) E20231004 22:51:35.964385 6 typesense_server.cpp:102] Typesense 0.24.1 is terminating abruptly. W20231004 22:54:27.922528 118 protobuf_file.cpp:91] open file failed, path: /data/state/log/log_meta: FILE_ERROR_NOT_FOUND W20231004 22:54:27.930387 118 log.cpp:685] /data/state/log is empty W20231004 22:54:28.024627 118 protobuf_file.cpp:91] open file failed, path: /data/state/meta/raft_meta: FILE_ERROR_NOT_FOUND W20231004 22:54:28.025213 118 protobuf_file.cpp:91] open file failed, path: /data/state/meta/raft_meta: FILE_ERROR_NOT_FOUND W20231004 22:54:28.207242 118 controller.cpp:1454] SIGINT was installed with 1 W20231004 22:54:28.207350 118 node.cpp:811] [default_group:172.18.0.22:8107:8108 ] Refusing concurrent configuration changing E20231004 22:54:28.207409 118 raft_server.cpp:601] Node not ready yet (known_applied_index is 0).
There seems to be issue with typesense container
Can you bring down the stack, remove typesense container and bring back the stack to receeate it
Still no luck after stopping all containers, removing typesense container and volume, then restarting all. Here is the log for the typesense container after letting it run for about 5 minutes
W20231005 23:52:38.653410 114 protobuf_file.cpp:91] open file failed, path: /data/state/log/log_meta: FILE_ERROR_NOT_FOUND
W20231005 23:52:38.653472 114 log.cpp:685] /data/state/log is empty
W20231005 23:52:38.978972 114 protobuf_file.cpp:91] open file failed, path: /data/state/meta/raft_meta: FILE_ERROR_NOT_FOUND
W20231005 23:52:38.979322 114 protobuf_file.cpp:91] open file failed, path: /data/state/meta/raft_meta: FILE_ERROR_NOT_FOUND
W20231005 23:52:39.117777 114 controller.cpp:1454] SIGINT was installed with 1
W20231005 23:52:39.117885 114 node.cpp:811] [default_group:172.18.0.21:8107:8108 ] Refusing concurrent configuration changing
E20231005 23:52:39.118185 133 raft_server.h:62] Peer refresh failed, error: Doing another configuration change
W20231005 23:53:58.689937 117 log.cpp:1105] open segment need discard, path: /data/state/log first_log_index: 1 first_index: 1 last_index: 0
Here are logs from typesense running after a reboot. I'm getting a 502 error now
W20231006 00:28:11.182459 118 protobuf_file.cpp:91] open file failed, path: /data/state/log/log_meta: FILE_ERROR_NOT_FOUND
W20231006 00:28:11.182535 118 log.cpp:685] /data/state/log is empty
W20231006 00:28:11.298080 118 protobuf_file.cpp:91] open file failed, path: /data/state/meta/raft_meta: FILE_ERROR_NOT_FOUND
W20231006 00:28:11.363497 118 protobuf_file.cpp:91] open file failed, path: /data/state/meta/raft_meta: FILE_ERROR_NOT_FOUND
I had the same search issue, and no facial recognition working after installing today. Fixed the search problem by updating the URL in admin>machine learning to the 172 docker ip instead of my host machine. Thanks thariq-shanavas!