jody/yacy_search_server
1
0 Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2026-10-25 05:54:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
14,543 Commits 1 Branch 28 Tags
6bec159f6076cd59936068ffa0c91ffceb2dd6cd
Commit Graph
14543 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Charlie Root 6bec159f60 flake: drop flake-utils as a dependency 
Replace flake-utils with a few lines of pure nix code, since flake-utils
is not really useful here.
 2025-02-22 12:14:49 +01:00
Michael Christen 4953151f6f Merge pull request #670 from okybaca/startfix 
if java executable not found using 'which', try to use 'command'
 2025-01-03 13:00:16 +01:00
Michael Christen 4e4d57a16f Merge pull request #672 from okybaca/kellogs 
modified kelondro so it uses KELONDRO prefix when logging
 2025-01-03 12:59:21 +01:00
okybaca 39218b74b1 modified kelondro so it uses KELONDRO prefix when logging 2024-12-24 00:54:23 +01:00
okybaca 4b6ec7a131 if java executable not found using 'which', try to use 'command' 2024-12-13 02:09:55 +01:00
Michael Christen 3ede322f5e Merge pull request #666 from okybaca/eldarskinfix 
fine tuned the dark-green skin - tables font color
 2024-12-02 22:12:23 +01:00
okybaca e979b32374 fine tuned the dark-green skin - tables font color 2024-11-29 13:39:34 +01:00
Michael Peter Christen 9f20f73362 library maintenance - updated some libraries 2024-11-28 22:55:48 +01:00
Michael Christen 51c612f845 Merge pull request #657 from codymikol/nixify 
feat(nix): add a nix flake
 2024-11-25 12:42:25 +01:00
Michael Christen 0d58f60f45 Merge pull request #664 from okybaca/log-kelo 
renamed INDEX-TRANSFER-DISPATCHER to DHT-OUT in the log
 2024-11-25 12:40:34 +01:00
Michael Peter Christen 54fa724352 reverted deprecation change since we are still using java 11, not 19 2024-11-25 12:34:05 +01:00
Michael Peter Christen 6ef3a0fca5 code maintenance - removed warnings and replaced deprecated functions 2024-11-25 12:29:11 +01:00
okybaca 91c753ab96 renamed INDEX-TRANSFER-DISPATCHER to DHT-OUT in the log 2024-11-25 01:23:57 +01:00
Michael Peter Christen feca150672 Automatically adjust crawling load limit to the local machine cpu cores 
The settings in the default configuration file is historic. Many
machines have much more CPU cores today and now an auto-scaling to this
hardware is better.
 2024-11-25 00:30:36 +01:00
Michael Peter Christen 16e031caeb added hint in README to install Ivy from archived updatesite. 2024-11-24 23:59:27 +01:00
Michael Peter Christen 7e8a1ef0e2 log file when OOM appears 2024-10-18 14:25:42 +02:00
Michael Peter Christen 3c88f87831 jetty upgrade 2024-10-17 11:36:51 +02:00
Michael Peter Christen a8c64b1af2 added an artificial snippet [Synonym Match] in case that there is only a match in the synonyms] 2024-09-21 21:56:12 +02:00
Michael Peter Christen f57df061da upgraded commons-io to 2.17.0 2024-09-21 21:56:12 +02:00
Michael Peter Christen c88c30a5c5 added an option to ViewFile to see all solr fields which contain texts 2024-09-21 21:51:19 +02:00
Cody Mikol c6127e4f2e feat(nix): add a nix flake 
nix flakes allow developers using NixOS or
the nix package manager to quickly set up a
working development environment with the correct
dependencies.

Fixes N/A
 2024-08-30 20:41:09 -04:00
Michael Peter Christen 6db374fdcf upgraded metadata-extractor to 2.19.0 2024-08-26 23:49:27 +02:00
Michael Peter Christen 3944984840 added snippet extraction with synonym matching 2024-08-26 23:44:42 +02:00
Michael Peter Christen d181b9e89b added deleted files from commit https://github.com/yacy/yacy_search_server/commit/254f12d60b2d80b8bd136216c4b091d43e4a8c90 which are still needed and had been linked outside of yacy/ui 2024-07-24 15:57:51 +02:00
Michael Peter Christen 910a496c9f replaced http links with https 2024-07-21 18:02:58 +02:00
Michael Peter Christen fd45ccf76e added sponsoring images 2024-07-21 17:25:22 +02:00
Michael Peter Christen 833d720989 upgraded ppt parser by migration of org.apache,poi from 3.17 to 5.3.0 
This also fixes the security waning
https://github.com/yacy/yacy_search_server/security/dependabot/37
 2024-07-21 15:28:13 +02:00
Michael Peter Christen 687820788d this assert does not work because of the 9_0_0 solr version format. 
An 9_0 is expected but it does not work this way with this version.
 2024-07-21 13:33:47 +02:00
Michael Christen accf4e424b Merge pull request #649 from virginOne/master 
Fix the issue of not being able to import the JSON format
 2024-07-10 16:36:54 +02:00
Michael Christen 2f5f3f8853 Merge pull request #650 from zutto/master 
Fix autocrawler crashing
 2024-07-10 16:35:39 +02:00
Michael Christen 326b5f6e6e Merge pull request #651 from okybaca/removeui 
removed yacy/ui as obsolete
 2024-07-10 16:34:07 +02:00
okybaca 254f12d60b removed yacy/ui as obsolete 2024-07-09 16:26:50 +02:00
zutto 5268ae2ce9 check the document protocol & host values before proceeding to form final url. 2024-06-29 10:11:58 +03:00
zutto 962aaec0c0 Improve the clarity of deep crawl feature UI text on AutoCrawler 2024-06-29 09:37:05 +03:00
zutto d958d1c0c4 ensure that returned SolrDocument is not null 2024-06-29 09:33:06 +03:00
virginOne f3cc818305 Merge branch 'yacy:master' into master 2024-06-23 19:52:54 +08:00
sgaebel 66cf7d4ca5 disables autowarm of filtercache, corrects luceneMatchVersion 2024-06-21 19:10:12 +02:00
Virgo 89c07f0900 Fix the issue of not being able to import the JSON format export of Solr index due to the inconsistency in time format between the exported JSON format and the Solr time format. 2024-06-21 10:03:08 +08:00
Michael Peter Christen 70454654f3 by default open the https url for a given host, not the http url 
(http does almost not exist any more)
 2024-05-27 00:53:18 +02:00
Michael Peter Christen 71a6074cc5 added setting of cache configuration for solr 
according to recommendation from
https://community.searchlab.eu/t/yacy-support-gpt-chatgpt-assistant/1622
However it is not clear if this configuration actually works (has an
effect at all) or is the solution for performance issues.
 2024-05-26 12:59:59 +02:00
Michael Peter Christen b8479430b6 400 is too small 2024-05-25 01:21:06 +02:00
Michael Peter Christen 5f4ea9ac5d reduced memory amount for network image 
reduced also the number of memory allocation for image storage
 2024-05-25 01:10:23 +02:00
Michael Peter Christen fe4c0aa890 refactoring of RAG reverse proxy: extracted code for ollama code to 
their own classes
 2024-05-21 00:06:19 +02:00
Michael Peter Christen 8b65a4d14e fixed build clean 2024-05-19 18:02:49 +02:00
Michael Peter Christen f1c70dce33 Merge branch 'master' of github.com:yacy/yacy_search_server 2024-05-19 17:35:24 +02:00
Michael Peter Christen 8eb0d490aa migrated solr to 9.0 
This is a major step because solr removed support for embedded solr
instances in 9.0 and we want to keep it because we want to ship
YaCy with an embedded solr. It was necessary to add parts of solr
code into YaCy to make this migration possible. Further on with
Solr 9.1 they removed even more parts which are required for embedded
operation, therefore we cannot migrate yet further without big
changes.
If you are running a YaCy instance with Solr 8.x, the migration should
be done automatically. If not you require to first migrate to a YaCy
version 1.93 with Solr 8.x to migrate to Solr 8 data.
Release_1.940 		2024-05-19 17:34:57 +02:00
Michael Peter Christen b8417e5619 removed Mac specific code which is not working any more on recent Macs 2024-05-19 17:29:16 +02:00
Michael Peter Christen 13fbff0bff Added a RAG Proxy for AI Chat with YaCy 
RAG (Retrieval Augmented Generation) is a method to combine a search
engine with a LLM (Large Language Model). When a new prompt is
submitted, a search engine injects knowledge from a search into the
content. This is done using a reverse proxy between the Chat Client and
the LLM. In this case, we used the following software:

LLM Backend - Ollama:
https://github.com/ollama/ollama
Install ollama and then load two required LLM models
with the following commands:
ollama pull phi3:3.8b
ollama pull llama3:8b

Chat Client - susi_chat:
https://github.com/susiai/susi_chat
just clone the repository and the open the file
susi_chat/chat_terminal/index.html
in your browser. This displays a chat terminal.
In this terminal, run the following command:
host http://localhost:8090
This sets the LLM backend to your YaCy peer.

Then start YaCy. It will provide the LLM endpoint to the client
while using ollama in the backend. It then injects search results
only from the local Solr index, not from the p2p network (so far).
 2024-05-19 17:19:09 +02:00
Michael Peter Christen 59c0cb0f30 fixed aarch64 dockerfile 2024-05-13 02:10:24 +02:00
Michael Christen 0405ec8ad2 Merge pull request #642 from HeliosLHC/reduce_image_size 
Reduce Docker Image Size
 2024-05-12 23:50:24 +02:00