190 Commits
Author SHA1 Message Date
Michael Christen b50b76bd55 Merge pull request #835 from chiliec/sorted-config-file
Write yacy.conf with alphabetically sorted keys
2026-09-23 08:34:22 +02:00
smokingwheels@yahoo.com c9aea943ff Fix ServletResource directory listing test on Windows 2026-09-23 01:07:25 +00:00
Vladimir Babin a4e0126f1e Write yacy.conf with alphabetically sorted keys
FileUtils.saveMap iterated a HashMap snapshot, so DATA/SETTINGS/yacy.conf
was written in hash order and its key order changed between saves. Take the
snapshot as a TreeMap so the file is written sorted by key, matching the
order shown in ConfigProperties_p.html.

Fixes #618
2026-09-23 03:15:56 +03:00
Michael Peter Christen 95078f5f1f Added data structures to store simple csv tables in YaCy. The purpose of
those tables is to provide a data exchange plattform for agent access
that can communicate with YaCy over a MCP server that provides simple
listTables, readTable and writeTable tool calls.
2026-09-20 13:24:28 +02:00
Michael Peter Christen 3f21c0c6c1 Bound web structure growth while preserving active crawl roots and connected paths 2026-09-20 12:30:49 +02:00
Michael Peter Christen e171a4a0e5 Keep access tracking cheap during request bursts 2026-09-04 23:31:35 +02:00
Michael Peter Christen c2c7783be8 loading paths now share 256 fixed locks, eliminating per-host lock
accumulation and the lock-creation race
2026-09-04 23:23:26 +02:00
Michael Peter Christen d05db9e6bb Introduced immutable indexes to solve the problem of
dying-peers-when-growing problem:

HeapReader can now open immutable indexes as SSTableHandleMap instances.
Keys and offsets remain file-backed instead of occupying the Java heap.
Lazy working copies avoid additional files until a mutation occurs.
Negative offsets record deletions without tombstone sidecars or RAM
maps. Mutable heaps retain RowHandleMap, while sealed segments save heap
memory.

With immutable indexes the memory consumption is not stopped, it is only
moved from heap memory to system memory. The result should be that there
is no need to assign more memory to YaCy when it gets bigger, it simply
takes it itself from the system memory.

This should also fix
https://github.com/yacy/yacy_search_server/issues/731
2026-08-30 14:55:29 +02:00
Michael Peter Christen b1fd3b3185 Fix Jetty 12 active request accounting
Track each HTTP request independently and always release its entry on
completion, failure, or async termination. Enforce the request limit
atomically, remove obsolete connection-close accounting, repair stale
cleanup, and persist the configured maximum correctly.

Update UI terminology, help, localization, and focused regression tests.

- Fixes #800
- Fixes #808
2026-08-16 21:53:13 +02:00
Michael Peter Christen b5c9695783 Fix stale config writes during concurrent updates 2026-08-14 21:21:29 +02:00
Michael Peter Christen 565ab0fd84 Merge branch 'master' of https://github.com/yacy/yacy_search_server 2026-07-30 23:41:09 +02:00
Michael Peter Christen 49d3428a45 Fix error handling for client disconnects 2026-07-30 23:41:05 +02:00
Michael Peter Christen c729aef849 Server-validated X-Real-IP proxy handling, publicPort lifecycle fix, peer-statistic iam parameter, transfer-IP fallback, and matching tests/docs 2026-07-14 22:18:11 +02:00
Michael Peter Christen ece7985d94 proper IP recognition using header X-Real-IP when YaCy is behind a
reverse proxy
2026-07-12 17:16:24 +02:00
Michael Peter Christen d0db6b69c1 Downgraded YaCy to Jetty 12.0.37 2026-07-12 12:43:55 +02:00
Michael Peter Christen 554911a88f Migration to Jetty 12.1.11 2026-07-12 12:03:57 +02:00
Michael Peter Christen b2e9142ea9 towards a Jetty 9 decoupling baseline for the Jetty 12 migration 2026-07-12 00:49:49 +02:00
Michael Peter Christen bfddfe5e7e isolate Solr 9.0 Jetty client dependencies in a relocated bridge 2026-07-11 23:40:15 +02:00
Michael Peter Christen edeb6162c4 de-coupling of security functions from jetty 2026-07-11 20:52:05 +02:00
Michael Peter Christen b1380c4a9f cleaned up user authentication
this removes the userDB-exception in the normal
authentication process which affected mostly wiki
and blog which are not required any more. We also
cleaned up translation messages as this function was
not used at all. This is a required step forward
a renovation of the jetty server.
2026-07-11 11:11:06 +02:00
Michael Peter Christen f2b0f41d84 migrated jcifs, mime4j to latest 2026-07-10 23:55:32 +02:00
Michael Peter Christen 30f66631bc enhanced Network Graph Caching 2026-07-09 22:17:32 +02:00
Michael Peter Christen 57d188e69a Major fix for localization: finalizing German, French, Spanish, Italian,
Greek, Slovak, Ukrainian, Turkish and Russian. Also added full support
for Polish language. All servlets are now fully supported by those
languages.
2026-07-07 21:36:59 +02:00
Michael Peter Christen 35a1d85f8b removed the snapshot feature and all dependencies from non-java code 2026-07-05 12:04:42 +02:00
Michael Peter Christen e419ceda7c IPv6-aware fixes
not a full IPv6 support fix, but changes towards
2026-07-05 08:38:08 +02:00
Michael Peter Christen b8daaacf6a Remove suspicious JavaScript code fragments from snippet lines. 2026-02-17 22:58:02 +01:00
Michael Peter Christen cb3366c3e9 fixed parsing of x-data-elements in <div> 2026-02-17 22:47:32 +01:00
Henschi 2fb50ce5d6 fix test after the lastest changes 2025-10-04 17:44:02 +02:00
Roman Szarowski ab095b8686 support for /date search to be sorted by date published - https://github.com/yacy/yacy_search_server/issues/622 2025-08-25 23:36:10 +02:00
Henschi e32c381394 adapt test, but I don't think that's right (extra space) 2025-04-04 16:48:06 +02:00
Henschi eab2768f79 adapt test to commit 0689f4f0ae 2025-04-04 16:32:54 +02:00
Henschi 7772a14f44 fix test and test the input values from document 2025-04-04 15:53:01 +02:00
Henschi 5b6a8520dd fix test values because title in windows and mac PPT is not empty or null 2025-04-03 20:50:58 +02:00
Henschi 5325670a8e fix tests 2025-04-03 20:13:25 +02:00
Henschi 3d5ba29d01 fix compile test 2025-03-28 11:45:03 +01:00
Michael Peter Christen 910a496c9f replaced http links with https 2024-07-21 18:02:58 +02:00
Michael Peter Christen 0579a9546a changed link to new forum location 2022-02-03 13:27:06 +01:00
Michael Peter Christen 3959d43a5c fixed doku link 2021-08-03 16:57:24 +02:00
sgaebel fc03c4b4fe removes some warning and unused objects 2020-08-03 20:44:31 +02:00
sgaebel 4a495df63a removes some deprecation-warnings 2020-07-31 17:28:06 +02:00
sgaebel dd9d4b1188 replace org.junit.Assert.assertThat by
org.hamcrest.MatcherAssert.assertThat from hamcrest 2.2 to avoid
deprecation-warning
2020-07-28 19:09:26 +02:00
sgaebel df9ea0a42a removes some warnings: unused imports, params 2020-07-27 22:20:49 +02:00
Michael Peter Christen 64a17faca0 added debug code to parser test to investigate why this fails in travis
build
2020-07-12 16:57:46 +02:00
Michael Christen 3a46b07603 fixed many links to old forum, now https://searchlab.eu 2019-06-15 11:43:27 +02:00
luccioman e90405b6f0 Support parsing audio URLs without file extension
Added also a Junit for the audio tag parser
2019-04-09 11:40:21 +02:00
luccioman 3fb449b3b6 Properly resolve relative URLs against document URL in html base tags
Fixes issue #256
2018-12-06 20:18:00 +01:00
luccioman 9daeea823b Fixed concurrency issue on cache used for circles rendering
Without synchronization lock, concurrent rendering of images including
circles could lead to glitches as reported in issue #248
2018-11-10 22:00:49 +01:00
luccioman 61c337f29a Decode blacklist entries for easier edition of non ascii chars
Not using the JDK URLDecoder.decode() function, as it strips '+'
characters when they occur after '?' (both characters having regular
expression semantics when used in blacklist path patterns)
2018-10-04 09:33:58 +02:00
luccioman ed93221fa1 Improved normalization of blacklist path patterns having non ascii chars
Normalize blacklist path patterns using percent-encoding, at pattern
edition in web interface and at loading from configuration files.

Fixes issue #237
2018-10-02 14:36:13 +02:00
luccioman 685122363d Added a parser for XZ compressed archives.
As suggested by LA_FORGE on mantis 781
(http://mantis.tokeek.de/view.php?id=781)
2018-08-15 10:07:39 +02:00