Michael Peter Christen 3f21c0c6c1 Bound web structure growth while preserving active crawl roots and connected paths

2026-09-20 12:30:49 +02:00

..

data

Bound web structure growth while preserving active crawl roots and connected paths

2026-09-20 12:30:49 +02:00

retrieval

migrated jcifs, mime4j to latest

2026-07-10 23:55:32 +02:00

robots

loading paths now share 256 fixed locks, eliminating per-host lock

2026-09-04 23:23:26 +02:00

Balancer.java

replaced http links with https

2024-07-21 18:02:58 +02:00

CrawlStacker.java

Bound web structure growth while preserving active crawl roots and connected paths

2026-09-20 12:30:49 +02:00

CrawlStarterFromScraper.java

adding SPDX license and copyright headers

2021-03-11 12:17:11 +01:00

CrawlSwitchboard.java

Bound web structure growth while preserving active crawl roots and connected paths

2026-09-20 12:30:49 +02:00

FileCrawlStarterTask.java

adding SPDX license and copyright headers

2021-03-11 12:17:11 +01:00

HarvestProcess.java

replaced http links with https

2024-07-21 18:02:58 +02:00

HostBalancer.java

implemented (most of)

2025-08-16 13:33:39 -06:00

HostQueue.java

replaced http links with https

2024-07-21 18:02:58 +02:00

IllegalCrawlProfileException.java

adding SPDX license and copyright headers

2021-03-11 12:17:11 +01:00

LegacyBalancer.java

fixed missing thread name revert after balancer waiting

2021-12-22 01:46:18 +01:00

RecrawlBusyThread.java

removed the snapshot feature and all dependencies from non-java code

2026-07-05 12:04:42 +02:00