Commit Graph
5791 Commits
Author SHA1 Message Date
lotus 01853ce849 removed "illegal character"
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6117 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-22 11:40:55 +00:00
lotus 187ee4d06e another IE fix (also same names in html and js)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6116 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-22 11:24:01 +00:00
lotus 48051fef4b another fix for IE
http://forum.yacy-websuche.de/viewtopic.php?p=16030#p16030

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6115 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-22 11:15:00 +00:00
lotus 37c162053d fix for IE & WatchCrawler (were same names in js and html)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6114 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-22 11:03:44 +00:00
orbiter f2db0d248b fix for multi-word search (makes a replace-all)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6113 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-22 06:37:11 +00:00
apfelmaennchen 7fcffdcb3c - yacyui-portalsearch: fix for multiple search terms
- http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209#p16015

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6112 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-22 05:43:54 +00:00
orbiter b07e518bcc added faviconcode to json search output
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6111 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-21 20:57:18 +00:00
apfelmaennchen f091ad3e23 - hopefully a fix for the 'koblenz'-bug
- http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209#p16005

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6110 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-21 20:24:39 +00:00
low012 91785d895c *) minor changes in comments
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6109 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-21 20:08:52 +00:00
lotus f6d0aaa787 update to java 6u14
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6108 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-21 19:27:08 +00:00
apfelmaennchen d268bb5108 yacyui-portalsearch: auto open navigator sidebar
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6107 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-21 12:53:14 +00:00
apfelmaennchen a22103560c yacyui-portalsearch waits with execution until all svripts have been loaded. It checks the load status every 200ms!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6106 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-21 07:54:42 +00:00
orbiter bdda140c02 fix for json output (no doubleqotes any more, doublequote quoting did not work)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6105 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-20 23:33:29 +00:00
apfelmaennchen 49955cc7b9 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209&p=15984#p15984
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6104 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-20 22:40:27 +00:00
orbiter 2f84736120 ignore signature files that cannot be downloaded because of failed encoding
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6103 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-20 20:46:58 +00:00
orbiter 041d9c253e some refactoring and more error-awareness in LogalizeHandler
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6102 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-20 20:29:57 +00:00
apfelmaennchen 2bb020a7a5 yacyui-portalsearch: small improvement to navigators
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6101 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-20 12:08:35 +00:00
apfelmaennchen fee88d5fa3 maybe this fixes: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209#p15967
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6100 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-20 11:41:44 +00:00
orbiter 6b307d6d59 more tolerance for corrupted index entries in exported row sets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6099 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-19 21:35:44 +00:00
orbiter 33aafa9b4b better logging when writing merged dumps
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6098 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-19 17:02:50 +00:00
lotus db70badcf0 possibility to set remote host on upnp device
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6097 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-19 15:32:59 +00:00
orbiter 4d29e90708 uaeh
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6096 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-19 14:54:39 +00:00
orbiter 3c3e6499ae added more logging for merge operation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6095 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-19 14:51:35 +00:00
orbiter a119860b82 moved IndexImportWikimedia into different menu position
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6094 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-19 14:03:28 +00:00
orbiter 15180fc95e - patch for future computation in SplitTable
- added same concurrent process for has() from SPlitTable in ArrayStack

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6093 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-18 23:24:23 +00:00
orbiter 9a5ec20b3c avoid merge during startup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6092 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-18 21:18:56 +00:00
lotus bf6b92343c try to avoid stuck pdf parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6091 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-18 06:31:55 +00:00
lotus c695c7f512 try to remove hung swf parser from queue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6090 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-17 17:48:02 +00:00
orbiter fc69a76197 update to web structure picture:
- allow bigger size
- better instructions for api usage

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6089 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-17 12:37:31 +00:00
orbiter ae015e8e98 refactoring of blob package classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6088 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-17 09:58:15 +00:00
orbiter 8b8877c233 moved image collector
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6087 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-16 21:48:09 +00:00
orbiter be1c7ddc64 refactoring of search classes -- moved Ranking Profile to search package
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6086 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-16 21:45:40 +00:00
orbiter 1457bfce16 added updateYACY.sh to release build
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6085 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-16 21:02:41 +00:00
orbiter fd31a3616a - more logging in server process
- fix for bas ascii in comment

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6084 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-16 15:10:59 +00:00
orbiter b5bc399cea added necessary synchronization for logging statistics (causes deadlock)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6083 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-16 10:37:13 +00:00
lulabad e377a1e9a1 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1969
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6082 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-16 08:16:59 +00:00
orbiter 5a7fd6b4c8 just some comment lines
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6081 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-16 06:38:26 +00:00
orbiter 31f60a3b3e when doing searches, also apply a online caution to DHT transmission and stop transmissions while heavy load caused by searching. This omits the many requests to the URL database that are needed for DHT transfer and it avoids collisions with URL retrieval needed for search results.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6080 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-15 22:03:27 +00:00
orbiter 17dc6d4be5 small fix for new Logger
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6079 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-15 21:39:24 +00:00
orbiter ce1adf9955 serialized all logging using concurrency:
high-performance search query situations as seen in yacy-metager integration showed deadlock situation caused by synchronization effects inside of sun.java code. It appears that the logger is not completely safe against deadlock situations in concurrent calls of the logger. One possible solution would be a outside-synchronization with 'synchronized' statements, but that would further apply blocking on all high-efficient methods that call the logger. It is much better to do a non-blocking hand-over of logging lines and work off log entries with a concurrent log writer. This also disconnects IO operations from logging, which can also cause IO operation when a log is written to a file. This commit not only moves the logger from kelondro to yacy.logging, it also inserts the concurrency methods to realize non-blocking logging.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6078 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-15 21:19:54 +00:00
lotus aec3e7995a autoconfig.pac can be used to browse .yacy-domains only
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6077 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-15 19:48:11 +00:00
orbiter 4e825852d2 added stub for phpBB3 search integration guide
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6076 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-15 11:52:57 +00:00
orbiter bc6dd8194b refactoring: moved search query class to new search package
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6075 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-15 11:49:00 +00:00
orbiter a4805defdd added stub for new search process
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6074 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-15 11:46:23 +00:00
orbiter b8e738a7be a collection of
- small bug fixes
- better/more comments
- more asserts
- fixed synchronization
- test case enhancements
- code cleanup
- performance hacks

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6073 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-14 22:09:08 +00:00
apfelmaennchen 39779e4796 DidYouMean: as I moved to only 8 consumer and 4 producer threads, I removed poison pills as it does not make sense anymore - threads are interrupted directly. Having a consumer thread per test case just didn't make sense either (see svn 6070) due to the massive overhead.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6072 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-14 16:31:31 +00:00
apfelmaennchen c3c4dd0933 DidYouMean - changed to much simpler LinkedBlockingQueue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6071 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-14 15:25:57 +00:00
apfelmaennchen 01ac1b5d7e - blocking queue implementation of DidYouMean
- timeout ist set to 500ms

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6070 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-14 11:53:09 +00:00
orbiter b8bb1bb364 join with a timeout does not cause that the corresponding thread is stopped after the time-out. It does only cause that the waiting is stopped. Here we need additionally a signal to the thread to stop after we finished waiting.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6069 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-13 23:54:52 +00:00
orbiter b69f22e9ca mistake in last commit: computation of loops in ReversingTwoConsecutiveLetters
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6068 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-06-13 23:37:51 +00:00