Commit Graph
13724 Commits
Author SHA1 Message Date
Erik Dominikus f04580ecfd Add contributor guidelines; closes #214 2018-08-15 23:23:30 +07:00
luccioman 685122363d Added a parser for XZ compressed archives.
As suggested by LA_FORGE on mantis 781
(http://mantis.tokeek.de/view.php?id=781)
2018-08-15 10:07:39 +02:00
luccioman 8ce9c066bf Updated the JRE URL from 8u171 to 8u181 for the MS Windows installer 2018-08-14 08:41:23 +02:00
luccioman 0efc6c89ef Fixed rendering of crawl queues page for URLs with raw IPV6 addresses 2018-08-13 14:36:22 +02:00
luccioman 4ee14ff3c5 Fixed NullPointerException case on malformed crawl queue folder name 2018-08-13 14:35:26 +02:00
luccioman 21ad9435ec Fixed crawl queue folder naming for IPv6 hosts on MS Windows filesystems
As reported by @vikulin in issue #187, crawling websites using a raw
IPv6 address as host name in their URL failed when running on Microsoft
Windows platforms (FAT32 or NTFS filesystems) when YaCy crawler created
the crawl queue folder, as the ':' character which is part of an IPV6
address is forbidden on these filesystems.
2018-08-11 10:02:26 +02:00
luccioman 0e976e9030 Added a link to MediaWiki dumps summary in import page for convenience 2018-08-08 08:11:02 +02:00
luccioman 1a91e87b05 Upgraded commons-compress dependency from version 1.16.1 to 1.17 2018-08-08 08:06:24 +02:00
luccioman f2c479fe88 Cleaned up unused old jar files not removed on previous Solr upgrade 2018-08-08 08:04:33 +02:00
luccioman ecd4535eb6 Prevent entering empty OpenSearch URLs in ConfigHeuristics_p.html
In order to early prevent adding invalid configuration entries to the
heuristicopensearch.conf file, as revealed the issue #209.
2018-08-06 12:07:47 +02:00
luccioman 1ca9cb6bd9 Fixed a NullPointerException case, reported in issue #209 2018-08-06 12:04:44 +02:00
luccioman 8a29551c54 Upgraded the OpenGeoDB dump URL
The status of the library in the DictionaryLoader_p.html page now also
advertises the user that an upgrade can be applied when an older dump is
already loaded.

Upgrade applied as suggested by Niklas Andrus @fapth_gitlab on Gitter
chat.
2018-08-03 18:39:41 +02:00
luccioman 373edf9eac Adjusted yjson Solr writer to support responses from an external Solr
Worked previously only with responses from YaCy embedded Solr, now able
to render the response when YaCy is configured to use an external Solr
index.
2018-07-31 16:22:21 +02:00
luccioman 87bd17b1cf Simplified a little bit the RSS OpenSearch Solr writer 2018-07-31 16:02:50 +02:00
luccioman dc49ca9c27 Fixed a NPE case on the Solr OpenSearch response writer
Occurred when omitHeader parameter is set to true
2018-07-29 16:30:37 +02:00
luccioman f4267ed247 Made Solr OpenSearch RSS writer compatible with external Solr index
Worked previously only with responses from YaCy embedded Solr, now able
to render the response when YaCy is configured to use an external Solr
index.
2018-07-28 11:03:31 +02:00
luccioman 2bbf070f57 Upgraded icu4j dependency from 61.1 to 62.1 2018-07-26 09:39:54 +02:00
luccioman ede8ae6697 Fixed few technical mistakes in updated Chinese translation from PR #188 2018-07-26 08:27:21 +02:00
luccioman 1e09a0284b Merge pull request #188 from tangdou1/patch-3
small update in zh.lng
2018-07-26 08:22:13 +02:00
luccioman b1410f593a Fixed stylesheet relative URLs rendering in Solr html writer
Relative URLs to CSS stylesheets were not properly rendered when using
the Solr html response writer and the "/solr/collection1/select" entry
point instead of "/solr/select".
2018-07-25 08:03:25 +02:00
luccioman 89c59814da Improved rendering of the Solr api relative url in the html writer
In order to have a consistent relative url when using either
/solr/select or /solr/collection1/select entry point.
2018-07-24 10:13:55 +02:00
luccioman bf4f320b16 Optionally render the response header when using the Solr html writer
With params rendered as html input fields for conveniently modifying
params values and refreshing results.
2018-07-23 18:36:57 +02:00
luccioman 313204ae2c Override qf and df Solr params with defaults only when they are not set 2018-07-23 13:50:24 +02:00
tangdou1 0ff2ca8f01 small update in zh.lng 2018-07-23 17:04:54 +08:00
luccioman 88e6ce23c9 Consistently render empty facets and facets having only entries at zero 2018-07-17 07:36:39 +02:00
luccioman 6831bdffb5 Fixed minor technical issues on Chinese updated translations 2018-07-17 07:08:30 +02:00
luccioman e03c464f16 Merge pull request #186 from tangdou1/patch-1
Update zh.lng
2018-07-17 07:03:07 +02:00
tangdou1 0ebb27e5da Update zh.lng 2018-07-16 20:18:02 +08:00
tangdou1 9c6a99f7ca Update zh.lng 2018-07-16 19:53:20 +08:00
tangdou1 68b5b48335 Update zh.lng 2018-07-16 18:04:37 +08:00
luccioman bdafb14336 Removed redundant synchronization lock on network switch function
Was useless as done in an already synchronized block, and the lock
object was assigned a new value in that same block, and nowhere else a
lock is requested on that same object.
2018-07-16 09:20:23 +02:00
luccioman d5f44ea216 Removed unnecessary synchronization lock from serverSwitch constructor
Lock was useless here as it was set on an object instance attribute
while the object itself is not yet constructed and no other threads can
access it.
2018-07-16 09:13:50 +02:00
tangdou1 f19570a797 Update zh.lng 2018-07-14 21:36:03 +08:00
tangdou1 edb431cf8a Update zh.lng 2018-07-14 17:18:43 +08:00
luccioman dcee2ee6a6 Use standard Java annotation syntax instead of custom Javadoc tag
For better support by building tools.
As reported by @KnustJohn_twitter , the custom
[@phase](https://maven.apache.org/plugin-tools/maven-plugin-tools-java/index.html)
Javadoc tag made NetBeans fail on Javadoc generation for the
GitRevmavenTask class.
Using instead standard Java 5
[annotations](https://maven.apache.org/plugin-tools/maven-plugin-plugin/examples/using-annotations.html#POM_configuration)
this is no more an issue.
2018-07-13 07:25:58 +02:00
luccioman e1bc035496 Ignore Eclipse projects config files derived from maven pom.xml 2018-07-13 07:12:57 +02:00
luccioman dcad393fe5 Fixed exceeding max size of failreason_s Solr field on large link list
When using the 'From Link-List of URL' as a crawl start, with lists in
the order of one or more thousands of links, the failreason_s Solr field
maximum size (32kb) was exceeded by the string representation of the URL
must-match filter when a crawl URL was rejected because not matching.
2018-07-11 08:13:29 +02:00
luccioman f467601561 Properly lock solrInstances for reboot and restoration of embedded Solr
Putting a synchronization lock directly on the solrInstances property
was ineffective as it is assigned a new (unlocked) instance in these
operations.
2018-07-08 08:57:59 +02:00
luccioman 9630f81306 Fixed small unnecessary lines of code 2018-07-08 08:15:26 +02:00
luccioman 26aa5f7a0f Suppress compilation warning on unit testing intentional failure 2018-07-08 08:14:07 +02:00
luccioman 876bcd2f54 Fixed useless comparison between int parameter and Long.MAX_VALUE 2018-07-08 08:11:01 +02:00
luccioman 534f09e92b Added and updated hint messages about remote crawler status
To help identify why remote crawl results may not be received.
2018-07-06 11:30:30 +02:00
luccioman c726154a59 Fixed removal of URLs from the delegatedURL remote crawl stack
URLs were removed from the stack using their hash as a bytes array,
whereas the hash is stored in the stack as String instance.
2018-07-05 09:36:36 +02:00
luccioman 2bdd71de60 Added server side columns sorting on the Process Scheduler table
For easier usage of large tables in the Table_API_p.html page.
2018-07-04 10:28:32 +02:00
luccioman bb51555830 Removed remaining unsafe accesses to SimpleDateFormat instances.
SimpleDateFormat must not be used by concurrent threads without
synchronization for parsing or formating dates as it is not thread-safe
(internally holds a calendar instance that is not synchronized).

Prefer now DateTimeFormatter when possible as it is thread-safe without
concurrent access performance bottleneck (does not internally use
synchronization locks).
2018-07-02 10:00:40 +02:00
reger 6b7883900c update bootstrap hosts 2018-07-02 00:00:04 +02:00
luccioman 39f7f5b074 Updated the JRE URL from 8u131 to 8u171 for the MS Windows installer 2018-06-30 14:27:37 +02:00
luccioman f895745e1c Removed more unsafe concurrent accesses to SimpleDateFormat instances.
SimpleDateFormat must not be used by concurrent threads without
synchronization for parsing or formating dates as it is not thread-safe
(internally holds a calendar instance that is not synchronized).

Prefer now DateTimeFormatter when possible as it is thread-safe without
concurrent access performance bottleneck (does not internally use
synchronization locks).
2018-06-29 15:49:55 +02:00
luccioman 5c6c61809a Fixed JavaScript sorting of tables with cells containing an input field 2018-06-29 13:01:05 +02:00
luccioman 3885fd64a0 Fixed Table_API_p.html current table page loss on row editing.
Reset only to the first table page when the search query is modified
2018-06-28 15:34:53 +02:00