Difference between revisions of "AppSuite:ReaderEngineConfig"

(adustest Config)
(adjusted config items / formatting)
Line 3: Line 3:
 
; com.openexchange.documentconverter.installDir=/opt/readerengine
 
; com.openexchange.documentconverter.installDir=/opt/readerengine
  
This item contains the the directory of the libreaderengine installation. The libreaderengine installation directory in general contains the ./program directory, which itself contains the engine executables. <br>
+
This item contains the the directory of the libreaderengine installation. The libreaderengine installation directory in general contains the ./program directory, which itself contains the engine executables.  
 +
<br>
 
Attention: If not set correctly, the complete web service will be nonfunctional.
 
Attention: If not set correctly, the complete web service will be nonfunctional.
 +
<br>
 +
Default value: "/opt/readerengine"
  
 
; com.openexchange.documentconverter.cacheDir=/var/spool/open-xchange/documentconverter/readerengine.cache
 
; com.openexchange.documentconverter.cacheDir=/var/spool/open-xchange/documentconverter/readerengine.cache
  
 
This item contains the directory that will make up the cache for persistent job data. The directory itself does not need to exist at startup, but the parent directory needs to exist and needs to have write permissions for the user running the servlet, in order for the servlet to create this cache directory at runtime.
 
This item contains the directory that will make up the cache for persistent job data. The directory itself does not need to exist at startup, but the parent directory needs to exist and needs to have write permissions for the user running the servlet, in order for the servlet to create this cache directory at runtime.
 +
<br>
 +
Attention: If not set correctly, the complete web service will be nonfunctional.
 +
<br>
 +
Default value: "/var/spool/open-xchange/documentconverter/readerengine.cache
  
 
; com.openexchange.documentconverter.scratchDir=/var/spool/open-xchange/documentconverter/readerengine.scratch
 
; com.openexchange.documentconverter.scratchDir=/var/spool/open-xchange/documentconverter/readerengine.scratch
Line 15: Line 22:
 
<br>
 
<br>
 
Attention: If not set correctly, the complete web service will be nonfunctional.
 
Attention: If not set correctly, the complete web service will be nonfunctional.
 +
<br>
 +
Default value: "/var/spool/open-xchange/documentconverter/readerengine.scratch"
  
 
; com.openexchange.documentconverter.errorDir=
 
; com.openexchange.documentconverter.errorDir=
 +
 +
The  temporary directory, containing files that could not be loaded due to an error condition or due to a timeout
 +
<br>
 +
Default value: n/a
 +
 +
; com.openexchange.documentconverter.blacklistFile=/opt/open-xchange/etc/readerengine.blacklist
  
 
The list of external document content URLs that are not allowed to be loaded
 
The list of external document content URLs that are not allowed to be loaded
Line 35: Line 50:
 
Upper/Lower cases need to be handled by the regular expression as well.
 
Upper/Lower cases need to be handled by the regular expression as well.
 
The file itself needs to be UTF-8 encoded to be read appropriately.
 
The file itself needs to be UTF-8 encoded to be read appropriately.
 +
<br>
 
Default value: "/opt/open-xchange/etc/readerengine.blacklist"
 
Default value: "/opt/open-xchange/etc/readerengine.blacklist"
; com.openexchange.documentconverter.blacklistFile=/opt/open-xchange/etc/readerengine.blacklist0
+
 
 +
; com.openexchange.documentconverter.whitelistFile=/opt/open-xchange/etc/readerengine.whitelist
  
 
The list of external document content URLs that are allowed to be loaded
 
The list of external document content URLs that are allowed to be loaded
Line 55: Line 72:
 
Upper/Lower cases need to be handled by the regular expression as well.
 
Upper/Lower cases need to be handled by the regular expression as well.
 
The file itself needs to be UTF-8 encoded to be read appropriately.
 
The file itself needs to be UTF-8 encoded to be read appropriately.
 +
<br>
 
Default value: "/opt/open-xchange/etc/readerengine.whitelist"
 
Default value: "/opt/open-xchange/etc/readerengine.whitelist"
; com.openexchange.documentconverter.whitelistFile=/opt/open-xchange/etc/readerengine.whitelist
+
 
 +
; com.openexchange.documentconverter.urlLinkLimit=200
  
 
The external URL link limit specifies the maximum amount of
 
The external URL link limit specifies the maximum amount of
Line 63: Line 82:
 
When this limit is reached, no more external internet URLs are resolved
 
When this limit is reached, no more external internet URLs are resolved
 
for the current document.
 
for the current document.
set to -1 for no upper limit or to 0 to disable the resolving of internet URLs completely
+
<br>
 +
Set to -1 for no upper limit or to 0 to disable the resolving of internet URLs completely
 +
<br>
 
Default value: 200;  
 
Default value: 200;  
; com.openexchange.documentconverter.urlLinkLimit=200
+
 
 +
; com.openexchange.documentconverter.urlLinkProxy =
  
 
The external URL link proxy entry specifies a proxy server that is used by the readerengine
 
The external URL link proxy entry specifies a proxy server that is used by the readerengine
Line 74: Line 96:
 
Recognized protocols are http://, https:// and ftp://
 
Recognized protocols are http://, https:// and ftp://
 
Leave empty, if no proxy server should be used by the readerengine
 
Leave empty, if no proxy server should be used by the readerengine
 +
<br>
 
Default value: n/a
 
Default value: n/a
; com.openexchange.documentconverter.urlLinkProxy =
+
 
 +
; com.openexchange.documentconverter.RemoteSharePointUrl =
  
 
Use a remote SharePoint service to do MSO to PDF conversions.
 
Use a remote SharePoint service to do MSO to PDF conversions.
Line 81: Line 105:
 
If left empty, the corresponding conversion job always returns false.
 
If left empty, the corresponding conversion job always returns false.
 
A fallback behavior should be implemented in any case
 
A fallback behavior should be implemented in any case
 +
<br>
 
Default value: n/a
 
Default value: n/a
com.openexchange.documentconverter.RemoteSharePointUrl =
+
 
 +
; com.openexchange.documentconverter.RemoteSharePointUsername =
  
 
The login user name to be used for calls to the SharePoint service
 
The login user name to be used for calls to the SharePoint service
 +
<br>
 
Default value: n/a
 
Default value: n/a
com.openexchange.documentconverter.RemoteSharePointUsername =
+
 
 +
; com.openexchange.documentconverter.RemoteSharePointPassword =
  
 
The password to be used for calls to the SharePoint service
 
The password to be used for calls to the SharePoint service
 +
<br>
 
Default value: n/a
 
Default value: n/a
com.openexchange.documentconverter.RemoteSharePointPassword =
 
 
This item contains a directory, where documents are saved that can't be converted.
 
By default errors are logged but documents are not saved. Set this item to keep documents producing errors.
 
  
 
; com.openexchange.documentconverter.RemoteBaseUrl =
 
; com.openexchange.documentconverter.RemoteBaseUrl =
Line 99: Line 124:
 
Use a remote document conversion webservice to do the actual conversion;
 
Use a remote document conversion webservice to do the actual conversion;
 
Set this entry to the base URL of the remote host http://host[:port]/documentconverterPath;
 
Set this entry to the base URL of the remote host http://host[:port]/documentconverterPath;
leave empty if conversion should happen on the local machine<br>
+
leave empty if conversion should happen on the local machine
 +
<br>
 
Default value: n/a
 
Default value: n/a
  
Line 119: Line 145:
 
; com.openexchange.documentconverter.jobProcessorCount=3
 
; com.openexchange.documentconverter.jobProcessorCount=3
  
This item determines the number of engines working in parallel for job execution. The value needs to be greater or equal to 1, with best performance results about (n+1), where n specifies the number of available CPU cores of the machine the service is running on.   
+
This item determines the number of engines working in parallel for job execution. The value needs to be greater or equal to 1, with best performance results about (n+1), where n specifies the number of available CPU cores of the machine the service is running on.
 
+
<br>
; com.openexchange.documentconverter.jobRestartCount=16
+
Default value: 3
 +
   
 +
; com.openexchange.documentconverter.jobRestartCount=50
  
 
This item determines the maximum number of executed jobs after which a single engine is automatically restarted in order to avoid memory fragmentation and possible memory leaks within one libreaderengine instance,
 
This item determines the maximum number of executed jobs after which a single engine is automatically restarted in order to avoid memory fragmentation and possible memory leaks within one libreaderengine instance,
 +
<br>
 +
Default value: 50
  
 
; com.openexchange.documentconverter.jobExecutionTimeoutMilliseconds=60000
 
; com.openexchange.documentconverter.jobExecutionTimeoutMilliseconds=60000
  
 
This item determines the timeout in milliseconds, after which the execution of a single job is terminated.
 
This item determines the timeout in milliseconds, after which the execution of a single job is terminated.
 +
<br>
 +
Default value: 60000
  
 
; com.openexchange.documentconverter.maxVMemMB=2048
 
; com.openexchange.documentconverter.maxVMemMB=2048
Line 134: Line 166:
 
<br>
 
<br>
 
Set this value to -1 for no upper limit.
 
Set this value to -1 for no upper limit.
 +
<br>
 +
Default value: 2048
  
 
; com.openexchange.documentconverter.maxCacheSizeMB=-1
 
; com.openexchange.documentconverter.maxCacheSizeMB=-1
Line 140: Line 174:
 
<br>
 
<br>
 
Set this value to -1 for no upper limit.
 
Set this value to -1 for no upper limit.
 +
<br>
 +
Default value: -1
  
 
; com.openexchange.documentconverter.maxCacheEntries=-1
 
; com.openexchange.documentconverter.maxCacheEntries=-1
Line 146: Line 182:
 
<br>
 
<br>
 
Set this value to -1 for no upper limit.
 
Set this value to -1 for no upper limit.
 +
<br>
 +
Default value: -1
  
 
; com.openexchange.documentconverter.cacheEntryTimeoutSeconds=2592000
 
; com.openexchange.documentconverter.cacheEntryTimeoutSeconds=2592000
Line 152: Line 190:
 
<br>
 
<br>
 
Set this value to 0 to disable the timeout based removal of cached job results.
 
Set this value to 0 to disable the timeout based removal of cached job results.
 +
<br>
 +
Default value: 2592000
  
 
; com.openexchange.documentconverter.servletLocalFileUrls=false
 
; com.openexchange.documentconverter.servletLocalFileUrls=false
  
 
This item determines, if the documentconverter servlet should be allowed to handle file Urls of the form file://... The file Url itself is a resource that locates files that are locally accessible on the machine, the documentconverter backend is running on.
 
This item determines, if the documentconverter servlet should be allowed to handle file Urls of the form file://... The file Url itself is a resource that locates files that are locally accessible on the machine, the documentconverter backend is running on.
 +
<br>
 +
Default value: false
 +
 +
; com.openexchange.capability.sharepointconversion=false
  
 
Capability to enable the usage of a SharePoint conversion server; capability is only
 
Capability to enable the usage of a SharePoint conversion server; capability is only
 
checked, if a valid SharePoint remote converter has been configured appropriately
 
checked, if a valid SharePoint remote converter has been configured appropriately
 +
<br>
 
Default value: false
 
Default value: false
com.openexchange.capability.sharepointconversion=false
 

Revision as of 13:45, 22 September 2014

A summary of all configuration items, together with each default value, is given below. Although the defaults have been carefully chosen for a real life deployment, the admin should take a closer look at each of them and adjust them accordingly, if necessary.

com.openexchange.documentconverter.installDir=/opt/readerengine

This item contains the the directory of the libreaderengine installation. The libreaderengine installation directory in general contains the ./program directory, which itself contains the engine executables.
Attention: If not set correctly, the complete web service will be nonfunctional.
Default value: "/opt/readerengine"

com.openexchange.documentconverter.cacheDir=/var/spool/open-xchange/documentconverter/readerengine.cache

This item contains the directory that will make up the cache for persistent job data. The directory itself does not need to exist at startup, but the parent directory needs to exist and needs to have write permissions for the user running the servlet, in order for the servlet to create this cache directory at runtime.
Attention: If not set correctly, the complete web service will be nonfunctional.
Default value: "/var/spool/open-xchange/documentconverter/readerengine.cache

com.openexchange.documentconverter.scratchDir=/var/spool/open-xchange/documentconverter/readerengine.scratch

This item contains the directory, that will make up the runtime enironment for the readerengine. The directory itself does not need to exist at startup, but the parent directory needs to exist and needs to have write permissions for the user running the servlet , in order for the servlet to create this cache directory at runtime.
Attention: If not set correctly, the complete web service will be nonfunctional.
Default value: "/var/spool/open-xchange/documentconverter/readerengine.scratch"

com.openexchange.documentconverter.errorDir=

The temporary directory, containing files that could not be loaded due to an error condition or due to a timeout
Default value: n/a

com.openexchange.documentconverter.blacklistFile=/opt/open-xchange/etc/readerengine.blacklist

The list of external document content URLs that are not allowed to be loaded by the readerengine after loading a document. The file itself contains a list of (newline separated) regular expressions. Each external URL is first checked against the list of blacklist URL regular expressions. If the external URL matches one blacklist entry, the external URL is then checked against the list of whitelist URL regular expressions. The behavior in summary is as follows: If the URL is not blacklisted and not whitelisted, it is resolved at runtime. If the URL is blacklisted but not whitelisted, it is not resolved at runtime. If the URL is not blacklisted but whitelisted, it is resolved at runtime. If the URL is blacklisted and whitelisted, it is resolved at runtime. In boolean notation: valid = (!blacklisted) || whitelisted Please note that the regular expressions need to fully qualify the patterns that the URL should be checked against. Upper/Lower cases need to be handled by the regular expression as well. The file itself needs to be UTF-8 encoded to be read appropriately.
Default value: "/opt/open-xchange/etc/readerengine.blacklist"

com.openexchange.documentconverter.whitelistFile=/opt/open-xchange/etc/readerengine.whitelist

The list of external document content URLs that are allowed to be loaded by the readerengine after an external URL matched a blacklist pattern. The file itself contains a list of (newline separated) regular expressions. Each external URL is only checked against the list of whitelist URL regular expressions if it previously matched a pattern in the blacklist file. If the external URL matches one blacklist entry, the external URL is then checked against the list of whitelist URL regular expressions. The behavior in summary is as follows: If the URL is not blacklisted and not whitelisted, it is resolved at runtime. If the URL is blacklisted but not whitelisted, it is not resolved at runtime. If the URL is not blacklisted but whitelisted, it is resolved at runtime. If the URL is blacklisted and whitelisted, it is resolved at runtime. In boolean notation: valid = (!blacklisted) || whitelisted Please note that the regular expressions need to fully qualify the patterns that the URL should be checked against. Upper/Lower cases need to be handled by the regular expression as well. The file itself needs to be UTF-8 encoded to be read appropriately.
Default value: "/opt/open-xchange/etc/readerengine.whitelist"

com.openexchange.documentconverter.urlLinkLimit=200

The external URL link limit specifies the maximum amount of valid external internet URLs (filtered by blacklist and whitelist before), that are tried to get resolved by the engine when loading a document. When this limit is reached, no more external internet URLs are resolved for the current document.
Set to -1 for no upper limit or to 0 to disable the resolving of internet URLs completely
Default value: 200;

com.openexchange.documentconverter.urlLinkProxy =

The external URL link proxy entry specifies a proxy server that is used by the readerengine to resolve external links, contained within a document. Such links are e.g. external http:// graphic links, that are going to be resolved during the filtering process of a readerengine instance. Set this entry to the address of the proxy server: host:port Recognized protocols are http://, https:// and ftp:// Leave empty, if no proxy server should be used by the readerengine
Default value: n/a

com.openexchange.documentconverter.RemoteSharePointUrl =

Use a remote SharePoint service to do MSO to PDF conversions. Set this entry to the URL of the SharePoint host: http://host[:port]/_vti_bin/oxconvert.svc/mex?wsdl If left empty, the corresponding conversion job always returns false. A fallback behavior should be implemented in any case
Default value: n/a

com.openexchange.documentconverter.RemoteSharePointUsername =

The login user name to be used for calls to the SharePoint service
Default value: n/a

com.openexchange.documentconverter.RemoteSharePointPassword =

The password to be used for calls to the SharePoint service
Default value: n/a

com.openexchange.documentconverter.RemoteBaseUrl =

Use a remote document conversion webservice to do the actual conversion; Set this entry to the base URL of the remote host http://host[:port]/documentconverterPath; leave empty if conversion should happen on the local machine
Default value: n/a

com.openexchange.documentconverter.jobProcessorCount=3

This item determines the number of engines working in parallel for job execution. The value needs to be greater or equal to 1, with best performance results about (n+1), where n specifies the number of available CPU cores of the machine the service is running on.
Default value: 3

com.openexchange.documentconverter.jobRestartCount=50

This item determines the maximum number of executed jobs after which a single engine is automatically restarted in order to avoid memory fragmentation and possible memory leaks within one libreaderengine instance,
Default value: 50

com.openexchange.documentconverter.jobExecutionTimeoutMilliseconds=60000

This item determines the timeout in milliseconds, after which the execution of a single job is terminated.
Default value: 60000

com.openexchange.documentconverter.maxVMemMB=2048

This item determines the maximum size in megabytes (MB) of virtual memory that each started readerengine process is allowed to consume. If a job tries to consume more VMem than set via this config item, the processing of the current job for the appropriate readerengine process will be aborted and the underlying process is restarted to avoid memory corruption.
Set this value to -1 for no upper limit.
Default value: 2048

com.openexchange.documentconverter.maxCacheSizeMB=-1

This item determines the maximum size in megabytes (MB) of all persistently cached converter job entries at runtime. A larger value may drastically reduce the time for conversion jobs, e.g. in case of a repeated creation of document previews.
Set this value to -1 for no upper limit.
Default value: -1

com.openexchange.documentconverter.maxCacheEntries=-1

This item determines the maximum number of converter jobs cached at runtime. The value affects the amount of runtime job information to be cached as well as the number of file entries within the cache directory.
Set this value to -1 for no upper limit.
Default value: -1

com.openexchange.documentconverter.cacheEntryTimeoutSeconds=2592000

This item determines the timeout in seconds, after which a cached job result is automatically removed from the cache.
Set this value to 0 to disable the timeout based removal of cached job results.
Default value: 2592000

com.openexchange.documentconverter.servletLocalFileUrls=false

This item determines, if the documentconverter servlet should be allowed to handle file Urls of the form file://... The file Url itself is a resource that locates files that are locally accessible on the machine, the documentconverter backend is running on.
Default value: false

com.openexchange.capability.sharepointconversion=false

Capability to enable the usage of a SharePoint conversion server; capability is only checked, if a valid SharePoint remote converter has been configured appropriately
Default value: false