Question:
How does Fulltext processing work?
Answer:
After storing a document in a file cabinet with Fulltext support enabled, Fulltext indexing for this document immediately begins.
OCR and Fulltext indexing tasks are generated in the dwsystem.dbo.DWTASKS table with TASK_TYPEs 0 and 2, respectively, and are then processed by the Background Process Service. The Fulltext server itself is only responsible for Fulltext search and does not perform Fulltext indexing. It, however, needs to be running to receive Fulltext data during Fulltext indexing.
Overview of Fulltext TASK_TYPEs in the dwsystem.dbo.DWTASKS table:
TASK_TYPE 0: OCR
TASK_TYPE 1: Intelligent Indexing textshot creation
TASK_TYPE 2: Fulltext index is updated in the DB and exported to the SOLR core, so the Fulltext server has access to it
TASK_TYPE 3: SOLR cleanup after document deletion
TASK_TYPE 4: Upgrade Task from an older DocuWare Version (No longer in use since DocuWare 7; Delete this task manually if you come across it)
TASK_TYPE 5: Fulltext Reset Task (check the settings column for the current status; Documents are processed from highest to lowest dwdocid)
Fulltext data is written into the _PAG and _PGT tables of a file cabinet. This data can be safely deleted, if necessary, provided you remove it from both _PGT and _PAG. You will need to perform a Fulltext reset if you want to regenerate your Fulltext index data afterward.
Note: Unlike in DocuWare 6, the _SEC table does not contain any Fulltext data! Never remove rows of existing documents from the _SEC table!
Once a document is fully indexed on the database side, the Fulltext index is then transferred to the SOLR core. These cores can be found in the Fulltext index storage location defined in your Fulltext connection. This can be configured in the Admin Tool (in 7.0 -7.13), or the DocuWare Server Manager (in versions 7.14 +) -> Data Connections.
The cores are named after the GUID of a file cabinet. This GUID can be checked in the file cabinet configuration part of the web configuration under General -> More Options.
Overview of STATUS values in the _PGT table:
0 = New
1 = Textshot successfully created
2 = Error during textshot creation
3 = Textshot successfully transferred to SOLR
4 = Error during transfer to SOLR
Only after the Fulltext data for a document has been completely transferred to SOLR will you be able to find the document via the Fulltext search.
KBA is applicable to On-premise Organizations ONLY.