Commit graph

6506 commits

Author SHA1 Message Date
Ted Lawless
5488b30d99 Fixes ETag quoting and strips white space from generated Etag. 2015-01-21 12:31:33 -05:00
Jim Blake
d382e0efd6 VIVO-869 Don't submit updates while indexer is paused.
When the pause flag is set, the IndexingChangeListener will continue to accumulate changes even if there
are gaps in the stream. The listener will not submit a task until the indexer is unpaused.
2015-01-21 12:30:44 -05:00
Jim Blake
7d16e10357 VIVO-945 Produce more concise log messages when a failure is caused by shutdown. 2015-01-20 18:08:52 -05:00
Jim Blake
d5a497774e VIVO-869 Don't operate on null URIs.
If a UriFinder finds a null URI, issue a warning message. If a null URI is submitted to UpdateUrisTask, ignore it.
2015-01-20 17:22:43 -05:00
Jim Blake
d37c41cf65 VIVO-869 Improve throttling for indexing tasks.
Start the implementation in "paused" state, so tasks submitted before startup() are queued.
Increase the time interval on IndexingChangeListener, so we get larger batches.
Change the RejectedExecutionHandler on the pool to CallerRunsPolicy,
   so if there is no available thread for a work unit then the thread of the task itself will run it.
2015-01-20 17:21:09 -05:00
Jim Blake
fcfd2e7be6 VIVO-869 The display should not barf if no IndexHistory is present. 2015-01-20 16:09:53 -05:00
Jim Blake
83a5523ace VIVO-869 Improve the display
Show exclusions count as separate from deletions count.
When there is an error on the Ajax call, display the error status and stop asking for refreshes.
When a rebuild is requested, redirect to just status, so refreshing the page would not request another rebuild.
2015-01-20 14:06:11 -05:00
Jim Blake
78491234db VIVO-871 Improve performance when reading object properties.
Also, improve display.
2015-01-20 10:25:55 -05:00
Jim Blake
56a640fe44 VIVO-870 Make the number of threads configurable.
Also, clean up the shutdown process and some comments.
2015-01-18 18:45:14 -05:00
Jim Blake
8c3e06fc78 VIVO-870 Move the DocumentModifiers into the configuration. 2015-01-16 16:52:52 -05:00
Jim Blake
4fac4b7576 VIVO-870 Start moving DocumentModifiers into the configuration.
Create the SimpleSparqlQueryDocumentModifier.
Use it to replace VivoISFGrantFields and VivoInformationResourceContextNodeFields.
2015-01-16 11:46:58 -05:00
Jim Blake
7b7ca268c8 VIVO-871 Improve performance when getting VClasses(). 2015-01-16 11:39:56 -05:00
Jim Blake
8d37fc0d18 VIVO-870 Issue a commit() on each PROGRESS event. 2015-01-16 11:38:57 -05:00
Jim Blake
27d3141bb6 VIVO-871 Break out more tasks to improve the timings
UpdateDocumentWorkUnit contains a list of required DocumentModifiers.
They are required but because they are in the list of DocumentModifiers, they are timed like the optional ones.

Similarly, UpdateUrisTask contains a required SearchIndexExcluder.
2015-01-16 11:34:31 -05:00
Jim Blake
0c477945a8 VIVO-870 Clean up exception handling on shutdown. 2015-01-14 15:59:59 -05:00
Jim Blake
982e81aece VIVO-871 Produce timing breakdowns from a developer option 2015-01-13 16:03:16 -05:00
Jim Blake
3fd72a7110 VIVO-870 Confirm that DocumentModifiers are thread-safe. 2015-01-12 18:07:41 -05:00
Jim Blake
dee53e3aac VIVO-870 Implement UpdateStatementsTask.
Also add the listener to support it and get rid of the last of the vestigial classes.
2015-01-12 15:15:16 -05:00
Jim Blake
0602406c53 VIVO-870 Create IndividualDao.getAllIndividualUris()
This replaces IndividualDao.getAllOfThisTypeIterator(). It returns the list that was created instead of
the iterator.

This would require a change to ObjectSourceIFace, but we get rid of it instead. Nobody was using it.
2015-01-11 18:30:28 -05:00
Jim Blake
99c03ce49a Merge branch 'develop' into feature/searchIndexerTry 2015-01-09 16:41:36 -05:00
Jim Blake
39f1ed0b27 VIVO-870 Implement UpdateUrisTask.
At the same time, broke the old IndexBuilder, so no listener and no rebuild.
2015-01-09 16:38:08 -05:00
brianjlowe
5d6780620b VIVO-890 and VIVO-892 ABoxRecomputer performance improvements 2015-01-08 16:40:45 +02:00
Ted Lawless
e51da9ac4e SPARQL update API comments in permission_config.n3
Change security update comment from SSH to HTTPs.  Adjust formatting to match rest of file.
2015-01-08 08:11:41 -05:00
Jim Blake
64624f2b84 VIVO-870 Make IndexingUriFinders configurable.
Use no-argument constructors, supplying data through the ContextModelsUser interface as needed.

Add toString() methods to IndexingUriFinders, DocumentModifiers and SearchIndexExcluders
2015-01-07 17:25:12 -05:00
Jim Blake
2ceab6e3df VIVO-873 Adapt the client code to the new interface.
Create a bridge implementation of SearchIndexerImpl that just wraps around an old IndexBuilder.

Modify client code:
Application, BasicAuthenticator, SearchServiceController, SparqlUpdateApiController,
UpdateUrisInIndex and VClassGroupCache

Rewrite IndexController to use AJAX and to show the current status and history of the indexer events.
2015-01-07 16:18:41 -05:00
Jim Blake
3bc42c1456 Merge branch 'develop' into feature/searchIndexerTry 2015-01-06 16:26:00 -05:00
Jim Blake
8a0d8a2639 VIVO-873 create SearchEngine.documentCount()
Also, remove the vestigial IndexConstants class and two unused methods in PagedSearchController.
2015-01-06 16:04:19 -05:00
Jim Blake
6513d34d86 VIVO-909 Improve documentation of the TripleStoreQuirks 2015-01-05 18:54:36 -05:00
Jim Blake
7639bf43e3 VIVO-907 make the the check for isomorphism more efficient.
Read the file graph into memory and check against that.
2015-01-05 12:58:03 -05:00
Jim Blake
2d44f5bec3 VIVO-873 restructure packages for SearchIndexer
documentBuilding, exclusions, and indexing, under  searchindex instead of search.
2015-01-04 17:19:13 -05:00
Jim Blake
ac39b0799e VIVO-935 Clean up code for search exclusion.
Take out the attribute key in SearchIndexerSetup. Nobody ever sets that attribute.
Take out the VClassGroupCache.removeClassesHiddenFromSearch() method. If nobody sets that attribute, this method does nothing.
Take out VClassGroupDao.removeClassesHiddenFromSearch() and VClassGroupDaoJena.removeClassesHiddenFromSearch(). They are never called.
Take out ClassProhibitedFromSearch interface. It is implemented but never referenced.
Take out FileBasedProhibitedFromSearch. It is never used.
Move ProhibitedFromSearch and ProhibitedFromSearchTest from edu.cornell.mannlib.vitro.webapp.search.beans to edu.cornell.mannlib.vitro.webapp.dao.vclassgroup
2015-01-02 14:01:06 -05:00
Jim Blake
f4f51a096f Merge branch 'feature/pelletRemoval' into develop 2014-12-31 15:13:37 -05:00
Jim Blake
b8ad8b64d0 VIVO-778 remove the pellet libraries. 2014-12-31 15:09:39 -05:00
Jim Blake
3905e84882 VIVO-778 Remove references to pellet. 2014-12-31 15:09:13 -05:00
Jim Blake
297d78134b VIVO-778 Remove the Pellet kluge in Jena.
This modification to BaseInfGraph was required to make Jena 2.10.1 compatible with Pellet 2.3.1
2014-12-31 15:08:36 -05:00
Jim Blake
51f537f0bc VIVO-778 Remove Pellet from SimpleReasoner unit tests. 2014-12-31 14:58:12 -05:00
Jim Blake
ac37a7f8e9 Merge pull request #7 from patrickmcelwee/fix_date_precision_display
Allow getFormat function to accept qualified date precisions
2014-12-30 17:04:01 -05:00
Patrick McElwee
4905c10be0 Allow getFormat function to accept qualified date precisions
This allows the date precision to be a fully qualified URL, like
"http://vivoweb.org/ontology/core#yearPrecision", while still accepting
"yearPrecision"
2014-12-30 16:54:01 -05:00
Jim Blake
08efbe2735 Don't offer Pellet reasoning on ingest. 2014-12-21 09:12:23 -05:00
Jim Blake
b6b8540546 VIVO-778 Let the TBoxReasoner provide its own OntModelSpec. 2014-12-21 09:11:22 -05:00
Jim Blake
22658eec7b Merge branch 'feature/elk' into develop 2014-12-17 17:46:19 -05:00
Jim Blake
8382c2620a VIVO-778 Use JFact as the TBox reasoner, instead of Pellet.
There are still some differences between the two, and I expect  some answers from Jon and Brian regarding irregularities in the ontologies.

The Pellet libraries have not yet been removed.
2014-12-17 17:44:21 -05:00
Tim Worrall
5c7d8990e8 VIVO-899: brought back the 3.1 version of HTTPClient jar file. 2014-12-17 10:45:24 -05:00
Jim Blake
dad574d33a Merge branch 'develop' into feature/elk 2014-12-11 16:24:52 -05:00
Jim Blake
f339f1864f VIVO-863 get rid of GuardAgainstUnmigratedRDB
It was only useful for the transition from 1.6 to 1.7, and it was a problem when someone used a triple-store other than SDB.
2014-12-11 16:12:42 -05:00
Jim Blake
73b76a6e90 VIVO-933 Read PropertyConfig.n3 into an existing model, just once. 2014-12-11 15:51:59 -05:00
Jim Blake
d48d6f63ec Merge branch 'develop' into feature/fauxEditing 2014-12-10 17:41:37 -05:00
Jim Blake
481d3fc1d8 VIVO-695 VIVO-699 Refactor and optimize the PropertyRestrictionBean
Formerly the PropertyRestrictionPolicyHelper.
2014-12-10 17:39:06 -05:00
hudajkhan
05fe47e50a needed access to rdfservice in nyccsc 2014-12-10 12:36:37 -05:00
Tim Worrall
da9e244c18 Merge branch 'feature/fauxEditing' of https://github.com/vivo-project/Vitro into feature/fauxEditing 2014-12-09 13:16:57 -05:00