History log of /forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/backends/pluggable/OnDiskMergeImporter.java
Revision Date Author Comments Expand
17f65d4da9ba08476fa18654d15ca3ec22761e9b 23-Dec-2015 Fabio Pistolesi <fabio.pistolesi@forgerock.com>

OPENDJ-2575 VLV indexed search with offset type control does not give expected results The patch is a two man's effort, most Yannick's than mine, actually. The counter index managed internally from VLV was not correctly populated during import/rebuild, since it is not a Tree known by the entry container. Manage VLVIndex with a specific importer task, as other special indexes do, creating a single key after rebuild/import.

90abd143a7aace72013ddb39bc0358035f170d0e 23-Dec-2015 Ludovic Poitou <ludovic.poitou@forgerock.com>

OPENDJ-2570 - rebuild-index --rebuildDegraded fails if no indexes are degraded. OnDiskMergeImporter.java : Detect an empty index list and log a message.

891b6b1cf89c7bbcd9796d4d664665ec2ec89dfe 17-Dec-2015 Jean-Noël Rouvignac <jean-noel.rouvignac@forgerock.com>

OPENDJ-2561 Rebuild-index: vlv cannot seem to be rebuilt The code was trying to find an AttributeIndex even though it was provided a VLV index name ("vlv.people-by-lastname"). The fix is to only look for an AttributeIndex once we know the index name could not be found by any other means.

4c366e571aa6962755bd9d9470df2ec3fd8e2565 09-Dec-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

OPENDJ-2526: NegativeArraySizeException in OnDiskMergeImporter during OpenAM embedded DJ upgrade (DJ 2.6 -> 3.0) Fix: OffHeapBuffer's InputStream read() must return int between 0 and 255.

b88a555f5a584c355442ee8db6d218c9fe95fa36 17-Nov-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

OPENDJ-2393: Possible index corruption In case of operation cancellation/exception, transactions are rolled back and with them the potential update of indexes' trusted state. That's why in case of transaction rollback we persist the indexes trusted state using another transaction. The number of keys contained in a VLV index is cached. This number can becomes incorrect when transaction updating index keys is aborted. The number of keys is now persisted using a sharded counted. Incorrect PDB RollbackException handling could have cause operations to abort rather than being retried. Refactoring: fix comments, removed dead code (obsoleted by id2children & id2subtree removal) Use specific compact encoding for shared-counter values.

/forgerock/opendj-v3/opendj-dsml-servlet/src/license/THIRD-PARTY.properties /forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/backends/pdb/PDBStorage.java AbstractTree.java CursorTransformer.java DefaultIndex.java EntryContainer.java EntryIDSet.java ID2ChildrenCount.java ID2Entry.java IndexBuffer.java OnDiskMergeImporter.java ShardedCounter.java VLVIndex.java VerifyJob.java spi/Cursor.java spi/WriteOperation.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/ID2ChildrenCountTest.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/OnDiskMergeImporterTest.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/PluggableBackendImplTestCase.java
f09c069e92d051036af2a969fe5289cb7c4826ba 26-Oct-2015 Matthew Swift <matthew.swift@forgerock.com>

OPENDJ-2349: fix deadlocks during subtree deletes and moddn The following changes were made: * ensure that cursors in JE use read committed isolation, not the default which is repeatable read * ensure that records are locked in a consistent order during update operations: dn2id, dn2uri, id2entry, id2childrenCount, and finally the attribute indexes * added support for deleting records directly from cursors * DN2ID: added renameSubtree() method in order to avoid breaking encapsulation when renaming DN keys during moddn operations * ID2Count: split apart updates to parent counts and total counts so that records can be updated in a well defined order. A consequence of this change is that the total count includes base entries * ID2Entry: added openCursor() method to facilitate implementation of subtree deletes and moddn operations.

/forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/backends/jeb/JEStorage.java /forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/backends/pdb/PDBStorage.java CursorTransformer.java DN2ID.java EntryContainer.java ID2Count.java ID2Entry.java OnDiskMergeImporter.java TracedStorage.java spi/SequentialCursor.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/DefaultIndexTest.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/ID2CountTest.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/OnDiskMergeImporterTest.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/PluggableBackendImplTestCase.java
4e47cc1e8ce6f654769127249a363cf0e9a64eec 16-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

OPENDJ-2361: rebuild-index ClearDegradedState option online mode generates an error.

f95e5533c089353bf365a5b6efd4ff6a4e881501 15-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

Fixes from PR #107 comments.

d0fe5d05f13134bae430b3ffd60abd4cbe85c964 15-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

OPENDJ-2321: Name of rebuilt index has changed in rebuild-index output.

00bc759fabe809563e9425ae196ec60ba7d61fb4 12-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

OPENDJ-2331: rebuild-index should fail when rebuilding a non-existing index

d127499b88dfe2d53370025b5d1de485ac6786d5 05-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

Fix: Rebuild id2childrencount with dn2id

e1d2ab73cce4f3ab8faa4f42c0cc0cc92947035b 05-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

OPENDJ-2316: Rebuild index fails with IllegalArgumentException.

7715a0a2eae8b4fbe540ed84e90928f8080078d3 05-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

Refactoring: Remove dead-code, use factory methods.

ba4e4ce138b66bad11e99a5d99398f556e6f5296 05-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

Fix: Exit early if there is no index to rebuild.

0a9a1ad52105f19ee193dc39f201823f67826e9c 05-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

Fix --clearDegradedState final log message.

3f3becc26b7631dad31b5aee4290fc61cf552815 05-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

Fix: Remove redundant clearTree().

dfe6772274d4642b2c332740ea6f65550b8cb855 05-Oct-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

Fix: Ensure latch is released if beforeImport() throws.

ed6d0cef83e5c0cec6ed62f3a0d93950e6a96f05 02-Oct-2015 Fabio Pistolesi <fabio.pistolesi@forgerock.com>

Fix checkstyle

a069e2643d6be5b34309179220b2777d42df13fc 02-Oct-2015 Jean-Noël Rouvignac <jean-noel.rouvignac@forgerock.com>

Final manual cleanup

6f1a7f89a2bc9812c61f71d282ead3299556f876 02-Oct-2015 Jean-Noël Rouvignac <jean-noel.rouvignac@forgerock.com>

Ran UCDetector on the pluggable and PDB backend

ad41085e4ca8a32e29d443591069ec4e94e65067 02-Oct-2015 Jean-Noël Rouvignac <jean-noel.rouvignac@forgerock.com>

AutoRefactor'ed the pluggable and PDB backend

/forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/backends/pdb/PDBBackend.java /forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/backends/pdb/PDBMonitor.java /forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/backends/pdb/PDBStorage.java /forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/backends/pdb/package-info.java AbstractTree.java AttributeIndex.java BackendMonitor.java CursorTransformer.java DN2ID.java DnKeyFormat.java EntryContainer.java ExportJob.java ID2Count.java ID2Entry.java ImportRecord.java IndexBuffer.java IndexFilter.java IndexQuery.java IndexQueryFactoryImpl.java OnDiskMergeImporter.java PersistentCompressedSchema.java RootContainer.java State.java SuccessiveAddsImportStrategy.java SuffixContainer.java TreePreloadComparator.java package-info.java
641e89ef0e15c9edde69f3b8cf82c7dd5f68687a 30-Sep-2015 Yannick Lecaillez <ylecaillez@forgerock.com>

OPENDJ-2016: New on disk merge import strategy based on storage engine.

/forgerock/opendj-v3/opendj-core/src/main/java/com/forgerock/opendj/util/PackedLong.java /forgerock/opendj-v3/opendj-core/src/main/java/org/forgerock/opendj/ldap/AVA.java /forgerock/opendj-v3/opendj-core/src/main/java/org/forgerock/opendj/ldap/ByteSequence.java /forgerock/opendj-v3/opendj-core/src/main/java/org/forgerock/opendj/ldap/ByteSequenceReader.java /forgerock/opendj-v3/opendj-core/src/main/java/org/forgerock/opendj/ldap/ByteString.java /forgerock/opendj-v3/opendj-core/src/main/java/org/forgerock/opendj/ldap/ByteStringBuilder.java /forgerock/opendj-v3/opendj-core/src/main/java/org/forgerock/opendj/ldap/Functions.java /forgerock/opendj-v3/opendj-core/src/main/java/org/forgerock/opendj/ldap/schema/ObjectIdentifierEqualityMatchingRuleImpl.java /forgerock/opendj-v3/opendj-core/src/test/java/org/forgerock/opendj/ldap/ByteStringBuilderTestCase.java /forgerock/opendj-v3/opendj-core/src/test/java/org/forgerock/opendj/ldap/ByteStringTestCase.java /forgerock/opendj-v3/opendj-core/src/test/java/org/forgerock/opendj/ldap/PackedLongTestCase.java /forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/backends/pdb/PDBStorage.java BackendImpl.java CursorTransformer.java DN2ID.java DefaultIndex.java EntryContainer.java EntryIDSet.java ID2Count.java ImportLDIFReader.java ImportStrategy.java Index.java IndexBuffer.java IndexInputBuffer.java IndexOutputBuffer.java OnDiskMergeBufferImporter.java OnDiskMergeImporter.java OnDiskMergeStorageImporter.java SuccessiveAddsImportStrategy.java Suffix.java TracedStorage.java spi/Importer.java spi/Storage.java spi/WriteableTransaction.java /forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/loggers/LoggingCategoryNames.java /forgerock/opendj-v3/opendj-server-legacy/src/main/java/org/opends/server/types/RDN.java /forgerock/opendj-v3/opendj-server-legacy/src/main/resources/org/forgerock/checkstyle/opends-checkstyle.xml /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/TestListener.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/DN2IDTest.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/DefaultIndexTest.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/ID2CountTest.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/OnDiskMergeImporterTest.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/PluggableBackendImplTestCase.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/backends/pluggable/StateTest.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/tasks/TasksTestCase.java /forgerock/opendj-v3/opendj-server-legacy/src/test/java/org/opends/server/util/PackageInfoTestCase.java