com.gigaspaces.internal.cluster.node.impl.processlog.multisourcesinglefile

Class MultiSourceSingleFileReliableAsyncTargetProcessLog

java.lang.Object

com.gigaspaces.internal.cluster.node.impl.processlog.AbstractSingleFileTargetProcessLog

com.gigaspaces.internal.cluster.node.impl.processlog.multisourcesinglefile.MultiSourceSingleFileReliableAsyncTargetProcessLog

All Implemented Interfaces:

IReplicationAsyncTargetProcessLog, IReplicationBatchConsumeAsyncTargetProcessLog, IReplicationTargetProcessLog, IPacketConsumedCallback, IReplicationReliableAsyncTargetProcessLog

public class MultiSourceSingleFileReliableAsyncTargetProcessLog
extends AbstractSingleFileTargetProcessLog
implements IReplicationReliableAsyncTargetProcessLog, IPacketConsumedCallback

A reliable async replication process log which merges multiple participants operations to a single operation. Packet is marked as "pending" if not all of its data arrived. Pending packets are not executed until all of the participants data is arrived. In the meantime the next operations are executed only if they're not interleaving with any pending packets. In such a case, execution will wait until the interleaving packet is consumed. The different process logs synchronization is done using the IReplicationParticipantsMediator component implementation.

Since:

8.0.4

Author:

idan

Field Summary

Fields inherited from class com.gigaspaces.internal.cluster.node.impl.processlog.AbstractSingleFileTargetProcessLog

_specificLogger

Constructor Summary

Constructors

Constructor and Description
MultiSourceSingleFileReliableAsyncTargetProcessLog(MultiSourceSingleFileProcessLogConfig processLogConfig, IReplicationPacketDataBatchConsumer<?> dataConsumer, IReplicationProcessLogExceptionHandler exceptionHandler, IReplicationInFacade replicationInFacade, String name, String groupName, String sourceLookupName, boolean firstHandshakeForTarget, IReplicationGroupHistory groupHistory, IReplicationParticipantsMediator participantsMediator, IProcessMemoryManager processMemoryManager)
MultiSourceSingleFileReliableAsyncTargetProcessLog(MultiSourceSingleFileProcessLogConfig processLogConfig, IReplicationPacketDataBatchConsumer<?> dataConsumer, IReplicationProcessLogExceptionHandler exceptionHandler, IReplicationInFacade replicationInFacade, String myLookupName, String groupName, String sourceLookupName, boolean firstHandshakeForTarget, IReplicationGroupHistory groupHistory, IReplicationParticipantsMediator participantsMediator, long lastProcessedKey, long firstUnprocessedKey, LinkedList<MultiSourceProcessLogPacket> pendingPacketsQueue, HashMap<String,MultiSourceProcessLogPacket> packetsByUidHelperMap, IProcessMemoryManager processMemoryManager)

Method Summary

Modifier and Type	Method and Description
boolean	close(long time, TimeUnit unit)
protected boolean	contentRequiredWhileProcessing()
String	dumpState()
protected boolean	filterDuplicate(IReplicationOrderedPacket packet)
protected void	filterDuplicate(List<IReplicationOrderedPacket> packets)
long	getFirstUnprocessedKey()
long	getLastProcessedKey()
HashMap<String,MultiSourceProcessLogPacket>	getPacketsByUidHelperMap()
LinkedList<MultiSourceProcessLogPacket>	getPendingPacketsQueue()
MultiSourceSingleFileProcessLogConfig	getProcessLogConfig()
protected boolean	isClosed()
protected boolean	isFirstHandshakeForTarget()
protected boolean	isOpen()
protected void	logDeletion(GlobalOrderDeletedBacklogPacket deletedBacklogPacket)
void	packetConsumed(long key)
GlobalOrderProcessLogHandshakeResponse	performHandshake(String memberName, IBacklogHandshakeRequest handshakeRequest)
IProcessResult	process(String sourceLookupName, IReplicationOrderedPacket packet, IReplicationInFilterCallback inFilterCallback)
IProcessResult	processBatch(String sourceLookupName, List<IReplicationOrderedPacket> packets, IReplicationInFilterCallback inFilterCallback)
void	processHandshakeIteration(String sourceMemberName, IHandshakeIteration handshakeIteration)
IProcessResult	processIdleStateData(String sourceLookupName, IIdleStateData idleStateData, IReplicationInFilterCallback inFilterCallback)
IProcessLogHandshakeResponse	resync(IBacklogHandshakeRequest handshakeRequest)
protected void	throwClosedException()
Object	toWireForm(IProcessResult processResult)

Methods inherited from class com.gigaspaces.internal.cluster.node.impl.processlog.AbstractSingleFileTargetProcessLog

createReplicationInContext, getDataConsumer, getExceptionHandler, getGroupHistory, getGroupName, getLogLevel, getReplicationInContext, getReplicationInFacade, getSourceLookupName, throwIfRepetitiveError, toLogMessage

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.gigaspaces.internal.cluster.node.impl.processlog.IReplicationTargetProcessLog

getDataConsumer, toLogMessage

Constructor Detail

MultiSourceSingleFileReliableAsyncTargetProcessLog

public MultiSourceSingleFileReliableAsyncTargetProcessLog(MultiSourceSingleFileProcessLogConfig processLogConfig,
                                                          IReplicationPacketDataBatchConsumer<?> dataConsumer,
                                                          IReplicationProcessLogExceptionHandler exceptionHandler,
                                                          IReplicationInFacade replicationInFacade,
                                                          String name,
                                                          String groupName,
                                                          String sourceLookupName,
                                                          boolean firstHandshakeForTarget,
                                                          IReplicationGroupHistory groupHistory,
                                                          IReplicationParticipantsMediator participantsMediator,
                                                          IProcessMemoryManager processMemoryManager)

MultiSourceSingleFileReliableAsyncTargetProcessLog

public MultiSourceSingleFileReliableAsyncTargetProcessLog(MultiSourceSingleFileProcessLogConfig processLogConfig,
                                                          IReplicationPacketDataBatchConsumer<?> dataConsumer,
                                                          IReplicationProcessLogExceptionHandler exceptionHandler,
                                                          IReplicationInFacade replicationInFacade,
                                                          String myLookupName,
                                                          String groupName,
                                                          String sourceLookupName,
                                                          boolean firstHandshakeForTarget,
                                                          IReplicationGroupHistory groupHistory,
                                                          IReplicationParticipantsMediator participantsMediator,
                                                          long lastProcessedKey,
                                                          long firstUnprocessedKey,
                                                          LinkedList<MultiSourceProcessLogPacket> pendingPacketsQueue,
                                                          HashMap<String,MultiSourceProcessLogPacket> packetsByUidHelperMap,
                                                          IProcessMemoryManager processMemoryManager)

Method Detail

contentRequiredWhileProcessing

protected boolean contentRequiredWhileProcessing()

Specified by:

contentRequiredWhileProcessing in class AbstractSingleFileTargetProcessLog

performHandshake

public GlobalOrderProcessLogHandshakeResponse performHandshake(String memberName,
                                                               IBacklogHandshakeRequest handshakeRequest)
                                                        throws IncomingReplicationOutOfSyncException

Specified by:

performHandshake in interface IReplicationTargetProcessLog

Throws:

IncomingReplicationOutOfSyncException

processBatch

public IProcessResult processBatch(String sourceLookupName,
                                   List<IReplicationOrderedPacket> packets,
                                   IReplicationInFilterCallback inFilterCallback)

Specified by:

processBatch in interface IReplicationTargetProcessLog

logDeletion

protected void logDeletion(GlobalOrderDeletedBacklogPacket deletedBacklogPacket)

filterDuplicate

protected void filterDuplicate(List<IReplicationOrderedPacket> packets)

filterDuplicate

protected boolean filterDuplicate(IReplicationOrderedPacket packet)

throwClosedException

protected void throwClosedException()

process

public IProcessResult process(String sourceLookupName,
                              IReplicationOrderedPacket packet,
                              IReplicationInFilterCallback inFilterCallback)

Specified by:

process in interface IReplicationTargetProcessLog

close

public boolean close(long time,
                     TimeUnit unit)
              throws InterruptedException

Specified by:

close in interface IReplicationTargetProcessLog

Throws:

InterruptedException

processHandshakeIteration

public void processHandshakeIteration(String sourceMemberName,
                                      IHandshakeIteration handshakeIteration)

Specified by:

processHandshakeIteration in interface IReplicationTargetProcessLog

resync

public IProcessLogHandshakeResponse resync(IBacklogHandshakeRequest handshakeRequest)

Specified by:

resync in interface IReplicationTargetProcessLog

toWireForm

public Object toWireForm(IProcessResult processResult)

Specified by:

toWireForm in interface IReplicationTargetProcessLog

isOpen

protected boolean isOpen()

isClosed

protected boolean isClosed()

packetConsumed

public void packetConsumed(long key)

Specified by:

packetConsumed in interface IPacketConsumedCallback

dumpState

public String dumpState()

Specified by:

dumpState in interface IReplicationTargetProcessLog

Specified by:

dumpState in class AbstractSingleFileTargetProcessLog

getProcessLogConfig

public MultiSourceSingleFileProcessLogConfig getProcessLogConfig()

isFirstHandshakeForTarget

protected boolean isFirstHandshakeForTarget()

getLastProcessedKey

public long getLastProcessedKey()

getFirstUnprocessedKey

public long getFirstUnprocessedKey()

getPendingPacketsQueue

public LinkedList<MultiSourceProcessLogPacket> getPendingPacketsQueue()

getPacketsByUidHelperMap

public HashMap<String,MultiSourceProcessLogPacket> getPacketsByUidHelperMap()

processIdleStateData

public IProcessResult processIdleStateData(String sourceLookupName,
                                           IIdleStateData idleStateData,
                                           IReplicationInFilterCallback inFilterCallback)

Specified by:

processIdleStateData in interface IReplicationTargetProcessLog