net.openhft.chronicle.queue.impl.single

Class SingleChronicleQueue

java.lang.Object

net.openhft.chronicle.core.io.AbstractCloseable

net.openhft.chronicle.queue.impl.single.SingleChronicleQueue

All Implemented Interfaces:

Closeable, AutoCloseable, net.openhft.chronicle.core.io.CloseableTracer, net.openhft.chronicle.core.io.QueryCloseable, net.openhft.chronicle.core.io.ReferenceOwner, ChronicleQueue, RollingChronicleQueue

public class SingleChronicleQueue
extends net.openhft.chronicle.core.io.AbstractCloseable
implements RollingChronicleQueue

Field Summary

Fields

Modifier and Type	Field and Description
static String	DISK_SPACE_CHECKER_NAME
protected boolean	doubleBuffer
protected @NotNull net.openhft.chronicle.core.threads.EventLoop	eventLoop
static String	LIBRARY_NAME
protected @NotNull TableStore<SCQMeta>	metaStore
protected @NotNull WireStorePool	pool
static String	QUEUE_METADATA_FILE
protected int	sourceId
protected ThreadLocal<ExcerptAppender>	strongExcerptAppenderThreadLocal
static String	SUFFIX

Fields inherited from class net.openhft.chronicle.core.io.AbstractCloseable

CHECK_THREAD_SAFETY, WARN_NS

Fields inherited from interface net.openhft.chronicle.queue.ChronicleQueue

TEST_BLOCK_SIZE

Fields inherited from interface net.openhft.chronicle.core.io.ReferenceOwner

INIT

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	SingleChronicleQueue(@NotNull SingleChronicleQueueBuilder builder)

Method Summary

Modifier and Type	Method and Description
@NotNull ExcerptAppender	acquireAppender() Returns a ExcerptAppender for this ChronicleQueue that is local to the current Thread.
<T> void	addCloseListener(net.openhft.chronicle.core.io.Closeable key)
WriteLock	appendLock()
long	blockSize()
long	bufferCapacity()
boolean	buffered()
void	clear() Removes all the excerpts in the current ChronicleQueue.
void	closeStore(@Nullable SingleChronicleQueueStore store)
long	countExcerpts(long fromIndex, long toIndex) Will give you the number of excerpts between 2 index?s ( as exists on the current file system ).
@NotNull ExcerptTailer	createTailer() Creates and returns a new ExcerptTailer for this ChronicleQueue.
@NotNull ExcerptTailer	createTailer(String id) Creates and returns a new ExcerptTailer for this ChronicleQueue with the given unique id.
int	cycle()
int	cycle(net.openhft.chronicle.core.time.TimeProvider timeProvider)
protected CycleCalculator	cycleCalculator(ZoneId zoneId)
int	deltaCheckpointInterval() Returns the Delta Checkpoint Interval for this ChronicleQueue.
@NotNull String	dump() Creates and returns a new String representation of this ChronicleQueue in YAML-format.
void	dump(@NotNull Writer writer, long fromIndex, long toIndex) Dumps a representation of this ChronicleQueue to the provided writer in YAML-format.
@NotNull String	dumpLastHeader() Creates and returns a new String representation of this ChronicleQueue's last header in YAML-format.
long	entryCount() Counts the number of messages in this queue instance.
long	epoch()
@NotNull net.openhft.chronicle.core.threads.EventLoop	eventLoop()
long	exceptsPerCycle(int cycle)
@NotNull File	file() Returns the base directory where ChronicleQueue stores its data.
@NotNull String	fileAbsolutePath() Returns the absolute path of the base directory where ChronicleQueue stores its data.
protected int	fileToCycle(File queueFile)
protected void	finalize()
int	firstCycle()
long	firstIndex() Returns the lowest valid index available for this ChronicleQueue, or Long.MAX_VALUE if no such index exists.
int	indexCount()
int	indexSpacing()
long	lastAcknowledgedIndexReplicated() when using replication to another host, this is the highest last index that has been confirmed to have been read by all of the remote host(s).
void	lastAcknowledgedIndexReplicated(long newValue) Sets the last index that has been sent to a remote host.
int	lastCycle()
long	lastIndexReplicated() when using replication to another host, this is the maxiumum last index that has been sent to any of the remote host(s).
void	lastIndexReplicated(long indexReplicated) Sets the last index that has been sent to a remote host.
NavigableSet<Long>	listCyclesBetween(int lowerCycle, int upperCycle)
TableStore	metaStore()
protected @NotNull ExcerptAppender	newAppender()
int	nextCycle(int cycle, @NotNull TailerDirection direction) the next available cycle, no cycle will be created by this method, this method is typically used by a tailer to jump to the next cycle when the cycles are not adjacent.
@NotNull Consumer<net.openhft.chronicle.bytes.BytesRingBufferStats>	onRingBufferStats()
long	overlapSize()
protected void	performClose()
@NotNull QueueLock	queueLock()
void	refreshDirectoryListing() Refreshed this ChronicleQueue's view of the directory used for storing files.
@NotNull RollCycle	rollCycle() Returns the RollCycle for this ChronicleQueue.
int	sourceId() Returns the source id.
protected StoreFileListener	storeFileListener()
@Nullable SingleChronicleQueueStore	storeForCycle(int cycle, long epoch, boolean createIfAbsent, SingleChronicleQueueStore oldStore)
protected @Nullable net.openhft.chronicle.core.values.LongValue	tableStoreAcquire(CharSequence key, long index)
long	tableStoreGet(CharSequence key)
void	tableStorePut(CharSequence key, long index)
protected boolean	threadSafetyCheck(boolean isUsed)
@NotNull net.openhft.chronicle.core.time.TimeProvider	time() Returns the TimeProvider for this ChronicleQueue.
@NotNull String	toString()
@NotNull net.openhft.chronicle.wire.WireType	wireType() Returns the WireType used for this ChronicleQueue.

Methods inherited from class net.openhft.chronicle.core.io.AbstractCloseable

assertCloseablesClosed, clearUsedByThread, close, createdHere, disableCloseableTracing, enableCloseableTracing, isClosed, isClosing, isInUserThread, performCloseInBackground, referenceId, resetUsedByThread, shouldPerformCloseInBackground, shouldWaitForClosed, throwExceptionIfClosed, throwExceptionIfClosedInSetter, unmonitor, waitForClosed, warnAndCloseIfNotClosed

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface net.openhft.chronicle.queue.ChronicleQueue

createAppender, dump, methodWriter, methodWriterBuilder, single, singleBuilder, singleBuilder, singleBuilder, singleBuilder

Methods inherited from interface net.openhft.chronicle.core.io.Closeable

close, closeQuietly, closeQuietly, notifyClosing

Methods inherited from interface net.openhft.chronicle.core.io.QueryCloseable

isClosed, isClosing, throwExceptionIfClosed

Methods inherited from interface net.openhft.chronicle.core.io.ReferenceOwner

referenceName, temporary

Field Detail

LIBRARY_NAME

public static final String LIBRARY_NAME

See Also:

Constant Field Values

SUFFIX

public static final String SUFFIX

See Also:

Constant Field Values

QUEUE_METADATA_FILE

public static final String QUEUE_METADATA_FILE

See Also:

Constant Field Values

DISK_SPACE_CHECKER_NAME

public static final String DISK_SPACE_CHECKER_NAME

See Also:

Constant Field Values

eventLoop

@NotNull
protected final @NotNull net.openhft.chronicle.core.threads.EventLoop eventLoop

metaStore

@NotNull
protected final @NotNull TableStore<SCQMeta> metaStore

pool

@NotNull
protected final @NotNull WireStorePool pool

sourceId

protected int sourceId

doubleBuffer

protected final boolean doubleBuffer

strongExcerptAppenderThreadLocal

protected final ThreadLocal<ExcerptAppender> strongExcerptAppenderThreadLocal

Constructor Detail

SingleChronicleQueue

protected SingleChronicleQueue(@NotNull
                               @NotNull SingleChronicleQueueBuilder builder)

Method Detail

cycleCalculator

protected CycleCalculator cycleCalculator(ZoneId zoneId)

sourceId

public int sourceId()

Description copied from interface: ChronicleQueue

Returns the source id.

The source id is non-negative.

Specified by:

sourceId in interface ChronicleQueue

Returns:

the source id

lastAcknowledgedIndexReplicated

public long lastAcknowledgedIndexReplicated()

when using replication to another host, this is the highest last index that has been confirmed to have been read by all of the remote host(s).

Specified by:

lastAcknowledgedIndexReplicated in interface ChronicleQueue

Returns:

the last index that was replicated and acknowledged by all remote hosts

lastAcknowledgedIndexReplicated

public void lastAcknowledgedIndexReplicated(long newValue)

Description copied from interface: ChronicleQueue

Sets the last index that has been sent to a remote host.

Specified by:

lastAcknowledgedIndexReplicated in interface ChronicleQueue

Parameters:

newValue - last acknowledged index that has been sent to the remote host(s).

See Also:

ChronicleQueue.lastAcknowledgedIndexReplicated()

refreshDirectoryListing

public void refreshDirectoryListing()

Description copied from interface: ChronicleQueue

Refreshed this ChronicleQueue's view of the directory used for storing files.

Invoke this method if you delete file from a chronicle-queue directory

The problem solved by this is that we cache the structure of the queue directory in order to reduce file system adds latency. Calling this method, after deleting .cq4 files, will update the internal caches accordingly,

Specified by:

refreshDirectoryListing in interface ChronicleQueue

lastIndexReplicated

public long lastIndexReplicated()

when using replication to another host, this is the maxiumum last index that has been sent to any of the remote host(s).

Specified by:

lastIndexReplicated in interface ChronicleQueue

Returns:

the last index that was replicated to a remote host

lastIndexReplicated

public void lastIndexReplicated(long indexReplicated)

Description copied from interface: ChronicleQueue

Sets the last index that has been sent to a remote host.

Specified by:

lastIndexReplicated in interface ChronicleQueue

Parameters:

indexReplicated - last index that has been sent to the remote host.

See Also:

ChronicleQueue.lastIndexReplicated()

clear

public void clear()

Description copied from interface: ChronicleQueue

Removes all the excerpts in the current ChronicleQueue.

Specified by:

clear in interface ChronicleQueue

file

@NotNull
public @NotNull File file()

Description copied from interface: ChronicleQueue

Returns the base directory where ChronicleQueue stores its data.

Specified by:

file in interface ChronicleQueue

Returns:

the base directory where ChronicleQueue stores its data

fileAbsolutePath

@NotNull
public @NotNull String fileAbsolutePath()

Description copied from interface: ChronicleQueue

Returns the absolute path of the base directory where ChronicleQueue stores its data.

This value might be cached, as getAbsolutePath is expensive

Specified by:

fileAbsolutePath in interface ChronicleQueue

Returns:

the absolute path of the base directory where ChronicleQueue stores its data

dumpLastHeader

@NotNull
public @NotNull String dumpLastHeader()

Description copied from interface: ChronicleQueue

Creates and returns a new String representation of this ChronicleQueue's last header in YAML-format.

Specified by:

dumpLastHeader in interface ChronicleQueue

Returns:

a new String representation of this ChronicleQueue's last header in YAML-format

dump

@NotNull
public @NotNull String dump()

Description copied from interface: ChronicleQueue

Creates and returns a new String representation of this ChronicleQueue in YAML-format.

Specified by:

dump in interface ChronicleQueue

Returns:

a new String representation of this ChronicleQueue in YAML-format

dump

public void dump(@NotNull
                 @NotNull Writer writer,
                 long fromIndex,
                 long toIndex)

Description copied from interface: ChronicleQueue

Dumps a representation of this ChronicleQueue to the provided writer in YAML-format. Dumping will be made from the provided (@code fromIndex) (inclusive) to the provided toIndex (inclusive).

Specified by:

dump in interface ChronicleQueue

Parameters:

writer - to write to

fromIndex - first index (inclusive)

toIndex - last index (inclusive)

indexCount

public int indexCount()

Specified by:

indexCount in interface RollingChronicleQueue

Returns:

the max size of each index and also the number number of index arrays. indexCount^2 is the maximum number of index queue entries.

indexSpacing

public int indexSpacing()

Specified by:

indexSpacing in interface RollingChronicleQueue

Returns:

the spacing between indexed entries. If 1 then every entry is indexed.

epoch

public long epoch()

Specified by:

epoch in interface RollingChronicleQueue

rollCycle

@NotNull
public @NotNull RollCycle rollCycle()

Description copied from interface: ChronicleQueue

Returns the RollCycle for this ChronicleQueue.

Specified by:

rollCycle in interface ChronicleQueue

Specified by:

rollCycle in interface RollingChronicleQueue

Returns:

the RollCycle for this ChronicleQueue

See Also:

RollCycle

deltaCheckpointInterval

public int deltaCheckpointInterval()

Description copied from interface: ChronicleQueue

Returns the Delta Checkpoint Interval for this ChronicleQueue.

The value returned is always a power of two.

Specified by:

deltaCheckpointInterval in interface ChronicleQueue

Specified by:

deltaCheckpointInterval in interface RollingChronicleQueue

Returns:

the checkpointInterval used by delta wire

buffered

public boolean buffered()

Returns:

if we uses a ring buffer to buffer the appends, the Excerpts are written to the Chronicle Queue using a background thread

eventLoop

@NotNull
public @NotNull net.openhft.chronicle.core.threads.EventLoop eventLoop()

newAppender

@NotNull
protected @NotNull ExcerptAppender newAppender()

storeFileListener

protected StoreFileListener storeFileListener()

acquireAppender

@NotNull
public @NotNull ExcerptAppender acquireAppender()

Description copied from interface: ChronicleQueue

Returns a ExcerptAppender for this ChronicleQueue that is local to the current Thread.

An Appender can be used to store new excerpts sequentially to the queue.

Appenders are NOT thread-safe. Sharing an Appender across threads will lead to errors and unpredictable behaviour.

This method returns a ThreadLocal appender, so does not produce any garbage, hence it's safe to simply call this method every time an appender is needed.

Specified by:

acquireAppender in interface ChronicleQueue

Returns:

Returns a ExcerptAppender for this ChronicleQueue that is local to the current Thread

queueLock

@NotNull
public @NotNull QueueLock queueLock()

Specified by:

queueLock in interface RollingChronicleQueue

appendLock

public WriteLock appendLock()

Returns:

true if appends are locked, sink replication handlers use this mechanism to prevent appends being written to.

createTailer

@NotNull
public @NotNull ExcerptTailer createTailer(String id)

Description copied from interface: ChronicleQueue

Creates and returns a new ExcerptTailer for this ChronicleQueue with the given unique id.

The id is used to persistently store the latest index for the trailer. Any new Trailer with a previously used id will continue where the old one left off. Tailers are NOT thread-safe. Sharing a Tailer across threads will lead to errors and unpredictable behaviour.

If the provided id is null, the Trailer will be unnamed and this is equivalent to invoking ChronicleQueue.createTailer().

Specified by:

createTailer in interface ChronicleQueue

Parameters:

id - unique id for a tailer which uses to track where it was up to

Returns:

a new ExcerptTailer for this ChronicleQueue with the given unique id

See Also:

ChronicleQueue.createTailer()

createTailer

@NotNull
public @NotNull ExcerptTailer createTailer()

Description copied from interface: ChronicleQueue

Creates and returns a new ExcerptTailer for this ChronicleQueue. Tailers are NOT thread-safe. Sharing a Tailer across threads will lead to errors and unpredictable behaviour. The tailor is created at the start, so unless you are using named tailors, this method is the same as calling `net.openhft.chronicle.queue.ChronicleQueue#createTailer(java.lang.String).toStart()`

Specified by:

createTailer in interface ChronicleQueue

Returns:

a new ExcerptTailer to read sequentially.

See Also:

ChronicleQueue.createTailer(String)

storeForCycle

@Nullable
public final @Nullable SingleChronicleQueueStore storeForCycle(int cycle,
                                                                         long epoch,
                                                                         boolean createIfAbsent,
                                                                         SingleChronicleQueueStore oldStore)

Specified by:

storeForCycle in interface RollingChronicleQueue

Parameters:

cycle - the cycle

epoch - an epoch offset as the number of number of milliseconds since January 1, 1970, 00:00:00 GMT

createIfAbsent - create missing stores if true, or return null if missing

Returns:

the WireStore associated with this cycle, or null if !createIfAbsent is false and absent

nextCycle

public int nextCycle(int cycle,
                     @NotNull
                     @NotNull TailerDirection direction)
              throws ParseException

Description copied from interface: RollingChronicleQueue

the next available cycle, no cycle will be created by this method, this method is typically used by a tailer to jump to the next cycle when the cycles are not adjacent.

Specified by:

nextCycle in interface RollingChronicleQueue

Parameters:

cycle - the current cycle

direction - the direction

Returns:

the next available cycle from the current cycle, or -1 if there is no next cycle

Throws:

ParseException

exceptsPerCycle

public long exceptsPerCycle(int cycle)

countExcerpts

public long countExcerpts(long fromIndex,
                          long toIndex)
                   throws IllegalStateException

Will give you the number of excerpts between 2 index?s ( as exists on the current file system ). If intermediate chronicle files are removed this will effect the result.

Specified by:

countExcerpts in interface RollingChronicleQueue

Parameters:

fromIndex - the lower index

toIndex - the higher index

Returns:

will give you the number of excerpts between 2 index?s. It?s not as simple as just subtracting one number from the other.

Throws:

IllegalStateException - if we are not able to read the chronicle files

listCyclesBetween

public NavigableSet<Long> listCyclesBetween(int lowerCycle,
                                            int upperCycle)
                                     throws ParseException

Throws:

ParseException

addCloseListener

public <T> void addCloseListener(net.openhft.chronicle.core.io.Closeable key)

performClose

protected void performClose()

Specified by:

performClose in class net.openhft.chronicle.core.io.AbstractCloseable

finalize

protected void finalize()
                 throws Throwable

Overrides:

finalize in class Object

Throws:

Throwable

closeStore

public final void closeStore(@Nullable
                             @Nullable SingleChronicleQueueStore store)

cycle

public final int cycle()

Specified by:

cycle in interface RollingChronicleQueue

Returns:

the current cycle

cycle

public final int cycle(net.openhft.chronicle.core.time.TimeProvider timeProvider)

firstIndex

public long firstIndex()

Description copied from interface: ChronicleQueue

Returns the lowest valid index available for this ChronicleQueue, or Long.MAX_VALUE if no such index exists.

Specified by:

firstIndex in interface ChronicleQueue

Returns:

the lowest valid index available for this ChronicleQueue, or Long.MAX_VALUE if no such index exists

entryCount

public long entryCount()

Description copied from interface: RollingChronicleQueue

Counts the number of messages in this queue instance.

Specified by:

entryCount in interface RollingChronicleQueue

Returns:

the number of document excerpts

firstCycle

public int firstCycle()

Specified by:

firstCycle in interface RollingChronicleQueue

Returns:

the first cycle number found, or Integer.MAX_VALUE is none found.

lastCycle

public int lastCycle()

Specified by:

lastCycle in interface RollingChronicleQueue

Returns:

the lastCycle available or Integer.MIN_VALUE if none is found.

fileToCycle

protected int fileToCycle(File queueFile)

onRingBufferStats

@NotNull
public @NotNull Consumer<net.openhft.chronicle.bytes.BytesRingBufferStats> onRingBufferStats()

blockSize

public long blockSize()

overlapSize

public long overlapSize()

wireType

@NotNull
public @NotNull net.openhft.chronicle.wire.WireType wireType()

Description copied from interface: ChronicleQueue

Returns the WireType used for this ChronicleQueue.

For example, the WireType could be WireTypes.TEXT or WireTypes.BINARY.

Specified by:

wireType in interface ChronicleQueue

Returns:

Returns the wire type used for this ChronicleQueue

See Also:

WireType

bufferCapacity

public long bufferCapacity()

toString

@NotNull
public @NotNull String toString()

Overrides:

toString in class net.openhft.chronicle.core.io.AbstractCloseable

time

@NotNull
public @NotNull net.openhft.chronicle.core.time.TimeProvider time()

Description copied from interface: ChronicleQueue

Returns the TimeProvider for this ChronicleQueue.

Specified by:

time in interface ChronicleQueue

Returns:

the TimeProvider for this ChronicleQueue

See Also:

TimeProvider

metaStore

public TableStore metaStore()

threadSafetyCheck

protected boolean threadSafetyCheck(boolean isUsed)

Overrides:

threadSafetyCheck in class net.openhft.chronicle.core.io.AbstractCloseable

tableStorePut

public void tableStorePut(CharSequence key,
                          long index)

tableStoreAcquire

@Nullable
protected @Nullable net.openhft.chronicle.core.values.LongValue tableStoreAcquire(CharSequence key,
                                                                                            long index)

tableStoreGet

public long tableStoreGet(CharSequence key)