| document | Document(English) | 文档（中文） |
| Options |
| indexNestLevel | 3 |
| checksumLevel | 0 |
| entropyAlgo | kNoEntropy |
| debugLevel | 0 |
| minPrefetchPages | 0 |
| indexNestScale | 8 |
| forceLegacyZvType | false |
| useSuffixArrayLocalMatch | false |
| enableStatistics | false |
| warmupLevel | kIndex |
| builderMinLevel | 0 |
| optimizeCpuL3Cache | true |
| indexTempLevel | 0 |
| offsetArrayBlockUnits | 0 |
| acceptCompressionRatio | 0.800000 |
| nltAcceptCompressionRatio | 0.400000 |
| estimateCompressionRatio | 0.200000 |
| keyRankCacheRatio | 0.001000 |
| sampleRatio | 0.010000 |
| localTempDir | /storage/mytopling/..//tmp |
| indexType | Mixed_XL_256_32_FL |
| softZipWorkingMemLimit | 16.000 GiB |
| hardZipWorkingMemLimit | 32.000 GiB |
| smallTaskMemory | 1.172 GiB |
| minDictZipValueSize | 10.000 MiB |
| maxSampleLen | 16.000 KiB |
| keyPrefixLen | 4 |
| indexCacheRatio | 0.000000 |
| minPreadLen | -1 |
| compressGlobalDict | false |
| indexMemAsHugePage | false |
| bytesPerBatch | 262144 |
| recordsPerBatch | 500 |
| speedupNestTrieBuild | true |
| fileWriterBufferSize | 128.000 KiB |
| fixedLenIndexCacheLeafSize | 512 B |
| enableApproximateKeyAnchors | true |
| enableCompositeUintIndex | false |
| enableFixedLenHoleIndex | false |
| enableUintIndex | true |
| preadUseRocksdbFS | false |
| needCompactMaxLevel | 2 |
|
|---|
| Env |
| DictZipBlobStore_zipThreads | -1 |
| ToplingZipTable_nltBuildThreads | 5 |
|
|---|
| num_new_table | 7137 |
| CompressInfo |
| gdict_raw_size | 0.000 GB |
| index_raw_size | 7.984 GB |
| index_zip_size | 0.692 GB |
| index:zip/raw | 0.087 |
| index:raw/zip | 11.543 |
| value_raw_size | 144.976 GB |
| value_zip_size | 145.733 GB |
| value:zip/raw | 1.005 |
| value:raw/zip | 0.995 |
| :raw:key/all | 0.052 |
| :raw:val/all | 0.948 |
| :zip:key/all | 0.005 |
| :zip:val/all | 0.995 |
|
|---|
| Statistics |
| sumWorkingMem | 0 B |
| sumWaitingMem | 0 B |
| waitQueueSize | 0 |
| sumKeyLen | 35.263 GiB |
| sumValueLen | 439.365 GiB |
| sumUserKeyLen | 24.612 GiB |
| sumUserKeyNum | 1429487980 |
| sumEntryNum | 1429487980 |
| writeSpeed+seq | 13.226 MiB/s |
| writeSpeed-seq | 12.929 MiB/s |
| zipServerPID | -1 |
|
|---|
| Iterator |
| cumu_iter_num | 0 |
| live_iter_num | 0 |
| iter_seek_cnt | 0 |
| iter_next_cnt | 0 |
| iter_prev_cnt | 0 |
| iter_key_len | 0 |
| iter_val_len | 0 |
|
|---|
| gdzip-reader | c632605c0344e6cbe799b3f941f63b6c7514086a
Author: rockeet <rockeet@gmail.com>
Date: Tue Nov 19 21:07:25 2024 +0800
Add stub `AutoStartZipServer` for community version
When compiled as community version, `HAS_TOPLING_ROCKS` will not
be defined.
ToplingZipTableBuilder is just for enterprise version, in which
case `HAS_TOPLING_ROCKS` is defined.
g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7)
Copyright (C) 2022 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
cpu_flag: -march=native -mbmi -mbmi2
|
| gdzip-builder | 255949aa4c3652d80b58964fa265eb30db63c3aa
Author: rockeet <rockeet@gmail.com>
Date: Sat Nov 16 20:31:28 2024 +0800
Add maxSampleLen for global dict sampling
g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7)
Copyright (C) 2022 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
cpu_flag: -march=native -mbmi -mbmi2
|
| topling-sst | 612f5d7a51f46ca5107beeadc629b01be8029e4c
Author: rockeet <rockeet@gmail.com>
Date: Wed Nov 13 14:16:34 2024 +0800
Bugfix: FragmentedRangeTombstoneIterator cons refs icmp
FragmentedRangeTombstoneIterator constructor stores pointer
to icmp(InternalKeyComparator)
g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7)
Copyright (C) 2022 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
cpu_flag: -march=native -mbmi -mbmi2
|
| topling-zbs | d44dd5ff72707128fe3c916077b43d2093c01f7c
Author: leipeng <rockeet@gmail.com>
Date: Sun Oct 27 23:38:26 2024 +0800
Fix for msvc, when toplingdb on msvc
GIT_PATH_ARG = src/terark/zbs tools/zbs
g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7)
Copyright (C) 2022 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
INCS = -Isrc -I3rdparty/zstd -Iboost-include
DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API=
CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector
WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3
RLS_FLAGS = -O3 -DNDEBUG -g3
WITH_BMI2 = 1
compile_cpu_flag: -march=haswell -mbmi -mbmi2
LDFLAGS = -fPIC -rdynamic
|
| topling-fsa | 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b
Author: leipeng <peng@topling.cn>
Date: Thu Nov 7 15:22:45 2024 +0800
Makefile: fix for x86_64 CPU older than haswell
GIT_PATH_ARG = src/terark/fsa tools/fsa
g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7)
Copyright (C) 2022 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
INCS = -Isrc -I3rdparty/zstd -Iboost-include
DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API=
CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector
WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3
RLS_FLAGS = -O3 -DNDEBUG -g3
WITH_BMI2 = 1
compile_cpu_flag: -march=haswell -mbmi -mbmi2
LDFLAGS = -fPIC -rdynamic
|
| topling-core | 81964c21ebbcc178d8e99dae0fbf61bded2729cc
Author: rockeet <rockeet@gmail.com>
Date: Mon Nov 11 21:28:46 2024 +0800
Makefile: fix gen git-version-*.cpp
GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs
g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7)
Copyright (C) 2022 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
INCS = -Isrc -I3rdparty/zstd -Iboost-include
DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API=
CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector
WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3
RLS_FLAGS = -O3 -DNDEBUG -g3
WITH_BMI2 = 1
compile_cpu_flag: -march=haswell -mbmi -mbmi2
LDFLAGS = -fPIC -rdynamic
|
| ToplingDB |
| build_type | release |
| CPU_ARCH | -march=haswell |
| CXXFLAGS | -fPIC -g3 -Wall -Wno-shadow -Wno-deprecated-builtins -march=haswell -std=gnu++17 -faligned-new -fno-builtin-memcmp -isystem third-party/gtest-1.8.1/fused-src -O2 -Woverloaded-virtual -Wnon-virtual-dtor -Wno-missing-field-initializers -Wno-invalid-offsetof |
| CXXDEFS | -DROCKSDB_DLL -DROCKSDB_USE_RTTI -DROCKSDB_NO_DYNAMIC_EXTENSION -DUSE_SERVER_STATS=1 -DOPENSSL_API_1_1=1 -DSIDE_PLUGIN_WITH_YAML=1 -DGITHUB_TOPLING_ZIP="https://github.com/topling/topling-zip" -DZSTD -DHAS_TOPLING_CSPP_MEMTABLE -DHAS_TOPLING_CSPP_WBWI -DHAS_TOPLING_SST -DHAS_TOPLING_SST -DHAS_TOPLING_ROCKS -DHAVE_ALIGNED_NEW -DROCKSDB_PLATFORM_POSIX -DROCKSDB_LIB_IO_POSIX -DOS_LINUX -DROCKSDB_FALLOCATE_PRESENT -DSNAPPY -DGFLAGS=1 -DZLIB -DBZIP2 -DLZ4 -DROCKSDB_MALLOC_USABLE_SIZE -DROCKSDB_PTHREAD_ADAPTIVE_MUTEX -DROCKSDB_BACKTRACE -DROCKSDB_RANGESYNC_PRESENT -DROCKSDB_SCHED_GETCPU_PRESENT -DROCKSDB_AUXV_GETAUXVAL_PRESENT -DHAVE_UINT128_EXTENSION -DNDEBUG |
| CXXINCS | -Isideplugin/rockside/3rdparty/rapidyaml -Isideplugin/rockside/3rdparty/rapidyaml/src -Isideplugin/rockside/3rdparty/rapidyaml/ext/c4core/src -Isideplugin/topling-zip/3rdparty/zstd/zstd -Isideplugin/topling-zip/3rdparty/zstd/zstd/dictBuilder -Isideplugin/topling-zip/src -Isideplugin/topling-zip/boost-include -Isideplugin/topling-zip/3rdparty/zstd -Isideplugin/topling-sst/src -Isideplugin/topling-zip_table_reader/src -Isideplugin/topling-rocks/src -Isideplugin/rockside/src -I. -I./include |
| LDFLAGS | -Lsideplugin/topling-zip/build/Linux-x86_64-g++-12.2-bmi2-1/lib_shared -lterark-{zbs,fsa,core}-g++-12.2-r -lstdc++fs -lcurl -lpthread -lrt -ldl -lsnappy -lgflags -lz -lbz2 -llz4 |
| git_sha | 888d4596487cc14ad7ff532a9825b8f09b20e0ce |
| git_tag | sideplugin-8.04.2-2023-06-20-2926e071 |
| git_date | 2024-11-19 20:29:50 |
| compile_date | 2024-11-20 11:23:49 |
| version | 8.4.2 |
|
|---|