2024/11/19-15:13:37.694510 140043962924992 RocksDB version: 8.4.2 2024/11/19-15:13:37.694558 140043962924992 Git sha 1436c4478ab05164c1d0929db1403a3077b1ba12 2024/11/19-15:13:37.694564 140043962924992 Compile date 2024-11-18 13:58:37 2024/11/19-15:13:37.694574 140043962924992 DB SUMMARY 2024/11/19-15:13:37.694580 140043962924992 Host name (Env): iZwz9deglxdazgiryp6ltbZ 2024/11/19-15:13:37.694584 140043962924992 DB Session ID: FHVYN7H0SI0L522SGBBX 2024/11/19-15:13:37.694738 140043962924992 CURRENT file: CURRENT 2024/11/19-15:13:37.694745 140043962924992 IDENTITY file: IDENTITY 2024/11/19-15:13:37.694752 140043962924992 MANIFEST file: MANIFEST-004289 size: 27226 Bytes 2024/11/19-15:13:37.694757 140043962924992 SST files in /storage/mytopling/.rocksdb dir, Total Num: 244, files: 003692.sst 003697.sst 003703.sst 003707.sst 003708.sst 003709.sst 003712.sst 003713.sst 003714.sst 2024/11/19-15:13:37.694763 140043962924992 Write Ahead Log file in /storage/mytopling/.rocksdb: 004294.log size: 0 ; 2024/11/19-15:13:37.694770 140043962924992 Options.error_if_exists: 0 2024/11/19-15:13:37.694775 140043962924992 Options.create_if_missing: 1 2024/11/19-15:13:37.694780 140043962924992 Options.paranoid_checks: 1 2024/11/19-15:13:37.694784 140043962924992 Options.flush_verify_memtable_count: 1 2024/11/19-15:13:37.694789 140043962924992 Options.track_and_verify_wals_in_manifest: 1 2024/11/19-15:13:37.694794 140043962924992 Options.verify_sst_unique_id_in_manifest: 1 2024/11/19-15:13:37.694799 140043962924992 Options.env: 0x2696d280 2024/11/19-15:13:37.694804 140043962924992 Options.fs: PosixFileSystem 2024/11/19-15:13:37.694809 140043962924992 Options.info_log: 0x26c14150 2024/11/19-15:13:37.694813 140043962924992 Options.max_file_opening_threads: 16 2024/11/19-15:13:37.694820 140043962924992 Options.statistics: 0x2697c2e0 2024/11/19-15:13:37.694825 140043962924992 Options.statistics stats level: 3 2024/11/19-15:13:37.694831 140043962924992 Options.use_fsync: 0 2024/11/19-15:13:37.694838 140043962924992 Options.max_log_file_size: 268435456 2024/11/19-15:13:37.694844 140043962924992 Options.max_manifest_file_size: 1073741824 2024/11/19-15:13:37.694851 140043962924992 Options.log_file_time_to_roll: 0 2024/11/19-15:13:37.694861 140043962924992 Options.keep_log_file_num: 100 2024/11/19-15:13:37.694866 140043962924992 Options.recycle_log_file_num: 0 2024/11/19-15:13:37.694872 140043962924992 Options.allow_fallocate: 1 2024/11/19-15:13:37.694879 140043962924992 Options.allow_mmap_reads: 0 2024/11/19-15:13:37.694885 140043962924992 Options.allow_mmap_writes: 0 2024/11/19-15:13:37.694892 140043962924992 Options.use_direct_reads: 0 2024/11/19-15:13:37.694898 140043962924992 Options.use_direct_io_for_flush_and_compaction: 0 2024/11/19-15:13:37.694903 140043962924992 Options.create_missing_column_families: 1 2024/11/19-15:13:37.694909 140043962924992 Options.db_log_dir: /storage/mytopling/..//infolog/.rocksdb 2024/11/19-15:13:37.694916 140043962924992 Options.wal_dir: 2024/11/19-15:13:37.694932 140043962924992 Options.table_cache_numshardbits: 6 2024/11/19-15:13:37.694939 140043962924992 Options.WAL_ttl_seconds: 0 2024/11/19-15:13:37.694945 140043962924992 Options.WAL_size_limit_MB: 0 2024/11/19-15:13:37.694949 140043962924992 Options.max_write_batch_group_size_bytes: 1048576 2024/11/19-15:13:37.694956 140043962924992 Options.manifest_preallocation_size: 4194304 2024/11/19-15:13:37.694962 140043962924992 Options.is_fd_close_on_exec: 1 2024/11/19-15:13:37.694969 140043962924992 Options.advise_random_on_open: 1 2024/11/19-15:13:37.694975 140043962924992 Options.db_write_buffer_size: 0 2024/11/19-15:13:37.694982 140043962924992 Options.write_buffer_manager: 0x26c38730 2024/11/19-15:13:37.694986 140043962924992 Options.access_hint_on_compaction_start: 1 2024/11/19-15:13:37.694993 140043962924992 Options.random_access_max_buffer_size: 1048576 2024/11/19-15:13:37.694999 140043962924992 Options.use_adaptive_mutex: 0 2024/11/19-15:13:37.695005 140043962924992 Options.rate_limiter: (nil) 2024/11/19-15:13:37.695013 140043962924992 Options.sst_file_manager.rate_bytes_per_sec: 0 2024/11/19-15:13:37.695020 140043962924992 Options.wal_recovery_mode: 2 2024/11/19-15:13:37.695024 140043962924992 Options.enable_thread_tracking: 1 2024/11/19-15:13:37.695031 140043962924992 Options.enable_pipelined_write: 0 2024/11/19-15:13:37.695037 140043962924992 Options.unordered_write: 0 2024/11/19-15:13:37.695044 140043962924992 Options.allow_concurrent_memtable_write: 1 2024/11/19-15:13:37.695050 140043962924992 Options.enable_write_thread_adaptive_yield: 0 2024/11/19-15:13:37.695057 140043962924992 Options.write_thread_max_yield_usec: 100 2024/11/19-15:13:37.695061 140043962924992 Options.write_thread_slow_yield_usec: 3 2024/11/19-15:13:37.695071 140043962924992 Options.row_cache: None 2024/11/19-15:13:37.695078 140043962924992 Options.wal_filter: None 2024/11/19-15:13:37.695085 140043962924992 Options.avoid_flush_during_recovery: 0 2024/11/19-15:13:37.695091 140043962924992 Options.allow_ingest_behind: 0 2024/11/19-15:13:37.695098 140043962924992 Options.two_write_queues: 1 2024/11/19-15:13:37.695102 140043962924992 Options.manual_wal_flush: 1 2024/11/19-15:13:37.695110 140043962924992 Options.wal_compression: 0 2024/11/19-15:13:37.695117 140043962924992 Options.atomic_flush: 0 2024/11/19-15:13:37.695123 140043962924992 Options.avoid_unnecessary_blocking_io: 1 2024/11/19-15:13:37.695130 140043962924992 Options.persist_stats_to_disk: 0 2024/11/19-15:13:37.695136 140043962924992 Options.write_dbid_to_manifest: 1 2024/11/19-15:13:37.695141 140043962924992 Options.log_readahead_size: 0 2024/11/19-15:13:37.695147 140043962924992 Options.file_checksum_gen_factory: Unknown 2024/11/19-15:13:37.695154 140043962924992 Options.best_efforts_recovery: 0 2024/11/19-15:13:37.695160 140043962924992 Options.max_bgerror_resume_count: 2147483647 2024/11/19-15:13:37.695167 140043962924992 Options.bgerror_resume_retry_interval: 1000000 2024/11/19-15:13:37.695173 140043962924992 Options.allow_data_in_errors: 0 2024/11/19-15:13:37.695177 140043962924992 Options.db_host_id: __hostname__ 2024/11/19-15:13:37.695184 140043962924992 Options.enforce_single_del_contracts: false 2024/11/19-15:13:37.695192 140043962924992 Options.max_background_jobs: 2 2024/11/19-15:13:37.695198 140043962924992 Options.max_background_compactions: 7 2024/11/19-15:13:37.695205 140043962924992 Options.max_subcompactions: 1 2024/11/19-15:13:37.695212 140043962924992 Options.max_level1_subcompactions: 3 2024/11/19-15:13:37.695216 140043962924992 Options.avoid_flush_during_shutdown: 0 2024/11/19-15:13:37.695222 140043962924992 Options.writable_file_max_buffer_size: 1048576 2024/11/19-15:13:37.695229 140043962924992 Options.delayed_write_rate : 16777216 2024/11/19-15:13:37.695236 140043962924992 Options.max_total_wal_size: 0 2024/11/19-15:13:37.695242 140043962924992 Options.delete_obsolete_files_period_micros: 21600000000 2024/11/19-15:13:37.695251 140043962924992 Options.stats_dump_period_sec: 0 2024/11/19-15:13:37.695255 140043962924992 Options.stats_persist_period_sec: 0 2024/11/19-15:13:37.695262 140043962924992 Options.stats_history_buffer_size: 1048576 2024/11/19-15:13:37.695269 140043962924992 Options.max_open_files: -1 2024/11/19-15:13:37.695275 140043962924992 Options.bytes_per_sync: 0 2024/11/19-15:13:37.695282 140043962924992 Options.wal_bytes_per_sync: 0 2024/11/19-15:13:37.695288 140043962924992 Options.strict_bytes_per_sync: 0 2024/11/19-15:13:37.695295 140043962924992 Options.compaction_readahead_size: 0 2024/11/19-15:13:37.695299 140043962924992 Options.max_background_flushes: 2 2024/11/19-15:13:37.695306 140043962924992 Compression algorithms supported: 2024/11/19-15:13:37.695313 140043962924992 kZSTDNotFinalCompression supported: 1 2024/11/19-15:13:37.695323 140043962924992 kZSTD supported: 1 2024/11/19-15:13:37.695330 140043962924992 kXpressCompression supported: 0 2024/11/19-15:13:37.695334 140043962924992 kLZ4HCCompression supported: 1 2024/11/19-15:13:37.695343 140043962924992 kZlibCompression supported: 1 2024/11/19-15:13:37.695349 140043962924992 kSnappyCompression supported: 1 2024/11/19-15:13:37.695356 140043962924992 kLZ4Compression supported: 1 2024/11/19-15:13:37.695363 140043962924992 kBZip2Compression supported: 1 2024/11/19-15:13:37.695371 140043962924992 Fast CRC32 supported: Supported on x86 2024/11/19-15:13:37.695378 140043962924992 DMutex implementation: pthread_mutex_t 2024/11/19-15:13:37.695454 140043962924992 [version_set.cc:6211] Recovering from manifest file: /storage/mytopling/.rocksdb/MANIFEST-004289 2024/11/19-15:13:37.695635 140043962924992 [column_family.cc:633] --------------- Options for column family [default]: 2024/11/19-15:13:37.695648 140043962924992 Options.comparator: leveldb.BytewiseComparator 2024/11/19-15:13:37.695655 140043962924992 Options.merge_operator: None 2024/11/19-15:13:37.695662 140043962924992 Options.compaction_filter: None 2024/11/19-15:13:37.695669 140043962924992 Options.compaction_filter_factory: Rdb_compact_filter_factory 2024/11/19-15:13:37.695676 140043962924992 Options.sst_partitioner_factory: SstPartitionerFixedPrefixEx 2024/11/19-15:13:37.695683 140043962924992 Options.memtable_factory: Dyna 2024/11/19-15:13:37.695688 140043962924992 Options.table_factory: DispatcherTable 2024/11/19-15:13:37.695707 140043962924992 table_factory options: {"default":"sng","readers":{"VecAutoSortTable":"auto_sort","BlockBasedTable":"bb","CSPPMemTabTable":"cspp_memtab_sst","ToplingZipTable":"dzip","SingleFastTable":"sng"},"level_writers":["sng","sng","light_dzip","dzip","dzip","dzip","dzip","dzip"],"//auto_compaction_max_wamp":10,"//trivial_move_always_max_output_level":4} 2024/11/19-15:13:37.695714 140043962924992 Options.write_buffer_size: 536870912 2024/11/19-15:13:37.695721 140043962924992 Options.max_write_buffer_number: 2 2024/11/19-15:13:37.695729 140043962924992 Options.compression: Snappy 2024/11/19-15:13:37.695738 140043962924992 Options.bottommost_compression: Disabled 2024/11/19-15:13:37.695743 140043962924992 Options.prefix_extractor: nullptr 2024/11/19-15:13:37.695750 140043962924992 Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024/11/19-15:13:37.695756 140043962924992 Options.num_levels: 7 2024/11/19-15:13:37.695763 140043962924992 Options.min_write_buffer_number_to_merge: 1 2024/11/19-15:13:37.695769 140043962924992 Options.max_write_buffer_number_to_maintain: 0 2024/11/19-15:13:37.695776 140043962924992 Options.max_write_buffer_size_to_maintain: 268435456 2024/11/19-15:13:37.695780 140043962924992 Options.bottommost_compression_opts.window_bits: -14 2024/11/19-15:13:37.695786 140043962924992 Options.bottommost_compression_opts.level: 32767 2024/11/19-15:13:37.695795 140043962924992 Options.bottommost_compression_opts.strategy: 0 2024/11/19-15:13:37.695802 140043962924992 Options.bottommost_compression_opts.max_dict_bytes: 0 2024/11/19-15:13:37.695808 140043962924992 Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024/11/19-15:13:37.695815 140043962924992 Options.bottommost_compression_opts.parallel_threads: 1 2024/11/19-15:13:37.695819 140043962924992 Options.bottommost_compression_opts.enabled: false 2024/11/19-15:13:37.695826 140043962924992 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024/11/19-15:13:37.695832 140043962924992 Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024/11/19-15:13:37.695839 140043962924992 Options.compression_opts.window_bits: -14 2024/11/19-15:13:37.695845 140043962924992 Options.compression_opts.level: 32767 2024/11/19-15:13:37.695852 140043962924992 Options.compression_opts.strategy: 0 2024/11/19-15:13:37.695856 140043962924992 Options.compression_opts.max_dict_bytes: 0 2024/11/19-15:13:37.695863 140043962924992 Options.compression_opts.zstd_max_train_bytes: 0 2024/11/19-15:13:37.695869 140043962924992 Options.compression_opts.use_zstd_dict_trainer: true 2024/11/19-15:13:37.695876 140043962924992 Options.compression_opts.parallel_threads: 1 2024/11/19-15:13:37.695882 140043962924992 Options.compression_opts.enabled: false 2024/11/19-15:13:37.695889 140043962924992 Options.compression_opts.max_dict_buffer_bytes: 0 2024/11/19-15:13:37.695895 140043962924992 Options.level0_file_num_compaction_trigger: 4 2024/11/19-15:13:37.695899 140043962924992 Options.level0_slowdown_writes_trigger: 5 2024/11/19-15:13:37.695906 140043962924992 Options.level0_stop_writes_trigger: 10 2024/11/19-15:13:37.695912 140043962924992 Options.target_file_size_base: 33554432 2024/11/19-15:13:37.695927 140043962924992 Options.target_file_size_multiplier: 2 2024/11/19-15:13:37.695935 140043962924992 Options.max_bytes_for_level_base: 536870912 2024/11/19-15:13:37.695942 140043962924992 Options.level_compaction_dynamic_level_bytes: 0 2024/11/19-15:13:37.695946 140043962924992 Options.max_bytes_for_level_multiplier: 1.000000 2024/11/19-15:13:37.695955 140043962924992 Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024/11/19-15:13:37.695962 140043962924992 Options.max_bytes_for_level_multiplier_addtl[1]: 3 2024/11/19-15:13:37.695970 140043962924992 Options.max_bytes_for_level_multiplier_addtl[2]: 5 2024/11/19-15:13:37.695979 140043962924992 Options.max_bytes_for_level_multiplier_addtl[3]: 7 2024/11/19-15:13:37.695986 140043962924992 Options.max_bytes_for_level_multiplier_addtl[4]: 10 2024/11/19-15:13:37.695990 140043962924992 Options.max_bytes_for_level_multiplier_addtl[5]: 10 2024/11/19-15:13:37.695996 140043962924992 Options.max_bytes_for_level_multiplier_addtl[6]: 10 2024/11/19-15:13:37.696003 140043962924992 Options.max_bytes_for_level_multiplier_addtl[7]: 10 2024/11/19-15:13:37.696009 140043962924992 Options.max_sequential_skip_in_iterations: 8 2024/11/19-15:13:37.696016 140043962924992 Options.max_compaction_bytes: 4294967296 2024/11/19-15:13:37.696022 140043962924992 Options.arena_block_size: 1048576 2024/11/19-15:13:37.696027 140043962924992 Options.soft_pending_compaction_bytes_limit: 137438953472 2024/11/19-15:13:37.696033 140043962924992 Options.hard_pending_compaction_bytes_limit: 274877906944 2024/11/19-15:13:37.696040 140043962924992 Options.disable_auto_compactions: 1 2024/11/19-15:13:37.696047 140043962924992 Options.compaction_style: kCompactionStyleLevel 2024/11/19-15:13:37.696054 140043962924992 Options.compaction_pri: kMinOverlappingRatio 2024/11/19-15:13:37.696060 140043962924992 Options.compaction_options_universal.size_ratio: 1 2024/11/19-15:13:37.696067 140043962924992 Options.compaction_options_universal.min_merge_width: 2 2024/11/19-15:13:37.696073 140043962924992 Options.compaction_options_universal.max_merge_width: 4294967295 2024/11/19-15:13:37.696080 140043962924992 Options.compaction_options_universal.max_size_amplification_percent: 200 2024/11/19-15:13:37.696086 140043962924992 Options.compaction_options_universal.compression_size_percent: -1 2024/11/19-15:13:37.696093 140043962924992 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024/11/19-15:13:37.696100 140043962924992 Options.compaction_options_fifo.max_table_files_size: 1073741824 2024/11/19-15:13:37.696107 140043962924992 Options.compaction_options_fifo.allow_compaction: 0 2024/11/19-15:13:37.696115 140043962924992 Options.table_properties_collectors: Rdb_tbl_prop_coll_factory; 2024/11/19-15:13:37.696122 140043962924992 Options.inplace_update_support: 0 2024/11/19-15:13:37.696128 140043962924992 Options.inplace_update_num_locks: 10000 2024/11/19-15:13:37.696135 140043962924992 Options.memtable_prefix_bloom_size_ratio: 0.000000 2024/11/19-15:13:37.696142 140043962924992 Options.allow_merge_memtables: 0 2024/11/19-15:13:37.696149 140043962924992 Options.memtable_whole_key_filtering: 0 2024/11/19-15:13:37.696155 140043962924992 Options.memtable_huge_page_size: 0 2024/11/19-15:13:37.696159 140043962924992 Options.bloom_locality: 0 2024/11/19-15:13:37.696166 140043962924992 Options.max_successive_merges: 0 2024/11/19-15:13:37.696172 140043962924992 Options.optimize_filters_for_hits: 0 2024/11/19-15:13:37.696179 140043962924992 Options.paranoid_file_checks: 0 2024/11/19-15:13:37.696185 140043962924992 Options.force_consistency_checks: 1 2024/11/19-15:13:37.696192 140043962924992 Options.report_bg_io_stats: 0 2024/11/19-15:13:37.696196 140043962924992 Options.ttl: 0 2024/11/19-15:13:37.696202 140043962924992 Options.periodic_compaction_seconds: 0 2024/11/19-15:13:37.696211 140043962924992 Options.preclude_last_level_data_seconds: 0 2024/11/19-15:13:37.696217 140043962924992 Options.preserve_internal_time_seconds: 0 2024/11/19-15:13:37.696225 140043962924992 Options.enable_blob_files: false 2024/11/19-15:13:37.696232 140043962924992 Options.min_blob_size: 0 2024/11/19-15:13:37.696236 140043962924992 Options.blob_file_size: 268435456 2024/11/19-15:13:37.696243 140043962924992 Options.blob_compression_type: NoCompression 2024/11/19-15:13:37.696250 140043962924992 Options.enable_blob_garbage_collection: false 2024/11/19-15:13:37.696256 140043962924992 Options.blob_garbage_collection_age_cutoff: 0.250000 2024/11/19-15:13:37.696264 140043962924992 Options.blob_garbage_collection_force_threshold: 1.000000 2024/11/19-15:13:37.696270 140043962924992 Options.blob_compaction_readahead_size: 0 2024/11/19-15:13:37.696275 140043962924992 Options.blob_file_starting_level: 0 2024/11/19-15:13:37.696281 140043962924992 Options.min_filter_level: 2 2024/11/19-15:13:37.696288 140043962924992 Options.experimental_mempurge_threshold: 0.000000 2024/11/19-15:13:37.696294 140043962924992 Options.memtable_max_range_deletions: 0 2024/11/19-15:13:37.697926 140043962924992 [column_family.cc:633] --------------- Options for column family [__system__]: 2024/11/19-15:13:37.697942 140043962924992 Options.comparator: leveldb.BytewiseComparator 2024/11/19-15:13:37.697948 140043962924992 Options.merge_operator: Rdb_system_merge_op 2024/11/19-15:13:37.697953 140043962924992 Options.compaction_filter: None 2024/11/19-15:13:37.697957 140043962924992 Options.compaction_filter_factory: None 2024/11/19-15:13:37.697964 140043962924992 Options.sst_partitioner_factory: None 2024/11/19-15:13:37.697969 140043962924992 Options.memtable_factory: CSPPMemTabFactory 2024/11/19-15:13:37.697973 140043962924992 Options.table_factory: DispatcherTable 2024/11/19-15:13:37.697978 140043962924992 table_factory options: {"default":"sng","readers":{"VecAutoSortTable":"auto_sort","BlockBasedTable":"bb","CSPPMemTabTable":"cspp_memtab_sst","ToplingZipTable":"dzip","SingleFastTable":"sng"},"level_writers":["sng","sng","light_dzip","dzip","dzip","dzip","dzip","dzip"],"//auto_compaction_max_wamp":10,"//trivial_move_always_max_output_level":4} 2024/11/19-15:13:37.697983 140043962924992 Options.write_buffer_size: 8388608 2024/11/19-15:13:37.697987 140043962924992 Options.max_write_buffer_number: 2 2024/11/19-15:13:37.697992 140043962924992 Options.compression: Snappy 2024/11/19-15:13:37.697996 140043962924992 Options.bottommost_compression: Disabled 2024/11/19-15:13:37.698000 140043962924992 Options.prefix_extractor: nullptr 2024/11/19-15:13:37.698005 140043962924992 Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024/11/19-15:13:37.698009 140043962924992 Options.num_levels: 7 2024/11/19-15:13:37.698013 140043962924992 Options.min_write_buffer_number_to_merge: 1 2024/11/19-15:13:37.698017 140043962924992 Options.max_write_buffer_number_to_maintain: 0 2024/11/19-15:13:37.698021 140043962924992 Options.max_write_buffer_size_to_maintain: 16777216 2024/11/19-15:13:37.698026 140043962924992 Options.bottommost_compression_opts.window_bits: -14 2024/11/19-15:13:37.698033 140043962924992 Options.bottommost_compression_opts.level: 32767 2024/11/19-15:13:37.698039 140043962924992 Options.bottommost_compression_opts.strategy: 0 2024/11/19-15:13:37.698046 140043962924992 Options.bottommost_compression_opts.max_dict_bytes: 0 2024/11/19-15:13:37.698051 140043962924992 Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024/11/19-15:13:37.698057 140043962924992 Options.bottommost_compression_opts.parallel_threads: 1 2024/11/19-15:13:37.698063 140043962924992 Options.bottommost_compression_opts.enabled: false 2024/11/19-15:13:37.698070 140043962924992 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024/11/19-15:13:37.698076 140043962924992 Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024/11/19-15:13:37.698083 140043962924992 Options.compression_opts.window_bits: -14 2024/11/19-15:13:37.698089 140043962924992 Options.compression_opts.level: 32767 2024/11/19-15:13:37.698093 140043962924992 Options.compression_opts.strategy: 0 2024/11/19-15:13:37.698100 140043962924992 Options.compression_opts.max_dict_bytes: 0 2024/11/19-15:13:37.698106 140043962924992 Options.compression_opts.zstd_max_train_bytes: 0 2024/11/19-15:13:37.698113 140043962924992 Options.compression_opts.use_zstd_dict_trainer: true 2024/11/19-15:13:37.698121 140043962924992 Options.compression_opts.parallel_threads: 1 2024/11/19-15:13:37.698128 140043962924992 Options.compression_opts.enabled: false 2024/11/19-15:13:37.698132 140043962924992 Options.compression_opts.max_dict_buffer_bytes: 0 2024/11/19-15:13:37.698138 140043962924992 Options.level0_file_num_compaction_trigger: 4 2024/11/19-15:13:37.698145 140043962924992 Options.level0_slowdown_writes_trigger: 5 2024/11/19-15:13:37.698151 140043962924992 Options.level0_stop_writes_trigger: 10 2024/11/19-15:13:37.698157 140043962924992 Options.target_file_size_base: 8388608 2024/11/19-15:13:37.698164 140043962924992 Options.target_file_size_multiplier: 2 2024/11/19-15:13:37.698168 140043962924992 Options.max_bytes_for_level_base: 8388608 2024/11/19-15:13:37.698174 140043962924992 Options.level_compaction_dynamic_level_bytes: 0 2024/11/19-15:13:37.698183 140043962924992 Options.max_bytes_for_level_multiplier: 1.000000 2024/11/19-15:13:37.698190 140043962924992 Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024/11/19-15:13:37.698197 140043962924992 Options.max_bytes_for_level_multiplier_addtl[1]: 3 2024/11/19-15:13:37.698203 140043962924992 Options.max_bytes_for_level_multiplier_addtl[2]: 5 2024/11/19-15:13:37.698207 140043962924992 Options.max_bytes_for_level_multiplier_addtl[3]: 7 2024/11/19-15:13:37.698214 140043962924992 Options.max_bytes_for_level_multiplier_addtl[4]: 10 2024/11/19-15:13:37.698220 140043962924992 Options.max_bytes_for_level_multiplier_addtl[5]: 10 2024/11/19-15:13:37.698227 140043962924992 Options.max_bytes_for_level_multiplier_addtl[6]: 10 2024/11/19-15:13:37.698233 140043962924992 Options.max_bytes_for_level_multiplier_addtl[7]: 10 2024/11/19-15:13:37.698239 140043962924992 Options.max_sequential_skip_in_iterations: 8 2024/11/19-15:13:37.698243 140043962924992 Options.max_compaction_bytes: 4294967296 2024/11/19-15:13:37.698250 140043962924992 Options.arena_block_size: 1048576 2024/11/19-15:13:37.698257 140043962924992 Options.soft_pending_compaction_bytes_limit: 68719476736 2024/11/19-15:13:37.698265 140043962924992 Options.hard_pending_compaction_bytes_limit: 274877906944 2024/11/19-15:13:37.698272 140043962924992 Options.disable_auto_compactions: 1 2024/11/19-15:13:37.698279 140043962924992 Options.compaction_style: kCompactionStyleLevel 2024/11/19-15:13:37.698284 140043962924992 Options.compaction_pri: kMinOverlappingRatio 2024/11/19-15:13:37.698290 140043962924992 Options.compaction_options_universal.size_ratio: 1 2024/11/19-15:13:37.698297 140043962924992 Options.compaction_options_universal.min_merge_width: 2 2024/11/19-15:13:37.698303 140043962924992 Options.compaction_options_universal.max_merge_width: 4294967295 2024/11/19-15:13:37.698309 140043962924992 Options.compaction_options_universal.max_size_amplification_percent: 200 2024/11/19-15:13:37.698316 140043962924992 Options.compaction_options_universal.compression_size_percent: -1 2024/11/19-15:13:37.698320 140043962924992 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024/11/19-15:13:37.698327 140043962924992 Options.compaction_options_fifo.max_table_files_size: 1073741824 2024/11/19-15:13:37.698333 140043962924992 Options.compaction_options_fifo.allow_compaction: 0 2024/11/19-15:13:37.698342 140043962924992 Options.table_properties_collectors: 2024/11/19-15:13:37.698351 140043962924992 Options.inplace_update_support: 0 2024/11/19-15:13:37.698357 140043962924992 Options.inplace_update_num_locks: 10000 2024/11/19-15:13:37.698364 140043962924992 Options.memtable_prefix_bloom_size_ratio: 0.000000 2024/11/19-15:13:37.698368 140043962924992 Options.allow_merge_memtables: 0 2024/11/19-15:13:37.698375 140043962924992 Options.memtable_whole_key_filtering: 0 2024/11/19-15:13:37.698381 140043962924992 Options.memtable_huge_page_size: 0 2024/11/19-15:13:37.698388 140043962924992 Options.bloom_locality: 0 2024/11/19-15:13:37.698395 140043962924992 Options.max_successive_merges: 0 2024/11/19-15:13:37.698401 140043962924992 Options.optimize_filters_for_hits: 0 2024/11/19-15:13:37.698406 140043962924992 Options.paranoid_file_checks: 0 2024/11/19-15:13:37.698412 140043962924992 Options.force_consistency_checks: 1 2024/11/19-15:13:37.698418 140043962924992 Options.report_bg_io_stats: 0 2024/11/19-15:13:37.698425 140043962924992 Options.ttl: 0 2024/11/19-15:13:37.698431 140043962924992 Options.periodic_compaction_seconds: 0 2024/11/19-15:13:37.698438 140043962924992 Options.preclude_last_level_data_seconds: 0 2024/11/19-15:13:37.698442 140043962924992 Options.preserve_internal_time_seconds: 0 2024/11/19-15:13:37.698448 140043962924992 Options.enable_blob_files: false 2024/11/19-15:13:37.698455 140043962924992 Options.min_blob_size: 0 2024/11/19-15:13:37.698462 140043962924992 Options.blob_file_size: 268435456 2024/11/19-15:13:37.698468 140043962924992 Options.blob_compression_type: NoCompression 2024/11/19-15:13:37.698475 140043962924992 Options.enable_blob_garbage_collection: false 2024/11/19-15:13:37.698479 140043962924992 Options.blob_garbage_collection_age_cutoff: 0.250000 2024/11/19-15:13:37.698486 140043962924992 Options.blob_garbage_collection_force_threshold: 1.000000 2024/11/19-15:13:37.698493 140043962924992 Options.blob_compaction_readahead_size: 0 2024/11/19-15:13:37.698499 140043962924992 Options.blob_file_starting_level: 0 2024/11/19-15:13:37.698506 140043962924992 Options.min_filter_level: 2 2024/11/19-15:13:37.698514 140043962924992 Options.experimental_mempurge_threshold: 0.000000 2024/11/19-15:13:37.698518 140043962924992 Options.memtable_max_range_deletions: 0 2024/11/19-15:13:37.841901 140042588653312 [top_zip_table.cc:59] core git_version_hash_info_is:commit 81964c21ebbcc178d8e99dae0fbf61bded2729cc Author: rockeet Date: Mon Nov 11 21:28:46 2024 +0800 Makefile: fix gen git-version-*.cpp GIT_PATH_ARG = :!src/terark/fsa :!tools/fsa :!src/terark/zbs :!tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/19-15:13:37.841949 140042588653312 [top_zip_table.cc:60] fsa git_version_hash_info_is:commit 5dfecb7d107196f044ff5bf78dc39d2e725b9d9b Author: leipeng Date: Thu Nov 7 15:22:45 2024 +0800 Makefile: fix for x86_64 CPU older than haswell GIT_PATH_ARG = src/terark/fsa tools/fsa g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/19-15:13:37.841971 140042588653312 [top_zip_table.cc:61] zbs git_version_hash_info_is:commit d44dd5ff72707128fe3c916077b43d2093c01f7c Author: leipeng Date: Sun Oct 27 23:38:26 2024 +0800 Fix for msvc, when toplingdb on msvc GIT_PATH_ARG = src/terark/zbs tools/zbs g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. INCS = -Isrc -I3rdparty/zstd -Iboost-include DEFS = -DTOPLING_IO_WITH_URING=1 -DDIVSUFSORT_API= CXXFLAGS = -fPIC -time -fdiagnostics-color -mcx16 -fno-stack-protector WARNINGS = -Wno-class-memaccess -Wformat=2 -Wcomment -Wall -Wextra -Wno-unused-parameter -Wno-alloc-size-larger-than -Wno-deprecated-declarations -Wstrict-aliasing=3 RLS_FLAGS = -O3 -DNDEBUG -g3 WITH_BMI2 = 1 compile_cpu_flag: -march=haswell -mbmi -mbmi2 LDFLAGS = -fPIC -rdynamic 2024/11/19-15:13:37.841984 140042588653312 [top_zip_table.cc:62] topling-zip_table_reader: git_version_hash_info_is: commit 79614a7e7dc27362fc5151b0797eb7d83c674c7b Author: rockeet Date: Sun Nov 10 15:02:21 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/19-15:13:37.841997 140042588653312 [top_zip_table.cc:64] topling-rocks git_version_hash_info_is: commit c46b65a52d9c74aa8b87aeb8438620ff2dbc669c Author: rockeet Date: Sun Nov 10 15:02:42 2024 +0800 cpu_has_bmi2.sh: detect by compile c++ code check __BMI2__ g++ (GCC) 12.2.1 20221121 (Red Hat 12.2.1-7) Copyright (C) 2022 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. cpu_flag: -march=native -mbmi -mbmi2 2024/11/19-15:13:37.875864 140043962924992 [version_set.cc:6254] Recovered from manifest file:/storage/mytopling/.rocksdb/MANIFEST-004289 succeeded,manifest_file_number is 4289, next_file_number is 4297, last_sequence is 105631335, log_number is 4294,prev_log_number is 0,max_column_family is 1,min_log_number_to_keep is 4294 2024/11/19-15:13:37.875894 140043962924992 [version_set.cc:6269] Column family [default] (ID 0), log number is 4284 2024/11/19-15:13:37.875901 140043962924992 [version_set.cc:6269] Column family [__system__] (ID 1), log number is 4294 2024/11/19-15:13:37.875948 140043962924992 [db_impl_open.cc:639] DB ID: d89b4006-2803-486e-b7a2-759bcf348921 2024/11/19-15:13:37.876996 140043962924992 EVENT_LOG_v1 {"time_micros": 1732000417876983, "job": 1, "event": "recovery_started", "wal_files": [4294]} 2024/11/19-15:13:37.877013 140043962924992 [db_impl_open.cc:1132] Recovering log #4294 mode 2 2024/11/19-15:13:37.877080 140043962924992 EVENT_LOG_v1 {"time_micros": 1732000417877079, "job": 1, "event": "recovery_finished"} 2024/11/19-15:13:37.877192 140043962924992 [version_set.cc:5724] Creating manifest 4299 2024/11/19-15:13:37.878321 140043962924992 [db_impl_open.cc:2123] SstFileManager instance 0x26c01ac0 2024/11/19-15:13:37.879129 140043962924992 DB pointer 0x26c3d000 2024/11/19-15:13:37.879196 140043962924992 [WARN] [pessimistic_transaction_db.cc:310] Transaction write_policy is WRITE_COMMITTED 2024/11/19-15:13:37.884543 140043962924992 [db_impl.cc:1284] SetOptions() on column family [default], inputs: 2024/11/19-15:13:37.884560 140043962924992 [db_impl.cc:1288] disable_auto_compactions: false 2024/11/19-15:13:37.884567 140043962924992 [db_impl.cc:1292] [default] SetOptions() succeeded 2024/11/19-15:13:37.884574 140043962924992 [cf_options.cc:1051] write_buffer_size: 536870912 2024/11/19-15:13:37.884580 140043962924992 [cf_options.cc:1054] max_write_buffer_number: 2 2024/11/19-15:13:37.884585 140043962924992 [cf_options.cc:1056] arena_block_size: 1048576 2024/11/19-15:13:37.884590 140043962924992 [cf_options.cc:1059] memtable_prefix_bloom_ratio: 0.000000 2024/11/19-15:13:37.884596 140043962924992 [cf_options.cc:1062] allow_merge_memtables: 0 2024/11/19-15:13:37.884601 140043962924992 [cf_options.cc:1064] memtable_whole_key_filtering: 0 2024/11/19-15:13:37.884606 140043962924992 [cf_options.cc:1066] memtable_huge_page_size: 0 2024/11/19-15:13:37.884611 140043962924992 [cf_options.cc:1069] max_successive_merges: 0 2024/11/19-15:13:37.884616 140043962924992 [cf_options.cc:1072] inplace_update_num_locks: 10000 2024/11/19-15:13:37.884621 140043962924992 [cf_options.cc:1075] prefix_extractor: nullptr 2024/11/19-15:13:37.884627 140043962924992 [cf_options.cc:1079] disable_auto_compactions: 0 2024/11/19-15:13:37.884632 140043962924992 [cf_options.cc:1081] soft_pending_compaction_bytes_limit: 137438953472 2024/11/19-15:13:37.884637 140043962924992 [cf_options.cc:1083] hard_pending_compaction_bytes_limit: 274877906944 2024/11/19-15:13:37.884642 140043962924992 [cf_options.cc:1085] level0_file_num_compaction_trigger: 4 2024/11/19-15:13:37.884647 140043962924992 [cf_options.cc:1087] level0_slowdown_writes_trigger: 5 2024/11/19-15:13:37.884652 140043962924992 [cf_options.cc:1089] level0_stop_writes_trigger: 10 2024/11/19-15:13:37.884658 140043962924992 [cf_options.cc:1091] max_compaction_bytes: 4294967296 2024/11/19-15:13:37.884663 140043962924992 [cf_options.cc:1093] target_file_size_base: 33554432 2024/11/19-15:13:37.884668 140043962924992 [cf_options.cc:1095] target_file_size_multiplier: 2 2024/11/19-15:13:37.884673 140043962924992 [cf_options.cc:1097] max_bytes_for_level_base: 536870912 2024/11/19-15:13:37.884678 140043962924992 [cf_options.cc:1099] max_bytes_for_level_multiplier: 1.000000 2024/11/19-15:13:37.884684 140043962924992 [cf_options.cc:1101] ttl: 0 2024/11/19-15:13:37.884699 140043962924992 [cf_options.cc:1103] periodic_compaction_seconds: 0 2024/11/19-15:13:37.884706 140043962924992 [cf_options.cc:1117] max_bytes_for_level_multiplier_additional: 1, 3, 5, 7, 10, 10, 10, 10 2024/11/19-15:13:37.884712 140043962924992 [cf_options.cc:1119] max_sequential_skip_in_iterations: 8 2024/11/19-15:13:37.884717 140043962924992 [cf_options.cc:1121] check_flush_compaction_key_order: 0 2024/11/19-15:13:37.884722 140043962924992 [cf_options.cc:1123] paranoid_file_checks: 0 2024/11/19-15:13:37.884727 140043962924992 [cf_options.cc:1125] report_bg_io_stats: 0 2024/11/19-15:13:37.884732 140043962924992 [cf_options.cc:1127] compression: 1 2024/11/19-15:13:37.884738 140043962924992 [cf_options.cc:1129] experimental_mempurge_threshold: 0.000000 2024/11/19-15:13:37.884743 140043962924992 [cf_options.cc:1134] compaction_options_universal.size_ratio : 1 2024/11/19-15:13:37.884748 140043962924992 [cf_options.cc:1136] compaction_options_universal.min_merge_width : 2 2024/11/19-15:13:37.884753 140043962924992 [cf_options.cc:1138] compaction_options_universal.max_merge_width : -1 2024/11/19-15:13:37.884758 140043962924992 [cf_options.cc:1140] compaction_options_universal.max_size_amplification_percent : 200 2024/11/19-15:13:37.884764 140043962924992 [cf_options.cc:1143] compaction_options_universal.compression_size_percent : -1 2024/11/19-15:13:37.884769 140043962924992 [cf_options.cc:1146] compaction_options_universal.stop_style : 1 2024/11/19-15:13:37.884774 140043962924992 [cf_options.cc:1148] compaction_options_universal.allow_trivial_move : 0 2024/11/19-15:13:37.884780 140043962924992 [cf_options.cc:1151] compaction_options_universal.incremental : 0 2024/11/19-15:13:37.884785 140043962924992 [cf_options.cc:1155] compaction_options_fifo.max_table_files_size : 1073741824 2024/11/19-15:13:37.884790 140043962924992 [cf_options.cc:1157] compaction_options_fifo.allow_compaction : 0 2024/11/19-15:13:37.884796 140043962924992 [cf_options.cc:1161] enable_blob_files: false 2024/11/19-15:13:37.884802 140043962924992 [cf_options.cc:1163] min_blob_size: 0 2024/11/19-15:13:37.884806 140043962924992 [cf_options.cc:1165] blob_file_size: 268435456 2024/11/19-15:13:37.884812 140043962924992 [cf_options.cc:1167] blob_compression_type: NoCompression 2024/11/19-15:13:37.884817 140043962924992 [cf_options.cc:1169] enable_blob_garbage_collection: false 2024/11/19-15:13:37.884822 140043962924992 [cf_options.cc:1171] blob_garbage_collection_age_cutoff: 0.250000 2024/11/19-15:13:37.884828 140043962924992 [cf_options.cc:1173] blob_garbage_collection_force_threshold: 1.000000 2024/11/19-15:13:37.884834 140043962924992 [cf_options.cc:1175] blob_compaction_readahead_size: 0 2024/11/19-15:13:37.884838 140043962924992 [cf_options.cc:1177] blob_file_starting_level: 0 2024/11/19-15:13:37.884843 140043962924992 [cf_options.cc:1179] prepopulate_blob_cache: disable 2024/11/19-15:13:37.884849 140043962924992 [cf_options.cc:1183] last_level_temperature: 0 2024/11/19-15:13:37.884884 140042810951424 [compaction_job.cc:2437] [default] [JOB 5] Compacting 4@1 files to L2, score 6.35, subcompactions 1 : 1 2024/11/19-15:13:37.884885 140042620110592 [compaction_job.cc:2437] [default] [JOB 3] Compacting 4@1 files to L2, score 6.85, subcompactions 1 : 1 2024/11/19-15:13:37.884895 140042821437184 [compaction_job.cc:2437] [default] [JOB 4] Compacting 4@1 files to L2, score 6.60, subcompactions 1 : 1 2024/11/19-15:13:37.884936 140042620110592 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4151(31MB) 4152(31MB) 4153(31MB) 4156(31MB)] 2024/11/19-15:13:37.884947 140042810951424 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4167(31MB) 4169(31MB) 4171(24MB) 4174(17MB)] 2024/11/19-15:13:37.884966 140042821437184 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4159(31MB) 4161(31MB) 4163(31MB) 4165(31MB)] 2024/11/19-15:13:37.885125 140042800465664 [compaction_job.cc:2437] [default] [JOB 6] Compacting 4@1 files to L2, score 6.14, subcompactions 1 : 1 2024/11/19-15:13:37.885160 140042800465664 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4172(31MB) 4177(31MB) 4180(31MB) 4184(31MB)] 2024/11/19-15:13:37.885180 140042641082112 [compaction_job.cc:2437] [default] [JOB 8] Compacting 4@1 files to L2, score 5.64, subcompactions 1 : 1 2024/11/19-15:13:37.885183 140042789979904 [compaction_job.cc:2437] [default] [JOB 7] Compacting 4@1 files to L2, score 5.89, subcompactions 1 : 1 2024/11/19-15:13:37.885191 140042630596352 [compaction_job.cc:2437] [default] [JOB 9] Compacting 4@1 files to L2, score 5.39, subcompactions 1 : 1 2024/11/19-15:13:37.885230 140042641082112 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4203(31MB) 4206(31MB) 4209(31MB) 4212(31MB)] 2024/11/19-15:13:37.885243 140042789979904 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4189(31MB) 4192(31MB) 4195(31MB) 4199(31MB)] 2024/11/19-15:13:37.885265 140042630596352 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4216(31MB) 4219(31MB) 4223(31MB) 4225(31MB)] 2024/11/19-15:13:37.885839 140043962924992 [db_impl.cc:1284] SetOptions() on column family [__system__], inputs: 2024/11/19-15:13:37.885859 140043962924992 [db_impl.cc:1288] disable_auto_compactions: false 2024/11/19-15:13:37.885870 140043962924992 [db_impl.cc:1292] [__system__] SetOptions() succeeded 2024/11/19-15:13:37.885878 140043962924992 [cf_options.cc:1051] write_buffer_size: 8388608 2024/11/19-15:13:37.885887 140043962924992 [cf_options.cc:1054] max_write_buffer_number: 2 2024/11/19-15:13:37.885899 140043962924992 [cf_options.cc:1056] arena_block_size: 1048576 2024/11/19-15:13:37.885908 140043962924992 [cf_options.cc:1059] memtable_prefix_bloom_ratio: 0.000000 2024/11/19-15:13:37.885918 140043962924992 [cf_options.cc:1062] allow_merge_memtables: 0 2024/11/19-15:13:37.885938 140043962924992 [cf_options.cc:1064] memtable_whole_key_filtering: 0 2024/11/19-15:13:37.885947 140043962924992 [cf_options.cc:1066] memtable_huge_page_size: 0 2024/11/19-15:13:37.885955 140043962924992 [cf_options.cc:1069] max_successive_merges: 0 2024/11/19-15:13:37.885962 140043962924992 [cf_options.cc:1072] inplace_update_num_locks: 10000 2024/11/19-15:13:37.885971 140043962924992 [cf_options.cc:1075] prefix_extractor: nullptr 2024/11/19-15:13:37.885982 140043962924992 [cf_options.cc:1079] disable_auto_compactions: 0 2024/11/19-15:13:37.885989 140043962924992 [cf_options.cc:1081] soft_pending_compaction_bytes_limit: 68719476736 2024/11/19-15:13:37.885997 140043962924992 [cf_options.cc:1083] hard_pending_compaction_bytes_limit: 274877906944 2024/11/19-15:13:37.886003 140043962924992 [cf_options.cc:1085] level0_file_num_compaction_trigger: 4 2024/11/19-15:13:37.886008 140043962924992 [cf_options.cc:1087] level0_slowdown_writes_trigger: 5 2024/11/19-15:13:37.886013 140043962924992 [cf_options.cc:1089] level0_stop_writes_trigger: 10 2024/11/19-15:13:37.886018 140043962924992 [cf_options.cc:1091] max_compaction_bytes: 4294967296 2024/11/19-15:13:37.886024 140043962924992 [cf_options.cc:1093] target_file_size_base: 8388608 2024/11/19-15:13:37.886029 140043962924992 [cf_options.cc:1095] target_file_size_multiplier: 2 2024/11/19-15:13:37.886036 140043962924992 [cf_options.cc:1097] max_bytes_for_level_base: 8388608 2024/11/19-15:13:37.886043 140043962924992 [cf_options.cc:1099] max_bytes_for_level_multiplier: 1.000000 2024/11/19-15:13:37.886050 140043962924992 [cf_options.cc:1101] ttl: 0 2024/11/19-15:13:37.886058 140043962924992 [cf_options.cc:1103] periodic_compaction_seconds: 0 2024/11/19-15:13:37.886069 140043962924992 [cf_options.cc:1117] max_bytes_for_level_multiplier_additional: 1, 3, 5, 7, 10, 10, 10, 10 2024/11/19-15:13:37.886077 140043962924992 [cf_options.cc:1119] max_sequential_skip_in_iterations: 8 2024/11/19-15:13:37.886084 140043962924992 [cf_options.cc:1121] check_flush_compaction_key_order: 1 2024/11/19-15:13:37.886090 140043962924992 [cf_options.cc:1123] paranoid_file_checks: 0 2024/11/19-15:13:37.886096 140043962924992 [cf_options.cc:1125] report_bg_io_stats: 0 2024/11/19-15:13:37.886105 140043962924992 [cf_options.cc:1127] compression: 1 2024/11/19-15:13:37.886114 140043962924992 [cf_options.cc:1129] experimental_mempurge_threshold: 0.000000 2024/11/19-15:13:37.886123 140043962924992 [cf_options.cc:1134] compaction_options_universal.size_ratio : 1 2024/11/19-15:13:37.886131 140043962924992 [cf_options.cc:1136] compaction_options_universal.min_merge_width : 2 2024/11/19-15:13:37.886138 140043962924992 [cf_options.cc:1138] compaction_options_universal.max_merge_width : -1 2024/11/19-15:13:37.886146 140043962924992 [cf_options.cc:1140] compaction_options_universal.max_size_amplification_percent : 200 2024/11/19-15:13:37.886155 140043962924992 [cf_options.cc:1143] compaction_options_universal.compression_size_percent : -1 2024/11/19-15:13:37.886163 140043962924992 [cf_options.cc:1146] compaction_options_universal.stop_style : 1 2024/11/19-15:13:37.886172 140043962924992 [cf_options.cc:1148] compaction_options_universal.allow_trivial_move : 0 2024/11/19-15:13:37.886181 140043962924992 [cf_options.cc:1151] compaction_options_universal.incremental : 0 2024/11/19-15:13:37.886190 140043962924992 [cf_options.cc:1155] compaction_options_fifo.max_table_files_size : 1073741824 2024/11/19-15:13:37.886199 140043962924992 [cf_options.cc:1157] compaction_options_fifo.allow_compaction : 0 2024/11/19-15:13:37.886207 140043962924992 [cf_options.cc:1161] enable_blob_files: false 2024/11/19-15:13:37.886216 140043962924992 [cf_options.cc:1163] min_blob_size: 0 2024/11/19-15:13:37.886224 140043962924992 [cf_options.cc:1165] blob_file_size: 268435456 2024/11/19-15:13:37.886233 140043962924992 [cf_options.cc:1167] blob_compression_type: NoCompression 2024/11/19-15:13:37.886242 140043962924992 [cf_options.cc:1169] enable_blob_garbage_collection: false 2024/11/19-15:13:37.886251 140043962924992 [cf_options.cc:1171] blob_garbage_collection_age_cutoff: 0.250000 2024/11/19-15:13:37.886261 140043962924992 [cf_options.cc:1173] blob_garbage_collection_force_threshold: 1.000000 2024/11/19-15:13:37.886271 140043962924992 [cf_options.cc:1175] blob_compaction_readahead_size: 0 2024/11/19-15:13:37.886280 140043962924992 [cf_options.cc:1177] blob_file_starting_level: 0 2024/11/19-15:13:37.886289 140043962924992 [cf_options.cc:1179] prepopulate_blob_cache: disable 2024/11/19-15:13:37.886298 140043962924992 [cf_options.cc:1183] last_level_temperature: 0 2024/11/19-15:13:38.203846 140042821437184 [dcompact_etcd.cc:1163] job-00004/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.318 sec, input = 127.240 MiB 2024/11/19-15:13:38.209968 140042641082112 [dcompact_etcd.cc:1163] job-00008/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.324 sec, input = 127.817 MiB 2024/11/19-15:13:38.214621 140042800465664 [dcompact_etcd.cc:1163] job-00006/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.329 sec, input = 127.821 MiB 2024/11/19-15:13:38.222080 140042789979904 [dcompact_etcd.cc:1163] job-00007/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.336 sec, input = 127.820 MiB 2024/11/19-15:13:38.231258 140042810951424 [dcompact_etcd.cc:1163] job-00005/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.346 sec, input = 105.031 MiB 2024/11/19-15:13:38.232275 140042630596352 [dcompact_etcd.cc:1163] job-00009/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.346 sec, input = 127.820 MiB 2024/11/19-15:13:38.244557 140042620110592 [dcompact_etcd.cc:1163] job-00003/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.359 sec, input = 127.237 MiB 2024/11/19-15:13:40.870515 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-00 2024/11/19-15:13:40.870603 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-00/compact.done) = No such file or directory: 2.626 sec on http probe failed: 1, retry 2024/11/19-15:13:41.394895 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-00 2024/11/19-15:13:41.394993 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-00/compact.done) = No such file or directory: 3.181 sec on http probe failed: 1, retry 2024/11/19-15:13:41.413928 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-00 2024/11/19-15:13:41.414006 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-00/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:13:41.418278 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-00 2024/11/19-15:13:41.418335 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-00/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:13:41.425427 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-00 2024/11/19-15:13:41.425487 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-00/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:13:41.435440 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-00 2024/11/19-15:13:41.435492 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-00/compact.done) = No such file or directory: 3.181 sec on http probe failed: 1, retry 2024/11/19-15:13:41.441006 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-00 2024/11/19-15:13:41.441064 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-00/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:13:42.880152 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-00 2024/11/19-15:13:42.880271 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-00/compact.done) = No such file or directory: 4.639 sec on http probe failed: 2, retry 2024/11/19-15:13:43.402911 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-00 2024/11/19-15:13:43.403002 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-00/compact.done) = No such file or directory: 5.191 sec on http probe failed: 2, retry 2024/11/19-15:13:43.422062 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-00 2024/11/19-15:13:43.422119 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-00/compact.done) = No such file or directory: 5.204 sec on http probe failed: 2, retry 2024/11/19-15:13:43.423652 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-00 2024/11/19-15:13:43.423705 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-00/compact.done) = No such file or directory: 5.204 sec on http probe failed: 2, retry 2024/11/19-15:13:43.432211 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-00 2024/11/19-15:13:43.432265 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-00/compact.done) = No such file or directory: 5.203 sec on http probe failed: 2, retry 2024/11/19-15:13:43.440141 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-00 2024/11/19-15:13:43.440190 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-00/compact.done) = No such file or directory: 5.191 sec on http probe failed: 2, retry 2024/11/19-15:13:43.454913 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-00 2024/11/19-15:13:43.454973 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-00/compact.done) = No such file or directory: 5.209 sec on http probe failed: 2, retry 2024/11/19-15:13:44.892747 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-00 2024/11/19-15:13:44.892817 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-00/compact.done) = No such file or directory: 6.649 sec on http probe failed: 3, retry 2024/11/19-15:13:45.413757 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-00 2024/11/19-15:13:45.413825 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-00/compact.done) = No such file or directory: 7.199 sec on http probe failed: 3, retry 2024/11/19-15:13:45.428220 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-00 2024/11/19-15:13:45.428273 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-00/compact.done) = No such file or directory: 7.212 sec on http probe failed: 3, retry 2024/11/19-15:13:45.429248 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-00 2024/11/19-15:13:45.429300 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-00/compact.done) = No such file or directory: 7.209 sec on http probe failed: 3, retry 2024/11/19-15:13:45.440731 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-00 2024/11/19-15:13:45.440780 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-00/compact.done) = No such file or directory: 7.210 sec on http probe failed: 3, retry 2024/11/19-15:13:45.444689 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-00 2024/11/19-15:13:45.444737 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-00/compact.done) = No such file or directory: 7.196 sec on http probe failed: 3, retry 2024/11/19-15:13:45.461983 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-00 2024/11/19-15:13:45.462032 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-00/compact.done) = No such file or directory: 7.223 sec on http probe failed: 3, retry 2024/11/19-15:13:46.901462 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-00 2024/11/19-15:13:46.901541 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-00/compact.done) = No such file or directory: 8.662 sec on http probe failed: 4, retry 2024/11/19-15:13:47.422193 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-00 2024/11/19-15:13:47.422271 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-00/compact.done) = No such file or directory: 9.210 sec on http probe failed: 4, retry 2024/11/19-15:13:47.436934 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-00 2024/11/19-15:13:47.436994 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-00/compact.done) = No such file or directory: 9.215 sec on http probe failed: 4, retry 2024/11/19-15:13:47.437346 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-00 2024/11/19-15:13:47.437407 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-00/compact.done) = No such file or directory: 9.218 sec on http probe failed: 4, retry 2024/11/19-15:13:47.449551 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-00 2024/11/19-15:13:47.449600 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-00/compact.done) = No such file or directory: 9.219 sec on http probe failed: 4, retry 2024/11/19-15:13:47.454014 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-00 2024/11/19-15:13:47.454062 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-00/compact.done) = No such file or directory: 9.200 sec on http probe failed: 4, retry 2024/11/19-15:13:47.470747 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-00 2024/11/19-15:13:47.470797 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-00/compact.done) = No such file or directory: 9.230 sec on http probe failed: 4, retry 2024/11/19-15:13:48.910583 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-00 2024/11/19-15:13:48.910684 140042810951424 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00005/att-00/compact.done) = No such file or directory: 10.670 sec on http probe failed: 5, giveup 2024/11/19-15:13:48.910712 140042810951424 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00005/att-00: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 105.031 sec, real 11.025 (submit 345.654 ms wait 10.670 s), input 105.031 MiB, send shutdown 2024/11/19-15:13:48.918708 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-00 2024/11/19-15:13:48.918943 140042810951424 [dcompact_etcd.cc:1773] job-00005/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:13:49.180935 140042810951424 [dcompact_etcd.cc:1163] job-00005/att-01: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.262 sec, input = 105.031 MiB 2024/11/19-15:13:49.427970 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-00 2024/11/19-15:13:49.428038 140042821437184 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00004/att-00/compact.done) = No such file or directory: 11.218 sec on http probe failed: 5, giveup 2024/11/19-15:13:49.428055 140042821437184 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00004/att-00: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.240 sec, real 11.542 (submit 318.179 ms wait 11.218 s), input 127.240 MiB, send shutdown 2024/11/19-15:13:49.436960 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-00 2024/11/19-15:13:49.437165 140042821437184 [dcompact_etcd.cc:1773] job-00004/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:13:49.442424 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-00 2024/11/19-15:13:49.442481 140042641082112 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00008/att-00/compact.done) = No such file or directory: 11.228 sec on http probe failed: 5, giveup 2024/11/19-15:13:49.442496 140042641082112 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00008/att-00: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.817 sec, real 11.557 (submit 324.192 ms wait 11.228 s), input 127.817 MiB, send shutdown 2024/11/19-15:13:49.444900 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-00 2024/11/19-15:13:49.444960 140042800465664 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00006/att-00/compact.done) = No such file or directory: 11.222 sec on http probe failed: 5, giveup 2024/11/19-15:13:49.444974 140042800465664 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00006/att-00: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.821 sec, real 11.559 (submit 328.915 ms wait 11.222 s), input 127.821 MiB, send shutdown 2024/11/19-15:13:49.449449 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-00 2024/11/19-15:13:49.449623 140042800465664 [dcompact_etcd.cc:1773] job-00006/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:13:49.451330 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-00 2024/11/19-15:13:49.451505 140042641082112 [dcompact_etcd.cc:1773] job-00008/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:13:49.454543 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-00 2024/11/19-15:13:49.454592 140042789979904 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00007/att-00/compact.done) = No such file or directory: 11.228 sec on http probe failed: 5, giveup 2024/11/19-15:13:49.454607 140042789979904 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00007/att-00: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.820 sec, real 11.569 (submit 336.233 ms wait 11.228 s), input 127.820 MiB, send shutdown 2024/11/19-15:13:49.461857 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-00 2024/11/19-15:13:49.461906 140042620110592 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00003/att-00/compact.done) = No such file or directory: 11.210 sec on http probe failed: 5, giveup 2024/11/19-15:13:49.461928 140042620110592 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00003/att-00: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.237 sec, real 11.576 (submit 359.023 ms wait 11.210 s), input 127.237 MiB, send shutdown 2024/11/19-15:13:49.463397 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-00 2024/11/19-15:13:49.463583 140042789979904 [dcompact_etcd.cc:1773] job-00007/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:13:49.470368 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-00 2024/11/19-15:13:49.470535 140042620110592 [dcompact_etcd.cc:1773] job-00003/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:13:49.478972 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-00 2024/11/19-15:13:49.479022 140042630596352 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00009/att-00/compact.done) = No such file or directory: 11.239 sec on http probe failed: 5, giveup 2024/11/19-15:13:49.479036 140042630596352 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00009/att-00: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.820 sec, real 11.593 (submit 346.391 ms wait 11.239 s), input 127.820 MiB, send shutdown 2024/11/19-15:13:49.488187 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-00 2024/11/19-15:13:49.488354 140042630596352 [dcompact_etcd.cc:1773] job-00009/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:13:49.692631 140042821437184 [dcompact_etcd.cc:1163] job-00004/att-01: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.255 sec, input = 127.240 MiB 2024/11/19-15:13:49.747625 140042800465664 [dcompact_etcd.cc:1163] job-00006/att-01: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.298 sec, input = 127.821 MiB 2024/11/19-15:13:49.760339 140042641082112 [dcompact_etcd.cc:1163] job-00008/att-01: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.309 sec, input = 127.817 MiB 2024/11/19-15:13:49.760841 140042789979904 [dcompact_etcd.cc:1163] job-00007/att-01: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.297 sec, input = 127.820 MiB 2024/11/19-15:13:49.761839 140042630596352 [dcompact_etcd.cc:1163] job-00009/att-01: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.273 sec, input = 127.820 MiB 2024/11/19-15:13:49.770554 140042620110592 [dcompact_etcd.cc:1163] job-00003/att-01: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.300 sec, input = 127.237 MiB 2024/11/19-15:13:51.815657 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-01 2024/11/19-15:13:51.815758 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-01/compact.done) = No such file or directory: 2.626 sec on http probe failed: 1, retry 2024/11/19-15:13:52.879649 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-01 2024/11/19-15:13:52.879728 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-01/compact.done) = No such file or directory: 3.181 sec on http probe failed: 1, retry 2024/11/19-15:13:52.953664 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-01 2024/11/19-15:13:52.953732 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-01/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:13:52.960268 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-01 2024/11/19-15:13:52.960325 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-01/compact.done) = No such file or directory: 3.181 sec on http probe failed: 1, retry 2024/11/19-15:13:52.962446 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-01 2024/11/19-15:13:52.962511 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-01/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:13:52.964299 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-01 2024/11/19-15:13:52.964355 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-01/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:13:52.965415 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-01 2024/11/19-15:13:52.965472 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-01/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:13:53.825891 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-01 2024/11/19-15:13:53.825979 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-01/compact.done) = No such file or directory: 4.635 sec on http probe failed: 2, retry 2024/11/19-15:13:54.888824 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-01 2024/11/19-15:13:54.888938 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-01/compact.done) = No such file or directory: 5.187 sec on http probe failed: 2, retry 2024/11/19-15:13:54.961407 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-01 2024/11/19-15:13:54.961468 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-01/compact.done) = No such file or directory: 5.206 sec on http probe failed: 2, retry 2024/11/19-15:13:54.965408 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-01 2024/11/19-15:13:54.965451 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-01/compact.done) = No such file or directory: 5.190 sec on http probe failed: 2, retry 2024/11/19-15:13:54.969399 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-01 2024/11/19-15:13:54.969454 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-01/compact.done) = No such file or directory: 5.204 sec on http probe failed: 2, retry 2024/11/19-15:13:54.971676 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-01 2024/11/19-15:13:54.971726 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-01/compact.done) = No such file or directory: 5.201 sec on http probe failed: 2, retry 2024/11/19-15:13:54.973392 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-01 2024/11/19-15:13:54.973444 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-01/compact.done) = No such file or directory: 5.205 sec on http probe failed: 2, retry 2024/11/19-15:13:55.834226 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-01 2024/11/19-15:13:55.834311 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-01/compact.done) = No such file or directory: 6.645 sec on http probe failed: 3, retry 2024/11/19-15:13:56.898547 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-01 2024/11/19-15:13:56.898634 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-01/compact.done) = No such file or directory: 7.196 sec on http probe failed: 3, retry 2024/11/19-15:13:56.966490 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-01 2024/11/19-15:13:56.966569 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-01/compact.done) = No such file or directory: 7.214 sec on http probe failed: 3, retry 2024/11/19-15:13:56.974742 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-01 2024/11/19-15:13:56.974795 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-01/compact.done) = No such file or directory: 7.195 sec on http probe failed: 3, retry 2024/11/19-15:13:56.977619 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-01 2024/11/19-15:13:56.977680 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-01/compact.done) = No such file or directory: 7.209 sec on http probe failed: 3, retry 2024/11/19-15:13:56.980483 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-01 2024/11/19-15:13:56.980539 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-01/compact.done) = No such file or directory: 7.210 sec on http probe failed: 3, retry 2024/11/19-15:13:56.983372 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-01 2024/11/19-15:13:56.983424 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-01/compact.done) = No such file or directory: 7.213 sec on http probe failed: 3, retry 2024/11/19-15:13:57.843001 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-01 2024/11/19-15:13:57.843085 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-01/compact.done) = No such file or directory: 8.653 sec on http probe failed: 4, retry 2024/11/19-15:13:58.907904 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-01 2024/11/19-15:13:58.907988 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-01/compact.done) = No such file or directory: 9.206 sec on http probe failed: 4, retry 2024/11/19-15:13:58.975303 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-01 2024/11/19-15:13:58.975370 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-01/compact.done) = No such file or directory: 9.219 sec on http probe failed: 4, retry 2024/11/19-15:13:58.979837 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-01 2024/11/19-15:13:58.979882 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-01/compact.done) = No such file or directory: 9.204 sec on http probe failed: 4, retry 2024/11/19-15:13:58.983083 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-01 2024/11/19-15:13:58.983140 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-01/compact.done) = No such file or directory: 9.217 sec on http probe failed: 4, retry 2024/11/19-15:13:58.988170 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-01 2024/11/19-15:13:58.988223 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-01/compact.done) = No such file or directory: 9.219 sec on http probe failed: 4, retry 2024/11/19-15:13:58.991134 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-01 2024/11/19-15:13:58.991187 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-01/compact.done) = No such file or directory: 9.223 sec on http probe failed: 4, retry 2024/11/19-15:13:59.853514 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-01 2024/11/19-15:13:59.853584 140042810951424 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00005/att-01/compact.done) = No such file or directory: 10.662 sec on http probe failed: 5, giveup 2024/11/19-15:13:59.853601 140042810951424 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00005/att-01: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 105.031 sec, real 10.935 (submit 261.903 ms wait 10.662 s), input 105.031 MiB, send shutdown 2024/11/19-15:13:59.858703 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-01 2024/11/19-15:13:59.858917 140042810951424 [dcompact_etcd.cc:1773] job-00005/att-01: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:00.140293 140042810951424 [dcompact_etcd.cc:1163] job-00005/att-02: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.281 sec, input = 105.031 MiB 2024/11/19-15:14:00.916553 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-01 2024/11/19-15:14:00.916648 140042821437184 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00004/att-01/compact.done) = No such file or directory: 11.215 sec on http probe failed: 5, giveup 2024/11/19-15:14:00.916669 140042821437184 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00004/att-01: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.240 sec, real 11.479 (submit 255.348 ms wait 11.215 s), input 127.240 MiB, send shutdown 2024/11/19-15:14:00.921768 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-01 2024/11/19-15:14:00.921989 140042821437184 [dcompact_etcd.cc:1773] job-00004/att-01: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:00.983898 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-01 2024/11/19-15:14:00.983970 140042800465664 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00006/att-01/compact.done) = No such file or directory: 11.228 sec on http probe failed: 5, giveup 2024/11/19-15:14:00.983990 140042800465664 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00006/att-01: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.821 sec, real 11.534 (submit 297.926 ms wait 11.228 s), input 127.821 MiB, send shutdown 2024/11/19-15:14:00.989283 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-01 2024/11/19-15:14:00.989338 140042641082112 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00008/att-01/compact.done) = No such file or directory: 11.223 sec on http probe failed: 5, giveup 2024/11/19-15:14:00.989354 140042641082112 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00008/att-01: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.817 sec, real 11.538 (submit 308.762 ms wait 11.223 s), input 127.817 MiB, send shutdown 2024/11/19-15:14:00.989633 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-01 2024/11/19-15:14:00.989682 140042620110592 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00003/att-01/compact.done) = No such file or directory: 11.209 sec on http probe failed: 5, giveup 2024/11/19-15:14:00.989695 140042620110592 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00003/att-01: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.237 sec, real 11.519 (submit 299.954 ms wait 11.209 s), input 127.237 MiB, send shutdown 2024/11/19-15:14:00.991893 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-01 2024/11/19-15:14:00.992094 140042800465664 [dcompact_etcd.cc:1773] job-00006/att-01: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:00.996661 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-01 2024/11/19-15:14:00.996714 140042630596352 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00009/att-01/compact.done) = No such file or directory: 11.226 sec on http probe failed: 5, giveup 2024/11/19-15:14:00.996729 140042630596352 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00009/att-01: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.820 sec, real 11.508 (submit 273.417 ms wait 11.226 s), input 127.820 MiB, send shutdown 2024/11/19-15:14:00.997832 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-01 2024/11/19-15:14:00.998012 140042620110592 [dcompact_etcd.cc:1773] job-00003/att-01: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:00.998191 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-01 2024/11/19-15:14:00.998380 140042641082112 [dcompact_etcd.cc:1773] job-00008/att-01: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:00.999112 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-01 2024/11/19-15:14:00.999165 140042789979904 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00007/att-01/compact.done) = No such file or directory: 11.230 sec on http probe failed: 5, giveup 2024/11/19-15:14:00.999179 140042789979904 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00007/att-01: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.820 sec, real 11.536 (submit 297.191 ms wait 11.230 s), input 127.820 MiB, send shutdown 2024/11/19-15:14:01.001188 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-01 2024/11/19-15:14:01.001367 140042630596352 [dcompact_etcd.cc:1773] job-00009/att-01: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:01.006976 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-01 2024/11/19-15:14:01.007150 140042789979904 [dcompact_etcd.cc:1773] job-00007/att-01: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:01.198334 140042821437184 [dcompact_etcd.cc:1163] job-00004/att-02: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.276 sec, input = 127.240 MiB 2024/11/19-15:14:01.259807 140042800465664 [dcompact_etcd.cc:1163] job-00006/att-02: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.268 sec, input = 127.821 MiB 2024/11/19-15:14:01.277574 140042789979904 [dcompact_etcd.cc:1163] job-00007/att-02: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.270 sec, input = 127.820 MiB 2024/11/19-15:14:01.282622 140042630596352 [dcompact_etcd.cc:1163] job-00009/att-02: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.281 sec, input = 127.820 MiB 2024/11/19-15:14:01.297109 140042620110592 [dcompact_etcd.cc:1163] job-00003/att-02: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.299 sec, input = 127.237 MiB 2024/11/19-15:14:01.308779 140042641082112 [dcompact_etcd.cc:1163] job-00008/att-02: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.310 sec, input = 127.817 MiB 2024/11/19-15:14:02.775463 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-02 2024/11/19-15:14:02.775562 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-02/compact.done) = No such file or directory: 2.626 sec on http probe failed: 1, retry 2024/11/19-15:14:04.388613 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-02 2024/11/19-15:14:04.388700 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-02/compact.done) = No such file or directory: 3.181 sec on http probe failed: 1, retry 2024/11/19-15:14:04.462022 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-02 2024/11/19-15:14:04.462107 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-02/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:14:04.479137 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-02 2024/11/19-15:14:04.479221 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-02/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:14:04.483394 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-02 2024/11/19-15:14:04.483456 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-02/compact.done) = No such file or directory: 3.181 sec on http probe failed: 1, retry 2024/11/19-15:14:04.488243 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-02 2024/11/19-15:14:04.488303 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-02/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:14:04.509072 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-02 2024/11/19-15:14:04.509127 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-02/compact.done) = No such file or directory: 3.195 sec on http probe failed: 1, retry 2024/11/19-15:14:04.783524 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-02 2024/11/19-15:14:04.783609 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-02/compact.done) = No such file or directory: 4.635 sec on http probe failed: 2, retry 2024/11/19-15:14:06.397004 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-02 2024/11/19-15:14:06.397118 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-02/compact.done) = No such file or directory: 5.190 sec on http probe failed: 2, retry 2024/11/19-15:14:06.470963 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-02 2024/11/19-15:14:06.471047 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-02/compact.done) = No such file or directory: 5.202 sec on http probe failed: 2, retry 2024/11/19-15:14:06.484015 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-02 2024/11/19-15:14:06.484078 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-02/compact.done) = No such file or directory: 5.202 sec on http probe failed: 2, retry 2024/11/19-15:14:06.491368 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-02 2024/11/19-15:14:06.491421 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-02/compact.done) = No such file or directory: 5.186 sec on http probe failed: 2, retry 2024/11/19-15:14:06.496484 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-02 2024/11/19-15:14:06.496536 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-02/compact.done) = No such file or directory: 5.206 sec on http probe failed: 2, retry 2024/11/19-15:14:06.514662 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-02 2024/11/19-15:14:06.514716 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-02/compact.done) = No such file or directory: 5.200 sec on http probe failed: 2, retry 2024/11/19-15:14:06.788734 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-02 2024/11/19-15:14:06.788816 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-02/compact.done) = No such file or directory: 6.643 sec on http probe failed: 3, retry 2024/11/19-15:14:08.405433 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-02 2024/11/19-15:14:08.405521 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-02/compact.done) = No such file or directory: 7.199 sec on http probe failed: 3, retry 2024/11/19-15:14:08.480666 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-02 2024/11/19-15:14:08.480749 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-02/compact.done) = No such file or directory: 7.211 sec on http probe failed: 3, retry 2024/11/19-15:14:08.492360 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-02 2024/11/19-15:14:08.492417 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-02/compact.done) = No such file or directory: 7.207 sec on http probe failed: 3, retry 2024/11/19-15:14:08.499872 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-02 2024/11/19-15:14:08.499935 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-02/compact.done) = No such file or directory: 7.194 sec on http probe failed: 3, retry 2024/11/19-15:14:08.501266 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-02 2024/11/19-15:14:08.501323 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-02/compact.done) = No such file or directory: 7.214 sec on http probe failed: 3, retry 2024/11/19-15:14:08.523219 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-02 2024/11/19-15:14:08.523281 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-02/compact.done) = No such file or directory: 7.206 sec on http probe failed: 3, retry 2024/11/19-15:14:08.797171 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-02 2024/11/19-15:14:08.797247 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00005/att-02/compact.done) = No such file or directory: 8.649 sec on http probe failed: 4, retry 2024/11/19-15:14:10.413614 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-02 2024/11/19-15:14:10.413698 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00004/att-02/compact.done) = No such file or directory: 9.207 sec on http probe failed: 4, retry 2024/11/19-15:14:10.489618 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-02 2024/11/19-15:14:10.489686 140042800465664 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00006/att-02/compact.done) = No such file or directory: 9.221 sec on http probe failed: 4, retry 2024/11/19-15:14:10.501957 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-02 2024/11/19-15:14:10.502015 140042789979904 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00007/att-02/compact.done) = No such file or directory: 9.215 sec on http probe failed: 4, retry 2024/11/19-15:14:10.506731 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-02 2024/11/19-15:14:10.506780 140042620110592 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00003/att-02/compact.done) = No such file or directory: 9.203 sec on http probe failed: 4, retry 2024/11/19-15:14:10.510205 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-02 2024/11/19-15:14:10.510258 140042630596352 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00009/att-02/compact.done) = No such file or directory: 9.219 sec on http probe failed: 4, retry 2024/11/19-15:14:10.531439 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-02 2024/11/19-15:14:10.531497 140042641082112 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00008/att-02/compact.done) = No such file or directory: 9.215 sec on http probe failed: 4, retry 2024/11/19-15:14:10.802532 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-02 2024/11/19-15:14:10.802613 140042810951424 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00005/att-02/compact.done) = No such file or directory: 10.657 sec on http probe failed: 5, giveup 2024/11/19-15:14:10.802633 140042810951424 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00005/att-02: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 105.031 sec, real 10.944 (submit 281.285 ms wait 10.657 s), input 105.031 MiB, send shutdown 2024/11/19-15:14:10.811642 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00005/att-02 2024/11/19-15:14:10.811865 140042810951424 [dcompact_etcd.cc:1773] job-00005/att-02: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:10.814180 140042810951424 [dcompact_etcd.cc:288] remove_all(/storage/mytopling/.rocksdb/job-00005) = success 2024/11/19-15:14:10.814188 140042810951424 [dcompact_etcd.cc:1773] job-00005/att-03: CleanFiles 0.002 sec : 0.000 2024/11/19-15:14:10.814217 140042810951424 (Original Log Time 2024/11/19-15:13:37.884992) EVENT_LOG_v1 {"time_micros": 1732000417884980, "job": 5, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4167, 4169, 4171, 4174], "score": 6.34662, "input_data_size": 111723011, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:10.814224 140042810951424 [compaction_job.cc:2437] [default] [JOB 5] Compacting 4@1 files to L2, score 6.35, subcompactions 1 : 1 2024/11/19-15:14:10.814231 140042810951424 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4167(31MB) 4169(31MB) 4171(24MB) 4174(17MB)] 2024/11/19-15:14:10.814531 140042810951424 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004300.sst) /storage/mytopling/..//tmp/Topling-81329-BeAOIO 2024/11/19-15:14:10.877837 140025429755648 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004300.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, nltTrie workingMem = 0.0009 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:10.884326 140025429755648 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004300.sst): index pass time = 0.01's, 186.853'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 100327 min-keylen = 12 max-keylen = 12 prefix = 4 subcplen = 3 raw-key = 0.0012 GB zip-key = 0.0002 GB avg-key = 12.00 avg-zkey = 1.70 2024/11/19-15:14:10.949226 140042810951424 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004300.sst): first pass time = 0.13's, 498.281'MB/sec 2024/11/19-15:14:10.949289 140042810951424 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004300.sst): old prealloc_size = 73819750, real_size = 65222736 2024/11/19-15:14:10.949363 140042810951424 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004300.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = PlainBlobStore usrkeys = 100327 prefix = 4 raw-key = 0.0012 GB zip-key = 0.0002 GB avg-key = 12.00 avg-zkey = 1.70 raw-val = 0.0647 GB zip-val = 0.0650 GB avg-val = 644.90 avg-zval = 648.15 2024/11/19-15:14:10.949458 140042810951424 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004300.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0002 GB, waited 0.072 sec, Key+Value = 0.067 GB 2024/11/19-15:14:11.020817 140042810951424 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004300.sst): second pass time = 0.00's,186997265.896'MB/sec, value only(96.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.07's, 915.635'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2401.660'MB/sec (index lex order gen) rebuild zvType time = 0.05's, 0.534'MB/sec write SST data time = 0.02's, 2677.450'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.065'GB zip my value throughput = 186997265.896'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 100327 avg-key = 24.00 avg-zkey = 1.70 avg-val = 644.90 avg-zval = 648.15 usrkeys = 100327 avg-key = 16.00 avg-zkey = 1.70 avg-val = 651.90 avg-zval = 648.15 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 100327 bytes = 275920 } seq expand size = 702289 multi value expand size = 0 cnt WriteAppend = 7945 UnZipSize{ index = 0.0016 GB value = 0.0647 GB dict = 0.00 MB all = 0.0671 GB } __ZipSize{ index = 0.0002 GB value = 0.0650 GB dict = 0.00 MB all = 0.0655 GB } UnZip/Zip{ index = 9.4363 value = 0.9950 dict = 0.00 all = 1.0249 } Zip/UnZip{ index = 0.1060 value = 1.0050 dict = 0.00 all = 0.9757 } ---------------------------- total value len = 0.065403 GB avg = 0.652 KB (by entry num) total key len = 0.002408 GB avg = 0.024 KB total ukey len = 0.001605 GB avg = 0.016 KB total ukey num = 0.000100327 Billion total entry num = 0.000100327 Billion write speed all = 328.690663695 MB/sec (with seq num) write speed all = 324.800267702 MB/sec (without seq num) 2024/11/19-15:14:11.025210 140042810951424 [compaction_job.cc:1948] [default] [JOB 5] Generated table #4300: 100327 keys, 65475482 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:11.025268 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000451025242, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 4300, "file_size": 65475482, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 100147731, "largest_seqno": 102385933, "table_properties": {"data_size": 65027328, "index_size": 170112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2407848, "raw_average_key_size": 24, "raw_value_size": 64701054, "raw_average_value_size": 644, "num_data_blocks": 1, "num_entries": 100327, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-PlainBlobStore", "creation_time": 1732000450, "oldest_key_time": 0, "file_creation_time": 1732000450, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4300, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:11.042371 140042810951424 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004301.sst) /storage/mytopling/..//tmp/Topling-81329-0DsqUh 2024/11/19-15:14:11.065407 140025461212928 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004301.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, nltTrie workingMem = 0.0003 GB, waited 0.000 sec, Key+Value = 0.025 GB 2024/11/19-15:14:11.067965 140025461212928 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004301.sst): index pass time = 0.00's, 180.738'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 37797 min-keylen = 12 max-keylen = 12 prefix = 4 subcplen = 3 raw-key = 0.0005 GB zip-key = 0.0001 GB avg-key = 12.00 avg-zkey = 1.72 2024/11/19-15:14:11.091769 140042810951424 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004301.sst): first pass time = 0.05's, 512.188'MB/sec 2024/11/19-15:14:11.091816 140042810951424 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004301.sst): old prealloc_size = 73819750, real_size = 24577472 2024/11/19-15:14:11.091859 140042810951424 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004301.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = PlainBlobStore usrkeys = 37797 prefix = 4 raw-key = 0.0005 GB zip-key = 0.0001 GB avg-key = 12.00 avg-zkey = 1.72 raw-val = 0.0244 GB zip-val = 0.0245 GB avg-val = 645.14 avg-zval = 648.27 2024/11/19-15:14:11.091933 140042810951424 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004301.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0001 GB, waited 0.027 sec, Key+Value = 0.025 GB 2024/11/19-15:14:11.118719 140042810951424 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004301.sst): second pass time = 0.00's,82379858.108'MB/sec, value only(96.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.03's, 917.359'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1622.778'MB/sec (index lex order gen) rebuild zvType time = 0.02's, 0.546'MB/sec write SST data time = 0.01's, 2583.269'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.024'GB zip my value throughput = 82379858.108'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 37797 avg-key = 24.00 avg-zkey = 1.72 avg-val = 645.14 avg-zval = 648.27 usrkeys = 37797 avg-key = 16.00 avg-zkey = 1.72 avg-val = 652.14 avg-zval = 648.27 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 37797 bytes = 94512 } seq expand size = 264579 multi value expand size = 0 cnt WriteAppend = 3000 UnZipSize{ index = 0.0006 GB value = 0.0244 GB dict = 0.00 MB all = 0.0253 GB } __ZipSize{ index = 0.0001 GB value = 0.0245 GB dict = 0.00 MB all = 0.0247 GB } UnZip/Zip{ index = 9.2913 value = 0.9952 dict = 0.00 all = 1.0254 } Zip/UnZip{ index = 0.1076 value = 1.0049 dict = 0.00 all = 0.9752 } ---------------------------- total value len = 0.090052 GB avg = 0.652 KB (by entry num) total key len = 0.003315 GB avg = 0.024 KB total ukey len = 0.002210 GB avg = 0.016 KB total ukey num = 0.000138124 Billion total entry num = 0.000138124 Billion write speed all = 306.912581190 MB/sec (with seq num) write speed all = 303.280305049 MB/sec (without seq num) 2024/11/19-15:14:11.120659 140042810951424 [compaction_job.cc:1948] [default] [JOB 5] Generated table #4301: 37797 keys, 24663961 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:11.120711 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000451120688, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 4301, "file_size": 24663961, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 101899078, "largest_seqno": 102620889, "table_properties": {"data_size": 24502768, "index_size": 65088, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 907128, "raw_average_key_size": 24, "raw_value_size": 24384438, "raw_average_value_size": 645, "num_data_blocks": 1, "num_entries": 37797, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-PlainBlobStore", "creation_time": 1732000451, "oldest_key_time": 0, "file_creation_time": 1732000451, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4301, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:11.126784 140042810951424 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004302.sst) /storage/mytopling/..//tmp/Topling-81329-yUKbY0 2024/11/19-15:14:11.191833 140025811437312 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004302.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, nltTrie workingMem = 0.0000 GB, waited 0.000 sec, Key+Value = 0.018 GB 2024/11/19-15:14:11.191956 140025811437312 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004302.sst): index pass time = 0.00's,24792.861'MB/sec index type = UintIndex_AllOne usrkeys = 239623 min-keylen = 8 max-keylen = 8 prefix = 4 subcplen = 5 raw-key = 0.0019 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.00 2024/11/19-15:14:11.210904 140042810951424 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004302.sst): first pass time = 0.08's, 210.846'MB/sec 2024/11/19-15:14:11.210959 140042810951424 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004302.sst): old prealloc_size = 73819750, real_size = 13719880 2024/11/19-15:14:11.210981 140042810951424 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004302.sst): index type = UintIndex_AllOne , store type = PlainBlobStore usrkeys = 239623 prefix = 4 raw-key = 0.0019 GB zip-key = 0.0000 GB avg-key = 8.00 avg-zkey = 0.00 raw-val = 0.0129 GB zip-val = 0.0137 GB avg-val = 54.00 avg-zval = 57.00 2024/11/19-15:14:11.241226 140042810951424 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004302.sst): second pass time = 0.00's,31485454.988'MB/sec, value only(73.0% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.03's, 473.379'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 10.164'MB/sec (index lex order gen) rebuild zvType time = 0.02's, 3.968'MB/sec write SST data time = 0.02's, 946.078'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.013'GB zip my value throughput = 31485454.988'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 239623 avg-key = 20.00 avg-zkey = 0.00 avg-val = 54.00 avg-zval = 57.00 usrkeys = 239623 avg-key = 12.00 avg-zkey = 0.00 avg-val = 61.00 avg-zval = 57.00 TagRS{ kinds = RS_Key0_Tag1 bytes = 0 } TagArray{ size = 239623 bytes = 658976 } seq expand size = 1677361 multi value expand size = 0 cnt WriteAppend = 1675 UnZipSize{ index = 0.0029 GB value = 0.0129 GB dict = 0.00 MB all = 0.0177 GB } __ZipSize{ index = 0.0000 GB value = 0.0137 GB dict = 0.00 MB all = 0.0143 GB } UnZip/Zip{ index =14976.4375 value = 0.9474 dict = 0.00 all = 1.2383 } Zip/UnZip{ index = 0.0001 value = 1.0556 dict = 0.00 all = 0.8075 } ---------------------------- total value len = 0.104670 GB avg = 0.277 KB (by entry num) total key len = 0.008107 GB avg = 0.021 KB total ukey len = 0.005085 GB avg = 0.013 KB total ukey num = 0.000377747 Billion total entry num = 0.000377747 Billion write speed all = 264.287593339 MB/sec (with seq num) write speed all = 257.205777404 MB/sec (without seq num) 2024/11/19-15:14:11.242489 140042810951424 [compaction_job.cc:1948] [default] [JOB 5] Generated table #4302: 239623 keys, 14319937 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:11.242539 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000451242517, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 4302, "file_size": 14319937, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 93922208, "largest_seqno": 97855474, "table_properties": {"data_size": 13659600, "index_size": 192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 4792460, "raw_average_key_size": 20, "raw_value_size": 12940522, "raw_average_value_size": 54, "num_data_blocks": 1, "num_entries": 239623, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 20, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "FlatZip", "compression_options": "RS_Key0_Tag1-UintIndex_AllOne-PlainBlobStore", "creation_time": 1732000451, "oldest_key_time": 0, "file_creation_time": 1732000451, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4302, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:11.246546 140042810951424 [compaction_job.cc:703] job-00005: subcompact[0], size: 0.104459 G, files: /storage/mytopling/.rocksdb [004300,004301,004302] 2024/11/19-15:14:11.247621 140042810951424 (Original Log Time 2024/11/19-15:14:10.814261) EVENT_LOG_v1 {"time_micros": 1732000450814245, "job": 5, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4167, 4169, 4171, 4174], "score": 6.34662, "input_data_size": 111723011, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:11.247630 140042810951424 (Original Log Time 2024/11/19-15:14:11.247166) [compaction_job.cc:2022] [default] [JOB 5] Compacted 4@1 files to L2 => 104459380 bytes 2024/11/19-15:14:11.247634 140042810951424 (Original Log Time 2024/11/19-15:14:11.247517) [compaction_job.cc:1224] [default] compacted to: files[3 108 49 80 0 0 0] max score 5.14 (136 files need compaction), MB/sec: 258.4 rd, 241.6 wr, level 2, files in(4, 0) out(3 +0 blob) MB in(106.5, 0.0 +0.0 blob) out(99.6 +0.0 blob), read-write-amplify(1.9) write-amplify(0.9) OK, records in: 377747, records dropped: 0 output_compression: Snappy 2024/11/19-15:14:11.247640 140042810951424 (Original Log Time 2024/11/19-15:14:11.247548) EVENT_LOG_v1 {"time_micros": 1732000451247532, "cf": "default", "job": 5, "event": "compaction_finished", "compaction_time_micros": 432295, "compaction_time_cpu_micros": 430284, "output_level": 2, "num_output_files": 3, "total_output_size": 104459380, "num_input_records": 377747, "num_output_records": 377747, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 108, 49, 80, 0, 0, 0]} 2024/11/19-15:14:11.247718 140042810951424 [compaction_job.cc:2437] [default] [JOB 10] Compacting 4@1 files to L2, score 5.14, subcompactions 1 : 1 2024/11/19-15:14:11.247726 140042810951424 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 8 Base level 1, inputs: [4227(31MB) 4229(31MB) 4235(31MB) 4239(31MB)] 2024/11/19-15:14:11.525994 140042810951424 [dcompact_etcd.cc:1163] job-00010/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.278 sec, input = 127.822 MiB 2024/11/19-15:14:12.422783 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-02 2024/11/19-15:14:12.422871 140042821437184 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00004/att-02/compact.done) = No such file or directory: 11.215 sec on http probe failed: 5, giveup 2024/11/19-15:14:12.422889 140042821437184 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00004/att-02: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.240 sec, real 11.501 (submit 276.264 ms wait 11.215 s), input 127.240 MiB, send shutdown 2024/11/19-15:14:12.431236 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00004/att-02 2024/11/19-15:14:12.431437 140042821437184 [dcompact_etcd.cc:1773] job-00004/att-02: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:12.434089 140042821437184 [dcompact_etcd.cc:288] remove_all(/storage/mytopling/.rocksdb/job-00004) = success 2024/11/19-15:14:12.434097 140042821437184 [dcompact_etcd.cc:1773] job-00004/att-03: CleanFiles 0.003 sec : 0.000 2024/11/19-15:14:12.434114 140042821437184 (Original Log Time 2024/11/19-15:13:37.884997) EVENT_LOG_v1 {"time_micros": 1732000417884987, "job": 4, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4159, 4161, 4163, 4165], "score": 6.59627, "input_data_size": 134026944, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:12.434121 140042821437184 [compaction_job.cc:2437] [default] [JOB 4] Compacting 4@1 files to L2, score 6.60, subcompactions 1 : 1 2024/11/19-15:14:12.434129 140042821437184 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4159(31MB) 4161(31MB) 4163(31MB) 4165(31MB)] 2024/11/19-15:14:12.434387 140042821437184 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004303.sst) /storage/mytopling/..//tmp/Topling-81329-LwIpBf 2024/11/19-15:14:12.495979 140025450727168 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004303.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, nltTrie workingMem = 0.0009 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.498000 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-02 2024/11/19-15:14:12.498130 140042800465664 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00006/att-02/compact.done) = No such file or directory: 11.230 sec on http probe failed: 5, giveup 2024/11/19-15:14:12.498156 140042800465664 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00006/att-02: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.821 sec, real 11.506 (submit 267.637 ms wait 11.230 s), input 127.821 MiB, send shutdown 2024/11/19-15:14:12.502307 140025450727168 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004303.sst): index pass time = 0.01's, 191.651'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 100352 min-keylen = 12 max-keylen = 12 prefix = 4 subcplen = 3 raw-key = 0.0012 GB zip-key = 0.0002 GB avg-key = 12.00 avg-zkey = 1.70 2024/11/19-15:14:12.502623 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00006/att-02 2024/11/19-15:14:12.502873 140042800465664 [dcompact_etcd.cc:1773] job-00006/att-02: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:12.504748 140042800465664 [dcompact_etcd.cc:288] remove_all(/storage/mytopling/.rocksdb/job-00006) = success 2024/11/19-15:14:12.504763 140042800465664 [dcompact_etcd.cc:1773] job-00006/att-03: CleanFiles 0.002 sec : 0.000 2024/11/19-15:14:12.504788 140042800465664 (Original Log Time 2024/11/19-15:13:37.885184) EVENT_LOG_v1 {"time_micros": 1732000417885176, "job": 6, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4172, 4177, 4180, 4184], "score": 6.13852, "input_data_size": 133299980, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:12.504799 140042800465664 [compaction_job.cc:2437] [default] [JOB 6] Compacting 4@1 files to L2, score 6.14, subcompactions 1 : 1 2024/11/19-15:14:12.504811 140042800465664 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4172(31MB) 4177(31MB) 4180(31MB) 4184(31MB)] 2024/11/19-15:14:12.505163 140042800465664 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004304.sst) /storage/mytopling/..//tmp/Topling-81329-fy0T9g 2024/11/19-15:14:12.508196 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-02 2024/11/19-15:14:12.508250 140042789979904 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00007/att-02/compact.done) = No such file or directory: 11.225 sec on http probe failed: 5, giveup 2024/11/19-15:14:12.508266 140042789979904 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00007/att-02: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.820 sec, real 11.501 (submit 270.359 ms wait 11.225 s), input 127.820 MiB, send shutdown 2024/11/19-15:14:12.514933 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-02 2024/11/19-15:14:12.514986 140042620110592 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00003/att-02/compact.done) = No such file or directory: 11.210 sec on http probe failed: 5, giveup 2024/11/19-15:14:12.515000 140042620110592 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00003/att-02: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.237 sec, real 11.517 (submit 299.034 ms wait 11.210 s), input 127.237 MiB, send shutdown 2024/11/19-15:14:12.516563 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00007/att-02 2024/11/19-15:14:12.516744 140042789979904 [dcompact_etcd.cc:1773] job-00007/att-02: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:12.518490 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-02 2024/11/19-15:14:12.518494 140042789979904 [dcompact_etcd.cc:288] remove_all(/storage/mytopling/.rocksdb/job-00007) = success 2024/11/19-15:14:12.518510 140042789979904 [dcompact_etcd.cc:1773] job-00007/att-03: CleanFiles 0.002 sec : 0.000 2024/11/19-15:14:12.518526 140042789979904 (Original Log Time 2024/11/19-15:13:37.885285) EVENT_LOG_v1 {"time_micros": 1732000417885275, "job": 7, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4189, 4192, 4195, 4199], "score": 5.88887, "input_data_size": 133300108, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:12.518533 140042789979904 [compaction_job.cc:2437] [default] [JOB 7] Compacting 4@1 files to L2, score 5.89, subcompactions 1 : 1 2024/11/19-15:14:12.518540 140042789979904 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4189(31MB) 4192(31MB) 4195(31MB) 4199(31MB)] 2024/11/19-15:14:12.518546 140042630596352 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00009/att-02/compact.done) = No such file or directory: 11.228 sec on http probe failed: 5, giveup 2024/11/19-15:14:12.518562 140042630596352 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00009/att-02: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.820 sec, real 11.517 (submit 281.186 ms wait 11.228 s), input 127.820 MiB, send shutdown 2024/11/19-15:14:12.518792 140042789979904 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004305.sst) /storage/mytopling/..//tmp/Topling-81329-dRsrFm 2024/11/19-15:14:12.523069 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00003/att-02 2024/11/19-15:14:12.523245 140042620110592 [dcompact_etcd.cc:1773] job-00003/att-02: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:12.523933 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00009/att-02 2024/11/19-15:14:12.524113 140042630596352 [dcompact_etcd.cc:1773] job-00009/att-02: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:12.524992 140042620110592 [dcompact_etcd.cc:288] remove_all(/storage/mytopling/.rocksdb/job-00003) = success 2024/11/19-15:14:12.525002 140042620110592 [dcompact_etcd.cc:1773] job-00003/att-03: CleanFiles 0.002 sec : 0.000 2024/11/19-15:14:12.525018 140042620110592 (Original Log Time 2024/11/19-15:13:37.884992) EVENT_LOG_v1 {"time_micros": 1732000417884977, "job": 3, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4151, 4152, 4153, 4156], "score": 6.84592, "input_data_size": 134027584, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:12.525031 140042620110592 [compaction_job.cc:2437] [default] [JOB 3] Compacting 4@1 files to L2, score 6.85, subcompactions 1 : 1 2024/11/19-15:14:12.525038 140042620110592 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4151(31MB) 4152(31MB) 4153(31MB) 4156(31MB)] 2024/11/19-15:14:12.525251 140042620110592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004306.sst) /storage/mytopling/..//tmp/Topling-81329-fsocQl 2024/11/19-15:14:12.526442 140042630596352 [dcompact_etcd.cc:288] remove_all(/storage/mytopling/.rocksdb/job-00009) = success 2024/11/19-15:14:12.526457 140042630596352 [dcompact_etcd.cc:1773] job-00009/att-03: CleanFiles 0.002 sec : 0.000 2024/11/19-15:14:12.526479 140042630596352 (Original Log Time 2024/11/19-15:13:37.885287) EVENT_LOG_v1 {"time_micros": 1732000417885279, "job": 9, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4216, 4219, 4223, 4225], "score": 5.38958, "input_data_size": 133300236, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:12.526489 140042630596352 [compaction_job.cc:2437] [default] [JOB 9] Compacting 4@1 files to L2, score 5.39, subcompactions 1 : 1 2024/11/19-15:14:12.526500 140042630596352 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4216(31MB) 4219(31MB) 4223(31MB) 4225(31MB)] 2024/11/19-15:14:12.526756 140042630596352 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004307.sst) /storage/mytopling/..//tmp/Topling-81329-nRO0RO 2024/11/19-15:14:12.536170 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-02 2024/11/19-15:14:12.536231 140042641082112 [dcompact_etcd.cc:1213] fopen(/storage/mytopling/.rocksdb/job-00008/att-02/compact.done) = No such file or directory: 11.223 sec on http probe failed: 5, giveup 2024/11/19-15:14:12.536250 140042641082112 [ERROR] [dcompact_etcd.cc:1318] DcompactEtcdExec::Attempt: job-00008/att-02: at http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 estimate timeout 127.817 sec, real 11.538 (submit 310.335 ms wait 11.223 s), input 127.817 MiB, send shutdown 2024/11/19-15:14:12.541118 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00008/att-02 2024/11/19-15:14:12.541320 140042641082112 [dcompact_etcd.cc:1773] job-00008/att-02: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:12.543135 140042641082112 [dcompact_etcd.cc:288] remove_all(/storage/mytopling/.rocksdb/job-00008) = success 2024/11/19-15:14:12.543151 140042641082112 [dcompact_etcd.cc:1773] job-00008/att-03: CleanFiles 0.002 sec : 0.000 2024/11/19-15:14:12.543172 140042641082112 (Original Log Time 2024/11/19-15:13:37.885259) EVENT_LOG_v1 {"time_micros": 1732000417885250, "job": 8, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4203, 4206, 4209, 4212], "score": 5.63923, "input_data_size": 133300172, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:12.543182 140042641082112 [compaction_job.cc:2437] [default] [JOB 8] Compacting 4@1 files to L2, score 5.64, subcompactions 1 : 1 2024/11/19-15:14:12.543195 140042641082112 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 6 Base level 1, inputs: [4203(31MB) 4206(31MB) 4209(31MB) 4212(31MB)] 2024/11/19-15:14:12.543478 140042641082112 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004308.sst) /storage/mytopling/..//tmp/Topling-81329-TDyUCS 2024/11/19-15:14:12.586070 140042821437184 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004303.sst): first pass time = 0.15's, 442.479'MB/sec 2024/11/19-15:14:12.586140 140042821437184 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004303.sst): old prealloc_size = 73819750, real_size = 65222736 2024/11/19-15:14:12.586222 140042821437184 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004303.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = PlainBlobStore usrkeys = 100352 prefix = 4 raw-key = 0.0012 GB zip-key = 0.0002 GB avg-key = 12.00 avg-zkey = 1.70 raw-val = 0.0647 GB zip-val = 0.0650 GB avg-val = 644.74 avg-zval = 647.99 2024/11/19-15:14:12.586299 140042821437184 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004303.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0002 GB, waited 0.090 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.624088 140025429755648 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004306.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, nltTrie workingMem = 0.0009 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.632379 140025429755648 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004306.sst): index pass time = 0.01's, 145.911'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 100293 min-keylen = 12 max-keylen = 12 prefix = 4 subcplen = 3 raw-key = 0.0012 GB zip-key = 0.0002 GB avg-key = 12.00 avg-zkey = 1.70 2024/11/19-15:14:12.669049 140025461212928 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004305.sst: sumWaitingMem = 0.006 GB, sumWorkingMem = 0.000 GB, nltTrie workingMem = 0.0060 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.672054 140025429755648 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004304.sst: sumWaitingMem = 0.006 GB, sumWorkingMem = 0.006 GB, nltTrie workingMem = 0.0060 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.685986 140042821437184 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004303.sst): second pass time = 0.00's,116159617.594'MB/sec, value only(96.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.10's, 653.265'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2124.465'MB/sec (index lex order gen) rebuild zvType time = 0.06's, 0.394'MB/sec write SST data time = 0.04's, 1809.602'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.065'GB zip my value throughput = 116159617.594'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 100352 avg-key = 24.00 avg-zkey = 1.70 avg-val = 644.74 avg-zval = 647.99 usrkeys = 100352 avg-key = 16.00 avg-zkey = 1.70 avg-val = 644.74 avg-zval = 647.99 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 7941 UnZipSize{ index = 0.0016 GB value = 0.0647 GB dict = 0.00 MB all = 0.0671 GB } __ZipSize{ index = 0.0002 GB value = 0.0650 GB dict = 0.00 MB all = 0.0652 GB } UnZip/Zip{ index = 9.4351 value = 0.9950 dict = 0.00 all = 1.0293 } Zip/UnZip{ index = 0.1060 value = 1.0050 dict = 0.00 all = 0.9715 } ---------------------------- total value len = 0.169371 GB avg = 0.354 KB (by entry num) total key len = 0.010516 GB avg = 0.022 KB total ukey len = 0.006691 GB avg = 0.014 KB total ukey num = 0.000478099 Billion total entry num = 0.000478099 Billion write speed all = 96.121772885 MB/sec (with seq num) write speed all = 94.078013644 MB/sec (without seq num) 2024/11/19-15:14:12.692222 140042821437184 [compaction_job.cc:1948] [default] [JOB 4] Generated table #4303: 100352 keys, 65199501 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:12.692293 140042821437184 EVENT_LOG_v1 {"time_micros": 1732000452692259, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 4303, "file_size": 65199501, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 65027264, "index_size": 170176, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2408448, "raw_average_key_size": 24, "raw_value_size": 64700907, "raw_average_value_size": 644, "num_data_blocks": 1, "num_entries": 100352, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-PlainBlobStore", "creation_time": 1732000452, "oldest_key_time": 0, "file_creation_time": 1732000452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4303, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:12.717452 140042821437184 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004309.sst) /storage/mytopling/..//tmp/Topling-81329-Pv6FDf 2024/11/19-15:14:12.718256 140042620110592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004306.sst): first pass time = 0.19's, 347.729'MB/sec 2024/11/19-15:14:12.718316 140042620110592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004306.sst): old prealloc_size = 73819750, real_size = 65223600 2024/11/19-15:14:12.718397 140042620110592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004306.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = PlainBlobStore usrkeys = 100293 prefix = 4 raw-key = 0.0012 GB zip-key = 0.0002 GB avg-key = 12.00 avg-zkey = 1.70 raw-val = 0.0647 GB zip-val = 0.0650 GB avg-val = 645.13 avg-zval = 648.38 2024/11/19-15:14:12.718473 140042620110592 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004306.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.012 GB, reorder workingMem = 0.0002 GB, waited 0.094 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.729364 140025461212928 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004305.sst): index pass time = 0.06's, 123.057'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 463563 min-keylen = 16 max-keylen = 16 prefix = 4 subcplen = 3 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 2024/11/19-15:14:12.737184 140025429755648 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004304.sst): index pass time = 0.07's, 113.937'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 463582 min-keylen = 16 max-keylen = 16 prefix = 4 subcplen = 3 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.89 2024/11/19-15:14:12.793138 140042789979904 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004305.sst): first pass time = 0.27's, 244.628'MB/sec 2024/11/19-15:14:12.793192 140042789979904 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004305.sst): old prealloc_size = 73819750, real_size = 55628848 2024/11/19-15:14:12.793437 140042789979904 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004305.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = MixedLenBlobStore usrkeys = 463563 prefix = 4 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0541 GB zip-val = 0.0546 GB avg-val = 116.77 avg-zval = 117.85 2024/11/19-15:14:12.793502 140042789979904 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004305.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.124 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.795627 140042800465664 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004304.sst): first pass time = 0.29's, 231.055'MB/sec 2024/11/19-15:14:12.795673 140042800465664 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004304.sst): old prealloc_size = 73819750, real_size = 55625200 2024/11/19-15:14:12.795896 140042800465664 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004304.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = MixedLenBlobStore usrkeys = 463582 prefix = 4 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.0541 GB zip-val = 0.0546 GB avg-val = 116.76 avg-zval = 117.85 2024/11/19-15:14:12.795960 140042800465664 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004304.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.001 GB, reorder workingMem = 0.0011 GB, waited 0.124 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.798085 140025811437312 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004307.sst: sumWaitingMem = 0.006 GB, sumWorkingMem = 0.002 GB, nltTrie workingMem = 0.0060 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.806565 140025461212928 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004308.sst: sumWaitingMem = 0.006 GB, sumWorkingMem = 0.007 GB, nltTrie workingMem = 0.0060 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.814356 140025429755648 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004309.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.012 GB, nltTrie workingMem = 0.0009 GB, waited 0.000 sec, Key+Value = 0.066 GB 2024/11/19-15:14:12.819385 140042620110592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004306.sst): second pass time = 0.00's,361464167.598'MB/sec, value only(96.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.10's, 645.293'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2110.126'MB/sec (index lex order gen) rebuild zvType time = 0.06's, 0.396'MB/sec write SST data time = 0.04's, 1729.128'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.065'GB zip my value throughput = 361464167.598'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 100293 avg-key = 24.00 avg-zkey = 1.70 avg-val = 645.13 avg-zval = 648.38 usrkeys = 100293 avg-key = 16.00 avg-zkey = 1.70 avg-val = 645.13 avg-zval = 648.38 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 7943 UnZipSize{ index = 0.0016 GB value = 0.0647 GB dict = 0.00 MB all = 0.0671 GB } __ZipSize{ index = 0.0002 GB value = 0.0650 GB dict = 0.00 MB all = 0.0652 GB } UnZip/Zip{ index = 9.4331 value = 0.9950 dict = 0.00 all = 1.0293 } Zip/UnZip{ index = 0.1060 value = 1.0050 dict = 0.00 all = 0.9716 } ---------------------------- total value len = 0.234073 GB avg = 0.405 KB (by entry num) total key len = 0.012923 GB avg = 0.022 KB total ukey len = 0.008296 GB avg = 0.014 KB total ukey num = 0.000578392 Billion total entry num = 0.000578392 Billion write speed all = 123.198577793 MB/sec (with seq num) write speed all = 120.890620484 MB/sec (without seq num) 2024/11/19-15:14:12.828969 140042620110592 [compaction_job.cc:1948] [default] [JOB 3] Generated table #4306: 100293 keys, 65200461 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:12.829050 140042620110592 EVENT_LOG_v1 {"time_micros": 1732000452829010, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 4306, "file_size": 65200461, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 65028256, "index_size": 170112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2407032, "raw_average_key_size": 24, "raw_value_size": 64702086, "raw_average_value_size": 645, "num_data_blocks": 1, "num_entries": 100293, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-PlainBlobStore", "creation_time": 1732000452, "oldest_key_time": 0, "file_creation_time": 1732000452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4306, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:12.841276 140025429755648 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004309.sst): index pass time = 0.03's, 44.251'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 99143 min-keylen = 12 max-keylen = 12 prefix = 4 subcplen = 3 raw-key = 0.0012 GB zip-key = 0.0002 GB avg-key = 12.00 avg-zkey = 1.70 2024/11/19-15:14:12.859841 140025811437312 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004307.sst): index pass time = 0.06's, 120.100'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 463365 min-keylen = 16 max-keylen = 16 prefix = 4 subcplen = 3 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.89 2024/11/19-15:14:12.859910 140042620110592 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004310.sst) /storage/mytopling/..//tmp/Topling-81329-BFiNuc 2024/11/19-15:14:12.866554 140025461212928 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004308.sst): index pass time = 0.06's, 123.688'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 463464 min-keylen = 16 max-keylen = 16 prefix = 4 subcplen = 3 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 2024/11/19-15:14:12.900895 140042789979904 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004305.sst): second pass time = 0.00's,145900684.636'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.11's, 515.578'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3641.192'MB/sec (index lex order gen) rebuild zvType time = 0.06's, 1.878'MB/sec write SST data time = 0.05's, 1213.969'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.054'GB zip my value throughput = 145900684.636'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 463563 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.77 avg-zval = 117.85 usrkeys = 463563 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.77 avg-zval = 117.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 6615 UnZipSize{ index = 0.0093 GB value = 0.0541 GB dict = 0.00 MB all = 0.0671 GB } __ZipSize{ index = 0.0009 GB value = 0.0546 GB dict = 0.00 MB all = 0.0555 GB } UnZip/Zip{ index = 10.5065 value = 0.9908 dict = 0.00 all = 1.2088 } Zip/UnZip{ index = 0.0952 value = 1.0093 dict = 0.00 all = 0.8273 } ---------------------------- total value len = 0.288202 GB avg = 0.277 KB (by entry num) total key len = 0.025903 GB avg = 0.025 KB total ukey len = 0.017567 GB avg = 0.017 KB total ukey num = 0.001041955 Billion total entry num = 0.001041955 Billion write speed all = 150.549897271 MB/sec (with seq num) write speed all = 146.554642608 MB/sec (without seq num) 2024/11/19-15:14:12.905204 140042789979904 [compaction_job.cc:1948] [default] [JOB 7] Generated table #4305: 463563 keys, 55518257 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:12.905259 140042789979904 EVENT_LOG_v1 {"time_micros": 1732000452905235, "cf_name": "default", "job": 7, "event": "table_file_creation", "file_number": 4305, "file_size": 55518257, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 54630368, "index_size": 882432, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 12979764, "raw_average_key_size": 28, "raw_value_size": 54129154, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 463563, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-MixedLenBlobStore", "creation_time": 1732000452, "oldest_key_time": 0, "file_creation_time": 1732000452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4305, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:12.908865 140042800465664 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004304.sst): second pass time = 0.00's,84974310.832'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.11's, 490.522'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 4000.073'MB/sec (index lex order gen) rebuild zvType time = 0.06's, 2.058'MB/sec write SST data time = 0.06's, 980.266'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.054'GB zip my value throughput = 84974310.832'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 463582 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.76 avg-zval = 117.85 usrkeys = 463582 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.76 avg-zval = 117.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 6615 UnZipSize{ index = 0.0093 GB value = 0.0541 GB dict = 0.00 MB all = 0.0671 GB } __ZipSize{ index = 0.0009 GB value = 0.0546 GB dict = 0.00 MB all = 0.0555 GB } UnZip/Zip{ index = 10.5690 value = 0.9908 dict = 0.00 all = 1.2089 } Zip/UnZip{ index = 0.0946 value = 1.0093 dict = 0.00 all = 0.8272 } ---------------------------- total value len = 0.342331 GB avg = 0.227 KB (by entry num) total key len = 0.038883 GB avg = 0.026 KB total ukey len = 0.026839 GB avg = 0.018 KB total ukey num = 0.001505537 Billion total entry num = 0.001505537 Billion write speed all = 182.019327143 MB/sec (with seq num) write speed all = 176.268503085 MB/sec (without seq num) 2024/11/19-15:14:12.912981 140042800465664 [compaction_job.cc:1948] [default] [JOB 6] Generated table #4304: 463582 keys, 55514609 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:12.913044 140042800465664 EVENT_LOG_v1 {"time_micros": 1732000452913006, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 4304, "file_size": 55514609, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 54631904, "index_size": 877248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 12980296, "raw_average_key_size": 28, "raw_value_size": 54128636, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 463582, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-MixedLenBlobStore", "creation_time": 1732000452, "oldest_key_time": 0, "file_creation_time": 1732000452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4304, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:12.915772 140042821437184 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004309.sst): first pass time = 0.20's, 334.415'MB/sec 2024/11/19-15:14:12.915832 140042821437184 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004309.sst): old prealloc_size = 73819750, real_size = 64447552 2024/11/19-15:14:12.915931 140042821437184 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004309.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = PlainBlobStore usrkeys = 99143 prefix = 4 raw-key = 0.0012 GB zip-key = 0.0002 GB avg-key = 12.00 avg-zkey = 1.70 raw-val = 0.0639 GB zip-val = 0.0643 GB avg-val = 644.85 avg-zval = 648.10 2024/11/19-15:14:12.916029 140042821437184 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004309.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0002 GB, waited 0.102 sec, Key+Value = 0.066 GB 2024/11/19-15:14:12.921122 140042789979904 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004311.sst) /storage/mytopling/..//tmp/Topling-81329-9431rn 2024/11/19-15:14:12.928574 140042800465664 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004312.sst) /storage/mytopling/..//tmp/Topling-81329-3HmmjU 2024/11/19-15:14:12.942730 140042630596352 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004307.sst): first pass time = 0.42's, 161.336'MB/sec 2024/11/19-15:14:12.942793 140042630596352 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004307.sst): old prealloc_size = 73819750, real_size = 55606832 2024/11/19-15:14:12.943092 140042630596352 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004307.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = MixedLenBlobStore usrkeys = 463365 prefix = 4 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.0541 GB zip-val = 0.0546 GB avg-val = 116.83 avg-zval = 117.86 2024/11/19-15:14:12.943193 140042630596352 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004307.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.145 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.958719 140025811437312 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004310.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.001 GB, nltTrie workingMem = 0.0009 GB, waited 0.000 sec, Key+Value = 0.066 GB 2024/11/19-15:14:12.963326 140042641082112 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004308.sst): first pass time = 0.42's, 159.847'MB/sec 2024/11/19-15:14:12.963383 140042641082112 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004308.sst): old prealloc_size = 73819750, real_size = 55620832 2024/11/19-15:14:12.963673 140042641082112 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004308.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = MixedLenBlobStore usrkeys = 463464 prefix = 4 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0541 GB zip-val = 0.0546 GB avg-val = 116.80 avg-zval = 117.86 2024/11/19-15:14:12.963770 140042641082112 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004308.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.001 GB, reorder workingMem = 0.0011 GB, waited 0.157 sec, Key+Value = 0.067 GB 2024/11/19-15:14:12.967098 140025811437312 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004310.sst): index pass time = 0.01's, 142.417'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 99088 min-keylen = 12 max-keylen = 12 prefix = 4 subcplen = 3 raw-key = 0.0012 GB zip-key = 0.0002 GB avg-key = 12.00 avg-zkey = 1.70 2024/11/19-15:14:13.015948 140042821437184 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004309.sst): second pass time = 0.00's,199164947.040'MB/sec, value only(96.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.10's, 643.745'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 1728.574'MB/sec (index lex order gen) rebuild zvType time = 0.06's, 0.391'MB/sec write SST data time = 0.04's, 1759.641'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.064'GB zip my value throughput = 199164947.040'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 99143 avg-key = 24.00 avg-zkey = 1.70 avg-val = 644.85 avg-zval = 648.10 usrkeys = 99143 avg-key = 16.00 avg-zkey = 1.70 avg-val = 644.85 avg-zval = 648.10 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 7848 UnZipSize{ index = 0.0016 GB value = 0.0639 GB dict = 0.00 MB all = 0.0663 GB } __ZipSize{ index = 0.0002 GB value = 0.0643 GB dict = 0.00 MB all = 0.0644 GB } UnZip/Zip{ index = 9.4314 value = 0.9950 dict = 0.00 all = 1.0293 } Zip/UnZip{ index = 0.1060 value = 1.0050 dict = 0.00 all = 0.9715 } ---------------------------- total value len = 0.406263 GB avg = 0.253 KB (by entry num) total key len = 0.041262 GB avg = 0.026 KB total ukey len = 0.028425 GB avg = 0.018 KB total ukey num = 0.001604680 Billion total entry num = 0.001604680 Billion write speed all = 203.289999942 MB/sec (with seq num) write speed all = 197.458547064 MB/sec (without seq num) 2024/11/19-15:14:13.022996 140042821437184 [compaction_job.cc:1948] [default] [JOB 4] Generated table #4309: 99143 keys, 64424653 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:13.023088 140042821437184 EVENT_LOG_v1 {"time_micros": 1732000453023052, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 4309, "file_size": 64424653, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 64254384, "index_size": 168192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2379432, "raw_average_key_size": 24, "raw_value_size": 63931948, "raw_average_value_size": 644, "num_data_blocks": 1, "num_entries": 99143, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-PlainBlobStore", "creation_time": 1732000452, "oldest_key_time": 0, "file_creation_time": 1732000452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4309, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:13.049186 140042821437184 [compaction_job.cc:703] job-00004: subcompact[0], size: 0.129624 G, files: /storage/mytopling/.rocksdb [004303,004309] 2024/11/19-15:14:13.050402 140042821437184 (Original Log Time 2024/11/19-15:14:12.434158) EVENT_LOG_v1 {"time_micros": 1732000452434142, "job": 4, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4159, 4161, 4163, 4165], "score": 6.59627, "input_data_size": 134026944, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:13.050417 140042821437184 (Original Log Time 2024/11/19-15:14:13.049787) [compaction_job.cc:2022] [default] [JOB 4] Compacted 4@1 files to L2 => 129624154 bytes 2024/11/19-15:14:13.050423 140042821437184 (Original Log Time 2024/11/19-15:14:13.050285) [compaction_job.cc:1224] [default] compacted to: files[3 104 51 80 0 0 0] max score 4.89 (134 files need compaction), MB/sec: 217.9 rd, 210.8 wr, level 2, files in(4, 0) out(2 +0 blob) MB in(127.8, 0.0 +0.0 blob) out(123.6 +0.0 blob), read-write-amplify(2.0) write-amplify(1.0) OK, records in: 199495, records dropped: 0 output_compression: Snappy 2024/11/19-15:14:13.050434 140042821437184 (Original Log Time 2024/11/19-15:14:13.050324) EVENT_LOG_v1 {"time_micros": 1732000453050305, "cf": "default", "job": 4, "event": "compaction_finished", "compaction_time_micros": 615052, "compaction_time_cpu_micros": 611075, "output_level": 2, "num_output_files": 2, "total_output_size": 129624154, "num_input_records": 199495, "num_output_records": 199495, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 104, 51, 80, 0, 0, 0]} 2024/11/19-15:14:13.050644 140042821437184 [compaction_job.cc:2437] [__system__] [JOB 11] Compacting 2@0 + 1@1 files to L1, score 0.50, subcompactions 3 : 1 2024/11/19-15:14:13.050658 140042821437184 [compaction_job.cc:2445] [__system__]: Compaction start summary: Base version 7 Base level 0, inputs: [4295(3417B) 4285(4186B)], [4124(5800B)] 2024/11/19-15:14:13.055800 140042620110592 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004310.sst): first pass time = 0.20's, 338.559'MB/sec 2024/11/19-15:14:13.055851 140042620110592 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004310.sst): old prealloc_size = 73819750, real_size = 64446064 2024/11/19-15:14:13.055935 140042620110592 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004310.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = PlainBlobStore usrkeys = 99088 prefix = 4 raw-key = 0.0012 GB zip-key = 0.0002 GB avg-key = 12.00 avg-zkey = 1.70 raw-val = 0.0639 GB zip-val = 0.0643 GB avg-val = 645.19 avg-zval = 648.44 2024/11/19-15:14:13.055986 140042620110592 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004310.sst: sumWaitingMem = 0.000 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0002 GB, waited 0.097 sec, Key+Value = 0.066 GB 2024/11/19-15:14:13.066740 140042821437184 [compaction_job.cc:1948] [__system__] [JOB 11] Generated table #4313: 34 keys, 5672 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:13.066799 140042821437184 EVENT_LOG_v1 {"time_micros": 1732000453066769, "cf_name": "__system__", "job": 11, "event": "table_file_creation", "file_number": 4313, "file_size": 5672, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 1216, "index_size": 3648, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 803, "raw_average_key_size": 23, "raw_value_size": 1193, "raw_average_value_size": 35, "num_data_blocks": 1, "num_entries": 34, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "__system__", "column_family_id": 1, "comparator": "leveldb.BytewiseComparator", "merge_operator": "Rdb_system_merge_op", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "SngFast", "compression_options": "allseq0", "creation_time": 1732000453, "oldest_key_time": 0, "file_creation_time": 1732000453, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4313, "seqno_to_time_mapping": "N/A"}} 2024/11/19-15:14:13.066860 140042821437184 [compaction_job.cc:703] job-00011: subcompact[0], size: 0.000006 G, files: /storage/mytopling/.rocksdb [004313] 2024/11/19-15:14:13.067620 140042821437184 (Original Log Time 2024/11/19-15:14:13.050678) EVENT_LOG_v1 {"time_micros": 1732000453050669, "job": 11, "event": "compaction_started", "compaction_reason": "FilesMarkedForCompaction", "files_L0": [4295, 4285], "files_L1": [4124], "score": 0.5, "input_data_size": 13403, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:13.067633 140042821437184 (Original Log Time 2024/11/19-15:14:13.067441) [compaction_job.cc:2022] [__system__] [JOB 11] Compacted 2@0 + 1@1 files to L1 => 5672 bytes 2024/11/19-15:14:13.067639 140042821437184 (Original Log Time 2024/11/19-15:14:13.067510) [compaction_job.cc:1224] [__system__] compacted to: files[0 1 0 0 0 0 0] max score 0.00, MB/sec: 0.8 rd, 0.4 wr, level 1, files in(2, 1) out(1 +0 blob) MB in(0.0, 0.0 +0.0 blob) out(0.0 +0.0 blob), read-write-amplify(2.5) write-amplify(0.7) OK, records in: 49, records dropped: 15 output_compression: Snappy 2024/11/19-15:14:13.067649 140042821437184 (Original Log Time 2024/11/19-15:14:13.067536) EVENT_LOG_v1 {"time_micros": 1732000453067523, "cf": "__system__", "job": 11, "event": "compaction_finished", "compaction_time_micros": 16192, "compaction_time_cpu_micros": 453, "output_level": 1, "num_output_files": 1, "total_output_size": 5672, "num_input_records": 49, "num_output_records": 34, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]} 2024/11/19-15:14:13.072194 140025429755648 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004311.sst: sumWaitingMem = 0.006 GB, sumWorkingMem = 0.000 GB, nltTrie workingMem = 0.0060 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:13.077844 140042641082112 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004308.sst): second pass time = 0.00's,104703907.157'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.11's, 485.006'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3058.583'MB/sec (index lex order gen) rebuild zvType time = 0.06's, 1.916'MB/sec write SST data time = 0.05's, 1033.745'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.054'GB zip my value throughput = 104703907.157'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 463464 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 117.86 usrkeys = 463464 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.80 avg-zval = 117.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 6615 UnZipSize{ index = 0.0093 GB value = 0.0541 GB dict = 0.00 MB all = 0.0671 GB } __ZipSize{ index = 0.0009 GB value = 0.0546 GB dict = 0.00 MB all = 0.0555 GB } UnZip/Zip{ index = 10.5035 value = 0.9910 dict = 0.00 all = 1.2089 } Zip/UnZip{ index = 0.0952 value = 1.0091 dict = 0.00 all = 0.8272 } ---------------------------- total value len = 0.460395 GB avg = 0.223 KB (by entry num) total key len = 0.054239 GB avg = 0.026 KB total ukey len = 0.037694 GB avg = 0.018 KB total ukey num = 0.002068144 Billion total entry num = 0.002068144 Billion write speed all = 227.378150325 MB/sec (with seq num) write speed all = 220.068093256 MB/sec (without seq num) 2024/11/19-15:14:13.079592 140025440241408 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004312.sst: sumWaitingMem = 0.006 GB, sumWorkingMem = 0.006 GB, nltTrie workingMem = 0.0060 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:13.084871 140042821437184 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004124.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:13.084907 140042821437184 EVENT_LOG_v1 {"time_micros": 1732000453084903, "job": 11, "event": "table_file_deletion", "file_number": 4124} 2024/11/19-15:14:13.089208 140042630596352 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004307.sst): second pass time = 0.00's,115425795.309'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.15's, 379.096'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2903.646'MB/sec (index lex order gen) rebuild zvType time = 0.07's, 1.614'MB/sec write SST data time = 0.07's, 746.573'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.054'GB zip my value throughput = 115425795.309'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 463365 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.83 avg-zval = 117.86 usrkeys = 463365 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.83 avg-zval = 117.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 6616 UnZipSize{ index = 0.0093 GB value = 0.0541 GB dict = 0.00 MB all = 0.0671 GB } __ZipSize{ index = 0.0009 GB value = 0.0546 GB dict = 0.00 MB all = 0.0555 GB } UnZip/Zip{ index = 10.5725 value = 0.9912 dict = 0.00 all = 1.2093 } Zip/UnZip{ index = 0.0946 value = 1.0089 dict = 0.00 all = 0.8270 } ---------------------------- total value len = 0.514530 GB avg = 0.203 KB (by entry num) total key len = 0.067214 GB avg = 0.027 KB total ukey len = 0.046962 GB avg = 0.019 KB total ukey num = 0.002531509 Billion total entry num = 0.002531509 Billion write speed all = 255.746397354 MB/sec (with seq num) write speed all = 246.843165917 MB/sec (without seq num) 2024/11/19-15:14:13.093404 140042641082112 [compaction_job.cc:1948] [default] [JOB 8] Generated table #4308: 463464 keys, 55510257 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:13.093461 140042641082112 EVENT_LOG_v1 {"time_micros": 1732000453093429, "cf_name": "default", "job": 8, "event": "table_file_creation", "file_number": 4308, "file_size": 55510257, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 54622288, "index_size": 882496, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 12976992, "raw_average_key_size": 28, "raw_value_size": 54131920, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 463464, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-MixedLenBlobStore", "creation_time": 1732000452, "oldest_key_time": 0, "file_creation_time": 1732000452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4308, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:13.103963 140042821437184 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004285.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:13.104005 140042821437184 EVENT_LOG_v1 {"time_micros": 1732000453104000, "job": 11, "event": "table_file_deletion", "file_number": 4285} 2024/11/19-15:14:13.104021 140042630596352 [compaction_job.cc:1948] [default] [JOB 9] Generated table #4307: 463365 keys, 55496241 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:13.104078 140042630596352 EVENT_LOG_v1 {"time_micros": 1732000453104048, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 4307, "file_size": 55496241, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 54614240, "index_size": 876544, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 12974220, "raw_average_key_size": 28, "raw_value_size": 54134698, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 463365, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-MixedLenBlobStore", "creation_time": 1732000452, "oldest_key_time": 0, "file_creation_time": 1732000452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4307, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:13.113769 140042821437184 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004295.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:13.113811 140042821437184 EVENT_LOG_v1 {"time_micros": 1732000453113807, "job": 11, "event": "table_file_deletion", "file_number": 4295} 2024/11/19-15:14:13.114082 140042821437184 [compaction_job.cc:2437] [default] [JOB 12] Compacting 3@1 files to L2, score 4.89, subcompactions 1 : 1 2024/11/19-15:14:13.114098 140042821437184 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 9 Base level 1, inputs: [4243(26MB) 4149(31MB) 4154(11MB)] 2024/11/19-15:14:13.116040 140042641082112 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004314.sst) /storage/mytopling/..//tmp/Topling-81329-SNBvQO 2024/11/19-15:14:13.120301 140025429755648 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004311.sst): index pass time = 0.05's, 153.767'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 462085 min-keylen = 16 max-keylen = 16 prefix = 4 subcplen = 3 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.92 2024/11/19-15:14:13.137124 140042620110592 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004310.sst): second pass time = 0.00's,273208192.308'MB/sec, value only(96.4% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.08's, 792.774'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 2028.180'MB/sec (index lex order gen) rebuild zvType time = 0.05's, 0.459'MB/sec write SST data time = 0.03's, 2364.024'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.064'GB zip my value throughput = 273208192.308'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 99088 avg-key = 24.00 avg-zkey = 1.70 avg-val = 645.19 avg-zval = 648.44 usrkeys = 99088 avg-key = 16.00 avg-zkey = 1.70 avg-val = 645.19 avg-zval = 648.44 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 7848 UnZipSize{ index = 0.0016 GB value = 0.0639 GB dict = 0.00 MB all = 0.0663 GB } __ZipSize{ index = 0.0002 GB value = 0.0643 GB dict = 0.00 MB all = 0.0644 GB } UnZip/Zip{ index = 9.4298 value = 0.9950 dict = 0.00 all = 1.0293 } Zip/UnZip{ index = 0.1060 value = 1.0050 dict = 0.00 all = 0.9716 } ---------------------------- total value len = 0.578460 GB avg = 0.220 KB (by entry num) total key len = 0.069592 GB avg = 0.026 KB total ukey len = 0.048547 GB avg = 0.018 KB total ukey num = 0.002630597 Billion total entry num = 0.002630597 Billion write speed all = 279.017269938 MB/sec (with seq num) write speed all = 269.956491522 MB/sec (without seq num) 2024/11/19-15:14:13.152513 140042620110592 [compaction_job.cc:1948] [default] [JOB 3] Generated table #4310: 99088 keys, 64423181 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:13.152567 140042620110592 EVENT_LOG_v1 {"time_micros": 1732000453152543, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 4310, "file_size": 64423181, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 64252960, "index_size": 168128, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 2378112, "raw_average_key_size": 24, "raw_value_size": 63930717, "raw_average_value_size": 645, "num_data_blocks": 1, "num_entries": 99088, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 24, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-PlainBlobStore", "creation_time": 1732000452, "oldest_key_time": 0, "file_creation_time": 1732000452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4310, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:13.152684 140025440241408 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004312.sst): index pass time = 0.07's, 101.210'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 462070 min-keylen = 16 max-keylen = 16 prefix = 4 subcplen = 3 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 2024/11/19-15:14:13.168897 140042620110592 [compaction_job.cc:703] job-00003: subcompact[0], size: 0.129624 G, files: /storage/mytopling/.rocksdb [004306,004310] 2024/11/19-15:14:13.170102 140042620110592 (Original Log Time 2024/11/19-15:14:12.525064) EVENT_LOG_v1 {"time_micros": 1732000452525048, "job": 3, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4151, 4152, 4153, 4156], "score": 6.84592, "input_data_size": 134027584, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:13.170115 140042620110592 (Original Log Time 2024/11/19-15:14:13.169513) [compaction_job.cc:2022] [default] [JOB 3] Compacted 4@1 files to L2 => 129623642 bytes 2024/11/19-15:14:13.170121 140042620110592 (Original Log Time 2024/11/19-15:14:13.169981) [compaction_job.cc:1224] [default] compacted to: files[3 100 53 80 0 0 0] max score 4.75 (133 files need compaction), MB/sec: 208.2 rd, 201.3 wr, level 2, files in(4, 0) out(2 +0 blob) MB in(127.8, 0.0 +0.0 blob) out(123.6 +0.0 blob), read-write-amplify(2.0) write-amplify(1.0) OK, records in: 199381, records dropped: 0 output_compression: Snappy 2024/11/19-15:14:13.170130 140042620110592 (Original Log Time 2024/11/19-15:14:13.170026) EVENT_LOG_v1 {"time_micros": 1732000453169999, "cf": "default", "job": 3, "event": "compaction_finished", "compaction_time_micros": 643849, "compaction_time_cpu_micros": 619976, "output_level": 2, "num_output_files": 2, "total_output_size": 129623642, "num_input_records": 199381, "num_output_records": 199381, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 100, 53, 80, 0, 0, 0]} 2024/11/19-15:14:13.170240 140042620110592 [compaction_job.cc:2437] [default] [JOB 13] Compacting 4@1 files to L2, score 4.75, subcompactions 1 : 1 2024/11/19-15:14:13.170253 140042620110592 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 11 Base level 1, inputs: [4157(31MB) 4160(31MB) 4162(31MB) 4164(31MB)] 2024/11/19-15:14:13.179390 140042630596352 [top_zip_table_builder.cc:960] ToplingZipTableBuilder(/storage/mytopling/.rocksdb/004315.sst) /storage/mytopling/..//tmp/Topling-81329-tcK3rp 2024/11/19-15:14:13.192762 140042800465664 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004312.sst): first pass time = 0.26's, 253.323'MB/sec 2024/11/19-15:14:13.192804 140042800465664 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004312.sst): old prealloc_size = 73819750, real_size = 55456928 2024/11/19-15:14:13.193063 140042800465664 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004312.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = MixedLenBlobStore usrkeys = 462070 prefix = 4 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0540 GB zip-val = 0.0545 GB avg-val = 116.83 avg-zval = 117.86 2024/11/19-15:14:13.193109 140042800465664 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004312.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.114 sec, Key+Value = 0.067 GB 2024/11/19-15:14:13.199518 140042789979904 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004311.sst): first pass time = 0.28's, 240.392'MB/sec 2024/11/19-15:14:13.199558 140042789979904 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004311.sst): old prealloc_size = 73819750, real_size = 55464240 2024/11/19-15:14:13.199786 140042789979904 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004311.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = MixedLenBlobStore usrkeys = 462085 prefix = 4 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.92 raw-val = 0.0540 GB zip-val = 0.0545 GB avg-val = 116.82 avg-zval = 117.86 2024/11/19-15:14:13.199827 140042789979904 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004311.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.001 GB, reorder workingMem = 0.0011 GB, waited 0.128 sec, Key+Value = 0.067 GB 2024/11/19-15:14:13.280994 140025811437312 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004314.sst: sumWaitingMem = 0.006 GB, sumWorkingMem = 0.000 GB, nltTrie workingMem = 0.0060 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:13.286232 140042800465664 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004312.sst): second pass time = 0.00's,142060547.368'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.09's, 592.496'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3426.875'MB/sec (index lex order gen) rebuild zvType time = 0.05's, 2.391'MB/sec write SST data time = 0.04's, 1234.011'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.054'GB zip my value throughput = 142060547.368'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 462070 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.83 avg-zval = 117.86 usrkeys = 462070 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.83 avg-zval = 117.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 6597 UnZipSize{ index = 0.0092 GB value = 0.0540 GB dict = 0.00 MB all = 0.0669 GB } __ZipSize{ index = 0.0009 GB value = 0.0545 GB dict = 0.00 MB all = 0.0553 GB } UnZip/Zip{ index = 10.5046 value = 0.9912 dict = 0.00 all = 1.2091 } Zip/UnZip{ index = 0.0952 value = 1.0089 dict = 0.00 all = 0.8270 } ---------------------------- total value len = 0.632443 GB avg = 0.204 KB (by entry num) total key len = 0.082530 GB avg = 0.027 KB total ukey len = 0.057788 GB avg = 0.019 KB total ukey num = 0.003092667 Billion total entry num = 0.003092667 Billion write speed all = 289.260068988 MB/sec (with seq num) write speed all = 279.250347686 MB/sec (without seq num) 2024/11/19-15:14:13.290309 140042800465664 [compaction_job.cc:1948] [default] [JOB 6] Generated table #4312: 462070 keys, 55346673 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:13.290362 140042800465664 EVENT_LOG_v1 {"time_micros": 1732000453290337, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 4312, "file_size": 55346673, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 54461456, "index_size": 879744, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 12937960, "raw_average_key_size": 28, "raw_value_size": 53983008, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 462070, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-MixedLenBlobStore", "creation_time": 1732000452, "oldest_key_time": 0, "file_creation_time": 1732000452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4312, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:13.295127 140042789979904 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004311.sst): second pass time = 0.00's,164579176.829'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.10's, 579.289'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3938.422'MB/sec (index lex order gen) rebuild zvType time = 0.05's, 2.463'MB/sec write SST data time = 0.05's, 1143.191'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.054'GB zip my value throughput = 164579176.829'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 462085 avg-key = 28.00 avg-zkey = 1.92 avg-val = 116.82 avg-zval = 117.86 usrkeys = 462085 avg-key = 20.00 avg-zkey = 1.92 avg-val = 116.82 avg-zval = 117.86 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 6597 UnZipSize{ index = 0.0092 GB value = 0.0540 GB dict = 0.00 MB all = 0.0669 GB } __ZipSize{ index = 0.0009 GB value = 0.0545 GB dict = 0.00 MB all = 0.0554 GB } UnZip/Zip{ index = 10.4314 value = 0.9912 dict = 0.00 all = 1.2090 } Zip/UnZip{ index = 0.0959 value = 1.0089 dict = 0.00 all = 0.8272 } ---------------------------- total value len = 0.686425 GB avg = 0.193 KB (by entry num) total key len = 0.095468 GB avg = 0.027 KB total ukey len = 0.067030 GB avg = 0.019 KB total ukey num = 0.003554752 Billion total entry num = 0.003554752 Billion write speed all = 315.199789068 MB/sec (with seq num) write speed all = 303.735749194 MB/sec (without seq num) 2024/11/19-15:14:13.299238 140042789979904 [compaction_job.cc:1948] [default] [JOB 7] Generated table #4311: 462085 keys, 55353969 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:13.299286 140042789979904 EVENT_LOG_v1 {"time_micros": 1732000453299264, "cf_name": "default", "job": 7, "event": "table_file_creation", "file_number": 4311, "file_size": 55353969, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 54462560, "index_size": 885952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 12938380, "raw_average_key_size": 28, "raw_value_size": 53981970, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 462085, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-MixedLenBlobStore", "creation_time": 1732000452, "oldest_key_time": 0, "file_creation_time": 1732000452, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4311, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:13.305954 140042800465664 [compaction_job.cc:703] job-00006: subcompact[0], size: 0.110861 G, files: /storage/mytopling/.rocksdb [004304,004312] 2024/11/19-15:14:13.307294 140042800465664 (Original Log Time 2024/11/19-15:14:12.504852) EVENT_LOG_v1 {"time_micros": 1732000452504829, "job": 6, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4172, 4177, 4180, 4184], "score": 6.13852, "input_data_size": 133299980, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:13.307303 140042800465664 (Original Log Time 2024/11/19-15:14:13.306842) [compaction_job.cc:2022] [default] [JOB 6] Compacted 4@1 files to L2 => 110861282 bytes 2024/11/19-15:14:13.307328 140042800465664 (Original Log Time 2024/11/19-15:14:13.307210) [compaction_job.cc:1224] [default] compacted to: files[3 96 55 80 0 0 0] max score 4.50 (131 files need compaction), MB/sec: 166.4 rd, 138.4 wr, level 2, files in(4, 0) out(2 +0 blob) MB in(127.1, 0.0 +0.0 blob) out(105.7 +0.0 blob), read-write-amplify(1.8) write-amplify(0.8) OK, records in: 925652, records dropped: 0 output_compression: Snappy 2024/11/19-15:14:13.307332 140042800465664 (Original Log Time 2024/11/19-15:14:13.307234) EVENT_LOG_v1 {"time_micros": 1732000453307222, "cf": "default", "job": 6, "event": "compaction_finished", "compaction_time_micros": 801115, "compaction_time_cpu_micros": 792308, "output_level": 2, "num_output_files": 2, "total_output_size": 110861282, "num_input_records": 925652, "num_output_records": 925652, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 96, 55, 80, 0, 0, 0]} 2024/11/19-15:14:13.307414 140042800465664 [compaction_job.cc:2437] [default] [JOB 14] Compacting 4@1 files to L2, score 4.50, subcompactions 1 : 1 2024/11/19-15:14:13.307422 140042800465664 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 12 Base level 1, inputs: [4168(31MB) 4170(31MB) 4173(31MB) 4175(31MB)] 2024/11/19-15:14:13.314533 140042789979904 [compaction_job.cc:703] job-00007: subcompact[0], size: 0.110872 G, files: /storage/mytopling/.rocksdb [004305,004311] 2024/11/19-15:14:13.315806 140042789979904 (Original Log Time 2024/11/19-15:14:12.518565) EVENT_LOG_v1 {"time_micros": 1732000452518551, "job": 7, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4189, 4192, 4195, 4199], "score": 5.88887, "input_data_size": 133300108, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:13.315816 140042789979904 (Original Log Time 2024/11/19-15:14:13.315402) [compaction_job.cc:2022] [default] [JOB 7] Compacted 4@1 files to L2 => 110872226 bytes 2024/11/19-15:14:13.315819 140042789979904 (Original Log Time 2024/11/19-15:14:13.315734) [compaction_job.cc:1224] [default] compacted to: files[3 92 57 80 0 0 0] max score 4.25 (129 files need compaction), MB/sec: 167.5 rd, 139.3 wr, level 2, files in(4, 0) out(2 +0 blob) MB in(127.1, 0.0 +0.0 blob) out(105.7 +0.0 blob), read-write-amplify(1.8) write-amplify(0.8) OK, records in: 925648, records dropped: 0 output_compression: Snappy 2024/11/19-15:14:13.315826 140042789979904 (Original Log Time 2024/11/19-15:14:13.315757) EVENT_LOG_v1 {"time_micros": 1732000453315746, "cf": "default", "job": 7, "event": "compaction_finished", "compaction_time_micros": 795981, "compaction_time_cpu_micros": 789312, "output_level": 2, "num_output_files": 2, "total_output_size": 110872226, "num_input_records": 925648, "num_output_records": 925648, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 92, 57, 80, 0, 0, 0]} 2024/11/19-15:14:13.315893 140042789979904 [compaction_job.cc:2437] [default] [JOB 15] Compacting 4@1 files to L2, score 4.25, subcompactions 1 : 1 2024/11/19-15:14:13.315901 140042789979904 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 13 Base level 1, inputs: [4176(31MB) 4178(31MB) 4179(31MB) 4181(31MB)] 2024/11/19-15:14:13.340040 140025811437312 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004314.sst): index pass time = 0.06's, 125.322'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 462161 min-keylen = 16 max-keylen = 16 prefix = 4 subcplen = 3 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 2024/11/19-15:14:13.353294 140025440241408 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004315.sst: sumWaitingMem = 0.006 GB, sumWorkingMem = 0.000 GB, nltTrie workingMem = 0.0060 GB, waited 0.000 sec, Key+Value = 0.067 GB 2024/11/19-15:14:13.387597 140042641082112 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004314.sst): first pass time = 0.27's, 246.439'MB/sec 2024/11/19-15:14:13.387617 140025440241408 [top_zip_table_builder.cc:1588] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004315.sst): index pass time = 0.03's, 215.696'MB/sec index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL usrkeys = 462269 min-keylen = 16 max-keylen = 16 prefix = 4 subcplen = 3 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.89 2024/11/19-15:14:13.387653 140042641082112 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004314.sst): old prealloc_size = 73819750, real_size = 55464000 2024/11/19-15:14:13.387883 140042641082112 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004314.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = MixedLenBlobStore usrkeys = 462161 prefix = 4 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.90 raw-val = 0.0540 GB zip-val = 0.0545 GB avg-val = 116.79 avg-zval = 117.85 2024/11/19-15:14:13.387955 140042641082112 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004314.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.107 sec, Key+Value = 0.067 GB 2024/11/19-15:14:13.433874 140042821437184 [dcompact_etcd.cc:1163] job-00012/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.319 sec, input = 70.230 MiB 2024/11/19-15:14:13.458541 140042630596352 [top_zip_table_builder.cc:1378] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004315.sst): first pass time = 0.28's, 239.743'MB/sec 2024/11/19-15:14:13.458586 140042630596352 [top_zip_table_builder.cc:2798] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004315.sst): old prealloc_size = 73819750, real_size = 55467776 2024/11/19-15:14:13.458810 140042630596352 [top_zip_table_builder.cc:1799] BuildReorderMap(/storage/mytopling/.rocksdb/004315.sst): index type = NestLoudsTrieDAWG_Mixed_XL_256_32_FL, store type = MixedLenBlobStore usrkeys = 462269 prefix = 4 raw-key = 0.0074 GB zip-key = 0.0009 GB avg-key = 16.00 avg-zkey = 1.89 raw-val = 0.0540 GB zip-val = 0.0545 GB avg-val = 116.76 avg-zval = 117.85 2024/11/19-15:14:13.458862 140042630596352 [top_zip_table_builder.cc:1325] /storage/mytopling/.rocksdb/004315.sst: sumWaitingMem = 0.001 GB, sumWorkingMem = 0.000 GB, reorder workingMem = 0.0011 GB, waited 0.106 sec, Key+Value = 0.067 GB 2024/11/19-15:14:13.474779 140042620110592 [dcompact_etcd.cc:1163] job-00013/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.304 sec, input = 126.886 MiB 2024/11/19-15:14:13.478737 140042641082112 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004314.sst): second pass time = 0.00's,156908029.070'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.09's, 607.803'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3915.672'MB/sec (index lex order gen) rebuild zvType time = 0.05's, 2.490'MB/sec write SST data time = 0.04's, 1245.614'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.054'GB zip my value throughput = 156908029.070'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 462161 avg-key = 28.00 avg-zkey = 1.90 avg-val = 116.79 avg-zval = 117.85 usrkeys = 462161 avg-key = 20.00 avg-zkey = 1.90 avg-val = 116.79 avg-zval = 117.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 6596 UnZipSize{ index = 0.0092 GB value = 0.0540 GB dict = 0.00 MB all = 0.0669 GB } __ZipSize{ index = 0.0009 GB value = 0.0545 GB dict = 0.00 MB all = 0.0554 GB } UnZip/Zip{ index = 10.4991 value = 0.9910 dict = 0.00 all = 1.2089 } Zip/UnZip{ index = 0.0952 value = 1.0091 dict = 0.00 all = 0.8272 } ---------------------------- total value len = 0.740402 GB avg = 0.184 KB (by entry num) total key len = 0.108409 GB avg = 0.027 KB total ukey len = 0.076273 GB avg = 0.019 KB total ukey num = 0.004016913 Billion total entry num = 0.004016913 Billion write speed all = 318.594126418 MB/sec (with seq num) write speed all = 306.532397241 MB/sec (without seq num) 2024/11/19-15:14:13.482692 140042641082112 [compaction_job.cc:1948] [default] [JOB 8] Generated table #4314: 462161 keys, 55353713 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:13.482742 140042641082112 EVENT_LOG_v1 {"time_micros": 1732000453482719, "cf_name": "default", "job": 8, "event": "table_file_creation", "file_number": 4314, "file_size": 55353713, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 54467888, "index_size": 880384, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 12940508, "raw_average_key_size": 28, "raw_value_size": 53976362, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 462161, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-MixedLenBlobStore", "creation_time": 1732000453, "oldest_key_time": 0, "file_creation_time": 1732000453, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4314, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:13.498092 140042641082112 [compaction_job.cc:703] job-00008: subcompact[0], size: 0.110864 G, files: /storage/mytopling/.rocksdb [004308,004314] 2024/11/19-15:14:13.499439 140042641082112 (Original Log Time 2024/11/19-15:14:12.543229) EVENT_LOG_v1 {"time_micros": 1732000452543209, "job": 8, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4203, 4206, 4209, 4212], "score": 5.63923, "input_data_size": 133300172, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:13.499448 140042641082112 (Original Log Time 2024/11/19-15:14:13.499015) [compaction_job.cc:2022] [default] [JOB 8] Compacted 4@1 files to L2 => 110863970 bytes 2024/11/19-15:14:13.499452 140042641082112 (Original Log Time 2024/11/19-15:14:13.499356) [compaction_job.cc:1224] [default] compacted to: files[3 88 59 80 0 0 0] max score 4.00 (127 files need compaction), MB/sec: 139.6 rd, 116.1 wr, level 2, files in(4, 0) out(2 +0 blob) MB in(127.1, 0.0 +0.0 blob) out(105.7 +0.0 blob), read-write-amplify(1.8) write-amplify(0.8) OK, records in: 925625, records dropped: 0 output_compression: Snappy 2024/11/19-15:14:13.499459 140042641082112 (Original Log Time 2024/11/19-15:14:13.499383) EVENT_LOG_v1 {"time_micros": 1732000453499371, "cf": "default", "job": 8, "event": "compaction_finished", "compaction_time_micros": 954876, "compaction_time_cpu_micros": 938612, "output_level": 2, "num_output_files": 2, "total_output_size": 110863970, "num_input_records": 925625, "num_output_records": 925625, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 88, 59, 80, 0, 0, 0]} 2024/11/19-15:14:13.499534 140042641082112 [compaction_job.cc:2437] [default] [JOB 16] Compacting 4@1 files to L2, score 4.00, subcompactions 1 : 1 2024/11/19-15:14:13.499542 140042641082112 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 14 Base level 1, inputs: [4182(31MB) 4183(31MB) 4185(31MB) 4186(31MB)] 2024/11/19-15:14:13.547967 140042630596352 [top_zip_table_builder.cc:3129] ToplingZipTableBuilder::Finish(/storage/mytopling/.rocksdb/004315.sst): second pass time = 0.00's,79260049.927'MB/sec, value only(80.7% of KV) wait indexing time = 0.00's, remap KeyValue time = 0.09's, 619.439'MB/sec (all stages of remap) Get OrderMap time = 0.00's, 3945.190'MB/sec (index lex order gen) rebuild zvType time = 0.05's, 2.552'MB/sec write SST data time = 0.04's, 1262.232'MB/sec dict compress time = 0.00's, 0.000'MB/sec z-dict build time = 0.00's, sample length = 0.000'MB, throughput = -nan'MB/sec zip my value time = 0.00's, unzip length = 0.054'GB zip my value throughput = 79260049.927'MB/sec zip pipeline throughput = 0.000'MB/sec entries = 462269 avg-key = 28.00 avg-zkey = 1.89 avg-val = 116.76 avg-zval = 117.85 usrkeys = 462269 avg-key = 20.00 avg-zkey = 1.89 avg-val = 116.76 avg-zval = 117.85 TagRS{ kinds = LegacyZvType bytes = 0 } TagArray{ size = 0 bytes = 0 } seq expand size = 0 multi value expand size = 0 cnt WriteAppend = 6596 UnZipSize{ index = 0.0092 GB value = 0.0540 GB dict = 0.00 MB all = 0.0669 GB } __ZipSize{ index = 0.0009 GB value = 0.0545 GB dict = 0.00 MB all = 0.0554 GB } UnZip/Zip{ index = 10.5699 value = 0.9908 dict = 0.00 all = 1.2089 } Zip/UnZip{ index = 0.0946 value = 1.0093 dict = 0.00 all = 0.8272 } ---------------------------- total value len = 0.794378 GB avg = 0.177 KB (by entry num) total key len = 0.121352 GB avg = 0.027 KB total ukey len = 0.085519 GB avg = 0.019 KB total ukey num = 0.004479182 Billion total entry num = 0.004479182 Billion write speed all = 335.006713957 MB/sec (with seq num) write speed all = 321.897554876 MB/sec (without seq num) 2024/11/19-15:14:13.551724 140042630596352 [compaction_job.cc:1948] [default] [JOB 9] Generated table #4315: 462269 keys, 55357489 bytes (need compaction), temperature: kUnknown 2024/11/19-15:14:13.551769 140042630596352 EVENT_LOG_v1 {"time_micros": 1732000453551747, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 4315, "file_size": 55357489, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 0, "largest_seqno": 0, "table_properties": {"data_size": 54477360, "index_size": 874688, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 12943532, "raw_average_key_size": 28, "raw_value_size": 53976094, "raw_average_value_size": 116, "num_data_blocks": 1, "num_entries": 462269, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 28, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[Rdb_tbl_prop_coll_factory]", "compression": "TooZip", "compression_options": "LegacyZvType-NestLoudsTrieDAWG_Mixed_XL_256_32_FL-MixedLenBlobStore", "creation_time": 1732000453, "oldest_key_time": 0, "file_creation_time": 1732000453, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4315, "seqno_to_time_mapping": "N/A", "__indexstats__": "[...1 records...]"}} 2024/11/19-15:14:13.566200 140042630596352 [compaction_job.cc:703] job-00009: subcompact[0], size: 0.110854 G, files: /storage/mytopling/.rocksdb [004307,004315] 2024/11/19-15:14:13.567463 140042630596352 (Original Log Time 2024/11/19-15:14:12.526532) EVENT_LOG_v1 {"time_micros": 1732000452526511, "job": 9, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4216, 4219, 4223, 4225], "score": 5.38958, "input_data_size": 133300236, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:13.567472 140042630596352 (Original Log Time 2024/11/19-15:14:13.567046) [compaction_job.cc:2022] [default] [JOB 9] Compacted 4@1 files to L2 => 110853730 bytes 2024/11/19-15:14:13.567475 140042630596352 (Original Log Time 2024/11/19-15:14:13.567368) [compaction_job.cc:1224] [default] compacted to: files[3 84 61 80 0 0 0] max score 3.75 (125 files need compaction), MB/sec: 128.2 rd, 106.6 wr, level 2, files in(4, 0) out(2 +0 blob) MB in(127.1, 0.0 +0.0 blob) out(105.7 +0.0 blob), read-write-amplify(1.8) write-amplify(0.8) OK, records in: 925634, records dropped: 0 output_compression: Snappy 2024/11/19-15:14:13.567482 140042630596352 (Original Log Time 2024/11/19-15:14:13.567391) EVENT_LOG_v1 {"time_micros": 1732000453567380, "cf": "default", "job": 9, "event": "compaction_finished", "compaction_time_micros": 1039679, "compaction_time_cpu_micros": 973427, "output_level": 2, "num_output_files": 2, "total_output_size": 110853730, "num_input_records": 925634, "num_output_records": 925634, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 84, 61, 80, 0, 0, 0]} 2024/11/19-15:14:13.571296 140042630596352 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004167.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:13.571319 140042630596352 EVENT_LOG_v1 {"time_micros": 1732000453571317, "job": 9, "event": "table_file_deletion", "file_number": 4167} 2024/11/19-15:14:13.575103 140042630596352 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004169.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:13.575124 140042630596352 EVENT_LOG_v1 {"time_micros": 1732000453575122, "job": 9, "event": "table_file_deletion", "file_number": 4169} 2024/11/19-15:14:13.578079 140042630596352 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004171.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:13.578098 140042630596352 EVENT_LOG_v1 {"time_micros": 1732000453578096, "job": 9, "event": "table_file_deletion", "file_number": 4171} 2024/11/19-15:14:13.580544 140042630596352 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004174.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:13.580563 140042630596352 EVENT_LOG_v1 {"time_micros": 1732000453580561, "job": 9, "event": "table_file_deletion", "file_number": 4174} 2024/11/19-15:14:13.580691 140042630596352 [compaction_job.cc:2437] [default] [JOB 17] Compacting 4@1 files to L2, score 3.75, subcompactions 1 : 1 2024/11/19-15:14:13.580700 140042630596352 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 15 Base level 1, inputs: [4187(31MB) 4188(31MB) 4190(31MB) 4191(31MB)] 2024/11/19-15:14:13.608336 140042800465664 [dcompact_etcd.cc:1163] job-00014/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.300 sec, input = 126.925 MiB 2024/11/19-15:14:13.613470 140042789979904 [dcompact_etcd.cc:1163] job-00015/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.297 sec, input = 126.998 MiB 2024/11/19-15:14:13.798317 140042641082112 [dcompact_etcd.cc:1163] job-00016/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.298 sec, input = 126.870 MiB 2024/11/19-15:14:13.886765 140042630596352 [dcompact_etcd.cc:1163] job-00017/att-00: init time wrt = 0.000, mka = 0.000, mkw = 0.000, curl https://aliyun-topling-saas.topling.cn:18443/dcompact = 0.306 sec, input = 126.908 MiB 2024/11/19-15:14:14.730611 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00010/att-00 2024/11/19-15:14:14.730709 140042810951424 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00010/att-00/compact.done) = No such file or directory: 3.196 sec on http probe failed: 1, retry 2024/11/19-15:14:15.198911 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/probe?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00012/att-00 2024/11/19-15:14:15.199025 140042821437184 [dcompact_etcd.cc:1209] fopen(/storage/mytopling/.rocksdb/job-00012/att-00/compact.done) = No such file or directory: 1.756 sec on http probe failed: 1, retry 2024/11/19-15:14:16.195930 140043962924992 [db_impl_compaction_flush.cc:1885] [default] Manual flush start. 2024/11/19-15:14:16.195958 140043962924992 [db_impl_compaction_flush.cc:1895] [default] Manual flush finished, status: OK 2024/11/19-15:14:16.195962 140043962924992 [db_impl_compaction_flush.cc:1885] [__system__] Manual flush start. 2024/11/19-15:14:16.196444 140043962924992 [db_impl_write.cc:2181] [__system__] New memtable created with log file: #4316. Immutable memtables: 0. 2024/11/19-15:14:16.196483 140043962924992 [cspp_memtable.cc:1074] ConvertToReadOnly in MarkReadOnly, mem_size = 0.062 M, time = 16.188 us 2024/11/19-15:14:16.196587 140042609624832 [db_impl_compaction_flush.cc:103] [JOB 18] Syncing log #4298 2024/11/19-15:14:16.196702 140042609624832 (Original Log Time 2024/11/19-15:14:16.196561) [db_impl_compaction_flush.cc:3040] Calling FlushMemTableToOutputFile with column family [__system__], flush slots available 2, compaction slots available 7, flush slots scheduled 1, compaction slots scheduled 7 2024/11/19-15:14:16.196712 140042609624832 [flush_job.cc:879] [__system__] [JOB 18] Flushing memtable with next log file: 4316 2024/11/19-15:14:16.196732 140042609624832 EVENT_LOG_v1 {"time_micros": 1732000456196726, "job": 18, "event": "flush_started", "num_memtables": 1, "num_entries": 6, "num_deletes": 0, "total_data_size": 488, "memory_usage": 65928, "num_range_deletes": 0, "flush_reason": "Manual Flush"} 2024/11/19-15:14:16.196735 140042609624832 [flush_job.cc:910] [__system__] [JOB 18] Level-0 flush table #4317: started 2024/11/19-15:14:16.197060 140042609624832 EVENT_LOG_v1 {"time_micros": 1732000456197041, "cf_name": "__system__", "job": 18, "event": "table_file_creation", "file_number": 4317, "file_size": 3417, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 105631336, "largest_seqno": 105631341, "table_properties": {"data_size": 320, "index_size": 2304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 0, "raw_key_size": 92, "raw_average_key_size": 18, "raw_value_size": 264, "raw_average_value_size": 52, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "fixed_value_len": 18446744073709551615, "filter_policy": "", "column_family_name": "__system__", "column_family_id": 1, "comparator": "leveldb.BytewiseComparator", "merge_operator": "Rdb_system_merge_op", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "SngFast", "compression_options": "", "creation_time": 1732000456, "oldest_key_time": 1732000417, "file_creation_time": 1732000456, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d89b4006-2803-486e-b7a2-759bcf348921", "db_session_id": "FHVYN7H0SI0L522SGBBX", "orig_file_number": 4317, "seqno_to_time_mapping": "N/A"}} 2024/11/19-15:14:16.197491 140042609624832 [flush_job.cc:1083] [__system__] [JOB 18] Flush lasted 790 microseconds, and 763 cpu microseconds. 2024/11/19-15:14:16.197619 140042609624832 (Original Log Time 2024/11/19-15:14:16.197077) [flush_job.cc:1029] [__system__] [JOB 18] Level-0 flush table #4317: 3417 bytes OK (needs compaction) 2024/11/19-15:14:16.197624 140042609624832 (Original Log Time 2024/11/19-15:14:16.197501) [memtable_list.cc:560] [__system__] Level-0 commit table #4317 started 2024/11/19-15:14:16.197627 140042609624832 (Original Log Time 2024/11/19-15:14:16.197566) [memtable_list.cc:759] [__system__] Level-0 commit table #4317: memtable #1 done 2024/11/19-15:14:16.197630 140042609624832 (Original Log Time 2024/11/19-15:14:16.197579) EVENT_LOG_v1 {"time_micros": 1732000456197574, "job": 18, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0} 2024/11/19-15:14:16.197633 140042609624832 (Original Log Time 2024/11/19-15:14:16.197593) [db_impl_compaction_flush.cc:310] [__system__] Level summary: files[1 1 0 0 0 0 0] max score 0.25 (1 files need compaction) 2024/11/19-15:14:16.197640 140042609624832 [db_impl_files.cc:470] [JOB 18] Try to delete WAL files size 500, prev total WAL file size 500, number of live WAL files 2. 2024/11/19-15:14:16.200104 140042609624832 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004298.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.200123 140043962924992 [db_impl_compaction_flush.cc:1895] [__system__] Manual flush finished, status: OK 2024/11/19-15:14:16.200135 140043962924992 [db_impl.cc:592] Shutdown: canceling all background work 2024/11/19-15:14:16.603708 140042821437184 [WARN] [dcompact_etcd.cc:1322] DcompactEtcd detected shutting down: nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-19T15.13.37/.rocksdb/job-00012/att-00 2024/11/19-15:14:16.612485 140042821437184 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00012/att-00 2024/11/19-15:14:16.612549 140042821437184 [dcompact_etcd.cc:1720] job-00012/att-00: CleanFiles: shutting down, do not delete files 2024/11/19-15:14:16.612556 140042821437184 [dcompact_etcd.cc:1773] job-00012/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:16.612579 140042821437184 (Original Log Time 2024/11/19-15:14:13.114120) EVENT_LOG_v1 {"time_micros": 1732000453114109, "job": 12, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4243, 4149, 4154], "score": 4.89028, "input_data_size": 73354249, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.612587 140042821437184 [compaction_job.cc:2437] [default] [JOB 12] Compacting 3@1 files to L2, score 4.89, subcompactions 1 : 1 2024/11/19-15:14:16.612594 140042821437184 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 9 Base level 1, inputs: [4243(26MB) 4149(31MB) 4154(11MB)] 2024/11/19-15:14:16.612724 140042821437184 [compaction_job.cc:703] job-00012: subcompact[0], size: 0.000000 G, files: /storage/mytopling/.rocksdb [] 2024/11/19-15:14:16.612807 140042821437184 (Original Log Time 2024/11/19-15:14:16.612623) EVENT_LOG_v1 {"time_micros": 1732000456612607, "job": 12, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4243, 4149, 4154], "score": 4.89028, "input_data_size": 73354249, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.612812 140042821437184 (Original Log Time 2024/11/19-15:14:16.612740) [compaction_job.cc:1224] [default] compacted to: files[3 84 61 80 0 0 0] max score 3.50 (121 files need compaction), MB/sec: 692021.2 rd, 0.0 wr, level 2, files in(3, 0) out(0 +0 blob) MB in(70.0, 0.0 +0.0 blob) out(0.0 +0.0 blob), read-write-amplify(1.0) write-amplify(0.0) Shutdown in progress: Database shutdown, records in: 508585, records dropped: 508585 output_compression: Snappy 2024/11/19-15:14:16.612828 140042821437184 (Original Log Time 2024/11/19-15:14:16.612756) EVENT_LOG_v1 {"time_micros": 1732000456612747, "cf": "default", "job": 12, "event": "compaction_finished", "compaction_time_micros": 106, "compaction_time_cpu_micros": 93, "output_level": 2, "num_output_files": 0, "total_output_size": 0, "num_input_records": 508585, "num_output_records": 0, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 84, 61, 80, 0, 0, 0]} 2024/11/19-15:14:16.647004 140042620110592 [WARN] [dcompact_etcd.cc:1322] DcompactEtcd detected shutting down: nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-19T15.13.37/.rocksdb/job-00013/att-00 2024/11/19-15:14:16.655197 140042620110592 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00013/att-00 2024/11/19-15:14:16.655253 140042620110592 [dcompact_etcd.cc:1720] job-00013/att-00: CleanFiles: shutting down, do not delete files 2024/11/19-15:14:16.655261 140042620110592 [dcompact_etcd.cc:1773] job-00013/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:16.655281 140042620110592 (Original Log Time 2024/11/19-15:14:13.170269) EVENT_LOG_v1 {"time_micros": 1732000453170260, "job": 13, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4157, 4160, 4162, 4164], "score": 4.75308, "input_data_size": 134099648, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.655288 140042620110592 [compaction_job.cc:2437] [default] [JOB 13] Compacting 4@1 files to L2, score 4.75, subcompactions 1 : 1 2024/11/19-15:14:16.655296 140042620110592 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 11 Base level 1, inputs: [4157(31MB) 4160(31MB) 4162(31MB) 4164(31MB)] 2024/11/19-15:14:16.655415 140042620110592 [compaction_job.cc:703] job-00013: subcompact[0], size: 0.000000 G, files: /storage/mytopling/.rocksdb [] 2024/11/19-15:14:16.655485 140042620110592 (Original Log Time 2024/11/19-15:14:16.655323) EVENT_LOG_v1 {"time_micros": 1732000456655307, "job": 13, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4157, 4160, 4162, 4164], "score": 4.75308, "input_data_size": 134099648, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.655489 140042620110592 (Original Log Time 2024/11/19-15:14:16.655429) [compaction_job.cc:1224] [default] compacted to: files[3 84 61 80 0 0 0] max score 3.50 (121 files need compaction), MB/sec: 1396871.3 rd, 0.0 wr, level 2, files in(4, 0) out(0 +0 blob) MB in(127.9, 0.0 +0.0 blob) out(0.0 +0.0 blob), read-write-amplify(1.0) write-amplify(0.0) Shutdown in progress: Database shutdown, records in: 128302, records dropped: 128302 output_compression: Snappy 2024/11/19-15:14:16.655505 140042620110592 (Original Log Time 2024/11/19-15:14:16.655444) EVENT_LOG_v1 {"time_micros": 1732000456655436, "cf": "default", "job": 13, "event": "compaction_finished", "compaction_time_micros": 96, "compaction_time_cpu_micros": 84, "output_level": 2, "num_output_files": 0, "total_output_size": 0, "num_input_records": 128302, "num_output_records": 0, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 84, 61, 80, 0, 0, 0]} 2024/11/19-15:14:16.730784 140042810951424 [WARN] [dcompact_etcd.cc:1322] DcompactEtcd detected shutting down: nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-19T15.13.37/.rocksdb/job-00010/att-00 2024/11/19-15:14:16.739268 140042810951424 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00010/att-00 2024/11/19-15:14:16.739321 140042810951424 [dcompact_etcd.cc:1720] job-00010/att-00: CleanFiles: shutting down, do not delete files 2024/11/19-15:14:16.739329 140042810951424 [dcompact_etcd.cc:1773] job-00010/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:16.739352 140042810951424 (Original Log Time 2024/11/19-15:14:11.247738) EVENT_LOG_v1 {"time_micros": 1732000451247732, "job": 10, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4227, 4229, 4235, 4239], "score": 5.13994, "input_data_size": 133300108, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.739359 140042810951424 [compaction_job.cc:2437] [default] [JOB 10] Compacting 4@1 files to L2, score 5.14, subcompactions 1 : 1 2024/11/19-15:14:16.739366 140042810951424 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 8 Base level 1, inputs: [4227(31MB) 4229(31MB) 4235(31MB) 4239(31MB)] 2024/11/19-15:14:16.739485 140042810951424 [compaction_job.cc:703] job-00010: subcompact[0], size: 0.000000 G, files: /storage/mytopling/.rocksdb [] 2024/11/19-15:14:16.739568 140042810951424 (Original Log Time 2024/11/19-15:14:16.739394) EVENT_LOG_v1 {"time_micros": 1732000456739378, "job": 10, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4227, 4229, 4235, 4239], "score": 5.13994, "input_data_size": 133300108, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.739573 140042810951424 (Original Log Time 2024/11/19-15:14:16.739500) [compaction_job.cc:1224] [default] compacted to: files[3 84 61 80 0 0 0] max score 3.50 (121 files need compaction), MB/sec: 1388542.8 rd, 0.0 wr, level 2, files in(4, 0) out(0 +0 blob) MB in(127.1, 0.0 +0.0 blob) out(0.0 +0.0 blob), read-write-amplify(1.0) write-amplify(0.0) Shutdown in progress: Database shutdown, records in: 925654, records dropped: 925654 output_compression: Snappy 2024/11/19-15:14:16.739588 140042810951424 (Original Log Time 2024/11/19-15:14:16.739513) EVENT_LOG_v1 {"time_micros": 1732000456739506, "cf": "default", "job": 10, "event": "compaction_finished", "compaction_time_micros": 96, "compaction_time_cpu_micros": 84, "output_level": 2, "num_output_files": 0, "total_output_size": 0, "num_input_records": 925654, "num_output_records": 0, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 84, 61, 80, 0, 0, 0]} 2024/11/19-15:14:16.743997 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004151.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.744023 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456744020, "job": 10, "event": "table_file_deletion", "file_number": 4151} 2024/11/19-15:14:16.747962 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004152.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.747985 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456747983, "job": 10, "event": "table_file_deletion", "file_number": 4152} 2024/11/19-15:14:16.752336 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004153.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.752356 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456752354, "job": 10, "event": "table_file_deletion", "file_number": 4153} 2024/11/19-15:14:16.756786 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004156.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.756809 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456756807, "job": 10, "event": "table_file_deletion", "file_number": 4156} 2024/11/19-15:14:16.761298 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004159.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.761320 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456761318, "job": 10, "event": "table_file_deletion", "file_number": 4159} 2024/11/19-15:14:16.765625 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004161.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.765646 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456765644, "job": 10, "event": "table_file_deletion", "file_number": 4161} 2024/11/19-15:14:16.770039 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004163.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.770060 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456770057, "job": 10, "event": "table_file_deletion", "file_number": 4163} 2024/11/19-15:14:16.774470 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004165.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.774489 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456774487, "job": 10, "event": "table_file_deletion", "file_number": 4165} 2024/11/19-15:14:16.778852 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004172.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.778871 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456778870, "job": 10, "event": "table_file_deletion", "file_number": 4172} 2024/11/19-15:14:16.781529 140042800465664 [WARN] [dcompact_etcd.cc:1322] DcompactEtcd detected shutting down: nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-19T15.13.37/.rocksdb/job-00014/att-00 2024/11/19-15:14:16.783188 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004177.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.783208 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456783206, "job": 10, "event": "table_file_deletion", "file_number": 4177} 2024/11/19-15:14:16.787307 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004180.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.787328 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456787326, "job": 10, "event": "table_file_deletion", "file_number": 4180} 2024/11/19-15:14:16.788497 140042789979904 [WARN] [dcompact_etcd.cc:1322] DcompactEtcd detected shutting down: nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-19T15.13.37/.rocksdb/job-00015/att-00 2024/11/19-15:14:16.790634 140042800465664 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00014/att-00 2024/11/19-15:14:16.790685 140042800465664 [dcompact_etcd.cc:1720] job-00014/att-00: CleanFiles: shutting down, do not delete files 2024/11/19-15:14:16.790693 140042800465664 [dcompact_etcd.cc:1773] job-00014/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:16.790714 140042800465664 (Original Log Time 2024/11/19-15:14:13.307435) EVENT_LOG_v1 {"time_micros": 1732000453307428, "job": 14, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4168, 4170, 4173, 4175], "score": 4.5033, "input_data_size": 134098624, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.790720 140042800465664 [compaction_job.cc:2437] [default] [JOB 14] Compacting 4@1 files to L2, score 4.50, subcompactions 1 : 1 2024/11/19-15:14:16.790728 140042800465664 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 12 Base level 1, inputs: [4168(31MB) 4170(31MB) 4173(31MB) 4175(31MB)] 2024/11/19-15:14:16.790836 140042800465664 [compaction_job.cc:703] job-00014: subcompact[0], size: 0.000000 G, files: /storage/mytopling/.rocksdb [] 2024/11/19-15:14:16.790911 140042800465664 (Original Log Time 2024/11/19-15:14:16.790749) EVENT_LOG_v1 {"time_micros": 1732000456790735, "job": 14, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4168, 4170, 4173, 4175], "score": 4.5033, "input_data_size": 134098624, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.790916 140042800465664 (Original Log Time 2024/11/19-15:14:16.790851) [compaction_job.cc:1224] [default] compacted to: files[3 84 61 80 0 0 0] max score 3.50 (121 files need compaction), MB/sec: 1457593.7 rd, 0.0 wr, level 2, files in(4, 0) out(0 +0 blob) MB in(127.9, 0.0 +0.0 blob) out(0.0 +0.0 blob), read-write-amplify(1.0) write-amplify(0.0) Shutdown in progress: Database shutdown, records in: 128345, records dropped: 128345 output_compression: Snappy 2024/11/19-15:14:16.790947 140042800465664 (Original Log Time 2024/11/19-15:14:16.790865) EVENT_LOG_v1 {"time_micros": 1732000456790857, "cf": "default", "job": 14, "event": "compaction_finished", "compaction_time_micros": 92, "compaction_time_cpu_micros": 80, "output_level": 2, "num_output_files": 0, "total_output_size": 0, "num_input_records": 128345, "num_output_records": 0, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 84, 61, 80, 0, 0, 0]} 2024/11/19-15:14:16.791421 140042810951424 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004184.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.791442 140042810951424 EVENT_LOG_v1 {"time_micros": 1732000456791440, "job": 10, "event": "table_file_deletion", "file_number": 4184} 2024/11/19-15:14:16.794383 140042789979904 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00015/att-00 2024/11/19-15:14:16.794429 140042789979904 [dcompact_etcd.cc:1720] job-00015/att-00: CleanFiles: shutting down, do not delete files 2024/11/19-15:14:16.794436 140042789979904 [dcompact_etcd.cc:1773] job-00015/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:16.794458 140042789979904 (Original Log Time 2024/11/19-15:14:13.315918) EVENT_LOG_v1 {"time_micros": 1732000453315907, "job": 15, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4176, 4178, 4179, 4181], "score": 4.25352, "input_data_size": 134099008, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.794465 140042789979904 [compaction_job.cc:2437] [default] [JOB 15] Compacting 4@1 files to L2, score 4.25, subcompactions 1 : 1 2024/11/19-15:14:16.794472 140042789979904 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 13 Base level 1, inputs: [4176(31MB) 4178(31MB) 4179(31MB) 4181(31MB)] 2024/11/19-15:14:16.794557 140042789979904 [compaction_job.cc:703] job-00015: subcompact[0], size: 0.000000 G, files: /storage/mytopling/.rocksdb [] 2024/11/19-15:14:16.794620 140042789979904 (Original Log Time 2024/11/19-15:14:16.794492) EVENT_LOG_v1 {"time_micros": 1732000456794480, "job": 15, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4176, 4178, 4179, 4181], "score": 4.25352, "input_data_size": 134099008, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.794625 140042789979904 (Original Log Time 2024/11/19-15:14:16.794569) [compaction_job.cc:1224] [default] compacted to: files[3 84 61 80 0 0 0] max score 3.50 (121 files need compaction), MB/sec: 1943463.9 rd, 0.0 wr, level 2, files in(4, 0) out(0 +0 blob) MB in(127.9, 0.0 +0.0 blob) out(0.0 +0.0 blob), read-write-amplify(1.0) write-amplify(0.0) Shutdown in progress: Database shutdown, records in: 128412, records dropped: 128412 output_compression: Snappy 2024/11/19-15:14:16.794640 140042789979904 (Original Log Time 2024/11/19-15:14:16.794582) EVENT_LOG_v1 {"time_micros": 1732000456794575, "cf": "default", "job": 15, "event": "compaction_finished", "compaction_time_micros": 69, "compaction_time_cpu_micros": 59, "output_level": 2, "num_output_files": 0, "total_output_size": 0, "num_input_records": 128412, "num_output_records": 0, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 84, 61, 80, 0, 0, 0]} 2024/11/19-15:14:16.795138 140042800465664 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004189.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.795160 140042800465664 EVENT_LOG_v1 {"time_micros": 1732000456795157, "job": 14, "event": "table_file_deletion", "file_number": 4189} 2024/11/19-15:14:16.798602 140042789979904 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004203.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.798624 140042789979904 EVENT_LOG_v1 {"time_micros": 1732000456798621, "job": 15, "event": "table_file_deletion", "file_number": 4203} 2024/11/19-15:14:16.799642 140042800465664 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004192.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.799662 140042800465664 EVENT_LOG_v1 {"time_micros": 1732000456799660, "job": 14, "event": "table_file_deletion", "file_number": 4192} 2024/11/19-15:14:16.802819 140042789979904 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004206.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.802839 140042789979904 EVENT_LOG_v1 {"time_micros": 1732000456802837, "job": 15, "event": "table_file_deletion", "file_number": 4206} 2024/11/19-15:14:16.804305 140042800465664 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004195.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.804325 140042800465664 EVENT_LOG_v1 {"time_micros": 1732000456804323, "job": 14, "event": "table_file_deletion", "file_number": 4195} 2024/11/19-15:14:16.806999 140042789979904 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004209.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.807019 140042789979904 EVENT_LOG_v1 {"time_micros": 1732000456807017, "job": 15, "event": "table_file_deletion", "file_number": 4209} 2024/11/19-15:14:16.809110 140042800465664 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004199.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.809129 140042800465664 EVENT_LOG_v1 {"time_micros": 1732000456809127, "job": 14, "event": "table_file_deletion", "file_number": 4199} 2024/11/19-15:14:16.811061 140042789979904 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004212.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.811081 140042789979904 EVENT_LOG_v1 {"time_micros": 1732000456811079, "job": 15, "event": "table_file_deletion", "file_number": 4212} 2024/11/19-15:14:16.970103 140042641082112 [WARN] [dcompact_etcd.cc:1322] DcompactEtcd detected shutting down: nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-19T15.13.37/.rocksdb/job-00016/att-00 2024/11/19-15:14:16.978528 140042641082112 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00016/att-00 2024/11/19-15:14:16.978579 140042641082112 [dcompact_etcd.cc:1720] job-00016/att-00: CleanFiles: shutting down, do not delete files 2024/11/19-15:14:16.978587 140042641082112 [dcompact_etcd.cc:1773] job-00016/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:16.978607 140042641082112 (Original Log Time 2024/11/19-15:14:13.499562) EVENT_LOG_v1 {"time_micros": 1732000453499548, "job": 16, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4182, 4183, 4185, 4186], "score": 4.00374, "input_data_size": 134100928, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.978615 140042641082112 [compaction_job.cc:2437] [default] [JOB 16] Compacting 4@1 files to L2, score 4.00, subcompactions 1 : 1 2024/11/19-15:14:16.978622 140042641082112 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 14 Base level 1, inputs: [4182(31MB) 4183(31MB) 4185(31MB) 4186(31MB)] 2024/11/19-15:14:16.978733 140042641082112 [compaction_job.cc:703] job-00016: subcompact[0], size: 0.000000 G, files: /storage/mytopling/.rocksdb [] 2024/11/19-15:14:16.978800 140042641082112 (Original Log Time 2024/11/19-15:14:16.978645) EVENT_LOG_v1 {"time_micros": 1732000456978631, "job": 16, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4182, 4183, 4185, 4186], "score": 4.00374, "input_data_size": 134100928, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:16.978804 140042641082112 (Original Log Time 2024/11/19-15:14:16.978747) [compaction_job.cc:1224] [default] compacted to: files[3 84 61 80 0 0 0] max score 3.50 (121 files need compaction), MB/sec: 1441945.5 rd, 0.0 wr, level 2, files in(4, 0) out(0 +0 blob) MB in(127.9, 0.0 +0.0 blob) out(0.0 +0.0 blob), read-write-amplify(1.0) write-amplify(0.0) Shutdown in progress: Database shutdown, records in: 128282, records dropped: 128282 output_compression: Snappy 2024/11/19-15:14:16.978819 140042641082112 (Original Log Time 2024/11/19-15:14:16.978760) EVENT_LOG_v1 {"time_micros": 1732000456978753, "cf": "default", "job": 16, "event": "compaction_finished", "compaction_time_micros": 93, "compaction_time_cpu_micros": 80, "output_level": 2, "num_output_files": 0, "total_output_size": 0, "num_input_records": 128282, "num_output_records": 0, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 84, 61, 80, 0, 0, 0]} 2024/11/19-15:14:16.982831 140042641082112 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004216.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.982855 140042641082112 EVENT_LOG_v1 {"time_micros": 1732000456982853, "job": 16, "event": "table_file_deletion", "file_number": 4216} 2024/11/19-15:14:16.987377 140042641082112 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004219.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.987399 140042641082112 EVENT_LOG_v1 {"time_micros": 1732000456987397, "job": 16, "event": "table_file_deletion", "file_number": 4219} 2024/11/19-15:14:16.991633 140042641082112 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004223.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.991653 140042641082112 EVENT_LOG_v1 {"time_micros": 1732000456991651, "job": 16, "event": "table_file_deletion", "file_number": 4223} 2024/11/19-15:14:16.995792 140042641082112 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004225.sst immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:16.995811 140042641082112 EVENT_LOG_v1 {"time_micros": 1732000456995809, "job": 16, "event": "table_file_deletion", "file_number": 4225} 2024/11/19-15:14:17.059537 140042630596352 [WARN] [dcompact_etcd.cc:1322] DcompactEtcd detected shutting down: nfs/i-wz9deglxdazgiryp6ltb_10.57.5.137/2024-11-19T15.13.37/.rocksdb/job-00017/att-00 2024/11/19-15:14:17.068065 140042630596352 [dcompact_etcd.cc:1500] curl http://cn-shenzhen.Aliyun.internal-saas-labour.topling.cn:8000/shutdown?labour=i-wz90axp17yqp1av7udge@10.0.3.178:8080 : 200 OK status = NotFound : job-00017/att-00 2024/11/19-15:14:17.068110 140042630596352 [dcompact_etcd.cc:1720] job-00017/att-00: CleanFiles: shutting down, do not delete files 2024/11/19-15:14:17.068117 140042630596352 [dcompact_etcd.cc:1773] job-00017/att-00: CleanFiles 0.000 sec : 0.000 2024/11/19-15:14:17.068137 140042630596352 (Original Log Time 2024/11/19-15:14:13.580712) EVENT_LOG_v1 {"time_micros": 1732000453580705, "job": 17, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4187, 4188, 4190, 4191], "score": 3.75396, "input_data_size": 134099328, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:17.068144 140042630596352 [compaction_job.cc:2437] [default] [JOB 17] Compacting 4@1 files to L2, score 3.75, subcompactions 1 : 1 2024/11/19-15:14:17.068152 140042630596352 [compaction_job.cc:2445] [default]: Compaction start summary: Base version 15 Base level 1, inputs: [4187(31MB) 4188(31MB) 4190(31MB) 4191(31MB)] 2024/11/19-15:14:17.068249 140042630596352 [compaction_job.cc:703] job-00017: subcompact[0], size: 0.000000 G, files: /storage/mytopling/.rocksdb [] 2024/11/19-15:14:17.068289 140042630596352 (Original Log Time 2024/11/19-15:14:17.068174) EVENT_LOG_v1 {"time_micros": 1732000457068159, "job": 17, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [4187, 4188, 4190, 4191], "score": 3.75396, "input_data_size": 134099328, "oldest_snapshot_seqno": -1} 2024/11/19-15:14:17.068294 140042630596352 (Original Log Time 2024/11/19-15:14:17.068262) [compaction_job.cc:1224] [default] compacted to: files[3 84 61 80 0 0 0] max score 3.50 (121 files need compaction), MB/sec: 1697459.8 rd, 0.0 wr, level 2, files in(4, 0) out(0 +0 blob) MB in(127.9, 0.0 +0.0 blob) out(0.0 +0.0 blob), read-write-amplify(1.0) write-amplify(0.0) Shutdown in progress: Database shutdown, records in: 128323, records dropped: 128323 output_compression: Snappy 2024/11/19-15:14:17.068300 140042630596352 (Original Log Time 2024/11/19-15:14:17.068276) EVENT_LOG_v1 {"time_micros": 1732000457068268, "cf": "default", "job": 17, "event": "compaction_finished", "compaction_time_micros": 79, "compaction_time_cpu_micros": 68, "output_level": 2, "num_output_files": 0, "total_output_size": 0, "num_input_records": 128323, "num_output_records": 0, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [3, 84, 61, 80, 0, 0, 0]} 2024/11/19-15:14:18.837927 140043962924992 [db_impl.cc:592] Shutdown: canceling all background work 2024/11/19-15:14:18.838336 140043962924992 [delete_scheduler.cc:73] Deleted file /storage/mytopling/.rocksdb/004294.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/11/19-15:14:18.908985 140043962924992 [db_impl.cc:774] Shutdown complete