git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Cluster configuration issue


Hi to all,

I have a problem with distribuited cluster configuration.
This is a test environment 
Cassandra version is 3.11.3
2 site Milan and Florence
2 servers on each site

1 common "cluster-name" and 2 DC

First installation and startup goes ok all the nodes are present in the cluster.

The issue startup after a server reboot in FLORENCE DC

Cassandra node did not startup and in system.log last line written is

INFO  [ScheduledTasks:1] 2018-11-09 10:36:54,306 TokenMetadata.java:498 - Updating topology for all endpoints that have changed



The only way to correct the thing I found is to cleanup the node, remove from cluster and re-join it.

How can I solve it?


here are configuration files

less cassandra-topology.properties
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

# Cassandra Node IP=Data Center:Rack
192.168.204.175=DC-FIRENZE:RACK1
192.168.204.176=DC-FIRENZE:RACK1
192.168.71.210=DC-MILANO:RACK1
192.168.71.211=DC-MILANO:RACK1

# default for unknown nodes
default=DC-FIRENZE:r1

# Native IPv6 is supported, however you must escape the colon in the IPv6 Address
# Also be sure to comment out JVM_OPTS="$JVM_OPTS -Djava.net.preferIPv4Stack=true"
# in cassandra-env.sh
#fe80\:0\:0\:0\:202\:b3ff\:fe1e\:8329=DC1:RAC3


cassandra-rackdc.properties

# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

# These properties are used with GossipingPropertyFileSnitch and will
# indicate the rack and dc for this node
dc=DC-FIRENZE
rack=RACK1

# Add a suffix to a datacenter name. Used by the Ec2Snitch and Ec2MultiRegionSnitch
# to append a string to the EC2 region name.
#dc_suffix=

# Uncomment the following line to make this snitch prefer the internal ip when possible, as the Ec2MultiRegionSnitch does.
# prefer_local=true


In attach the system.log file

Regards

Francesco Messere


INFO  [main] 2018-11-09 10:37:24,378 YamlConfigurationLoader.java:89 - Configuration location: file:/data/CASSANDRA_SHARE_PROD_data/CASSANDRA_PRIV_3/conf/cassandra.yaml
INFO  [main] 2018-11-09 10:37:24,621 Config.java:495 - Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; back_pressure_enabled=false; back_pressure_strategy=org.apache.cassandra.net.RateBasedBackPressure{high_ratio=0.9, factor=5, flow=FAST}; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=192.168.204.176; broadcast_rpc_address=null; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=/work/cassandra/cassandra_priv_3/cdc_raw; cdc_total_space_in_mb=4096; client_encryption_options=<REDACTED>; cluster_name=CASSANDRA_3; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/commitlog/cassandra/cassandra_priv_3/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=NaN; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=8192; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@229d10bd; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_materialized_views=true; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=GossipingPropertyFileSnitch; file_cache_round_up=null; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/work/cassandra/cassandra_priv_3/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=dc; internode_recv_buff_size_in_bytes=0; internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=192.168.204.176; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=0; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=17055; native_transport_port_ssl=null; num_tokens=256; otc_backlog_expiration_interval_ms=200; otc_coalescing_enough_coalesced_messages=8; otc_coalescing_strategy=DISABLED; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=10000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=192.168.204.176; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=17056; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/work/cassandra/cassandra_priv_3/saved_caches; seed_provider=org.apache.cassandra.locator.SimpleSeedProvider{seeds=192.168.71.210,192.168.71.211}; server_encryption_options=<REDACTED>; slow_query_log_timeout_in_ms=500; snapshot_before_compaction=false; ssl_storage_port=17054; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=17053; stream_throughput_outbound_megabits_per_sec=200; streaming_keep_alive_period_in_secs=300; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@47542153; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=10000]
INFO  [main] 2018-11-09 10:37:24,621 DatabaseDescriptor.java:367 - DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO  [main] 2018-11-09 10:37:24,621 DatabaseDescriptor.java:425 - Global memtable on-heap threshold is enabled at 989MB
INFO  [main] 2018-11-09 10:37:24,622 DatabaseDescriptor.java:429 - Global memtable off-heap threshold is enabled at 989MB
INFO  [main] 2018-11-09 10:37:24,734 RateBasedBackPressure.java:123 - Initialized back-pressure with high ratio: 0.9, factor: 5, flow: FAST, window size: 10000.
INFO  [main] 2018-11-09 10:37:24,735 DatabaseDescriptor.java:729 - Back-pressure is disabled with strategy org.apache.cassandra.net.RateBasedBackPressure{high_ratio=0.9, factor=5, flow=FAST}.
INFO  [main] 2018-11-09 10:37:24,839 GossipingPropertyFileSnitch.java:64 - Loaded cassandra-topology.properties for compatibility
WARN  [main] 2018-11-09 10:37:24,867 CassandraDaemon.java:114 - JMX settings in cassandra-env.sh have been bypassed as the JMX connector server is already initialized. Please refer to cassandra-env.(sh|ps1) for JMX configuration info
INFO  [main] 2018-11-09 10:37:24,873 CassandraDaemon.java:473 - Hostname: hsserver-dr-02
INFO  [main] 2018-11-09 10:37:24,874 CassandraDaemon.java:480 - JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.8.0_151
INFO  [main] 2018-11-09 10:37:24,875 CassandraDaemon.java:481 - Heap size: 3.867GiB/3.867GiB
INFO  [main] 2018-11-09 10:37:24,876 CassandraDaemon.java:486 - Code Cache Non-heap memory: init = 2555904(2496K) used = 7189056(7020K) committed = 7208960(7040K) max = 251658240(245760K)
INFO  [main] 2018-11-09 10:37:24,876 CassandraDaemon.java:486 - Metaspace Non-heap memory: init = 0(0K) used = 19307360(18854K) committed = 19791872(19328K) max = -1(-1K)
INFO  [main] 2018-11-09 10:37:24,877 CassandraDaemon.java:486 - Compressed Class Space Non-heap memory: init = 0(0K) used = 2370808(2315K) committed = 2490368(2432K) max = 1073741824(1048576K)
INFO  [main] 2018-11-09 10:37:24,877 CassandraDaemon.java:486 - Par Eden Space Heap memory: init = 1145372672(1118528K) used = 320705464(313188K) committed = 1145372672(1118528K) max = 1145372672(1118528K)
INFO  [main] 2018-11-09 10:37:24,877 CassandraDaemon.java:486 - Par Survivor Space Heap memory: init = 143130624(139776K) used = 0(0K) committed = 143130624(139776K) max = 143130624(139776K)
INFO  [main] 2018-11-09 10:37:24,878 CassandraDaemon.java:486 - CMS Old Gen Heap memory: init = 2863333376(2796224K) used = 0(0K) committed = 2863333376(2796224K) max = 2863333376(2796224K)
INFO  [main] 2018-11-09 10:37:24,879 CassandraDaemon.java:488 - Classpath: ../bin/cassandra-3.11.3/lib/airline-0.6.jar:../bin/cassandra-3.11.3/lib/antlr-runtime-3.5.2.jar:../bin/cassandra-3.11.3/lib/apache-cassandra-3.11.3.jar:../bin/cassandra-3.11.3/lib/apache-cassandra-thrift-3.11.3.jar:../bin/cassandra-3.11.3/lib/asm-5.0.4.jar:../bin/cassandra-3.11.3/lib/caffeine-2.2.6.jar:../bin/cassandra-3.11.3/lib/cassandra-driver-core-3.0.1-shaded.jar:../bin/cassandra-3.11.3/lib/cassandra-driver-internal-only-3.10.zip:../bin/cassandra-3.11.3/lib/cassandra-driver-internal-only-3.11.0-bb96859b.zip:../bin/cassandra-3.11.3/lib/commons-cli-1.1.jar:../bin/cassandra-3.11.3/lib/commons-codec-1.9.jar:../bin/cassandra-3.11.3/lib/commons-lang3-3.1.jar:../bin/cassandra-3.11.3/lib/commons-math3-3.2.jar:../bin/cassandra-3.11.3/lib/compress-lzf-0.8.4.jar:../bin/cassandra-3.11.3/lib/concurrentlinkedhashmap-lru-1.4.jar:../bin/cassandra-3.11.3/lib/concurrent-trees-2.4.0.jar:../bin/cassandra-3.11.3/lib/disruptor-3.0.1.jar:../bin/cassandra-3.11.3/lib/ecj-4.4.2.jar:../bin/cassandra-3.11.3/lib/futures-2.1.6-py2.py3-none-any.zip:../bin/cassandra-3.11.3/lib/guava-18.0.jar:../bin/cassandra-3.11.3/lib/HdrHistogram-2.1.9.jar:../bin/cassandra-3.11.3/lib/high-scale-lib-1.0.6.jar:../bin/cassandra-3.11.3/lib/hppc-0.5.4.jar:../bin/cassandra-3.11.3/lib/jackson-core-asl-1.9.13.jar:../bin/cassandra-3.11.3/lib/jackson-mapper-asl-1.9.13.jar:../bin/cassandra-3.11.3/lib/jamm-0.3.0.jar:../bin/cassandra-3.11.3/lib/javax.inject.jar:../bin/cassandra-3.11.3/lib/jbcrypt-0.3m.jar:../bin/cassandra-3.11.3/lib/jcl-over-slf4j-1.7.7.jar:../bin/cassandra-3.11.3/lib/jctools-core-1.2.1.jar:../bin/cassandra-3.11.3/lib/jflex-1.6.0.jar:../bin/cassandra-3.11.3/lib/jna-4.2.2.jar:../bin/cassandra-3.11.3/lib/joda-time-2.4.jar:../bin/cassandra-3.11.3/lib/json-simple-1.1.jar:../bin/cassandra-3.11.3/lib/jstackjunit-0.0.1.jar:../bin/cassandra-3.11.3/lib/libthrift-0.9.2.jar:../bin/cassandra-3.11.3/lib/log4j-over-slf4j-1.7.7.jar:../bin/cassandra-3.11.3/lib/logback-classic-1.1.3.jar:../bin/cassandra-3.11.3/lib/logback-core-1.1.3.jar:../bin/cassandra-3.11.3/lib/lz4-1.3.0.jar:../bin/cassandra-3.11.3/lib/metrics-core-3.1.5.jar:../bin/cassandra-3.11.3/lib/metrics-jvm-3.1.5.jar:../bin/cassandra-3.11.3/lib/metrics-logback-3.1.5.jar:../bin/cassandra-3.11.3/lib/netty-all-4.0.44.Final.jar:../bin/cassandra-3.11.3/lib/ohc-core-0.4.4.jar:../bin/cassandra-3.11.3/lib/ohc-core-j8-0.4.4.jar:../bin/cassandra-3.11.3/lib/reporter-config3-3.0.3.jar:../bin/cassandra-3.11.3/lib/reporter-config-base-3.0.3.jar:../bin/cassandra-3.11.3/lib/sigar-1.6.4.jar:../bin/cassandra-3.11.3/lib/six-1.7.3-py2.py3-none-any.zip:../bin/cassandra-3.11.3/lib/slf4j-api-1.7.7.jar:../bin/cassandra-3.11.3/lib/snakeyaml-1.11.jar:../bin/cassandra-3.11.3/lib/snappy-java-1.1.1.7.jar:../bin/cassandra-3.11.3/lib/snowball-stemmer-1.3.0.581.1.jar:../bin/cassandra-3.11.3/lib/ST4-4.0.8.jar:../bin/cassandra-3.11.3/lib/stream-2.5.2.jar:../bin/cassandra-3.11.3/lib/thrift-server-0.3.7.jar:../bin/FTSLF4JBridge.jar:./jna-4.0.0.jar:./conf::../bin/cassandra-3.11.3/lib/jamm-0.3.0.jar
INFO  [main] 2018-11-09 10:37:24,879 CassandraDaemon.java:490 - JVM Arguments: [vfprintf, -Xrs, -Dcassandra.config=cassandra.yaml, -Dcassandra.metricsReporterConfigFile=metrics-reporter-config.yaml, -ea, -javaagent:../bin/cassandra-3.11.3/lib/jamm-0.3.0.jar, -Djava.library.path=../bin/cassandra-3.11.3/lib/sigar-bin, -Xms4G, -Xmx4G, -XX:+HeapDumpOnOutOfMemoryError, -XX:+UseParNewGC, -XX:+UseConcMarkSweepGC, -XX:+CMSParallelRemarkEnabled, -XX:SurvivorRatio=8, -XX:MaxTenuringThreshold=1, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Dcom.sun.management.jmxremote.port=17052, -Dcom.sun.management.jmxremote.ssl=false, -Dcom.sun.management.jmxremote.authenticate=false, -Xrs]
WARN  [main] 2018-11-09 10:37:24,927 NativeLibrary.java:187 - Unable to lock JVM memory (ENOMEM). This can result in part of the JVM being swapped out, especially with mmapped I/O enabled. Increase RLIMIT_MEMLOCK or run Cassandra as root.
WARN  [main] 2018-11-09 10:37:24,928 StartupChecks.java:136 - jemalloc shared library could not be preloaded to speed up memory allocations
WARN  [main] 2018-11-09 10:37:24,928 StartupChecks.java:169 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info.
ERROR [main] 2018-11-09 10:37:24,928 StartupChecks.java:172 - cassandra.jmx.local.port missing from cassandra-env.sh, unable to start local JMX service.
WARN  [main] 2018-11-09 10:37:24,929 StartupChecks.java:187 - Use of com.sun.management.jmxremote.port at startup is deprecated. Please use cassandra.jmx.remote.port instead.
WARN  [main] 2018-11-09 10:37:24,929 StartupChecks.java:220 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError:  -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>"
INFO  [main] 2018-11-09 10:37:24,930 SigarLibrary.java:44 - Initializing SIGAR library
WARN  [main] 2018-11-09 10:37:24,940 SigarLibrary.java:174 - Cassandra server running in degraded mode. Is swap disabled? : false,  Address space adequate? : true,  nofile limit adequate? : true, nproc limit adequate? : false 
INFO  [main] 2018-11-09 10:37:25,048 QueryProcessor.java:116 - Initialized prepared statement caches with 15 MB (native) and 15 MB (Thrift)
INFO  [main] 2018-11-09 10:37:25,417 ColumnFamilyStore.java:411 - Initializing system.IndexInfo
INFO  [SSTableBatchOpen:12] 2018-11-09 10:37:25,957 BufferPool.java:230 - Global buffer pool is enabled, when pool is exhausted (max is 512.000MiB) it will allocate on heap
INFO  [main] 2018-11-09 10:37:26,494 CacheService.java:112 - Initializing key cache with capacity of 100 MBs.
INFO  [main] 2018-11-09 10:37:26,505 CacheService.java:134 - Initializing row cache with capacity of 0 MBs
INFO  [main] 2018-11-09 10:37:26,507 CacheService.java:163 - Initializing counter cache with capacity of 50 MBs
INFO  [main] 2018-11-09 10:37:26,509 CacheService.java:174 - Scheduling counter cache save to every 7200 seconds (going to save all keys).
INFO  [main] 2018-11-09 10:37:26,548 ColumnFamilyStore.java:411 - Initializing system.batches
INFO  [main] 2018-11-09 10:37:26,554 ColumnFamilyStore.java:411 - Initializing system.paxos
INFO  [main] 2018-11-09 10:37:26,563 ColumnFamilyStore.java:411 - Initializing system.local
INFO  [main] 2018-11-09 10:37:26,575 ColumnFamilyStore.java:411 - Initializing system.peers
INFO  [main] 2018-11-09 10:37:26,607 ColumnFamilyStore.java:411 - Initializing system.peer_events
INFO  [main] 2018-11-09 10:37:26,611 ColumnFamilyStore.java:411 - Initializing system.range_xfers
INFO  [main] 2018-11-09 10:37:26,618 ColumnFamilyStore.java:411 - Initializing system.compaction_history
INFO  [main] 2018-11-09 10:37:26,636 ColumnFamilyStore.java:411 - Initializing system.sstable_activity
INFO  [main] 2018-11-09 10:37:26,649 ColumnFamilyStore.java:411 - Initializing system.size_estimates
INFO  [main] 2018-11-09 10:37:26,655 ColumnFamilyStore.java:411 - Initializing system.available_ranges
INFO  [main] 2018-11-09 10:37:26,662 ColumnFamilyStore.java:411 - Initializing system.transferred_ranges
INFO  [main] 2018-11-09 10:37:26,667 ColumnFamilyStore.java:411 - Initializing system.views_builds_in_progress
INFO  [main] 2018-11-09 10:37:26,671 ColumnFamilyStore.java:411 - Initializing system.built_views
INFO  [main] 2018-11-09 10:37:26,675 ColumnFamilyStore.java:411 - Initializing system.hints
INFO  [main] 2018-11-09 10:37:26,679 ColumnFamilyStore.java:411 - Initializing system.batchlog
INFO  [main] 2018-11-09 10:37:26,683 ColumnFamilyStore.java:411 - Initializing system.prepared_statements
INFO  [main] 2018-11-09 10:37:26,687 ColumnFamilyStore.java:411 - Initializing system.schema_keyspaces
INFO  [main] 2018-11-09 10:37:26,691 ColumnFamilyStore.java:411 - Initializing system.schema_columnfamilies
INFO  [main] 2018-11-09 10:37:26,694 ColumnFamilyStore.java:411 - Initializing system.schema_columns
INFO  [main] 2018-11-09 10:37:26,697 ColumnFamilyStore.java:411 - Initializing system.schema_triggers
INFO  [main] 2018-11-09 10:37:26,701 ColumnFamilyStore.java:411 - Initializing system.schema_usertypes
INFO  [main] 2018-11-09 10:37:26,705 ColumnFamilyStore.java:411 - Initializing system.schema_functions
INFO  [main] 2018-11-09 10:37:26,708 ColumnFamilyStore.java:411 - Initializing system.schema_aggregates
INFO  [main] 2018-11-09 10:37:26,709 ViewManager.java:137 - Not submitting build tasks for views in keyspace system as storage service is not initialized
INFO  [main] 2018-11-09 10:37:26,809 ApproximateTime.java:44 - Scheduling approximate time-check task with a precision of 10 milliseconds
INFO  [main] 2018-11-09 10:37:26,843 ColumnFamilyStore.java:411 - Initializing system_schema.keyspaces
INFO  [main] 2018-11-09 10:37:26,850 ColumnFamilyStore.java:411 - Initializing system_schema.tables
INFO  [main] 2018-11-09 10:37:26,856 ColumnFamilyStore.java:411 - Initializing system_schema.columns
INFO  [main] 2018-11-09 10:37:26,862 ColumnFamilyStore.java:411 - Initializing system_schema.triggers
INFO  [main] 2018-11-09 10:37:26,868 ColumnFamilyStore.java:411 - Initializing system_schema.dropped_columns
INFO  [main] 2018-11-09 10:37:26,875 ColumnFamilyStore.java:411 - Initializing system_schema.views
INFO  [main] 2018-11-09 10:37:26,881 ColumnFamilyStore.java:411 - Initializing system_schema.types
INFO  [main] 2018-11-09 10:37:26,888 ColumnFamilyStore.java:411 - Initializing system_schema.functions
INFO  [main] 2018-11-09 10:37:26,894 ColumnFamilyStore.java:411 - Initializing system_schema.aggregates
INFO  [main] 2018-11-09 10:37:26,900 ColumnFamilyStore.java:411 - Initializing system_schema.indexes
INFO  [main] 2018-11-09 10:37:26,903 ViewManager.java:137 - Not submitting build tasks for views in keyspace system_schema as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,165 StorageService.java:600 - Populating token metadata from system tables
INFO  [main] 2018-11-09 10:37:27,194 StorageService.java:607 - Token metadata: Normal Tokens:
INFO  [main] 2018-11-09 10:37:27,347 ViewManager.java:137 - Not submitting build tasks for views in keyspace bbpm_int_depth as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,351 ColumnFamilyStore.java:411 - Initializing system_distributed.parent_repair_history
INFO  [main] 2018-11-09 10:37:27,378 ColumnFamilyStore.java:411 - Initializing system_distributed.repair_history
INFO  [main] 2018-11-09 10:37:27,390 ColumnFamilyStore.java:411 - Initializing system_distributed.view_build_status
INFO  [main] 2018-11-09 10:37:27,396 ViewManager.java:137 - Not submitting build tasks for views in keyspace system_distributed as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,397 ViewManager.java:137 - Not submitting build tasks for views in keyspace bbpm_int_exchange_rate as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,398 ViewManager.java:137 - Not submitting build tasks for views in keyspace bbpm_int_quote as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,399 ViewManager.java:137 - Not submitting build tasks for views in keyspace bbpm_int_last_exec as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,400 ViewManager.java:137 - Not submitting build tasks for views in keyspace bbpm_int_depth_sampled as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,401 ViewManager.java:137 - Not submitting build tasks for views in keyspace bbpm_int_official_price as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,402 ViewManager.java:137 - Not submitting build tasks for views in keyspace bbpm_int_sec_info as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,405 ColumnFamilyStore.java:411 - Initializing system_auth.resource_role_permissons_index
INFO  [main] 2018-11-09 10:37:27,410 ColumnFamilyStore.java:411 - Initializing system_auth.role_members
INFO  [main] 2018-11-09 10:37:27,415 ColumnFamilyStore.java:411 - Initializing system_auth.role_permissions
INFO  [main] 2018-11-09 10:37:27,420 ColumnFamilyStore.java:411 - Initializing system_auth.roles
INFO  [main] 2018-11-09 10:37:27,423 ViewManager.java:137 - Not submitting build tasks for views in keyspace system_auth as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,428 ColumnFamilyStore.java:411 - Initializing bbpm_prd_quote.data_201801
INFO  [main] 2018-11-09 10:37:27,591 ViewManager.java:137 - Not submitting build tasks for views in keyspace bbpm_prd_quote as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,595 ColumnFamilyStore.java:411 - Initializing system_traces.events
INFO  [main] 2018-11-09 10:37:27,603 ColumnFamilyStore.java:411 - Initializing system_traces.sessions
INFO  [main] 2018-11-09 10:37:27,609 ViewManager.java:137 - Not submitting build tasks for views in keyspace system_traces as storage service is not initialized
INFO  [main] 2018-11-09 10:37:27,612 ColumnFamilyStore.java:411 - Initializing bbpm_int.custommetadata
INFO  [main] 2018-11-09 10:37:27,626 ColumnFamilyStore.java:411 - Initializing bbpm_int.custommetadata.custommetadata_value_idx
INFO  [main] 2018-11-09 10:37:27,660 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201801
INFO  [main] 2018-11-09 10:37:27,674 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201802
INFO  [main] 2018-11-09 10:37:27,685 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201803
INFO  [main] 2018-11-09 10:37:27,696 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201804
INFO  [main] 2018-11-09 10:37:27,707 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201805
INFO  [main] 2018-11-09 10:37:27,718 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201806
INFO  [main] 2018-11-09 10:37:27,727 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201807
INFO  [main] 2018-11-09 10:37:27,735 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201808
INFO  [main] 2018-11-09 10:37:27,745 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201809
INFO  [main] 2018-11-09 10:37:27,753 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201810
INFO  [main] 2018-11-09 10:37:27,762 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201811
INFO  [main] 2018-11-09 10:37:27,770 ColumnFamilyStore.java:411 - Initializing bbpm_int.data_201812
INFO  [main] 2018-11-09 10:37:27,778 ColumnFamilyStore.java:411 - Initializing bbpm_int.metadata
INFO  [main] 2018-11-09 10:37:28,081 ColumnFamilyStore.java:411 - Initializing bbpm_int.names
INFO  [main] 2018-11-09 10:37:28,132 ViewManager.java:137 - Not submitting build tasks for views in keyspace bbpm_int as storage service is not initialized
INFO  [pool-3-thread-1] 2018-11-09 10:37:28,135 AutoSavingCache.java:198 - reading saved cache /work/cassandra/cassandra_priv_3/saved_caches/KeyCache-e.db
INFO  [pool-3-thread-1] 2018-11-09 10:37:28,143 AutoSavingCache.java:174 - Completed loading (9 ms; 117 keys) KeyCache cache
INFO  [main] 2018-11-09 10:37:28,155 CommitLog.java:157 - Replaying /commitlog/cassandra/cassandra_priv_3/commitlog/CommitLog-6-1541755272997.log, /commitlog/cassandra/cassandra_priv_3/commitlog/CommitLog-6-1541755272998.log
INFO  [main] 2018-11-09 10:37:28,175 CommitLogReader.java:105 - Skipping playback of empty log: CommitLog-6-1541755272998.log
INFO  [main] 2018-11-09 10:37:28,269 CommitLog.java:159 - Log replay complete, 111 replayed mutations
INFO  [main] 2018-11-09 10:37:28,270 StorageService.java:600 - Populating token metadata from system tables
INFO  [main] 2018-11-09 10:37:28,288 StorageService.java:607 - Token metadata: Normal Tokens:
INFO  [ScheduledTasks:1] 2018-11-09 10:37:29,841 TokenMetadata.java:498 - Updating topology for all endpoints that have changed
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@xxxxxxxxxxxxxxxxxxxx
For additional commands, e-mail: user-help@xxxxxxxxxxxxxxxxxxxx