git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Inconsistent behaviour of counter update during cassandra intermediate upgrade


Hi All,

I have 3 node (A,B,C) 2.1.16 cassandra cluster which i am upgrading to cassandra 3.11.2.
My current cluster status is node a has been upgrade to 3.11.2, B is down, and C is on cassandra 2.1.16

when i run counter update using cqlsh it is behaving strange inconsistent way , sometimes the update actualy applied and sometimes it does not apply at all.


See the below example of cqlsh logged in to node A:
===============Incorrect update : update not applied ========
user@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |     0
 
user@cqlsh:ks> UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count';

user@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |     0


 ===============Correct update : update applied successfully ========
user@cqlsh> USE ks ;
user@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |  -100
 
user@cqlsh:ks> UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count';

user@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |     0


I have attached the output with trace enabled (with actual timestamp) for both correct and incorrect counter update .

What is the reason of this weird behavior ?
--

regards,
Laxmikant Upadhyay

================================================================================================================CORRECT UPDATE ============================================================================
vs@cqlsh> USE ks ;
vs@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |  -100

(1 rows)
vs@cqlsh:ks> tracing on;
Now Tracing is enabled
vs@cqlsh:ks> UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count';

Tracing session: f69e8240-e195-11e8-88e0-913c16841bd0

 activity                                                                                                                                              | timestamp                  | source        | source_elapsed | client
-------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------+---------------+----------------+---------------
                                                                                                                                    Execute CQL3 query | 2018-11-06 08:31:23.876000 | xx.yy.zz.51 |              0 | xx.yy.zz.51
 Parsing UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count'; [Native-Transport-Requests-1] | 2018-11-06 08:31:23.877000 | xx.yy.zz.51 |            254 | xx.yy.zz.51
                                                                                                     Preparing statement [Native-Transport-Requests-1] | 2018-11-06 08:31:23.877000 | xx.yy.zz.51 |            468 | xx.yy.zz.51
 Parsing UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count'; [Native-Transport-Requests-1] | 2018-11-06 08:31:23.877000 | xx.yy.zz.51 |            717 | xx.yy.zz.51
                                                                                                     Preparing statement [Native-Transport-Requests-1] | 2018-11-06 08:31:23.877000 | xx.yy.zz.51 |            839 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-3] | 2018-11-06 08:31:23.877000 | xx.yy.zz.51 |           1133 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:31:23.877000 | xx.yy.zz.51 |           1209 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-3] | 2018-11-06 08:31:23.878000 | xx.yy.zz.51 |           1258 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-3] | 2018-11-06 08:31:23.878000 | xx.yy.zz.51 |           1339 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:31:23.878000 | xx.yy.zz.51 |           1505 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-2] | 2018-11-06 08:31:23.878000 | xx.yy.zz.51 |           1749 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-2] | 2018-11-06 08:31:23.878000 | xx.yy.zz.51 |           1804 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-2] | 2018-11-06 08:31:23.878000 | xx.yy.zz.51 |           1842 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-2] | 2018-11-06 08:31:23.878000 | xx.yy.zz.51 |           1877 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:31:23.878001 | xx.yy.zz.51 |           1958 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-4] | 2018-11-06 08:31:23.878001 | xx.yy.zz.51 |           2154 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-4] | 2018-11-06 08:31:23.878001 | xx.yy.zz.51 |           2205 | xx.yy.zz.51
                                                               Skipped 2/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-4] | 2018-11-06 08:31:23.879000 | xx.yy.zz.51 |           2259 | xx.yy.zz.51
                                                                                                  Read 0 live rows and 0 tombstone cells [ReadStage-4] | 2018-11-06 08:31:23.879000 | xx.yy.zz.51 |           2300 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-6] | 2018-11-06 08:31:23.879000 | xx.yy.zz.51 |           2550 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-6] | 2018-11-06 08:31:23.879000 | xx.yy.zz.51 |           2594 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-6] | 2018-11-06 08:31:23.879000 | xx.yy.zz.51 |           2630 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-6] | 2018-11-06 08:31:23.879000 | xx.yy.zz.51 |           2664 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-6] | 2018-11-06 08:31:23.879001 | xx.yy.zz.51 |           2744 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-3] | 2018-11-06 08:31:23.879001 | xx.yy.zz.51 |           2965 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:31:23.879001 | xx.yy.zz.51 |           3013 | xx.yy.zz.51
                                                               Skipped 2/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-3] | 2018-11-06 08:31:23.879001 | xx.yy.zz.51 |           3051 | xx.yy.zz.51
                                                                                                  Read 0 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:31:23.879001 | xx.yy.zz.51 |           3084 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-2] | 2018-11-06 08:31:23.880000 | xx.yy.zz.51 |           3248 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-2] | 2018-11-06 08:31:23.880000 | xx.yy.zz.51 |           3277 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-2] | 2018-11-06 08:31:23.880000 | xx.yy.zz.51 |           3293 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-2] | 2018-11-06 08:31:23.880000 | xx.yy.zz.51 |           3318 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:31:23.880000 | xx.yy.zz.51 |           3376 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-4] | 2018-11-06 08:31:23.880000 | xx.yy.zz.51 |           3562 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-4] | 2018-11-06 08:31:23.880001 | xx.yy.zz.51 |           3595 | xx.yy.zz.51
                                                               Skipped 0/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-4] | 2018-11-06 08:31:23.880001 | xx.yy.zz.51 |           3626 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-4] | 2018-11-06 08:31:23.880001 | xx.yy.zz.51 |           3690 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 2 [ReadStage-4] | 2018-11-06 08:31:23.880001 | xx.yy.zz.51 |           3738 | xx.yy.zz.51
                                                                                               Merged data from memtables and 2 sstables [ReadStage-4] | 2018-11-06 08:31:23.880001 | xx.yy.zz.51 |           3818 | xx.yy.zz.51
                                                                                speculating read retry on /xx.yy.zz.53 [Native-Transport-Requests-1] | 2018-11-06 08:31:23.880001 | xx.yy.zz.51 |           3849 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-4] | 2018-11-06 08:31:23.880001 | xx.yy.zz.51 |           3859 | xx.yy.zz.51
                                           Sending READ message to host3_priv/xx.yy.zz.53 [MessagingService-Outgoing-host3_priv/xx.yy.zz.53-Small] | 2018-11-06 08:31:23.881000 | xx.yy.zz.51 |           4237 | xx.yy.zz.51
                                                                                       Determining replicas for mutation [Native-Transport-Requests-1] | 2018-11-06 08:31:23.881000 | xx.yy.zz.51 |           4349 | xx.yy.zz.51
                                                                                                      Acquiring counter locks [CounterMutationStage-4] | 2018-11-06 08:31:23.881000 | xx.yy.zz.51 |           4491 | xx.yy.zz.51
                                                                                         Fetching 1 counter values from cache [CounterMutationStage-4] | 2018-11-06 08:31:23.881001 | xx.yy.zz.51 |           4579 | xx.yy.zz.51
                                                                                                       Appending to commitlog [CounterMutationStage-4] | 2018-11-06 08:31:23.881001 | xx.yy.zz.51 |           4678 | xx.yy.zz.51
                                                                                           Adding to counterTable memtable [CounterMutationStage-4] | 2018-11-06 08:31:23.881001 | xx.yy.zz.51 |           4718 | xx.yy.zz.51
                                                                   Not hinting /xx.yy.zz.52 which has been down 14302254 ms [CounterMutationStage-4] | 2018-11-06 08:31:23.881001 | xx.yy.zz.51 |           4905 | xx.yy.zz.51
                                       Sending MUTATION message to host3_priv/xx.yy.zz.53 [MessagingService-Outgoing-host3_priv/xx.yy.zz.53-Small] | 2018-11-06 08:31:23.883000 | xx.yy.zz.51 |             -- | xx.yy.zz.51
                                                                                                                                      Request complete | 2018-11-06 08:31:23.880886 | xx.yy.zz.51 |           4886 | xx.yy.zz.51


vs@cqlsh:ks> TRACING OFF ;
Disabled Tracing.
vs@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |     0

(1 rows)

===============================================================================================================================CORRECT UPDATE =======================================================================
vs@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |     0

(1 rows)
vs@cqlsh:ks> UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count';
vs@cqlsh:ks> tracing on;
Now Tracing is enabled
vs@cqlsh:ks> UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count';

Tracing session: 07608f00-e197-11e8-88e0-913c16841bd0

 activity                                                                                                                                              | timestamp                  | source        | source_elapsed | client
-------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------+---------------+----------------+---------------
                                                                                                                                    Execute CQL3 query | 2018-11-06 08:39:01.488000 | xx.yy.zz.51 |              0 | xx.yy.zz.51
 Parsing UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count'; [Native-Transport-Requests-1] | 2018-11-06 08:39:01.489000 | xx.yy.zz.51 |            346 | xx.yy.zz.51
                                                                                                     Preparing statement [Native-Transport-Requests-1] | 2018-11-06 08:39:01.489000 | xx.yy.zz.51 |            584 | xx.yy.zz.51
 Parsing UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count'; [Native-Transport-Requests-1] | 2018-11-06 08:39:01.489000 | xx.yy.zz.51 |            818 | xx.yy.zz.51
                                                                                                     Preparing statement [Native-Transport-Requests-1] | 2018-11-06 08:39:01.489000 | xx.yy.zz.51 |            914 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-2] | 2018-11-06 08:39:01.489000 | xx.yy.zz.51 |           1092 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-2] | 2018-11-06 08:39:01.490000 | xx.yy.zz.51 |           1247 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-2] | 2018-11-06 08:39:01.490000 | xx.yy.zz.51 |           1271 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-2] | 2018-11-06 08:39:01.490000 | xx.yy.zz.51 |           1308 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:39:01.490000 | xx.yy.zz.51 |           1442 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-2] | 2018-11-06 08:39:01.490000 | xx.yy.zz.51 |           1577 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-2] | 2018-11-06 08:39:01.490000 | xx.yy.zz.51 |           1684 | xx.yy.zz.51
                                                               Skipped 2/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-2] | 2018-11-06 08:39:01.490000 | xx.yy.zz.51 |           1720 | xx.yy.zz.51
                                                                                                  Read 0 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:39:01.490001 | xx.yy.zz.51 |           1751 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-3] | 2018-11-06 08:39:01.490001 | xx.yy.zz.51 |           1875 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:39:01.490001 | xx.yy.zz.51 |           1922 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-3] | 2018-11-06 08:39:01.490001 | xx.yy.zz.51 |           1943 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-3] | 2018-11-06 08:39:01.490001 | xx.yy.zz.51 |           1974 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:39:01.490001 | xx.yy.zz.51 |           2045 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-3] | 2018-11-06 08:39:01.490001 | xx.yy.zz.51 |           2168 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:39:01.491000 | xx.yy.zz.51 |           2191 | xx.yy.zz.51
                                                               Skipped 2/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-3] | 2018-11-06 08:39:01.491000 | xx.yy.zz.51 |           2218 | xx.yy.zz.51
                                                                                                  Read 0 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:39:01.491000 | xx.yy.zz.51 |           2245 | xx.yy.zz.51
                                                                                       Determining replicas for mutation [Native-Transport-Requests-1] | 2018-11-06 08:39:01.491000 | xx.yy.zz.51 |           2377 | xx.yy.zz.51
                                                                                                      Acquiring counter locks [CounterMutationStage-2] | 2018-11-06 08:39:01.491000 | xx.yy.zz.51 |           2459 | xx.yy.zz.51
                                                                                         Fetching 1 counter values from cache [CounterMutationStage-2] | 2018-11-06 08:39:01.491000 | xx.yy.zz.51 |           2603 | xx.yy.zz.51
                                                                                                       Appending to commitlog [CounterMutationStage-2] | 2018-11-06 08:39:01.491001 | xx.yy.zz.51 |           2673 | xx.yy.zz.51
                                                                                           Adding to counterTable memtable [CounterMutationStage-2] | 2018-11-06 08:39:01.491001 | xx.yy.zz.51 |           2758 | xx.yy.zz.51
                                                                   Not hinting /xx.yy.zz.52 which has been down 14759864 ms [CounterMutationStage-2] | 2018-11-06 08:39:01.491001 | xx.yy.zz.51 |           2990 | xx.yy.zz.51
                                                              MUTATION message received from /xx.yy.zz.51 [MessagingService-Incoming-/xx.yy.zz.51] | 2018-11-06 08:39:01.492000 | xx.yy.zz.53 |             21 | xx.yy.zz.51
                                                                                                          Appending to commitlog [SharedPool-Worker-1] | 2018-11-06 08:39:01.492000 | xx.yy.zz.53 |            387 | xx.yy.zz.51
                                                      REQUEST_RESPONSE message received from /xx.yy.zz.53 [MessagingService-Incoming-/xx.yy.zz.53] | 2018-11-06 08:39:01.493000 | xx.yy.zz.51 |             51 | xx.yy.zz.51
                                                                                              Adding to counterTable memtable [SharedPool-Worker-1] | 2018-11-06 08:39:01.493000 | xx.yy.zz.53 |            495 | xx.yy.zz.51
                                                                                      Processing response from /xx.yy.zz.53 [RequestResponseStage-1] | 2018-11-06 08:39:01.493000 | xx.yy.zz.51 |            110 | xx.yy.zz.51
                                                                                            Enqueuing response to /xx.yy.zz.51 [SharedPool-Worker-1] | 2018-11-06 08:39:01.493000 | xx.yy.zz.53 |            627 | xx.yy.zz.51
                                                         Sending REQUEST_RESPONSE message to /xx.yy.zz.51 [MessagingService-Outgoing-/xx.yy.zz.51] | 2018-11-06 08:39:01.493000 | xx.yy.zz.53 |            668 | xx.yy.zz.51
                                       Sending MUTATION message to host3_priv/xx.yy.zz.53 [MessagingService-Outgoing-host3_priv/xx.yy.zz.53-Small] | 2018-11-06 08:39:01.502000 | xx.yy.zz.51 |             -- | xx.yy.zz.51
                                                                                                                                      Request complete | 2018-11-06 08:39:01.491085 | xx.yy.zz.51 |           3085 | xx.yy.zz.51


vs@cqlsh:ks> TRACING OFF ;
Disabled Tracing.
vs@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |   100

(1 rows)
vs@cqlsh:ks>
================================================ ===============================================INCORRECT UPDATE ============================================================================

user@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |     0

(1 rows)
user@cqlsh:ks> tracing on;
Now Tracing is enabled
user@cqlsh:ks> UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count';

Tracing session: 19333350-e196-11e8-88e0-913c16841bd0

 activity                                                                                                                                              | timestamp                  | source        | source_elapsed | client
-------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------+---------------+----------------+---------------
                                                                                                                                    Execute CQL3 query | 2018-11-06 08:32:21.894000 | xx.yy.zz.51 |              0 | xx.yy.zz.51
 Parsing UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count'; [Native-Transport-Requests-1] | 2018-11-06 08:32:21.894000 | xx.yy.zz.51 |            136 | xx.yy.zz.51
                                                                                                     Preparing statement [Native-Transport-Requests-1] | 2018-11-06 08:32:21.894000 | xx.yy.zz.51 |            341 | xx.yy.zz.51
 Parsing UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count'; [Native-Transport-Requests-1] | 2018-11-06 08:32:21.894000 | xx.yy.zz.51 |            544 | xx.yy.zz.51
                                                                                                     Preparing statement [Native-Transport-Requests-1] | 2018-11-06 08:32:21.894000 | xx.yy.zz.51 |            637 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-3] | 2018-11-06 08:32:21.894000 | xx.yy.zz.51 |            848 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:32:21.894000 | xx.yy.zz.51 |            907 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-3] | 2018-11-06 08:32:21.894001 | xx.yy.zz.51 |            933 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-3] | 2018-11-06 08:32:21.894001 | xx.yy.zz.51 |            976 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:32:21.895000 | xx.yy.zz.51 |           1095 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-2] | 2018-11-06 08:32:21.895000 | xx.yy.zz.51 |           1294 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-2] | 2018-11-06 08:32:21.895000 | xx.yy.zz.51 |           1346 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-2] | 2018-11-06 08:32:21.895000 | xx.yy.zz.51 |           1373 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-2] | 2018-11-06 08:32:21.895000 | xx.yy.zz.51 |           1407 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:32:21.895000 | xx.yy.zz.51 |           1476 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-3] | 2018-11-06 08:32:21.895001 | xx.yy.zz.51 |           1630 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:32:21.895001 | xx.yy.zz.51 |           1669 | xx.yy.zz.51
                                                               Skipped 2/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-3] | 2018-11-06 08:32:21.895001 | xx.yy.zz.51 |           1704 | xx.yy.zz.51
                                                                                                  Read 0 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:32:21.895001 | xx.yy.zz.51 |           1740 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-3] | 2018-11-06 08:32:21.895001 | xx.yy.zz.51 |           1856 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:32:21.895001 | xx.yy.zz.51 |           1881 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-3] | 2018-11-06 08:32:21.895001 | xx.yy.zz.51 |           1898 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-3] | 2018-11-06 08:32:21.895001 | xx.yy.zz.51 |           1922 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:32:21.896000 | xx.yy.zz.51 |           1995 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-3] | 2018-11-06 08:32:21.896000 | xx.yy.zz.51 |           2098 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:32:21.896000 | xx.yy.zz.51 |           2124 | xx.yy.zz.51
                                                               Skipped 2/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-3] | 2018-11-06 08:32:21.896000 | xx.yy.zz.51 |           2152 | xx.yy.zz.51
                                                                                                  Read 0 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:32:21.896000 | xx.yy.zz.51 |           2184 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-3] | 2018-11-06 08:32:21.896000 | xx.yy.zz.51 |           2268 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:32:21.896001 | xx.yy.zz.51 |           2295 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-3] | 2018-11-06 08:32:21.896001 | xx.yy.zz.51 |           2325 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-3] | 2018-11-06 08:32:21.896001 | xx.yy.zz.51 |           2353 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:32:21.896001 | xx.yy.zz.51 |           2410 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-2] | 2018-11-06 08:32:21.896001 | xx.yy.zz.51 |           2554 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-2] | 2018-11-06 08:32:21.896001 | xx.yy.zz.51 |           2587 | xx.yy.zz.51
                                                               Skipped 0/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-2] | 2018-11-06 08:32:21.896001 | xx.yy.zz.51 |           2622 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-2] | 2018-11-06 08:32:21.896001 | xx.yy.zz.51 |           2668 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 2 [ReadStage-2] | 2018-11-06 08:32:21.896001 | xx.yy.zz.51 |           2709 | xx.yy.zz.51
                                                                                               Merged data from memtables and 2 sstables [ReadStage-2] | 2018-11-06 08:32:21.896002 | xx.yy.zz.51 |           2783 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:32:21.896002 | xx.yy.zz.51 |           2816 | xx.yy.zz.51
                                                                                       Determining replicas for mutation [Native-Transport-Requests-1] | 2018-11-06 08:32:21.896002 | xx.yy.zz.51 |           2939 | xx.yy.zz.51
                                                                              Enqueuing counter update to /xx.yy.zz.53 [Native-Transport-Requests-1] | 2018-11-06 08:32:21.897000 | xx.yy.zz.51 |           3035 | xx.yy.zz.51
                                                      COUNTER_MUTATION message received from /xx.yy.zz.51 [MessagingService-Incoming-/xx.yy.zz.51] | 2018-11-06 08:32:21.897000 | xx.yy.zz.53 |             39 | xx.yy.zz.51
                               Sending COUNTER_MUTATION message to host3_priv/xx.yy.zz.53 [MessagingService-Outgoing-host3_priv/xx.yy.zz.53-Small] | 2018-11-06 08:32:21.897000 | xx.yy.zz.51 |           3265 | xx.yy.zz.51
                                                      REQUEST_RESPONSE message received from /xx.yy.zz.53 [MessagingService-Incoming-/xx.yy.zz.53] | 2018-11-06 08:32:21.898000 | xx.yy.zz.51 |           4592 | xx.yy.zz.51
                                                                                                       Acquiring 1 counter locks [SharedPool-Worker-1] | 2018-11-06 08:32:21.898000 | xx.yy.zz.53 |            235 | xx.yy.zz.51
                                                              MUTATION message received from /xx.yy.zz.53 [MessagingService-Incoming-/xx.yy.zz.53] | 2018-11-06 08:32:21.898000 | xx.yy.zz.51 |           4682 | xx.yy.zz.51
                                                                                      Processing response from /xx.yy.zz.53 [RequestResponseStage-3] | 2018-11-06 08:32:21.898000 | xx.yy.zz.51 |           4683 | xx.yy.zz.51
                                                                                                              Appending to commitlog [MutationStage-3] | 2018-11-06 08:32:21.898000 | xx.yy.zz.51 |           4802 | xx.yy.zz.51
                                                                                                  Adding to counterTable memtable [MutationStage-3] | 2018-11-06 08:32:21.898000 | xx.yy.zz.51 |           4895 | xx.yy.zz.51
                                                                                                Enqueuing response to /xx.yy.zz.53 [MutationStage-3] | 2018-11-06 08:32:21.899000 | xx.yy.zz.51 |           4975 | xx.yy.zz.51
                                                                                            Fetching 1 counter values from cache [SharedPool-Worker-1] | 2018-11-06 08:32:21.899000 | xx.yy.zz.53 |            337 | xx.yy.zz.51
                               Sending REQUEST_RESPONSE message to host3_priv/xx.yy.zz.53 [MessagingService-Outgoing-host3_priv/xx.yy.zz.53-Small] | 2018-11-06 08:32:21.899000 | xx.yy.zz.51 |             -- | xx.yy.zz.51
                                                                                                          Appending to commitlog [SharedPool-Worker-1] | 2018-11-06 08:32:21.899000 | xx.yy.zz.53 |            384 | xx.yy.zz.51
                                                                                              Adding to counterTable memtable [SharedPool-Worker-1] | 2018-11-06 08:32:21.900000 | xx.yy.zz.53 |            495 | xx.yy.zz.51
                                                         Sending REQUEST_RESPONSE message to /xx.yy.zz.51 [MessagingService-Outgoing-/xx.yy.zz.51] | 2018-11-06 08:32:21.900000 | xx.yy.zz.53 |            723 | xx.yy.zz.51
                                                                       Not hinting /xx.yy.zz.52 which has been down 82854172ms [SharedPool-Worker-1] | 2018-11-06 08:32:21.901000 | xx.yy.zz.53 |            748 | xx.yy.zz.51
                                                                 Sending MUTATION message to /xx.yy.zz.51 [MessagingService-Outgoing-/xx.yy.zz.51] | 2018-11-06 08:32:21.901000 | xx.yy.zz.53 |             -- | xx.yy.zz.51
                                                      REQUEST_RESPONSE message received from /xx.yy.zz.51 [MessagingService-Incoming-/xx.yy.zz.51] | 2018-11-06 08:32:21.901000 | xx.yy.zz.53 |             -- | xx.yy.zz.51
                                                                                         Processing response from /xx.yy.zz.51 [SharedPool-Worker-2] | 2018-11-06 08:32:21.902000 | xx.yy.zz.53 |             -- | xx.yy.zz.51
                                                                                                                                      Request complete | 2018-11-06 08:32:21.898764 | xx.yy.zz.51 |           4764 | xx.yy.zz.51


user@cqlsh:ks> TRACING OFF ;
Disabled Tracing.
user@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |     0

(1 rows)
user@cqlsh:ks>



======================================================================================================INCORRECT UPDATE =============================================================================

user@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |     0

(1 rows)
user@cqlsh:ks> tracing on;
Now Tracing is enabled
user@cqlsh:ks> UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count';

Tracing session: e6092370-e197-11e8-88e0-913c16841bd0

 activity                                                                                                                                              | timestamp                  | source        | source_elapsed | client
-------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------+---------------+----------------+---------------
                                                                                                                                    Execute CQL3 query | 2018-11-06 08:45:15.047000 | xx.yy.zz.51 |              0 | xx.yy.zz.51
 Parsing UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count'; [Native-Transport-Requests-1] | 2018-11-06 08:45:15.047000 | xx.yy.zz.51 |            154 | xx.yy.zz.51
                                                                                                     Preparing statement [Native-Transport-Requests-1] | 2018-11-06 08:45:15.048000 | xx.yy.zz.51 |            393 | xx.yy.zz.51
 Parsing UPDATE "counterTable" SET value = value + 100 WHERE key = 'key1' AND column1 = 'count'; [Native-Transport-Requests-1] | 2018-11-06 08:45:15.048000 | xx.yy.zz.51 |            561 | xx.yy.zz.51
                                                                                                     Preparing statement [Native-Transport-Requests-1] | 2018-11-06 08:45:15.048000 | xx.yy.zz.51 |            672 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-2] | 2018-11-06 08:45:15.048000 | xx.yy.zz.51 |            882 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-2] | 2018-11-06 08:45:15.048000 | xx.yy.zz.51 |            919 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-2] | 2018-11-06 08:45:15.048000 | xx.yy.zz.51 |            935 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-2] | 2018-11-06 08:45:15.048001 | xx.yy.zz.51 |            969 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:45:15.048001 | xx.yy.zz.51 |           1071 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-3] | 2018-11-06 08:45:15.048001 | xx.yy.zz.51 |           1213 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:45:15.048001 | xx.yy.zz.51 |           1245 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-3] | 2018-11-06 08:45:15.048001 | xx.yy.zz.51 |           1262 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-3] | 2018-11-06 08:45:15.048001 | xx.yy.zz.51 |           1285 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:45:15.049000 | xx.yy.zz.51 |           1364 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-3] | 2018-11-06 08:45:15.049000 | xx.yy.zz.51 |           1488 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:45:15.049000 | xx.yy.zz.51 |           1504 | xx.yy.zz.51
                                                               Skipped 2/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-3] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           1532 | xx.yy.zz.51
                                                                                                  Read 0 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           1581 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-2] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           1736 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-2] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           1776 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-2] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           1789 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-2] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           1808 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           1855 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-3] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           1950 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-3] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           1966 | xx.yy.zz.51
                                                               Skipped 2/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-3] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           1983 | xx.yy.zz.51
                                                                                                  Read 0 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           2003 | xx.yy.zz.51
                                                                                               Executing single-partition query on users [ReadStage-2] | 2018-11-06 08:45:15.049001 | xx.yy.zz.51 |           2132 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-2] | 2018-11-06 08:45:15.049002 | xx.yy.zz.51 |           2151 | xx.yy.zz.51
                                                                                                               Merging memtable contents [ReadStage-2] | 2018-11-06 08:45:15.049002 | xx.yy.zz.51 |           2160 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-2] | 2018-11-06 08:45:15.049002 | xx.yy.zz.51 |           2182 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:45:15.049002 | xx.yy.zz.51 |           2225 | xx.yy.zz.51
                                                                                    Executing single-partition query on role_permissions [ReadStage-2] | 2018-11-06 08:45:15.050000 | xx.yy.zz.51 |           2340 | xx.yy.zz.51
                                                                                                            Acquiring sstable references [ReadStage-2] | 2018-11-06 08:45:15.050000 | xx.yy.zz.51 |           2355 | xx.yy.zz.51
                                                               Skipped 0/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-2] | 2018-11-06 08:45:15.050000 | xx.yy.zz.51 |           2395 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 1 [ReadStage-2] | 2018-11-06 08:45:15.050000 | xx.yy.zz.51 |           2436 | xx.yy.zz.51
                                                                                                             Key cache hit for sstable 2 [ReadStage-2] | 2018-11-06 08:45:15.050000 | xx.yy.zz.51 |           2468 | xx.yy.zz.51
                                                                                               Merged data from memtables and 2 sstables [ReadStage-2] | 2018-11-06 08:45:15.050000 | xx.yy.zz.51 |           2530 | xx.yy.zz.51
                                                                                                  Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:45:15.050001 | xx.yy.zz.51 |           2552 | xx.yy.zz.51
                                                                                       Determining replicas for mutation [Native-Transport-Requests-1] | 2018-11-06 08:45:15.050001 | xx.yy.zz.51 |           2700 | xx.yy.zz.51
                                                                              Enqueuing counter update to /xx.yy.zz.53 [Native-Transport-Requests-1] | 2018-11-06 08:45:15.050001 | xx.yy.zz.51 |           2813 | xx.yy.zz.51
                               Sending COUNTER_MUTATION message to host3_priv/xx.yy.zz.53 [MessagingService-Outgoing-host3_priv/xx.yy.zz.53-Small] | 2018-11-06 08:45:15.050001 | xx.yy.zz.51 |           2960 | xx.yy.zz.51
                                                      REQUEST_RESPONSE message received from /xx.yy.zz.53 [MessagingService-Incoming-/xx.yy.zz.53] | 2018-11-06 08:45:15.051000 | xx.yy.zz.51 |           3798 | xx.yy.zz.51
                                                      COUNTER_MUTATION message received from /xx.yy.zz.51 [MessagingService-Incoming-/xx.yy.zz.51] | 2018-11-06 08:45:15.051000 | xx.yy.zz.53 |             24 | xx.yy.zz.51
                                                                                      Processing response from /xx.yy.zz.53 [RequestResponseStage-2] | 2018-11-06 08:45:15.051000 | xx.yy.zz.51 |           3834 | xx.yy.zz.51
                                                                                                       Acquiring 1 counter locks [SharedPool-Worker-1] | 2018-11-06 08:45:15.051000 | xx.yy.zz.53 |            130 | xx.yy.zz.51
                                                                                            Fetching 1 counter values from cache [SharedPool-Worker-1] | 2018-11-06 08:45:15.051000 | xx.yy.zz.53 |            209 | xx.yy.zz.51
                                                                                                          Appending to commitlog [SharedPool-Worker-1] | 2018-11-06 08:45:15.051000 | xx.yy.zz.53 |            256 | xx.yy.zz.51
                                                                                              Adding to counterTable memtable [SharedPool-Worker-1] | 2018-11-06 08:45:15.051000 | xx.yy.zz.53 |            279 | xx.yy.zz.51
                                                         Sending REQUEST_RESPONSE message to /xx.yy.zz.51 [MessagingService-Outgoing-/xx.yy.zz.51] | 2018-11-06 08:45:15.051000 | xx.yy.zz.53 |            479 | xx.yy.zz.51
                                                                 Sending MUTATION message to /xx.yy.zz.51 [MessagingService-Outgoing-/xx.yy.zz.51] | 2018-11-06 08:45:15.051001 | xx.yy.zz.53 |             -- | xx.yy.zz.51
                                                                       Not hinting /xx.yy.zz.52 which has been down 83627325ms [SharedPool-Worker-1] | 2018-11-06 08:45:15.051001 | xx.yy.zz.53 |            720 | xx.yy.zz.51
                                                              MUTATION message received from /xx.yy.zz.53 [MessagingService-Incoming-/xx.yy.zz.53] | 2018-11-06 08:45:15.052000 | xx.yy.zz.51 |             24 | xx.yy.zz.51
                                                                                                              Appending to commitlog [MutationStage-1] | 2018-11-06 08:45:15.052000 | xx.yy.zz.51 |             77 | xx.yy.zz.51
                                                                                                  Adding to counterTable memtable [MutationStage-1] | 2018-11-06 08:45:15.052000 | xx.yy.zz.51 |            179 | xx.yy.zz.51
                                                                                                Enqueuing response to /xx.yy.zz.53 [MutationStage-1] | 2018-11-06 08:45:15.052000 | xx.yy.zz.51 |            276 | xx.yy.zz.51
                               Sending REQUEST_RESPONSE message to host3_priv/xx.yy.zz.53 [MessagingService-Outgoing-host3_priv/xx.yy.zz.53-Small] | 2018-11-06 08:45:15.052000 | xx.yy.zz.51 |            384 | xx.yy.zz.51
                                                      REQUEST_RESPONSE message received from /xx.yy.zz.51 [MessagingService-Incoming-/xx.yy.zz.51] | 2018-11-06 08:45:15.053000 | xx.yy.zz.53 |             -- | xx.yy.zz.51
                                                                                         Processing response from /xx.yy.zz.51 [SharedPool-Worker-1] | 2018-11-06 08:45:15.053000 | xx.yy.zz.53 |             -- | xx.yy.zz.51
                                                                                                                                      Request complete | 2018-11-06 08:45:15.050878 | xx.yy.zz.51 |           3878 | xx.yy.zz.51


user@cqlsh:ks> select * from "counterTable";

 key              | column1        | value
------------------+----------------+-------
 key1 | count |     0

(1 rows)

Tracing session: e865ff30-e197-11e8-88e0-913c16841bd0

 activity                                                                                                                      | timestamp                  | source        | source_elapsed | client
-------------------------------------------------------------------------------------------------------------------------------+----------------------------+---------------+----------------+---------------
                                                                                                            Execute CQL3 query | 2018-11-06 08:45:19.011000 | xx.yy.zz.51 |              0 | xx.yy.zz.51
                                                        Parsing select * from "counterTable"; [Native-Transport-Requests-1] | 2018-11-06 08:45:19.011000 | xx.yy.zz.51 |            125 | xx.yy.zz.51
                                                                             Preparing statement [Native-Transport-Requests-1] | 2018-11-06 08:45:19.011000 | xx.yy.zz.51 |            214 | xx.yy.zz.51
                                                        Parsing select * from "counterTable"; [Native-Transport-Requests-1] | 2018-11-06 08:45:19.012000 | xx.yy.zz.51 |            343 | xx.yy.zz.51
                                                                             Preparing statement [Native-Transport-Requests-1] | 2018-11-06 08:45:19.012000 | xx.yy.zz.51 |            383 | xx.yy.zz.51
                                                                       Executing single-partition query on users [ReadStage-3] | 2018-11-06 08:45:19.012000 | xx.yy.zz.51 |            553 | xx.yy.zz.51
                                                                                    Acquiring sstable references [ReadStage-3] | 2018-11-06 08:45:19.012000 | xx.yy.zz.51 |            579 | xx.yy.zz.51
                                                                                       Merging memtable contents [ReadStage-3] | 2018-11-06 08:45:19.012000 | xx.yy.zz.51 |            595 | xx.yy.zz.51
                                                                                     Key cache hit for sstable 1 [ReadStage-3] | 2018-11-06 08:45:19.012000 | xx.yy.zz.51 |            642 | xx.yy.zz.51
                                                                          Read 1 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:45:19.012001 | xx.yy.zz.51 |            752 | xx.yy.zz.51
                                                                       Executing single-partition query on users [ReadStage-3] | 2018-11-06 08:45:19.012001 | xx.yy.zz.51 |            897 | xx.yy.zz.51
                                                                                    Acquiring sstable references [ReadStage-3] | 2018-11-06 08:45:19.012001 | xx.yy.zz.51 |            915 | xx.yy.zz.51
                                                                                       Merging memtable contents [ReadStage-3] | 2018-11-06 08:45:19.012001 | xx.yy.zz.51 |            927 | xx.yy.zz.51
                                                                                     Key cache hit for sstable 1 [ReadStage-3] | 2018-11-06 08:45:19.012001 | xx.yy.zz.51 |            945 | xx.yy.zz.51
                                                                          Read 1 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:45:19.012001 | xx.yy.zz.51 |            992 | xx.yy.zz.51
                                                            Executing single-partition query on role_permissions [ReadStage-4] | 2018-11-06 08:45:19.012001 | xx.yy.zz.51 |           1128 | xx.yy.zz.51
                                                                                    Acquiring sstable references [ReadStage-4] | 2018-11-06 08:45:19.012001 | xx.yy.zz.51 |           1168 | xx.yy.zz.51
                                       Skipped 2/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-4] | 2018-11-06 08:45:19.012002 | xx.yy.zz.51 |           1201 | xx.yy.zz.51
                                                                          Read 0 live rows and 0 tombstone cells [ReadStage-4] | 2018-11-06 08:45:19.012002 | xx.yy.zz.51 |           1236 | xx.yy.zz.51
                                                                       Executing single-partition query on users [ReadStage-5] | 2018-11-06 08:45:19.013000 | xx.yy.zz.51 |           1341 | xx.yy.zz.51
                                                                                    Acquiring sstable references [ReadStage-5] | 2018-11-06 08:45:19.013000 | xx.yy.zz.51 |           1382 | xx.yy.zz.51
                                                                                       Merging memtable contents [ReadStage-5] | 2018-11-06 08:45:19.013000 | xx.yy.zz.51 |           1404 | xx.yy.zz.51
                                                                                     Key cache hit for sstable 1 [ReadStage-5] | 2018-11-06 08:45:19.013000 | xx.yy.zz.51 |           1430 | xx.yy.zz.51
                                                                          Read 1 live rows and 0 tombstone cells [ReadStage-5] | 2018-11-06 08:45:19.013000 | xx.yy.zz.51 |           1511 | xx.yy.zz.51
                                                            Executing single-partition query on role_permissions [ReadStage-5] | 2018-11-06 08:45:19.013000 | xx.yy.zz.51 |           1613 | xx.yy.zz.51
                                                                                    Acquiring sstable references [ReadStage-5] | 2018-11-06 08:45:19.013000 | xx.yy.zz.51 |           1651 | xx.yy.zz.51
                                       Skipped 2/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-5] | 2018-11-06 08:45:19.013001 | xx.yy.zz.51 |           1680 | xx.yy.zz.51
                                                                          Read 0 live rows and 0 tombstone cells [ReadStage-5] | 2018-11-06 08:45:19.013001 | xx.yy.zz.51 |           1719 | xx.yy.zz.51
                                                                       Executing single-partition query on users [ReadStage-2] | 2018-11-06 08:45:19.013001 | xx.yy.zz.51 |           1805 | xx.yy.zz.51
                                                                                    Acquiring sstable references [ReadStage-2] | 2018-11-06 08:45:19.013001 | xx.yy.zz.51 |           1835 | xx.yy.zz.51
                                                                                       Merging memtable contents [ReadStage-2] | 2018-11-06 08:45:19.013001 | xx.yy.zz.51 |           1853 | xx.yy.zz.51
                                                                                     Key cache hit for sstable 1 [ReadStage-2] | 2018-11-06 08:45:19.013001 | xx.yy.zz.51 |           1875 | xx.yy.zz.51
                                                                          Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:45:19.013001 | xx.yy.zz.51 |           1949 | xx.yy.zz.51
                                                            Executing single-partition query on role_permissions [ReadStage-3] | 2018-11-06 08:45:19.013001 | xx.yy.zz.51 |           2052 | xx.yy.zz.51
                                                                                    Acquiring sstable references [ReadStage-3] | 2018-11-06 08:45:19.013002 | xx.yy.zz.51 |           2075 | xx.yy.zz.51
                                       Skipped 0/2 non-slice-intersecting sstables, included 0 due to tombstones [ReadStage-3] | 2018-11-06 08:45:19.013002 | xx.yy.zz.51 |           2098 | xx.yy.zz.51
                                                                                     Key cache hit for sstable 1 [ReadStage-3] | 2018-11-06 08:45:19.013002 | xx.yy.zz.51 |           2134 | xx.yy.zz.51
                                                                                     Key cache hit for sstable 2 [ReadStage-3] | 2018-11-06 08:45:19.013002 | xx.yy.zz.51 |           2168 | xx.yy.zz.51
                                                                       Merged data from memtables and 2 sstables [ReadStage-3] | 2018-11-06 08:45:19.013002 | xx.yy.zz.51 |           2233 | xx.yy.zz.51
                                                                          Read 1 live rows and 0 tombstone cells [ReadStage-3] | 2018-11-06 08:45:19.013002 | xx.yy.zz.51 |           2254 | xx.yy.zz.51
                                                                       Computing ranges to query [Native-Transport-Requests-1] | 2018-11-06 08:45:19.014000 | xx.yy.zz.51 |           2437 | xx.yy.zz.51
 Submitting range requests on 769 ranges with a concurrency of 112 (0.9 rows per range expected) [Native-Transport-Requests-1] | 2018-11-06 08:45:19.014000 | xx.yy.zz.51 |           2859 | xx.yy.zz.51
                                                           Submitted 1 concurrent range requests [Native-Transport-Requests-1] | 2018-11-06 08:45:19.015000 | xx.yy.zz.51 |           3441 | xx.yy.zz.51
                 Executing seq scan across 3 sstables for (min(-9223372036854775808), min(-9223372036854775808)] [ReadStage-2] | 2018-11-06 08:45:19.015000 | xx.yy.zz.51 |           3527 | xx.yy.zz.51
                                                                          Read 1 live rows and 0 tombstone cells [ReadStage-2] | 2018-11-06 08:45:19.015000 | xx.yy.zz.51 |           3759 | xx.yy.zz.51
                                                                                                              Request complete | 2018-11-06 08:45:19.014863 | xx.yy.zz.51 |           3863 | xx.yy.zz.51


user@cqlsh:ks>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@xxxxxxxxxxxxxxxxxxxx
For additional commands, e-mail: user-help@xxxxxxxxxxxxxxxxxxxx