You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-18 - 19:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot3.osadl.org (updated Wed Jun 18, 2025 12:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
91232233171,21sleep20-21swapper/207:08:112
90622212173,28sleep00-21swapper/007:07:250
89422208174,23sleep30-21swapper/307:05:513
91992201168,22sleep10-21swapper/107:09:111
9726996813,19cyclictest2067-21cat09:10:002
9727996329,4cyclictest41-21ksoftirqd/309:00:003
972699613,22cyclictest0-21swapper/210:23:432
972699605,20cyclictest322792chrt11:19:122
972699605,20cyclictest322792chrt11:19:122
972699584,22cyclictest6549-21taskset09:15:432
972699561,3cyclictest0-21swapper/209:56:072
972699540,4cyclictest23269-21cpuspeed_turbos11:00:142
256872540,3sleep0972499cyclictest08:50:190
9727995321,4cyclictest41-21ksoftirqd/311:45:003
9727995220,7cyclictest41-21ksoftirqd/309:10:013
9727995123,8cyclictest41-21ksoftirqd/310:12:383
9727995121,4cyclictest41-21ksoftirqd/310:05:003
9727995021,4cyclictest41-21ksoftirqd/308:14:593
972699498,19cyclictest22657-21runrttasks08:45:102
972799484,2cyclictest121rcu_preempt10:20:463
9727994818,5cyclictest41-21ksoftirqd/308:40:153
9727994815,8cyclictest41-21ksoftirqd/309:00:263
972699480,3cyclictest0-21swapper/210:27:042
51302480,1sleep30-21swapper/308:05:293
9727994735,3cyclictest59298rtkit-daemon11:56:063
9727994719,8cyclictest41-21ksoftirqd/308:45:183
9727994715,8cyclictest41-21ksoftirqd/308:30:253
9727994713,9cyclictest41-21ksoftirqd/310:20:003
9727994621,3cyclictest41-21ksoftirqd/309:50:163
9727994620,6cyclictest41-21ksoftirqd/310:50:143
9727994619,3cyclictest41-21ksoftirqd/308:35:153
9727994618,4cyclictest41-21ksoftirqd/310:45:243
9727994616,3cyclictest41-21ksoftirqd/311:05:193
9727994614,4cyclictest41-21ksoftirqd/311:30:013
9727994614,4cyclictest41-21ksoftirqd/311:25:013
9727994612,4cyclictest41-21ksoftirqd/310:40:273
972699461,3cyclictest7154-21/usr/sbin/munin09:20:262
136991460,1ptp4l401ktimersoftd/312:24:333
9727994515,4cyclictest41-21ksoftirqd/311:30:253
9727994511,5cyclictest41-21ksoftirqd/311:35:263
9727994420,2cyclictest41-21ksoftirqd/309:23:003
9727994416,4cyclictest41-21ksoftirqd/311:00:273
9727994415,7cyclictest41-21ksoftirqd/312:35:013
9727994415,4cyclictest41-21ksoftirqd/307:25:153
9727994414,4cyclictest41-21ksoftirqd/310:55:253
9727994414,4cyclictest41-21ksoftirqd/309:30:003
9727994413,4cyclictest41-21ksoftirqd/311:15:183
9727994413,4cyclictest41-21ksoftirqd/311:15:183
9727994412,4cyclictest41-21ksoftirqd/307:50:003
972699441,2cyclictest0-21swapper/211:34:432
972799434,4cyclictest41-21ksoftirqd/310:34:073
9727994315,4cyclictest41-21ksoftirqd/308:25:153
9727994315,4cyclictest41-21ksoftirqd/308:25:153
9727994314,3cyclictest41-21ksoftirqd/309:32:213
9727994313,4cyclictest41-21ksoftirqd/311:50:223
9727994313,4cyclictest41-21ksoftirqd/309:38:283
9727994313,3cyclictest41-21ksoftirqd/308:23:033
972799431,2cyclictest121rcu_preempt10:30:003
9727994213,7cyclictest41-21ksoftirqd/311:10:233
9727994211,4cyclictest41-21ksoftirqd/308:15:173
136991420,0ptp4l401ktimersoftd/308:50:463
972799417,4cyclictest41-21ksoftirqd/312:25:273
9727994115,3cyclictest41-21ksoftirqd/309:46:283
972799411,4cyclictest41-21ksoftirqd/309:41:273
972799411,4cyclictest41-21ksoftirqd/309:41:273
9727994114,3cyclictest41-21ksoftirqd/312:39:053
9727994114,3cyclictest41-21ksoftirqd/310:39:383
9727994113,3cyclictest41-21ksoftirqd/309:10:493
9727994113,3cyclictest41-21ksoftirqd/309:10:493
9727994112,4cyclictest41-21ksoftirqd/310:07:013
9727994112,4cyclictest41-21ksoftirqd/307:32:323
9727994112,3cyclictest41-21ksoftirqd/312:13:373
972699415,22cyclictest0-21swapper/207:33:582
972699413,24cyclictest0-21swapper/208:38:572
972699411,38cyclictest11399-21kworker/2:008:40:232
136991410,0ptp4l401ktimersoftd/309:59:433
9727994035,3cyclictest41-21ksoftirqd/307:55:003
972799403,4cyclictest41-21ksoftirqd/308:01:113
9727994030,2cyclictest121rcu_preempt07:40:273
9727994026,11cyclictest41-21ksoftirqd/311:45:203
972699404,23cyclictest0-21swapper/210:10:002
972699403,23cyclictest0-21swapper/212:00:402
972699401,37cyclictest3027-21kworker/2:211:51:272
136991400,0ptp4l401ktimersoftd/307:55:203
972799397,4cyclictest41-21ksoftirqd/307:15:183
972799396,5cyclictest41-21ksoftirqd/312:05:173
972799391,4cyclictest41-21ksoftirqd/312:01:123
9726993933,4cyclictest12938-21cron08:25:012
972699386,30cyclictest11399-21kworker/2:009:13:232
972699386,30cyclictest11399-21kworker/2:009:13:232
9726993831,5cyclictest33-21ksoftirqd/209:33:252
972699380,18cyclictest22684-21kworker/2:212:30:232
9725993833,3cyclictest25-21ksoftirqd/110:12:381
972799373,3cyclictest121rcu_preempt07:14:593
9727993732,3cyclictest41-21ksoftirqd/312:15:303
9727993732,3cyclictest41-21ksoftirqd/312:15:303
9727993731,3cyclictest41-21ksoftirqd/307:40:003
972699376,22cyclictest11399-21kworker/2:007:40:192
9726993731,4cyclictest33-21ksoftirqd/207:26:442
972699371,34cyclictest20036-21kworker/2:010:55:142
9725993732,3cyclictest22428-21sh08:45:001
9725993731,4cyclictest25-21ksoftirqd/110:36:181
9727993631,2cyclictest41-21ksoftirqd/307:25:003
972699365,30cyclictest20036-21kworker/2:011:23:512
972699364,30cyclictest11399-21kworker/2:009:03:072
9726993630,4cyclictest33-21ksoftirqd/211:26:502
9726993630,4cyclictest33-21ksoftirqd/210:41:372
9726993629,5cyclictest33-21ksoftirqd/208:09:122
9726993614,19cyclictest23812-21sleep09:55:002
9725993629,4cyclictest25-21ksoftirqd/109:05:051
9727993530,3cyclictest41-21ksoftirqd/309:15:173
972699354,30cyclictest3027-21kworker/2:211:37:352
972699354,29cyclictest11399-21kworker/2:008:28:592
972699354,29cyclictest11399-21kworker/2:008:28:592
9726993529,4cyclictest33-21ksoftirqd/207:54:362
9726993528,4cyclictest33-21ksoftirqd/211:41:592
9725993530,3cyclictest25-21ksoftirqd/109:34:401
9725993529,4cyclictest25-21ksoftirqd/111:21:401
9725993529,4cyclictest25-21ksoftirqd/107:16:081
9725993528,5cyclictest25-21ksoftirqd/110:06:381
9724993529,4cyclictest9-21ksoftirqd/012:24:280
9724993529,4cyclictest9-21ksoftirqd/008:38:470
9724993528,4cyclictest9-21ksoftirqd/010:57:190
972799340,3cyclictest121rcu_preempt07:20:163
972699344,29cyclictest22684-21kworker/2:212:35:592
972699343,30cyclictest17119-21kworker/2:109:40:512
972699343,30cyclictest17119-21kworker/2:109:40:512
972699343,29cyclictest23541-21kworker/2:210:00:192
9726993429,3cyclictest33-21ksoftirqd/208:32:232
9726993428,4cyclictest33-21ksoftirqd/208:01:502
9726993427,4cyclictest33-21ksoftirqd/208:17:022
9726993427,4cyclictest33-21ksoftirqd/207:37:512
972699342,30cyclictest11399-21kworker/2:007:11:002
972699342,30cyclictest10739-21kworker/2:110:46:072
9725993430,3cyclictest25-21ksoftirqd/111:55:001
9725993428,4cyclictest25-21ksoftirqd/112:22:171
9725993428,4cyclictest25-21ksoftirqd/109:16:151
9725993428,4cyclictest25-21ksoftirqd/108:03:131
9725993428,3cyclictest25-21ksoftirqd/112:30:121
9724993427,4cyclictest9-21ksoftirqd/007:10:090
39542340,4sleep13957-21ptp4l11:25:251
9726993328,3cyclictest33-21ksoftirqd/212:00:002
9726993328,3cyclictest33-21ksoftirqd/207:57:412
9726993327,4cyclictest33-21ksoftirqd/212:09:032
9726993327,4cyclictest33-21ksoftirqd/211:14:422
9726993327,4cyclictest33-21ksoftirqd/207:45:422
9726993326,5cyclictest33-21ksoftirqd/211:06:042
9726993326,5cyclictest33-21ksoftirqd/208:57:022
9726993314,16cyclictest10109-21sed10:30:272
9725993328,3cyclictest25-21ksoftirqd/110:00:001
9725993328,3cyclictest25-21ksoftirqd/109:21:471
9725993327,4cyclictest25-21ksoftirqd/112:26:191
9725993327,4cyclictest25-21ksoftirqd/112:11:011
9725993327,4cyclictest25-21ksoftirqd/109:49:411
9724993327,4cyclictest9-21ksoftirqd/011:20:000
9724993327,4cyclictest9-21ksoftirqd/011:19:590
9724993327,4cyclictest9-21ksoftirqd/010:21:570
9724993327,4cyclictest9-21ksoftirqd/009:59:590
9724993327,4cyclictest9-21ksoftirqd/009:21:200
9724993327,4cyclictest9-21ksoftirqd/008:34:010
9726993227,3cyclictest33-21ksoftirqd/211:46:502
9726993227,3cyclictest33-21ksoftirqd/209:46:342
9726993226,4cyclictest33-21ksoftirqd/212:20:572
9726993226,4cyclictest33-21ksoftirqd/210:37:282
9726993226,4cyclictest33-21ksoftirqd/210:15:412
9726993213,16cyclictest14906-21cat07:20:172
9726993213,16cyclictest14906-21cat07:20:162
972699321,30cyclictest11399-21kworker/2:007:16:482
972699320,4cyclictest32113-21grep10:10:242
972699320,3cyclictest26700-21egrep12:15:162
972699320,3cyclictest26700-21egrep12:15:162
972699320,31cyclictest11399-21kworker/2:008:52:482
9725993226,4cyclictest25-21ksoftirqd/111:11:171
9725993226,4cyclictest25-21ksoftirqd/110:45:171
9725993226,4cyclictest25-21ksoftirqd/110:33:051
9725993226,4cyclictest25-21ksoftirqd/108:16:291
9725993226,4cyclictest25-21ksoftirqd/107:41:111
9724993227,3cyclictest9-21ksoftirqd/012:07:240
9724993227,3cyclictest9-21ksoftirqd/009:34:230
9724993226,4cyclictest9-21ksoftirqd/007:46:200
9724993226,4cyclictest9-21ksoftirqd/007:25:490
9724993226,3cyclictest9-21ksoftirqd/011:28:210
9724993225,4cyclictest9-21ksoftirqd/009:48:230
9726993127,3cyclictest33-21ksoftirqd/208:12:592
9726993126,3cyclictest33-21ksoftirqd/209:35:482
972699310,27cyclictest18163-21/usr/sbin/munin10:50:122
9725993126,3cyclictest25-21ksoftirqd/111:18:091
9725993126,3cyclictest25-21ksoftirqd/111:18:091
9725993126,3cyclictest25-21ksoftirqd/109:27:221
9725993126,3cyclictest25-21ksoftirqd/108:22:591
9725993125,4cyclictest25-21ksoftirqd/110:42:561
9725993125,4cyclictest25-21ksoftirqd/110:00:131
9725993125,4cyclictest25-21ksoftirqd/109:41:501
9725993125,4cyclictest25-21ksoftirqd/109:41:501
9725993125,4cyclictest25-21ksoftirqd/109:10:051
9725993125,4cyclictest25-21ksoftirqd/109:10:051
9725993125,4cyclictest25-21ksoftirqd/109:01:261
9725993125,4cyclictest25-21ksoftirqd/108:36:041
9725993124,5cyclictest25-21ksoftirqd/111:57:541
9724993126,3cyclictest9-21ksoftirqd/012:12:170
9724993126,3cyclictest9-21ksoftirqd/012:04:350
9724993125,4cyclictest9-21ksoftirqd/011:49:590
9724993125,4cyclictest9-21ksoftirqd/010:01:350
9724993124,4cyclictest9-21ksoftirqd/008:14:200
972699301,28cyclictest3216-21kworker/2:109:25:032
972699301,28cyclictest22684-21kworker/2:212:13:392
9726993011,16cyclictest31583-21cut12:25:152
9725993025,3cyclictest25-21ksoftirqd/112:05:401
9725993025,3cyclictest25-21ksoftirqd/110:16:481
9725993025,3cyclictest25-21ksoftirqd/108:58:331
9725993025,3cyclictest25-21ksoftirqd/108:30:541
9725993025,3cyclictest25-21ksoftirqd/107:13:421
9725993024,4cyclictest25-21ksoftirqd/111:45:431
9725993024,4cyclictest25-21ksoftirqd/111:30:131
9725993024,4cyclictest25-21ksoftirqd/108:11:441
9725993024,4cyclictest25-21ksoftirqd/107:29:361
9724993025,3cyclictest9-21ksoftirqd/012:26:110
9724993025,3cyclictest9-21ksoftirqd/010:36:010
9724993025,3cyclictest9-21ksoftirqd/008:29:560
9724993025,3cyclictest9-21ksoftirqd/008:29:550
9724993025,3cyclictest9-21ksoftirqd/007:33:120
9724993024,4cyclictest9-21ksoftirqd/011:14:410
9724993024,4cyclictest9-21ksoftirqd/009:51:170
9724993024,4cyclictest9-21ksoftirqd/007:38:490
9724993022,5cyclictest9-21ksoftirqd/008:25:000
9725992925,2cyclictest25-21ksoftirqd/111:03:011
9725992924,3cyclictest25-21ksoftirqd/108:47:291
9725992924,3cyclictest25-21ksoftirqd/108:29:481
9725992924,3cyclictest25-21ksoftirqd/108:29:481
9725992924,3cyclictest25-21ksoftirqd/108:07:391
9725992924,3cyclictest25-21ksoftirqd/107:59:431
9725992923,4cyclictest25-21ksoftirqd/110:20:461
9725992923,4cyclictest25-21ksoftirqd/107:35:421
9724992924,3cyclictest9-21ksoftirqd/012:18:070
9724992924,3cyclictest9-21ksoftirqd/012:18:070
9724992923,4cyclictest9-21ksoftirqd/011:40:120
9724992923,4cyclictest9-21ksoftirqd/011:30:450
9724992923,4cyclictest9-21ksoftirqd/011:01:570
9724992923,4cyclictest9-21ksoftirqd/010:47:450
9724992923,4cyclictest9-21ksoftirqd/010:15:070
9724992923,4cyclictest9-21ksoftirqd/009:28:330
9724992923,4cyclictest9-21ksoftirqd/008:03:570
9724992923,4cyclictest9-21ksoftirqd/007:17:560
9724992923,4cyclictest16463-21wc09:40:000
9724992923,3cyclictest9-21ksoftirqd/007:56:510
9725992822,4cyclictest25-21ksoftirqd/112:16:441
9725992822,4cyclictest25-21ksoftirqd/112:16:431
9725992822,4cyclictest25-21ksoftirqd/110:58:451
9725992822,4cyclictest25-21ksoftirqd/107:49:531
9724992823,3cyclictest9-21ksoftirqd/011:51:310
9724992823,3cyclictest9-21ksoftirqd/010:06:260
9724992823,3cyclictest9-21ksoftirqd/008:59:450
9724992823,3cyclictest9-21ksoftirqd/008:08:340
9724992822,4cyclictest9-21ksoftirqd/008:49:180
9725992721,4cyclictest25-21ksoftirqd/110:52:231
9725992721,4cyclictest25-21ksoftirqd/107:51:381
9725992721,4cyclictest25-21ksoftirqd/107:21:571
9725992721,4cyclictest25-21ksoftirqd/107:21:571
9724992722,3cyclictest9-21ksoftirqd/010:12:380
9724992722,3cyclictest9-21ksoftirqd/007:40:220
9724992721,4cyclictest9-21ksoftirqd/008:40:510
9725992621,3cyclictest25-21ksoftirqd/111:40:521
9725992621,3cyclictest25-21ksoftirqd/111:36:551
9725992621,3cyclictest25-21ksoftirqd/111:07:451
9725992621,3cyclictest25-21ksoftirqd/107:31:001
9725992620,4cyclictest25-21ksoftirqd/112:35:161
9725992620,4cyclictest25-21ksoftirqd/108:53:001
9724992622,3cyclictest9-21ksoftirqd/011:08:030
9724992621,3cyclictest9-21ksoftirqd/011:38:440
9724992621,3cyclictest9-21ksoftirqd/011:20:180
9724992620,4cyclictest9-21ksoftirqd/010:29:070
9724992620,4cyclictest9-21ksoftirqd/009:17:180
9724992620,4cyclictest9-21ksoftirqd/007:50:580
9724992521,3cyclictest9-21ksoftirqd/010:44:550
9724992520,3cyclictest9-21ksoftirqd/009:10:000
9724992519,4cyclictest9-21ksoftirqd/012:31:390
9724992519,4cyclictest9-21ksoftirqd/009:11:120
9724992519,4cyclictest9-21ksoftirqd/009:11:120
9724992519,3cyclictest5951-21sh12:40:010
9725992419,3cyclictest25-21ksoftirqd/110:28:281
9724992417,4cyclictest30071-21cstates09:00:170
9724992318,3cyclictest9-21ksoftirqd/007:24:130
9724992318,3cyclictest9-21ksoftirqd/007:24:120
9725992217,3cyclictest25-21ksoftirqd/112:00:211
9724992217,3cyclictest9-21ksoftirqd/010:30:200
9724992216,3cyclictest19311-21sh12:00:000
9724992117,3cyclictest9-21ksoftirqd/008:20:000
9725992015,3cyclictest25-21ksoftirqd/109:35:081
9724992013,4cyclictest18466-21sed10:50:150
9724991915,2cyclictest9-21ksoftirqd/009:42:530
9724991915,2cyclictest9-21ksoftirqd/009:42:530
9725991812,3cyclictest23123-21wc09:50:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional

 
OSZAR »