You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-31 - 21:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Sat May 31, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
65407099140,12cyclictest0-21swapper/310:22:483
65407099130,12cyclictest673958-21turbostat08:04:543
65407099130,12cyclictest0-21swapper/307:20:123
654070991211,0cyclictest0-21swapper/307:30:123
654070991210,1cyclictest0-21swapper/310:35:153
65407099120,1cyclictest0-21swapper/307:50:153
65407099120,11cyclictest0-21swapper/309:10:193
65407099120,11cyclictest0-21swapper/309:00:143
654070991110,0cyclictest0-21swapper/311:05:203
654070991110,0cyclictest0-21swapper/308:40:133
65407099110,10cyclictest0-21swapper/309:15:143
65407099110,0cyclictest0-21swapper/312:25:143
65407099110,0cyclictest0-21swapper/311:15:193
65407099110,0cyclictest0-21swapper/308:27:193
65407099110,0cyclictest0-21swapper/307:15:013
65407099109,0cyclictest0-21swapper/310:05:143
654070991010,0cyclictest0-21swapper/311:10:203
654070991010,0cyclictest0-21swapper/310:45:143
654070991010,0cyclictest0-21swapper/310:30:173
654070991010,0cyclictest0-21swapper/309:55:233
654070991010,0cyclictest0-21swapper/309:45:203
654070991010,0cyclictest0-21swapper/309:20:193
654070991010,0cyclictest0-21swapper/308:05:133
65407099100,9cyclictest0-21swapper/311:30:233
65407099100,9cyclictest0-21swapper/309:50:203
65407099100,0cyclictest0-21swapper/312:30:203
65407099100,0cyclictest0-21swapper/310:55:183
65407099100,0cyclictest0-21swapper/309:30:223
6540709999,0cyclictest0-21swapper/311:50:193
6540709999,0cyclictest0-21swapper/311:47:293
6540709999,0cyclictest0-21swapper/311:25:143
6540709999,0cyclictest0-21swapper/310:45:003
6540709999,0cyclictest0-21swapper/308:15:143
6540709999,0cyclictest0-21swapper/307:45:003
6540709998,0cyclictest0-21swapper/307:45:563
6540709990,8cyclictest0-21swapper/312:10:153
6540709990,0cyclictest0-21swapper/311:00:183
6540709988,0cyclictest0-21swapper/310:25:203
6540709988,0cyclictest0-21swapper/308:40:013
6540709980,7cyclictest0-21swapper/307:25:233
6540709980,0cyclictest0-21swapper/310:18:333
652117280,5sleep30-21swapper/307:05:113
6540709977,0cyclictest0-21swapper/312:20:163
6540709977,0cyclictest0-21swapper/312:15:133
6540709977,0cyclictest0-21swapper/312:05:263
6540709977,0cyclictest0-21swapper/311:40:023
6540709977,0cyclictest0-21swapper/309:25:143
6540709977,0cyclictest0-21swapper/308:20:133
6540709977,0cyclictest0-21swapper/308:10:153
6540709977,0cyclictest0-21swapper/307:55:223
6540709977,0cyclictest0-21swapper/307:35:133
6540709976,0cyclictest0-21swapper/310:10:193
6540709970,7cyclictest0-21swapper/310:00:193
6540709970,0cyclictest0-21swapper/309:45:013
13989870,0rtkit-daemon1397-21rtkit-daemon10:57:222
6540709966,0cyclictest653814-21turbostat07:14:563
6540709966,0cyclictest0-21swapper/311:57:303
6540709960,3cyclictest0-21swapper/312:01:113
6540709960,0cyclictest0-21swapper/309:35:183
13989860,3rtkit-daemon0-21swapper/207:05:472
744635250,5sleep20-21swapper/210:51:092
6540709955,0cyclictest0-21swapper/308:50:163
6540709955,0cyclictest0-21swapper/308:45:233
6540709950,4cyclictest0-21swapper/309:05:173
6540709950,3cyclictest0-21swapper/311:21:133
6540709950,3cyclictest0-21swapper/308:55:183
13989850,0rtkit-daemon0-21swapper/208:50:022
725917240,2sleep10-21swapper/110:10:141
6540709944,0cyclictest0-21swapper/308:30:163
6540709940,3cyclictest788913-21chrt12:36:523
6540709940,3cyclictest743244-21chrt10:50:133
653516242,1sleep10-21swapper/107:06:381
652732241,1sleep00-21swapper/007:05:170
13989840,2rtkit-daemon760-21snmpd11:16:542
13989840,2rtkit-daemon760-21snmpd10:27:512
13989840,2rtkit-daemon656194-21munin-node12:28:512
13989840,2rtkit-daemon614-21wpa_supplicant09:19:232
13989840,2rtkit-daemon1-21systemd11:58:002
13989840,2rtkit-daemon1-21systemd10:05:522
13989840,1rtkit-daemon1-21systemd11:03:482
760488230,2sleep1760690-21sed11:30:191
723313230,3sleep10-21swapper/110:02:411
6540709930,3cyclictest0-21swapper/311:35:013
13989830,2rtkit-daemon760-21snmpd08:16:502
13989830,2rtkit-daemon417-21systemd-journal07:34:352
13989830,2rtkit-daemon1399-21sendmail-mta11:46:162
13989830,2rtkit-daemon1-21systemd12:18:442
13989830,1rtkit-daemon762-21ntpd11:54:032
13989830,1rtkit-daemon760-21snmpd11:40:042
13989830,1rtkit-daemon760-21snmpd09:56:472
13989830,1rtkit-daemon760-21snmpd08:35:042
13989830,1rtkit-daemon760-21snmpd08:27:342
13989830,1rtkit-daemon760-21snmpd07:25:032
13989830,1rtkit-daemon755821-21apt-get11:20:162
13989830,1rtkit-daemon753584-21latency_hist11:15:012
13989830,1rtkit-daemon734707-21aten_r1power_en10:30:152
13989830,1rtkit-daemon697227-21apt-get09:00:152
13989830,1rtkit-daemon678408-21cat08:10:162
13989830,1rtkit-daemon656194-21munin-node09:25:312
13989830,1rtkit-daemon600-21avahi-daemon09:43:432
13989830,1rtkit-daemon417-21systemd-journal10:13:362
13989830,1rtkit-daemon331-21plymouthd12:12:262
13989830,1rtkit-daemon331-21plymouthd10:45:232
13989830,1rtkit-daemon331-21plymouthd07:50:222
13989830,1rtkit-daemon331-21plymouthd07:35:012
13989830,1rtkit-daemon1-21systemd12:36:582
13989830,1rtkit-daemon1-21systemd12:01:232
13989830,1rtkit-daemon1-21systemd11:36:342
13989830,1rtkit-daemon1-21systemd11:26:212
13989830,1rtkit-daemon1-21systemd11:08:592
13989830,1rtkit-daemon1-21systemd10:20:412
13989830,1rtkit-daemon1-21systemd10:15:052
13989830,1rtkit-daemon1-21systemd09:51:252
13989830,1rtkit-daemon1-21systemd09:05:062
13989830,1rtkit-daemon1-21systemd07:10:472
783694220,1sleep0783778-21irqstats12:25:170
773419220,0sleep00-21swapper/012:00:200
766436220,1sleep1766683-21diskstats11:45:161
766281220,0sleep00-21swapper/011:45:150
760403220,1sleep0760487-21irqstats11:30:180
759271220,0sleep00-21swapper/011:26:080
751791220,1sleep1752038-21diskstats11:10:161
750872222,0sleep00-21swapper/011:05:480
748965220,1sleep1748967-21ssh11:02:251
746871220,1sleep00-21swapper/010:57:320
739280220,1sleep0739526-21diskstats10:40:180
736000220,1sleep0736002-21ssh10:30:570
727747222,0sleep00-21swapper/010:15:010
702783220,1sleep0703123-21apt-key09:15:000
695265220,0sleep20-21swapper/208:55:132
672695220,1sleep1672777-21irqstats07:55:171
668872220,1sleep2668954-21irqstats07:45:162
666652220,1sleep1666913-21cstates07:40:161
658832220,1sleep2659104-21df07:20:152
656027220,1sleep0656534-21grep07:15:020
13989820,1rtkit-daemon760-21snmpd10:40:172
13989820,1rtkit-daemon760-21snmpd09:10:412
13989820,1rtkit-daemon760-21snmpd08:05:142
13989820,1rtkit-daemon656194-21munin-node09:45:582
13989820,1rtkit-daemon331-21plymouthd12:30:142
13989820,1rtkit-daemon1399-21sendmail-mta12:05:462
13989820,1rtkit-daemon1399-21sendmail-mta07:40:052
13989820,1rtkit-daemon1-21systemd10:03:152
13989820,1rtkit-daemon1-21systemd08:42:222
13989820,1rtkit-daemon1-21systemd08:30:162
13989820,0rtkit-daemon656194-21munin-node08:46:032
13989820,0rtkit-daemon331-21plymouthd08:00:212
13989820,0rtkit-daemon0-21swapper/212:20:312
13989820,0rtkit-daemon0-21swapper/211:30:112
13989820,0rtkit-daemon0-21swapper/210:35:142
13989820,0rtkit-daemon0-21swapper/209:35:022
13989820,0rtkit-daemon0-21swapper/209:30:242
13989820,0rtkit-daemon0-21swapper/209:20:142
13989820,0rtkit-daemon0-21swapper/208:20:082
13989820,0rtkit-daemon0-21swapper/207:55:062
13989820,0rtkit-daemon0-21swapper/207:15:232
788147210,0sleep00-21swapper/012:35:180
787587210,0sleep10-21swapper/112:35:151
786812210,0sleep10-21swapper/112:31:461
786672210,0sleep00-21swapper/012:30:330
783257210,0sleep10-21swapper/112:25:141
782692210,0sleep10-21swapper/112:22:181
782467210,1sleep00-21swapper/012:20:240
780504210,0sleep10-21swapper/112:16:371
779317210,0sleep00-21swapper/012:15:170
778340210,0sleep00-21swapper/012:10:560
778311210,0sleep10-21swapper/112:10:411
776708210,0sleep00-21swapper/012:09:550
774897210,0sleep10-21swapper/112:05:201
774103210,0sleep10-21swapper/112:00:251
770747210,0sleep00-21swapper/011:55:150
769952210,0sleep00-21swapper/011:50:460
768785210,0sleep10-21swapper/111:50:151
764167210,0sleep10-21swapper/111:40:151
763740210,0sleep00-21swapper/011:38:460
762053210,0sleep10-21swapper/111:35:141
757887210,0sleep10-21swapper/111:25:131
755789210,0sleep10-21swapper/111:20:141
755774210,1sleep00-21swapper/011:20:050
755422210,1sleep00-21swapper/011:19:130
753679210,0sleep10-21swapper/111:15:141
752984210,0sleep00-21swapper/011:11:030
750234210,0sleep10-21swapper/111:05:211
747696210,0sleep00-21swapper/011:00:160
746098210,0sleep10-21swapper/110:55:191
744144210,0sleep00-21swapper/010:50:230
743250210,0sleep10-21swapper/110:50:161
742478210,1sleep1742482-21ssh10:45:321
742202210,0sleep00-21swapper/010:45:220
740471210,0sleep10-21swapper/110:41:041
737150210,0sleep00-21swapper/010:35:180
736717210,0sleep10-21swapper/110:35:151
735063210,0sleep10-21swapper/110:30:181
734078210,0sleep10-21swapper/110:27:271
732703210,0sleep00-21swapper/010:25:180
731524211,0sleep00-21swapper/010:21:170
729839210,0sleep10-21swapper/110:20:021
729610210,0sleep00-21swapper/010:18:010
729312210,0sleep10-21swapper/110:15:251
725278210,0sleep10-21swapper/110:06:411
724545210,0sleep00-21swapper/010:05:190
723408210,0sleep00-21swapper/010:03:360
721064210,0sleep10-21swapper/109:56:291
720061210,0sleep00-21swapper/009:55:200
719068210,0sleep00-21swapper/009:52:140
718943210,0sleep10-21swapper/109:51:071
717260210,0sleep10-21swapper/109:49:441
715444210,0sleep00-21swapper/009:45:030
714956210,0sleep10-21swapper/109:42:481
713382210,0sleep00-21swapper/009:40:150
711507210,0sleep10-21swapper/109:35:141
709946210,0sleep10-21swapper/109:30:231
709331210,0sleep00-21swapper/009:30:180
707784210,0sleep10-21swapper/109:25:191
707101210,0sleep00-21swapper/009:25:010
707035210,0sleep00-21swapper/009:24:220
705807210,0sleep10-21swapper/109:20:181
703291210,1sleep00-21swapper/009:15:090
703171210,0sleep10-21swapper/109:15:021
701030210,0sleep10-21swapper/109:10:131
699547210,0sleep10-21swapper/109:05:171
699338210,0sleep00-21swapper/009:05:160
698518210,0sleep00-21swapper/009:00:360
697386210,0sleep10-21swapper/109:00:171
695388210,0sleep0695673-21cstates08:55:150
694843210,0sleep00-21swapper/008:52:480
694659210,0sleep10-21swapper/108:50:241
692737210,0sleep00-21swapper/008:45:220
692242210,0sleep10-21swapper/108:45:201
689626210,0sleep10-21swapper/108:40:151
688647210,0sleep10-21swapper/108:35:241
687970210,0sleep00-21swapper/008:35:190
683778210,0sleep10-21swapper/108:25:151
683776210,0sleep00-21swapper/008:25:140
683175210,0sleep10-21swapper/108:20:311
681429211,0sleep00-21swapper/008:17:520
679930210,0sleep10-21swapper/108:15:131
678014210,0sleep10-21swapper/108:10:101
676101210,0sleep10-21swapper/108:05:101
672447210,0sleep00-21swapper/007:55:160
670486210,0sleep10-21swapper/107:50:171
670381210,0sleep00-21swapper/007:50:150
669235210,0sleep10-21swapper/107:45:201
667146210,0sleep00-21swapper/007:40:190
664697210,0sleep10-21swapper/107:35:151
664515210,0sleep00-21swapper/007:35:140
663802210,0sleep10-21swapper/107:30:241
663021210,0sleep00-21swapper/007:30:190
661939210,1sleep00-21swapper/007:26:020
661918210,0sleep10-21swapper/107:25:471
658737210,0sleep10-21swapper/107:20:141
658410210,0sleep00-21swapper/007:20:010
656537210,0sleep10-21swapper/107:15:031
770666200,0sleep10-21swapper/111:55:041
763889200,0sleep00-21swapper/011:40:010
711300200,0sleep00-21swapper/009:35:010
695254200,0sleep10-21swapper/108:55:041
689521200,0sleep00-21swapper/008:40:030
685675200,0sleep10-21swapper/108:30:021
685674200,0sleep00-21swapper/008:30:010
681651200,0sleep00-21swapper/008:20:020
677769200,0sleep00-21swapper/008:10:010
675856200,0sleep00-21swapper/008:05:010
674183200,0sleep00-21swapper/008:00:040
673924200,0sleep10-21swapper/108:00:001
668426200,0sleep00-21swapper/007:45:030
654354200,0sleep00-21swapper/007:10:040
654214200,0sleep10-21swapper/107:10:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional

 
OSZAR »