You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-30 - 18:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Fri May 30, 2025 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
396353699140115,12cyclictest4010149-21apt-get09:34:471
396353499119112,5cyclictest3989421-21kworker/u8:2+flush-179:008:40:240
39635349910599,4cyclictest4016534-21kworker/u8:1+events_unbound09:55:130
39635369910398,4cyclictest3974894-21kworker/u8:3+flush-179:008:05:301
39635349910291,9cyclictest3982812-21latency_hist08:10:010
39635349910090,7cyclictest3997399-21latency_hist08:55:000
3963536999990,6cyclictest3972977-21kworker/u8:1+events_unbound07:40:181
3963536999985,4cyclictest4021316-21kworker/u8:0+events_unbound10:55:161
3963534999986,10cyclictest3994482-21apt-get08:45:140
3963536999890,5cyclictest4045531-21kworker/u8:3+events_unbound11:50:171
3963534999784,11cyclictest3984656-21apt-get08:15:140
3963536999580,6cyclictest3974894-21kworker/u8:3+events_unbound08:20:001
3963536999485,7cyclictest4059789-21kworker/u8:2+flush-179:012:25:201
3963534999489,4cyclictest3947847-21kworker/u8:3+events_unbound07:15:390
3963534999488,4cyclictest4037764-21kworker/u8:1+events_unbound11:00:170
3963536999380,4cyclictest4021316-21kworker/u8:0+events_unbound10:25:021
3963536999380,4cyclictest4021316-21kworker/u8:0+events_unbound10:25:021
3963534999388,4cyclictest4028958-21kworker/u8:2+events_unbound10:30:240
3963534999279,11cyclictest4036177-21apt-get10:55:140
3963536999185,4cyclictest4047311-21kworker/u8:0+flush-179:011:35:211
3963536999083,5cyclictest4069649-21kworker/u8:2+events_unbound12:39:591
3963536999078,4cyclictest4040687-21kworker/u8:0+flush-179:011:20:161
3963534999084,4cyclictest4016534-21kworker/u8:1+events_unbound10:00:180
3963536998979,7cyclictest4047311-21kworker/u8:0+events_unbound12:05:241
3963536998882,5cyclictest3961874-21kworker/u8:1+flush-179:007:20:201
3963536998880,6cyclictest4014048-21kworker/u8:0+flush-179:010:00:001
3963536998879,8cyclictest4055064-21kworker/u8:1+events_unbound12:15:021
3963534998883,4cyclictest3998968-21kworker/u8:1+flush-179:009:00:200
3963536998779,6cyclictest3997378-21kworker/u8:0+flush-179:008:55:251
3963536998680,4cyclictest4021316-21kworker/u8:0+flush-179:010:50:161
3963536998680,4cyclictest4021316-21kworker/u8:0+flush-179:010:50:161
3963536998675,8cyclictest4008551-21latency_hist09:30:021
3963536998672,5cyclictest4021316-21kworker/u8:0+flush-179:010:50:001
3963534998673,10cyclictest3970047-21apt-get07:30:150
3963536998578,5cyclictest4000630-21kworker/u8:2+events_unbound09:20:231
3963536998578,5cyclictest3982272-21kworker/u8:1+flush-179:008:20:171
3963536998571,11cyclictest3972997-21latency_hist07:40:011
3963534998471,10cyclictest4023182-21apt-get10:15:130
3963536998377,4cyclictest4016534-21kworker/u8:1+flush-179:010:10:221
3963536998273,7cyclictest4013384-21latency_hist09:45:001
3963536998272,7cyclictest3971380-21latency_hist07:35:011
3963534998271,9cyclictest4013640-21apt-get09:45:150
3963536998176,3cyclictest4040687-21kworker/u8:0+flush-179:011:10:161
3963536998173,6cyclictest3947847-21kworker/u8:3+events_unbound07:15:421
3963536998164,5cyclictest3989421-21kworker/u8:2+flush-179:008:45:231
3963534998175,4cyclictest4055064-21kworker/u8:1+events_unbound12:10:140
3963536998074,4cyclictest4055064-21kworker/u8:1+events_unbound12:35:001
3963536998068,5cyclictest4042326-21kworker/u8:2+flush-179:011:30:001
3963536998064,5cyclictest3947847-21kworker/u8:3+flush-179:007:25:161
3963534998075,4cyclictest4000630-21kworker/u8:2+flush-179:009:40:230
3963536997967,5cyclictest4014048-21kworker/u8:0+flush-179:010:00:271
3963534997968,9cyclictest4008807-21apt-get09:30:130
3963536997873,4cyclictest4021316-21kworker/u8:0+flush-179:010:20:211
3963534997865,11cyclictest4063520-21apt-get12:20:120
3963536997764,4cyclictest3968180-21kworker/u8:0+flush-179:008:00:181
3963536997763,4cyclictest4043932-21kworker/u8:1+flush-179:011:30:221
3963534997772,4cyclictest4021316-21kworker/u8:0+events_unbound10:20:150
3963536997670,4cyclictest3989421-21kworker/u8:2+events_unbound08:30:171
3963536997571,3cyclictest4014048-21kworker/u8:0+events_unbound09:50:291
3963534997570,4cyclictest4000630-21kworker/u8:2+events_unbound09:35:250
3963534997468,4cyclictest3991021-21kworker/u8:3+events_unbound09:10:220
3963536997367,4cyclictest3991021-21kworker/u8:3+events_unbound09:00:231
3963536997363,7cyclictest4047311-21kworker/u8:0+flush-179:012:00:201
3963536997360,5cyclictest4016600-21kworker/u8:3+events_unbound10:05:281
3963534997368,4cyclictest4042326-21kworker/u8:2+events_unbound11:25:250
3963536997267,4cyclictest4014048-21kworker/u8:0+flush-179:009:45:261
3963536997258,5cyclictest3991021-21kworker/u8:3+events_unbound09:05:261
3963536997158,5cyclictest4021316-21kworker/u8:0+flush-179:010:35:211
3963534997167,3cyclictest4063500-21kworker/u8:3+events_unbound12:35:280
3963536996964,4cyclictest4059789-21kworker/u8:2+flush-179:012:20:151
3963536996961,6cyclictest4031418-21apt-get10:40:121
3963536996959,8cyclictest3105085-21systemd-journal11:10:001
3963534996964,4cyclictest4047311-21kworker/u8:0+events_unbound11:49:480
3963534996964,4cyclictest3961874-21kworker/u8:1+flush-179:007:20:280
396353499690,67cyclictest722-21Xorg08:28:000
396353999680,65cyclictest0-21swapper/207:44:592
3963536996862,4cyclictest4055064-21kworker/u8:1+flush-179:012:15:001
3963534996864,3cyclictest4021316-21kworker/u8:0+events_unbound10:48:470
3963534996863,3cyclictest4042326-21kworker/u8:2+flush-179:011:15:190
3963534996763,3cyclictest4066674-21kworker/u8:0+events_unbound12:31:460
3963534996763,3cyclictest3947847-21kworker/u8:3+flush-179:007:10:250
3963534996756,4cyclictest4047311-21kworker/u8:0+events_unbound11:51:470
3963536996660,5cyclictest3997378-21kworker/u8:0+events_unbound08:54:521
3963534996662,3cyclictest4047311-21kworker/u8:0+flush-179:011:35:280
3963534996662,3cyclictest4040687-21kworker/u8:0+events_unbound11:12:470
3963534996661,4cyclictest4029588-21kworker/u8:3+events_unbound10:53:470
3963534996661,4cyclictest4029588-21kworker/u8:3+events_unbound10:53:470
3963534996656,8cyclictest4005613-21/usr/sbin/munin09:20:240
3963536996555,3cyclictest3972977-21kworker/u8:1+events_unbound07:45:221
3963536996555,3cyclictest3972977-21kworker/u8:1+events_unbound07:45:211
3963536996554,4cyclictest4045531-21kworker/u8:3+events_unbound11:40:221
3963536996554,4cyclictest4045531-21kworker/u8:3+events_unbound11:40:221
3963534996560,4cyclictest4000630-21kworker/u8:2+events_unbound09:50:020
3963534996556,8cyclictest3974894-21kworker/u8:3+flush-179:008:05:000
3963534996556,7cyclictest4031162-21latency_hist10:40:020
3963539996437,1cyclictest0-21swapper/209:17:582
3963536996439,20cyclictest3998968-21kworker/u8:1+flush-179:009:15:161
3963534996459,4cyclictest4016534-21kworker/u8:1+flush-179:010:40:100
3963536996357,4cyclictest3974894-21kworker/u8:3+flush-179:007:55:221
3963536996356,5cyclictest4000630-21kworker/u8:2+flush-179:009:10:171
3963536996256,4cyclictest4045531-21kworker/u8:3+flush-179:011:55:121
3963536996256,4cyclictest3991021-21kworker/u8:3+flush-179:008:40:281
3963536996245,12cyclictest4016534-21kworker/u8:1+events_unbound10:15:171
3963534996258,3cyclictest4000630-21kworker/u8:2+flush-179:009:15:170
3963534996257,4cyclictest3970989-21kworker/u8:2+events_unbound07:35:410
3963534996256,5cyclictest3968180-21kworker/u8:0+events_unbound08:00:010
3963536996155,4cyclictest3974894-21kworker/u8:3+flush-179:008:10:211
3963536996154,5cyclictest4009217-21kworker/u8:3+events_unbound09:35:281
3963534996156,4cyclictest3991021-21kworker/u8:3+events_unbound08:59:530
3963536996047,6cyclictest3987729-21kworker/u8:0+events_unbound08:25:171
3963534996056,3cyclictest3968180-21kworker/u8:0+events_unbound07:27:460
3963534996051,4cyclictest4016534-21kworker/u8:1+events_unbound10:10:170
3963536995953,5cyclictest3989421-21kworker/u8:2+events_unbound08:39:501
3963534995955,3cyclictest4016534-21kworker/u8:1+events_unbound10:25:080
3963534995955,3cyclictest4016534-21kworker/u8:1+events_unbound10:25:080
3963534995955,3cyclictest3982272-21kworker/u8:1+events_unbound08:24:480
3963534995954,4cyclictest4055064-21kworker/u8:1+events_unbound12:29:470
3963534995954,4cyclictest4043932-21kworker/u8:1+events_unbound11:21:480
396353499591,56cyclictest1-21systemd12:09:450
3963534995853,4cyclictest4040692-21kworker/u8:3+events_unbound11:09:470
3963534995853,4cyclictest3972977-21kworker/u8:1+events_unbound07:40:460
3963534995753,3cyclictest3968180-21kworker/u8:0+events_unbound07:49:420
3963534995753,3cyclictest3968180-21kworker/u8:0+events_unbound07:49:410
3963534995752,4cyclictest4047311-21kworker/u8:0+events_unbound12:04:560
3963536995651,4cyclictest4045531-21kworker/u8:3+events_unbound11:45:141
3963536995651,4cyclictest4037764-21kworker/u8:1+events_unbound11:02:481
3963536995651,4cyclictest4016534-21kworker/u8:1+events_unbound10:34:471
3963536995651,4cyclictest3974894-21kworker/u8:3+events_unbound07:51:471
3963534995652,3cyclictest4047311-21kworker/u8:0+flush-179:011:59:550
3963534995652,3cyclictest4045531-21kworker/u8:3+events_unbound11:42:470
3963534995652,3cyclictest4045531-21kworker/u8:3+events_unbound11:42:470
3963534995651,4cyclictest4059789-21kworker/u8:2+flush-179:012:15:280
3963534995450,3cyclictest3998968-21kworker/u8:1+events_unbound09:29:590
3963534995450,3cyclictest3991021-21kworker/u8:3+events_unbound08:35:230
3963534995147,3cyclictest4016534-21kworker/u8:1+events_unbound10:09:550
3963536995046,3cyclictest3947847-21kworker/u8:3+flush-179:007:10:401
3963534995046,3cyclictest3989421-21kworker/u8:2+flush-179:008:30:300
3963534995043,6cyclictest3982272-21kworker/u8:1+flush-179:008:15:010
4505291480,12ptp4l61790irq/134-eno1-TxRx-007:09:563
3963534994642,3cyclictest3968180-21kworker/u8:0+events_unbound07:50:530
3963534994339,3cyclictest4042326-21kworker/u8:2+events_unbound11:30:030
396353499421,3cyclictest4002182-21munin-run09:10:000
396354099410,39cyclictest3992640-21turbostat08:40:003
396354099400,39cyclictest3978038-21turbostat07:55:003
396353999390,36cyclictest0-21swapper/212:33:592
396353999390,36cyclictest0-21swapper/208:44:552
396353999380,36cyclictest0-21swapper/212:26:592
396353999380,36cyclictest0-21swapper/208:03:002
396353999380,35cyclictest0-21swapper/208:24:552
3963539993734,2cyclictest0-21swapper/211:34:592
3963539993734,2cyclictest0-21swapper/210:20:592
3963539993734,2cyclictest0-21swapper/209:44:002
3963539993734,2cyclictest0-21swapper/209:26:002
3963539993734,2cyclictest0-21swapper/209:24:562
396353999370,35cyclictest0-21swapper/211:57:582
396353999370,35cyclictest0-21swapper/209:56:002
396353999370,35cyclictest0-21swapper/207:57:592
3963536993732,4cyclictest4040687-21kworker/u8:0+events_unbound11:17:471
3963540993634,1cyclictest0-21swapper/311:03:593
396354099360,35cyclictest0-21swapper/311:15:593
396354099360,35cyclictest0-21swapper/309:13:593
396353999360,1cyclictest0-21swapper/208:47:002
396353999360,1cyclictest0-21swapper/207:35:592
396354099350,34cyclictest0-21swapper/312:19:593
3963539993532,2cyclictest0-21swapper/212:03:592
3963539993532,2cyclictest0-21swapper/211:44:552
3963539993532,2cyclictest0-21swapper/211:44:552
4505291340,6ptp4l61790irq/134-eno1-TxRx-012:00:013
4505291340,6ptp4l441ktimers/309:30:003
3963540993429,4cyclictest4064864-21turbostat12:25:013
396353999340,2cyclictest0-21swapper/209:35:582
3963540993331,1cyclictest0-21swapper/310:36:003
3963540993230,1cyclictest0-21swapper/308:41:003
3963540993230,1cyclictest0-21swapper/308:28:003
3963540993128,2cyclictest0-21swapper/308:52:583
396354099310,29cyclictest0-21swapper/309:55:113
3963539993129,1cyclictest0-21swapper/209:49:582
3963539993128,2cyclictest0-21swapper/212:40:002
3963539993128,2cyclictest0-21swapper/207:50:142
3963539993128,2cyclictest0-21swapper/207:12:592
396353999310,2cyclictest0-21swapper/209:11:592
3963540993028,1cyclictest0-21swapper/311:28:593
3963540993028,1cyclictest0-21swapper/308:14:003
3963540993027,2cyclictest0-21swapper/309:15:143
3963540993026,2cyclictest0-21swapper/307:36:583
3963540993025,2cyclictest0-21swapper/309:30:143
396354099300,28cyclictest0-21swapper/311:20:153
396354099300,28cyclictest0-21swapper/311:05:153
396354099300,27cyclictest0-21swapper/309:20:143
396354099300,27cyclictest0-21swapper/307:20:133
396354099300,25cyclictest0-21swapper/310:30:143
3963539993027,2cyclictest0-21swapper/211:45:132
3963539993026,2cyclictest0-21swapper/211:20:592
4505291290,7ptp4l441ktimers/311:50:003
4505291290,7ptp4l441ktimers/310:04:593
3963540992927,1cyclictest0-21swapper/310:29:003
3963540992927,1cyclictest0-21swapper/310:28:593
3963540992927,1cyclictest0-21swapper/310:12:593
396354099290,27cyclictest0-21swapper/311:10:153
396354099290,27cyclictest0-21swapper/310:05:173
396354099290,27cyclictest0-21swapper/308:20:023
396354099290,27cyclictest0-21swapper/307:45:143
396354099290,27cyclictest0-21swapper/307:45:133
3963539992926,2cyclictest0-21swapper/212:15:012
3963539992926,2cyclictest0-21swapper/210:45:142
3963539992926,2cyclictest0-21swapper/210:25:042
3963539992926,2cyclictest0-21swapper/210:25:032
3963539992926,2cyclictest0-21swapper/209:09:002
396353999290,27cyclictest0-21swapper/211:35:162
396353999290,27cyclictest0-21swapper/210:35:142
396353999290,27cyclictest0-21swapper/210:10:142
396353999290,27cyclictest0-21swapper/208:32:002
396353999290,27cyclictest0-21swapper/207:30:162
4505291280,7ptp4l441ktimers/311:45:003
4505291280,7ptp4l441ktimers/311:45:003
4505291280,6ptp4l441ktimers/311:54:593
4505291280,5ptp4l441ktimers/312:30:013
3963540992826,1cyclictest0-21swapper/309:52:003
3963540992826,1cyclictest0-21swapper/308:15:153
3963540992826,1cyclictest0-21swapper/308:06:583
3963540992825,2cyclictest0-21swapper/312:08:593
396354099280,26cyclictest0-21swapper/310:55:153
396354099280,26cyclictest0-21swapper/307:10:173
396354099280,20cyclictest0-21swapper/312:35:183
3963539992825,2cyclictest0-21swapper/210:42:002
3963539992825,2cyclictest0-21swapper/207:48:002
3963539992825,2cyclictest0-21swapper/207:48:002
396353999280,27cyclictest0-21swapper/212:15:012
396353999280,27cyclictest0-21swapper/207:20:132
396353999280,27cyclictest0-21swapper/207:15:142
396353999280,26cyclictest0-21swapper/211:10:142
396353999280,26cyclictest0-21swapper/210:50:142
396353999280,26cyclictest0-21swapper/210:50:142
396353999280,25cyclictest0-21swapper/207:29:562
4505291270,6ptp4l61790irq/134-eno1-TxRx-009:49:553
4505291270,6ptp4l441ktimers/310:55:013
4505291270,6ptp4l441ktimers/310:55:013
4505291270,6ptp4l441ktimers/310:25:013
4505291270,6ptp4l441ktimers/307:35:003
4505291270,6ptp4l441ktimers/307:30:003
3963540992725,1cyclictest0-21swapper/312:13:593
3963540992725,1cyclictest0-21swapper/309:44:593
3963540992725,1cyclictest0-21swapper/307:40:163
3963540992721,5cyclictest4011781-21turbostat09:40:003
396354099270,26cyclictest3979653-21turbostat08:00:003
396354099270,26cyclictest0-21swapper/308:30:173
3963539992724,2cyclictest0-21swapper/212:09:562
3963539992724,2cyclictest0-21swapper/210:00:582
3963539992724,2cyclictest0-21swapper/208:56:592
396353999270,1cyclictest0-21swapper/210:15:142
4505291260,6ptp4l61790irq/134-eno1-TxRx-010:44:553
4505291260,5ptp4l61790irq/134-eno1-TxRx-011:40:003
4505291260,5ptp4l61790irq/134-eno1-TxRx-007:20:013
4505291260,5ptp4l441ktimers/308:50:013
4505291260,5ptp4l441ktimers/308:04:553
4505291260,4ptp4l61790irq/134-eno1-TxRx-012:05:013
3963540992624,1cyclictest0-21swapper/312:30:143
3963540992624,1cyclictest0-21swapper/310:49:553
3963539992623,2cyclictest0-21swapper/211:05:152
3963539992623,2cyclictest0-21swapper/208:09:562
4505291250,6ptp4l441ktimers/309:10:003
4505291250,5ptp4l441ktimers/311:34:553
4505291250,5ptp4l441ktimers/310:19:563
4505291250,5ptp4l441ktimers/308:59:553
4505291250,4ptp4l441ktimers/309:04:563
3963539992522,2cyclictest0-21swapper/211:54:592
3963539992522,2cyclictest0-21swapper/210:09:542
3963539992422,1cyclictest0-21swapper/209:52:592
3963539992421,2cyclictest0-21swapper/212:20:592
3963539992421,2cyclictest0-21swapper/210:30:582
3963539992220,1cyclictest0-21swapper/211:05:002
3963539992219,2cyclictest0-21swapper/209:31:582
3963539992119,1cyclictest0-21swapper/208:12:592
3963534992118,2cyclictest151ktimers/007:10:010
3963539992017,2cyclictest0-21swapper/211:18:592
3963539992017,2cyclictest0-21swapper/208:29:592
396353699181,16cyclictest3963394-21latency_hist07:10:021
3963539991714,2cyclictest0-21swapper/209:03:582
3963539991714,2cyclictest0-21swapper/208:50:592
3963539991613,2cyclictest0-21swapper/210:57:592
3963539991613,2cyclictest0-21swapper/208:35:592
396353999118,2cyclictest0-21swapper/208:15:152
39635399985,2cyclictest0-21swapper/211:25:242
39635399920,1cyclictest0-21swapper/207:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional

 
OSZAR »