You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-05 - 03:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Thu Jun 05, 2025 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
202982199174,20sleep00-21swapper/019:05:050
221742189172,12sleep30-21swapper/319:05:323
222962188171,12sleep10-21swapper/119:07:081
202952174157,12sleep20-21swapper/219:05:032
42422510,0sleep30-21swapper/322:24:093
149762480,1sleep314979-21pmu-power19:55:163
315142460,0sleep30-21swapper/323:26:353
69302450,0sleep20-21swapper/222:09:072
142562410,0sleep10-21swapper/121:23:581
21072390,0sleep20-21swapper/223:11:402
2270599102,4cyclictest28473-21cron19:20:000
8610290,0sleep20-21swapper/223:48:082
16882290,0sleep10-21swapper/122:46:221
227059980,6cyclictest0-21swapper/022:10:110
227059970,4cyclictest24101-21munin-run23:40:010
227199963,3cyclictest0-21swapper/320:40:143
227159961,4cyclictest0-21swapper/221:00:122
227059962,4cyclictest18373-21munin-run20:05:000
14229260,0sleep00-21swapper/021:23:570
9806250,0sleep10-21swapper/122:43:091
5430250,0sleep10-21swapper/100:03:011
227199953,1cyclictest5420-21users22:40:213
227199950,5cyclictest0-21swapper/322:54:203
227199950,5cyclictest0-21swapper/321:43:313
227199950,5cyclictest0-21swapper/300:28:203
227199950,5cyclictest0-21swapper/300:08:063
227199950,4cyclictest28092-21apt-get21:15:013
227199950,4cyclictest24454-21df_inode21:45:143
227199950,1cyclictest16129-21/usr/sbin/munin20:00:203
227199950,0cyclictest0-21swapper/323:50:123
227159950,5cyclictest0-21swapper/223:36:232
227159950,4cyclictest3737-21apt-get19:35:142
227159950,0cyclictest0-21swapper/222:14:462
227119951,3cyclictest0-21swapper/100:20:131
227119951,2cyclictest0-21swapper/119:35:131
227119951,2cyclictest0-21swapper/119:20:121
227119950,5cyclictest0-21swapper/123:36:021
227119950,5cyclictest0-21swapper/122:04:571
227119950,5cyclictest0-21swapper/100:10:141
227059955,0cyclictest0-21swapper/022:28:250
227059954,1cyclictest10939-21munin-run19:50:000
227059950,5cyclictest0-21swapper/023:40:090
227059950,5cyclictest0-21swapper/023:40:080
227059950,5cyclictest0-21swapper/022:59:340
19767250,1sleep019792-21ssh23:04:590
5711240,3sleep30-21swapper/321:51:483
227199944,0cyclictest25459-21kworker/3:023:15:073
227199944,0cyclictest25459-21kworker/3:000:33:293
227199943,1cyclictest8462-21/usr/sbin/munin20:50:233
227199943,1cyclictest2234-21/usr/sbin/munin23:45:213
227199943,1cyclictest18601-21/usr/sbin/munin20:05:173
227199942,1cyclictest7872-21threads22:25:203
227199940,4cyclictest20003-21ssh21:26:183
227199940,4cyclictest0-21swapper/323:55:103
227199940,4cyclictest0-21swapper/323:37:343
227199940,4cyclictest0-21swapper/323:11:213
227199940,4cyclictest0-21swapper/322:56:503
227199940,4cyclictest0-21swapper/322:11:023
227199940,4cyclictest0-21swapper/322:06:193
227199940,4cyclictest0-21swapper/322:00:143
227199940,4cyclictest0-21swapper/321:57:053
227199940,4cyclictest0-21swapper/320:30:133
227199940,4cyclictest0-21swapper/319:10:133
227199940,4cyclictest0-21swapper/300:35:153
227199940,4cyclictest0-21swapper/300:21:003
227199940,4cyclictest0-21swapper/300:11:433
227199940,3cyclictest8745-21sed00:05:013
227199940,3cyclictest6204-21memory23:30:193
227199940,3cyclictest32321-21sed19:25:153
227199940,3cyclictest28691-21sh00:15:093
227199940,3cyclictest26280-21ssh23:40:203
227199940,3cyclictest26280-21ssh23:40:203
227199940,3cyclictest26159-21ssh21:30:023
227199940,3cyclictest21467-21ssh23:05:163
227199940,3cyclictest0-21swapper/322:30:013
227199940,3cyclictest0-21swapper/321:35:143
227199940,1cyclictest5988-21/usr/sbin/munin20:45:213
227199940,1cyclictest28738-21/usr/sbin/munin19:20:123
227199940,1cyclictest25895-21/usr/sbin/munin22:35:173
227199940,1cyclictest15894-21/usr/sbin/munin21:05:173
227199940,1cyclictest11707-21memory23:00:183
227199940,1cyclictest0-21swapper/321:20:123
227199940,0cyclictest20358-21mailstats22:15:183
227159944,0cyclictest0-21swapper/200:20:372
227159942,2cyclictest3127-21kworker/2:020:49:542
227159942,2cyclictest30997-21snmpd23:57:482
227159941,3cyclictest3127-21kworker/2:000:15:262
227159941,3cyclictest30997-21snmpd00:34:272
227159941,3cyclictest23251-21cut22:50:142
227159941,3cyclictest17021-21expr21:25:162
227159941,1cyclictest0-21swapper/200:35:142
227159940,4cyclictest7032-21df_inode21:20:152
227159940,4cyclictest18129-21diskmemload00:10:132
227159940,4cyclictest180772sleep220:01:332
227159940,4cyclictest0-21swapper/223:40:142
227159940,4cyclictest0-21swapper/223:40:142
227159940,4cyclictest0-21swapper/223:25:112
227159940,4cyclictest0-21swapper/223:07:312
227159940,4cyclictest0-21swapper/222:55:152
227159940,4cyclictest0-21swapper/222:45:142
227159940,4cyclictest0-21swapper/222:41:262
227159940,4cyclictest0-21swapper/222:35:132
227159940,4cyclictest0-21swapper/222:15:122
227159940,4cyclictest0-21swapper/221:56:092
227159940,4cyclictest0-21swapper/221:51:482
227159940,4cyclictest0-21swapper/221:35:022
227159940,4cyclictest0-21swapper/221:15:132
227159940,4cyclictest0-21swapper/220:40:142
227159940,4cyclictest0-21swapper/219:50:102
227159940,4cyclictest0-21swapper/219:40:122
227159940,4cyclictest0-21swapper/200:07:252
227159940,3cyclictest7529-21ssh23:15:012
227159940,3cyclictest707-21ssh00:00:192
227159940,3cyclictest31826-21tune2fs19:25:122
227159940,3cyclictest28338-21gpgv21:15:012
227159940,3cyclictest28272-21latency_hist20:25:012
227159940,3cyclictest26181-21perl19:15:012
227159940,3cyclictest25579-21python21:45:202
227159940,3cyclictest21973-21ssh23:21:472
227159940,3cyclictest21869-21ssh22:32:472
227159940,3cyclictest17229-21ssh23:03:202
227159940,3cyclictest17016-21ssh21:41:002
227159940,3cyclictest16932-21hddtemp_smartct00:25:152
227159940,3cyclictest11102-21sed19:50:002
227159940,1cyclictest28664-21apt-get22:20:132
227119944,0cyclictest0-21swapper/123:08:061
227119944,0cyclictest0-21swapper/122:51:571
227119944,0cyclictest0-21swapper/122:38:341
227119944,0cyclictest0-21swapper/122:31:351
227119944,0cyclictest0-21swapper/122:17:281
227119944,0cyclictest0-21swapper/121:30:561
227119944,0cyclictest0-21swapper/121:18:501
227119942,1cyclictest0-21swapper/119:25:101
227119941,2cyclictest0-21swapper/122:55:151
227119941,2cyclictest0-21swapper/122:05:011
227119941,2cyclictest0-21swapper/120:55:121
227119941,2cyclictest0-21swapper/120:50:151
227119941,2cyclictest0-21swapper/120:20:121
227119941,2cyclictest0-21swapper/119:40:121
227119941,2cyclictest0-21swapper/100:35:141
227119941,2cyclictest0-21swapper/100:30:141
227119941,1cyclictest0-21swapper/120:25:121
227119940,4cyclictest0-21swapper/123:58:091
227119940,4cyclictest0-21swapper/123:23:051
227119940,4cyclictest0-21swapper/123:14:481
227119940,4cyclictest0-21swapper/120:09:161
227119940,4cyclictest0-21swapper/119:34:381
227119940,0cyclictest0-21swapper/119:55:091
227059944,0cyclictest0-21swapper/023:45:140
227059944,0cyclictest0-21swapper/022:00:370
227059944,0cyclictest0-21swapper/000:25:580
227059944,0cyclictest0-21swapper/000:09:060
227059943,1cyclictest3-21ksoftirqd/022:35:120
227059941,3cyclictest15000-21ssh22:45:220
227059941,2cyclictest0-21swapper/023:10:140
227059941,2cyclictest0-21swapper/019:10:010
227059940,4cyclictest24234-21ssh22:17:320
227059940,4cyclictest16853-21tr21:25:160
227059940,4cyclictest0-21swapper/023:55:120
227059940,4cyclictest0-21swapper/023:23:180
227059940,4cyclictest0-21swapper/023:16:030
227059940,4cyclictest0-21swapper/022:20:130
227059940,4cyclictest0-21swapper/021:55:320
227059940,4cyclictest0-21swapper/021:35:150
227059940,4cyclictest0-21swapper/021:30:130
227059940,4cyclictest0-21swapper/019:55:100
227059940,4cyclictest0-21swapper/000:35:140
227059940,4cyclictest0-21swapper/000:30:140
227059940,4cyclictest0-21swapper/000:21:140
227059940,4cyclictest0-21swapper/000:10:360
227059940,3cyclictest8577-21latency_hist00:05:010
227059940,3cyclictest5988-21/usr/sbin/munin20:45:160
227059940,3cyclictest5923-21latency_hist21:20:010
227059940,3cyclictest4577-21latency_hist23:30:010
227059940,3cyclictest3085-21ssh22:40:010
227059940,3cyclictest30471-21ssh21:48:140
227059940,3cyclictest21760-21ssh23:05:180
227059940,3cyclictest2096-21hddtemp_smartct19:30:140
227059940,3cyclictest1972-21df21:50:140
227059940,3cyclictest19576-21ssh22:31:200
227059940,3cyclictest18129-21diskmemload23:52:120
227059940,3cyclictest0-21swapper/022:05:020
227059940,3cyclictest0-21swapper/020:35:110
227059940,1cyclictest5624-21cron00:20:000
227059940,1cyclictest15338-21ntp_states21:40:180
227059940,0cyclictest0-21swapper/023:32:260
26406230,0sleep10-21swapper/121:13:571
227199932,1cyclictest30997-21snmpd20:10:013
227199932,1cyclictest30997-21snmpd19:40:043
227199932,1cyclictest18523-21ssh21:10:083
227199931,1cyclictest0-21swapper/321:00:123
227199931,1cyclictest0-21swapper/320:35:113
227199930,3cyclictest8698-21apt-get19:45:113
227199930,3cyclictest4157-21expr19:35:143
227199930,3cyclictest28489-21date20:25:013
227199930,3cyclictest25811-21grep19:15:013
227199930,3cyclictest17452-21sh23:20:033
227199930,3cyclictest13001-21sh22:45:033
227199930,3cyclictest11166-21apt-get19:50:103
227199930,3cyclictest0-21swapper/320:55:023
227199930,3cyclictest0-21swapper/320:20:133
227199930,3cyclictest0-21swapper/320:15:093
227199930,3cyclictest0-21swapper/319:30:113
227159932,1cyclictest30997-21snmpd20:55:022
227159930,3cyclictest8702-21grep20:50:162
227159930,3cyclictest18129-21diskmemload23:30:022
227159930,3cyclictest18129-21diskmemload21:30:132
227159930,3cyclictest0-21swapper/223:50:022
227159930,3cyclictest0-21swapper/222:25:112
227159930,3cyclictest0-21swapper/222:00:022
227159930,3cyclictest0-21swapper/221:05:152
227159930,3cyclictest0-21swapper/220:35:112
227159930,3cyclictest0-21swapper/220:30:102
227159930,3cyclictest0-21swapper/220:25:122
227159930,3cyclictest0-21swapper/220:15:122
227159930,3cyclictest0-21swapper/220:10:022
227159930,3cyclictest0-21swapper/220:05:152
227159930,3cyclictest0-21swapper/219:55:022
227159930,3cyclictest0-21swapper/219:30:112
227159930,3cyclictest0-21swapper/219:20:122
227159930,2cyclictest0-21swapper/219:10:012
227119933,0cyclictest0-21swapper/120:32:591
227119933,0cyclictest0-21swapper/100:09:221
227119931,2cyclictest0-21swapper/122:25:111
227119931,1cyclictest0-21swapper/123:50:111
227119931,1cyclictest0-21swapper/123:45:121
227119931,1cyclictest0-21swapper/123:30:151
227119931,1cyclictest0-21swapper/123:00:131
227119931,1cyclictest0-21swapper/121:55:121
227119931,1cyclictest0-21swapper/121:40:121
227119931,1cyclictest0-21swapper/121:00:121
227119931,1cyclictest0-21swapper/120:50:001
227119931,1cyclictest0-21swapper/120:40:141
227119931,1cyclictest0-21swapper/120:15:121
227119931,1cyclictest0-21swapper/120:10:121
227119931,1cyclictest0-21swapper/119:45:111
227119931,1cyclictest0-21swapper/119:15:121
227119930,2cyclictest0-21swapper/123:40:151
227119930,2cyclictest0-21swapper/123:40:141
227119930,2cyclictest0-21swapper/122:20:131
227119930,2cyclictest0-21swapper/121:45:121
227119930,2cyclictest0-21swapper/121:25:151
227119930,2cyclictest0-21swapper/119:50:101
227119930,2cyclictest0-21swapper/119:10:141
227059931,1cyclictest0-21swapper/021:00:120
227059931,1cyclictest0-21swapper/020:55:120
227059930,3cyclictest4048-21df_inode20:40:150
227059930,3cyclictest31505-21df_inode20:30:140
227059930,3cyclictest29257-21df19:20:140
227059930,3cyclictest18605-21apt-get20:05:150
227059930,3cyclictest0-21swapper/022:50:030
227059930,3cyclictest0-21swapper/021:10:040
227059930,3cyclictest0-21swapper/021:05:150
227059930,3cyclictest0-21swapper/020:50:020
227059930,3cyclictest0-21swapper/020:25:120
227059930,3cyclictest0-21swapper/020:20:120
227059930,3cyclictest0-21swapper/020:15:050
227059930,3cyclictest0-21swapper/020:10:110
227059930,3cyclictest0-21swapper/019:50:060
227059930,3cyclictest0-21swapper/019:40:120
227059930,3cyclictest0-21swapper/019:35:050
227059930,3cyclictest0-21swapper/019:25:100
227119921,1cyclictest0-21swapper/121:35:141
227119921,1cyclictest0-21swapper/120:00:121
227119921,1cyclictest0-21swapper/100:15:111
227119920,1cyclictest8811-21chrt22:10:101
227119920,1cyclictest15885-21chrt00:25:061
227119920,1cyclictest0-21swapper/123:25:151
227119920,1cyclictest0-21swapper/123:15:141
227119920,1cyclictest0-21swapper/121:50:071
227119920,1cyclictest0-21swapper/121:05:161
227119920,1cyclictest0-21swapper/120:35:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional

 
OSZAR »