View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0001176 | channel: kernel/el8 | kernel-ml | public | 2021-12-27 07:38 | 2022-02-27 22:24 |
| Reporter | akrherz | Assigned To | toracat | ||
| Priority | normal | Severity | minor | Reproducibility | always |
| Status | resolved | Resolution | fixed | ||
| Summary | 0001176: InfiniBand: QLogic Corp. IBA7322 QDR sysfs: cannot create duplicate filename | ||||
| Description | Thank you for all your efforts on the kernel-ml package. I am having troubles though with getting my Infiniband card working on recent kernel-ml kernels. I continue to successfully use 5.12.13-1 for now. On 5.15.11-1.el8.elrepo.x86_64 the following dmesg appears: [ 29.606125] ib_qib 0000:03:00.0: qib0: Reserving QPNs from 0x656b78 to 0x656b78 for non-verbs use [ 29.606711] sysfs: cannot create duplicate filename '/devices/pci0000:00/0000:00:07.0/0000:03:00.0/infiniband/qib0/ports/1/linkcontrol' [ 29.606718] CPU: 15 PID: 1545 Comm: modprobe Tainted: G I E 5.15.11-1.el8.elrepo.x86_64 #1 [ 29.606725] Hardware name: Dell Inc. PowerEdge R410/01V648, BIOS 1.14.0 05/30/2018 [ 29.606729] Call Trace: [ 29.606734] <TASK> [ 29.606740] dump_stack_lvl+0x45/0x57 [ 29.606752] sysfs_warn_dup.cold.4+0x17/0x23 [ 29.606760] internal_create_group+0x369/0x380 [ 29.606771] internal_create_groups.part.4+0x3d/0xa0 [ 29.606778] ib_setup_port_attrs+0x71e/0x820 [ib_core] [ 29.606841] ? klist_add_tail+0x1b/0x50 [ 29.606851] ib_register_device+0x560/0x630 [ib_core] [ 29.606908] ? __vmalloc_node_range+0x1fb/0x320 [ 29.606917] ? __vmalloc_node+0x4b/0x70 [ 29.606924] rvt_register_device+0xfa/0x230 [rdmavt] [ 29.606944] qib_register_ib_device+0x60a/0x7a0 [ib_qib] [ 29.607000] ? mod_timer+0x19b/0x300 [ 29.607009] qib_init_one+0x156/0x400 [ib_qib] [ 29.607057] local_pci_probe+0x45/0x80 [ 29.607065] pci_device_probe+0xff/0x1b0 [ 29.607073] really_probe+0x1b8/0x3b0 [ 29.607082] __driver_probe_device+0xfb/0x170 [ 29.607088] driver_probe_device+0x1f/0x90 [ 29.607094] __driver_attach+0x96/0x160 [ 29.607099] ? __device_attach_driver+0xe0/0xe0 [ 29.607105] ? __device_attach_driver+0xe0/0xe0 [ 29.607110] bus_for_each_dev+0x77/0xc0 [ 29.607116] bus_add_driver+0x14d/0x1f0 [ 29.607122] ? qib_init_qibfs+0x11/0x11 [ib_qib] [ 29.607163] driver_register+0x6b/0xb0 [ 29.607169] ? qib_init_qibfs+0x11/0x11 [ib_qib] [ 29.607209] qib_ib_init+0x3c/0xf68 [ib_qib] [ 29.607249] do_one_initcall+0x44/0x1d0 [ 29.607260] ? __cond_resched+0x15/0x30 [ 29.607268] ? kmem_cache_alloc_trace+0x3d/0x3b0 [ 29.607277] do_init_module+0x5a/0x230 [ 29.607287] load_module+0x1afe/0x1c80 [ 29.607298] ? __do_sys_init_module+0x17a/0x1c0 [ 29.607304] __do_sys_init_module+0x17a/0x1c0 [ 29.607313] do_syscall_64+0x3a/0x80 [ 29.607321] entry_SYSCALL_64_after_hwframe+0x44/0xae [ 29.607328] RIP: 0033:0x7f9a3694e14e [ 29.607335] Code: 48 8b 0d 3d 4d 38 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 49 89 ca b8 af 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 0a 4d 38 00 f7 d8 64 89 01 48 [ 29.607340] RSP: 002b:00007fff1b64bf38 EFLAGS: 00000246 ORIG_RAX: 00000000000000af [ 29.607346] RAX: ffffffffffffffda RBX: 000056472ad6bc60 RCX: 00007f9a3694e14e [ 29.607350] RDX: 0000564729a1d8b6 RSI: 00000000000b1790 RDI: 00007f9a3239d010 [ 29.607354] RBP: 0000564729a1d8b6 R08: 000056472ad6b01a R09: 0000000000000000 [ 29.607357] R10: 000056472ad6b010 R11: 0000000000000246 R12: 00007f9a3239d010 [ 29.607360] R13: 000056472ad6bec0 R14: 0000000000040004 R15: 000056472ad6e25f [ 29.607366] </TASK> [ 29.607453] infiniband qib0: Couldn't register device with driver model [ 29.907785] kvm: VM_EXIT_LOAD_IA32_PERF_GLOBAL_CTRL does not work properly. Using workaround [ 33.448035] ib_qib 0000:03:00.0: qib0: Failed to register driver with ib core. [ 33.448096] ib_qib 0000:03:00.0: qib0: cannot register verbs: 17! [ 33.449211] ib_qib 0000:03:00.0: Disabling notifier on HCA 0 irq 34 [ 33.449222] ib_qib 0000:03:00.0: Disabling notifier on HCA 0 irq 35 [ 33.449230] ib_qib 0000:03:00.0: Disabling notifier on HCA 0 irq 36 [ 33.449241] ib_qib 0000:03:00.0: Disabling notifier on HCA 0 irq 38 [ 33.449915] ib_qib: probe of 0000:03:00.0 failed with error -17 lspci -vv 03:00.0 InfiniBand: QLogic Corp. IBA7322 QDR InfiniBand HCA (rev 02) Subsystem: QLogic Corp. IBA7322 QDR InfiniBand HCA Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx- Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- Interrupt: pin A routed to IRQ 31 Region 0: Memory at df400000 (64-bit, non-prefetchable) [size=4M] Expansion ROM at df000000 [disabled] [size=128K] Capabilities: [40] Power Management version 3 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME- Capabilities: [70] Express (v2) Endpoint, MSI 00 DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 25.000W DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+ RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop- MaxPayload 256 bytes, MaxReadReq 512 bytes DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend- LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM L0s, Exit Latency L0s <4us ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp- LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+ ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta: Speed 5GT/s (ok), Width x8 (ok) TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- DevCap2: Completion Timeout: Not Supported, TimeoutDis+ NROPrPrP- LTR- 10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix- EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit- FRS- TPHComp- ExtTPHComp- AtomicOpsCap: 32bit- 64bit- 128bitCAS- DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis+ LTR- OBFF Disabled, AtomicOpsCtl: ReqEn- LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis- Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS- Compliance De-emphasis: -6dB LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1- EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest- Retimer- 2Retimers- CrosslinkRes: unsupported Capabilities: [b0] MSI-X: Enable- Count=32 Masked- Vector table: BAR=0 offset=00008000 PBA: BAR=0 offset=00009000 Capabilities: [100 v1] Advanced Error Reporting UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UESvrt: DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol- CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr- CEMsk: RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ AdvNonFatalErr+ AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn- MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap- HeaderLog: 00000000 00000000 00000000 00000000 Kernel modules: ib_qib Any ideas? Thanks! | ||||
| Steps To Reproduce | 1. Boot into recent kernel-ml 2. Infiniband fails to properly initialize | ||||
| Tags | No tags attached. | ||||
|
|
Maybe related: https://bugzilla.redhat.com/show_bug.cgi?id=2014094 |
|
|
Maybe not. The patch in that bug report is already in the stable kernel-5.15. |
|
|
Thanks @toracat, indeed, I was just going to comment on that as I reproducing with 5.15.11-1. |
|
|
How about 5.15.10-1? What was the last version that did not have the issue? |
|
|
I have all of my systems on 5.12.13 at the moment as I have seen the least number of troubles with it and for this issue, the Infiniband card works. I have a test system at the moment and can step through some kernel releases to see if the troubles exist with each: 5.14.7-1 -> fails 5.13.9-1 -> works 5.13.12-1 -> works 5.14.1-1 -> fails 5.13.13-1 -> works 5.14.0-1 -> fails So the breaking version is at least isolated. My understanding of the `sysfs` error is that some other module is attempting to control the infiniband card? I am likely totally wrong about that. FWIW, here's a list of loaded modules on 5.14.0-1 xt_CHECKSUM 16384 1 xt_MASQUERADE 20480 6 xt_conntrack 16384 2 ipt_REJECT 16384 4 nf_reject_ipv4 16384 1 ipt_REJECT nft_compat 20480 30 nft_counter 16384 51 nft_chain_nat 16384 8 nf_nat 53248 2 nft_chain_nat,xt_MASQUERADE nf_conntrack 176128 3 xt_conntrack,nf_nat,xt_MASQUERADE nf_defrag_ipv6 24576 1 nf_conntrack nf_defrag_ipv4 16384 1 nf_conntrack nf_tables 253952 205 nft_compat,nft_counter,nft_chain_nat nfnetlink 16384 2 nft_compat,nf_tables bridge 278528 0 stp 16384 1 bridge llc 16384 2 bridge,stp mpt3sas 335872 0 raid_class 16384 1 mpt3sas rfkill 28672 1 dell_rbu 20480 0 sunrpc 655360 1 intel_powerclamp 20480 0 coretemp 20480 0 kvm_intel 315392 0 kvm 1028096 1 kvm_intel irqbypass 16384 1 kvm joydev 28672 0 crct10dif_pclmul 16384 1 crc32_pclmul 16384 0 iTCO_wdt 16384 0 ghash_clmulni_intel 16384 0 intel_pmc_bxt 16384 1 iTCO_wdt ib_qib 405504 0 rdmavt 126976 1 ib_qib dcdbas 20480 0 iTCO_vendor_support 16384 1 iTCO_wdt intel_cstate 20480 0 ib_uverbs 172032 1 rdmavt gpio_ich 16384 0 ib_core 421888 3 ib_qib,ib_uverbs,rdmavt intel_uncore 192512 0 dca 16384 1 ib_qib pcspkr 16384 0 ipmi_ssif 40960 0 lpc_ich 28672 0 i7core_edac 28672 0 ipmi_si 73728 1 ipmi_devintf 20480 2 ipmi_msghandler 118784 3 ipmi_devintf,ipmi_si,ipmi_ssif acpi_power_meter 20480 0 xfs 1769472 3 libcrc32c 16384 4 nf_conntrack,nf_nat,nf_tables,xfs sd_mod 61440 4 t10_pi 16384 1 sd_mod sr_mod 28672 0 cdrom 77824 1 sr_mod sg 40960 0 ata_generic 16384 0 pata_acpi 16384 0 mgag200 36864 0 drm_kms_helper 294912 3 mgag200 syscopyarea 16384 1 drm_kms_helper sysfillrect 16384 1 drm_kms_helper sysimgblt 16384 1 drm_kms_helper fb_sys_fops 16384 1 drm_kms_helper ata_piix 36864 0 drm 679936 3 drm_kms_helper,mgag200 libata 290816 3 ata_piix,pata_acpi,ata_generic crc32c_intel 24576 1 mptsas 69632 2 serio_raw 20480 0 mptscsih 49152 1 mptsas i2c_algo_bit 16384 1 mgag200 mptbase 102400 2 mptsas,mptscsih bnx2 94208 0 scsi_transport_sas 49152 2 mptsas,mpt3sas wmi 36864 0 dm_mirror 28672 0 dm_region_hash 24576 1 dm_mirror dm_log 20480 2 dm_region_hash,dm_mirror dm_mod 163840 12 dm_log,dm_mirror fuse 163840 1 |
|
|
Good job bisecting the kernel. It looks like the problem started when the version was updated from 5.13 to 5.14. Unfortunately this is a "big jump". There are 7 -rc (release candidates) for kernel-5.14 (from -rc1 to -rc7). We don't offer these -rc kernels (maybe available internally), making it hard to do further bisecting. |
|
|
Since RedHat released a bunch of errata yesterday, I figured I would give this another shot with the latest kernel-ml 5.15.13-1. Same result :( I also spammed the Red Hat Community forums about this issue https://access.redhat.com/discussions/6618141 and didn't yield a response yet. Will keep boggling :) There was definitely sysfs changes that went in for 5.14 release |
|
|
I continue to be stuck in the mud with this issue :( I just gave `5.16.10-1.el8.elrepo.x86_64` a spin and got the same result[ 30.575489] ib_qib 0000:03:00.0: qib0: Reserving QPNs from 0x656b78 to 0x656b78 for non-verbs use [ 30.575872] sysfs: cannot create duplicate filename '/devices/pci0000:00/0000:00:07.0/0000:03:00.0/infiniband/qib0/ports/1/linkcontrol' [ 30.575878] CPU: 12 PID: 1544 Comm: modprobe Tainted: G I E 5.16.10-1.el8.elrepo.x86_64 #1 [ 30.575883] Hardware name: Dell Inc. PowerEdge R410/01V648, BIOS 1.14.0 05/30/2018 [ 30.575885] Call Trace: [ 30.575889] <TASK> [ 30.575893] dump_stack_lvl+0x47/0x5c [ 30.575913] sysfs_warn_dup.cold.3+0x17/0x23 [ 30.575922] internal_create_group+0x365/0x380 [ 30.575931] internal_create_groups.part.4+0x3d/0xa0 [ 30.575935] ib_setup_port_attrs+0x745/0x850 [ib_core] [ 30.575979] ? klist_add_tail+0x1b/0x40 [ 30.575987] ib_register_device+0x57a/0x650 [ib_core] [ 30.576025] ? rvt_driver_mr_init+0x91/0x120 [rdmavt] [ 30.576039] rvt_register_device+0xfa/0x240 [rdmavt] [ 30.576050] qib_register_ib_device+0x60a/0x7a0 [ib_qib] [ 30.576090] ? mod_timer+0x19d/0x300 [ 30.576097] qib_init_one+0x156/0x410 [ib_qib] [ 30.576133] local_pci_probe+0x45/0x80 [ 30.576141] ? pci_match_device+0xe0/0x130 [ 30.576145] pci_device_probe+0xd1/0x1c0 [ 30.576152] really_probe+0x1b8/0x3b0 [ 30.576159] __driver_probe_device+0xfb/0x170 [ 30.576163] driver_probe_device+0x1f/0x90 [ 30.576168] __driver_attach+0x96/0x160 [ 30.576172] ? __device_attach_driver+0xe0/0xe0 [ 30.576176] ? __device_attach_driver+0xe0/0xe0 [ 30.576180] bus_for_each_dev+0x77/0xc0 [ 30.576185] bus_add_driver+0x14d/0x1f0 [ 30.576189] ? qib_init_qibfs+0x11/0x11 [ib_qib] [ 30.576217] driver_register+0x6b/0xb0 [ 30.576222] ? qib_init_qibfs+0x11/0x11 [ib_qib] [ 30.576248] qib_ib_init+0x3c/0xf68 [ib_qib] [ 30.576275] do_one_initcall+0x44/0x200 [ 30.576282] ? do_init_module+0x22/0x230 [ 30.576287] ? kmem_cache_alloc_trace+0x148/0x280 [ 30.576295] do_init_module+0x5a/0x230 [ 30.576298] load_module+0x1a83/0x1c40 [ 30.576306] ? __do_sys_init_module+0x17a/0x1c0 [ 30.576310] __do_sys_init_module+0x17a/0x1c0 [ 30.576315] do_syscall_64+0x3a/0x80 [ 30.576320] entry_SYSCALL_64_after_hwframe+0x44/0xae [ 30.576326] RIP: 0033:0x7f6a0fc9814e [ 30.576330] Code: 48 8b 0d 3d 4d 38 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 49 89 ca b8 af 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 0a 4d 38 00 f7 d8 64 89 01 48 [ 30.576334] RSP: 002b:00007ffca0abc5e8 EFLAGS: 00000246 ORIG_RAX: 00000000000000af [ 30.576339] RAX: ffffffffffffffda RBX: 000055dd2edc4c60 RCX: 00007f6a0fc9814e [ 30.576341] RDX: 000055dd2e61d8b6 RSI: 00000000000af810 RDI: 00007f6a0b6ed010 [ 30.576343] RBP: 000055dd2e61d8b6 R08: 000055dd2edc401a R09: 0000000000000000 [ 30.576345] R10: 000055dd2edc4010 R11: 0000000000000246 R12: 00007f6a0b6ed010 [ 30.576347] R13: 000055dd2edc4ec0 R14: 0000000000040004 R15: 000055dd2edc71ff [ 30.576352] </TASK> [ 30.576493] infiniband qib0: Couldn't register device with driver model [ 30.782421] kvm: VM_EXIT_LOAD_IA32_PERF_GLOBAL_CTRL does not work properly. Using workaround [ 34.411302] ib_qib 0000:03:00.0: qib0: Failed to register driver with ib core. [ 34.411375] ib_qib 0000:03:00.0: qib0: cannot register verbs: 17! [ 34.412087] ib_qib 0000:03:00.0: Disabling notifier on HCA 0 irq 34 [ 34.412096] ib_qib 0000:03:00.0: Disabling notifier on HCA 0 irq 35 [ 34.412103] ib_qib 0000:03:00.0: Disabling notifier on HCA 0 irq 36 [ 34.412137] ib_qib 0000:03:00.0: Disabling notifier on HCA 0 irq 38 [ 34.412760] ib_qib: probe of 0000:03:00.0 failed with error -17 Any ideas? Thanks and sorry. |
|
|
Looks like this issue has been reported upstream at kernel.org and the fix is coming soon in kernel 5.17. https://lore.kernel.org/linux-rdma/1645106372-23004-1-git-send-email-mike.marciniszyn@cornelisnetworks.com/ |
|
|
Oooooo, that's awesome, thanks @toracat for finding that! |
|
|
@akrherz If you'd like try it out, look in: https://elrepo.org/people/ajb/devel/kernel-ml/el8/x86_64/RPMS/ (thanks to burakkucat) |
|
|
I tried out 5.17.0-0.rc5 and got the same error [ 26.512556] sysfs: cannot create duplicate filename '/devices/pci0000:00/0000:00:07.0/0000:03:00.0/infiniband/qib0/ports/1/linkcontrol' [ 26.512561] CPU: 0 PID: 1515 Comm: modprobe Tainted: G I E 5.17.0-0.rc5.el8.elrepo.x86_64 #1 are you sure this patch made it into rc5 ? I don't see it here yet https://github.com/torvalds/linux/tree/master/drivers/infiniband/hw/qib |
|
|
According to: https://lore.kernel.org/all/CAJt3DjAEjZbM9uQSAq1LTdNz=XGGsNT225a5YPzHEqZdHDcHJw@mail.gmail.com/ "Tested on 5.17 and my ports are back. I can confirm the patch works." It's dated Feb 17. |
|
|
I think Robin just tested the patch locally, I'll monitor Linus's tree to watch of its inclusion. It does not appear to be a part of the rc-5 tag. |
|
|
Maybe you are right. I just checked the source code of -rc5. The patch is not there yet. :( |
|
|
@akrherz I just learned from @burakkucat that he has built kernel-ml-5.17.0-0.rc6.el8.elrepo and it has the patch you've been waiting for. Look in: https://elrepo.org/people/ajb/devel/kernel-ml/el8/x86_64/RPMS/ |
|
|
Agreed, it is here and tagged against rc6! https://github.com/torvalds/linux/commit/32f57cb1b2c8d6f20aefec7052b1bfeb7e3b69d4 So excited, will try it in a few hours. Horray! |
|
|
5.17.0-0.rc6.el8.elrepo.x86_64 works! Thank you so much :) I don't see a means to close this issue, so please do if appropriate. |
|
|
Thanks for reporting back. Now closing as 'resolved'. |
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2021-12-27 07:38 | akrherz | New Issue | |
| 2021-12-27 07:38 | akrherz | Status | new => assigned |
| 2021-12-27 07:38 | akrherz | Assigned To | => burakkucat |
| 2021-12-27 11:48 | toracat | Note Added: 0008112 | |
| 2021-12-27 12:13 | toracat | Note Added: 0008113 | |
| 2021-12-27 12:29 | akrherz | Note Added: 0008114 | |
| 2021-12-28 18:51 | toracat | Note Added: 0008120 | |
| 2021-12-29 08:32 | akrherz | Note Added: 0008125 | |
| 2021-12-29 14:44 | toracat | Note Added: 0008133 | |
| 2022-01-05 11:14 | akrherz | Note Added: 0008147 | |
| 2022-02-23 10:07 | akrherz | Note Added: 0008211 | |
| 2022-02-23 12:26 | toracat | Note Added: 0008212 | |
| 2022-02-23 12:29 | akrherz | Note Added: 0008213 | |
| 2022-02-23 12:34 | toracat | Note Added: 0008214 | |
| 2022-02-23 12:46 | akrherz | Note Added: 0008215 | |
| 2022-02-23 12:54 | toracat | Note Added: 0008216 | |
| 2022-02-23 13:01 | akrherz | Note Added: 0008217 | |
| 2022-02-23 13:09 | toracat | Note Added: 0008218 | |
| 2022-02-23 16:05 | burakkucat | Assigned To | burakkucat => toracat |
| 2022-02-27 18:44 | toracat | Note Added: 0008226 | |
| 2022-02-27 19:02 | akrherz | Note Added: 0008227 | |
| 2022-02-27 21:46 | akrherz | Note Added: 0008228 | |
| 2022-02-27 22:24 | toracat | Status | assigned => resolved |
| 2022-02-27 22:24 | toracat | Resolution | open => fixed |
| 2022-02-27 22:24 | toracat | Note Added: 0008229 |
