QA Session Recordings

# linux QA Video Report - Generated at: 2026-04-12T13:52:19.952Z - Model: `gemini-3-flash-preview` - Target: https://github.com/Comfy-Org/ComfyUI_frontend/issues/10288 - Source video: `./qa-artifacts/qa-report-Linux-24307528181/qa-session.mp4` - Video size: 853.8 KB ## AI Review ## Summary The video confirms several accessibility regressions reported in Issue #10288, specifically focusing on the settings panel. It demonstrates the visual detachment between labels and controls due to excessive whitespace and the poor visibility of scrollbars. The video does not cover the startup splash flash or animation-related issues. ## Confirmed Issues ### Settings Panel Readability: Labels detached from controls `HIGH` `00:06` `Confidence: High` Labels and their corresponding controls (toggle switches, input fields) in the settings panel are positioned at opposite ends of a wide container. This creates a large gap of empty whitespace (approx. 350-400px), making it difficult for users to visually associate a label with its correct control. **Evidence:** Between 00:06 and 00:34, the video explicitly highlights rows in the settings panel where the label is on the far left and the toggle is on the far right. The narrator explains that the label container uses `flex-grow`, pushing controls to the edge. **Suggested Fix:** Reduce the maximum width of the settings container or use a layout that keeps controls closer to their labels, perhaps by aligning controls to the left after a fixed-width label column or adding dotted "leader lines" between them. ### Low-contrast, thin scrollbars `MEDIUM` `00:10` `Confidence: High` The scrollbar in the settings panel is extremely thin and has very low contrast against the dark background, making it nearly invisible and difficult to interact with. **Evidence:** Throughout the video, the scrollbar on the right edge of the "Settings" modal is visible as a very thin, dark grey line that is hard to distinguish from the black background of the panel. **Suggested Fix:** Increase the width of the scrollbar and improve its contrast by using a lighter color for the scrollbar thumb in dark mode. --- ## Possible Issues (Needs Human Verification) - **Text Readability**: While the narrator mentions text size issues, it is difficult to assess if text is "smaller" than previous versions without a side-by-side comparison with v0.16.4. However, the overall information density in the settings panel appears low due to the spacing. ## Overall Risk `Medium` The confirmed issues represent significant accessibility barriers. For users with visual or motor impairments, the detachment of controls from labels and the hard-to-see scrollbars can make the application's configuration difficult or impossible to use effectively. ## Narration The video contains a TTS narration: "Look at a settings row — the label text is on the far left, but the control widget is pushed to the far right edge with hundreds of pixels of empty space between them. The label container uses flex-grow and fills the entire content area. Only the label text (about 100px wide) is visible — the remaining 350 to 400 pixels of the container are empty whitespace. This means a user must visually scan hundreds of pixels across the dialog to connect each label to its toggle or control — a severe accessibility barrier." ## Verdict {"verdict": "REPRODUCED", "risk": "medium", "confidence": "high", "narrationDetected": true} --- # linux QA Video Report - Generated at: 2026-04-12T13:37:27.294Z - Model: `gemini-3-flash-preview` - Target: https://github.com/Comfy-Org/ComfyUI_frontend/issues/10288 - Source video: `./qa-artifacts/qa-report-Linux-24307528181/qa-session-1.mp4` - Video size: 27.7 MB ## AI Review ## Summary The video fails to reproduce the reported accessibility regressions. The reproduction steps require the UI to be in **light mode** to observe the "startup splash flash," but the user in the video remains in **dark mode** throughout the session. Additionally, the user does not open the settings panel, interact with scrollbars, or trigger any job popups as described in the issue. After the initial 8 seconds of loading, the video shows over 4 minutes of an idle, static screen. ## Confirmed Issues No issues from the report were confirmed in this video. ## Possible Issues (Needs Human Verification) ### Missing Test Steps `LOW` `00:09` `Confidence: High` The test session stops interacting with the UI almost immediately after login. The reporter does not switch to light mode, open the settings panel (where readability issues were reported), or perform any actions that would reveal scrollbars or job popups. **Evidence:** From 00:09 to 04:44, the video shows a static, empty dark-mode graph with no user interaction. **Suggested Fix:** Re-run the test following the specific steps: switch to light mode, open settings, and trigger a workflow to observe animations and popups. ## Overall Risk The video provides no evidence of the reported regressions, but it also fails to disprove them because the necessary conditions (light mode, settings interaction) were not met. The risk remains unverified. ## Narration No narration detected. ## Verdict {"verdict": "INCONCLUSIVE", "risk": null, "confidence": "high", "narrationDetected": false} --- # linux QA Video Report - Generated at: 2026-04-12T13:42:27.129Z - Model: `gemini-3-flash-preview` - Target: https://github.com/Comfy-Org/ComfyUI_frontend/issues/10288 - Source video: `./qa-artifacts/qa-report-Linux-24307528181/qa-session-2.mp4` - Video size: 45.7 MB ## AI Review ## Summary The video is **INCONCLUSIVE** regarding the reproduction of the reported accessibility regressions. The video recording shows the initial application splash and login sequence, but it fails to follow the primary reproduction steps (specifically using the UI in Light Mode). Furthermore, after the initial load at 00:05, the video remains completely static on a dark-themed workspace with a "required model missing" error for the remaining 6 minutes and 36 seconds, with no UI interactions performed. ## Confirmed Issues No issues from the bug report were confirmed. The video did not demonstrate Light Mode usage, the settings panel, scrollbar interaction, or job queue popups. ## Possible Issues (Needs Human Verification) ### Static Session / Recording Failure `HIGH` `00:05` `Confidence: High` The video enters a static state at 00:05 and remains unchanged until the end at 06:41. No mouse movement, typing, or UI updates occur. This suggests either the automated test script hung or the recording environment failed. **Evidence:** The frame at 00:05 is identical to the frame at 06:40. ## Overall Risk The overall risk is **High** because the provided reproduction video is a failure. It does not test the reported accessibility regressions, and the 6-minute static hang indicates a significant issue with the testing pipeline or the application's stability in the test environment. ## Narration No narration detected. ## Verdict {"verdict": "INCONCLUSIVE", "risk": "high", "confidence": "high", "narrationDetected": false} --- # linux QA Video Report - Generated at: 2026-04-12T13:47:26.362Z - Model: `gemini-3-flash-preview` - Target: https://github.com/Comfy-Org/ComfyUI_frontend/issues/10288 - Source video: `./qa-artifacts/qa-report-Linux-24307528181/qa-session-3.mp4` - Video size: 41.3 MB ## AI Review ## Summary The video attempts to reproduce accessibility regressions reported in version 0.17.2, specifically focusing on the startup splash, settings readability, and UI animations. However, the video fails to perform the necessary setup (switching to light mode) or the reproduction steps (opening settings, running a queue). Additionally, the workspace fails to load functional nodes due to a missing model error, and the video remains idle for over 6 minutes without further interaction. ## Confirmed Issues No issues from the report were confirmed because the required UI states were not reached. ## Possible Issues (Needs Human Verification) ### Missing Test Prerequisites `HIGH` `00:05` `Confidence: High` The test session encountered a blocking error immediately upon loading the workspace: "1 required model is missing." This prevented any interaction with the queue or progress UI, which was necessary to observe the reported animation regressions. **Evidence:** An error dialog appears at 00:05 and remains for the duration of the recording. **Suggested Fix:** Ensure the testing environment has the required models (`v1-5-pruned-emaonly-fp16.safetensors`) installed before running the accessibility audit. ## Overall Risk `HIGH` The test session is highly ineffective. It does not toggle the "Light" theme, which is a prerequisite for observing the "dark flash" and scrollbar contrast issues. The failure to interact with the UI after the initial error message means none of the reported regressions were actually tested. ## Narration No narration detected. ## Verdict INCONCLUSIVE {"verdict": "INCONCLUSIVE", "risk": "high", "confidence": "high", "narrationDetected": false}