QA Session Recordings

# linux QA Video Report - Generated at: 2026-04-02T04:23:07.016Z - Model: `gemini-3-flash-preview` - Target: https://github.com/Comfy-Org/ComfyUI_frontend/issues/10288 - Source video: `./qa-artifacts/qa-report-Linux-23882940794/qa-session.mp4` - Video size: 375.5 KB ## AI Review ## Phase 1: Blind Observation (describe what you SEE) - **00:00 - 00:01**: The screen is entirely white. - **00:01 - 00:02**: A faint white-on-white "Comfy" logo appears in the center. - **00:02 - 00:03**: A black, liquid-like wavy animation representing "ComfyUI" text appears abruptly in the center of the white screen. - **00:03 - 00:04**: The UI transitions to a dark-themed canvas with nodes (Dark Mode). - **00:05**: The user moves the cursor to the left sidebar and clicks the **Settings** (gear) icon. - **00:05**: A "Settings" modal opens. It contains a left navigation pane and a right content pane. - **00:06**: In the "Comfy" section of settings, several rows are visible (Nodes 2.0, API Nodes, etc.). Labels are aligned to the extreme left, while toggles and input boxes are aligned to the extreme right. There is a large empty space between the label text and the interactive control. A very thin, dark gray scrollbar is visible on the right edge of the content pane. - **00:07**: The user clicks on **Appearance** in the settings sidebar. - **00:07 - 00:08**: The user types "animation" into the "Search settings..." box. - **00:08**: The results show "Appearance > General" with a "Disable animations" toggle. The toggle is currently off. ## Phase 2: Compare against expected behavior The video confirms several points of the accessibility regression reported in **Issue #10288**: 1. **Startup splash/animation flash**: The video shows a high-contrast transition at **00:02** where a dark, moving animation appears suddenly on a stark white background. Although the final state in the video is Dark Mode (not the Light Mode mentioned by the reporter), the presence of a high-motion splash screen is confirmed. 2. **Settings panel readability**: At **00:06**, the visual detachment of controls is clearly visible. For "Edit Token Weight", the label is on the far left and the numeric input is on the far right, separated by several inches of empty space, making it difficult to track which control belongs to which row. 3. **Thin, low-contrast scrollbars**: At **00:06**, the scrollbar in the settings modal is extremely thin and has low contrast against the dark background, making it difficult to locate. 4. **Extra UI animations**: The startup animation is confirmed. The user is seen searching for a "Disable animations" toggle at **00:08**, confirming that while a setting exists, the startup animation may have bypassed it or is not yet disabled for this user. ## Summary The video reproduces several accessibility regressions reported in Issue #10288. Specifically, it confirms the high-motion startup splash animation, the detached layout of the settings panel, and the low-contrast, thin scrollbars. ## Confirmed Issues ### Startup Splash Animation High Contrast/Motion `HIGH` `00:02` `Confidence: High` The startup animation features a black liquid/wave effect that appears suddenly over a white background. This matches the reporter's description of a "startup flash + motion" that could be photosensitive-triggering. **Evidence:** At 00:02, the "ComfyUI" text animates with a wavy distortion effect in high-contrast black on white. **Suggested Fix:** Provide a way to completely bypass the splash screen or ensure it respects `prefers-reduced-motion` and matches the user's theme earlier in the load process. ### Settings Panel Visual Detachment `MEDIUM` `00:06` `Confidence: High` Labels and controls in the settings modal are pushed to opposite horizontal ends of the container. This creates a "scanning" burden for users, as reported. **Evidence:** At 00:06, the "Edit Token Weight" label is on the far left of the modal, while the input field is on the far right, with no visual horizontal guides. **Suggested Fix:** Reduce the maximum width of the settings content or add subtle row highlights/zebra-striping to guide the eye from label to control. ### Low-Contrast Thin Scrollbars `MEDIUM` `00:06` `Confidence: High` The scrollbars are extremely narrow and use a color that barely stands out from the container background. **Evidence:** A very thin gray line is barely visible on the right side of the Settings content pane at 00:06. **Suggested Fix:** Increase the width of the scrollbar and improve the contrast ratio of the scrollbar thumb against the track. ## Possible Issues (Needs Human Verification) - **Text Size Consistency**: Some text in the settings panel (labels vs descriptions) appears to have inconsistent sizing, but without a side-by-side comparison with v0.16.4, it is difficult to quantify as a regression. ## Overall Risk The reported issues represent significant accessibility barriers for users with visual impairments or photosensitivity. The startup flash is a high-severity risk for photosensitive users. ## Verdict REPRODUCED {"verdict": "REPRODUCED", "risk": "high", "confidence": "high"} --- # linux QA Video Report - Generated at: 2026-04-02T04:08:08.711Z - Model: `gemini-3-flash-preview` - Target: https://github.com/Comfy-Org/ComfyUI_frontend/issues/10288 - Source video: `./qa-artifacts/qa-report-Linux-23882940794/qa-session-1.mp4` - Video size: 11.6 MB ## AI Review ## Summary The video shows the initial loading sequence of the ComfyUI frontend, but it fails to reproduce the reported accessibility regressions. The reporter specifically highlighted issues that occur when using **light mode**, however, the test session recorded is conducted entirely in **dark mode**. Furthermore, the tester does not open the settings panel, interact with scrollbars, or trigger any job popups, which were the primary areas of concern in the bug report. Most of the video consists of a static screen with no interactions. ## Confirmed Issues No issues from the report were confirmed as the necessary UI elements and modes were not accessed. ## Possible Issues (Needs Human Verification) ### Theme Mismatch during Startup `LOW` `00:01` `Confidence: Medium` The video shows a white splash screen (00:00) that transitions abruptly to a dark login screen (00:01). While the report describes a "dark flash" before returning to "light mode," the video shows the inverse (light splash before dark mode). This suggests that the splash screen theme does not currently synchronize with the user's preferred theme or the application's stored theme before initialization, which can cause a "flash" effect. ## Overall Risk The video is insufficient to assess the risk of the reported regressions. However, the lack of interaction with the settings panel and light mode means the high-priority accessibility concerns (readability, contrast, and motion) remain unverified. ## Verdict **INCONCLUSIVE** {"verdict": "INCONCLUSIVE", "risk": null, "confidence": "high"} --- # linux QA Video Report - Generated at: 2026-04-02T04:13:04.773Z - Model: `gemini-3-flash-preview` - Target: https://github.com/Comfy-Org/ComfyUI_frontend/issues/10288 - Source video: `./qa-artifacts/qa-report-Linux-23882940794/qa-session-2.mp4` - Video size: 24.7 MB ## AI Review ## Summary The issue report ( #10288) describes multiple accessibility regressions in version 0.17.2, specifically focusing on a "flash-bang" effect during startup when using light mode, poor readability/layout in the settings panel, and low-contrast/thin scrollbars. The video is **INCONCLUSIVE**. While it captures the startup sequence, the application is configured in **dark mode**, whereas the report specifically highlights issues occurring in **light mode**. Furthermore, the user never opens the settings panel or interacts with the UI beyond the initial login, failing to perform the specific steps required to observe the reported regressions. ## Confirmed Issues No issues from the report were confirmed because the prerequisite environment (Light Mode) and the required interactions (Opening Settings) were not performed. ## Possible Issues (Needs Human Verification) ### Startup "Flash" `LOW` `00:01` `Confidence: Medium` The video shows the initial page load starts with a solid white/light-gray background and logo (`00:00`), which immediately transitions to a dark gray splash screen/login page (`00:01`). While the user is in dark mode, this confirms a significant brightness shift (light to dark) exists during initialization, which supports the reporter's claim of a "photosensitive-triggering" flash, albeit in the opposite direction (light to dark vs dark back to light). ### Thin Scrollbars `LOW` `00:04` `Confidence: High` The scrollbars visible on the "Load Checkpoint" node and the right-hand panel are extremely thin (visually ~6px). This aligns with the reporter's description of scrollbars being "too thin," though contrast cannot be evaluated for light mode. **Evidence:** Visible scrollbar on the left side of the "Load Checkpoint" node at `00:04`. ## Overall Risk The video does not provide enough evidence to assess the risk of the reported regressions. However, the presence of a 3-minute-long static screen after an "Error" popup (`00:05`) suggests the test environment might be broken or improperly configured for this reproduction. ## Verdict **INCONCLUSIVE** {"verdict": "INCONCLUSIVE", "risk": null, "confidence": "low"} --- # linux QA Video Report - Generated at: 2026-04-02T04:18:09.374Z - Model: `gemini-3-flash-preview` - Target: https://github.com/Comfy-Org/ComfyUI_frontend/issues/10288 - Source video: `./qa-artifacts/qa-report-Linux-23882940794/qa-session-3.mp4` - Video size: 20.2 MB ## AI Review ## Phase 1: Blind Observation (describe what you SEE) - **00:00**: The screen displays a pure white background with a grey "Comfy" logo in the center (Startup splash). - **00:01**: The background abruptly changes to dark grey. A centered "ComfyUI" login dialog appears. - **00:02**: The user clicks the "Existing user:" dropdown. - **00:03**: The user selects "qa-ci" and clicks the "Next" button. - **00:04**: The main application interface loads. The UI is in **dark mode**. - **00:05**: An "ERROR" notification appears in the top-right corner stating "1 required model is missing". A red border appears around the "Load Checkpoint" node. - **00:19**: The user clicks the "Run" button in the top navigation bar. - **00:20 - 02:55**: The screen remains static. No further mouse movements, clicks, scrolling, or menu interactions occur for the remainder of the video. ## Phase 2: Compare against expected behavior The video fails to follow the reproduction steps outlined in **Issue #10288**. 1. **Startup splash flash**: The issue reports a dark flash for users in **light mode**. The video shows a white splash screen followed by a dark login screen and a dark main UI. Because the user never switches to or starts in light mode, the reported "return to light mode" transition cannot be evaluated. 2. **Settings panel readability**: **NOT SHOWN**. The user never opens the settings panel to inspect label alignment or layout. 3. **Low-contrast scrollbars**: **NOT SHOWN**. There is no interaction with scrollable regions (like the node library or long settings lists) to evaluate scrollbar visibility. 4. **Animations and Job popups**: **NOT SHOWN**. The workflow fails immediately due to a missing model, so no queue progress animations or "intrusive" job popups are triggered. 5. **UI text size**: While text is visible, without a side-by-side comparison to version 0.16.4 or a review of the settings panel text, this cannot be confirmed as a regression from the video alone. ## Summary The issue reports several accessibility regressions specifically affecting light mode users and the settings panel layout. The provided video shows the application loading in dark mode and remains on a static workspace for nearly three minutes without navigating to any of the affected UI areas (Settings, Scrollbars, or Queue notifications). Because the reproduction steps were not followed, the bug is not visible. ## Confirmed Issues None. ## Possible Issues (Needs Human Verification) ### Incorrect Theme for Reproduction `LOW` `00:04` `Confidence: High` The reporter specifically mentions issues using the frontend in **light mode**. The video shows the tester proceeding in **dark mode**, which bypasses the primary visual triggers described (the dark flash before returning to light theme). ### Incomplete Test Session `LOW` `00:20` `Confidence: High` The video stops recording active interactions after 20 seconds, remaining static until 02:55. None of the specific UI elements mentioned in the bug report (Settings panel, scrollbars, or animations) were interacted with or displayed. ## Overall Risk Low (The video does not demonstrate the bug, but it also does not prove the bug is fixed, as the steps were not followed). ## Verdict INCONCLUSIVE {"verdict": "INCONCLUSIVE", "risk": "low", "confidence": "high"}