AI: Improve AccessibilityAgent preamble and add context tools

This CL improves the AccessibilityAgent by updating its preamble to
be more structured and proactive. It also adds new tools that allow
the agent to fetch live page data using Lighthouse paths.

- Updated the preamble to enforce a "problem, root cause, next steps"
  structure and prioritize critical issues.
- Added `getStyles` to fetch computed styles for elements identified
  in the Lighthouse report. This function is similar to the one in the
  StylingAgent, but it uses a different look-up system as LH only has
  the path not the backend node IDs.
- Added `getElementAccessibilityDetails` to fetch live accessibility
  properties (role, name, ARIA attributes) using the AccessibilityModel.
- Implemented a private helper to resolve Lighthouse paths to DOM nodes.
- Added unit tests for the new functionality.

The preamble will need syncing to the server, and also I'm still testing
how often the agent calls these functions, but I wanted to land this as
as starting point.

Bug: 489620101
Change-Id: I978de38a189f848991a5999e5e69b7ba158cef46
Reviewed-on: https://chromium-review.googlesource.com/c/devtools/devtools-frontend/+/7679406
Reviewed-by: Alina Varkki <alinavarkki@chromium.org>
Auto-Submit: Jack Franklin <jacktfranklin@chromium.org>
Commit-Queue: Alina Varkki <alinavarkki@chromium.org>
2 files changed
tree: d706ece0fbaa65e1a4262e57bb7b70291db2dc46
  1. .agents/
  2. .gemini/
  3. .github/
  4. .vscode/
  5. build_overrides/
  6. config/
  7. docs/
  8. extension-api/
  9. extensions/
  10. front_end/
  11. inspector_overlay/
  12. mcp/
  13. node_modules/
  14. scripts/
  15. test/
  16. third_party/
  17. v8/
  18. .clang-format
  19. .clang-format-ignore
  20. .editorconfig
  21. .env.template
  22. .geminiignore
  23. .git-blame-ignore-revs
  24. .gitallowed
  25. .gitattributes
  26. .gitignore
  27. .gitmodules
  28. .gn
  29. .mailmap
  30. .npmignore
  31. .npmrc
  32. .style.yapf
  33. .stylelintignore
  34. .stylelintrc.json
  35. AUTHORS
  36. BUILD.gn
  37. codereview.settings
  38. CONTRIBUTING.md
  39. DEPS
  40. DIR_METADATA
  41. eslint.config.mjs
  42. favicon.ico
  43. LICENSE
  44. OWNERS
  45. package-lock.json
  46. package.json
  47. PRESUBMIT.py
  48. README.md
  49. WATCHLISTS
README.md

Chrome DevTools frontend

npm package

The client-side of the Chrome DevTools, including all TypeScript & CSS to run the DevTools webapp.

Source code and documentation

The frontend is available on chromium.googlesource.com. Check out the Chromium DevTools documentation for instructions to set up, use, and maintain a DevTools front-end checkout, as well as design guidelines, and architectural documentation.

Source mirrors

DevTools frontend repository is mirrored on GitHub.

DevTools frontend is also available on NPM as the chrome-devtools-frontend package. It's not currently available via CJS or ES modules, so consuming this package in other tools may require some effort.

The version number of the npm package (e.g. 1.0.373466) refers to the Chromium commit position of latest frontend git commit. It's incremented with every Chromium commit, however the package is updated roughly daily.

Getting in touch

There are a few options to keep an eye on the latest and greatest of DevTools development: