Google Git Google Git
Sign in
chromium/chromium/src/agents/testing/HEAD
  1. b1f0d9a Ruff: explicitly set legacy 0.15 default lint rules. by Alex Ovsienko · 6 days ago main
  2. 23d786e Ruff lint: relint //agents with ruff and remove pylint usage. by Alex Ovsienko · 6 days ago
  3. 095dac2 presubmit: Fast-path nested PRESUBMITs in agents/, gpu/, and content/test/gpu/ (part 6 of 8) by James Hawkins · 6 days ago
  4. a4b1ea9 Ruff: reformat agents. by Alex Ovsienko · 6 days ago
  5. 740b772 Add automatic prompt eval for feature_flags_add by Bryan Kim · 6 days ago
  6. d3cc656 Update //agents presubmits to support absolute imports by Brian Sheedy · 6 days ago
  7. 57ca2fd Add auto-rater capabilities to auto prompt eval by Bryan Kim · 6 days ago
  8. cdff08f doc: Add an instruction about virtualized workspace path for builds on Btrfs by Junji Watanabe · 6 days ago
  9. 2e0b0d4 Add support for internal prompts/skills and mock commands in testing. by Nathan Scoglio · 6 days ago
  10. 4d688ce Remove strip call on git status result by Bryan Kim · 6 days ago
  11. 45e8478 Fix and promote adapt_builder to stable by Bryan Kim · 6 days ago
  12. 7655bdd Exclude prompt files from format check and update instructions by Joe Mason · 6 days ago
  13. b186849 Upgrade Gemini CLI version used for tests by Brian Sheedy · 6 days ago
  14. 318f0c3 Default to and correctly use hermetic gCLI by Brian Sheedy · 6 days ago
  15. 11222f9 Use virtual siso paths for prompt evals by Brian Sheedy · 6 days ago
  16. 5dce4e6 Switch prompt eval tests to Gemini 3 Flash by Brian Sheedy · 6 days ago
  17. 0536a0f Support launching gemini.ps1 on Windows by Greg Thompson · 6 days ago
  18. 83bc1fb Kill promptfoo process group by Brian Sheedy · 6 days ago
  19. e3978f8 Enable prompt eval fetch error retries by Brian Sheedy · 6 days ago
  20. 633b3e8 Switch prompt eval model to 2.5 pro by Brian Sheedy · 6 days ago
  21. d94893d Change prompt eval model to flash by Brian Sheedy · 6 days ago
  22. ad53cdf Update prompt eval model by Brian Sheedy · 6 days ago
  23. 7028321 Specify model for prompt eval tests by Brian Sheedy · 6 days ago
  24. 90c9361 Update prompt eval dependencies by Brian Sheedy · 6 days ago
  25. d62053a Populate fuzzing skill by Jon Toohill · 6 days ago
  26. aa1f39c Add --list-tests to eval_prompts by Sven Zheng · 6 days ago
  27. 8335448 Add support for extra test paths in eval_prompts.py by Ashwin Verleker · 6 days ago
  28. 43cb8f1 Add a new evaluation for class refactoring. by Jie Sheng · 6 days ago
  29. b472bf0 Set system prompts correctly by Struan Shrimpton · 6 days ago
  30. d1fbce4 Revert "Update promptfoo cipd tags" by Struan Shrimpton · 6 days ago
  31. 5c46dce Update promptfoo cipd tags by Struan Shrimpton · 6 days ago
  32. 8b1babd Include the prompt/response in the rdb test result by Struan Shrimpton · 6 days ago
  33. ac54af9 Support tool call checks in gemini cli eval framework. by Jie Sheng · 6 days ago
  34. 622e1be Make owners explicit by Struan Shrimpton · 6 days ago
  35. c6c41f4 Improve the test log output in gemini cli eval framework. by Jie Sheng · 6 days ago
  36. 0291d1f Include the test tags in the rdb tags by Struan Shrimpton · 6 days ago
  37. 0be016e Update prompt eval metric reporting by Brian Sheedy · 6 days ago
  38. 16f19ab Create a new gemini cli eval to build a file. by Jie Sheng · 6 days ago
  39. a0db354 Tag rdb results with their metrics by Struan Shrimpton · 6 days ago
  40. 2c80c47 Update run_tests_in_file by Struan Shrimpton · 6 days ago
  41. fb23141 Clean workdirs regardless of forced by Struan Shrimpton · 6 days ago
  42. a2806c3 [agents][eval] Store system prompt in `//GEMINI.md` by Jonathan Lee · 6 days ago
  43. a4eea75 Create a new gemini cli eval to verify run tests in file. by Jie Sheng · 6 days ago
  44. 21bb149 Move perf uploading to handler by Brian Sheedy · 6 days ago
  45. be677c7 eval: Add negative tag filtering for tests by James Woo · 6 days ago
  46. 4030cd1 Move ResultDB reporting to handler by Brian Sheedy · 6 days ago
  47. 389faaa Support user-provided result handlers by Brian Sheedy · 6 days ago
  48. fb9d8fc Separate reporting for each iteration by Struan Shrimpton · 6 days ago
  49. 7c4d2d3 eval: Add test filtering on metadata by James Woo · 6 days ago
  50. fd7c69c Adjust prompt eval perf upload location by Brian Sheedy · 6 days ago
  51. 7faded4 Reland "Eval Prompts: Add custom node support and cipd option for gcli" by Struan Shrimpton · 6 days ago
  52. 2bdf810 Revert "Eval Prompts: Add custom node support and cipd option for gcli" by Struan Shrimpton · 6 days ago
  53. 6ef99b3 Fix perf uploading location by Brian Sheedy · 6 days ago
  54. 611cae3 Eval Prompts: Add custom node support and cipd option for gcli by Struan Shrimpton · 6 days ago
  55. 18b5e3e Adjust perf upload format by Brian Sheedy · 6 days ago
  56. c58193f Add prompt eval metric uploading by Brian Sheedy · 6 days ago
  57. ea61c8f Prompt Evals: specify precompile_targets on the test by Struan Shrimpton · 6 days ago
  58. 5f241bb Eval Prompts: Remove promptfoo npm/src by Struan Shrimpton · 6 days ago
  59. 5a03290 Prompt Eval: Improve test reliability by Struan Shrimpton · 6 days ago
  60. 8b1912c Eval Prompts: Improve readability of test results by Struan Shrimpton · 6 days ago
  61. 3f5492e Refactor test/iteration results by Brian Sheedy · 6 days ago
  62. 08cb213 Add pass@k support to prompt evals by James Woo · 6 days ago
  63. 4c3c3b9 Adjust args for perf dashboard uploading by Brian Sheedy · 6 days ago
  64. 7d76fc3 Prevent unit tests from pulling cipd packages by Struan Shrimpton · 6 days ago
  65. 00afbda Eval prompts: fix default gemini bin for 1P by Struan Shrimpton · 6 days ago
  66. 23d803b Eval Prompts: Add trusted folders for temp HOME dir by Struan Shrimpton · 6 days ago
  67. a222faf Add and use by default cipd promptfoo by Struan Shrimpton · 6 days ago
  68. 8d6feea Use settings.json for gemini-cli telemetry by Brian Sheedy · 6 days ago
  69. 930f5bc Extract prompt eval scores by Brian Sheedy · 6 days ago
  70. 46c29b8 Update //agents/testing/README by Struan Shrimpton · 6 days ago
  71. 0cc3ad0 Surface gemini-cli token usage by Brian Sheedy · 6 days ago
  72. d3dd0cd Update eval_prompts for structured test ids by Struan Shrimpton · 6 days ago
  73. 6519c56 agents: Add pass@k configuration parsing by James Woo · 6 days ago
  74. 89a37c1 Fix gemini_provider console width parsing by Brian Sheedy · 6 days ago
  75. d07e352 Refactor gemini_provider's call_api by Brian Sheedy · 6 days ago
  76. ebd6f6f Docs: Improve btrfs setup instructions by James Woo · 6 days ago
  77. 8dff1af agents: Centralize Gemini helper functions by James Woo · 6 days ago
  78. 58b9595 feat(eval): Set sandbox PATH from container image by James Woo · 6 days ago
  79. e7dd537 Add an unrestricted parallel option by Struan Shrimpton · 6 days ago
  80. fd00991 [agents][eval] Introduce reusable `check_gtests.py` assert by Jonathan Lee · 6 days ago
  81. 4d4b48d [agents][eval] Enable `use_remoteexec` to speed up builds by Jonathan Lee · 6 days ago
  82. 81322b0 feat(eval): Mount depot_tools in sandbox by James Woo · 6 days ago
  83. 8db69c8 Add missing prompt eval arg by Brian Sheedy · 6 days ago
  84. 0089d4a refactor(eval): Directly fetch sandbox image by James Woo · 6 days ago
  85. d2bea7e Add remaining isolated script args + validation by Brian Sheedy · 6 days ago
  86. 0411761 Add prompt eval --isolated-script-test-repeat by Brian Sheedy · 6 days ago
  87. d656cc7 feat(eval): Use temp home for test environments by James Woo · 6 days ago
  88. 4a9f914 Update prompt eval test filtering by Brian Sheedy · 6 days ago
  89. 695746b Rename example and test extensions with underscores by Struan Shrimpton · 6 days ago
  90. 2926081 Refactor prompt eval argument parsing by Brian Sheedy · 6 days ago
  91. 75d5c6a Update build_information MCP to build-information by Struan Shrimpton · 6 days ago
  92. 405db56 Add OWNERS to extensions and testing by Struan Shrimpton · 6 days ago
  93. 1f0cc15 Add missing //agents/testing tests by Brian Sheedy · 6 days ago
  94. 4f58035 feat(eval): Add support for local dev binaries by James Woo · 6 days ago
  95. d590ab7 Reland "Add presubmit checks for `promptfoo.yaml` files." by Jiamei Liu · 6 days ago
  96. 29a1543 [6/6] Parallel worker cleanup by Brian Sheedy · 6 days ago
  97. 7dadcfc [5/6?] Support multiple parallel workers by Brian Sheedy · 6 days ago
  98. f579352 feat(testing): Add test retries for flaky tests by James Woo · 6 days ago
  99. 61638f7 [4/?] Move promptfoo installation code to new file by Brian Sheedy · 6 days ago
  100. 0c3e507 [3/?] Move WorkDir to new file by Brian Sheedy · 6 days ago