mirror of
https://github.com/catlog22/Claude-Code-Workflow.git
synced 2026-02-11 02:33:51 +08:00
feat: migrate test-task-generate to agent-driven architecture
- Refactor test-task-generate.md to use action-planning-agent - Add two-phase execution flow (Discovery → Agent Execution) - Integrate Memory-First principle and MCP tool enhancements - Support both agent-mode (default) and cli-execute-mode - Add test-specific context package with TEST_ANALYSIS_RESULTS.md - Align with task-generate-agent.md architecture - Remove 556 lines of redundant old content (Phase 1-4 old structure) - Update test-gen.md and test-fix-gen.md to reflect agent-driven changes Changes include: - Core Philosophy with agent-driven principles - Agent Context Package structure for test sessions - Discovery Actions for test context loading - Agent Invocation with test-specific requirements - Test Task Structure Reference - Updated Integration & Usage sections - Enhanced Related Commands documentation Now test task generation uses autonomous agent planning with MCP enhancements for better test coverage analysis and generation. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
catlog22
@@ -473,9 +473,9 @@ WFS-test-[session]/
|
|||||||
- `/workflow:tools:test-context-gather` - Phase 2 (Session Mode): Gather source session context
|
- `/workflow:tools:test-context-gather` - Phase 2 (Session Mode): Gather source session context
|
||||||
- `/workflow:tools:context-gather` - Phase 2 (Prompt Mode): Analyze codebase directly
|
- `/workflow:tools:context-gather` - Phase 2 (Prompt Mode): Analyze codebase directly
|
||||||
- `/workflow:tools:test-concept-enhanced` - Phase 3: Generate test requirements using Gemini
|
- `/workflow:tools:test-concept-enhanced` - Phase 3: Generate test requirements using Gemini
|
||||||
- `/workflow:tools:test-task-generate` - Phase 4: Generate test task JSONs with fix cycle specification
|
- `/workflow:tools:test-task-generate` - Phase 4: Generate test task JSONs using action-planning-agent (autonomous, default)
|
||||||
- `/workflow:tools:test-task-generate --use-codex` - Phase 4: With automated Codex fixes (when `--use-codex` flag used)
|
- `/workflow:tools:test-task-generate --use-codex` - Phase 4: With automated Codex fixes for IMPL-002 (when `--use-codex` flag used)
|
||||||
- `/workflow:tools:test-task-generate --cli-execute` - Phase 4: With CLI execution mode (when `--cli-execute` flag used)
|
- `/workflow:tools:test-task-generate --cli-execute` - Phase 4: With CLI execution mode for IMPL-001 test generation (when `--cli-execute` flag used)
|
||||||
|
|
||||||
**Follow-up Commands**:
|
**Follow-up Commands**:
|
||||||
- `/workflow:status` - Review generated test tasks
|
- `/workflow:status` - Review generated test tasks
|
||||||
|
|||||||
@@ -337,9 +337,9 @@ See `/workflow:tools:test-task-generate` for complete JSON schemas.
|
|||||||
- `/workflow:session:start` - Phase 1: Create independent test workflow session
|
- `/workflow:session:start` - Phase 1: Create independent test workflow session
|
||||||
- `/workflow:tools:test-context-gather` - Phase 2: Analyze test coverage and gather source session context
|
- `/workflow:tools:test-context-gather` - Phase 2: Analyze test coverage and gather source session context
|
||||||
- `/workflow:tools:test-concept-enhanced` - Phase 3: Generate test requirements and strategy using Gemini
|
- `/workflow:tools:test-concept-enhanced` - Phase 3: Generate test requirements and strategy using Gemini
|
||||||
- `/workflow:tools:test-task-generate` - Phase 4: Generate test generation and execution task JSONs
|
- `/workflow:tools:test-task-generate` - Phase 4: Generate test task JSONs using action-planning-agent (autonomous, default)
|
||||||
- `/workflow:tools:test-task-generate --use-codex` - Phase 4: With automated Codex fixes (when `--use-codex` flag used)
|
- `/workflow:tools:test-task-generate --use-codex` - Phase 4: With automated Codex fixes for IMPL-002 (when `--use-codex` flag used)
|
||||||
- `/workflow:tools:test-task-generate --cli-execute` - Phase 4: With CLI execution mode (when `--cli-execute` flag used)
|
- `/workflow:tools:test-task-generate --cli-execute` - Phase 4: With CLI execution mode for IMPL-001 test generation (when `--cli-execute` flag used)
|
||||||
|
|
||||||
**Follow-up Commands**:
|
**Follow-up Commands**:
|
||||||
- `/workflow:status` - Review generated test tasks
|
- `/workflow:status` - Review generated test tasks
|
||||||
|
|||||||
@@ -1,6 +1,6 @@
|
|||||||
---
|
---
|
||||||
name: test-task-generate
|
name: test-task-generate
|
||||||
description: Generate test-fix task JSON with iterative test-fix-retest cycle specification using Gemini/Qwen/Codex
|
description: Autonomous test-fix task generation using action-planning-agent with test-fix-retest cycle specification and discovery phase
|
||||||
argument-hint: "[--use-codex] [--cli-execute] --session WFS-test-session-id"
|
argument-hint: "[--use-codex] [--cli-execute] --session WFS-test-session-id"
|
||||||
examples:
|
examples:
|
||||||
- /workflow:tools:test-task-generate --session WFS-test-auth
|
- /workflow:tools:test-task-generate --session WFS-test-auth
|
||||||
@@ -9,10 +9,23 @@ examples:
|
|||||||
- /workflow:tools:test-task-generate --cli-execute --use-codex --session WFS-test-auth
|
- /workflow:tools:test-task-generate --cli-execute --use-codex --session WFS-test-auth
|
||||||
---
|
---
|
||||||
|
|
||||||
# Test Task Generation Command
|
# Autonomous Test Task Generation Command
|
||||||
|
|
||||||
## Overview
|
## Overview
|
||||||
Generate specialized test-fix task JSON with comprehensive test-fix-retest cycle specification, including Gemini diagnosis (using bug-fix template) and manual fix workflow (Codex automation only when explicitly requested).
|
Autonomous test-fix task JSON generation using action-planning-agent with two-phase execution: discovery and document generation. Supports both agent-driven execution (default) and CLI tool execution modes. Generates specialized test-fix tasks with comprehensive test-fix-retest cycle specification.
|
||||||
|
|
||||||
|
## Core Philosophy
|
||||||
|
- **Agent-Driven**: Delegate execution to action-planning-agent for autonomous operation
|
||||||
|
- **Two-Phase Flow**: Discovery (context gathering) → Output (document generation)
|
||||||
|
- **Memory-First**: Reuse loaded documents from conversation memory
|
||||||
|
- **MCP-Enhanced**: Use MCP tools for advanced code analysis and test research
|
||||||
|
- **Pre-Selected Templates**: Command selects correct test template based on `--cli-execute` flag **before** invoking agent
|
||||||
|
- **Agent Simplicity**: Agent receives pre-selected template and focuses only on content generation
|
||||||
|
- **Path Clarity**: All `focus_paths` prefer absolute paths (e.g., `D:\\project\\src\\module`), or clear relative paths from project root
|
||||||
|
- **Test-First**: Generate comprehensive test coverage before execution
|
||||||
|
- **Iterative Refinement**: Test-fix-retest cycle until all tests pass
|
||||||
|
- **Surgical Fixes**: Minimal code changes, no refactoring during test fixes
|
||||||
|
- **Auto-Revert**: Rollback all changes if max iterations reached
|
||||||
|
|
||||||
## Execution Modes
|
## Execution Modes
|
||||||
|
|
||||||
@@ -24,583 +37,278 @@ Generate specialized test-fix task JSON with comprehensive test-fix-retest cycle
|
|||||||
- **Manual Mode (Default)**: Gemini diagnosis → user applies fixes
|
- **Manual Mode (Default)**: Gemini diagnosis → user applies fixes
|
||||||
- **Codex Mode (`--use-codex`)**: Gemini diagnosis → Codex applies fixes with resume mechanism
|
- **Codex Mode (`--use-codex`)**: Gemini diagnosis → Codex applies fixes with resume mechanism
|
||||||
|
|
||||||
## Core Philosophy
|
|
||||||
- **Analysis-Driven Test Generation**: Use TEST_ANALYSIS_RESULTS.md from test-concept-enhanced
|
|
||||||
- **Agent-Based Test Creation**: Call @code-developer agent for comprehensive test generation
|
|
||||||
- **Coverage-First**: Generate all missing tests before execution
|
|
||||||
- **Test Execution**: Execute complete test suite after generation
|
|
||||||
- **Gemini Diagnosis**: Use Gemini for root cause analysis and fix suggestions (references bug-fix template)
|
|
||||||
- **Manual Fixes First**: Apply fixes manually by default, codex only when explicitly needed
|
|
||||||
- **Iterative Refinement**: Repeat test-analyze-fix-retest cycle until all tests pass
|
|
||||||
- **Surgical Fixes**: Minimal code changes, no refactoring during test fixes
|
|
||||||
- **Auto-Revert**: Rollback all changes if max iterations reached
|
|
||||||
|
|
||||||
## Core Responsibilities
|
|
||||||
- Parse TEST_ANALYSIS_RESULTS.md from test-concept-enhanced
|
|
||||||
- Extract test requirements and generation strategy
|
|
||||||
- Parse `--use-codex` flag to determine fix mode (manual vs automated)
|
|
||||||
- Generate test generation subtask calling @code-developer
|
|
||||||
- Generate test execution and fix cycle task JSON with appropriate fix mode
|
|
||||||
- Configure Gemini diagnosis workflow (bug-fix template) and manual/Codex fix application
|
|
||||||
- Create test-oriented IMPL_PLAN.md and TODO_LIST.md with test generation phase
|
|
||||||
|
|
||||||
## Execution Lifecycle
|
## Execution Lifecycle
|
||||||
|
|
||||||
### Phase 1: Input Validation & Discovery
|
### Phase 1: Discovery & Context Loading
|
||||||
|
**⚡ Memory-First Rule**: Skip file loading if documents already in conversation memory
|
||||||
|
|
||||||
1. **Parameter Parsing**
|
**Agent Context Package**:
|
||||||
- Parse `--use-codex` flag from command arguments → Controls IMPL-002 fix mode
|
```javascript
|
||||||
- Parse `--cli-execute` flag from command arguments → Controls IMPL-001 generation mode
|
|
||||||
- Store flag values for task JSON generation
|
|
||||||
|
|
||||||
2. **Test Session Validation**
|
|
||||||
- Load `.workflow/{test-session-id}/workflow-session.json`
|
|
||||||
- Verify `workflow_type: "test_session"`
|
|
||||||
- Extract `source_session_id` from metadata
|
|
||||||
|
|
||||||
3. **Test Analysis Results Loading**
|
|
||||||
- **REQUIRED**: Load `.workflow/{test-session-id}/.process/TEST_ANALYSIS_RESULTS.md`
|
|
||||||
- Parse test requirements by file
|
|
||||||
- Extract test generation strategy
|
|
||||||
- Identify test files to create with specifications
|
|
||||||
|
|
||||||
4. **Test Context Package Loading**
|
|
||||||
- Load `.workflow/{test-session-id}/.process/test-context-package.json`
|
|
||||||
- Extract test framework configuration
|
|
||||||
- Extract coverage gaps and priorities
|
|
||||||
- Load source session implementation summaries
|
|
||||||
|
|
||||||
### Phase 2: Task JSON Generation
|
|
||||||
|
|
||||||
Generate **TWO task JSON files**:
|
|
||||||
1. **IMPL-001.json** - Test Generation (calls @code-developer)
|
|
||||||
2. **IMPL-002.json** - Test Execution and Fix Cycle (calls @test-fix-agent)
|
|
||||||
|
|
||||||
#### IMPL-001.json - Test Generation Task
|
|
||||||
|
|
||||||
```json
|
|
||||||
{
|
{
|
||||||
"id": "IMPL-001",
|
"session_id": "WFS-test-[session-id]",
|
||||||
"title": "Generate comprehensive tests for [sourceSessionId]",
|
"execution_mode": "agent-mode" | "cli-execute-mode", // Determined by flag
|
||||||
"status": "pending",
|
"task_json_template_path": "~/.claude/workflows/cli-templates/prompts/workflow/task-json-agent-mode.txt"
|
||||||
"meta": {
|
| "~/.claude/workflows/cli-templates/prompts/workflow/task-json-cli-mode.txt",
|
||||||
"type": "test-gen",
|
// Path selected by command based on --cli-execute flag, agent reads it
|
||||||
"agent": "@code-developer",
|
"workflow_type": "test_session",
|
||||||
"source_session": "[sourceSessionId]",
|
"use_codex": true | false, // Determined by --use-codex flag
|
||||||
"test_framework": "jest|pytest|cargo|detected"
|
"session_metadata": {
|
||||||
|
// If in memory: use cached content
|
||||||
|
// Else: Load from .workflow/{test-session-id}/workflow-session.json
|
||||||
},
|
},
|
||||||
"context": {
|
"test_analysis_results_path": ".workflow/{test-session-id}/.process/TEST_ANALYSIS_RESULTS.md",
|
||||||
"requirements": [
|
"test_analysis_results": {
|
||||||
"Generate comprehensive test files based on TEST_ANALYSIS_RESULTS.md",
|
// If in memory: use cached content
|
||||||
"Follow existing test patterns and conventions from test framework",
|
// Else: Load from TEST_ANALYSIS_RESULTS.md
|
||||||
"Create tests for all missing coverage identified in analysis",
|
|
||||||
"Include happy path, error handling, edge cases, and integration tests",
|
|
||||||
"Use test data and mocks as specified in analysis",
|
|
||||||
"Ensure tests follow project coding standards"
|
|
||||||
],
|
|
||||||
"focus_paths": [
|
|
||||||
"tests/**/*",
|
|
||||||
"src/**/*.test.*",
|
|
||||||
"{paths_from_analysis}"
|
|
||||||
],
|
|
||||||
"acceptance": [
|
|
||||||
"All test files from TEST_ANALYSIS_RESULTS.md section 5 are created",
|
|
||||||
"Tests follow existing test patterns and conventions",
|
|
||||||
"Test scenarios cover happy path, errors, edge cases, integration",
|
|
||||||
"All dependencies are properly mocked",
|
|
||||||
"Test files are syntactically valid and can be executed",
|
|
||||||
"Test coverage meets analysis requirements"
|
|
||||||
],
|
|
||||||
"depends_on": [],
|
|
||||||
"source_context": {
|
|
||||||
"session_id": "[sourceSessionId]",
|
|
||||||
"test_analysis": ".workflow/[testSessionId]/.process/TEST_ANALYSIS_RESULTS.md",
|
|
||||||
"test_context": ".workflow/[testSessionId]/.process/test-context-package.json",
|
|
||||||
"implementation_summaries": [
|
|
||||||
".workflow/[sourceSessionId]/.summaries/IMPL-001-summary.md"
|
|
||||||
]
|
|
||||||
}
|
|
||||||
},
|
},
|
||||||
"flow_control": {
|
"test_context_package_path": ".workflow/{test-session-id}/.process/test-context-package.json",
|
||||||
"pre_analysis": [
|
"test_context_package": {
|
||||||
{
|
// Existing test patterns and coverage analysis
|
||||||
"step": "load_test_analysis",
|
},
|
||||||
"action": "Load test generation requirements and strategy",
|
"source_session_id": "[source-session-id]", // if exists
|
||||||
"commands": [
|
"source_session_summaries": {
|
||||||
"Read(.workflow/[testSessionId]/.process/TEST_ANALYSIS_RESULTS.md)",
|
// Implementation context from source session
|
||||||
"Read(.workflow/[testSessionId]/.process/test-context-package.json)"
|
},
|
||||||
],
|
"mcp_capabilities": {
|
||||||
"output_to": "test_generation_requirements",
|
"code_index": true,
|
||||||
"on_error": "fail"
|
"exa_code": true,
|
||||||
},
|
"exa_web": true
|
||||||
{
|
|
||||||
"step": "load_implementation_context",
|
|
||||||
"action": "Load source implementation for test generation context",
|
|
||||||
"commands": [
|
|
||||||
"bash(for f in .workflow/[sourceSessionId]/.summaries/IMPL-*-summary.md; do echo \"=== $(basename $f) ===\"&& cat \"$f\"; done)"
|
|
||||||
],
|
|
||||||
"output_to": "implementation_context",
|
|
||||||
"on_error": "skip_optional"
|
|
||||||
},
|
|
||||||
{
|
|
||||||
"step": "load_existing_test_patterns",
|
|
||||||
"action": "Study existing tests for pattern reference",
|
|
||||||
"commands": [
|
|
||||||
"bash(find . -name \"*.test.*\" -type f)",
|
|
||||||
"bash(# Read first 2 existing test files as examples)",
|
|
||||||
"bash(test_files=$(find . -name \"*.test.*\" -type f | head -2))",
|
|
||||||
"bash(for f in $test_files; do echo \"=== $f ===\"&& cat \"$f\"; done)"
|
|
||||||
],
|
|
||||||
"output_to": "existing_test_patterns",
|
|
||||||
"on_error": "skip_optional"
|
|
||||||
}
|
|
||||||
],
|
|
||||||
// Agent Mode (Default): Agent implements tests
|
|
||||||
"implementation_approach": [
|
|
||||||
{
|
|
||||||
"step": 1,
|
|
||||||
"title": "Generate comprehensive test suite",
|
|
||||||
"description": "Generate comprehensive test suite based on TEST_ANALYSIS_RESULTS.md. Follow test generation strategy and create all test files listed in section 5 (Implementation Targets).",
|
|
||||||
"modification_points": [
|
|
||||||
"Read TEST_ANALYSIS_RESULTS.md sections 3 and 4",
|
|
||||||
"Study existing test patterns",
|
|
||||||
"Create test files with all required scenarios",
|
|
||||||
"Implement happy path, error handling, edge case, and integration tests",
|
|
||||||
"Add required mocks and fixtures"
|
|
||||||
],
|
|
||||||
"logic_flow": [
|
|
||||||
"Read TEST_ANALYSIS_RESULTS.md section 3 (Test Requirements by File)",
|
|
||||||
"Read TEST_ANALYSIS_RESULTS.md section 4 (Test Generation Strategy)",
|
|
||||||
"Study existing test patterns from test_context.test_framework.conventions",
|
|
||||||
"For each test file in section 5 (Implementation Targets): Create test file with specified scenarios, Implement happy path tests, Implement error handling tests, Implement edge case tests, Implement integration tests (if specified), Add required mocks and fixtures",
|
|
||||||
"Follow test framework conventions and project standards",
|
|
||||||
"Ensure all tests are executable and syntactically valid"
|
|
||||||
],
|
|
||||||
"depends_on": [],
|
|
||||||
"output": "test_suite"
|
|
||||||
}
|
|
||||||
],
|
|
||||||
|
|
||||||
// CLI Execute Mode (--cli-execute): Use Codex command (alternative format shown below)
|
|
||||||
"implementation_approach": [{
|
|
||||||
"step": 1,
|
|
||||||
"title": "Generate tests using Codex",
|
|
||||||
"description": "Use Codex CLI to autonomously generate comprehensive test suite based on TEST_ANALYSIS_RESULTS.md",
|
|
||||||
"modification_points": [
|
|
||||||
"Codex loads TEST_ANALYSIS_RESULTS.md and existing test patterns",
|
|
||||||
"Codex generates all test files listed in analysis section 5",
|
|
||||||
"Codex ensures tests follow framework conventions"
|
|
||||||
],
|
|
||||||
"logic_flow": [
|
|
||||||
"Start new Codex session",
|
|
||||||
"Pass TEST_ANALYSIS_RESULTS.md to Codex",
|
|
||||||
"Codex studies existing test patterns",
|
|
||||||
"Codex generates comprehensive test suite",
|
|
||||||
"Codex validates test syntax and executability"
|
|
||||||
],
|
|
||||||
"command": "bash(codex -C [focus_paths] --full-auto exec \"PURPOSE: Generate comprehensive test suite TASK: Create test files based on TEST_ANALYSIS_RESULTS.md section 5 MODE: write CONTEXT: @.workflow/WFS-test-[session]/.process/TEST_ANALYSIS_RESULTS.md @.workflow/WFS-test-[session]/.process/test-context-package.json EXPECTED: All test files with happy path, error handling, edge cases, integration tests RULES: Follow test framework conventions, ensure tests are executable\" --skip-git-repo-check -s danger-full-access)",
|
|
||||||
"depends_on": [],
|
|
||||||
"output": "test_generation"
|
|
||||||
}],
|
|
||||||
"target_files": [
|
|
||||||
"{test_file_1 from TEST_ANALYSIS_RESULTS.md section 5}",
|
|
||||||
"{test_file_2 from TEST_ANALYSIS_RESULTS.md section 5}",
|
|
||||||
"{test_file_N from TEST_ANALYSIS_RESULTS.md section 5}"
|
|
||||||
]
|
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
```
|
```
|
||||||
|
|
||||||
#### IMPL-002.json - Test Execution & Fix Cycle Task
|
**Discovery Actions**:
|
||||||
|
1. **Load Test Session Context** (if not in memory)
|
||||||
|
```javascript
|
||||||
|
if (!memory.has("workflow-session.json")) {
|
||||||
|
Read(.workflow/{test-session-id}/workflow-session.json)
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
```json
|
2. **Load TEST_ANALYSIS_RESULTS.md** (if not in memory, REQUIRED)
|
||||||
{
|
```javascript
|
||||||
"id": "IMPL-002",
|
if (!memory.has("TEST_ANALYSIS_RESULTS.md")) {
|
||||||
"title": "Execute and fix tests for [sourceSessionId]",
|
Read(.workflow/{test-session-id}/.process/TEST_ANALYSIS_RESULTS.md)
|
||||||
"status": "pending",
|
}
|
||||||
"meta": {
|
```
|
||||||
"type": "test-fix",
|
|
||||||
"agent": "@test-fix-agent",
|
3. **Load Test Context Package** (if not in memory)
|
||||||
"source_session": "[sourceSessionId]",
|
```javascript
|
||||||
"test_framework": "jest|pytest|cargo|detected",
|
if (!memory.has("test-context-package.json")) {
|
||||||
"max_iterations": 5,
|
Read(.workflow/{test-session-id}/.process/test-context-package.json)
|
||||||
"use_codex": false // Set to true if --use-codex flag present
|
}
|
||||||
},
|
```
|
||||||
"context": {
|
|
||||||
"requirements": [
|
4. **Load Source Session Summaries** (if source_session_id exists)
|
||||||
"Execute complete test suite (generated in IMPL-001)",
|
```javascript
|
||||||
"Diagnose test failures using Gemini analysis with bug-fix template",
|
if (sessionMetadata.source_session_id) {
|
||||||
"Present fixes to user for manual application (default)",
|
const summaryFiles = Bash("find .workflow/{source-session-id}/.summaries/ -name 'IMPL-*-summary.md'")
|
||||||
"Use Codex ONLY if user explicitly requests automation",
|
summaryFiles.forEach(file => Read(file))
|
||||||
"Iterate until all tests pass or max iterations reached",
|
}
|
||||||
"Revert changes if unable to fix within iteration limit"
|
```
|
||||||
],
|
|
||||||
"focus_paths": [
|
5. **Code Analysis with Native Tools** (optional - enhance understanding)
|
||||||
"tests/**/*",
|
```bash
|
||||||
"src/**/*.test.*",
|
# Find test files and patterns
|
||||||
"{implementation_files_from_source_session}"
|
find . -name "*test*" -type f
|
||||||
],
|
rg "describe|it\(|test\(" -g "*.ts"
|
||||||
"acceptance": [
|
```
|
||||||
"All tests pass successfully (100% pass rate)",
|
|
||||||
"No test failures or errors in final run",
|
6. **MCP External Research** (optional - gather test best practices)
|
||||||
"Code changes are minimal and surgical",
|
```javascript
|
||||||
"All fixes are verified through retest",
|
// Get external test examples and patterns
|
||||||
"Iteration logs document fix progression"
|
mcp__exa__get_code_context_exa(
|
||||||
],
|
query="TypeScript test generation best practices jest",
|
||||||
"depends_on": ["IMPL-001"],
|
tokensNum="dynamic"
|
||||||
"source_context": {
|
)
|
||||||
"session_id": "[sourceSessionId]",
|
```
|
||||||
"test_generation_summary": ".workflow/[testSessionId]/.summaries/IMPL-001-summary.md",
|
|
||||||
"implementation_summaries": [
|
### Phase 2: Agent Execution (Document Generation)
|
||||||
".workflow/[sourceSessionId]/.summaries/IMPL-001-summary.md"
|
|
||||||
]
|
**Pre-Agent Template Selection** (Command decides path before invoking agent):
|
||||||
}
|
```javascript
|
||||||
},
|
// Command checks flag and selects template PATH (not content)
|
||||||
"flow_control": {
|
const templatePath = hasCliExecuteFlag
|
||||||
"pre_analysis": [
|
? "~/.claude/workflows/cli-templates/prompts/workflow/task-json-cli-mode.txt"
|
||||||
{
|
: "~/.claude/workflows/cli-templates/prompts/workflow/task-json-agent-mode.txt";
|
||||||
"step": "load_source_session_summaries",
|
```
|
||||||
"action": "Load implementation context from source session",
|
|
||||||
"commands": [
|
**Agent Invocation**:
|
||||||
"bash(find .workflow/[sourceSessionId]/.summaries/ -name 'IMPL-*-summary.md' 2>/dev/null)",
|
```javascript
|
||||||
"bash(for f in .workflow/[sourceSessionId]/.summaries/IMPL-*-summary.md; do echo \"=== $(basename $f) ===\"&& cat \"$f\"; done)"
|
Task(
|
||||||
],
|
subagent_type="action-planning-agent",
|
||||||
"output_to": "implementation_context",
|
description="Generate test-fix task JSON and implementation plan",
|
||||||
"on_error": "skip_optional"
|
prompt=`
|
||||||
},
|
## Execution Context
|
||||||
{
|
|
||||||
"step": "discover_test_framework",
|
**Session ID**: WFS-test-{session-id}
|
||||||
"action": "Identify test framework and test command",
|
**Workflow Type**: Test Session
|
||||||
"commands": [
|
**Execution Mode**: {agent-mode | cli-execute-mode}
|
||||||
"bash(jq -r '.scripts.test // \"npm test\"' package.json 2>/dev/null || echo 'pytest' || echo 'cargo test')",
|
**Task JSON Template Path**: {template_path}
|
||||||
"bash([ -f 'package.json' ] && echo 'jest/npm' || [ -f 'pytest.ini' ] && echo 'pytest' || [ -f 'Cargo.toml' ] && echo 'cargo' || echo 'unknown')"
|
**Use Codex**: {true | false}
|
||||||
],
|
|
||||||
"output_to": "test_command",
|
## Phase 1: Discovery Results (Provided Context)
|
||||||
"on_error": "fail"
|
|
||||||
},
|
### Test Session Metadata
|
||||||
{
|
{session_metadata_content}
|
||||||
"step": "analyze_test_coverage",
|
- source_session_id: {source_session_id} (if exists)
|
||||||
"action": "Analyze test coverage and identify missing tests",
|
- workflow_type: "test_session"
|
||||||
"commands": [
|
|
||||||
"bash(find . -name \"*.test.*\" -type f)",
|
### TEST_ANALYSIS_RESULTS.md (REQUIRED)
|
||||||
"bash(rg \"test|describe|it|def test_\" -g \"*.test.*\")",
|
{test_analysis_results_content}
|
||||||
"bash(# Count implementation files vs test files)",
|
- Coverage Assessment
|
||||||
"bash(impl_count=$(find [changed_files_dirs] -type f \\( -name '*.ts' -o -name '*.js' -o -name '*.py' \\) ! -name '*.test.*' 2>/dev/null | wc -l))",
|
- Test Framework & Conventions
|
||||||
"bash(test_count=$(find . -name \"*.test.*\" -type f | wc -l))",
|
- Test Requirements by File
|
||||||
"bash(echo \"Implementation files: $impl_count, Test files: $test_count\")"
|
- Test Generation Strategy
|
||||||
],
|
- Implementation Targets
|
||||||
"output_to": "test_coverage_analysis",
|
- Success Criteria
|
||||||
"on_error": "skip_optional"
|
|
||||||
},
|
### Test Context Package
|
||||||
{
|
{test_context_package_summary}
|
||||||
"step": "identify_files_without_tests",
|
- Existing test patterns, framework config, coverage analysis
|
||||||
"action": "List implementation files that lack corresponding test files",
|
|
||||||
"commands": [
|
### Source Session Implementation Context (Optional)
|
||||||
"bash(# For each changed file from source session, check if test exists)",
|
{source_session_summaries}
|
||||||
"bash(for file in [changed_files]; do test_file=$(echo $file | sed 's/\\(.*\\)\\.\\(ts\\|js\\|py\\)$/\\1.test.\\2/'); [ ! -f \"$test_file\" ] && echo \"$file\"; done)"
|
- Implementation context from completed session
|
||||||
],
|
|
||||||
"output_to": "files_without_tests",
|
### MCP Analysis Results (Optional)
|
||||||
"on_error": "skip_optional"
|
**Code Structure**: {mcp_code_index_results}
|
||||||
},
|
**External Research**: {mcp_exa_research_results}
|
||||||
{
|
|
||||||
"step": "prepare_test_environment",
|
## Phase 2: Test Task Document Generation
|
||||||
"action": "Ensure test environment is ready",
|
|
||||||
"commands": [
|
**Agent Configuration Reference**: All test task generation rules, test-fix cycle structure, quality standards, and execution details are defined in action-planning-agent.
|
||||||
"bash([ -f 'package.json' ] && npm install 2>/dev/null || true)",
|
|
||||||
"bash([ -f 'requirements.txt' ] && pip install -q -r requirements.txt 2>/dev/null || true)"
|
Refer to: @.claude/agents/action-planning-agent.md for:
|
||||||
],
|
- Test Task Decomposition Standards
|
||||||
"output_to": "environment_status",
|
- Test-Fix-Retest Cycle Requirements
|
||||||
"on_error": "skip_optional"
|
- 5-Field Task JSON Schema
|
||||||
}
|
- IMPL_PLAN.md Structure (Test variant)
|
||||||
],
|
- TODO_LIST.md Format
|
||||||
"implementation_approach": [
|
- Test Execution Flow & Quality Validation
|
||||||
{
|
|
||||||
"step": 1,
|
### Test-Specific Requirements Summary
|
||||||
"title": "Execute iterative test-fix-retest cycle",
|
|
||||||
"description": "Execute iterative test-fix-retest cycle using Gemini diagnosis (bug-fix template) and manual fixes (Codex only if meta.use_codex=true). Max 5 iterations with automatic revert on failure.",
|
#### Task Structure Philosophy
|
||||||
"test_fix_cycle": {
|
- **Minimum 2 tasks**: IMPL-001 (test generation) + IMPL-002 (test execution & fix)
|
||||||
"max_iterations": 5,
|
- **Expandable**: Add IMPL-003+ for complex projects (per-module, integration, etc.)
|
||||||
"cycle_pattern": "test → gemini_diagnose → manual_fix (or codex if needed) → retest",
|
- IMPL-001: Uses @code-developer or CLI execution
|
||||||
"tools": {
|
- IMPL-002: Uses @test-fix-agent with iterative fix cycle
|
||||||
"test_execution": "bash(test_command)",
|
|
||||||
"diagnosis": "gemini (MODE: analysis, uses bug-fix template)",
|
#### Test-Fix Cycle Configuration
|
||||||
"fix_application": "manual (default) or codex exec resume --last (if explicitly needed)",
|
- **Max Iterations**: 5 (for IMPL-002)
|
||||||
"verification": "bash(test_command) + regression_check"
|
- **Diagnosis Tool**: Gemini with bug-fix template
|
||||||
},
|
- **Fix Application**: Manual (default) or Codex (if --use-codex flag)
|
||||||
"exit_conditions": {
|
- **Cycle Pattern**: test → gemini_diagnose → manual_fix (or codex) → retest
|
||||||
"success": "all_tests_pass",
|
- **Exit Conditions**: All tests pass OR max iterations reached (auto-revert)
|
||||||
"failure": "max_iterations_reached",
|
|
||||||
"error": "test_command_not_found"
|
#### Required Outputs Summary
|
||||||
}
|
|
||||||
},
|
##### 1. Test Task JSON Files (.task/IMPL-*.json)
|
||||||
"modification_points": [
|
- **Location**: `.workflow/{test-session-id}/.task/`
|
||||||
"PHASE 1: Initial Test Execution",
|
- **Template**: Read from `{template_path}` (pre-selected by command based on `--cli-execute` flag)
|
||||||
" 1.1. Discover test command from framework detection",
|
- **Schema**: 5-field structure with test-specific metadata
|
||||||
" 1.2. Execute initial test run: bash([test_command])",
|
- IMPL-001: `meta.type: "test-gen"`, `meta.agent: "@code-developer"`
|
||||||
" 1.3. Parse test output and count failures",
|
- IMPL-002: `meta.type: "test-fix"`, `meta.agent: "@test-fix-agent"`, `meta.use_codex: {use_codex}`
|
||||||
" 1.4. If all pass → Skip to PHASE 3 (success)",
|
- `flow_control`: Test generation approach (IMPL-001) or test-fix cycle (IMPL-002)
|
||||||
" 1.5. If failures → Store failure output, proceed to PHASE 2",
|
- **Details**: See action-planning-agent.md § Test Task JSON Generation
|
||||||
"",
|
|
||||||
"PHASE 2: Iterative Test-Fix-Retest Cycle (max 5 iterations)",
|
##### 2. IMPL_PLAN.md (Test Variant)
|
||||||
" Note: This phase handles test failures, NOT test generation failures",
|
- **Location**: `.workflow/{test-session-id}/IMPL_PLAN.md`
|
||||||
" Initialize: max_iterations=5, current_iteration=0",
|
- **Template**: `~/.claude/workflows/cli-templates/prompts/workflow/impl-plan-template.txt`
|
||||||
" ",
|
- **Test-Specific Frontmatter**: workflow_type="test_session", test_framework, source_session_id
|
||||||
" WHILE (tests failing AND current_iteration < max_iterations):",
|
- **Test-Fix-Retest Cycle Section**: Iterative fix cycle with Gemini diagnosis
|
||||||
" current_iteration++",
|
- **Details**: See action-planning-agent.md § Test Implementation Plan Creation
|
||||||
" ",
|
|
||||||
" STEP 2.1: Gemini Diagnosis (using bug-fix template)",
|
##### 3. TODO_LIST.md
|
||||||
" - Prepare diagnosis context:",
|
- **Location**: `.workflow/{test-session-id}/TODO_LIST.md`
|
||||||
" * Test failure output from previous run",
|
- **Format**: Task list with test generation and execution phases
|
||||||
" * Source files from focus_paths",
|
- **Status**: [ ] (pending), [x] (completed)
|
||||||
" * Implementation summaries from source session",
|
- **Details**: See action-planning-agent.md § TODO List Generation
|
||||||
" - Execute Gemini analysis with bug-fix template:",
|
|
||||||
" bash(cd .workflow/WFS-test-[session]/.process && gemini \"",
|
### Agent Execution Summary
|
||||||
" PURPOSE: Diagnose test failure iteration [N] and propose minimal fix",
|
|
||||||
" TASK: Systematic bug analysis and fix recommendations for test failure",
|
**Key Steps** (Detailed instructions in action-planning-agent.md):
|
||||||
" MODE: analysis",
|
1. Load task JSON template from provided path
|
||||||
" CONTEXT: @CLAUDE.md,**/*CLAUDE.md",
|
2. Parse TEST_ANALYSIS_RESULTS.md for test requirements
|
||||||
" Test output: [test_failures]",
|
3. Generate IMPL-001 (test generation) task JSON
|
||||||
" Source files: [focus_paths]",
|
4. Generate IMPL-002 (test execution & fix) task JSON with use_codex flag
|
||||||
" Implementation: [implementation_context]",
|
5. Generate additional IMPL-*.json if project complexity requires
|
||||||
" EXPECTED: Root cause analysis, code path tracing, targeted fixes",
|
6. Create IMPL_PLAN.md using test template variant
|
||||||
" RULES: $(cat ~/.claude/workflows/cli-templates/prompts/analysis/01-diagnose-bug-root-cause.txt) | Bug: [test_failure_description]",
|
7. Generate TODO_LIST.md with test task indicators
|
||||||
" Minimal surgical fixes only - no refactoring",
|
8. Update session state with test metadata
|
||||||
" \" > fix-iteration-[N]-diagnosis.md)",
|
|
||||||
" - Parse diagnosis → extract fix_suggestion and target_files",
|
**Quality Gates** (Full checklist in action-planning-agent.md):
|
||||||
" - Present fix to user for manual application (default)",
|
- ✓ Minimum 2 tasks created (IMPL-001 + IMPL-002)
|
||||||
" ",
|
- ✓ IMPL-001 has test generation approach from TEST_ANALYSIS_RESULTS.md
|
||||||
" STEP 2.2: Apply Fix (Based on meta.use_codex Flag)",
|
- ✓ IMPL-002 has test-fix cycle with correct use_codex flag
|
||||||
" ",
|
- ✓ Test framework configuration integrated
|
||||||
" IF meta.use_codex = false (DEFAULT):",
|
- ✓ Source session context referenced (if exists)
|
||||||
" - Present Gemini diagnosis to user for manual fix",
|
- ✓ MCP tool integration added
|
||||||
" - User applies fix based on diagnosis recommendations",
|
- ✓ Documents follow test template structure
|
||||||
" - Stage changes: bash(git add -A)",
|
|
||||||
" - Store fix log: .process/fix-iteration-[N]-changes.log",
|
## Output
|
||||||
" ",
|
|
||||||
" IF meta.use_codex = true (--use-codex flag present):",
|
Generate all three documents and report completion status:
|
||||||
" - Stage current changes (if valid git repo): bash(git add -A)",
|
- Test task JSON files created: N files (minimum 2)
|
||||||
" - First iteration: Start new Codex session",
|
- Test requirements integrated: TEST_ANALYSIS_RESULTS.md
|
||||||
" codex -C [project_root] --full-auto exec \"",
|
- Test context integrated: existing patterns and coverage
|
||||||
" PURPOSE: Fix test failure iteration 1",
|
- Source session context: {source_session_id} summaries (if exists)
|
||||||
" TASK: [fix_suggestion from Gemini]",
|
- MCP enhancements: code-index, exa-research
|
||||||
" MODE: write",
|
- Session ready for test execution: /workflow:execute or /workflow:test-cycle-execute
|
||||||
" CONTEXT: Diagnosis: .workflow/.process/fix-iteration-1-diagnosis.md",
|
`
|
||||||
" Target files: [target_files]",
|
)
|
||||||
" Implementation context: [implementation_context]",
|
```
|
||||||
" EXPECTED: Minimal code changes to resolve test failure",
|
|
||||||
" RULES: Apply ONLY suggested changes, no refactoring",
|
### Agent Context Passing
|
||||||
" Preserve existing code style",
|
|
||||||
" \" --skip-git-repo-check -s danger-full-access",
|
**Memory-Aware Context Assembly**:
|
||||||
" - Subsequent iterations: Resume session for context continuity",
|
```javascript
|
||||||
" codex exec \"",
|
// Assemble context package for agent
|
||||||
" CONTINUE TO NEXT FIX:",
|
const agentContext = {
|
||||||
" Iteration [N] of 5: Fix test failure",
|
session_id: "WFS-test-[id]",
|
||||||
" ",
|
workflow_type: "test_session",
|
||||||
" PURPOSE: Fix remaining test failures",
|
use_codex: hasUseCodexFlag,
|
||||||
" TASK: [fix_suggestion from Gemini iteration N]",
|
|
||||||
" CONTEXT: Previous fixes applied, diagnosis: .process/fix-iteration-[N]-diagnosis.md",
|
// Use memory if available, else load
|
||||||
" EXPECTED: Surgical fix for current failure",
|
session_metadata: memory.has("workflow-session.json")
|
||||||
" RULES: Build on previous fixes, maintain consistency",
|
? memory.get("workflow-session.json")
|
||||||
" \" resume --last --skip-git-repo-check -s danger-full-access",
|
: Read(.workflow/WFS-test-[id]/workflow-session.json),
|
||||||
" - Store fix log: .process/fix-iteration-[N]-changes.log",
|
|
||||||
" ",
|
test_analysis_results_path: ".workflow/WFS-test-[id]/.process/TEST_ANALYSIS_RESULTS.md",
|
||||||
" STEP 2.3: Retest and Verification",
|
|
||||||
" - Re-execute test suite: bash([test_command])",
|
test_analysis_results: memory.has("TEST_ANALYSIS_RESULTS.md")
|
||||||
" - Capture output: .process/fix-iteration-[N]-retest.log",
|
? memory.get("TEST_ANALYSIS_RESULTS.md")
|
||||||
" - Count failures: bash(grep -c 'FAIL\\|ERROR' .process/fix-iteration-[N]-retest.log)",
|
: Read(".workflow/WFS-test-[id]/.process/TEST_ANALYSIS_RESULTS.md"),
|
||||||
" - Check for regression:",
|
|
||||||
" IF new_failures > previous_failures:",
|
test_context_package_path: ".workflow/WFS-test-[id]/.process/test-context-package.json",
|
||||||
" WARN: Regression detected",
|
|
||||||
" Include in next Gemini diagnosis context",
|
test_context_package: memory.has("test-context-package.json")
|
||||||
" - Analyze results:",
|
? memory.get("test-context-package.json")
|
||||||
" IF all_tests_pass:",
|
: Read(".workflow/WFS-test-[id]/.process/test-context-package.json"),
|
||||||
" BREAK loop → Proceed to PHASE 3",
|
|
||||||
" ELSE:",
|
// Load source session summaries if exists
|
||||||
" Update test_failures context",
|
source_session_id: session_metadata.source_session_id || null,
|
||||||
" CONTINUE loop",
|
|
||||||
" ",
|
source_session_summaries: session_metadata.source_session_id
|
||||||
" IF max_iterations reached AND tests still failing:",
|
? loadSourceSummaries(session_metadata.source_session_id)
|
||||||
" EXECUTE: git reset --hard HEAD (revert all changes)",
|
: null,
|
||||||
" MARK: Task status = blocked",
|
|
||||||
" GENERATE: Detailed failure report with iteration logs",
|
// Optional MCP enhancements
|
||||||
" EXIT: Require manual intervention",
|
mcp_analysis: executeMcpDiscovery()
|
||||||
"",
|
|
||||||
"PHASE 3: Final Validation and Certification",
|
|
||||||
" 3.1. Execute final confirmation test run",
|
|
||||||
" 3.2. Generate success summary:",
|
|
||||||
" - Iterations required: [current_iteration]",
|
|
||||||
" - Fixes applied: [summary from iteration logs]",
|
|
||||||
" - Test results: All passing ✅",
|
|
||||||
" 3.3. Mark task status: completed",
|
|
||||||
" 3.4. Update TODO_LIST.md: Mark as ✅",
|
|
||||||
" 3.5. Certify code: APPROVED for deployment"
|
|
||||||
],
|
|
||||||
"logic_flow": [
|
|
||||||
"Load source session implementation context",
|
|
||||||
"Discover test framework and command",
|
|
||||||
"PHASE 0: Test Coverage Check",
|
|
||||||
" Analyze existing test files",
|
|
||||||
" Identify files without tests",
|
|
||||||
" IF tests missing:",
|
|
||||||
" Report to user (no automatic generation)",
|
|
||||||
" Wait for user to generate tests or request automation",
|
|
||||||
" ELSE:",
|
|
||||||
" Skip to Phase 1",
|
|
||||||
"PHASE 1: Initial Test Execution",
|
|
||||||
" Execute test suite",
|
|
||||||
" IF all pass → Success (Phase 3)",
|
|
||||||
" ELSE → Store failures, proceed to Phase 2",
|
|
||||||
"PHASE 2: Iterative Fix Cycle (max 5 iterations)",
|
|
||||||
" LOOP (max 5 times):",
|
|
||||||
" 1. Gemini diagnoses failure with bug-fix template → fix suggestion",
|
|
||||||
" 2. Check meta.use_codex flag:",
|
|
||||||
" - IF false (default): Present fix to user for manual application",
|
|
||||||
" - IF true (--use-codex): Codex applies fix with resume for continuity",
|
|
||||||
" 3. Retest and check results",
|
|
||||||
" 4. IF pass → Exit loop to Phase 3",
|
|
||||||
" 5. ELSE → Continue with updated context",
|
|
||||||
" IF max iterations → Revert + report failure",
|
|
||||||
"PHASE 3: Final Validation",
|
|
||||||
" Confirm all tests pass",
|
|
||||||
" Generate summary (include test generation info)",
|
|
||||||
" Certify code APPROVED"
|
|
||||||
],
|
|
||||||
"error_handling": {
|
|
||||||
"max_iterations_reached": {
|
|
||||||
"action": "revert_all_changes",
|
|
||||||
"commands": [
|
|
||||||
"bash(git reset --hard HEAD)",
|
|
||||||
"bash(jq '.status = \"blocked\"' .workflow/[session]/.task/IMPL-001.json > temp.json && mv temp.json .workflow/[session]/.task/IMPL-001.json)"
|
|
||||||
],
|
|
||||||
"report": "Generate failure report with iteration logs in .summaries/IMPL-001-failure-report.md"
|
|
||||||
},
|
|
||||||
"test_command_fails": {
|
|
||||||
"action": "treat_as_test_failure",
|
|
||||||
"context": "Use stderr as failure context for Gemini diagnosis"
|
|
||||||
},
|
|
||||||
"codex_apply_fails": {
|
|
||||||
"action": "retry_once_then_skip",
|
|
||||||
"fallback": "Mark iteration as skipped, continue to next"
|
|
||||||
},
|
|
||||||
"gemini_diagnosis_fails": {
|
|
||||||
"action": "retry_with_simplified_context",
|
|
||||||
"fallback": "Use previous diagnosis, continue"
|
|
||||||
},
|
|
||||||
"regression_detected": {
|
|
||||||
"action": "log_warning_continue",
|
|
||||||
"context": "Include regression info in next Gemini diagnosis"
|
|
||||||
}
|
|
||||||
},
|
|
||||||
"depends_on": [],
|
|
||||||
"output": "test_fix_results"
|
|
||||||
}
|
|
||||||
],
|
|
||||||
"target_files": [
|
|
||||||
"Auto-discovered from test failures",
|
|
||||||
"Extracted from Gemini diagnosis each iteration",
|
|
||||||
"Format: file:function:lines or file (for new files)"
|
|
||||||
],
|
|
||||||
"codex_session": {
|
|
||||||
"strategy": "resume_for_continuity",
|
|
||||||
"first_iteration": "codex exec \"fix iteration 1\" --full-auto",
|
|
||||||
"subsequent_iterations": "codex exec \"fix iteration N\" resume --last",
|
|
||||||
"benefits": [
|
|
||||||
"Maintains conversation context across fixes",
|
|
||||||
"Remembers previous decisions and patterns",
|
|
||||||
"Ensures consistency in fix approach",
|
|
||||||
"Reduces redundant context injection"
|
|
||||||
]
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
}
|
||||||
```
|
```
|
||||||
|
|
||||||
### Phase 3: IMPL_PLAN.md Generation
|
## Test Task Structure Reference
|
||||||
|
|
||||||
#### Document Structure
|
This section provides quick reference for test task JSON structure. For complete implementation details, see the agent invocation prompt in Phase 2 above.
|
||||||
```markdown
|
|
||||||
---
|
|
||||||
identifier: WFS-test-[session-id]
|
|
||||||
source_session: WFS-[source-session-id]
|
|
||||||
workflow_type: test_session
|
|
||||||
test_framework: jest|pytest|cargo|detected
|
|
||||||
---
|
|
||||||
|
|
||||||
# Test Validation Plan: [Source Session Topic]
|
**Quick Reference**:
|
||||||
|
- Minimum 2 tasks: IMPL-001 (test-gen) + IMPL-002 (test-fix)
|
||||||
## Summary
|
- Expandable for complex projects (IMPL-003+)
|
||||||
Execute comprehensive test suite for implementation from session WFS-[source-session-id].
|
- IMPL-001: `meta.agent: "@code-developer"`, test generation approach
|
||||||
Diagnose and fix all test failures using iterative Gemini analysis and Codex execution.
|
- IMPL-002: `meta.agent: "@test-fix-agent"`, `meta.use_codex: {flag}`, test-fix cycle
|
||||||
|
- See Phase 2 agent prompt for full schema and requirements
|
||||||
## Source Session Context
|
|
||||||
- **Implementation Session**: WFS-[source-session-id]
|
|
||||||
- **Completed Tasks**: IMPL-001, IMPL-002, ...
|
|
||||||
- **Changed Files**: [list from git log]
|
|
||||||
- **Implementation Summaries**: [references to source session summaries]
|
|
||||||
|
|
||||||
## Test Framework
|
|
||||||
- **Detected Framework**: jest|pytest|cargo|other
|
|
||||||
- **Test Command**: npm test|pytest|cargo test
|
|
||||||
- **Test Files**: [discovered test files]
|
|
||||||
- **Coverage**: [estimated test coverage]
|
|
||||||
|
|
||||||
## Test-Fix-Retest Cycle
|
|
||||||
- **Max Iterations**: 5
|
|
||||||
- **Diagnosis Tool**: Gemini (analysis mode with bug-fix template from bug-index.md)
|
|
||||||
- **Fix Tool**: Manual (default, meta.use_codex=false) or Codex (if --use-codex flag, meta.use_codex=true)
|
|
||||||
- **Verification**: Bash test execution + regression check
|
|
||||||
|
|
||||||
### Cycle Workflow
|
|
||||||
1. **Initial Test**: Execute full suite, capture failures
|
|
||||||
2. **Iterative Fix Loop** (max 5 times):
|
|
||||||
- Gemini diagnoses failure using bug-fix template → surgical fix suggestion
|
|
||||||
- Check meta.use_codex flag:
|
|
||||||
- If false (default): Present fix to user for manual application
|
|
||||||
- If true (--use-codex): Codex applies fix with resume for context continuity
|
|
||||||
- Retest and verify (check for regressions)
|
|
||||||
- Continue until all pass or max iterations reached
|
|
||||||
3. **Final Validation**: Confirm all tests pass, certify code
|
|
||||||
|
|
||||||
### Error Recovery
|
|
||||||
- **Max iterations reached**: Revert all changes, report failure
|
|
||||||
- **Test command fails**: Treat as test failure, diagnose with Gemini
|
|
||||||
- **Codex fails**: Retry once, skip iteration if still failing
|
|
||||||
- **Regression detected**: Log warning, include in next diagnosis
|
|
||||||
|
|
||||||
## Task Breakdown
|
|
||||||
- **IMPL-001**: Execute and validate tests with iterative fix cycle
|
|
||||||
|
|
||||||
## Implementation Strategy
|
|
||||||
- **Phase 1**: Initial test execution and failure capture
|
|
||||||
- **Phase 2**: Iterative Gemini diagnosis + Codex fix + retest
|
|
||||||
- **Phase 3**: Final validation and code certification
|
|
||||||
|
|
||||||
## Success Criteria
|
|
||||||
- All tests pass (100% pass rate)
|
|
||||||
- No test failures or errors in final run
|
|
||||||
- Minimal, surgical code changes
|
|
||||||
- Iteration logs document fix progression
|
|
||||||
- Code certified APPROVED for deployment
|
|
||||||
```
|
|
||||||
|
|
||||||
### Phase 4: TODO_LIST.md Generation
|
|
||||||
|
|
||||||
```markdown
|
|
||||||
# Tasks: Test Validation for [Source Session]
|
|
||||||
|
|
||||||
## Task Progress
|
|
||||||
- [ ] **IMPL-001**: Execute and validate tests with iterative fix cycle → [📋](./.task/IMPL-001.json)
|
|
||||||
|
|
||||||
## Execution Details
|
|
||||||
- **Source Session**: WFS-[source-session-id]
|
|
||||||
- **Test Framework**: jest|pytest|cargo
|
|
||||||
- **Max Iterations**: 5
|
|
||||||
- **Tools**: Gemini diagnosis + Codex resume fixes
|
|
||||||
|
|
||||||
## Status Legend
|
|
||||||
- `- [ ]` = Pending
|
|
||||||
- `- [x]` = Completed
|
|
||||||
```
|
|
||||||
|
|
||||||
## Output Files Structure
|
## Output Files Structure
|
||||||
```
|
```
|
||||||
@@ -648,29 +356,52 @@ Diagnose and fix all test failures using iterative Gemini analysis and Codex exe
|
|||||||
## Integration & Usage
|
## Integration & Usage
|
||||||
|
|
||||||
### Command Chain
|
### Command Chain
|
||||||
- **Called By**: `/workflow:test-gen` (Phase 4)
|
- **Called By**: `/workflow:test-gen` (Phase 4), `/workflow:test-fix-gen` (Phase 4)
|
||||||
- **Calls**: None (terminal command)
|
- **Invokes**: `action-planning-agent` for autonomous task generation
|
||||||
- **Followed By**: `/workflow:execute` (user-triggered)
|
- **Followed By**: `/workflow:execute` or `/workflow:test-cycle-execute` (user-triggered)
|
||||||
|
|
||||||
### Basic Usage
|
### Basic Usage
|
||||||
```bash
|
```bash
|
||||||
# Manual fix mode (default)
|
# Agent mode (default, autonomous execution)
|
||||||
/workflow:tools:test-task-generate --session WFS-test-auth
|
/workflow:tools:test-task-generate --session WFS-test-auth
|
||||||
|
|
||||||
# Automated Codex fix mode
|
# With automated Codex fixes for IMPL-002
|
||||||
/workflow:tools:test-task-generate --use-codex --session WFS-test-auth
|
/workflow:tools:test-task-generate --use-codex --session WFS-test-auth
|
||||||
|
|
||||||
|
# CLI execution mode for IMPL-001 test generation
|
||||||
|
/workflow:tools:test-task-generate --cli-execute --session WFS-test-auth
|
||||||
|
|
||||||
|
# Both flags combined
|
||||||
|
/workflow:tools:test-task-generate --cli-execute --use-codex --session WFS-test-auth
|
||||||
```
|
```
|
||||||
|
|
||||||
|
### Execution Modes
|
||||||
|
- **Agent mode** (default): Uses `action-planning-agent` with agent-mode task template
|
||||||
|
- **CLI mode** (`--cli-execute`): Uses Gemini/Qwen/Codex with cli-mode task template for IMPL-001
|
||||||
|
- **Codex fixes** (`--use-codex`): Enables automated fixes in IMPL-002 task
|
||||||
|
|
||||||
### Flag Behavior
|
### Flag Behavior
|
||||||
- **No flag**: `meta.use_codex=false`, manual fixes presented to user
|
- **No flags**: `meta.use_codex=false` (manual fixes), agent-mode generation
|
||||||
- **--use-codex**: `meta.use_codex=true`, Codex automatically applies fixes with resume mechanism
|
- **--use-codex**: `meta.use_codex=true` (Codex automated fixes with resume mechanism in IMPL-002)
|
||||||
|
- **--cli-execute**: Uses CLI tool execution mode for IMPL-001 test generation
|
||||||
|
- **Both flags**: CLI generation + automated Codex fixes
|
||||||
|
|
||||||
|
### Output
|
||||||
|
- Test task JSON files in `.task/` directory (minimum 2: IMPL-001.json + IMPL-002.json)
|
||||||
|
- IMPL_PLAN.md with test generation and fix cycle strategy
|
||||||
|
- TODO_LIST.md with test task indicators
|
||||||
|
- Session state updated with test metadata
|
||||||
|
- MCP enhancements integrated (if available)
|
||||||
|
|
||||||
## Related Commands
|
## Related Commands
|
||||||
- `/workflow:test-gen` - Creates test session and calls this tool
|
- `/workflow:test-gen` - Creates test session and calls this tool (Phase 4)
|
||||||
- `/workflow:tools:context-gather` - Provides cross-session context
|
- `/workflow:test-fix-gen` - Creates test-fix session and calls this tool (Phase 4)
|
||||||
- `/workflow:tools:concept-enhanced` - Provides test strategy analysis
|
- `/workflow:tools:test-context-gather` - Gathers test coverage context
|
||||||
- `/workflow:execute` - Executes the generated test-fix task
|
- `/workflow:tools:test-concept-enhanced` - Generates test strategy analysis (TEST_ANALYSIS_RESULTS.md)
|
||||||
- `@test-fix-agent` - Agent that executes the iterative test-fix cycle
|
- `/workflow:execute` - Executes the generated test-fix tasks
|
||||||
|
- `/workflow:test-cycle-execute` - Executes test-fix cycle with iteration management
|
||||||
|
- `@code-developer` - Agent that executes IMPL-001 (test generation)
|
||||||
|
- `@test-fix-agent` - Agent that executes IMPL-002 (test execution & fix)
|
||||||
|
|
||||||
## Agent Execution Notes
|
## Agent Execution Notes
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user