Files
agents/tools/data-validation.md
Seth Hobson d2f3886ae1 Consolidate workflows and tools from commands repository
Repository Restructure:
- Move all 83 agent .md files to agents/ subdirectory
- Add 15 workflow orchestrators from commands repo to workflows/
- Add 42 development tools from commands repo to tools/
- Update README for unified repository structure

The commands repository functionality is now fully integrated, providing
complete workflow orchestration and development tooling alongside agents.

Directory Structure:
- agents/    - 83 specialized AI agents
- workflows/ - 15 multi-agent orchestration commands
- tools/     - 42 focused development utilities

No breaking changes to agent functionality - all agents remain accessible
with same names and behavior. Adds workflow and tool commands for enhanced
multi-agent coordination capabilities.
2025-10-08 08:28:33 -04:00

1.4 KiB

model
model
claude-sonnet-4-0

Data Validation Pipeline

Create a comprehensive data validation system for: $ARGUMENTS

Implement validation including:

  1. Schema Validation:

    • Pydantic models for structure
    • JSON Schema generation
    • Type checking and coercion
    • Nested object validation
    • Custom validators
  2. Data Quality Checks:

    • Null/missing value handling
    • Outlier detection
    • Statistical validation
    • Business rule enforcement
    • Referential integrity
  3. Data Profiling:

    • Automatic type inference
    • Distribution analysis
    • Cardinality checks
    • Pattern detection
    • Anomaly identification
  4. Validation Rules:

    • Field-level constraints
    • Cross-field validation
    • Temporal consistency
    • Format validation (email, phone, etc.)
    • Custom business logic
  5. Error Handling:

    • Detailed error messages
    • Error categorization
    • Partial validation support
    • Error recovery strategies
    • Validation reports
  6. Performance:

    • Streaming validation
    • Batch processing
    • Parallel validation
    • Caching strategies
    • Incremental validation
  7. Integration:

    • API endpoint validation
    • Database constraints
    • Message queue validation
    • File upload validation
    • Real-time validation

Include data quality metrics, monitoring dashboards, and alerting. Make it extensible for custom validation rules.