Files
agents/tools/data-validation.md
Seth Hobson d2f3886ae1 Consolidate workflows and tools from commands repository
Repository Restructure:
- Move all 83 agent .md files to agents/ subdirectory
- Add 15 workflow orchestrators from commands repo to workflows/
- Add 42 development tools from commands repo to tools/
- Update README for unified repository structure

The commands repository functionality is now fully integrated, providing
complete workflow orchestration and development tooling alongside agents.

Directory Structure:
- agents/    - 83 specialized AI agents
- workflows/ - 15 multi-agent orchestration commands
- tools/     - 42 focused development utilities

No breaking changes to agent functionality - all agents remain accessible
with same names and behavior. Adds workflow and tool commands for enhanced
multi-agent coordination capabilities.
2025-10-08 08:28:33 -04:00

61 lines
1.4 KiB
Markdown

---
model: claude-sonnet-4-0
---
# Data Validation Pipeline
Create a comprehensive data validation system for: $ARGUMENTS
Implement validation including:
1. **Schema Validation**:
- Pydantic models for structure
- JSON Schema generation
- Type checking and coercion
- Nested object validation
- Custom validators
2. **Data Quality Checks**:
- Null/missing value handling
- Outlier detection
- Statistical validation
- Business rule enforcement
- Referential integrity
3. **Data Profiling**:
- Automatic type inference
- Distribution analysis
- Cardinality checks
- Pattern detection
- Anomaly identification
4. **Validation Rules**:
- Field-level constraints
- Cross-field validation
- Temporal consistency
- Format validation (email, phone, etc.)
- Custom business logic
5. **Error Handling**:
- Detailed error messages
- Error categorization
- Partial validation support
- Error recovery strategies
- Validation reports
6. **Performance**:
- Streaming validation
- Batch processing
- Parallel validation
- Caching strategies
- Incremental validation
7. **Integration**:
- API endpoint validation
- Database constraints
- Message queue validation
- File upload validation
- Real-time validation
Include data quality metrics, monitoring dashboards, and alerting. Make it extensible for custom validation rules.