Spaces:
Running
Running
File size: 2,903 Bytes
55d584b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 |
# Warbler CDA Package - Complete File List
## Package Structure (21 core files + infrastructure)
### Core RAG System (9 files)
β warbler_cda/retrieval_api.py - Main RAG API with hybrid scoring
β warbler_cda/semantic_anchors.py - Semantic memory with provenance
β warbler_cda/anchor_data_classes.py - Core data structures
β warbler_cda/anchor_memory_pool.py - Performance optimization
β warbler_cda/summarization_ladder.py - Hierarchical compression
β warbler_cda/conflict_detector.py - Conflict detection
β warbler_cda/castle_graph.py - Concept extraction
β warbler_cda/melt_layer.py - Memory consolidation
β warbler_cda/evaporation.py - Content distillation
### STAT7 System (4 files)
β warbler_cda/stat7_rag_bridge.py - STAT7 hybrid scoring bridge
β warbler_cda/stat7_entity.py - STAT7 entity system
β warbler_cda/stat7_experiments.py - Validation experiments
β warbler_cda/stat7_visualization.py - Visualization tools
### Embeddings (4 files)
β warbler_cda/embeddings/__init__.py
β warbler_cda/embeddings/base_provider.py - Abstract interface
β warbler_cda/embeddings/factory.py - Provider factory
β warbler_cda/embeddings/local_provider.py - Local TF-IDF embeddings
β warbler_cda/embeddings/openai_provider.py - OpenAI embeddings
### Production API (2 files)
β warbler_cda/api/__init__.py
β warbler_cda/api/service.py - FastAPI service (exp09_api_service.py)
β warbler_cda/api/cli.py - CLI interface (exp09_cli.py)
### Utilities (2 files)
β warbler_cda/utils/__init__.py
β warbler_cda/utils/load_warbler_packs.py - Pack loader
β warbler_cda/utils/hf_warbler_ingest.py - HF dataset ingestion
### Infrastructure Files
β warbler_cda/__init__.py - Package initialization
β requirements.txt - Dependencies
β pyproject.toml - Package metadata
β README.md - Documentation
β app.py - Gradio demo for HuggingFace
β .gitignore - Git exclusions
β LICENSE - MIT License
β DEPLOYMENT.md - Deployment guide
β README_HF.md - HuggingFace Space config
β setup.sh - Quick setup script
β transform_imports.sh - Import transformation script
## Total Files: 32 files
## Import Transformations Applied
All imports have been transformed from:
- `from seed.engine.X import Y` β `from warbler_cda.X import Y`
- `from .X import Y` β `from warbler_cda.X import Y`
Privacy hooks have been removed (not needed for HuggingFace deployment).
## Size Estimate
Total package size: ~500KB (source code only)
With dependencies: ~2GB (includes PyTorch, Transformers, etc.)
## Next Steps
1. Test the package locally:
```bash
cd warbler-cda-package
./setup.sh
python app.py
```
2. Deploy to HuggingFace:
- Set HF_TOKEN in GitLab CI/CD variables
- Push to main or create a tag
- Pipeline will auto-sync to HuggingFace Space
3. Publish to PyPI (optional):
```bash
python -m build
twine upload dist/*
```
|