warbler-cda / PACKAGE_MANIFEST.md
Bellok
staged changes are still showing even after forced push.
55d584b
|
raw
history blame
2.9 kB

Warbler CDA Package - Complete File List

Package Structure (21 core files + infrastructure)

Core RAG System (9 files)

βœ“ warbler_cda/retrieval_api.py - Main RAG API with hybrid scoring βœ“ warbler_cda/semantic_anchors.py - Semantic memory with provenance βœ“ warbler_cda/anchor_data_classes.py - Core data structures βœ“ warbler_cda/anchor_memory_pool.py - Performance optimization βœ“ warbler_cda/summarization_ladder.py - Hierarchical compression βœ“ warbler_cda/conflict_detector.py - Conflict detection βœ“ warbler_cda/castle_graph.py - Concept extraction βœ“ warbler_cda/melt_layer.py - Memory consolidation βœ“ warbler_cda/evaporation.py - Content distillation

STAT7 System (4 files)

βœ“ warbler_cda/stat7_rag_bridge.py - STAT7 hybrid scoring bridge βœ“ warbler_cda/stat7_entity.py - STAT7 entity system βœ“ warbler_cda/stat7_experiments.py - Validation experiments βœ“ warbler_cda/stat7_visualization.py - Visualization tools

Embeddings (4 files)

βœ“ warbler_cda/embeddings/init.py βœ“ warbler_cda/embeddings/base_provider.py - Abstract interface βœ“ warbler_cda/embeddings/factory.py - Provider factory βœ“ warbler_cda/embeddings/local_provider.py - Local TF-IDF embeddings βœ“ warbler_cda/embeddings/openai_provider.py - OpenAI embeddings

Production API (2 files)

βœ“ warbler_cda/api/init.py βœ“ warbler_cda/api/service.py - FastAPI service (exp09_api_service.py) βœ“ warbler_cda/api/cli.py - CLI interface (exp09_cli.py)

Utilities (2 files)

βœ“ warbler_cda/utils/init.py βœ“ warbler_cda/utils/load_warbler_packs.py - Pack loader βœ“ warbler_cda/utils/hf_warbler_ingest.py - HF dataset ingestion

Infrastructure Files

βœ“ warbler_cda/init.py - Package initialization βœ“ requirements.txt - Dependencies βœ“ pyproject.toml - Package metadata βœ“ README.md - Documentation βœ“ app.py - Gradio demo for HuggingFace βœ“ .gitignore - Git exclusions βœ“ LICENSE - MIT License βœ“ DEPLOYMENT.md - Deployment guide βœ“ README_HF.md - HuggingFace Space config βœ“ setup.sh - Quick setup script βœ“ transform_imports.sh - Import transformation script

Total Files: 32 files

Import Transformations Applied

All imports have been transformed from:

  • from seed.engine.X import Y β†’ from warbler_cda.X import Y
  • from .X import Y β†’ from warbler_cda.X import Y

Privacy hooks have been removed (not needed for HuggingFace deployment).

Size Estimate

Total package size: ~500KB (source code only) With dependencies: ~2GB (includes PyTorch, Transformers, etc.)

Next Steps

  1. Test the package locally:

    cd warbler-cda-package
    ./setup.sh
    python app.py
    
  2. Deploy to HuggingFace:

    • Set HF_TOKEN in GitLab CI/CD variables
    • Push to main or create a tag
    • Pipeline will auto-sync to HuggingFace Space
  3. Publish to PyPI (optional):

    python -m build
    twine upload dist/*