Upload 204 files

.gitattributes

@@ -41,3 +41,4 @@ final/__pycache__/hf_unified_server.cpython-313.pyc filter=lfs diff=lfs merge=lf
 final/data/crypto_monitor.db filter=lfs diff=lfs merge=lfs -text
 app/final/__pycache__/hf_unified_server.cpython-313.pyc filter=lfs diff=lfs merge=lfs -text
 app/final/data/crypto_monitor.db filter=lfs diff=lfs merge=lfs -text
+__pycache__/api_server_extended.cpython-313.pyc filter=lfs diff=lfs merge=lfs -text

DEPLOYMENT_GUIDE.md

@@ -1,269 +1,215 @@
-# 🚀 Deployment Guide - HuggingFace Space
-
-## مشکل Dependency Conflict و حل آن
-
-### مشکل قبلی:
-```
-ERROR: Cannot install gradio and websockets>=12.0 because these package versions have conflicting dependencies.
-```
-
-### حل شده:
-```python
-websockets>=10.4,<12.0  # Compatible with gradio-client
-```
-
-## نصب و راه‌اندازی
-
-### روش 1: Docker (توصیه می‌شود)
-```bash
-# Build
-docker build -t crypto-hf-hub .
-
-# Run
-docker run -d \
-  -p 7860:7860 \
-  -e HF_TOKEN=your_token_here \
-  --name crypto-hub \
-  crypto-hf-hub
-
-# Logs
-docker logs -f crypto-hub
-```
-
-### روش 2: مستقیم (Local Development)
-```bash
-# ایجاد virtual environment
-python3 -m venv venv
-source venv/bin/activate  # Windows: venv\Scripts\activate
-
-# نصب dependencies
-pip install --upgrade pip
-pip install -r requirements.txt
-
-# تنظیم environment variables
-export HF_TOKEN=your_huggingface_token
-export PORT=7860
-
-# اجرا
-uvicorn hf_unified_server:app --host 0.0.0.0 --port 7860 --reload
-```
-
-### روش 3: HuggingFace Space
-```bash
-# 1. ساخت Space جدید در HuggingFace
-#    Space SDK: Docker
-#    Hardware: CPU basic (free)
-
-# 2. کلون کردن repository
-git clone https://huggingface.co/spaces/YOUR_USERNAME/YOUR_SPACE_NAME
-cd YOUR_SPACE_NAME
-
-# 3. کپی کردن فایل‌های پروژه
-cp -r crypto-hf-integrated/* .
-
-# 4. Commit و Push
-git add .
-git commit -m "Initial deployment with HF integration"
-git push
-```
-
-## تنظیمات HuggingFace Space
-
-### Dockerfile
-```dockerfile
-FROM python:3.10-slim
-
-WORKDIR /app
-
-# Install system dependencies
-RUN apt-get update && apt-get install -y \
-    build-essential \
-    && rm -rf /var/lib/apt/lists/*
-
-# Copy requirements
-COPY requirements.txt .
-
-# Install Python dependencies
-RUN pip install --no-cache-dir -r requirements.txt
-
-# Copy application
-COPY . .
-
-# Create directories
-RUN mkdir -p data/database logs
-
-# Expose port
-EXPOSE 7860
-
-# Set environment
-ENV PORT=7860
-ENV PYTHONUNBUFFERED=1
-
-# Start server
-CMD ["uvicorn", "hf_unified_server:app", "--host", "0.0.0.0", "--port", "7860"]
-```
-
-### Space Settings (در UI)
-```yaml
-# Secrets
-HF_TOKEN: your_token_here
-
-# Hardware
-- CPU basic (Free) - برای شروع
-- CPU upgrade (Paid) - برای production با traffic بیشتر
-```
-
-## تست Endpoints
-
-### Health Check
-```bash
-curl http://localhost:7860/api/health
-```
-
-### Top Coins
-```bash
-curl http://localhost:7860/api/coins/top?limit=10
-```
-
-### Market Stats
-```bash
-curl http://localhost:7860/api/market/stats
-```
-
-### Sentiment Analysis
-```bash
-curl -X POST http://localhost:7860/api/sentiment/analyze \
-  -H "Content-Type: application/json" \
-  -d '{"text": "Bitcoin is breaking new ATH!"}'
-```
-
-### Models List
-```bash
-curl http://localhost:7860/api/models/list
-```
-
-### Datasets List
-```bash
-curl http://localhost:7860/api/datasets/list
-```
-
-### WebSocket Test (در browser console)
-```javascript
-const ws = new WebSocket('ws://localhost:7860/ws');
-
-ws.onopen = () => console.log('Connected');
-ws.onmessage = (event) => console.log('Update:', JSON.parse(event.data));
-ws.onerror = (error) => console.error('Error:', error);
-```
-
-## مشکلات رایج و راه حل
-
-### 1. Out of Memory
-```bash
-# کاهش مدل‌های load شده
-# در ai_models.py فقط crypto_sent_0 و financial_sent_0 load میشه
-
-# یا استفاده از CPU basic به جای GPU
-```
-
-### 2. Slow Model Loading
-```bash
-# استفاده از model caching در HuggingFace
-export TRANSFORMERS_CACHE=/app/.cache/huggingface
-```
-
-### 3. Rate Limiting
-```bash
-# استفاده از HF_TOKEN برای rate limit بالاتر
-export HF_TOKEN=hf_your_token
-```
-
-### 4. WebSocket Connection Failed
-```bash
-# چک کردن CORS settings
-# مطمئن شوید که در hf_unified_server.py:
-app.add_middleware(
-    CORSMiddleware,
-    allow_origins=["*"],
-    allow_credentials=True,
-    allow_methods=["*"],
-    allow_headers=["*"],
-)
-```
-
-## بهینه‌سازی برای Production
-
-### 1. Caching
-```python
-# در hf_unified_server.py
-from functools import lru_cache
-
-@lru_cache(maxsize=128)
-def get_cached_coins(limit: int):
-    # Cache results for 1 minute
-    pass
-```
-
-### 2. Rate Limiting
-```python
-from slowapi import Limiter
-from slowapi.util import get_remote_address
-
-limiter = Limiter(key_func=get_remote_address)
-app.state.limiter = limiter
-
-@app.get("/api/sentiment/analyze")
-@limiter.limit("10/minute")
-async def analyze_sentiment(...):
-    pass
-```
-
-### 3. Model Optimization
-```python
-# Use smaller models for faster inference
-# quantization برای کاهش حجم
-from transformers import AutoModelForSequenceClassification
-model = AutoModelForSequenceClassification.from_pretrained(
-    "model_id",
-    torch_dtype=torch.float16  # Half precision
-)
-```
-
-## Monitoring
-
-### Logs
-```bash
-# Docker logs
-docker logs -f crypto-hub
-
-# HuggingFace Space logs
-# قابل مشاهده در dashboard Space
-```
-
-### Metrics
-```bash
-# Health endpoint برای monitoring
-curl http://your-space.hf.space/api/health
-
-# Response:
-{
-  "status": "healthy",
-  "uptime": 3600,
-  "models_loaded": 2,
-  "datasets_available": 14
-}
-```
-
-## Support
-
-- **Documentation**: README_HF_INTEGRATION.md
-- **Issues**: Check logs first
-- **Performance**: Use HF Space with GPU for heavy models
-
-## نکات مهم
-
-1. ⚠️ **HF_TOKEN**: حتماً در secrets تنظیم کنید
-2. 🔥 **Models**: اولین بار کند است (downloading)
-3. 💾 **Cache**: مدل‌ها cache می‌شوند
-4. 🚀 **WebSocket**: برای real-time updates
-5. 📊 **Dashboard**: در `/` قابل دسترسی
+# 🚀 Deployment Guide - Modern Crypto Intelligence Hub
+
+## Overview
+This guide explains how to deploy the **new modern UI** with sidebar navigation, glassmorphism theme, and visual sentiment analysis.
+
+---
+
+## 🎯 What Changed
+
+### ✨ New Features
+1. **Vertical Sidebar Navigation** - Replaces top tab bar, collapses to hamburger menu on mobile
+2. **Inline SVG Icons** - Replaced FontAwesome with crisp SVG icons (Heroicons/Feather style)
+3. **Glassmorphism Theme** - Deep dark theme with blur effects and neon accents
+4. **Modern News Cards** - Time-ago formatting, sorted by latest, image placeholders
+5. **Visual Sentiment Analysis**:
+   - Gauge/speedometer charts showing sentiment scores
+   - Animated trend arrows (green up for bullish, red down for bearish)
+   - Confidence bars with shimmer effects
+6. **Fixed Dashboard** - Loads immediately on page load
+
+### 📁 Files Updated
+- `index.html` - New sidebar structure with SVG icons
+- `static/css/main.css` - Glassmorphism styles, news cards, sentiment visualizations
+- `static/js/app.js` - Visual sentiment functions, time-ago formatting, improved news display
+- `app.py` - Forces FastAPI mode
+- `Dockerfile` - Updated to run FastAPI directly
+- `README.md` - Added Hugging Face Space metadata
+
+---
+
+## 🚀 Deployment Options
+
+### Option 1: Hugging Face Spaces (Recommended)
+
+The app is configured to run on Hugging Face Spaces with Docker SDK.
+
+**Steps:**
+1. Push all files to your Hugging Face Space repository
+2. Ensure `README.md` has the correct metadata (already added):
+   ```yaml
+   ---
+   title: Crypto Intelligence Hub
+   emoji: 🚀
+   sdk: docker
+   app_port: 7860
+   ---
+   ```
+3. The Space will automatically build and deploy using the `Dockerfile`
+4. The Dockerfile is configured to run: `uvicorn api_server_extended:app`
+
+**Environment Variables (Optional):**
+- `USE_FASTAPI_HTML=true` (default in Dockerfile)
+- `PORT=7860` (default)
+
+### Option 2: Local Development
+
+**Using PowerShell:**
+```powershell
+# Navigate to project directory
+cd "path\to\crypto-dt-source-main"
+
+# Install dependencies
+pip install -r requirements.txt
+
+# Run FastAPI server directly
+python -m uvicorn api_server_extended:app --host 0.0.0.0 --port 7860 --reload
+```
+
+**Using the startup script:**
+```bash
+# Make executable (Linux/Mac)
+chmod +x start_app.sh
+./start_app.sh
+```
+
+### Option 3: Docker
+
+```bash
+# Build image
+docker build -t crypto-hub .
+
+# Run container
+docker run -p 7860:7860 crypto-hub
+```
+
+---
+
+## 🔧 Troubleshooting
+
+### Issue: Gradio UI shows instead of modern HTML UI
+
+**Solution:**
+The app should automatically use FastAPI mode. If you see Gradio:
+
+1. Check environment variables:
+   ```bash
+   export USE_FASTAPI_HTML=true
+   export USE_GRADIO=false
+   ```
+
+2. Run FastAPI directly:
+   ```bash
+   python -m uvicorn api_server_extended:app --host 0.0.0.0 --port 7860
+   ```
+
+3. Verify `Dockerfile` CMD:
+   ```dockerfile
+   CMD ["python", "-m", "uvicorn", "api_server_extended:app", "--host", "0.0.0.0", "--port", "7860"]
+   ```
+
+### Issue: Static files not loading
+
+**Solution:**
+1. Verify `static/` folder exists with `css/` and `js/` subdirectories
+2. Check `api_server_extended.py` mounts static files:
+   ```python
+   app.mount("/static", StaticFiles(directory=str(static_path)), name="static")
+   ```
+3. Access files at: `http://localhost:7860/static/css/main.css`
+
+### Issue: News not loading
+
+**Solution:**
+1. Click "Fetch Latest News" button to pull from CryptoCompare API
+2. Check database: `data/database/crypto_monitor.db`
+3. Verify `/api/news` endpoint returns data
+
+### Issue: Sentiment analysis not working
+
+**Solution:**
+1. Check Hugging Face models are loaded: Visit `/api/models/status`
+2. Models use fallback lexical analysis if HF models unavailable
+3. Check logs for model loading errors
+
+---
+
+## 📊 API Endpoints
+
+The FastAPI server provides these endpoints:
+
+- `/` - Main dashboard (HTML UI)
+- `/api/resources` - System resources summary
+- `/api/market` - Cryptocurrency market data
+- `/api/news` - News articles
+- `/api/news/fetch` - Fetch latest news from CryptoCompare
+- `/api/sentiment/analyze` - Sentiment analysis
+- `/api/models/status` - AI models status
+- `/api/models/list` - Available models
+- `/docs` - Interactive API documentation
+- `/health` - Health check
+
+---
+
+## 🎨 UI Features
+
+### Sidebar Navigation
+- **Desktop:** Fixed sidebar on left, 280px wide
+- **Mobile:** Collapsible hamburger menu with overlay
+- **Icons:** Inline SVG for crisp rendering at any size
+
+### News Feed
+- **Time-Ago:** Shows "2 hours ago" instead of dates
+- **Sorting:** Latest news first
+- **Cards:** Modern card design with image placeholders
+- **Symbols:** Related crypto symbols as badges
+
+### Sentiment Analysis
+- **Gauge Chart:** Semi-circular gauge (0-100 scale)
+- **Trend Arrows:** Animated SVG arrows indicating direction
+- **Confidence Bar:** Progress bar with shimmer animation
+- **Color Coding:**
+  - Green (Bullish/Positive)
+  - Red (Bearish/Negative)
+  - Yellow (Neutral)
+
+---
+
+## 🔒 Security Notes
+
+1. **API Keys:** Store in environment variables, not in code
+2. **CORS:** Configured for all origins in development (restrict in production)
+3. **Rate Limiting:** Consider adding rate limiting for production
+4. **Database:** SQLite for development, consider PostgreSQL for production
+
+---
+
+## 📝 Next Steps
+
+1. **Deploy to Hugging Face Spaces**
+2. **Test all features:**
+   - Dashboard loads
+   - News fetches and displays
+   - Sentiment analysis works
+   - Sidebar navigation functions
+   - Mobile responsive design
+3. **Monitor logs** for any errors
+4. **Customize:**
+   - Add your own API keys
+   - Adjust theme colors in `main.css`
+   - Add more trading pairs in `trading_pairs.txt`
+
+---
+
+## 🆘 Support
+
+If you encounter issues:
+1. Check browser console for JavaScript errors
+2. Check server logs for Python errors
+3. Verify all dependencies are installed
+4. Ensure `index.html`, `main.css`, and `app.js` are in correct locations
+
+---
+
+**Enjoy your modern Crypto Intelligence Hub! 🚀**
+

Dockerfile

@@ -33,5 +33,5 @@ ENV USE_GRADIO=false
 
 EXPOSE 7860
 
-# Run the application (will choose Gradio or FastAPI based on env vars)
-CMD ["python", "app.py"]
+# Run the FastAPI application directly for modern HTML UI
+CMD ["python", "-m", "uvicorn", "api_server_extended:app", "--host", "0.0.0.0", "--port", "7860"]

__pycache__/api_server_extended.cpython-313.pyc

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:25c377b2d08d563fce48c8cd8fda8166287ce225d1a7469a288227d1ab6b42e3
+size 146136

__pycache__/hf_unified_server.cpython-313.pyc

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:95d175b459a983f328419804aacfc0f73321bc4e516957dfabc266847afc655c
-size 113609
+oid sha256:daa8c605bec5a177f1583e7c65957cbe2b6d7b9345bd816a4776b3f43e1d0b34
+size 457

api_server_extended.py

@@ -655,15 +655,15 @@ try:
     static_path = WORKSPACE_ROOT / "static"
     if static_path.exists():
         app.mount("/static", StaticFiles(directory=str(static_path)), name="static")
-        print(f"✓ Mounted static files from {static_path}")
+        logger.info(f"Mounted static files from {static_path}")
     else:
         # Create static directories if they don't exist
         static_path.mkdir(parents=True, exist_ok=True)
         (static_path / "css").mkdir(exist_ok=True)
         (static_path / "js").mkdir(exist_ok=True)
-        print(f"✓ Created static directories at {static_path}")
+        logger.info(f"Created static directories at {static_path}")
 except Exception as e:
-    print(f"⚠ Could not mount static files: {e}")
+    logger.warning(f"Could not mount static files: {e}")
 
 # Serve trading pairs file
 @app.get("/trading_pairs.txt")

app.py

@@ -768,11 +768,12 @@ if __name__ == "__main__":
     logger.info(f"🤖 Models available: {len(hub.get_available_models())}")
     logger.info(f"🔌 FastAPI available: {FASTAPI_AVAILABLE}")
     
-    # Force FastAPI+HTML mode for HuggingFace Spaces
-    # Choose mode based on environment variables
+    # FORCE FastAPI+HTML mode for modern UI
+    # Always prefer FastAPI with HTML interface over Gradio
     if FASTAPI_AVAILABLE:
         # Run FastAPI with HTML interface (preferred for HF Spaces)
         logger.info("🌐 Starting FastAPI server with HTML interface...")
+        logger.info("✨ Modern UI with Sidebar Navigation enabled")
         import uvicorn
         port = int(os.getenv("PORT", "7860"))
         uvicorn.run(
@@ -781,17 +782,23 @@ if __name__ == "__main__":
             port=port,
             log_level="info"
         )
-    elif USE_GRADIO:
-        # Run Gradio interface (fallback)
-        logger.info("🎨 Starting Gradio interface...")
-        app = create_gradio_interface()
-        app.launch(
-            server_name="0.0.0.0",
-            server_port=int(os.getenv("GRADIO_SERVER_PORT", "7860")),
-            share=False,
-            show_error=True
-        )
     else:
-        # No UI mode available
-        logger.error("❌ No UI mode available (FastAPI unavailable and Gradio disabled). Exiting.")
-        raise SystemExit(1)
+        # Fallback: Try to import and run api_server_extended directly
+        logger.warning("⚠️ FastAPI not imported via normal path, trying direct import...")
+        try:
+            import sys
+            sys.path.insert(0, str(WORKSPACE_ROOT))
+            from api_server_extended import app as fastapi_app_direct
+            import uvicorn
+            port = int(os.getenv("PORT", "7860"))
+            logger.info("🌐 Starting FastAPI server (direct import)...")
+            uvicorn.run(
+                fastapi_app_direct,
+                host="0.0.0.0",
+                port=port,
+                log_level="info"
+            )
+        except Exception as e:
+            logger.error(f"❌ Could not start FastAPI: {e}")
+            logger.error("❌ Modern UI unavailable. Please check api_server_extended.py")
+            raise SystemExit(1)