Hugging Face's logo
Rahul Bajaj's picture
8 3 5

Rahul Bajaj PRO

thebajajra
ai-queen's profile picture SelmaNajih001's profile picture GVR's profile picture
Ā·
https://bajajra.github.io/machinamasquerade

AI & ML interests

None yet

Recent Activity

reacted to yeonseok-zeticai's post with šŸš€ 14 days ago
āš” RexBERT Complete On-device Study: Comprehensive Performance Analysis Across Mobile Devices (Check details at https://mlange.zetic.ai/p/Steve/RexBERT) TL;DR: Transformer models are now practical for real-time mobile applications. The cloud-to-edge AI migration is complete. - Original model from @thebajajra šŸŽÆ Study Overview: - Model: RexBERT (ModernBERT for E-commerce) - Focus: Real-world deployment viability and performance analysis šŸ“Š Key Performance Metrics: Latency Results: - NPU (Best): 4.74ms average - GPU: 12.56ms average - CPU: 35.16ms average NPU Advantage: 16.98x speedup over CPU Memory Efficiency: - Model Size: 568.96 MB (compressed for mobile) - Runtime Memory: 299.01 MB peak consumption - Load Memory Range: 285 MB - 1,072 MB across devices Accuracy Preservation: - FP16 Precision: 63.72 dB - Quantized Mode: Available with minimal accuracy loss - Inference Quality: Production-grade maintained šŸ›  Technical Implementation: (Runnable with Copy & Paste at the ZETIC.MLange link: https://mlange.zetic.ai/p/Steve/RexBERT) This study demonstrates that: Transformer models are viable for real-time mobile applications NPU acceleration provides the breakthrough needed for practical deployment Mobile-first AI architecture is now technically feasible The performance gap between cloud and edge inference is rapidly closing šŸš€ Real-World Applications Enabled: E-commerce Intelligence: - Instant product search and discovery - Real-time semantic matching - Context-aware recommendations - Natural language query processing Conversational Commerce: - Voice-to-product search - Chatbot-style shopping assistance - Intent recognition and classification - Multi-turn conversation handling Privacy-First AI: - On-device processing (no data transmission) - GDPR/privacy regulation compliant - Reduced server infrastructure costs - Offline capability maintenance Are you ready to integrate BERT-level language understanding into your mobile applications?
updated a model 16 days ago
thebajajra/RexBERT-base-embed-pf-v0.4
updated a model 16 days ago
thebajajra/RexBERT-base-embed-pf-v0.3
View all activity

Organizations

Blog-explorers's profile picture Owlgebra AI's profile picture