| Unnamed: 0,question,answer,clean_answer,total_time_seconds,status,error_message,processed_timestamp,pipeline_processing_seconds,response_cleaning_seconds,rag_analysis_seconds,embedding_generation_seconds,weaviate_query_seconds,rag_results_count,rag_embedding_time,rag_weaviate_time,rag_total_time,detailed_logs,performance_analysis,bottleneck_step,performance_grade | |
| 0,What is autism?,"<div dir=""ltr"">Autism, or Autism Spectrum Disorder (ASD), is a natural way of being that affects how a person communicates, interacts with others, and experiences the world. It’s not a disease or illness — it’s a lifelong neurodevelopmental difference that exists on a spectrum, meaning it looks different for every person. | |
| Key aspects of autism include: | |
| - **Social Communication**: Some people with autism may find it harder to understand social cues like facial expressions, tone of voice, or body language. They might prefer direct communication and may have different ways of showing interest or connection. | |
| - **Repetitive Behaviors & Special Interests**: Many autistic people enjoy routines and may feel upset if something changes unexpectedly. They might also have strong, focused interests (like trains, numbers, or animals) that they learn about deeply. | |
| - **Sensory Differences**: Sounds, lights, textures, or smells may feel overwhelming or unnoticed in ways that differ from neurotypical people. For example, a loud noise might feel painful, or a certain fabric might feel uncomfortable. | |
| - **Strengths & Abilities**: Autism often comes with unique strengths — such as excellent attention to detail, strong memory, creativity, honesty, and deep knowledge in special interests. | |
| Autism is not caused by vaccines, parenting style, or poor upbringing. It’s something a person is born with, and it’s a core part of their identity. | |
| Support and understanding — not trying to “fix” autism — help autistic people thrive. With the right accommodations and acceptance, autistic people can lead happy, meaningful lives. | |
| If you’re learning about autism for yourself, a loved one, or a child, I’m here to help with simple, respectful answers. 😊</div>","Autism, or Autism Spectrum Disorder (ASD), is a natural way of being that affects how a person communicates, interacts with others, and experiences the world. It’s not a disease or illness — it’s a lifelong neurodevelopmental difference that exists on a spectrum, meaning it looks different for every person. Key aspects of autism include: - **Social Communication**: Some people with autism may find it harder to understand social cues like facial expressions, tone of voice, or body language. They might prefer direct communication and may have different ways of showing interest or connection. - **Repetitive Behaviors & Special Interests**: Many autistic people enjoy routines and may feel upset if something changes unexpectedly. They might also have strong, focused interests (like trains, numbers, or animals) that they learn about deeply. - **Sensory Differences**: Sounds, lights, textures, or smells may feel overwhelming or unnoticed in ways that differ from neurotypical people. For example, a loud noise might feel painful, or a certain fabric might feel uncomfortable. - **Strengths & Abilities**: Autism often comes with unique strengths — such as excellent attention to detail, strong memory, creativity, honesty, and deep knowledge in special interests. Autism is not caused by vaccines, parenting style, or poor upbringing. It’s something a person is born with, and it’s a core part of their identity. Support and understanding — not trying to “fix” autism — help autistic people thrive. With the right accommodations and acceptance, autistic people can lead happy, meaningful lives. If you’re learning about autism for yourself, a loved one, or a child, I’m here to help with simple, respectful answers. 😊",24.88,success,,2025-09-01T08:15:06.829938,21.75787591934204,6.985664367675781e-05,3.121,1.5114600658416748,1.6092629432678223,3.0,1.5114600658416748,1.6092629432678223,3.1207258701324463,"[08:14:41.949] Starting processing for question 1: 'What is autism?...' | |
| [08:14:41.949] STARTED: Total_Processing | |
| [08:14:41.949] STARTED: RAG_Analysis | |
| [08:14:41.949] Performing detailed RAG analysis... | |
| [08:14:45.070] COMPLETED: RAG_Analysis - 3.121s | Retrieved 3 results, Embedding: 1.511s, Weaviate: 1.609s | |
| RAG ANALYSIS: Query(15 chars, 3 words) -> Embedding: 1.511s (48.43%), Weaviate: 1.609s (51.57%), Results: 3, Total: 3.121s | |
| [08:14:45.071] STARTED: Pipeline_Processing | |
| [08:14:45.071] Starting main pipeline processing... | |
| [08:15:06.829] COMPLETED: Pipeline_Processing - 21.758s | Response length: 1753 chars | |
| [08:15:06.829] STARTED: Response_Cleaning | |
| [08:15:06.829] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 1724 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 24.879s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 21.758s (87.5%) | |
| 🟡 MODERATE RAG_Analysis: 3.121s (12.5%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 3 words, 15 chars | |
| Embedding generation: 1.511s (48.43%) | |
| Weaviate query: 1.609s (51.57%) | |
| Results retrieved: 3",Pipeline_Processing,D (Very Slow) | |
| 1,What is Asperger syndrome?,"<div dir=""ltr"">Asperger syndrome was a term used in the past to describe a type of autism spectrum disorder (ASD) characterized by: | |
| - **Strong language and cognitive abilities** (with no significant delays in speech or intelligence), | |
| - **Difficulty with social interactions**, such as understanding social cues, making eye contact, or building friendships, | |
| - **Restrictive and repetitive behaviors or intense, narrow interests** (e.g., memorizing facts about trains, planets, or maps), | |
| - **Odd or formal speech patterns**, such as speaking in a monotone voice or using overly complex language. | |
| However, in 2013, the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition) unified all types of autism—including Asperger syndrome—under a single diagnosis: **Autism Spectrum Disorder (ASD)**, with levels of support needed (Level 1 being the mildest). | |
| Today, the term “Asperger syndrome” is no longer used clinically, but some individuals and communities still use it to describe their experience. Many people with this profile are referred to as “high-functioning” on the autism spectrum, though the term ""high-functioning"" is not always accurate or helpful—it can downplay the real challenges people face. | |
| Support and strategies often include: | |
| - Social skills coaching, | |
| - Sensory-friendly environments, | |
| - Clear, structured routines, | |
| - Accommodations in school or work. | |
| If you or someone you know shows traits associated with Asperger syndrome, speaking with a mental health professional or developmental specialist experienced in autism can help with understanding and support.</div>","Asperger syndrome was a term used in the past to describe a type of autism spectrum disorder (ASD) characterized by: - **Strong language and cognitive abilities** (with no significant delays in speech or intelligence), - **Difficulty with social interactions**, such as understanding social cues, making eye contact, or building friendships, - **Restrictive and repetitive behaviors or intense, narrow interests** (e.g., memorizing facts about trains, planets, or maps), - **Odd or formal speech patterns**, such as speaking in a monotone voice or using overly complex language. However, in 2013, the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition) unified all types of autism—including Asperger syndrome—under a single diagnosis: **Autism Spectrum Disorder (ASD)**, with levels of support needed (Level 1 being the mildest). Today, the term “Asperger syndrome” is no longer used clinically, but some individuals and communities still use it to describe their experience. Many people with this profile are referred to as “high-functioning” on the autism spectrum, though the term ""high-functioning"" is not always accurate or helpful—it can downplay the real challenges people face. Support and strategies often include: - Social skills coaching, - Sensory-friendly environments, - Clear, structured routines, - Accommodations in school or work. If you or someone you know shows traits associated with Asperger syndrome, speaking with a mental health professional or developmental specialist experienced in autism can help with understanding and support.",21.039,success,,2025-09-01T08:15:28.877200,17.640773057937622,3.886222839355469e-05,3.397,1.325078010559082,2.071218967437744,3.0,1.325078010559082,2.071218967437744,3.396301031112671,"[08:15:07.837] Starting processing for question 2: 'What is Asperger syndrome?...' | |
| [08:15:07.837] STARTED: Total_Processing | |
| [08:15:07.837] STARTED: RAG_Analysis | |
| [08:15:07.837] Performing detailed RAG analysis... | |
| [08:15:11.234] COMPLETED: RAG_Analysis - 3.397s | Retrieved 3 results, Embedding: 1.325s, Weaviate: 2.071s | |
| RAG ANALYSIS: Query(26 chars, 4 words) -> Embedding: 1.325s (39.02%), Weaviate: 2.071s (60.98%), Results: 3, Total: 3.396s | |
| [08:15:11.235] STARTED: Pipeline_Processing | |
| [08:15:11.235] Starting main pipeline processing... | |
| [08:15:28.876] COMPLETED: Pipeline_Processing - 17.641s | Response length: 1608 chars | |
| [08:15:28.876] STARTED: Response_Cleaning | |
| [08:15:28.876] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 1582 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 21.038s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 17.641s (83.9%) | |
| 🟡 MODERATE RAG_Analysis: 3.397s (16.1%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 4 words, 26 chars | |
| Embedding generation: 1.325s (39.02%) | |
| Weaviate query: 2.071s (60.98%) | |
| Results retrieved: 3 | |
| ⚠️ ISSUE: Weaviate query is the bottleneck | |
| 💡 SUGGESTION: Check Weaviate connection, indexing, or reduce vector dimensions",Pipeline_Processing,D (Very Slow) | |
| 2,How can you tell autism from Asperger syndrome?,"✅ Your query was not clearly related to autism. Do you mean: """"?","✅ Your query was not clearly related to autism. Do you mean: """"?",5.044,success,,2025-09-01T08:15:34.928028,2.7343292236328125,1.9311904907226562e-05,2.309,0.8849329948425293,1.423072099685669,3.0,0.8849329948425293,1.423072099685669,2.308008909225464,"[08:15:29.883] Starting processing for question 3: 'How can you tell autism from Asperger syndrome?...' | |
| [08:15:29.883] STARTED: Total_Processing | |
| [08:15:29.883] STARTED: RAG_Analysis | |
| [08:15:29.883] Performing detailed RAG analysis... | |
| [08:15:32.192] COMPLETED: RAG_Analysis - 2.309s | Retrieved 3 results, Embedding: 0.885s, Weaviate: 1.423s | |
| RAG ANALYSIS: Query(47 chars, 8 words) -> Embedding: 0.885s (38.34%), Weaviate: 1.423s (61.66%), Results: 3, Total: 2.308s | |
| [08:15:32.193] STARTED: Pipeline_Processing | |
| [08:15:32.193] Starting main pipeline processing... | |
| [08:15:34.927] COMPLETED: Pipeline_Processing - 2.734s | Response length: 64 chars | |
| [08:15:34.927] STARTED: Response_Cleaning | |
| [08:15:34.927] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 64 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 5.043s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 2.734s (54.2%) | |
| 🔴 SLOW RAG_Analysis: 2.309s (45.8%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 8 words, 47 chars | |
| Embedding generation: 0.885s (38.34%) | |
| Weaviate query: 1.423s (61.66%) | |
| Results retrieved: 3 | |
| ⚠️ ISSUE: Weaviate query is the bottleneck | |
| 💡 SUGGESTION: Check Weaviate connection, indexing, or reduce vector dimensions",pipeline_processing_seconds,B (Average) | |
| 3,What is pervasive developmental disorder–not otherwise specified?,"Hello I'm Wisal, an AI assistant developed by Compumacy AI. Please ask a question specifically about autism.","Hello I'm Wisal, an AI assistant developed by Compumacy AI. Please ask a question specifically about autism.",2.905,success,,2025-09-01T08:15:38.841114,0.0026319026947021484,0.00011205673217773438,2.901,1.2823212146759033,1.6172938346862793,3.0,1.2823212146759033,1.6172938346862793,2.899620294570923,"[08:15:35.935] Starting processing for question 4: 'What is pervasive developmental disorder–not otherwise specified?...' | |
| [08:15:35.935] STARTED: Total_Processing | |
| [08:15:35.935] STARTED: RAG_Analysis | |
| [08:15:35.935] Performing detailed RAG analysis... | |
| [08:15:38.836] COMPLETED: RAG_Analysis - 2.901s | Retrieved 3 results, Embedding: 1.282s, Weaviate: 1.617s | |
| RAG ANALYSIS: Query(65 chars, 7 words) -> Embedding: 1.282s (44.22%), Weaviate: 1.617s (55.78%), Results: 3, Total: 2.900s | |
| [08:15:38.837] STARTED: Pipeline_Processing | |
| [08:15:38.837] Starting main pipeline processing... | |
| [08:15:38.840] COMPLETED: Pipeline_Processing - 0.003s | Response length: 108 chars | |
| [08:15:38.840] STARTED: Response_Cleaning | |
| [08:15:38.840] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 108 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 2.904s | |
| -------------------------------------------------- | |
| 🔴 SLOW RAG_Analysis: 2.901s (99.9%) | |
| 🟢 FAST Pipeline_Processing: 0.003s (0.1%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 7 words, 65 chars | |
| Embedding generation: 1.282s (44.22%) | |
| Weaviate query: 1.617s (55.78%) | |
| Results retrieved: 3",rag_analysis_seconds,A (Good) | |
| 4,What is childhood disintegrative disorder?,"✅ Your query was not clearly related to autism. Do you mean: """"?","✅ Your query was not clearly related to autism. Do you mean: """"?",4.999,success,,2025-09-01T08:15:44.847230,2.3453872203826904,2.2172927856445312e-05,2.653,1.261171817779541,1.3911161422729492,3.0,1.261171817779541,1.3911161422729492,2.652291774749756,"[08:15:39.847] Starting processing for question 5: 'What is childhood disintegrative disorder?...' | |
| [08:15:39.847] STARTED: Total_Processing | |
| [08:15:39.847] STARTED: RAG_Analysis | |
| [08:15:39.847] Performing detailed RAG analysis... | |
| [08:15:42.500] COMPLETED: RAG_Analysis - 2.653s | Retrieved 3 results, Embedding: 1.261s, Weaviate: 1.391s | |
| RAG ANALYSIS: Query(42 chars, 5 words) -> Embedding: 1.261s (47.55%), Weaviate: 1.391s (52.45%), Results: 3, Total: 2.652s | |
| [08:15:42.501] STARTED: Pipeline_Processing | |
| [08:15:42.501] Starting main pipeline processing... | |
| [08:15:44.846] COMPLETED: Pipeline_Processing - 2.345s | Response length: 64 chars | |
| [08:15:44.846] STARTED: Response_Cleaning | |
| [08:15:44.846] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 64 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 4.998s | |
| -------------------------------------------------- | |
| 🔴 SLOW RAG_Analysis: 2.653s (53.1%) | |
| 🔴 SLOW Pipeline_Processing: 2.345s (46.9%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 5 words, 42 chars | |
| Embedding generation: 1.261s (47.55%) | |
| Weaviate query: 1.391s (52.45%) | |
| Results retrieved: 3",rag_analysis_seconds,B (Average) | |
| 5,What is the prognosis of children with autism?,"Hello I'm Wisal, an AI assistant developed by Compumacy AI. Please ask a question specifically about autism.","Hello I'm Wisal, an AI assistant developed by Compumacy AI. Please ask a question specifically about autism.",2.648,success,,2025-09-01T08:15:48.504171,0.002007007598876953,4.7206878662109375e-05,2.646,1.0874121189117432,1.5574243068695068,3.0,1.0874121189117432,1.5574243068695068,2.6448402404785156,"[08:15:45.855] Starting processing for question 6: 'What is the prognosis of children with autism?...' | |
| [08:15:45.855] STARTED: Total_Processing | |
| [08:15:45.855] STARTED: RAG_Analysis | |
| [08:15:45.855] Performing detailed RAG analysis... | |
| [08:15:48.501] COMPLETED: RAG_Analysis - 2.646s | Retrieved 3 results, Embedding: 1.087s, Weaviate: 1.557s | |
| RAG ANALYSIS: Query(46 chars, 8 words) -> Embedding: 1.087s (41.11%), Weaviate: 1.557s (58.89%), Results: 3, Total: 2.645s | |
| [08:15:48.501] STARTED: Pipeline_Processing | |
| [08:15:48.501] Starting main pipeline processing... | |
| [08:15:48.503] COMPLETED: Pipeline_Processing - 0.002s | Response length: 108 chars | |
| [08:15:48.503] STARTED: Response_Cleaning | |
| [08:15:48.503] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 108 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 2.648s | |
| -------------------------------------------------- | |
| 🔴 SLOW RAG_Analysis: 2.646s (99.9%) | |
| 🟢 FAST Pipeline_Processing: 0.002s (0.1%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 8 words, 46 chars | |
| Embedding generation: 1.087s (41.11%) | |
| Weaviate query: 1.557s (58.89%) | |
| Results retrieved: 3",rag_analysis_seconds,A (Good) | |