| Unnamed: 0,question,answer,clean_answer,total_time_seconds,status,error_message,processed_timestamp,pipeline_processing_seconds,response_cleaning_seconds,rag_analysis_seconds,embedding_generation_seconds,weaviate_query_seconds,rag_results_count,rag_embedding_time,rag_weaviate_time,rag_total_time,detailed_logs,performance_analysis,bottleneck_step,performance_grade | |
| 0,What is autism?,"<div dir=""ltr"">Autism, or Autism Spectrum Disorder (ASD), is a neurodevelopmental condition characterized by differences in social interaction, communication, and behavior. Individuals with autism may have unique ways of processing information, sensory sensitivities, and patterns of interest or behavior. Autism is a spectrum, meaning it affects individuals in different ways and to varying degrees. It is typically diagnosed in early childhood and is believed to be caused by a combination of genetic and environmental factors. Autism is not a disease or illness, but a natural variation of the human brain.</div>","Autism, or Autism Spectrum Disorder (ASD), is a neurodevelopmental condition characterized by differences in social interaction, communication, and behavior. Individuals with autism may have unique ways of processing information, sensory sensitivities, and patterns of interest or behavior. Autism is a spectrum, meaning it affects individuals in different ways and to varying degrees. It is typically diagnosed in early childhood and is believed to be caused by a combination of genetic and environmental factors. Autism is not a disease or illness, but a natural variation of the human brain.",21.813,success,,2025-09-01T07:41:55.321327,19.163684844970703,6.890296936035156e-05,2.648,1.1609511375427246,1.4868340492248535,3.0,1.1609511375427246,1.4868340492248535,2.647789239883423,"[07:41:33.507] Starting processing for question 1: 'What is autism?...' | |
| [07:41:33.507] STARTED: Total_Processing | |
| [07:41:33.507] STARTED: RAG_Analysis | |
| [07:41:33.507] Performing detailed RAG analysis... | |
| [07:41:36.155] COMPLETED: RAG_Analysis - 2.648s | Retrieved 3 results, Embedding: 1.161s, Weaviate: 1.487s | |
| RAG ANALYSIS: Query(15 chars, 3 words) -> Embedding: 1.161s (43.85%), Weaviate: 1.487s (56.15%), Results: 3, Total: 2.648s | |
| [07:41:36.156] STARTED: Pipeline_Processing | |
| [07:41:36.156] Starting main pipeline processing... | |
| [07:41:55.320] COMPLETED: Pipeline_Processing - 19.164s | Response length: 615 chars | |
| [07:41:55.320] STARTED: Response_Cleaning | |
| [07:41:55.320] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 594 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 21.812s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 19.164s (87.9%) | |
| 🟡 MODERATE RAG_Analysis: 2.648s (12.1%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 3 words, 15 chars | |
| Embedding generation: 1.161s (43.85%) | |
| Weaviate query: 1.487s (56.15%) | |
| Results retrieved: 3",Pipeline_Processing,D (Very Slow) | |
| 1,What is Asperger syndrome?,"<div dir=""ltr"">Asperger syndrome is a neurodevelopmental condition that was previously considered a separate diagnosis within the autism spectrum. It is characterized by challenges with social interaction, restricted or repetitive patterns of behavior, and intense focus on specific interests. Unlike other forms of autism, individuals with Asperger syndrome typically do not have significant delays in language or cognitive development. The term ""Asperger syndrome"" is no longer used in the current diagnostic manual (DSM-5), as the condition is now included under the broader category of Autism Spectrum Disorder (ASD). However, many people still use the term to describe their experience.</div>","Asperger syndrome is a neurodevelopmental condition that was previously considered a separate diagnosis within the autism spectrum. It is characterized by challenges with social interaction, restricted or repetitive patterns of behavior, and intense focus on specific interests. Unlike other forms of autism, individuals with Asperger syndrome typically do not have significant delays in language or cognitive development. The term ""Asperger syndrome"" is no longer used in the current diagnostic manual (DSM-5), as the condition is now included under the broader category of Autism Spectrum Disorder (ASD). However, many people still use the term to describe their experience.",26.027,success,,2025-09-01T07:42:22.355475,23.784883975982666,2.6226043701171875e-05,2.241,0.8744008541107178,1.3659179210662842,3.0,0.8744008541107178,1.3659179210662842,2.240324020385742,"[07:41:56.327] Starting processing for question 2: 'What is Asperger syndrome?...' | |
| [07:41:56.328] STARTED: Total_Processing | |
| [07:41:56.328] STARTED: RAG_Analysis | |
| [07:41:56.328] Performing detailed RAG analysis... | |
| [07:41:58.569] COMPLETED: RAG_Analysis - 2.241s | Retrieved 3 results, Embedding: 0.874s, Weaviate: 1.366s | |
| RAG ANALYSIS: Query(26 chars, 4 words) -> Embedding: 0.874s (39.03%), Weaviate: 1.366s (60.97%), Results: 3, Total: 2.240s | |
| [07:41:58.569] STARTED: Pipeline_Processing | |
| [07:41:58.569] Starting main pipeline processing... | |
| [07:42:22.354] COMPLETED: Pipeline_Processing - 23.785s | Response length: 697 chars | |
| [07:42:22.354] STARTED: Response_Cleaning | |
| [07:42:22.354] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 676 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 26.026s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 23.785s (91.4%) | |
| 🟢 FAST RAG_Analysis: 2.241s (8.6%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 4 words, 26 chars | |
| Embedding generation: 0.874s (39.03%) | |
| Weaviate query: 1.366s (60.97%) | |
| Results retrieved: 3 | |
| ⚠️ ISSUE: Weaviate query is the bottleneck | |
| 💡 SUGGESTION: Check Weaviate connection, indexing, or reduce vector dimensions",Pipeline_Processing,D (Very Slow) | |
| 2,How can you tell autism from Asperger syndrome?,"<div dir=""ltr"">Autism and Asperger's syndrome are both part of the autism spectrum, but they differed mainly in the level of language development and intellectual ability: | |
| - **Autism (ASD)**: Can involve delays or lack of language development, as well as intellectual or developmental delays. Social communication challenges and repetitive behaviors are present. | |
| - **Asperger's Syndrome**: Involved similar social and behavioral challenges, but without significant delays in language or cognitive development. Individuals typically had normal to above-average intelligence and early language skills. | |
| However, since the DSM-5 (2013) was published, Asperger's syndrome is no longer a separate diagnosis. It has been included under the broader category of **Autism Spectrum Disorder (ASD)**. Now, all individuals are classified based on the level of support they need, rather than specific subtypes. The term ""Asperger’s"" is still sometimes used informally to describe someone on the spectrum who has strong language and cognitive skills but struggles with social interaction and has restricted interests.</div>","Autism and Asperger's syndrome are both part of the autism spectrum, but they differed mainly in the level of language development and intellectual ability: - **Autism (ASD)**: Can involve delays or lack of language development, as well as intellectual or developmental delays. Social communication challenges and repetitive behaviors are present. - **Asperger's Syndrome**: Involved similar social and behavioral challenges, but without significant delays in language or cognitive development. Individuals typically had normal to above-average intelligence and early language skills. However, since the DSM-5 (2013) was published, Asperger's syndrome is no longer a separate diagnosis. It has been included under the broader category of **Autism Spectrum Disorder (ASD)**. Now, all individuals are classified based on the level of support they need, rather than specific subtypes. The term ""Asperger’s"" is still sometimes used informally to describe someone on the spectrum who has strong language and cognitive skills but struggles with social interaction and has restricted interests.",27.634,success,,2025-09-01T07:42:51.001211,25.20990300178528,8.106231689453125e-05,2.423,1.1454429626464844,1.2770929336547852,3.0,1.1454429626464844,1.2770929336547852,2.4225380420684814,"[07:42:23.361] Starting processing for question 3: 'How can you tell autism from Asperger syndrome?...' | |
| [07:42:23.362] STARTED: Total_Processing | |
| [07:42:23.362] STARTED: RAG_Analysis | |
| [07:42:23.362] Performing detailed RAG analysis... | |
| [07:42:25.785] COMPLETED: RAG_Analysis - 2.423s | Retrieved 3 results, Embedding: 1.145s, Weaviate: 1.277s | |
| RAG ANALYSIS: Query(47 chars, 8 words) -> Embedding: 1.145s (47.28%), Weaviate: 1.277s (52.72%), Results: 3, Total: 2.423s | |
| [07:42:25.785] STARTED: Pipeline_Processing | |
| [07:42:25.785] Starting main pipeline processing... | |
| [07:42:50.995] COMPLETED: Pipeline_Processing - 25.210s | Response length: 1111 chars | |
| [07:42:50.995] STARTED: Response_Cleaning | |
| [07:42:50.995] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 1087 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 27.633s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 25.210s (91.2%) | |
| 🟢 FAST RAG_Analysis: 2.423s (8.8%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 8 words, 47 chars | |
| Embedding generation: 1.145s (47.28%) | |
| Weaviate query: 1.277s (52.72%) | |
| Results retrieved: 3",Pipeline_Processing,D (Very Slow) | |
| 3,What is pervasive developmental disorder–not otherwise specified?,"<div dir=""ltr"">ما هو الاضطراب التنموي الشامل – غير محدد آخر؟ | |
| الاضطراب التنموي الشامل – غير محدد آخر (PDD-NOS) كان تشخيصًا استخدمه دليل التشخيص والتصنيف التشخيصي للاضطرابات النفسية (DSM-IV) بالنسبة للأشخاص الذين أظهروا بعض، لكن ليس جميع، أعراض اضطراب طيف التوحد (ASD)، أو الذين كانت أعراضهم غير شديدة بما يكفي لتلبية المعايير الكاملة لحالات مثل اضطراب التوحد أو متلازمة أسبرجر. وكان يُمنح غالبًا للأفراد الذين يواجهون تحديات واضحة في التفاعل الاجتماعي أو التواصل أو السلوك، والتي لم تكن مناسبة بالضبط لمعايير التشخيص الأخرى الخاصة باضطرابات طيف التوحد. | |
| ومع ذلك، لم يعد يُستخدم مصطلح PDD-NOS كتشخيص منفصل. ومع إصدار دليل DSM-5 عام 2013، أصبح جميع الأشخاص الذين كان من المفترض أن يُ诊断وا سابقًا بالـ PDD-NOS الآن يُ диагنوسون بـ اضطراب طيف التوحد (ASD). يُستخدم النظام الجديد تشخيصًا واحدًا مع مستويات مختلفة من الدعم اللازم لعكس مدى شدة الأعراض ومداها، مع الاعتراف بأن التوحد موجود على طيف. وقد ساهم هذا التغيير في توفير فهم أوضح وثابت أكثر للتوحد، وضمان وصول أفضل إلى الخدمات والدعم المناسبة.</div>",ما هو الاضطراب التنموي الشامل – غير محدد آخر؟ الاضطراب التنموي الشامل – غير محدد آخر (PDD-NOS) كان تشخيصًا استخدمه دليل التشخيص والتصنيف التشخيصي للاضطرابات النفسية (DSM-IV) بالنسبة للأشخاص الذين أظهروا بعض، لكن ليس جميع، أعراض اضطراب طيف التوحد (ASD)، أو الذين كانت أعراضهم غير شديدة بما يكفي لتلبية المعايير الكاملة لحالات مثل اضطراب التوحد أو متلازمة أسبرجر. وكان يُمنح غالبًا للأفراد الذين يواجهون تحديات واضحة في التفاعل الاجتماعي أو التواصل أو السلوك، والتي لم تكن مناسبة بالضبط لمعايير التشخيص الأخرى الخاصة باضطرابات طيف التوحد. ومع ذلك، لم يعد يُستخدم مصطلح PDD-NOS كتشخيص منفصل. ومع إصدار دليل DSM-5 عام 2013، أصبح جميع الأشخاص الذين كان من المفترض أن يُ诊断وا سابقًا بالـ PDD-NOS الآن يُ диагنوسون بـ اضطراب طيف التوحد (ASD). يُستخدم النظام الجديد تشخيصًا واحدًا مع مستويات مختلفة من الدعم اللازم لعكس مدى شدة الأعراض ومداها، مع الاعتراف بأن التوحد موجود على طيف. وقد ساهم هذا التغيير في توفير فهم أوضح وثابت أكثر للتوحد، وضمان وصول أفضل إلى الخدمات والدعم المناسبة.,47.96,success,,2025-09-01T07:43:39.968086,45.65593719482422,7.295608520507812e-05,2.304,0.9525830745697021,1.350536823272705,3.0,0.9525830745697021,1.350536823272705,2.3031232357025146,"[07:42:52.006] Starting processing for question 4: 'What is pervasive developmental disorder–not otherwise specified?...' | |
| [07:42:52.006] STARTED: Total_Processing | |
| [07:42:52.006] STARTED: RAG_Analysis | |
| [07:42:52.006] Performing detailed RAG analysis... | |
| [07:42:54.310] COMPLETED: RAG_Analysis - 2.304s | Retrieved 3 results, Embedding: 0.953s, Weaviate: 1.351s | |
| RAG ANALYSIS: Query(65 chars, 7 words) -> Embedding: 0.953s (41.36%), Weaviate: 1.351s (58.64%), Results: 3, Total: 2.303s | |
| [07:42:54.310] STARTED: Pipeline_Processing | |
| [07:42:54.310] Starting main pipeline processing... | |
| [07:43:39.966] COMPLETED: Pipeline_Processing - 45.656s | Response length: 999 chars | |
| [07:43:39.966] STARTED: Response_Cleaning | |
| [07:43:39.966] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 975 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 47.960s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 45.656s (95.2%) | |
| 🟢 FAST RAG_Analysis: 2.304s (4.8%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 7 words, 65 chars | |
| Embedding generation: 0.953s (41.36%) | |
| Weaviate query: 1.351s (58.64%) | |
| Results retrieved: 3",Pipeline_Processing,D (Very Slow) | |
| 4,What is childhood disintegrative disorder?,"<div dir=""ltr"">Childhood Disintegrative Disorder (CDD), also known as Heller's syndrome, is a rare condition on the autism spectrum characterized by a significant regression in skills after a period of normal development, typically between ages 2 and 10. Children with CDD lose previously acquired abilities in areas such as language, social skills, toileting, motor skills, and play. Symptoms often include communication deficits, impaired social interactions, repetitive behaviors, and restricted interests. The condition is distinct from other autism spectrum disorders due to the marked regression and later onset. Diagnosis requires a thorough evaluation, and early intervention with behavioral, educational, and supportive therapies can help improve outcomes. CDD is extremely rare and is now considered part of the broader autism spectrum in diagnostic criteria like the DSM-5.</div>","Childhood Disintegrative Disorder (CDD), also known as Heller's syndrome, is a rare condition on the autism spectrum characterized by a significant regression in skills after a period of normal development, typically between ages 2 and 10. Children with CDD lose previously acquired abilities in areas such as language, social skills, toileting, motor skills, and play. Symptoms often include communication deficits, impaired social interactions, repetitive behaviors, and restricted interests. The condition is distinct from other autism spectrum disorders due to the marked regression and later onset. Diagnosis requires a thorough evaluation, and early intervention with behavioral, educational, and supportive therapies can help improve outcomes. CDD is extremely rare and is now considered part of the broader autism spectrum in diagnostic criteria like the DSM-5.",29.816,success,,2025-09-01T07:44:10.789189,27.2437961101532,5.6743621826171875e-05,2.571,1.075753927230835,1.4941470623016357,3.0,1.075753927230835,1.4941470623016357,2.5699050426483154,"[07:43:40.970] Starting processing for question 5: 'What is childhood disintegrative disorder?...' | |
| [07:43:40.970] STARTED: Total_Processing | |
| [07:43:40.970] STARTED: RAG_Analysis | |
| [07:43:40.970] Performing detailed RAG analysis... | |
| [07:43:43.542] COMPLETED: RAG_Analysis - 2.571s | Retrieved 3 results, Embedding: 1.076s, Weaviate: 1.494s | |
| RAG ANALYSIS: Query(42 chars, 5 words) -> Embedding: 1.076s (41.86%), Weaviate: 1.494s (58.14%), Results: 3, Total: 2.570s | |
| [07:43:43.543] STARTED: Pipeline_Processing | |
| [07:43:43.543] Starting main pipeline processing... | |
| [07:44:10.786] COMPLETED: Pipeline_Processing - 27.244s | Response length: 890 chars | |
| [07:44:10.786] STARTED: Response_Cleaning | |
| [07:44:10.787] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 869 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 29.815s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 27.244s (91.4%) | |
| 🟢 FAST RAG_Analysis: 2.571s (8.6%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 5 words, 42 chars | |
| Embedding generation: 1.076s (41.86%) | |
| Weaviate query: 1.494s (58.14%) | |
| Results retrieved: 3",Pipeline_Processing,D (Very Slow) | |
| 5,What is the prognosis of children with autism?,"<div dir=""ltr"">The prognosis for children with autism varies widely depending on individual factors such as early intervention, access to therapy, support systems, and the severity of symptoms. With early diagnosis and evidence-based interventions—such as applied behavior analysis (ABA), speech therapy, occupational therapy, and social skills training—many children with autism can make significant developmental gains. Some may achieve independence in daily living, education, and employment, while others may require ongoing support. Early and consistent support greatly improves long-term outcomes, and many individuals with autism lead fulfilling, meaningful lives.</div>","The prognosis for children with autism varies widely depending on individual factors such as early intervention, access to therapy, support systems, and the severity of symptoms. With early diagnosis and evidence-based interventions—such as applied behavior analysis (ABA), speech therapy, occupational therapy, and social skills training—many children with autism can make significant developmental gains. Some may achieve independence in daily living, education, and employment, while others may require ongoing support. Early and consistent support greatly improves long-term outcomes, and many individuals with autism lead fulfilling, meaningful lives.",25.12,success,,2025-09-01T07:44:36.946852,22.910234928131104,3.1948089599609375e-05,2.209,1.0583431720733643,1.1499149799346924,3.0,1.0583431720733643,1.1499149799346924,2.208261251449585,"[07:44:11.796] Starting processing for question 6: 'What is the prognosis of children with autism?...' | |
| [07:44:11.796] STARTED: Total_Processing | |
| [07:44:11.796] STARTED: RAG_Analysis | |
| [07:44:11.796] Performing detailed RAG analysis... | |
| [07:44:14.005] COMPLETED: RAG_Analysis - 2.209s | Retrieved 3 results, Embedding: 1.058s, Weaviate: 1.150s | |
| RAG ANALYSIS: Query(46 chars, 8 words) -> Embedding: 1.058s (47.93%), Weaviate: 1.150s (52.07%), Results: 3, Total: 2.208s | |
| [07:44:14.005] STARTED: Pipeline_Processing | |
| [07:44:14.005] Starting main pipeline processing... | |
| [07:44:36.916] COMPLETED: Pipeline_Processing - 22.910s | Response length: 677 chars | |
| [07:44:36.916] STARTED: Response_Cleaning | |
| [07:44:36.916] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 656 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 25.119s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 22.910s (91.2%) | |
| 🟢 FAST RAG_Analysis: 2.209s (8.8%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 8 words, 46 chars | |
| Embedding generation: 1.058s (47.93%) | |
| Weaviate query: 1.15s (52.07%) | |
| Results retrieved: 3",pipeline_processing_seconds,D (Very Slow) | |