| Unnamed: 0,question,answer,clean_answer,total_time_seconds,status,error_message,processed_timestamp,pipeline_processing_seconds,response_cleaning_seconds,rag_analysis_seconds,embedding_generation_seconds,weaviate_query_seconds,rag_results_count,rag_embedding_time,rag_weaviate_time,rag_total_time,detailed_logs,performance_analysis,bottleneck_step,performance_grade | |
| 0,What is autism?,"<div dir=""ltr"">Autism, or Autism Spectrum Disorder (ASD), is a neurodevelopmental condition characterized by differences in social communication, restricted or repetitive behaviors, and unique patterns of thinking and sensory experiences. It is a spectrum disorder, meaning it affects individuals in different ways and to varying degrees. Common traits may include challenges with verbal and nonverbal communication, difficulty with social interactions, intense focus on specific interests, and sensitivity to sensory stimuli (like sound, light, or touch). Autism is present from early childhood and is typically diagnosed in early developmental years. It is important to recognize that people with autism have strengths and abilities as well as challenges, and support should be tailored to individual needs.</div>","Autism, or Autism Spectrum Disorder (ASD), is a neurodevelopmental condition characterized by differences in social communication, restricted or repetitive behaviors, and unique patterns of thinking and sensory experiences. It is a spectrum disorder, meaning it affects individuals in different ways and to varying degrees. Common traits may include challenges with verbal and nonverbal communication, difficulty with social interactions, intense focus on specific interests, and sensitivity to sensory stimuli (like sound, light, or touch). Autism is present from early childhood and is typically diagnosed in early developmental years. It is important to recognize that people with autism have strengths and abilities as well as challenges, and support should be tailored to individual needs.",24.752,success,,2025-09-01T08:04:09.675503,21.852086067199707,5.698204040527344e-05,2.899,1.2554700374603271,1.6429882049560547,3.0,1.2554700374603271,1.6429882049560547,2.8984620571136475,"[08:03:44.923] Starting processing for question 1: 'What is autism?...' | |
| [08:03:44.923] STARTED: Total_Processing | |
| [08:03:44.923] STARTED: RAG_Analysis | |
| [08:03:44.923] Performing detailed RAG analysis... | |
| [08:03:47.822] COMPLETED: RAG_Analysis - 2.899s | Retrieved 3 results, Embedding: 1.255s, Weaviate: 1.643s | |
| RAG ANALYSIS: Query(15 chars, 3 words) -> Embedding: 1.255s (43.32%), Weaviate: 1.643s (56.68%), Results: 3, Total: 2.898s | |
| [08:03:47.822] STARTED: Pipeline_Processing | |
| [08:03:47.822] Starting main pipeline processing... | |
| [08:04:09.674] COMPLETED: Pipeline_Processing - 21.852s | Response length: 815 chars | |
| [08:04:09.674] STARTED: Response_Cleaning | |
| [08:04:09.674] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 794 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 24.751s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 21.852s (88.3%) | |
| 🟡 MODERATE RAG_Analysis: 2.899s (11.7%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 3 words, 15 chars | |
| Embedding generation: 1.255s (43.32%) | |
| Weaviate query: 1.643s (56.68%) | |
| Results retrieved: 3",pipeline_processing_seconds,D (Very Slow) | |
| 1,What is Asperger syndrome?,"<div dir=""ltr"">Asperger syndrome is a type of autism spectrum disorder (ASD) characterized by significant challenges in social interaction and restricted, repetitive patterns of behavior and interests. Unlike other forms of autism, individuals with Asperger syndrome typically do not have delays in language or cognitive development. They often have average or above-average intelligence and may excel in specific areas, such as math, science, or music. However, they may struggle with understanding social cues, making eye contact, or engaging in reciprocal conversations. It’s important to note that Asperger syndrome is no longer a separate diagnosis in the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, 5th edition); instead, it is now included under the broader category of Autism Spectrum Disorder.</div>","Asperger syndrome is a type of autism spectrum disorder (ASD) characterized by significant challenges in social interaction and restricted, repetitive patterns of behavior and interests. Unlike other forms of autism, individuals with Asperger syndrome typically do not have delays in language or cognitive development. They often have average or above-average intelligence and may excel in specific areas, such as math, science, or music. However, they may struggle with understanding social cues, making eye contact, or engaging in reciprocal conversations. It’s important to note that Asperger syndrome is no longer a separate diagnosis in the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, 5th edition); instead, it is now included under the broader category of Autism Spectrum Disorder.",25.064,success,,2025-09-01T08:04:35.747873,19.482991933822632,2.47955322265625e-05,5.579,3.8280911445617676,1.7505238056182861,3.0,3.8280911445617676,1.7505238056182861,5.578618049621582,"[08:04:10.683] Starting processing for question 2: 'What is Asperger syndrome?...' | |
| [08:04:10.683] STARTED: Total_Processing | |
| [08:04:10.683] STARTED: RAG_Analysis | |
| [08:04:10.683] Performing detailed RAG analysis... | |
| [08:04:16.262] COMPLETED: RAG_Analysis - 5.579s | Retrieved 3 results, Embedding: 3.828s, Weaviate: 1.751s | |
| RAG ANALYSIS: Query(26 chars, 4 words) -> Embedding: 3.828s (68.62%), Weaviate: 1.751s (31.38%), Results: 3, Total: 5.579s | |
| [08:04:16.264] STARTED: Pipeline_Processing | |
| [08:04:16.264] Starting main pipeline processing... | |
| [08:04:35.747] COMPLETED: Pipeline_Processing - 19.483s | Response length: 826 chars | |
| [08:04:35.747] STARTED: Response_Cleaning | |
| [08:04:35.747] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 805 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 25.062s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 19.483s (77.7%) | |
| 🟡 MODERATE RAG_Analysis: 5.579s (22.3%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 4 words, 26 chars | |
| Embedding generation: 3.828s (68.62%) | |
| Weaviate query: 1.751s (31.38%) | |
| Results retrieved: 3 | |
| ⚠️ ISSUE: Embedding generation is the bottleneck | |
| 💡 SUGGESTION: Consider caching embeddings or using faster embedding model",Pipeline_Processing,D (Very Slow) | |
| 2,How can you tell autism from Asperger syndrome?,"<div dir=""ltr"">Autism and Asperger syndrome were once considered separate conditions, but they are now understood as part of the same spectrum. The main historical difference was in language and cognitive development: | |
| - **Autism** (including what was once called Autism Spectrum Disorder with intellectual disability) could involve delays in language development and varying levels of cognitive ability, often requiring more support. | |
| - **Asperger syndrome** referred to individuals with average or above-average intelligence and no significant delay in language development, but who still faced challenges with social interactions and had repetitive behaviors. | |
| However, since the 2013 update to the DSM-5, Asperger syndrome is no longer a separate diagnosis. It is now included within the broader category of **Autism Spectrum Disorder (ASD)**. Today, clinicians focus on the individual’s specific strengths and challenges—such as social communication, repetitive behaviors, and sensory sensitivities—rather than using separate labels like Asperger syndrome. | |
| In summary: The distinction is mainly historical. Both were part of the autism spectrum, but the current approach emphasizes individual profiles within ASD, not separate diagnoses.</div>","Autism and Asperger syndrome were once considered separate conditions, but they are now understood as part of the same spectrum. The main historical difference was in language and cognitive development: - **Autism** (including what was once called Autism Spectrum Disorder with intellectual disability) could involve delays in language development and varying levels of cognitive ability, often requiring more support. - **Asperger syndrome** referred to individuals with average or above-average intelligence and no significant delay in language development, but who still faced challenges with social interactions and had repetitive behaviors. However, since the 2013 update to the DSM-5, Asperger syndrome is no longer a separate diagnosis. It is now included within the broader category of **Autism Spectrum Disorder (ASD)**. Today, clinicians focus on the individual’s specific strengths and challenges—such as social communication, repetitive behaviors, and sensory sensitivities—rather than using separate labels like Asperger syndrome. In summary: The distinction is mainly historical. Both were part of the autism spectrum, but the current approach emphasizes individual profiles within ASD, not separate diagnoses.",25.577,success,,2025-09-01T08:05:02.332697,21.983684062957764,5.984306335449219e-05,3.593,1.699686050415039,1.8924789428710938,3.0,1.699686050415039,1.8924789428710938,3.5921690464019775,"[08:04:36.754] Starting processing for question 3: 'How can you tell autism from Asperger syndrome?...' | |
| [08:04:36.754] STARTED: Total_Processing | |
| [08:04:36.754] STARTED: RAG_Analysis | |
| [08:04:36.754] Performing detailed RAG analysis... | |
| [08:04:40.347] COMPLETED: RAG_Analysis - 3.593s | Retrieved 3 results, Embedding: 1.700s, Weaviate: 1.892s | |
| RAG ANALYSIS: Query(47 chars, 8 words) -> Embedding: 1.700s (47.32%), Weaviate: 1.892s (52.68%), Results: 3, Total: 3.592s | |
| [08:04:40.348] STARTED: Pipeline_Processing | |
| [08:04:40.348] Starting main pipeline processing... | |
| [08:05:02.331] COMPLETED: Pipeline_Processing - 21.984s | Response length: 1249 chars | |
| [08:05:02.331] STARTED: Response_Cleaning | |
| [08:05:02.331] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 1224 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 25.577s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 21.984s (86.0%) | |
| 🟡 MODERATE RAG_Analysis: 3.593s (14.0%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 8 words, 47 chars | |
| Embedding generation: 1.7s (47.32%) | |
| Weaviate query: 1.892s (52.68%) | |
| Results retrieved: 3",Pipeline_Processing,D (Very Slow) | |
| 3,What is pervasive developmental disorder–not otherwise specified?,"<div dir=""ltr"">ما هو الاضطراب النمائي الشامل ليس حسب النوع المحدد؟ | |
| الاضطراب النمائي الشامل – ليس حسب النوع المحدد (PDD-NOS) كان تشخيصاً استخدم في الدليل التشخيصي والإحصائي للاضطرابات النفسية (DSM-IV) لوصف الأشخاص الذين أظهروا عجزاً كبيراً في التفاعل الاجتماعي أو التواصل أو السلوكيات المتكررة، لكنهم لم يحققوا المعايير الكاملة لأحد الاضطرابات الطيفية للتوحد المحددة، مثل اضطراب التوحد أو اضطراب آسبرجر. | |
| كان يُطلق على PDD-NOS أحياناً ""التوحد غير النمطي""، لأنه شمل أشخاصاً يعانون من أعراض شبيهة بالتوحد لكنها أقل شدة أو تظهر بطريقة مختلفة عن الحالات النمطية. على سبيل المثال، قد يمتلك شخص ما مهارات لغوية قوية لكنه يعاني من صعوبات في التفاعل الاجتماعي المتبادل، أو قد يكون لديه عدد قليل من سمات التوحد. | |
| ومع نشر الدليل التشخيصي والإحصائي للاضطرابات النفسية (DSM-5) في عام 2013، تم استبدال PDD-NOS بتشخيص واحد فقط: اضطراب طيف التوحد (ASD). تم اتخاذ هذا التغيير لتيسير التشخيص وتعكس فهمنا بأن التوحد يوجد على طيف. لذا، بينما لم يعد PDD-NOS مستخدماً في الممارسة التشخيصية الحالية، فإنه وصف شكلًا من أشكال التوحد الذي لم يكن ضمن المعايير التشخيصية الصارمة، لكنه كان يحتوي على تحديات تنموية في المجالات الأساسية.</div>","ما هو الاضطراب النمائي الشامل ليس حسب النوع المحدد؟ الاضطراب النمائي الشامل – ليس حسب النوع المحدد (PDD-NOS) كان تشخيصاً استخدم في الدليل التشخيصي والإحصائي للاضطرابات النفسية (DSM-IV) لوصف الأشخاص الذين أظهروا عجزاً كبيراً في التفاعل الاجتماعي أو التواصل أو السلوكيات المتكررة، لكنهم لم يحققوا المعايير الكاملة لأحد الاضطرابات الطيفية للتوحد المحددة، مثل اضطراب التوحد أو اضطراب آسبرجر. كان يُطلق على PDD-NOS أحياناً ""التوحد غير النمطي""، لأنه شمل أشخاصاً يعانون من أعراض شبيهة بالتوحد لكنها أقل شدة أو تظهر بطريقة مختلفة عن الحالات النمطية. على سبيل المثال، قد يمتلك شخص ما مهارات لغوية قوية لكنه يعاني من صعوبات في التفاعل الاجتماعي المتبادل، أو قد يكون لديه عدد قليل من سمات التوحد. ومع نشر الدليل التشخيصي والإحصائي للاضطرابات النفسية (DSM-5) في عام 2013، تم استبدال PDD-NOS بتشخيص واحد فقط: اضطراب طيف التوحد (ASD). تم اتخاذ هذا التغيير لتيسير التشخيص وتعكس فهمنا بأن التوحد يوجد على طيف. لذا، بينما لم يعد PDD-NOS مستخدماً في الممارسة التشخيصية الحالية، فإنه وصف شكلًا من أشكال التوحد الذي لم يكن ضمن المعايير التشخيصية الصارمة، لكنه كان يحتوي على تحديات تنموية في المجالات الأساسية.",39.732,success,,2025-09-01T08:05:43.069058,37.35445713996887,5.7220458984375e-05,2.377,0.9508841037750244,1.4260830879211426,3.0,0.9508841037750244,1.4260830879211426,2.376969337463379,"[08:05:03.336] Starting processing for question 4: 'What is pervasive developmental disorder–not otherwise specified?...' | |
| [08:05:03.336] STARTED: Total_Processing | |
| [08:05:03.336] STARTED: RAG_Analysis | |
| [08:05:03.336] Performing detailed RAG analysis... | |
| [08:05:05.713] COMPLETED: RAG_Analysis - 2.377s | Retrieved 3 results, Embedding: 0.951s, Weaviate: 1.426s | |
| RAG ANALYSIS: Query(65 chars, 7 words) -> Embedding: 0.951s (40.0%), Weaviate: 1.426s (60.0%), Results: 3, Total: 2.377s | |
| [08:05:05.713] STARTED: Pipeline_Processing | |
| [08:05:05.713] Starting main pipeline processing... | |
| [08:05:43.068] COMPLETED: Pipeline_Processing - 37.354s | Response length: 1118 chars | |
| [08:05:43.068] STARTED: Response_Cleaning | |
| [08:05:43.068] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 1089 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 39.731s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 37.354s (94.0%) | |
| 🟢 FAST RAG_Analysis: 2.377s (6.0%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 7 words, 65 chars | |
| Embedding generation: 0.951s (40.0%) | |
| Weaviate query: 1.426s (60.0%) | |
| Results retrieved: 3",pipeline_processing_seconds,D (Very Slow) | |
| 4,What is childhood disintegrative disorder?,"<div dir=""ltr"">Childhood Disintegrative Disorder (CDD), also known as Heller’s syndrome, is a rare condition in which a child develops normally for at least the first two years of life, then experiences a significant loss of previously acquired skills in multiple areas—such as language, social interaction, motor skills, and self-care—typically between ages 3 and 10. This regression is followed by the onset of autism spectrum-like symptoms. CDD is now classified under Autism Spectrum Disorder (ASD) in the DSM-5, but it is distinguished by its late onset and more severe regression. The exact cause is unknown, but it may involve genetic and neurodevelopmental factors. Early diagnosis and intervention are crucial for improving outcomes.</div>","Childhood Disintegrative Disorder (CDD), also known as Heller’s syndrome, is a rare condition in which a child develops normally for at least the first two years of life, then experiences a significant loss of previously acquired skills in multiple areas—such as language, social interaction, motor skills, and self-care—typically between ages 3 and 10. This regression is followed by the onset of autism spectrum-like symptoms. CDD is now classified under Autism Spectrum Disorder (ASD) in the DSM-5, but it is distinguished by its late onset and more severe regression. The exact cause is unknown, but it may involve genetic and neurodevelopmental factors. Early diagnosis and intervention are crucial for improving outcomes.",22.199,success,,2025-09-01T08:06:06.275298,19.291403770446777,3.504753112792969e-05,2.907,1.342069149017334,1.5649142265319824,3.0,1.342069149017334,1.5649142265319824,2.9069859981536865,"[08:05:44.075] Starting processing for question 5: 'What is childhood disintegrative disorder?...' | |
| [08:05:44.075] STARTED: Total_Processing | |
| [08:05:44.075] STARTED: RAG_Analysis | |
| [08:05:44.075] Performing detailed RAG analysis... | |
| [08:05:46.982] COMPLETED: RAG_Analysis - 2.907s | Retrieved 3 results, Embedding: 1.342s, Weaviate: 1.565s | |
| RAG ANALYSIS: Query(42 chars, 5 words) -> Embedding: 1.342s (46.17%), Weaviate: 1.565s (53.83%), Results: 3, Total: 2.907s | |
| [08:05:46.983] STARTED: Pipeline_Processing | |
| [08:05:46.983] Starting main pipeline processing... | |
| [08:06:06.274] COMPLETED: Pipeline_Processing - 19.291s | Response length: 748 chars | |
| [08:06:06.274] STARTED: Response_Cleaning | |
| [08:06:06.274] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 727 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 22.198s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 19.291s (86.9%) | |
| 🟡 MODERATE RAG_Analysis: 2.907s (13.1%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 5 words, 42 chars | |
| Embedding generation: 1.342s (46.17%) | |
| Weaviate query: 1.565s (53.83%) | |
| Results retrieved: 3",pipeline_processing_seconds,D (Very Slow) | |
| 5,What is the prognosis of children with autism?,"<div dir=""ltr"">The prognosis for children with autism varies widely depending on the individual, but many children can make meaningful progress with early intervention and appropriate support. With early diagnosis and access to therapies such as speech, occupational, and behavioral interventions (e.g., Applied Behavior Analysis), many children improve in communication, social skills, and daily living abilities. Some individuals with autism go on to lead independent or semi-independent lives as adults, while others may require ongoing support. The level of support needed depends on the severity of symptoms, co-occurring conditions, and access to resources. Early and consistent support significantly improves long-term outcomes.</div>","The prognosis for children with autism varies widely depending on the individual, but many children can make meaningful progress with early intervention and appropriate support. With early diagnosis and access to therapies such as speech, occupational, and behavioral interventions (e.g., Applied Behavior Analysis), many children improve in communication, social skills, and daily living abilities. Some individuals with autism go on to lead independent or semi-independent lives as adults, while others may require ongoing support. The level of support needed depends on the severity of symptoms, co-occurring conditions, and access to resources. Early and consistent support significantly improves long-term outcomes.",24.801,success,,2025-09-01T08:06:32.086103,22.127034902572632,6.985664367675781e-05,2.673,1.309581995010376,1.363041877746582,3.0,1.309581995010376,1.363041877746582,2.6726269721984863,"[08:06:07.282] Starting processing for question 6: 'What is the prognosis of children with autism?...' | |
| [08:06:07.282] STARTED: Total_Processing | |
| [08:06:07.282] STARTED: RAG_Analysis | |
| [08:06:07.282] Performing detailed RAG analysis... | |
| [08:06:09.955] COMPLETED: RAG_Analysis - 2.673s | Retrieved 3 results, Embedding: 1.310s, Weaviate: 1.363s | |
| RAG ANALYSIS: Query(46 chars, 8 words) -> Embedding: 1.310s (49.0%), Weaviate: 1.363s (51.0%), Results: 3, Total: 2.673s | |
| [08:06:09.956] STARTED: Pipeline_Processing | |
| [08:06:09.956] Starting main pipeline processing... | |
| [08:06:32.083] COMPLETED: Pipeline_Processing - 22.127s | Response length: 741 chars | |
| [08:06:32.083] STARTED: Response_Cleaning | |
| [08:06:32.083] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 720 chars","PERFORMANCE BOTTLENECK ANALYSIS: | |
| Total Pipeline Time: 24.800s | |
| -------------------------------------------------- | |
| 🔴 SLOW Pipeline_Processing: 22.127s (89.2%) | |
| 🟡 MODERATE RAG_Analysis: 2.673s (10.8%) | |
| 🟢 FAST Response_Cleaning: 0.000s (0.0%) | |
| RAG DETAILED ANALYSIS: | |
| ------------------------------ | |
| Query complexity: 8 words, 46 chars | |
| Embedding generation: 1.31s (49.0%) | |
| Weaviate query: 1.363s (51.0%) | |
| Results retrieved: 3",pipeline_processing_seconds,D (Very Slow) | |