Unnamed: 0,question,answer,clean_answer,total_time_seconds,status,error_message,processed_timestamp,pipeline_processing_seconds,response_cleaning_seconds,rag_analysis_seconds,embedding_generation_seconds,weaviate_query_seconds,rag_results_count,rag_embedding_time,rag_weaviate_time,rag_total_time,detailed_logs,performance_analysis,bottleneck_step,performance_grade
0,What is autism?,"
Autism, or Autism Spectrum Disorder (ASD), is a neurodevelopmental condition characterized by differences in social communication, restricted interests, and repetitive behaviors. It is a spectrum, meaning it affects individuals in varying ways and to different degrees. People with autism may experience challenges with verbal and nonverbal communication, social interactions, and sensory processing, but they also often have strengths such as attention to detail, strong memory, and deep focus on specific topics. Autism is present from early childhood and is diagnosed based on behavioral observations and developmental history. It is not a disorder to be cured, but a different way of thinking and experiencing the world, and individuals with autism can lead fulfilling lives with appropriate support and accommodations.
","Autism, or Autism Spectrum Disorder (ASD), is a neurodevelopmental condition characterized by differences in social communication, restricted interests, and repetitive behaviors. It is a spectrum, meaning it affects individuals in varying ways and to different degrees. People with autism may experience challenges with verbal and nonverbal communication, social interactions, and sensory processing, but they also often have strengths such as attention to detail, strong memory, and deep focus on specific topics. Autism is present from early childhood and is diagnosed based on behavioral observations and developmental history. It is not a disorder to be cured, but a different way of thinking and experiencing the world, and individuals with autism can lead fulfilling lives with appropriate support and accommodations.",25.501,success,,2025-09-01T08:08:54.118127,22.51584506034851,5.698204040527344e-05,2.985,1.6164658069610596,1.3680741786956787,3.0,1.6164658069610596,1.3680741786956787,2.9845399856567383,"[08:08:28.616] Starting processing for question 1: 'What is autism?...'
[08:08:28.616] STARTED: Total_Processing
[08:08:28.616] STARTED: RAG_Analysis
[08:08:28.616] Performing detailed RAG analysis...
[08:08:31.601] COMPLETED: RAG_Analysis - 2.985s | Retrieved 3 results, Embedding: 1.616s, Weaviate: 1.368s
RAG ANALYSIS: Query(15 chars, 3 words) -> Embedding: 1.616s (54.16%), Weaviate: 1.368s (45.84%), Results: 3, Total: 2.985s
[08:08:31.601] STARTED: Pipeline_Processing
[08:08:31.601] Starting main pipeline processing...
[08:08:54.117] COMPLETED: Pipeline_Processing - 22.516s | Response length: 844 chars
[08:08:54.117] STARTED: Response_Cleaning
[08:08:54.117] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 823 chars","PERFORMANCE BOTTLENECK ANALYSIS:
Total Pipeline Time: 25.501s
--------------------------------------------------
🔴 SLOW Pipeline_Processing: 22.516s (88.3%)
🟡 MODERATE RAG_Analysis: 2.985s (11.7%)
🟢 FAST Response_Cleaning: 0.000s (0.0%)
RAG DETAILED ANALYSIS:
------------------------------
Query complexity: 3 words, 15 chars
Embedding generation: 1.616s (54.16%)
Weaviate query: 1.368s (45.84%)
Results retrieved: 3
⚠️ ISSUE: Embedding generation is the bottleneck
💡 SUGGESTION: Consider caching embeddings or using faster embedding model",Pipeline_Processing,D (Very Slow)
1,What is Asperger syndrome?,"Asperger syndrome is a neurodevelopmental condition that was once considered a separate diagnosis within the autism spectrum. It is marked by difficulties in social interaction, restricted and repetitive behaviors, and deep focus on specific interests. People with Asperger syndrome typically have average or above-average intelligence and do not have significant delays in language development.
However, in current diagnostic guidelines like the DSM-5, Asperger syndrome is no longer used as a standalone diagnosis. Instead, it is included under the broader category of Autism Spectrum Disorder (ASD), specifically Level 1, which reflects the range of support needs across the spectrum.
Individuals who were previously diagnosed with Asperger syndrome may still use that term to describe their experiences, as it can reflect their unique strengths and challenges. It’s important to remember that everyone on the autism spectrum is different, with a wide variety of strengths, challenges, and personal experiences.
","Asperger syndrome is a neurodevelopmental condition that was once considered a separate diagnosis within the autism spectrum. It is marked by difficulties in social interaction, restricted and repetitive behaviors, and deep focus on specific interests. People with Asperger syndrome typically have average or above-average intelligence and do not have significant delays in language development. However, in current diagnostic guidelines like the DSM-5, Asperger syndrome is no longer used as a standalone diagnosis. Instead, it is included under the broader category of Autism Spectrum Disorder (ASD), specifically Level 1, which reflects the range of support needs across the spectrum. Individuals who were previously diagnosed with Asperger syndrome may still use that term to describe their experiences, as it can reflect their unique strengths and challenges. It’s important to remember that everyone on the autism spectrum is different, with a wide variety of strengths, challenges, and personal experiences.",23.096,success,,2025-09-01T08:09:18.223022,20.379661083221436,3.409385681152344e-05,2.716,0.8906631469726562,1.8244140148162842,3.0,0.8906631469726562,1.8244140148162842,2.715080976486206,"[08:08:55.126] Starting processing for question 2: 'What is Asperger syndrome?...'
[08:08:55.126] STARTED: Total_Processing
[08:08:55.126] STARTED: RAG_Analysis
[08:08:55.126] Performing detailed RAG analysis...
[08:08:57.842] COMPLETED: RAG_Analysis - 2.716s | Retrieved 3 results, Embedding: 0.891s, Weaviate: 1.824s
RAG ANALYSIS: Query(26 chars, 4 words) -> Embedding: 0.891s (32.8%), Weaviate: 1.824s (67.2%), Results: 3, Total: 2.715s
[08:08:57.842] STARTED: Pipeline_Processing
[08:08:57.842] Starting main pipeline processing...
[08:09:18.222] COMPLETED: Pipeline_Processing - 20.380s | Response length: 1037 chars
[08:09:18.222] STARTED: Response_Cleaning
[08:09:18.222] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 1014 chars","PERFORMANCE BOTTLENECK ANALYSIS:
Total Pipeline Time: 23.096s
--------------------------------------------------
🔴 SLOW Pipeline_Processing: 20.380s (88.2%)
🟡 MODERATE RAG_Analysis: 2.716s (11.8%)
🟢 FAST Response_Cleaning: 0.000s (0.0%)
RAG DETAILED ANALYSIS:
------------------------------
Query complexity: 4 words, 26 chars
Embedding generation: 0.891s (32.8%)
Weaviate query: 1.824s (67.2%)
Results retrieved: 3
⚠️ ISSUE: Weaviate query is the bottleneck
💡 SUGGESTION: Check Weaviate connection, indexing, or reduce vector dimensions",Pipeline_Processing,D (Very Slow)
2,How can you tell autism from Asperger syndrome?,"Autism and Asperger's syndrome were once seen as separate conditions, but today they are understood as part of the same spectrum. Historically, Asperger's syndrome was described as a form of autism with average or above-average intelligence and no early delay in language development, while still involving challenges in social interaction and repetitive behaviors.
However, since the release of the DSM-5 in 2013, Asperger's syndrome is no longer used as a separate diagnosis. Instead, all these presentations are now included under the single diagnosis of Autism Spectrum Disorder (ASD). This means that individuals who were previously diagnosed with Asperger's now receive an ASD diagnosis, with the level of support needed based on their specific symptoms.
In short, there is no current clinical distinction between autism and Asperger's syndrome—Asperger’s is now part of the broader autism spectrum. Differences in ability and behavior are described within the spectrum rather than through separate labels.
","Autism and Asperger's syndrome were once seen as separate conditions, but today they are understood as part of the same spectrum. Historically, Asperger's syndrome was described as a form of autism with average or above-average intelligence and no early delay in language development, while still involving challenges in social interaction and repetitive behaviors. However, since the release of the DSM-5 in 2013, Asperger's syndrome is no longer used as a separate diagnosis. Instead, all these presentations are now included under the single diagnosis of Autism Spectrum Disorder (ASD). This means that individuals who were previously diagnosed with Asperger's now receive an ASD diagnosis, with the level of support needed based on their specific symptoms. In short, there is no current clinical distinction between autism and Asperger's syndrome—Asperger’s is now part of the broader autism spectrum. Differences in ability and behavior are described within the spectrum rather than through separate labels.",33.137,success,,2025-09-01T08:09:52.367910,30.484313249588013,0.00011587142944335938,2.652,1.2051458358764648,1.4470551013946533,3.0,1.2051458358764648,1.4470551013946533,2.652202844619751,"[08:09:19.227] Starting processing for question 3: 'How can you tell autism from Asperger syndrome?...'
[08:09:19.227] STARTED: Total_Processing
[08:09:19.227] STARTED: RAG_Analysis
[08:09:19.227] Performing detailed RAG analysis...
[08:09:21.880] COMPLETED: RAG_Analysis - 2.652s | Retrieved 3 results, Embedding: 1.205s, Weaviate: 1.447s
RAG ANALYSIS: Query(47 chars, 8 words) -> Embedding: 1.205s (45.44%), Weaviate: 1.447s (54.56%), Results: 3, Total: 2.652s
[08:09:21.880] STARTED: Pipeline_Processing
[08:09:21.880] Starting main pipeline processing...
[08:09:52.364] COMPLETED: Pipeline_Processing - 30.484s | Response length: 1035 chars
[08:09:52.364] STARTED: Response_Cleaning
[08:09:52.365] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 1012 chars","PERFORMANCE BOTTLENECK ANALYSIS:
Total Pipeline Time: 33.136s
--------------------------------------------------
🔴 SLOW Pipeline_Processing: 30.484s (92.0%)
🟢 FAST RAG_Analysis: 2.652s (8.0%)
🟢 FAST Response_Cleaning: 0.000s (0.0%)
RAG DETAILED ANALYSIS:
------------------------------
Query complexity: 8 words, 47 chars
Embedding generation: 1.205s (45.44%)
Weaviate query: 1.447s (54.56%)
Results retrieved: 3",pipeline_processing_seconds,D (Very Slow)
3,What is pervasive developmental disorder–not otherwise specified?,"ما هو الاضطراب النمائي الشامل – غير المحدد بشكل آخر؟
الاضطراب النمائي الشامل – غير المحدد بشكل آخر (PDD-NOS) كان تشخيصًا استُخدم في دليل التشخيص وال thốngوبين DSM-IV لوصف الأشخاص الذين أظهروا بعض، لكن ليس جميع، خصائص اضطراب طيف التوحد (ASD). ويعني ذلك الأشخاص الذين واجهوا صعوبات في التفاعل الاجتماعي، أو التواصل، أو السلوك التكراري، لكنهم لم يلتزموا بالشروط الكاملة للتوحد الكلاسيكي أو أي اضطرابات نمائية شمولية أخرى محددة.
ومع صدور دليل التشخيص وال thốngوبين DSM-5 في عام 2013، تم استبدال PDD-NOS بالتصنيف الأوسع المسمى اضطراب طيف التوحد (ASD). وبهذا، يُصنف الآن أي شخص كان قد تلقى تشخيصًا بـ PDD-NOS ضمن اضطراب طيف التوحد، مع تحديد مستوى الدعم اللازم بناءً على التحديات والقدرات الفردية لكل شخص. وقد ساهم هذا التغيير في إنشاء طريقة أكثر اتساقًا ودقة لفهم ودعم الأشخاص على طيف التوحد.
",ما هو الاضطراب النمائي الشامل – غير المحدد بشكل آخر؟ الاضطراب النمائي الشامل – غير المحدد بشكل آخر (PDD-NOS) كان تشخيصًا استُخدم في دليل التشخيص وال thốngوبين DSM-IV لوصف الأشخاص الذين أظهروا بعض، لكن ليس جميع، خصائص اضطراب طيف التوحد (ASD). ويعني ذلك الأشخاص الذين واجهوا صعوبات في التفاعل الاجتماعي، أو التواصل، أو السلوك التكراري، لكنهم لم يلتزموا بالشروط الكاملة للتوحد الكلاسيكي أو أي اضطرابات نمائية شمولية أخرى محددة. ومع صدور دليل التشخيص وال thốngوبين DSM-5 في عام 2013، تم استبدال PDD-NOS بالتصنيف الأوسع المسمى اضطراب طيف التوحد (ASD). وبهذا، يُصنف الآن أي شخص كان قد تلقى تشخيصًا بـ PDD-NOS ضمن اضطراب طيف التوحد، مع تحديد مستوى الدعم اللازم بناءً على التحديات والقدرات الفردية لكل شخص. وقد ساهم هذا التغيير في إنشاء طريقة أكثر اتساقًا ودقة لفهم ودعم الأشخاص على طيف التوحد.,30.499,success,,2025-09-01T08:10:23.875661,27.664196252822876,3.790855407714844e-05,2.834,1.037384033203125,1.7957072257995605,3.0,1.037384033203125,1.7957072257995605,2.8330960273742676,"[08:09:53.375] Starting processing for question 4: 'What is pervasive developmental disorder–not otherwise specified?...'
[08:09:53.375] STARTED: Total_Processing
[08:09:53.375] STARTED: RAG_Analysis
[08:09:53.375] Performing detailed RAG analysis...
[08:09:56.209] COMPLETED: RAG_Analysis - 2.834s | Retrieved 3 results, Embedding: 1.037s, Weaviate: 1.796s
RAG ANALYSIS: Query(65 chars, 7 words) -> Embedding: 1.037s (36.62%), Weaviate: 1.796s (63.38%), Results: 3, Total: 2.833s
[08:09:56.210] STARTED: Pipeline_Processing
[08:09:56.210] Starting main pipeline processing...
[08:10:23.874] COMPLETED: Pipeline_Processing - 27.664s | Response length: 810 chars
[08:10:23.874] STARTED: Response_Cleaning
[08:10:23.874] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 786 chars","PERFORMANCE BOTTLENECK ANALYSIS:
Total Pipeline Time: 30.498s
--------------------------------------------------
🔴 SLOW Pipeline_Processing: 27.664s (90.7%)
🟢 FAST RAG_Analysis: 2.834s (9.3%)
🟢 FAST Response_Cleaning: 0.000s (0.0%)
RAG DETAILED ANALYSIS:
------------------------------
Query complexity: 7 words, 65 chars
Embedding generation: 1.037s (36.62%)
Weaviate query: 1.796s (63.38%)
Results retrieved: 3
⚠️ ISSUE: Weaviate query is the bottleneck
💡 SUGGESTION: Check Weaviate connection, indexing, or reduce vector dimensions",pipeline_processing_seconds,D (Very Slow)
4,What is childhood disintegrative disorder?,"Childhood Disintegrative Disorder (CDD), also known as Heller's syndrome, is a rare condition where a child who has developed normally for at least the first two years of life experiences a significant loss of previously acquired skills. This regression typically happens between the ages of 2 and 10 and affects areas such as language, social interaction, play, motor abilities, and bladder or bowel control. Although CDD shares features with Autism Spectrum Disorder (ASD), it is distinct in that it involves a noticeable decline after a period of normal development. It is now classified under ASD in the DSM-5. The exact cause is not fully understood, but it may involve genetic, neurological, and environmental factors. Early diagnosis and intervention, including behavioral therapies and support services, can help improve a child’s development and quality of life.
","Childhood Disintegrative Disorder (CDD), also known as Heller's syndrome, is a rare condition where a child who has developed normally for at least the first two years of life experiences a significant loss of previously acquired skills. This regression typically happens between the ages of 2 and 10 and affects areas such as language, social interaction, play, motor abilities, and bladder or bowel control. Although CDD shares features with Autism Spectrum Disorder (ASD), it is distinct in that it involves a noticeable decline after a period of normal development. It is now classified under ASD in the DSM-5. The exact cause is not fully understood, but it may involve genetic, neurological, and environmental factors. Early diagnosis and intervention, including behavioral therapies and support services, can help improve a child’s development and quality of life.",22.212,success,,2025-09-01T08:10:47.096354,19.227113008499146,5.078315734863281e-05,2.984,0.7789449691772461,2.204317092895508,3.0,0.7789449691772461,2.204317092895508,2.9832630157470703,"[08:10:24.883] Starting processing for question 5: 'What is childhood disintegrative disorder?...'
[08:10:24.884] STARTED: Total_Processing
[08:10:24.884] STARTED: RAG_Analysis
[08:10:24.884] Performing detailed RAG analysis...
[08:10:27.868] COMPLETED: RAG_Analysis - 2.984s | Retrieved 3 results, Embedding: 0.779s, Weaviate: 2.204s
RAG ANALYSIS: Query(42 chars, 5 words) -> Embedding: 0.779s (26.11%), Weaviate: 2.204s (73.89%), Results: 3, Total: 2.983s
[08:10:27.868] STARTED: Pipeline_Processing
[08:10:27.868] Starting main pipeline processing...
[08:10:47.095] COMPLETED: Pipeline_Processing - 19.227s | Response length: 892 chars
[08:10:47.095] STARTED: Response_Cleaning
[08:10:47.095] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 871 chars","PERFORMANCE BOTTLENECK ANALYSIS:
Total Pipeline Time: 22.211s
--------------------------------------------------
🔴 SLOW Pipeline_Processing: 19.227s (86.6%)
🟡 MODERATE RAG_Analysis: 2.984s (13.4%)
🟢 FAST Response_Cleaning: 0.000s (0.0%)
RAG DETAILED ANALYSIS:
------------------------------
Query complexity: 5 words, 42 chars
Embedding generation: 0.779s (26.11%)
Weaviate query: 2.204s (73.89%)
Results retrieved: 3
⚠️ ISSUE: Weaviate query is the bottleneck
💡 SUGGESTION: Check Weaviate connection, indexing, or reduce vector dimensions",pipeline_processing_seconds,D (Very Slow)
5,What is the prognosis of children with autism?,"The prognosis for children with autism varies widely depending on individual factors such as the severity of symptoms, early intervention, access to support services, and co-occurring conditions. With early diagnosis and evidence-based interventions—such as applied behavior analysis (ABA), speech and language therapy, occupational therapy, and social skills training—many children with autism can make significant progress in communication, social interaction, and daily living skills. Some may achieve independence in adulthood, while others may require ongoing support. Early and consistent intervention greatly improves long-term outcomes, helping individuals with autism lead fulfilling lives.
","The prognosis for children with autism varies widely depending on individual factors such as the severity of symptoms, early intervention, access to support services, and co-occurring conditions. With early diagnosis and evidence-based interventions—such as applied behavior analysis (ABA), speech and language therapy, occupational therapy, and social skills training—many children with autism can make significant progress in communication, social interaction, and daily living skills. Some may achieve independence in adulthood, while others may require ongoing support. Early and consistent intervention greatly improves long-term outcomes, helping individuals with autism lead fulfilling lives.",20.774,success,,2025-09-01T08:11:08.879043,17.72189998626709,7.510185241699219e-05,3.052,1.1245718002319336,1.9270789623260498,3.0,1.1245718002319336,1.9270789623260498,3.051654100418091,"[08:10:48.101] Starting processing for question 6: 'What is the prognosis of children with autism?...'
[08:10:48.101] STARTED: Total_Processing
[08:10:48.101] STARTED: RAG_Analysis
[08:10:48.101] Performing detailed RAG analysis...
[08:10:51.153] COMPLETED: RAG_Analysis - 3.052s | Retrieved 3 results, Embedding: 1.125s, Weaviate: 1.927s
RAG ANALYSIS: Query(46 chars, 8 words) -> Embedding: 1.125s (36.85%), Weaviate: 1.927s (63.15%), Results: 3, Total: 3.052s
[08:10:51.153] STARTED: Pipeline_Processing
[08:10:51.153] Starting main pipeline processing...
[08:11:08.875] COMPLETED: Pipeline_Processing - 17.722s | Response length: 720 chars
[08:11:08.875] STARTED: Response_Cleaning
[08:11:08.875] COMPLETED: Response_Cleaning - 0.000s | Cleaned length: 699 chars","PERFORMANCE BOTTLENECK ANALYSIS:
Total Pipeline Time: 20.774s
--------------------------------------------------
🔴 SLOW Pipeline_Processing: 17.722s (85.3%)
🟡 MODERATE RAG_Analysis: 3.052s (14.7%)
🟢 FAST Response_Cleaning: 0.000s (0.0%)
RAG DETAILED ANALYSIS:
------------------------------
Query complexity: 8 words, 46 chars
Embedding generation: 1.125s (36.85%)
Weaviate query: 1.927s (63.15%)
Results retrieved: 3
⚠️ ISSUE: Weaviate query is the bottleneck
💡 SUGGESTION: Check Weaviate connection, indexing, or reduce vector dimensions",Pipeline_Processing,D (Very Slow)