  Storytelling serves as a crucial avenue for children to acquire knowledge,
offering numerous benefits such as enhancing children's sensitivity to various
forms of syntax, diction, and rhetoric; recognizing patterns in language and
human experience; stimulating creativity; and providing practice in
problem-solving, decision-making, and evaluation. However, current storytelling
book facing these problems:1.Traditional 3D storybooks lack flexibility in
dealing with text changing, as adding a new story requires remaking of the 3D
book by artists. 2. Children often have many questions after reading stories,
but traditional 3D books are unable to provide answers or explanations for
children.3.Children can easily feel bored when reading text, and traditional 3D
books still rely on text to tell stories, thus limiting their ability to
increase children's enthusiasm for reading. So, we propose the Metabook: an
automatically generated interactive 3D storybook. Our main contributions are as
follows: First, we propose a story to 3D generation scheme, enabling 3D books
to be automatically generated based on stories. Next, we introduce cartoon
Metahumans for storytelling, utilizing lip-syncing and eye-tracking technology
to enable facial interaction with children, enhancing the fun of reading. Last
but not least, we connect GPT-4 to the brain of the metahuman, which provides
answers and explanations to the questions children have after reading.
