  This paper aims to investigate the open research problem of uncovering the
social behaviors of LLM-based agents. To achieve this goal, we adopt Avalon, a
representative communication game, as the environment and use system prompts to
guide LLM agents to play the game. While previous studies have conducted
preliminary investigations into gameplay with LLM agents, there lacks research
on their social behaviors. In this paper, we present a novel framework designed
to seamlessly adapt to Avalon gameplay. The core of our proposed framework is a
multi-agent system that enables efficient communication and interaction among
agents. We evaluate the performance of our framework based on metrics from two
perspectives: winning the game and analyzing the social behaviors of LLM
agents. Our results demonstrate the effectiveness of our framework in
generating adaptive and intelligent agents and highlight the potential of
LLM-based agents in addressing the challenges associated with dynamic social
environment interaction. By analyzing the social behaviors of LLM agents from
the aspects of both collaboration and confrontation, we provide insights into
the research and applications of this domain. Our code is publicly available at
https://github.com/3DAgentWorld/LLM-Game-Agent
