TY - JOUR
T1 - Using focal point learning to improve human-machine tacit coordination
AU - Zuckerman, Inon
AU - Kraus, Sarit
AU - Rosenschein, Jeffrey S.
N1 - Funding Information:
Acknowledgements This research is based upon work supported in part by the U.S. Army Research Laboratory and the U.S. Army Research Office under grant number W911NF-08-1-0144, AFOSR grant FA95500610405, NSF grant 0705587 and under ISF grant #1357/07. We appreciate the comments of the anonymous reviewers, which were quite useful.
PY - 2011/3
Y1 - 2011/3
N2 - We consider an automated agent that needs to coordinate with a human partner when communication between them is not possible or is undesirable (tacit coordination games). Specifically, we examine situations where an agent and human attempt to coordinate their choices among several alternatives with equivalent utilities. We use machine learning algorithms to help the agent predict human choices in these tacit coordination domains. Experiments have shown that humans are often able to coordinate with one another in communication-free games, by using focal points, "prominent" solutions to coordination problems. We integrate focal point rules into the machine learning process, by transforming raw domain data into a new hypothesis space. We present extensive empirical results from three different tacit coordination domains. The Focal Point Learning approach results in classifiers with a 40-80% higher correct classification rate, and shorter training time, than when using regular classifiers, and a 35% higher correct classification rate than classical focal point techniques without learning. In addition, the integration of focal points into learning algorithms results in agents that are more robust to changes in the environment. We also present several results describing various biases that might arise in Focal Point based coordination.
AB - We consider an automated agent that needs to coordinate with a human partner when communication between them is not possible or is undesirable (tacit coordination games). Specifically, we examine situations where an agent and human attempt to coordinate their choices among several alternatives with equivalent utilities. We use machine learning algorithms to help the agent predict human choices in these tacit coordination domains. Experiments have shown that humans are often able to coordinate with one another in communication-free games, by using focal points, "prominent" solutions to coordination problems. We integrate focal point rules into the machine learning process, by transforming raw domain data into a new hypothesis space. We present extensive empirical results from three different tacit coordination domains. The Focal Point Learning approach results in classifiers with a 40-80% higher correct classification rate, and shorter training time, than when using regular classifiers, and a 35% higher correct classification rate than classical focal point techniques without learning. In addition, the integration of focal points into learning algorithms results in agents that are more robust to changes in the environment. We also present several results describing various biases that might arise in Focal Point based coordination.
KW - Autonomous agents
KW - Cognitive model
KW - Focal points
KW - Human-machine interaction
KW - Tactic coordination
UR - http://www.scopus.com/inward/record.url?scp=79751524003&partnerID=8YFLogxK
U2 - 10.1007/s10458-010-9126-5
DO - 10.1007/s10458-010-9126-5
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:79751524003
SN - 1387-2532
VL - 22
SP - 289
EP - 316
JO - Autonomous Agents and Multi-Agent Systems
JF - Autonomous Agents and Multi-Agent Systems
IS - 2
ER -