All Outputs (2)

POSSCORE: A Simple Yet Effective Evaluation of Conversational Search with Part of Speech Labelling (2021)
Presentation / Conference Contribution
Liu, Z., Zhou, K., Mao, J., & Wilson, M. L. (2021, November). POSSCORE: A Simple Yet Effective Evaluation of Conversational Search with Part of Speech Labelling. Presented at CIKM '21: The 30th ACM International Conference on Information and Knowledge Management, Virtual Event Queensland Australia

Conversational search systems, such as Google Assistant and Microsoft Cortana, provide a new search paradigm where users are allowed, via natural language dialogues, to communicate with search systems. Evaluating such systems is very challenging sinc... Read More about POSSCORE: A Simple Yet Effective Evaluation of Conversational Search with Part of Speech Labelling.

Meta-evaluation of Conversational Search Evaluation Metrics (2021)
Journal Article
Liu, Z., Zhou, K., & Wilson, M. L. (2021). Meta-evaluation of Conversational Search Evaluation Metrics. ACM Transactions on Information Systems, 39(4), 1-42. https://doi.org/10.1145/3445029

Conversational search systems, such as Google assistant and Microsoft Cortana, enable users to interact with search systems in multiple rounds through natural language dialogues. Evaluating such systems is very challenging, given that any natural lan... Read More about Meta-evaluation of Conversational Search Evaluation Metrics.