So, You Want to Build a Copilot?

Michal Furmakiewicz (), Chang Liu (), Angus Taylor () and Ilya Venger ()
Additional contact information
Michal Furmakiewicz: Microsoft
Chang Liu: Microsoft
Angus Taylor: Microsoft
Ilya Venger: Microsoft

A chapter in The Design of Human-Centered Artificial Intelligence for the Workplace, 2025, pp 351-370 from Springer

Abstract: Abstract Building a successful AI copilot requires a systematic approach. This chapter is divided into two sections, covering the design and evaluation of a copilot, respectively. A case study of developing copilot templates by Microsoft for the retail domain is used to illustrate the role and importance of each aspect. The first section explores the key technical components of a copilot’s architecture, including the LLM, plugins for knowledge retrieval and actions, orchestration, system prompts, and responsible AI guardrails. The second section discusses testing and evaluation as a principled way to manage desired outcomes and unintended consequences of using AI in a business context. We discuss how to measure and improve its quality and safety, through the lens of an end-to-end human-AI decision loop framework. By providing insights into the anatomy of a copilot and the critical aspects of testing and evaluation, this chapter provides concrete evidence of how good design and evaluation practices are essential for building effective, human-centered AI assistants.

Date: 2025
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:prochp:978-3-031-83512-4_20

Ordering information: This item can be ordered from
http://www.springer.com/9783031835124

DOI: 10.1007/978-3-031-83512-4_20

Access Statistics for this chapter

More chapters in Progress in IS from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().