Record Details
Personalizing machine learning systems with explanatory debugging
ScholarsArchive at Oregon State University
| Field | Value |
|---|---|
| Title | Personalizing machine learning systems with explanatory debugging |
| Names |
Kulesza, Todd
(creator) Burnett, Margaret M. (advisor) |
| Date Issued | 2014-12-01 (iso8601) |
| Note | Graduation date: 2015 |
| Abstract | How can end users efficiently influence the predictions that machine learning systems make on their behalf? Traditional systems rely on users to provide examples of how they want the learning system to behave, but this is not always practical for the user, nor efficient for the learning system. This dissertation explores a different personalization approach: a two-way cycle of explanations, in which the learning system explains the reasons for its predictions to the end user, who can then explain any necessary corrections back to the system. In formative work, we study the feasibility of explaining a machine learning system's reasoning to end users and whether this might help users explain corrections back to the learning system. We then conduct a detailed study of how learning systems should explain their reasoning to end users. We use the results of this formative work to inform Explanatory Debugging, our explanation-centric approach for personalizing machine learning systems, and present an example of how this novel approach can be instantiated in a text classification system. Finally, we evaluate the effectiveness of Explanatory Debugging versus a traditional learning system, finding that explanations of the learning system's reasoning improved study participants' understanding by over 50% (compared with participants who used the traditional system) and participants' corrections to this reasoning were up to twice as efficient as providing examples to the learning system. |
| Genre | Thesis/Dissertation |
| Access Condition | http://creativecommons.org/licenses/by-sa/3.0/us/ |
| Topic | machine learning |
| Identifier | http://hdl.handle.net/1957/54622 |
