Explainability in AI

In this post, I will share a few of my thoughts on explainability in AI/ML.

Motivating Stories

These situations ought to explain why explainability in AI is important.

• When a human is riding a self-driving taxi, and the taxi takes a sudden unexpected detour, you become suspicious and probably scared, wondering if the car is malfunctioning or has been hacked and if you are being taken to a different place. The AI agent driving the taxi will need to give an explanation — something like, the road ahead has been blocked, or there is…