Understand JavaScript Callback Functions

Callbacks are frequently mentioned in the context of functions and events, but can also be one of the more difficult aspects of JavaScript to understand. So what are callbacks, and how do they work?