Description of the need
When adding a context by path, every field available to the context is presented in the dialog box. This not only produces un-necessary clutter but creates a bad UX because the field chosen may be attached to a different entity type, making it easy to accidentally add a similarly named field that won't display data as expected because it doesn't belong to the given layout path provided in the context.
Additionally, not filtering on a given criteria might also a performance hit on larger sites that have hundreds of fields. By limiting through the selection rule, it reduces the number of fields that need to be loaded.
Proposed solution
Add Selection Rules so a context can be limited to only show the fields related to the rule.
Alternatives that have been considered
See the Drupal Panels module Selection Rules for more inspiration.

Recent comments
If choosing the Views approach you can also use https://backdropcms.org/project/eva which allows you to place the list with more flexibility.
Backlinks for Entity Reference?
Thanks. It still took a lot of trial and error for all the settings within the settings, but I eventually got it to display based on these instructions.
Backlinks for Entity Reference?
Another easy way to do this is to use the module Corresponding Entity References (cer). You would need to add an entity reference field in the authors content type pointing at the book, then set...
Backlinks for Entity Reference?