How to include a layout template in module (or theme)?

Experimenting with this and found that simply adding the .json file a config directory in the module seems to work, I assume the same might be true for themes.