Configuration Change

Restart Required

AAP xml files

No, but existing sessions may be accessing stale data, that is, the values of some HTTP headers may be incorrect

shibboleth.xml

It's not a yes/no answer. The file is reloaded on the fly, but some of the file is only read at initial start up. Basically stuff that loads extensions or configures the Caches, Listener mechanism, and other global issues are startup only. Most of the mapping, settings, application config, endpoints, etc. are all dynamic.
Note that Apache is more complex because it has children that come and go. A child loads whatever is there at that time into its process, so you can corrupt your system until restart if you modify a setting that breaks the connection between Apache and shibd without restarting shibd.

metadata files

No