build: Fix custom type formatting for pre-compiled spdlog

In case of using pre-compiled spdlog (distribution package or conda
build) it relies on using the external fmt library. The external fmt
library does not simply use the ostream operator << for formatting
custom types, but in addition needs a specialization of `fmt::formatter`
that inherits from `ostream_formatter`.