Update logging, no filtering, explicit warning

Why these changes are being introduced:

The previous approach filtered all logging to only loggers
from the namespace 'tim' thereby excluding the
new 'timdex_dataset_api' (TDA) logging that we would like
exposed.  This pattern works well most of the time when
3rd party library logging is not needed, but inflexible
when it is.

How this addresses that need:

Reworks the application logging setup as part of
configure_logger() to:

* not use logging.basicConfig()
* avoid filtering loggers, but instead explicitly setting
some logger names to WARNING level (e.g. chatty ones
like botocore) via arguments or env vars

Side effects of this change:

In production, where log level is INFO, it is possible
that some libraries may produce more logging statements,
but anticipated to be low. But desirable logs, like the
timdex_dataset_api library, will now show and will be
driven by this application's --verbose flag.

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/TIMX-459

Author: ghukill

tim/config.py

@@ -31,23 +31,40 @@ def configure_index_settings() -> tuple:
         return all_settings["mappings"], all_settings["settings"]
 
 
-def configure_logger(logger: logging.Logger, *, verbose: bool) -> str:
+def configure_logger(
+    root_logger: logging.Logger,
+    *,
+    verbose: bool = False,
+    warning_only_loggers: str | None = None,
+) -> str:
+    """Configure application via passed application root logger.
+
+    If verbose=True, 3rd party libraries can be quite chatty.  For convenience, they can
+    be set to WARNING level by either passing a comma seperated list of logger names to
+    'warning_only_loggers' or by setting the env var WARNING_ONLY_LOGGERS.
+    """
     if verbose:
-        logging.basicConfig(
-            format="%(asctime)s %(levelname)s %(name)s.%(funcName)s() line %(lineno)d: "
-            "%(message)s"
+        root_logger.setLevel(logging.DEBUG)
+        logging_format = (
+            "%(asctime)s %(levelname)s %(name)s.%(funcName)s() "
+            "line %(lineno)d: %(message)s"
         )
-        logger.setLevel(logging.DEBUG)
     else:
-        logging.basicConfig(
-            format="%(asctime)s %(levelname)s %(name)s.%(funcName)s(): %(message)s"
-        )
-        logger.setLevel(logging.INFO)
-    for handler in logging.root.handlers:
-        handler.addFilter(logging.Filter("tim"))
+        root_logger.setLevel(logging.INFO)
+        logging_format = "%(asctime)s %(levelname)s %(name)s.%(funcName)s(): %(message)s"
+
+    warning_only_loggers = os.getenv("WARNING_ONLY_LOGGERS", warning_only_loggers)
+    if warning_only_loggers:
+        for name in warning_only_loggers.split(","):
+            logging.getLogger(name).setLevel(logging.WARNING)
+
+    handler = logging.StreamHandler()
+    handler.setFormatter(logging.Formatter(logging_format))
+    root_logger.addHandler(handler)
+
     return (
-        f"Logger '{logger.name}' configured with level="
-        f"{logging.getLevelName(logger.getEffectiveLevel())}"
+        f"Logger '{root_logger.name}' configured with level="
+        f"{logging.getLevelName(root_logger.getEffectiveLevel())}"
     )