Change timeout thread checks to 60 seconds

Summary:
The timeout thread and the main thread contend for a lock to access
the work objects.  Having the timeout thread check too frequently can
cause lock contention.  Reduce check frequency to minimize lock
contention.

Reviewed By: tanquer

Differential Revision: D85455461

fbshipit-source-id: 84576b79acc2ccb5fedbfb6eb95a9be89d8bcb5c

Author: pavanbalaji

comms/torchcomms/ncclx/TorchCommNCCLXUtils.cpp

@@ -181,9 +181,10 @@ void TorchCommNCCLX::timeoutWatchdog() noexcept {
     {
       std::unique_lock<std::mutex> lock(timeout_mutex_);
       // Wait for a shorter interval to check work objects periodically
-      // Wake up either after 1 second or immediately if shutdown is requested
-      timeout_cv_.wait_for(
-          lock, std::chrono::seconds(1), [this]() { return shutdown_.load(); });
+      // Wake up either after 60 seconds or immediately if shutdown is requested
+      timeout_cv_.wait_for(lock, std::chrono::seconds(60), [this]() {
+        return shutdown_.load();
+      });
 
       // If we're shutting down, exit the loop
       if (shutdown_) {