Is your feature request related to a problem? Please describe.
With the introduction of external storage, downloading and uploading payload from/to external storage contributes to the workflow task duration. The operational time of workflow tasks may be longer due to communication with storage systems and cause them to approach the workflow task timeout or exceed it.
Describe the solution you'd like
When approaching the workflow task timeout, the worker should log information that may contribute to the workflow task duration, for example:
- Total wall clock time for external storage download
- Total number of payloads downloaded
- Total size of payloads downloaded
- Total wall clock time for external storage upload
- Total number of payloads uploaded
- Total size of payloads uploaded
The worker should emit this information at the info level when greater than 5s and warning level when greater than 10s. The worker should emit this information with the TMPRL1104 rule.
Per-SDK Tickets
Is your feature request related to a problem? Please describe.
With the introduction of external storage, downloading and uploading payload from/to external storage contributes to the workflow task duration. The operational time of workflow tasks may be longer due to communication with storage systems and cause them to approach the workflow task timeout or exceed it.
Describe the solution you'd like
When approaching the workflow task timeout, the worker should log information that may contribute to the workflow task duration, for example:
The worker should emit this information at the info level when greater than 5s and warning level when greater than 10s. The worker should emit this information with the TMPRL1104 rule.
Per-SDK Tickets