The worst thing about making calls to external service is that those calls sometimes fail because of network errors or because the service is temporarily unavailable. It makes sense to retry the function call a few times and hope that the problem disappears in those situations.

The retry package gives us an easy method to implement retries in Python. All we need is a decorator added to the function we want to retry.

First, we have to install the package. If we use pip, the installation looks like this: pip install retry.

After that, we must find the definition of the function we want to retry, for example, this one:

def a_function_that_fails_for_no_reason():

Now, we add the decorator to the function. To define a decorator, we need the names of the errors that should cause a retry. All other errors will be propagated to the caller without retrying the function.

Additionally, we need the number of retries and the delay between the subsequent function calls.

from retry import retry

@retry((HTTPError, DNSError), tries = 3, delay = 2, backoff = 2)
def a_function_that_fails_for_no_reason():
Older post

Send a Slack message from an Airflow DAG

How to use the SlackAPIPostOperator to send a templated message to a Slack channel

Newer post

How to automatically remove files from S3 using lifecycle rules defined in Terraform

How to define S3 lifecycle rules using Terraform