Metaflow/community

Hi, I am working on getting the metaflow artifacts from S3. The code is deployed on AWS lambda I set the environment variable “METAFLOW_DATASTORE_SYSROOT_S3” to the s3 location. Our use case requires us to change the datastore environ variable in every iteration so that different flows and runs’ artifacts can be accessed as follows:

def _queryMetaflow(self, appName, starflowResp):
metaflow_run_id = starflowResp["details"]["frdm"]["metaflowRunNumber"]
metaflow_name = starflowResp["details"]["frdm"]["metaflowId"]

    os.environ['METAFLOW_DATASTORE_SYSROOT_S3'] = "{}/artifacts/{}/higher".format(getMetadataLocation(), appName)

    from metaflow import Metaflow, get_metadata, metadata, namespace, Run, get_namespace, Flow

    metadata1 = metadata(getMetadataURL())
    namespace(None)
    mf = Metaflow()

    # call metaflow and get results and send success or error
    try:
        metaflowResp = Run(metaflow_name + '/' + metaflow_run_id).data
        print(metaflowResp)
        del Metaflow, get_metadata, metadata, namespace, Run, get_namespace, Flow
        return metaflowResp
    except Exception as e:
        print("Exception occured in query metaflow: {}".format(e))
        raise CapAppFailure("Exception occured in metaflow response, S3 datastore operation _get_s3_object failed likely")

When this method is called the first time, it doesn’t fail in the first iteration but fails in the second iteration. I inspected the environ variable and the location is the correct in every iteration but this error is encountered in the second iteration:
S3 datastore operation _get_s3_object failed (An error occurred (404) when calling the HeadObject operation: Not Found). Retrying 7 more times..

I am unable to fix this issue. Can you please help?