pythonfsspec/s3fs #558Not a task: already works

S3 error : Unable to locate credentials

envgap__fsspec__s3fs-558

Original GitHub issue ↗Dated source checkout ↗Opened 2021-11-19

01 / FAILURE SIGNATURE

As reported upstream

botocore.exceptions.NoCredentialsError: Unable to locate credentials

Not a benchmark task.

The project already builds and runs before the fix, so there is nothing to repair.

02 / ENVIRONMENT RECIPE

Base commit: 2a53f0f4b64edf315df52898bdbaabcca3a54e1f
Manifest: requirements.txt
Reproduce: Awaiting issue-specific recipe
Run under trace: Awaiting a meaningful runtime command

03 / ORIGINAL ISSUE TEXT

fsspec/s3fs #558 · read the original issue

Hello,



since asynciohttp [v3.8.1](https://github.com/conda-forge/aiohttp-feedstock/commit/94e676be31151745cea34f6f3e0eea095e9ed2c4) was deployed on condaforge 3 days ago while trying to use s3fs with iamRole based credentials in AWS EC2 servers, we are encountering the following errors :



``` 

  File "fastparquet/api.py", line 132, in __init__

  File "fsspec/asyn.py", line 91, in wrapper

  File "fsspec/asyn.py", line 71, in sync

  File "fsspec/asyn.py", line 25, in _runner

  File "s3fs/core.py", line 1128, in _isdir

  File "s3fs/core.py", line 580, in _lsdir

  File "aiobotocore/paginate.py", line 32, in __anext__

  File "aiobotocore/client.py", line 142, in _make_api_call

  File "aiobotocore/client.py", line 161, in _make_request

  File "aiobotocore/endpoint.py", line 77, in _send_request

  File "aiobotocore/endpoint.py", line 71, in create_request

  File "aiobotocore/hooks.py", line 27, in _emit

  File "aiobotocore/signers.py", line 16, in handler

  File "aiobotocore/signers.py", line 63, in sign

  File "botocore/auth.py", line 373, in add_auth

botocore.exceptions.NoCredentialsError: Unable to locate credentials

 ```

It seems that fixing aiohttp in version v3.7.4.post0 solves this issue.



Not also that we are not encountering the same errors on the same codebase on tasks that are running on Fargate instead of EC2.



I guess it would be good to investigate what happened with aiohttp (which is required by aiobotocore)



Any better solution than fixing aiohttp version is welcome !

Continue on GitHub ↗

04 / LABELS

Labels from the report text only; not yet run

No supported category has been assigned.

Label rules and the text that matched

[]