从S3获取3MB文件到MemoryStream耗时过长的问题排查
S3 3MB文件CopyToAsync耗时超1分钟的问题排查与解决方案
尝试从S3存储桶获取一个3MB的文件并复制到MemoryStream用于后续查看内容,但调用CopyToAsync时耗时至少1分钟,用传输工具打开流或下载文件耗时相近。
当前代码:
using var s3Object = await _client.GetObjectAsync(getRequest); var ms = new MemoryStream(); // 耗时极长 await s3Object.ResponseStream.CopyToAsync(ms); return ms;
我理解s3Object包含该S3对象的元数据以及文件流的起始部分,因此调用CopyToAsync时才会实际完整下载文件。
文件内容示例:
DEPT .M :1 Index curve GR .GAPI :2 L05-07 DT .US/F :3 L05-07 RHOB .G/C3 :4 L05-07 DRHO .G/C3 :5 L05-07 NPHI .V/V :6 L05-07 ~Ascii Log Data 63.1000 -999.250000 -999.250000 -999.250000 -999.250000 -999.250000 63.2000 -999.250000 -999.250000 -999.250000 -999.250000 -999.250000 63.3000 -999.250000 -999.250000 -999.250000 -999.250000 -999.250000 63.4000 -999.250000 -999.250000 -999.250000 -999.250000 -999.250000 63.5000 11.094475 -999.250000 -999.250000 -999.250000 -999.250000 63.6000 11.473166 -999.250000 -999.250000 -999.250000 -999.250000 63.7000 12.066418 -999.250000 -999.250000 -999.250000 -999.250000 63.8000 12.302490 -999.250000 -999.250000 -999.250000 -999.250000 63.9000 12.272800 -999.250000 -999.250000 -999.250000 -999.250000 64.0000 11.762026 -999.250000 -999.250000 -999.250000 -999.250000 64.1000 10.414513 -999.250000 -999.250000 -999.250000 -999.250000 64.2000 9.588345 -999.250000 -999.250000 -999.250000 -999.250000
请问我的操作是否有误?有没有其他解决方案?
内容的提问来源于stack exchange,提问作者mmgyyc
相关产品推荐
相关产品推荐

