寻求支持超长行的StreamReader.ReadLine/ReadLineAsync变体方案

.NET标准库中并没有直接提供带最大行长度限制、同时返回截断标识的ReadLine/ReadLineAsync变体，官方方法遇到超出内存的超长行时会抛出异常，需要自行实现扩展方法来满足需求。

同步版本扩展方法 #

以下是StreamReader的同步扩展方法ReadLineStart，可以读取每行的前N个字符，并标记该行是否因超长被截断：

public static class StreamReaderExtensions
{
    public static (string LineStart, bool IsTruncated) ReadLineStart(this StreamReader reader, int maxLineLength)
    {
        if (reader == null)
            throw new ArgumentNullException(nameof(reader));
        if (maxLineLength <= 0)
            throw new ArgumentOutOfRangeException(nameof(maxLineLength), "Maximum line length must be a positive number.");

        var charBuffer = new char[maxLineLength];
        int charsRead = 0;
        bool isTruncated = false;
        int currentChar;

        // 读取前maxLineLength个字符，直到遇到换行符或流结束
        while (charsRead < maxLineLength)
        {
            currentChar = reader.Read();
            if (currentChar == -1) // 流已读完，终止读取
                break;
            if (currentChar == '\n') // 遇到LF换行符，结束此行
                break;
            if (currentChar == '\r') // 处理CRLF换行符
            {
                charBuffer[charsRead++] = (char)currentChar;
                // 检查下一个字符是否为LF，是的话跳过
                if (reader.Peek() == '\n')
                    reader.Read();
                break;
            }
            charBuffer[charsRead++] = (char)currentChar;
        }

        // 若已读满maxLineLength，跳过该行剩余内容
        if (charsRead == maxLineLength)
        {
            isTruncated = true;
            while ((currentChar = reader.Read()) != -1)
            {
                if (currentChar == '\n')
                    break;
            }
        }

        return (new string(charBuffer, 0, charsRead), isTruncated);
    }
}

异步版本扩展方法 #

对应异步场景的ReadLineStartAsync方法，逻辑与同步版本一致，使用异步读取API：

public static async Task<(string LineStart, bool IsTruncated)> ReadLineStartAsync(this StreamReader reader, int maxLineLength)
{
    if (reader == null)
        throw new ArgumentNullException(nameof(reader));
    if (maxLineLength <= 0)
        throw new ArgumentOutOfRangeException(nameof(maxLineLength), "Maximum line length must be a positive number.");

    var charBuffer = new char[maxLineLength];
    int charsRead = 0;
    bool isTruncated = false;
    int currentChar;

    while (charsRead < maxLineLength)
    {
        currentChar = await reader.ReadAsync();
        if (currentChar == -1)
            break;
        if (currentChar == '\n')
            break;
        if (currentChar == '\r')
        {
            charBuffer[charsRead++] = (char)currentChar;
            if (reader.Peek() == '\n')
                await reader.ReadAsync();
            break;
        }
        charBuffer[charsRead++] = (char)currentChar;
    }

    if (charsRead == maxLineLength)
    {
        isTruncated = true;
        while ((currentChar = await reader.ReadAsync()) != -1)
        {
            if (currentChar == '\n')
                break;
        }
    }

    return (new string(charBuffer, 0, charsRead), isTruncated);
}

使用示例 #

同步使用 #

var maxLineLength = 100;
using var reader = new StreamReader("large-file.txt");

while (!reader.EndOfStream)
{
    var (lineStart, isTruncated) = reader.ReadLineStart(maxLineLength);

    if (isTruncated)
    {
        Console.WriteLine("Too long, skipping...");
    }
    else
    {
        Console.WriteLine(lineStart);
    }
}

异步使用 #

可以额外添加一个异步枚举扩展方法，方便遍历所有行：

public static async IAsyncEnumerable<(string LineStart, bool IsTruncated)> ReadLinesStartAsync(this StreamReader reader, int maxLineLength)
{
    while (!reader.EndOfStream)
    {
        yield return await reader.ReadLineStartAsync(maxLineLength);
    }
}

调用示例：

var maxLineLength = 100;
using var asyncReader = new StreamReader("large-file.txt");

await foreach (var (lineStart, isTruncated) in asyncReader.ReadLinesStartAsync(maxLineLength))
{
    if (isTruncated)
    {
        Console.WriteLine("Too long, skipping...");
    }
    else
    {
        Console.WriteLine(lineStart);
    }
}

关键细节说明 #

• 同时兼容\n（Unix）和\r\n（Windows）两种换行格式
• 当流提前结束时，已读取的内容会正常返回，不会标记为截断（除非已达到最大长度）
• 扩展方法需放在静态类中，确保在项目中可访问

内容的提问来源于stack exchange，提问作者sdgfsdh