Windows下用bat/cmd处理大日志文件：删除匹配行及前后行

Since you're dealing with a large (300MB+) log file on Windows, I'll share two reliable approaches: a batch script (for pure cmd compatibility) and a PowerShell script (faster for large files). Both will remove lines containing your target string, plus the line before and after each match.

Batch Script (CleanLog.bat) #

This script processes lines one at a time to avoid loading the entire file into memory, making it suitable for large logs.

@echo off
setlocal enabledelayedexpansion

:: Configure these values first!
set "TARGET_STRING=Hybrid Aggregation Mode enabled."
set "INPUT_FILE=MASTER.log"
set "OUTPUT_FILE=MASTER_CLEANED.log"

:: Initialize tracking variables
set "prev_line="
set "skip_next=0"

:: Loop through each line in the input log
for /f "delims=" %%a in ('type "%INPUT_FILE%"') do (
    if !skip_next! equ 1 (
        :: Skip this line (it's the line after the target match)
        set "skip_next=0"
    ) else (
        :: Check if current line contains our target string
        echo "%%a" | findstr /c:"!TARGET_STRING!" >nul
        if !errorlevel! equ 0 (
            :: Found a match: discard the previous line, skip current and next
            set "prev_line="
            set "skip_next=1"
        ) else (
            :: No match: write the previous line (if exists) and save current as new previous
            if not "!prev_line!"=="" (
                echo !prev_line!>>"%OUTPUT_FILE%"
            )
            set "prev_line=%%a"
        )
    )
)

:: Write the final line if it wasn't marked for skipping
if !skip_next! equ 0 if not "!prev_line!"=="" (
    echo !prev_line!>>"%OUTPUT_FILE%"
)

echo Done! Cleaned log saved to %OUTPUT_FILE%
endlocal

How to use: #

1. Edit the TARGET_STRING, INPUT_FILE, and OUTPUT_FILE variables to match your log details.
2. Double-click the batch file or run it from the command prompt.

Key notes: #

• Uses delayed expansion to handle special characters (like &, @, or parentheses) in log lines.
• Processes lines incrementally, so it won't bog down your system with large file loads.

PowerShell Alternative (Faster for Large Files) #

PowerShell is more efficient for very large logs. This script uses array handling to streamline the cleaning process.

# Configuration - adjust these values
$targetString = "Hybrid Aggregation Mode enabled."
$inputFile = "MASTER.log"
$outputFile = "MASTER_CLEANED.log"

# Load log lines (PowerShell handles large files efficiently here)
$lines = Get-Content $inputFile
$cleanedLines = @()
$skipNextLine = $false

for ($i = 0; $i -lt $lines.Count; $i++) {
    if ($skipNextLine) {
        $skipNextLine = $false
        continue
    }

    # Check for target string (escapes special regex characters automatically)
    if ($lines[$i] -match [regex]::Escape($targetString)) {
        # Remove the previously added line (the one before the match)
        if ($i -gt 0) {
            $cleanedLines = $cleanedLines[0..($cleanedLines.Count-2)]
        }
        # Skip the next line in the loop
        $skipNextLine = $true
    } else {
        $cleanedLines += $lines[$i]
    }
}

# Save the cleaned log
$cleanedLines | Set-Content $outputFile -Encoding UTF8
Write-Host "Cleaning complete! Output saved to $outputFile"

How to use: #

1. Save this as CleanLog.ps1.
2. Run from PowerShell: .\CleanLog.ps1
3. Or from command prompt: powershell -ExecutionPolicy Bypass -File CleanLog.ps1

Key notes: #

• Faster than batch for files over 300MB due to optimized memory handling.
• Automatically escapes special characters in your target string (like parentheses or brackets) to avoid regex errors.

Critical Pre-Caution: #

Always make a backup of your original MASTER.log before running any cleaning script—better safe than sorry! Test the script on a small sample of your log first to confirm it works as expected.

内容的提问来源于stack exchange，提问作者Eneko