PowerShell v7并行处理文件报错：参数集无法解析求助

报错原因分析 #

报错出现在ForEach-Object -Parallel调用处，核心问题及潜在问题如下：

1. 变量引用错误：并行块中错误尝试访问当前文件对象的Patterns属性（$using:_.Patterns），但Patterns是外部定义的哈希表变量$patterns，并非文件对象属性；同时当前文件对象的FullName无需使用$using:，$_在并行块内直接指代当前管道传递的文件对象。
2. 函数作用域问题：并行运行的子PowerShell会话不会自动继承父会话中定义的Search-PIIInFile函数，直接调用会触发函数未找到的错误。
3. 文件计数逻辑缺陷：当Get-ChildItem仅返回单个文件时，$files.Count会返回文件字节长度而非文件数量，导致判断失效。
4. 错误信息丢失：并行块内的错误未被收集到最终结果中，无法追踪文件处理失败的原因。

修复步骤 #

1. 修正并行块变量引用：
   • 将$FilePath = $using:_.FullName改为$FilePath = $_.FullName
   • 将$Patterns = $using:_.Patterns改为$Patterns = $using:patterns
2. 传递函数到并行会话：通过$using:Search-PIIInFile将外部函数传递到并行块，用&调用函数。
3. 修复文件计数逻辑：用@($files).Count确保数组计数正确，避免单个文件时的判断错误。
4. 完善错误处理：在catch块中返回包含错误信息的自定义对象，确保错误被记录到结果中。

完整修正代码 #

# Import necessary modules
Import-Module ImportExcel -ErrorAction Stop
# Import-Module PSWord -ErrorAction Stop
# Import-Module PSWriteWord -ErrorAction Stop
# Import-Module PdfTools -ErrorAction Stop

# Define PII patterns
$patterns = @{
    "Email" = "\b[A-Za-z0-9._%+-]+@[A-Za-z0-9.-]+\.[A-Za-z]{2,6}\b"
    "Phone" = "\b\d{3}[-. ]?\d{3}[-. ]?\d{4}\b"
    "SSN"   = "\b\d{3}-\d{2}-\d{4}\b"
    "CreditCard" = "\b(?:4[0-9]{12}(?:[0-9]{3})?|5[1-5][0-9]{14}|6(?:011|5[0-9][0-9])[0-9]{12}|3[47][0-9]{13}|3(?:0[0-5]|[68][0-9])[0-9]{11}|(?:2131|1800|35\d{3})\d{11})\b"
}

# Define file types and search paths
$fileTypes = ".txt", ".csv", ".xlsx", ".docx", ".pdf"
$searchPaths = @(
    "E:\Documents"
)

function Search-PIIInFile {
    param (
        [string]$filePath,
        [hashtable]$patterns
    )

    $results = @()
    $fileExtension = [System.IO.Path]::GetExtension($filePath).ToLower()
    $content = ""

    # Open and read file based on type
    switch ($fileExtension) {
        ".txt" {
            $content = Get-Content -Path $filePath -Raw -ErrorAction Stop
        }
        ".csv" {
            $content = Import-Csv -Path $filePath | Out-String
        }
        ".xlsx" {
            $headerNames = 1..100 | ForEach-Object { "Column$_" }
            $content = Import-Excel -Path $filePath -HeaderName $headerNames | Out-String
        }
        ".docx" {
            $doc = Get-WordText -FilePath $filePath
            $content = $doc | Out-String
        }
        ".pdf" {
            $content = Get-PdfText -Path $filePath -ErrorAction Stop
        }
        default {
            Write-Warning "Unsupported file type: $fileExtension for file $filePath"
            return
        }
    }

    # Safe output handling for content
    if ($null -eq $content -or $content.Length -eq 0) {
        Write-Output "No content was retrieved from $filePath."
    } else {
        Write-Output "Content length from ${filePath}: $($content.Length)"
        Write-Output "Snippet of content from ${filePath}: $($content.Substring(0, [Math]::Min(200, $content.Length)))"
    }

    # Search for patterns
    foreach ($patternName in $patterns.Keys) {
        $pattern = $patterns[$patternName]
        if ($content -match $pattern) {
            $matches = [regex]::matches($content, $pattern)
            foreach ($match in $matches) {
                $lineNum = ($content -split "`r?`n").IndexOf($match.Value) + 1
                $results += [PSCustomObject]@{
                    File       = $filePath
                    PII_Type   = $patternName
                    Match      = $match.Value
                    LineNumber = if ($lineNum -gt 0) { $lineNum } else { "N/A" }
                    Error      = $null
                }
            }
        }
    }

    return $results
}

$logPath = "C:\Logs\PII_Search_Results.log"

# Collect all files and search for PII across multiple directories
$allResults = @()

foreach ($searchPath in $searchPaths) {
    if (!(Test-Path -Path $searchPath)) {
        Write-Output "Path does not exist: $searchPath"
        continue
    }
    
    Write-Output "Searching in path: $searchPath"

    # Get all files in the search path with specified types
    $files = Get-ChildItem -Path $searchPath -Recurse -Force -ErrorAction SilentlyContinue | Where-Object {
        $fileTypes -contains $_.Extension.ToLower()
    }

    # Ensure that we have files to process
    if (@($files).Count -eq 0) {
        Write-Output "No files found in path: $searchPath"
        continue
    }

    # Process files in parallel
    $results = $files | ForEach-Object -Parallel {
        $FilePath = $_.FullName
        $Patterns = $using:patterns
        $SearchFunction = $using:Search-PIIInFile

        try {
            # Call the search function and return results
            & $SearchFunction -filePath $FilePath -patterns $Patterns
        }
        catch {
            # Return error object to track failures
            [PSCustomObject]@{
                File       = $FilePath
                PII_Type   = "Error"
                Match      = $_.Exception.Message
                LineNumber = "N/A"
                Error      = $_.Exception
            }
        }
    } 
    
    # Aggregate results from parallel processing
    $allResults += $results
}

# Output results to a .txt file
$txtPath = "C:\Logs\PII_Search_Results.txt"
$allResults | ForEach-Object {
    if ($_.Error) {
        "$($_.File) - ERROR: $($_.Match)"
    } else {
        "$($_.File) - PII Type: $($_.PII_Type) - Match: $($_.Match) - Line Number: $($_.LineNumber)"
    }
} | Out-File -FilePath $txtPath -Encoding UTF8

Write-Output "PII search completed. Results saved to $txtPath."

关键修改说明 #

• 并行块变量引用修正：直接使用$_.FullName获取当前文件路径，用$using:patterns引用外部PII规则哈希表。
• 函数传递与调用：通过$using:Search-PIIInFile将外部函数传入并行会话，用& $SearchFunction执行函数。
• 错误追踪：在catch块中返回包含错误信息的自定义对象，确保文件处理失败的原因被记录到结果文件。
• 文件计数修复：用@($files).Count统一数组计数逻辑，避免单个文件时的判断错误。

内容的提问来源于stack exchange，提问作者nutt318