JavaScript如何直接读取含重音字母的本地文本文件并解决乱码？

Hey there! Let’s get that accented character issue sorted out—nothing’s more frustrating than seeing � replace perfectly valid characters like é, ñ, or ü.

The Root Cause #

This almost always boils down to encoding mismatch. When you read a file without specifying the correct character encoding, your code defaults to something like UTF-8. If your text file uses a different encoding (common ones are ISO-8859-1/Latin-1, Windows-1252, or regional encodings like GBK), the bytes representing accented characters get misinterpreted, resulting in those garbled replacement symbols.

Step-by-Step Fixes #

First, confirm your file’s actual encoding: use a text editor like Notepad++ or VS Code to check (look in the "Encoding" menu). Then adjust your readTextFile function to handle that encoding properly.

Option 1: Basic Fix for Node.js/Electron

If you’re using Node.js (or Electron, which gives you access to Node’s fs module), modify your function to read with the correct encoding, then convert to UTF-8 for consistent handling:

// myFileReader.js
const fs = require('fs');

function readTextFile(file) {
  try {
    // Replace 'latin1' with your file's actual encoding (e.g., 'win1252')
    const rawContent = fs.readFileSync(file, 'latin1');
    // Convert to UTF-8 to ensure accented characters parse correctly
    const utf8Content = Buffer.from(rawContent, 'latin1').toString('utf8');
    
    // Now split lines/words without garbling
    const lines = utf8Content.split('\n');
    const words = utf8Content.split(/\s+/);
    
    return { lines, words, content: utf8Content };
  } catch (err) {
    console.error('Error reading file:', err);
    return null;
  }
}

Option 2: Using a Library for Automatic Encoding Handling

If you’re unsure of the file’s encoding, use the iconv-lite library to handle conversion reliably:

1. Install the library first:

npm install iconv-lite

2. Update your function:

// myFileReader.js
const iconv = require('iconv-lite');
const fs = require('fs');

function readTextFile(file) {
  try {
    const fileBuffer = fs.readFileSync(file);
    // Replace 'win1252' with your file's encoding (or test common ones if unsure)
    const utf8Content = iconv.decode(fileBuffer, 'win1252');
    
    const lines = utf8Content.split('\n');
    const words = utf8Content.split(/\s+/);
    
    return { lines, words, content: utf8Content };
  } catch (err) {
    console.error('Error reading file:', err);
    return null;
  }
}

Key Notes #

• Always match the encoding parameter to your file’s actual encoding—this is the critical step.
• UTF-8 is the standard for modern web apps, so converting to UTF-8 after reading ensures consistent handling across your code.

内容的提问来源于stack exchange，提问作者Yone