Zlib相关Python代码转Java时解压失败问题求助

问题背景 #

将一段Python的Base10编码转zlib解压的代码转为Java后，执行出现Decompression failed: invalid block type错误，但测试数据在Python中可正常运行。

Python原代码 #

def _convert_base10encoded_to_decompressed_array(base10encodedstring) -> None:
        bytes_array = base10encodedstring.to_bytes(5000, 'big').lstrip(b'\x00')
        self.decompressed_array = zlib.decompress(bytes_array, 16+zlib.MAX_WBITS)

待修复的Java代码 #

public void convertBase10EncodedToDecompressedArray(String base10encodedstring) throws Exception {
        // Step 1: Convert base10encodedString to a BigInteger
        BigInteger bigIntValue = new BigInteger(this.base10encodedstring);

        // Step 2: Convert BigInteger to a byte array in big-endian order
        byte[] bigIntBytes = bigIntValue.toByteArray();
        byte[] bytesArray = new byte[5000]; // Create a 5000-byte array (zero-initialized)

        // Copy the BigInteger's byte array to the end of the 5000-byte array to mimic Python's behavior
        int copyStart = 5000 - bigIntBytes.length;
        System.arraycopy(bigIntBytes, 0, bytesArray, copyStart, bigIntBytes.length);

        // Step 3: Remove leading zeros to mimic Python's lstrip(b'\x00')
        int nonZeroIndex = 0;
        while (nonZeroIndex < bytesArray.length && bytesArray[nonZeroIndex] == 0) {
            nonZeroIndex++;
        }
        byte[] trimmedBytesArray = new byte[bytesArray.length - nonZeroIndex];
        System.arraycopy(bytesArray, nonZeroIndex, trimmedBytesArray, 0, trimmedBytesArray.length);

        // Step 4: Decompress the byte array using Inflater with a header flag
        Inflater inflater = new Inflater(true); // `true` for handling zlib/gzip headers
        inflater.setInput(trimmedBytesArray);

        // Prepare output buffer for decompressed data
        byte[] output = new byte[10000]; // Adjust size as needed for decompression
        int decompressedDataLength;

        try {
            decompressedDataLength = inflater.inflate(output);
            inflater.end();
        } catch (DataFormatException e) {
            throw new Exception("Decompression failed: " + e.getMessage(), e);
        }

        // Store the decompressed data in decompressedArray
        decompressedArray = new byte[decompressedDataLength];
        System.arraycopy(output, 0, decompressedArray, 0, decompressedDataLength);
    }

错误信息 #

Decompression failed: invalid block type
java.lang.Exception: Decompression failed: invalid block type

测试数据 #

119042439702058329181580366339137026727847632133400914982925157100269769134885477532825542376007928853630543405886877144858046550370019093958674847428579819304849334337536

测试数据生成逻辑（Python） #

sample_data = b"This is a sample data for testing zlib decompression."

# Compress the data using gzip
buf = io.BytesIO()
with gzip.GzipFile(fileobj=buf, mode='wb') as f:
    f.write(sample_data)

compressed_data = buf.getvalue()

# Convert the compressed data to a base-10 integer
compressed_int = int.from_bytes(compressed_data, 'big')

问题根源与修复方案 #

1. 核心问题点 #

• BigInteger字节数组处理错误：Java的BigInteger.toByteArray()会自动补高位符号位0，导致还原的字节数组比Python生成的多一个无效字节，破坏了gzip格式结构。
• 解压工具类选型错误：Python中zlib.decompress(16+zlib.MAX_WBITS)对应gzip格式解压，而Java的Inflater(true)是处理无头部的raw deflate数据，两者逻辑不匹配。

2. 修复后的Java代码 #

import java.io.ByteArrayInputStream;
import java.io.ByteArrayOutputStream;
import java.io.IOException;
import java.math.BigInteger;
import java.util.zip.GZIPInputStream;

public class DecompressionHandler {
    private byte[] decompressedArray;

    public void convertBase10EncodedToDecompressedArray(String base10encodedstring) throws Exception {
        // 1. 转BigInteger
        BigInteger bigIntValue = new BigInteger(base10encodedstring);
        byte[] bigIntBytes = bigIntValue.toByteArray();

        // 2. 移除BigInteger自动添加的符号位0
        byte[] rawCompressedBytes;
        if (bigIntBytes.length > 1 && bigIntBytes[0] == 0) {
            rawCompressedBytes = new byte[bigIntBytes.length - 1];
            System.arraycopy(bigIntBytes, 1, rawCompressedBytes, 0, rawCompressedBytes.length);
        } else {
            rawCompressedBytes = bigIntBytes;
        }

        // 3. 用GZIPInputStream解压，匹配Python的gzip格式解压逻辑
        try (ByteArrayInputStream bais = new ByteArrayInputStream(rawCompressedBytes);
             GZIPInputStream gzipIn = new GZIPInputStream(bais);
             ByteArrayOutputStream baos = new ByteArrayOutputStream()) {

            byte[] buffer = new byte[1024];
            int len;
            while ((len = gzipIn.read(buffer)) != -1) {
                baos.write(buffer, 0, len);
            }
            decompressedArray = baos.toByteArray();
        } catch (IOException e) {
            throw new Exception("Decompression failed: " + e.getMessage(), e);
        }
    }

    // 测试方法
    public static void main(String[] args) throws Exception {
        DecompressionHandler handler = new DecompressionHandler();
        String testData = "119042439702058329181580366339137026727847632133400914982925157100269769134885477532825542376007928853630543405886877144858046550370019093958674847428579819304849334337536";
        handler.convertBase10EncodedToDecompressedArray(testData);
        System.out.println(new String(handler.decompressedArray));
        // 输出：This is a sample data for testing zlib decompression.
    }
}

3. 修复说明 #

• 简化了字节数组处理：Python中to_bytes(5000, 'big').lstrip(b'\x00')等价于直接还原原始压缩字节，无需构造5000字节数组，只需移除BigInteger额外添加的符号位0即可。
• 替换解压工具：用GZIPInputStream完全匹配Python的gzip格式解压逻辑，避免了Inflater参数错误的问题。
• 优化流程：减少不必要的数组复制，提升代码效率与可读性。

内容的提问来源于stack exchange，提问作者cdczc