Python注释识别状态机开发报错：TypeError解包NoneType失败

Root Cause of the TypeError #

The error TypeError: cannot unpack non-iterable NoneType object occurs because the comments method in commentSM only returns a tuple when the current state is ''. For any other state, it returns nothing (implicitly None), which can't be unpacked into (s,o) in the sit method.

Key Issues in the Original Code #

• Incomplete state handling: The state machine doesn't manage transitions between "non-comment" and "comment" modes, nor does it process characters once in comment mode.
• Broken showcom function: This function is passed single characters (not lists) when called, and its logic doesn't correctly identify comment characters. It's unnecessary for the intended functionality.
• Unclear state labels: Using '' as the start state makes the code hard to read; explicit labels like 'normal' are better.

Corrected Code #

class SM:
    def start(self):
        self.state = self.startState
    def sit(self, inp):
        (s, o) = self.comments(inp, self.state)
        self.state = s
        return o
    def transduce(self, input):
        self.start()
        return [self.sit(inp) for inp in input]

class CommentSM(SM):
    startState = 'normal'  # Initial state: not in a comment

    def comments(self, input_char, state):
        if state == 'normal':
            if input_char == '#':
                # Enter comment state, output '#' as part of the comment
                return ('comment', input_char)
            else:
                # Stay in normal state, output None
                return ('normal', None)
        elif state == 'comment':
            if input_char == '\n':
                # Exit comment state at newline, output None (newline isn't part of the comment)
                return ('normal', None)
            else:
                # Stay in comment state, output the current character
                return ('comment', input_char)

# Test the implementation
input_str = '''print(hello)  # comment\nanother line # another comment'''
m = CommentSM()
result = m.transduce(input_str)

# Display results alongside original characters
for char, output in zip(input_str, result):
    print(f"Char: '{char}' | Output: {output}")

Explanation of Corrected Code #

• State transitions: The machine starts in 'normal' state. When it hits '#', it switches to 'comment' mode and outputs the '#'. While in comment mode, it outputs every character until a newline is encountered, at which point it switches back to 'normal' and outputs None.
• Simplified code: The redundant split function is removed since Python strings are iterable directly.
• Clear logic: Explicit state labels and straightforward transitions make the code easy to follow and maintain.

内容的提问来源于stack exchange，提问作者ramanujans alkhazarim