Accept a commented line at end of document

marijnh · marijnh · commit 7606e067d67a · 2024-06-25T18:13:54.000+02:00
FIX: Fix an issue where a commented line at the end of the input would emit an error node. Closes lezer-parser#25
diff --git a/src/python.grammar b/src/python.grammar
@@ -270,7 +270,7 @@ skw<term> { @extend[@name={term}]<identifier, term> }
   formatStringSpec { FormatSpec { ":" (formatStringSpecChars | nestedFormatReplacement)* } "}" }
 
   blankLine {
-    blankLineStart space? Comment? newline
+    blankLineStart space? Comment? (newline | eof)
   }
 }
 
diff --git a/test/statement.txt b/test/statement.txt
@@ -261,6 +261,16 @@ Script(
     ExpressionStatement(VariableName))),
   ExpressionStatement(VariableName))
 
+# Script ending in a comment
+
+x = 1
+
+# End
+
+==>
+
+Script(AssignStatement(VariableName,AssignOp,Number),Comment)
+
 # Escaped newlines
 
 x = 1 + \

Original file line number	Diff line number	Diff line change
`@@ -270,7 +270,7 @@ skw<term> { @extend[@name={term}]<identifier, term> }`
`270`	`270`	`formatStringSpec { FormatSpec { ":" (formatStringSpecChars \| nestedFormatReplacement)* } "}" }`
`271`	`271`
`272`	`272`	`blankLine {`
`273`		`- blankLineStart space? Comment? newline`
	`273`	`+ blankLineStart space? Comment? (newline \| eof)`
`274`	`274`	`}`
`275`	`275`	`}`
`276`	`276`