Macro argument quoting does not prevent recognition of punctuation

and of called macros.

This bug affects almost all macros, and fixing it simplifies the
code.  It is amazing that the bogus ARGS_QWORD feature got implemented
in the first place, and then carrier along for more than eight years
without anybody ever noticing that it was pointless.

Reported by Leah Neukirchen <leah at vuxu dot org>, found on Void Linux.

4 files changed, 101 insertions, 1 deletions

diff --git a/regress/mdoc/Ic/Makefile b/regress/mdoc/Ic/Makefile
index 1be2a84a..33faa380 100644
--- a/regress/mdoc/Ic/Makefile
+++ b/regress/mdoc/Ic/Makefile
@@ -1,6 +1,6 @@
 # $OpenBSD: Makefile,v 1.4 2014/07/02 20:18:42 schwarze Exp $
 
-REGRESS_TARGETS = noarg font
+REGRESS_TARGETS = font noarg punct
 LINT_TARGETS	= noarg
 
 .include <bsd.regress.mk>
diff --git a/regress/mdoc/Ic/punct.in b/regress/mdoc/Ic/punct.in
new file mode 100644
index 00000000..a62058b6
--- /dev/null
+++ b/regress/mdoc/Ic/punct.in
@@ -0,0 +1,42 @@
+.Dd August 21, 2014
+.Dt Ic-PUNCT 1
+.Os OpenBSD
+.Sh NAME
+.Nm Ic-punct
+.Nd punctuation handling by the Ic macro
+.Sh DESCRIPTION
+closing punctuation
+.Ic a )
+only one
+.Ic )
+only more than one
+.Ic ) )
+middle
+.Ic a ) z
+start
+.Ic ) z
+dot
+.Ic . z
+comma
+.Ic , z
+semicolon
+.Ic ; z
+colon
+.Ic : z
+quest
+.Ic ? z
+excl
+.Ic ! z
+paren
+.Ic ) z
+bracket
+.Ic ] z
+bar
+.Ic | m
+op paren
+.Ic ( a
+op bracket
+.Ic [ a
+.Pp
+quoted punctuation:
+.Ic a "(" b "|" c ")" d "," "Em" italic .
diff --git a/regress/mdoc/Ic/punct.out_ascii b/regress/mdoc/Ic/punct.out_ascii
new file mode 100644
index 00000000..4c370483
--- /dev/null
+++ b/regress/mdoc/Ic/punct.out_ascii
@@ -0,0 +1,13 @@
+Ic-PUNCT(1)                 General Commands Manual                Ic-PUNCT(1)
+
+NNAAMMEE
+     IIcc--ppuunncctt - punctuation handling by the Ic macro
+
+DDEESSCCRRIIPPTTIIOONN
+     closing punctuation aa) only one ) only more than one )) middle aa) zz start
+     ) zz dot . zz comma , zz semicolon ; zz colon : zz quest ? zz excl ! zz paren )
+     zz bracket ] zz bar | mm op paren (aa op bracket [aa
+
+     quoted punctuation: aa (bb | cc) dd, _i_t_a_l_i_c.
+
+OpenBSD                         August 21, 2014                        OpenBSD
diff --git a/regress/mdoc/Ic/punct.out_markdown b/regress/mdoc/Ic/punct.out_markdown
new file mode 100644
index 00000000..7fd2742f
--- /dev/null
+++ b/regress/mdoc/Ic/punct.out_markdown
@@ -0,0 +1,45 @@
+Ic-PUNCT(1) - General Commands Manual
+
+# NAME
+
+**Ic-punct** - punctuation handling by the Ic macro
+
+# DESCRIPTION
+
+closing punctuation
+**a**)
+only one
+)
+only more than one
+))
+middle
+**a**) **z**
+start
+) **z**
+dot
+. **z**
+comma
+, **z**
+semicolon
+; **z**
+colon
+: **z**
+quest
+? **z**
+excl
+! **z**
+paren
+) **z**
+bracket
+] **z**
+bar
+| **m**
+op paren
+(**a**
+op bracket
+\[**a**
+
+quoted punctuation:
+**a** (**b** | **c**) **d**, *italic*.
+
+OpenBSD - August 21, 2014