Reuse part of a Regex pattern
Question:
Consider this (very simplified) example string:
1aw2,5cx7
As you can see, it is two digit/letter/letter/digit values separated by a comma.
Now, I could match this with the following:
>>> from re import match
>>> match("dwwd,dwwd", "1aw2,5cx7")
<_sre.SRE_Match object at 0x01749D40>
>>>
The problem is though, I have to write dwwd twice. With small patterns, this isn’t so bad but, with more complex Regexes, writing the exact same thing twice makes the end pattern enormous and cumbersome to work with. It also seems redundant.
I tried using a named capture group:
>>> from re import match
>>> match("(?P<id>dwwd),(?P=id)", "1aw2,5cx7")
>>>
But it didn’t work because it was looking for two occurrences of 1aw2, not digit/letter/letter/digit.
Is there any way to save part of a pattern, such as dwwd, so it can be used latter on in the same pattern? In other words, can I reuse a sub-pattern in a pattern?
Answers:
No, when using the standard library re module, regular expression patterns cannot be ‘symbolized’.
You can always do so by re-using Python variables, of course:
digit_letter_letter_digit = r'dwwd'
then use string formatting to build the larger pattern:
match(r"{0},{0}".format(digit_letter_letter_digit), inputtext)
or, using Python 3.6+ f-strings:
dlld = r'dwwd'
match(fr"{dlld},{dlld}", inputtext)
I often do use this technique to compose larger, more complex patterns from re-usable sub-patterns.
If you are prepared to install an external library, then the regex project can solve this problem with a regex subroutine call. The syntax (?<digit>) re-uses the pattern of an already used (implicitly numbered) capturing group:
(dwwd),(?1)
^........^ ^..^
|
| re-use pattern of capturing group 1
capturing group 1
You can do the same with named capturing groups, where (?<groupname>...) is the named group groupname, and (?&groupname), (?P&groupname) or (?P>groupname) re-use the pattern matched by groupname (the latter two forms are alternatives for compatibility with other engines).
And finally, regex supports the (?(DEFINE)...) block to ‘define’ subroutine patterns without them actually matching anything at that stage. You can put multiple (..) and (?<name>...) capturing groups in that construct to then later refer to them in the actual pattern:
(?(DEFINE)(?<dlld>dwwd))(?&dlld),(?&dlld)
^...............^ ^......^ ^......^
| /
creates 'dlld' pattern uses 'dlld' pattern twice
Just to be explicit: the standard library re module does not support subroutine patterns.
Try using back referencing, i believe it works something like below to match
1aw2,5cx7
You could use
(dwwd),1
See here for reference http://www.regular-expressions.info/backref.html
Note: this will work with PyPi regex module, not with re module.
You could use the notation (?group-number), in your case:
(dwwd),(?1)
it is equivalent to:
(dwwd),(dwwd)
Be aware that w includes d. The regex will be:
(d[a-zA-Z]{2}d),(?1)
I was troubled with the same problem and wrote this snippet
import nre
my_regex=nre.from_string('''
a=dwwd
b={{a}},{{a}}
c=?P<id>{{a}}),(?P=id)
''')
my_regex["b"].match("1aw2,5cx7")
For lack of a more descriptive name, I named the partial regexes as a,b and c.
Accessing them is as easy as {{a}}
import re
digit_letter_letter_digit = re.compile("dwwd") # we compile pattern so that we can reuse it later
all_finds = re.findall(digit_letter_letter_digit, "1aw2,5cx7") # finditer instead of findall
for value in all_finds:
print(re.match(digit_letter_letter_digit, value))
Since you’re already using re, why not use string processing to manage the pattern repetition as well:
pattern = "P,P".replace("P",r"dwwd")
re.match(pattern, "1aw2,5cx7")
OR
P = r"dwwd"
re.match(f"{P},{P}", "1aw2,5cx7")
Consider this (very simplified) example string:
1aw2,5cx7
As you can see, it is two digit/letter/letter/digit values separated by a comma.
Now, I could match this with the following:
>>> from re import match
>>> match("dwwd,dwwd", "1aw2,5cx7")
<_sre.SRE_Match object at 0x01749D40>
>>>
The problem is though, I have to write dwwd twice. With small patterns, this isn’t so bad but, with more complex Regexes, writing the exact same thing twice makes the end pattern enormous and cumbersome to work with. It also seems redundant.
I tried using a named capture group:
>>> from re import match
>>> match("(?P<id>dwwd),(?P=id)", "1aw2,5cx7")
>>>
But it didn’t work because it was looking for two occurrences of 1aw2, not digit/letter/letter/digit.
Is there any way to save part of a pattern, such as dwwd, so it can be used latter on in the same pattern? In other words, can I reuse a sub-pattern in a pattern?
No, when using the standard library re module, regular expression patterns cannot be ‘symbolized’.
You can always do so by re-using Python variables, of course:
digit_letter_letter_digit = r'dwwd'
then use string formatting to build the larger pattern:
match(r"{0},{0}".format(digit_letter_letter_digit), inputtext)
or, using Python 3.6+ f-strings:
dlld = r'dwwd'
match(fr"{dlld},{dlld}", inputtext)
I often do use this technique to compose larger, more complex patterns from re-usable sub-patterns.
If you are prepared to install an external library, then the regex project can solve this problem with a regex subroutine call. The syntax (?<digit>) re-uses the pattern of an already used (implicitly numbered) capturing group:
(dwwd),(?1)
^........^ ^..^
|
| re-use pattern of capturing group 1
capturing group 1
You can do the same with named capturing groups, where (?<groupname>...) is the named group groupname, and (?&groupname), (?P&groupname) or (?P>groupname) re-use the pattern matched by groupname (the latter two forms are alternatives for compatibility with other engines).
And finally, regex supports the (?(DEFINE)...) block to ‘define’ subroutine patterns without them actually matching anything at that stage. You can put multiple (..) and (?<name>...) capturing groups in that construct to then later refer to them in the actual pattern:
(?(DEFINE)(?<dlld>dwwd))(?&dlld),(?&dlld)
^...............^ ^......^ ^......^
| /
creates 'dlld' pattern uses 'dlld' pattern twice
Just to be explicit: the standard library re module does not support subroutine patterns.
Try using back referencing, i believe it works something like below to match
1aw2,5cx7
You could use
(dwwd),1
See here for reference http://www.regular-expressions.info/backref.html
Note: this will work with PyPi regex module, not with re module.
You could use the notation (?group-number), in your case:
(dwwd),(?1)
it is equivalent to:
(dwwd),(dwwd)
Be aware that w includes d. The regex will be:
(d[a-zA-Z]{2}d),(?1)
I was troubled with the same problem and wrote this snippet
import nre
my_regex=nre.from_string('''
a=dwwd
b={{a}},{{a}}
c=?P<id>{{a}}),(?P=id)
''')
my_regex["b"].match("1aw2,5cx7")
For lack of a more descriptive name, I named the partial regexes as a,b and c.
Accessing them is as easy as {{a}}
import re
digit_letter_letter_digit = re.compile("dwwd") # we compile pattern so that we can reuse it later
all_finds = re.findall(digit_letter_letter_digit, "1aw2,5cx7") # finditer instead of findall
for value in all_finds:
print(re.match(digit_letter_letter_digit, value))
Since you’re already using re, why not use string processing to manage the pattern repetition as well:
pattern = "P,P".replace("P",r"dwwd")
re.match(pattern, "1aw2,5cx7")
OR
P = r"dwwd"
re.match(f"{P},{P}", "1aw2,5cx7")