The token module, shown in Example 13-21, contains a list of all tokens used by the standard Python tokenizer.
token
Example 13-21. Using the token Module
File: token-example-1.py import token print "NUMBER", token.NUMBER print "PLUS", token.STAR print "STRING", token.STRING NUMBER 2 PLUS 16 STRING 3
NUMBER 2
PLUS 16
STRING 3
3.142.199.181