The following ISO Latin 1 characters can be classified as punctuation characters:
For some typographic notes on punctuation characters, see Microsoft's Character design standards - Math symbols for Latin 1.
Punctuation rules vary from one language to another. Even within a language, there might be differences in the recommended rules, depending on style and authority. For the English language, the following resources contain well thought-of recommendations:
As regards to some other languages:
The parentheses, brackets and braces, i.e. characters ()[]{}, are classified as "paired punctuation" characters in Unicode. This means that the characters ([{ are regarded as defined logically, as opening punctuation, and the characters )]} correspondingly closing. Thus, although e.g. the name of "(" is "left parenthesis", it is really by definition "opening parenthesis".
This means that if the writing direction is from right to left, as in Hebrew and Arabic, the mirror images of the "normal" glyphs of these characters are used. Thus, a "left parenthesis", "(", would appear as mirrored so that it looks like what we are used to regarding as right parenthess, ")".