The upper right of the following page has a block labelled "How to Format". What's the formal name for this element in GUI design?
I would call it an Inline Help Box which can take many forms and shapes. Take a look at UI Patterns: Inline Help Box, where they explain the following:
...which is exactly what "How to format" in your screenshot is meant to do.