The Header classes and Payload classes should be better in sync, potentially also with signature functionality, and have a clearer hierarchy. It's hard to tell the difference between header's various types and payload's various types.

A better class hierarchy should help answer the question of where various payload and header functionality should live.

Also, everything under an "impl" file is difficult to comprehend.