Add token masking and cg fixes

Ekaterina Nikonovarequested to merge
fix/masked_nxt_token into main
  • Add token masking
  • Fix generation using trainer
  • Add random text sampling

Merge request reports