TokenizerOutput constructor

const TokenizerOutput({
  1. required Int64List inputIds,
  2. required Int64List attentionMask,
  3. required Int64List tokenTypeIds,
  4. required bool truncated,
})

Creates a TokenizerOutput.

Implementation

const TokenizerOutput({
  required this.inputIds,
  required this.attentionMask,
  required this.tokenTypeIds,
  required this.truncated,
});