Refactor Trainer and pretokenization interface by taku910 · Pull Request #1287 · google/sentencepiece

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

@taku910

The following contributors were found for this pull request:

✅ 28d5b00 Author: @taku910 <t**u@google.com>

(Only the first commit for a unique contributor is listed.)