Skip to content
This repository was archived by the owner on Apr 19, 2026. It is now read-only.
This repository was archived by the owner on Apr 19, 2026. It is now read-only.

Can I interpret the positive examples in PAWS as exact paraphrase? #16

Description

@Punchwes

Hi,

Thanks very much for your work, these datasets are great for evaluation. Given many positive examples in datasets like MRPC and TwitterURL are quasi-paraphrases (similar but not the same meaning), can I interpret positive examples in PAWS are all exact paraphrases? The way (word swapping and back-translation) you use to create positive examples seems like that to me .

Activity

  1. tvrbanec commented on Jul 31, 2023

    @tvrbanec

    Just looking at sentence pairs and their labels makes me believe that one cannot rely on PAWS corpora for a thing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions