Skip to content

Remove duplicate articles due to multiple authors #10

Description

@ArtPoon
  • Some articles have two or more authors from the same faculty or department.
  • This is causing columns representing the same document to appear more than once in the term-document matrix
  • We should screen for this by removing duplicate columns (it is exceedingly unlikely that two documents will have exactly the same frequency distribution of words out of 10,000 words by chance)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions