Automation and scraping · Independent · 26 Oct 2026

dell-research-harvard/linktransformer

A convenient way to link, deduplicate, aggregate and cluster data(frames) in Python using deep learning

← Automation and scraping
LinkTransformer: semantic data linking. Matches and cleans messy rows across spreadsheets using AI models.
Verified26 Oct 2026

Radar check

What we found when we opened it. Every bar is one fact, with its date.

Alive90

Last code pushed 15 Oct 2026, 10 days before this check.

Releases—

No releases published on GitHub; the code date above is the one to trust.

Maturity70

Public since August 2023, a little over 3 years.

Adoption43

147 stars and 16 forks.

Activity25

1 commits and 0 new issues in the last 90 days.

Community40

5 contributors. 1 pull requests merged in 90 days. A small team carries it.

Security40

No security policy file says how to report a problem. No published security advisories.

Licence GPL-3.0: free to use; software you hand out that includes it must be GPL tooSetup effort 2 of 5Payoff 4 of 5
How the bars are scored
  • Alive. Days since the last code push: a week or less 100, a month 90, three months 70, six months 50, a year 30, eighteen months 15, older 0.
  • Releases. Age of the latest GitHub release, on a similar scale; no bar when the project publishes no releases.
  • Maturity. Age of the project: eight years 100, five 90, three 70, two 55, one 40, six months 25, younger 10.
  • Adoption. Stars on a log scale: 100,000 stars is 100, 10,000 is 80, 1,000 is 60, 100 is 40.
  • Activity. Commits in the last 90 days: 300 or more 100, 100 85, 30 65, 10 45, any 25.
  • Community. People who have contributed: 100 or more 100, 30 80, 10 60, 5 40, 2 25, one 10.
  • Security. A published security policy 80, none 40; published advisories are listed, not scored.

Checked by Repo Radar on 26 Oct 2026 from the repository on GitHub.

In simple English

Data from different spreadsheets often has spelling mistakes or slight differences. Fixing these errors by hand takes hours of tedious work. This tool matches similar rows and cleans up text automatically using artificial intelligence. You write simple Python commands to run the process on your computer. It needs some basic programming knowledge to set up and use.

What it is

LinkTransformer is an open-source Python package for record linkage, data deduplication, and row classification using deep learning models. It connects tabular datasets by comparing text semantics rather than exact spelling.

What it is good for

Solo builders and researchers who need to merge messy customer lists, product catalogs, or survey results from different sources without writing complex matching rules.

Stars147
LicenceGPL-3.0
LatestNo tagged releasechecked 26 Oct 2026
Last code change2026-10-15
Written inPython
Setup effort
2 / 5
Payoff
4 / 5
Good
  • Matches rows even when spelling differs.
  • Combines local models and cloud APIs.
  • Supports deduplication and text classification.
Watch for
  • Requires writing Python code to run.
  • Needs an internet connection or a fast computer for large models.
  • GPL-3.0 licence may restrict how you share modified versions.
Replaces

manual spreadsheet matching and fuzzy lookup scripts

Works well with

pandas

Similar repositories
  • cleanlab/cleanlab12k stars

    Finds label errors and data issues in datasets using machine learning.

Also reviewed on Repo Radar
  • Athou/commafeed3.6k stars

    A feed reader you run yourself, which collects new articles from the sites you follow.

  • apache/airflow47k stars

    Runs chains of scheduled jobs written in Python, and keeps a record of every run.

  • cybertec-postgresql/pg_timetable1.4k stars

    A job scheduler for PostgreSQL whose jobs and schedules live in the database itself.

Install
source venv/bin/activate
pip install linktransformer
Screenshots and video

Independent: reviewed for Repo Radar outside the daily editions. Every independent repository

On Stack Radar: Data & Research › Data Enrichment & Collection › Data Cleaning & Deduplication.

Get the next edition in your inbox

A dozen repositories, opened and checked. The licence read, the last release dated, and the ones that did not make it named with the reason. It is the half most lists leave out.

No tracking pixels. One click to leave. The archive stays free either way.

We use your address to send the edition and nothing else. Confirm by email, leave in one click. How we handle it.