Skip to content

chore: refresh DB dump — feat: link page numbers to the paper dictionaries' scans on archive.org (arabterm#65) - #121

Merged
forzagreen merged 1 commit into
mainfrom
auto/update-dump-92c14530ed361bf5b076ff7c5822bb9b14866b29
Oct 16, 2026
Merged

forzagreen merged 1 commit into
mainfrom
auto/update-dump-92c14530ed361bf5b076ff7c5822bb9b14866b29

Conversation

@forzagreen

Copy link
Copy Markdown
Owner

Auto-generated from a data change in forzagreen/arabterm, commit 92c1453:

feat: link page numbers to the paper dictionaries' scans on archive.org (forzagreen/arabterm#65)

Add two columns to dictionary, so that a term's printed page can link to
that page of the dictionary's scan:

  • archive_org_url: the archive.org scan, from Wikidata's "full work
    available at URL" (P953); set for the 45 dictionaries that have one
  • page_offset: printed page p is page p + page_offset of the file
    (Wikidata's "file page offset", P8330); the link is
    <archive_org_url>/page/n<p + page_offset - 1>/mode/1up, as the Cite Q
    module of ar.wikipedia builds it

Every offset was checked against the scan's OCR: each term votes for the
scan page whose text contains its English form. The 30 offsets already on
Wikidata all agree; the 10 that were missing were inferred this way and
added to Wikidata. 40 of the 46 dictionaries with page numbers now link
their pages; the 6 others have no archive.org scan.

Renumber medical_terms_2 (-238) and medical_terms_3 (-552) to their printed
pages: arabterm numbered the three volumes continuously, the printed
volumes each start at page 1 (so the ص= of their citations was wrong too).

make validate checks the new columns, and the website links its page
numbers and each dictionary's scan.

Data changes

  • Dictionaries: 89 (unchanged)
  • Terms: 613280 (unchanged)

Terms changed in existing dictionaries

Dictionary Added Removed Modified
medical_terms_2 0 0 4357
medical_terms_3 0 0 3078

Modified columns: page (7435)

Terms modified (7435)
  • term 449068 (medical_terms_2)
    • page: 252 → 14
  • term 452975 (medical_terms_2)
    • page: 243 → 5
  • term 452976 (medical_terms_2)
    • page: 248 → 10
  • term 452977 (medical_terms_2)
    • page: 278 → 40
  • term 452978 (medical_terms_2)
    • page: 239 → 1
  • term 452979 (medical_terms_2)
    • page: 239 → 1
  • term 452980 (medical_terms_2)
    • page: 239 → 1
  • term 452981 (medical_terms_2)
    • page: 239 → 1
  • term 452982 (medical_terms_2)
    • page: 239 → 1
  • term 452983 (medical_terms_2)
    • page: 239 → 1
  • term 452984 (medical_terms_2)
    • page: 240 → 2
  • term 452985 (medical_terms_2)
    • page: 239 → 1
  • term 452986 (medical_terms_2)
    • page: 239 → 1
  • term 452987 (medical_terms_2)
    • page: 239 → 1
  • term 452988 (medical_terms_2)
    • page: 239 → 1
  • term 452989 (medical_terms_2)
    • page: 239 → 1
  • term 452990 (medical_terms_2)
    • page: 239 → 1
  • term 452991 (medical_terms_2)
    • page: 239 → 1
  • term 452992 (medical_terms_2)
    • page: 240 → 2
  • term 452993 (medical_terms_2)
    • page: 240 → 2
  • … and 7415 more

Schema

  • column dictionary.archive_org_url added
  • column dictionary.page_offset added

Ran make download_dump && make fix_dump against arabterm main: 7586 lines added to the SQL dump, 7582 removed. db/arabterm.sql.gz is gzipped, so GitHub shows no diff of it; merge to trigger the production DB import.

@forzagreen
forzagreen merged commit b3f8ff5 into main Oct 16, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant