{"author":"Koichi Yasuoka","author_email":"yasuoka@kanji.zinbun.kyoto-u.ac.jp","bugtrack_url":null,"classifiers":["License :: OSI Approved :: MIT License","Natural Language :: Chinese (Simplified)","Natural Language :: Chinese (Traditional)","Natural Language :: English","Natural Language :: German","Natural Language :: Japanese","Natural Language :: Korean","Natural Language :: Serbian","Natural Language :: Thai","Natural Language :: Vietnamese","Operating System :: OS Independent","Programming Language :: Python :: 3","Topic :: Text Processing :: Linguistic"],"description":"[![Current PyPI packages](https://badge.fury.io/py/esupar.svg)](https://pypi.org/project/esupar/)\n\n# esupar\n\nTokenizer, POS-tagger, and dependency-parser with [Transformers](https://huggingface.co/transformers/) and [SuPar](https://pypi.org/project/supar/).\n\n## Basic usage\n\n```py\n>>> import esupar\n>>> nlp=esupar.load(\"ja\")\n>>> doc=nlp(\"太郎は花子が読んでいる本を次郎に渡した\")\n>>> print(doc)\n1\t太郎\t_\tPROPN\t_\t_\t12\tnsubj\t_\tSpaceAfter=No\n2\tは\t_\tADP\t_\t_\t1\tcase\t_\tSpaceAfter=No\n3\t花子\t_\tPROPN\t_\t_\t5\tnsubj\t_\tSpaceAfter=No\n4\tが\t_\tADP\t_\t_\t3\tcase\t_\tSpaceAfter=No\n5\t読ん\t_\tVERB\t_\t_\t8\tacl\t_\tSpaceAfter=No\n6\tで\t_\tSCONJ\t_\t_\t5\tmark\t_\tSpaceAfter=No\n7\tいる\t_\tAUX\t_\t_\t5\taux\t_\tSpaceAfter=No\n8\t本\t_\tNOUN\t_\t_\t12\tobj\t_\tSpaceAfter=No\n9\tを\t_\tADP\t_\t_\t8\tcase\t_\tSpaceAfter=No\n10\t次郎\t_\tPROPN\t_\t_\t12\tobl\t_\tSpaceAfter=No\n11\tに\t_\tADP\t_\t_\t10\tcase\t_\tSpaceAfter=No\n12\t渡し\t_\tVERB\t_\t_\t0\troot\t_\tSpaceAfter=No\n13\tた\t_\tAUX\t_\t_\t12\taux\t_\t_\n\n>>> import deplacy\n>>> deplacy.render(doc,Japanese=True)\n太郎 PROPN ═╗<════════╗ nsubj(主語)\nは ADP <╝ ║ case(格表示)\n花子 PROPN ═╗<══╗ ║ nsubj(主語)\nが ADP <╝ ║ ║ case(格表示)\n読ん VERB ═╗═╗═╝<╗ ║ acl(連体修飾節)\nで SCONJ <╝ ║ ║ ║ mark(標識)\nいる AUX <══╝ ║ ║ aux(動詞補助成分)\n本 NOUN ═╗═════╝<╗ ║ obj(目的語)\nを ADP <╝ ║ ║ case(格表示)\n次郎 PROPN ═╗<╗ ║ ║ obl(斜格補語)\nに ADP <╝ ║ ║ ║ case(格表示)\n渡し VERB ═╗═╝═════╝═╝ root(親)\nた AUX <╝ aux(動詞補助成分)\n```\n\n`esupar.load(model)` loads a natural language processor pipeline, working on [Universal Dependencies](https://universaldependencies.org/format.html). Available `model` options are:\n\n* `model=\"ja\"` Japanese model [bert-base-japanese-upos](https://huggingface.co/KoichiYasuoka/bert-base-japanese-upos) (default)\n* `model=\"ja_large\"` Japanese model [bert-large-japanese-upos](https://huggingface.co/KoichiYasuoka/bert-large-japanese-upos)\n* `model=\"ja_luw_small\"` Japanese long-unit-word model [roberta-small-japanese-char-luw-upos](https://huggingface.co/KoichiYasuoka/roberta-small-japanese-char-luw-upos)\n* `model=\"ja_luw_base\"` Japanese long-unit-word model [bert-base-japanese-luw-upos](https://huggingface.co/KoichiYasuoka/bert-base-japanese-luw-upos)\n* `model=\"ja_luw_large\"` Japanese long-unit-word model [bert-large-japanese-luw-upos](https://huggingface.co/KoichiYasuoka/bert-large-japanese-luw-upos)\n* `model=\"ko\"` Korean model [roberta-base-korean-upos](https://huggingface.co/KoichiYasuoka/roberta-base-korean-upos)\n* `model=\"ko_large\"` Korean model [roberta-large-korean-upos](https://huggingface.co/KoichiYasuoka/roberta-large-korean-upos)\n* `model=\"ko_morph_base\"` Korean morpheme model [roberta-base-korean-morph-upos](https://huggingface.co/KoichiYasuoka/roberta-base-korean-morph-upos)\n* `model=\"ko_morph_large\"` Korean morpheme model [roberta-large-korean-morph-upos](https://huggingface.co/KoichiYasuoka/roberta-large-korean-morph-upos)\n* `model=\"zh\"` Chinese model [chinese-bert-wwm-ext-upos](https://huggingface.co/KoichiYasuoka/chinese-bert-wwm-ext-upos)\n* `model=\"zh_base\"` Chinese model [chinese-roberta-base-upos](https://huggingface.co/KoichiYasuoka/chinese-roberta-base-upos)\n* `model=\"zh_large\"` Chinese model [chinese-roberta-large-upos](https://huggingface.co/KoichiYasuoka/chinese-roberta-large-upos)\n* `model=\"lzh\"` Classical Chinese model [roberta-classical-chinese-base-upos](https://huggingface.co/KoichiYasuoka/roberta-classical-chinese-base-upos)\n* `model=\"lzh_large\"` Classical Chinese model [roberta-classical-chinese-large-upos](https://huggingface.co/KoichiYasuoka/roberta-classical-chinese-large-upos)\n* `model=\"th\"` Thai model [roberta-base-thai-spm-upos](https://huggingface.co/KoichiYasuoka/roberta-base-thai-spm-upos)\n* `model=\"vi\"` Vietnamese model [bert-base-vietnamese-upos](https://huggingface.co/KoichiYasuoka/bert-base-vietnamese-upos)\n* `model=\"en\"` English model [roberta-base-english-upos](https://huggingface.co/KoichiYasuoka/roberta-base-english-upos)\n* `model=\"en_large\"` English model [roberta-large-english-upos](https://huggingface.co/KoichiYasuoka/roberta-large-english-upos)\n* `model=\"de\"` German model [bert-base-german-upos](https://huggingface.co/KoichiYasuoka/bert-base-german-upos)\n* `model=\"de_large\"` German model [bert-large-german-upos](https://huggingface.co/KoichiYasuoka/bert-large-german-upos)\n* `model=\"sr\"` Serbian (Cyrillic and Latin) model [gpt2-small-serbian-upos](https://huggingface.co/KoichiYasuoka/gpt2-small-serbian-upos)\n* `model=\"sr_large\"` Serbian (Cyrillic and Latin) model [gpt2-large-serbian-upos](https://huggingface.co/KoichiYasuoka/gpt2-large-serbian-upos)\n* `model=\"cop\"` Coptic model [roberta-base-coptic-upos](https://huggingface.co/KoichiYasuoka/roberta-base-coptic-upos)\n* `model=\"ain\"` Ainu model [roberta-base-ainu-upos](https://huggingface.co/KoichiYasuoka/roberta-base-ainu-upos)\n\n## Installation for Linux\n\n```sh\npip3 install esupar --user\n```\n\n## Installation for Cygwin64\n\nMake sure to get `python37-devel` `python37-pip` `python37-cython` `python37-numpy` `python37-wheel` `gcc-g++` `mingw64-x86_64-gcc-g++` `git` `curl` `make` `cmake`, and then:\n\n```sh\ncurl -L https://raw.githubusercontent.com/KoichiYasuoka/CygTorch/master/installer/supar.sh | sh\npip3.7 install esupar\n```\n\n## Installation for Google Colaboratory\n\n```py\n!pip install esupar\n```\n\nTry [notebook](https://colab.research.google.com/github/KoichiYasuoka/esupar/blob/master/esupar.ipynb).\n\n## Author\n\nKoichi Yasuoka (安岡孝一)\n\n","description_content_type":"text/markdown","docs_url":null,"download_url":null,"downloads":{"last_day":-1,"last_month":-1,"last_week":-1},"dynamic":null,"home_page":"https://github.com/KoichiYasuoka/esupar","keywords":"NLP Japanese Korean Chinese Thai Vietnamese English German Serbian Coptic Ainu","license":"MIT","license_expression":null,"license_files":null,"maintainer":null,"maintainer_email":null,"name":"esupar","package_url":"https://pypi.org/project/esupar/","platform":null,"project_url":"https://pypi.org/project/esupar/","project_urls":{"Homepage":"https://github.com/KoichiYasuoka/esupar","Source":"https://github.com/KoichiYasuoka/esupar","Tracker":"https://github.com/KoichiYasuoka/esupar/issues"},"provides_extra":null,"release_url":"https://pypi.org/project/esupar/1.8.2/","requires_dist":["deplacy>=2.1.0","supar>=1.1.4","transformers>=4.28.0"],"requires_python":">=3.7","summary":"Tokenizer POS-tagger and Dependency-parser with BERT/RoBERTa/DeBERTa models for Japanese and other languages","version":"1.8.2","yanked":false,"yanked_reason":null}

Dependencies of esupar (3).
Dependency	Optional
deplacy	false
supar	false
transformers	false

Package search

esupar

project_urls

Dependencies

All package metadata

Releases