Skip to content

Commit 7d7fd40

Browse files
committed
test: recfactor test suits
1 parent 2f67912 commit 7d7fd40

29 files changed

Lines changed: 254 additions & 218 deletions

tests/conftest.py

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
from pathlib import Path
2+
3+
import pytest
4+
5+
from botok import Config, Tokenize, WordTokenizer
6+
7+
8+
@pytest.fixture
9+
def empty_wt():
10+
"""Return empty word tokenizer."""
11+
dialect_pack_path = Path("./tests/data/empty_dialect_pack")
12+
config = Config(dialect_pack_path)
13+
return WordTokenizer(config=config)
14+
15+
16+
@pytest.fixture
17+
def wt():
18+
"""Return default word tokenizer."""
19+
return WordTokenizer()

tests/data/empty_dialect_pack/adjustments/.keep

Whitespace-only changes.

tests/data/empty_dialect_pack/dictionary/.keep

Whitespace-only changes.

tests/trie_data/remove/test.txt renamed to tests/data/trie_dialect_pack/adjustments/remove/test.txt

File renamed without changes.

tests/data/trie_dialect_pack/adjustments/rules/test.tsv

Whitespace-only changes.

tests/trie_data/words/test.tsv renamed to tests/data/trie_dialect_pack/adjustments/words/test.tsv

File renamed without changes.

0 commit comments

Comments
 (0)