Skip to content

Commit

Permalink
Type annotation support for python 3.8
Browse files Browse the repository at this point in the history
  • Loading branch information
I8dNLo committed Sep 24, 2024
1 parent 87e3563 commit b86a94e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion fastembed/sparse/utils/tokenizer.py
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@


class SimpleTokenizer:
def tokenize(text: str) -> list[str]:
def tokenize(text: str) -> List[str]:
text = re.sub(r"[^\w]", " ", text.lower())
text = re.sub(r"\s+", " ", text)

Expand Down

0 comments on commit b86a94e

Please sign in to comment.