Skip to content

Commit 21587e7

Browse files
committed
Adjust multilingual policy
1 parent 6b95e5b commit 21587e7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

Diff for: src/datatrove/pipeline/filters/multilingual_policy_filter.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,7 @@ def __init__(
5959
self.language = language
6060
self.split_paragraph = split_paragraph
6161
self.min_num_sentences = min_num_sentences
62-
self.policy_strings = policy_strings if policy_strings else POLICY_SUBSTRINGS[self.language]
62+
self.policy_strings = policy_strings if policy_strings is not None else POLICY_SUBSTRINGS[self.language]
6363

6464

6565
def filter(self, doc: Document) -> bool | tuple[bool, str]:

0 commit comments

Comments
 (0)