Skip to content

Commit 5c87f13

Browse files
kuarorafacebook-github-bot
authored andcommitted
Add sampling fields to dataset descriptor (facebookresearch#3782)
Summary: Pull Request resolved: facebookresearch#3782 Fields sampling_column and sampling_rate are added to dataset descriptor for supporting sampling in dataset readers. Reviewed By: satymish Differential Revision: D61569067 fbshipit-source-id: e5db9957538b033bbef4b7662154411b9044d1f8
1 parent a43afd6 commit 5c87f13

1 file changed

Lines changed: 5 additions & 0 deletions

File tree

benchs/bench_fw/descriptors.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -80,6 +80,11 @@ class DatasetDescriptor:
8080

8181
embedding_column: Optional[str] = None
8282

83+
sampling_rate: Optional[float] = None
84+
85+
# sampling column for xdb
86+
sampling_column: Optional[str] = None
87+
8388
def __hash__(self):
8489
return hash(self.get_filename())
8590

0 commit comments

Comments
 (0)