Skip to content
Merged
Show file tree
Hide file tree
Changes from 28 commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
07f6ed3
add dcn files.
jiangyzy Mar 24, 2022
8882312
add README.md
jiangyzy Mar 24, 2022
e953d85
update readme.md, requirements.txt, train.sh. pretrained models cover…
jiangyzy Mar 25, 2022
d241dbf
deleted files
jiangyzy Mar 28, 2022
e2d76dd
deleted files
jiangyzy Mar 28, 2022
a632cb5
auto format by CI
oneflow-ci-bot Mar 28, 2022
62b98d0
deleted .gitignore
jiangyzy Mar 28, 2022
543a1bb
deleted .gitignore
jiangyzy Mar 28, 2022
6e3a757
updated files
jiangyzy Mar 28, 2022
68e8e49
modified nn.init.zeros_ and nn.init.xavier_normal_ in crossnet.
jiangyzy Mar 29, 2022
06dfe97
fix change form /scripts/swin_dataloader_compare_speed_with_pytorch.py
jiangyzy Mar 30, 2022
c672dc4
add processing frappe from csv to parqurt format files: tools/frap…
jiangyzy Mar 30, 2022
03c5763
modified frappe download link in README.md
jiangyzy Mar 30, 2022
d9dfd92
delete tools dir
jiangyzy Mar 31, 2022
249b794
add tools dir
jiangyzy Mar 31, 2022
b87dbab
update dcn_graph_train_eval files
jiangyzy Apr 1, 2022
f14901b
Merge branch 'main' of https://github.com/Oneflow-Inc/models into dcn…
jiangyzy Apr 13, 2022
bc1d6d6
update fuxi dcn graph train and eval files , new dataset make tool ba…
jiangyzy Apr 13, 2022
472645f
modified train.sh table_size_array
jiangyzy Apr 13, 2022
91a88a4
fix some erroe in fuxi_data_util when save csv
jiangyzy Apr 14, 2022
900cab4
Merge remote-tracking branch 'origin/dcn_fuxi_train_eval' into main
jiangyzy Apr 18, 2022
09f6501
Criteo dcn related files
jiangyzy Apr 19, 2022
bb364fb
modified README.md
jiangyzy Apr 19, 2022
6d477b8
modified dcn_train_eval.py some arguments name
jiangyzy Apr 20, 2022
3c9201b
create graph when lr_decay
jiangyzy Apr 24, 2022
e987402
deleted fm_persistent
jiangyzy Apr 24, 2022
2e50a5b
update dcn_train_eval.py
jiangyzy Apr 26, 2022
bd77d0f
formated file by
jiangyzy Apr 26, 2022
329f789
new tool dir , and modified dcn_train_eval.py/sh fake path
jiangyzy May 5, 2022
a589398
add feature_map_json argment
jiangyzy May 5, 2022
572d969
delete unnecessary and useless code
jiangyzy May 6, 2022
24fe34d
add cast in make_criteo_parquet.py, modified dcn_train_eval.py
jiangyzy May 12, 2022
d29f5ee
delete useless
jiangyzy May 12, 2022
6297862
add throughput
jiangyzy May 16, 2022
e14f763
Merge branch 'main' of https://github.com/Oneflow-Inc/models into cri…
jiangyzy May 16, 2022
b2dc7d6
add valid test samples arg
jiangyzy May 16, 2022
9bae48b
fix batch_size and train_batch_size mismatched problem
jiangyzy May 16, 2022
1960bd7
delete uesless print code
jiangyzy May 16, 2022
ed02f35
add a blank line in the bottom of dataset_config.yaml
jiangyzy May 17, 2022
8bfb01b
add requirements.txt, update README.md
jiangyzy May 17, 2022
5ea1f41
move loss=loss.numpy() to improve efficiency
jiangyzy May 17, 2022
22a0477
delete fuxi code in dcn_train_eval.py, add scala related files, upda…
jiangyzy May 18, 2022
dd87ca6
update README
jiangyzy May 18, 2022
062680b
remove RecommenderSystems/dcn/tools/make_criteo_parquet.py and Recom…
jiangyzy May 18, 2022
3adeb3b
simplified DNN module, modified test eval process and related READEM…
jiangyzy May 19, 2022
cc9b8c4
add Crossnet fuxi quote, modified directory description in Readme an…
jiangyzy May 19, 2022
1cef2f6
name auc loglogg in eval process as val_auc val_logloss, add pandas …
jiangyzy May 20, 2022
314831f
simplified train.sh and related README contents
jiangyzy May 20, 2022
2bb71e4
simplified L2,3,4 in train.sh
jiangyzy May 20, 2022
b2574fb
set size_factor default=3
jiangyzy May 20, 2022
fffafce
add dcn structure image
jiangyzy May 20, 2022
60f8505
update Crossnet implementation in README
jiangyzy May 21, 2022
b1f9403
update Crossnet implementation in README
jiangyzy May 21, 2022
104127f
update Crossnet implementation in README
jiangyzy May 21, 2022
8eac6b3
update Crossnet implementation in README
jiangyzy May 21, 2022
ee21320
update README
jiangyzy May 23, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions RecommenderSystems/dcn/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
# Deep&Cross
[Deep & Cross Network](https://dl.acm.org/doi/10.1145/3124749.3124754) (DCN) can not only keep the advantages of DNN model, but also learn specific bounded feature crossover more effectively. In particular, DCN can explicitly learn cross features for each layer without the need for manual feature engineering, and the increased algorithm complexity is almost negligible compared with DNN model.


## Directory description
```
.
|-- tools
|-- criteo.py # fuxi data preprofile
|-- csv_2_h5.py # fuxi file used to transform data from csv to h5
|-- dataset_config.yaml # dataset config file
|-- fuxi_features.py # fuxi file
|--
|--criteo1t_parquet.py # Read Criteo1T data and export it as parquet data format
|-- dlrm_train_eval.py # OneFlow DLRM training and evaluation scripts with OneEmbedding module
|-- requirements.txt # python package configuration file
└── README.md # Documentation
```



Loading