Skip to content

[FEATURE] pre-training data pipeline을 개발한다. #1

@seopbo

Description

@seopbo

🚀 Feature

LightningDataModule class를 이용해서 pre-training data pipeline을 개발한다.

Motivation

  • single-node에서 pre-training을 위한 data pipeline 개발

Pitch

Additional context

https://pytorch-lightning.readthedocs.io/en/latest/datamodules.html?highlight=LightningDataModule

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions