torchtext不支持对数据进行拆分

train_path = '../data/match_data/train.csv'
test_path = '../data/match_data/dev.csv'
all_train_data = pd.read_csv(train_path)
train, val = train_test_split(all_train_data, test_size=0.2)
train.to_csv("../data/match_data/split_train.csv", index=False)
val.to_csv("../data/match_data/split_val.csv", index=False)

数据拆分代码见上面代码

你可能感兴趣的:(Pytorch)