components nlp_ner_datapreprocessing

DataPreProcessing for AutoMLNLPNER

nlp_ner_datapreprocessing

Overview

Component to preprocess data for automl nlp ner task

Version: 0.0.1

View in Studio: https://ml.azure.com/registries/azureml/components/nlp_ner_datapreprocessing/version/0.0.1

Inputs

Token Classification task arguments

Name	Description	Type	Default	Optional	Enum
token_key	token key name	string		True
tag_key	tag key name	string		True
batch_size	Number of examples to batch before calling the tokenization function	integer	32	True

Inputs

Name	Description	Type	Default	Optional	Enum
train_file_path	Enter the train file path	uri_file		False
valid_file_path	Enter the validation file path	uri_file		False

Dataset parameters

Name	Description	Type	Default	Optional	Enum
model_selector_output	output folder of model selector containing model metadata like config, checkpoints, tokenizer config	uri_folder		False

Outputs

Name	Description	Type
output_dir	folder to store preprocessed outputs of input data	uri_folder

Environment

azureml://registries/azureml/environments/acft-hf-nlp-gpu/versions/16